2023-10-08T06:52:43.074 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T06:52:43.074 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414 --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} --name yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi --verbose -- /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/orig.config.yaml 2023-10-08T06:52:43.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T06:52:43.374 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414 branch: main description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} email: yweinste@redhat.com first_in_suite: false job_id: '7417414' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: rhel os_version: '8.6' overrides: admin_socket: branch: main ceph: conf: global: osd_pg_log_dups_tracked: 10000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 9064 sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 sleep_before_teardown: 0 subset: 111/12000 suite: powercycle suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_14:08:36 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T06:52:43.375 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa; will attempt to use it 2023-10-08T06:52:43.375 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa/tasks 2023-10-08T06:52:43.376 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T06:52:43.379 INFO:teuthology.task.internal:Checking packages... 2023-10-08T06:52:43.403 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '9725b08fd801c82987c737f7e6d354878f036ee8' 2023-10-08T06:52:43.403 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T06:52:43.404 INFO:teuthology.packaging:ref: None 2023-10-08T06:52:43.404 INFO:teuthology.packaging:tag: None 2023-10-08T06:52:43.404 INFO:teuthology.packaging:branch: main 2023-10-08T06:52:43.404 INFO:teuthology.packaging:sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:52:43.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2023-10-08T06:52:43.729 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6613.gb05d167b 2023-10-08T06:52:43.729 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T06:52:43.735 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T06:52:43.735 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T06:52:43.741 INFO:teuthology.task.internal:Saving configuration 2023-10-08T06:52:43.754 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T06:52:43.759 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T06:52:43.784 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:47:34.430942', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T06:52:43.807 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:47:34.432359', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T06:52:43.833 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:47:34.433498', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T06:52:43.857 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:47:34.434637', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T06:52:43.857 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T06:52:43.862 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2023-10-08T06:52:43.862 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['osd.0'] 2023-10-08T06:52:43.862 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['osd.1'] 2023-10-08T06:52:43.863 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['osd.2'] 2023-10-08T06:52:43.863 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T06:52:43.998 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbc39d8daf0>, signals=[15]) 2023-10-08T06:52:43.998 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T06:52:44.004 INFO:teuthology.task.internal:Opening connections... 2023-10-08T06:52:44.004 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2023-10-08T06:52:44.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:52:44.074 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2023-10-08T06:52:44.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:52:44.142 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2023-10-08T06:52:44.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:52:44.214 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T06:52:44.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:52:44.281 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T06:52:44.287 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-10-08T06:52:44.310 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-10-08T06:52:44.310 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-10-08T06:52:44.370 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T06:52:44.370 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T06:52:44.371 INFO:teuthology.orchestra.run.smithi017.stdout:ID="rhel" 2023-10-08T06:52:44.371 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="fedora" 2023-10-08T06:52:44.371 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8.6" 2023-10-08T06:52:44.371 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-10-08T06:52:44.371 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T06:52:44.371 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-10-08T06:52:44.371 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T06:52:44.371 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T06:52:44.371 INFO:teuthology.orchestra.run.smithi017.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T06:52:44.372 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T06:52:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T06:52:44.372 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T06:52:44.372 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T06:52:44.372 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T06:52:44.372 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T06:52:44.373 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-10-08T06:52:44.392 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-10-08T06:52:44.413 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-10-08T06:52:44.413 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-10-08T06:52:44.474 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T06:52:44.474 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T06:52:44.474 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2023-10-08T06:52:44.475 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2023-10-08T06:52:44.475 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6" 2023-10-08T06:52:44.475 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-10-08T06:52:44.475 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T06:52:44.475 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-10-08T06:52:44.475 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T06:52:44.475 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T06:52:44.475 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T06:52:44.475 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T06:52:44.475 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T06:52:44.475 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T06:52:44.475 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T06:52:44.476 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T06:52:44.476 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T06:52:44.476 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-10-08T06:52:44.501 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-10-08T06:52:44.520 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-10-08T06:52:44.521 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-10-08T06:52:44.583 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T06:52:44.583 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T06:52:44.583 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-10-08T06:52:44.583 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-10-08T06:52:44.583 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2023-10-08T06:52:44.584 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-10-08T06:52:44.584 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T06:52:44.584 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-10-08T06:52:44.584 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T06:52:44.584 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T06:52:44.584 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T06:52:44.584 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T06:52:44.584 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T06:52:44.584 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T06:52:44.584 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T06:52:44.584 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T06:52:44.584 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T06:52:44.585 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-10-08T06:52:44.609 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-10-08T06:52:44.628 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-10-08T06:52:44.629 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-10-08T06:52:44.688 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T06:52:44.689 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T06:52:44.689 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-10-08T06:52:44.689 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-10-08T06:52:44.689 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6" 2023-10-08T06:52:44.689 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-10-08T06:52:44.689 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T06:52:44.689 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-10-08T06:52:44.689 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T06:52:44.689 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T06:52:44.690 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T06:52:44.690 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T06:52:44.690 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T06:52:44.690 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T06:52:44.690 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T06:52:44.690 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T06:52:44.690 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T06:52:44.690 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-10-08T06:52:44.709 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T06:52:44.718 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T06:52:44.723 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T06:52:44.723 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2023-10-08T06:52:44.725 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2023-10-08T06:52:44.728 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2023-10-08T06:52:44.730 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2023-10-08T06:52:44.748 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T06:52:44.755 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T06:52:44.756 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2023-10-08T06:52:44.785 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2023-10-08T06:52:44.788 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2023-10-08T06:52:44.792 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2023-10-08T06:52:44.820 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T06:52:44.946 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T06:52:44.962 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-08T06:52:44.963 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-08T06:52:44.963 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T06:52:44.964 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T06:52:44.964 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T06:52:44.964 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T06:52:44.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:52:44.984 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2023-10-08T06:52:44.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:52:44.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:52:44.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:52:44.986 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2023-10-08T06:52:44.987 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2023-10-08T06:52:44.987 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2023-10-08T06:52:45.043 INFO:teuthology.orchestra.run.smithi144.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:45.043 INFO:teuthology.task.kernel:Running kernel on smithi144: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:45.043 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum install -y kernel 2023-10-08T06:52:45.046 INFO:teuthology.orchestra.run.smithi033.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:45.046 INFO:teuthology.task.kernel:Running kernel on smithi033: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:45.047 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum install -y kernel 2023-10-08T06:52:45.047 INFO:teuthology.orchestra.run.smithi017.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:45.048 INFO:teuthology.task.kernel:Running kernel on smithi017: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:45.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2023-10-08T06:52:45.049 INFO:teuthology.orchestra.run.smithi086.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:45.049 INFO:teuthology.task.kernel:Running kernel on smithi086: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:45.050 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum install -y kernel 2023-10-08T06:52:46.180 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T06:52:46.180 INFO:teuthology.orchestra.run.smithi144.stdout:Unable to read consumer identity 2023-10-08T06:52:46.299 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2023-10-08T06:52:46.300 INFO:teuthology.orchestra.run.smithi033.stdout:Unable to read consumer identity 2023-10-08T06:52:46.331 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-10-08T06:52:46.332 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2023-10-08T06:52:46.335 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-08T06:52:46.335 INFO:teuthology.orchestra.run.smithi017.stdout:Unable to read consumer identity 2023-10-08T06:52:47.580 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-08T06:52:47.707 INFO:teuthology.orchestra.run.smithi017.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-08T06:52:47.806 INFO:teuthology.orchestra.run.smithi033.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-10-08T06:52:47.873 INFO:teuthology.orchestra.run.smithi086.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-10-08T06:52:48.339 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-08T06:52:48.931 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-10-08T06:52:49.017 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-08T06:52:49.023 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-10-08T06:52:51.847 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 413 kB/s | 24 kB 00:00 2023-10-08T06:52:52.523 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 366 kB/s | 24 kB 00:00 2023-10-08T06:52:52.558 INFO:teuthology.orchestra.run.smithi144.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T06:52:52.611 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-10-08T06:52:52.612 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2023-10-08T06:52:52.612 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-10-08T06:52:52.736 DEBUG:teuthology.orchestra.run.smithi144:> echo no | sudo yum reinstall kernel || true 2023-10-08T06:52:52.757 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 355 kB/s | 24 kB 00:00 2023-10-08T06:52:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 478 kB/s | 24 kB 00:00 2023-10-08T06:52:53.065 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T06:52:53.066 INFO:teuthology.orchestra.run.smithi144.stdout:Unable to read consumer identity 2023-10-08T06:52:53.210 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T06:52:53.263 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2023-10-08T06:52:53.264 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2023-10-08T06:52:53.264 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2023-10-08T06:52:53.333 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 06:52:51 AM UTC. 2023-10-08T06:52:53.373 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:52:53.407 INFO:teuthology.orchestra.run.smithi144.stderr:Error: No packages marked for reinstall. 2023-10-08T06:52:53.409 DEBUG:teuthology.orchestra.run.smithi086:> echo no | sudo yum reinstall kernel || true 2023-10-08T06:52:53.454 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum reinstall -y kernel || true 2023-10-08T06:52:53.492 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T06:52:53.544 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T06:52:53.549 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2023-10-08T06:52:53.550 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2023-10-08T06:52:53.550 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2023-10-08T06:52:53.585 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-10-08T06:52:53.586 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2023-10-08T06:52:53.586 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-10-08T06:52:53.684 DEBUG:teuthology.orchestra.run.smithi033:> echo no | sudo yum reinstall kernel || true 2023-10-08T06:52:53.700 DEBUG:teuthology.orchestra.run.smithi017:> echo no | sudo yum reinstall kernel || true 2023-10-08T06:52:53.743 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-10-08T06:52:53.743 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2023-10-08T06:52:53.782 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T06:52:53.782 INFO:teuthology.orchestra.run.smithi144.stdout:Unable to read consumer identity 2023-10-08T06:52:54.015 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 06:52:52 AM UTC. 2023-10-08T06:52:54.037 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2023-10-08T06:52:54.037 INFO:teuthology.orchestra.run.smithi033.stdout:Unable to read consumer identity 2023-10-08T06:52:54.044 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:00:03 ago on Sun 08 Oct 2023 06:52:51 AM UTC. 2023-10-08T06:52:54.054 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-08T06:52:54.054 INFO:teuthology.orchestra.run.smithi017.stdout:Unable to read consumer identity 2023-10-08T06:52:54.059 INFO:teuthology.orchestra.run.smithi086.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:52:54.084 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:52:54.094 INFO:teuthology.orchestra.run.smithi086.stderr:Error: No packages marked for reinstall. 2023-10-08T06:52:54.110 INFO:teuthology.orchestra.run.smithi144.stderr:Error: No packages marked for reinstall. 2023-10-08T06:52:54.140 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum reinstall -y kernel || true 2023-10-08T06:52:54.156 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T06:52:54.236 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:54.236 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:54.236 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T06:52:54.236 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2023-10-08T06:52:54.236 DEBUG:teuthology.orchestra.run.smithi144:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T06:52:54.270 INFO:teuthology.orchestra.run.smithi144.stdout:ttyS1 2023-10-08T06:52:54.292 DEBUG:teuthology.parallel:result is None 2023-10-08T06:52:54.329 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 06:52:52 AM UTC. 2023-10-08T06:52:54.336 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 06:52:52 AM UTC. 2023-10-08T06:52:54.377 INFO:teuthology.orchestra.run.smithi033.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:52:54.379 INFO:teuthology.orchestra.run.smithi017.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:52:54.408 INFO:teuthology.orchestra.run.smithi033.stderr:Error: No packages marked for reinstall. 2023-10-08T06:52:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:Error: No packages marked for reinstall. 2023-10-08T06:52:54.456 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum reinstall -y kernel || true 2023-10-08T06:52:54.457 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum reinstall -y kernel || true 2023-10-08T06:52:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-10-08T06:52:54.469 INFO:teuthology.orchestra.run.smithi086.stdout:Unable to read consumer identity 2023-10-08T06:52:54.735 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 06:52:52 AM UTC. 2023-10-08T06:52:54.774 INFO:teuthology.orchestra.run.smithi086.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:52:54.803 INFO:teuthology.orchestra.run.smithi086.stderr:Error: No packages marked for reinstall. 2023-10-08T06:52:54.806 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2023-10-08T06:52:54.806 INFO:teuthology.orchestra.run.smithi033.stdout:Unable to read consumer identity 2023-10-08T06:52:54.808 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-08T06:52:54.808 INFO:teuthology.orchestra.run.smithi017.stdout:Unable to read consumer identity 2023-10-08T06:52:54.848 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T06:52:54.928 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:54.928 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:54.928 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T06:52:54.928 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2023-10-08T06:52:54.928 DEBUG:teuthology.orchestra.run.smithi086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T06:52:54.957 INFO:teuthology.orchestra.run.smithi086.stdout:ttyS1 2023-10-08T06:52:54.971 DEBUG:teuthology.parallel:result is None 2023-10-08T06:52:55.082 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:03 ago on Sun 08 Oct 2023 06:52:52 AM UTC. 2023-10-08T06:52:55.095 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:03 ago on Sun 08 Oct 2023 06:52:52 AM UTC. 2023-10-08T06:52:55.123 INFO:teuthology.orchestra.run.smithi033.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:52:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T06:52:55.148 INFO:teuthology.orchestra.run.smithi033.stderr:Error: No packages marked for reinstall. 2023-10-08T06:52:55.166 INFO:teuthology.orchestra.run.smithi017.stderr:Error: No packages marked for reinstall. 2023-10-08T06:52:55.197 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T06:52:55.213 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T06:52:55.280 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:55.281 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:55.281 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T06:52:55.281 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2023-10-08T06:52:55.281 DEBUG:teuthology.orchestra.run.smithi033:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T06:52:55.295 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:55.296 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T06:52:55.296 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T06:52:55.296 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-08T06:52:55.296 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T06:52:55.308 INFO:teuthology.orchestra.run.smithi033.stdout:ttyS1 2023-10-08T06:52:55.322 DEBUG:teuthology.parallel:result is None 2023-10-08T06:52:55.329 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2023-10-08T06:52:55.341 DEBUG:teuthology.parallel:result is None 2023-10-08T06:52:55.341 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T06:52:55.350 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T06:52:55.350 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T06:52:55.383 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T06:52:55.386 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T06:52:55.388 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T06:52:55.408 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T06:52:55.416 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T06:52:55.424 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T06:52:55.425 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T06:52:55.440 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T06:52:55.443 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T06:52:55.446 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T06:52:55.473 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T06:52:55.479 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T06:52:55.480 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T06:52:55.498 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T06:52:55.511 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T06:52:55.513 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T06:52:55.538 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:52:55.544 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:52:55.549 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:52:55.554 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:52:55.560 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:52:55.564 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:52:55.571 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:52:55.574 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T06:52:55.576 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T06:52:55.583 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T06:52:55.583 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T06:52:55.593 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T06:52:55.598 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T06:52:55.600 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T06:52:55.631 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T06:52:55.639 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T06:52:55.640 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T06:52:55.661 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T06:52:55.666 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T06:52:55.668 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T06:52:55.689 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:52:55.760 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:52:55.814 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:52:55.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:52:55.943 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T06:52:55.943 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T06:52:56.030 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:52:56.075 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:52:56.125 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:52:56.208 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:52:56.253 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-08T06:52:56.253 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T06:52:56.337 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:52:56.378 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:52:56.445 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:52:56.491 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:52:56.533 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-08T06:52:56.533 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T06:52:56.612 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:52:56.660 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T06:52:56.721 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:52:56.767 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T06:52:56.810 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T06:52:56.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T06:52:56.880 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2023-10-08T06:52:56.882 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2023-10-08T06:52:56.884 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2023-10-08T06:52:56.886 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2023-10-08T06:52:56.943 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T06:52:56.950 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T06:52:56.958 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T06:52:56.998 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T06:52:57.479 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T06:52:57.487 INFO:teuthology.task.internal:Starting timer... 2023-10-08T06:52:57.487 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T06:52:57.540 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T06:52:57.548 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-08T06:52:57.548 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2023-10-08T06:52:57.615 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2023-10-08T06:52:57.617 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2023-10-08T06:52:57.678 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: 2023-10-08T06:52:57.680 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2023-10-08T06:52:57.731 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: 2023-10-08T06:52:57.733 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2023-10-08T06:52:57.797 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2023-10-08T06:52:57.799 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T06:52:57.799 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2023-10-08T06:52:57.822 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2023-10-08T06:52:57.822 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2023-10-08T06:52:57.850 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2023-10-08T06:52:57.851 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2023-10-08T06:52:57.871 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2023-10-08T06:52:57.871 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2023-10-08T06:52:57.896 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2023-10-08T06:52:57.896 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi086.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive'} 2023-10-08T06:52:57.896 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T06:52:57.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:52:57.925 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T06:52:57.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:52:57.953 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T06:52:57.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:52:57.982 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T06:52:58.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:52:58.010 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T06:52:58.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2023-10-08T06:52:58.039 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2023-10-08T06:52:58.066 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2023-10-08T06:52:58.093 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2023-10-08T06:52:58.122 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T06:52:58.132 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-08T06:52:58.139 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-08T06:52:58.289 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T06:52:58.324 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T06:52:58.325 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi033.front.sepia.ceph.com,smithi086.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T07:02:20.902 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2023-10-08T07:02:20.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-08T07:02:20.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T07:02:20.973 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-10-08T07:02:21.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-08T07:02:21.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-08T07:02:21.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T07:02:21.112 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-10-08T07:02:21.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-08T07:02:21.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-08T07:02:21.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T07:02:21.251 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-10-08T07:02:21.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-08T07:02:21.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-08T07:02:21.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T07:02:21.389 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-10-08T07:02:21.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-08T07:02:21.461 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T07:02:21.471 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T07:02:21.471 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T07:02:21.472 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T07:02:21.474 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T07:02:21.474 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T07:02:21.476 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T07:02:21.476 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T07:02:21.478 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T07:02:21.479 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T07:02:21.509 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T07:02:21.510 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T07:02:21.512 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T07:02:21.526 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T07:02:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T07:02:21.528 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T07:02:21.532 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T07:02:21.547 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T07:02:21.599 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2023-10-08T07:02:21.600 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2023-10-08T07:02:21.604 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2023-10-08T07:02:21.612 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2023-10-08T07:02:21.613 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2023-10-08T07:02:21.617 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2023-10-08T07:02:21.617 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2023-10-08T07:02:21.627 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T07:02:21.628 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T07:02:21.629 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2023-10-08T07:02:21.633 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T07:02:21.641 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T07:02:21.643 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T07:02:21.643 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T07:02:21.648 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T07:02:21.657 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T07:02:21.709 INFO:teuthology.orchestra.run.smithi086.stderr:bash: ntpq: command not found 2023-10-08T07:02:21.713 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T07:02:21.713 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2023-10-08T07:02:21.713 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.713 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.713 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.713 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:bash: ntpq: command not found 2023-10-08T07:02:21.721 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T07:02:21.721 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2023-10-08T07:02:21.721 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.721 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.721 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.722 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.724 INFO:teuthology.orchestra.run.smithi017.stderr:bash: ntpq: command not found 2023-10-08T07:02:21.726 INFO:teuthology.orchestra.run.smithi144.stderr:bash: ntpq: command not found 2023-10-08T07:02:21.728 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T07:02:21.728 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2023-10-08T07:02:21.728 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.728 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.728 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.728 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.729 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T07:02:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-10-08T07:02:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:02:21.731 INFO:teuthology.run_tasks:Running task install... 2023-10-08T07:02:21.739 DEBUG:teuthology.task.install:project ceph 2023-10-08T07:02:21.739 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}} 2023-10-08T07:02:21.740 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'} 2023-10-08T07:02:21.740 INFO:teuthology.task.install:Using flavor: default 2023-10-08T07:02:21.745 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T07:02:21.745 INFO:teuthology.task.install:extra packages: [] 2023-10-08T07:02:21.746 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'tag': None, 'wait_for_package': False} 2023-10-08T07:02:21.746 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T07:02:21.748 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'tag': None, 'wait_for_package': False} 2023-10-08T07:02:21.748 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T07:02:21.749 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'tag': None, 'wait_for_package': False} 2023-10-08T07:02:21.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T07:02:21.750 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'tag': None, 'wait_for_package': False} 2023-10-08T07:02:21.751 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T07:02:21.900 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/ 2023-10-08T07:02:21.900 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6609.g9725b08f 2023-10-08T07:02:21.909 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/ 2023-10-08T07:02:21.909 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6609.g9725b08f 2023-10-08T07:02:21.972 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/ 2023-10-08T07:02:21.972 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6609.g9725b08f 2023-10-08T07:02:21.987 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/ 2023-10-08T07:02:21.987 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6609.g9725b08f 2023-10-08T07:02:22.020 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T07:02:22.020 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-08T07:02:22.020 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T07:02:22.048 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T07:02:22.048 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9725b08fd801c82987c737f7e6d354878f036ee8/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T07:02:22.068 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T07:02:22.069 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T07:02:22.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T07:02:22.077 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T07:02:22.077 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-08T07:02:22.077 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T07:02:22.098 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T07:02:22.101 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9725b08fd801c82987c737f7e6d354878f036ee8/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T07:02:22.106 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T07:02:22.106 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9725b08fd801c82987c737f7e6d354878f036ee8/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T07:02:22.116 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T07:02:22.154 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T07:02:22.154 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:02:22.154 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T07:02:22.167 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T07:02:22.174 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T07:02:22.191 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T07:02:22.191 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9725b08fd801c82987c737f7e6d354878f036ee8/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T07:02:22.195 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T07:02:22.246 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T07:02:22.252 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T07:02:22.260 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2023-10-08T07:02:22.261 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2023-10-08T07:02:22.263 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T07:02:22.313 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2023-10-08T07:02:22.315 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2023-10-08T07:02:22.318 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2023-10-08T07:02:22.320 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2023-10-08T07:02:22.345 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T07:02:22.413 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2023-10-08T07:02:22.415 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2023-10-08T07:02:22.633 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-10-08T07:02:22.686 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T07:02:22.712 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2023-10-08T07:02:22.807 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-08T07:02:22.893 INFO:teuthology.orchestra.run.smithi086.stdout:44 files removed 2023-10-08T07:02:22.936 INFO:teuthology.orchestra.run.smithi144.stdout:44 files removed 2023-10-08T07:02:22.939 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T07:02:22.971 INFO:teuthology.orchestra.run.smithi033.stdout:44 files removed 2023-10-08T07:02:22.983 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T07:02:23.018 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T07:02:23.046 INFO:teuthology.orchestra.run.smithi017.stdout:44 files removed 2023-10-08T07:02:23.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T07:02:23.268 INFO:teuthology.orchestra.run.smithi086.stdout:Updating Subscription Management repositories. 2023-10-08T07:02:23.312 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T07:02:23.369 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2023-10-08T07:02:23.446 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-08T07:02:23.973 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 225 kB/s | 81 kB 00:00 2023-10-08T07:02:24.002 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 308 kB/s | 81 kB 00:00 2023-10-08T07:02:24.015 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 224 kB/s | 81 kB 00:00 2023-10-08T07:02:24.118 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 268 kB/s | 81 kB 00:00 2023-10-08T07:02:24.274 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 41 kB/s | 9.4 kB 00:00 2023-10-08T07:02:24.311 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2023-10-08T07:02:24.332 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-10-08T07:02:24.419 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-10-08T07:02:24.550 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 5.9 kB/s | 1.5 kB 00:00 2023-10-08T07:02:24.620 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 5.2 kB/s | 1.5 kB 00:00 2023-10-08T07:02:24.674 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2023-10-08T07:02:24.692 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-10-08T07:02:24.770 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2023-10-08T07:02:24.787 INFO:teuthology.orchestra.run.smithi033.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-08T07:02:24.800 INFO:teuthology.orchestra.run.smithi086.stdout:Copr repo for python3-asyncssh owned by ceph 33 kB/s | 3.5 kB 00:00 2023-10-08T07:02:24.920 INFO:teuthology.orchestra.run.smithi017.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-08T07:02:25.277 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 28 MB/s | 16 MB 00:00 2023-10-08T07:02:25.955 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-10-08T07:02:26.397 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-10-08T07:02:27.571 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 5.8 MB/s | 16 MB 00:02 2023-10-08T07:02:28.760 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 432 kB/s | 24 kB 00:00 2023-10-08T07:02:29.697 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 609 kB/s | 24 kB 00:00 2023-10-08T07:02:29.703 INFO:teuthology.orchestra.run.smithi144.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-10-08T07:02:29.892 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 309 kB/s | 24 kB 00:00 2023-10-08T07:02:30.615 INFO:teuthology.orchestra.run.smithi017.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-10-08T07:02:30.778 INFO:teuthology.orchestra.run.smithi086.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-10-08T07:02:31.246 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 442 kB/s | 24 kB 00:00 2023-10-08T07:02:32.190 INFO:teuthology.orchestra.run.smithi033.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-10-08T07:02:37.796 INFO:teuthology.orchestra.run.smithi144.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-10-08T07:02:38.678 INFO:teuthology.orchestra.run.smithi086.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-10-08T07:02:39.124 INFO:teuthology.orchestra.run.smithi017.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-10-08T07:02:40.557 INFO:teuthology.orchestra.run.smithi033.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-10-08T07:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T07:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T07:02:49.252 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-10-08T07:02:49.263 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================================================= 2023-10-08T07:02:49.263 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2023-10-08T07:02:49.264 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================================================= 2023-10-08T07:02:49.264 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2023-10-08T07:02:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T07:02:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.4 k 2023-10-08T07:02:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 5.4 M 2023-10-08T07:02:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 918 k 2023-10-08T07:02:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 167 k 2023-10-08T07:02:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 1.6 M 2023-10-08T07:02:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 132 k 2023-10-08T07:02:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 1.8 M 2023-10-08T07:02:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 7.4 M 2023-10-08T07:02:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 47 k 2023-10-08T07:02:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 14 M 2023-10-08T07:02:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 49 M 2023-10-08T07:02:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 261 k 2023-10-08T07:02:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 190 k 2023-10-08T07:02:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T07:02:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T07:02:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T07:02:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 31 k 2023-10-08T07:02:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 839 k 2023-10-08T07:02:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 139 k 2023-10-08T07:02:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T07:02:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T07:02:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T07:02:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 197 k 2023-10-08T07:02:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 371 k 2023-10-08T07:02:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 364 k 2023-10-08T07:02:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 107 k 2023-10-08T07:02:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 94 k 2023-10-08T07:02:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.6 M 2023-10-08T07:02:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 179 k 2023-10-08T07:02:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T07:02:49.266 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2023-10-08T07:02:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T07:02:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T07:02:49.267 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2023-10-08T07:02:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T07:02:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 23 M 2023-10-08T07:02:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 23 k 2023-10-08T07:02:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 2.3 M 2023-10-08T07:02:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 242 k 2023-10-08T07:02:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 4.6 M 2023-10-08T07:02:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 18 M 2023-10-08T07:02:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 15 k 2023-10-08T07:02:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 24 k 2023-10-08T07:02:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T07:02:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T07:02:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T07:02:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T07:02:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T07:02:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 183 k 2023-10-08T07:02:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T07:02:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T07:02:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T07:02:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T07:02:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T07:02:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 518 k 2023-10-08T07:02:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T07:02:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.9 M 2023-10-08T07:02:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T07:02:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T07:02:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T07:02:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T07:02:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T07:02:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T07:02:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T07:02:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T07:02:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T07:02:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T07:02:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T07:02:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T07:02:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T07:02:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T07:02:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T07:02:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T07:02:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 45 k 2023-10-08T07:02:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 125 k 2023-10-08T07:02:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T07:02:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T07:02:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T07:02:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T07:02:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T07:02:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T07:02:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T07:02:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T07:02:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T07:02:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T07:02:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T07:02:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T07:02:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T07:02:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T07:02:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T07:02:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T07:02:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T07:02:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T07:02:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T07:02:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T07:02:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T07:02:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T07:02:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T07:02:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T07:02:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T07:02:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T07:02:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T07:02:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T07:02:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T07:02:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T07:02:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T07:02:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T07:02:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T07:02:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T07:02:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T07:02:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T07:02:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T07:02:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T07:02:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T07:02:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T07:02:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T07:02:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T07:02:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T07:02:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T07:02:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T07:02:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T07:02:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T07:02:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T07:02:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:02:49.275 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-10-08T07:02:49.275 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================================================= 2023-10-08T07:02:49.275 INFO:teuthology.orchestra.run.smithi144.stdout:Install 120 Packages 2023-10-08T07:02:49.275 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 2 Packages 2023-10-08T07:02:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:02:49.276 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 200 M 2023-10-08T07:02:49.276 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-10-08T07:02:49.446 INFO:teuthology.orchestra.run.smithi144.stdout:(1/122): ceph-18.0.0-6609.g9725b08f.el8.x86_64. 51 kB/s | 6.4 kB 00:00 2023-10-08T07:02:49.771 INFO:teuthology.orchestra.run.smithi144.stdout:(2/122): ceph-fuse-18.0.0-6609.g9725b08f.el8.x8 2.8 MB/s | 918 kB 00:00 2023-10-08T07:02:49.776 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T07:02:49.777 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T07:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout:(3/122): ceph-immutable-object-cache-18.0.0-660 2.2 MB/s | 167 kB 00:00 2023-10-08T07:02:49.917 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2023-10-08T07:02:49.928 INFO:teuthology.orchestra.run.smithi086.stdout:======================================================================================================================= 2023-10-08T07:02:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2023-10-08T07:02:49.929 INFO:teuthology.orchestra.run.smithi086.stdout:======================================================================================================================= 2023-10-08T07:02:49.929 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2023-10-08T07:02:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T07:02:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.4 k 2023-10-08T07:02:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 5.4 M 2023-10-08T07:02:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 918 k 2023-10-08T07:02:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 167 k 2023-10-08T07:02:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 1.6 M 2023-10-08T07:02:49.929 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 132 k 2023-10-08T07:02:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 1.8 M 2023-10-08T07:02:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 7.4 M 2023-10-08T07:02:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 47 k 2023-10-08T07:02:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 14 M 2023-10-08T07:02:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 49 M 2023-10-08T07:02:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 261 k 2023-10-08T07:02:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 190 k 2023-10-08T07:02:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T07:02:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T07:02:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T07:02:49.930 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 31 k 2023-10-08T07:02:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 839 k 2023-10-08T07:02:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 139 k 2023-10-08T07:02:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T07:02:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T07:02:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T07:02:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 197 k 2023-10-08T07:02:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 371 k 2023-10-08T07:02:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 364 k 2023-10-08T07:02:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 107 k 2023-10-08T07:02:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 94 k 2023-10-08T07:02:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.6 M 2023-10-08T07:02:49.931 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 179 k 2023-10-08T07:02:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T07:02:49.932 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2023-10-08T07:02:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T07:02:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T07:02:49.932 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2023-10-08T07:02:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T07:02:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 23 M 2023-10-08T07:02:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 23 k 2023-10-08T07:02:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 2.3 M 2023-10-08T07:02:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 242 k 2023-10-08T07:02:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 4.6 M 2023-10-08T07:02:49.932 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 18 M 2023-10-08T07:02:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 15 k 2023-10-08T07:02:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 24 k 2023-10-08T07:02:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T07:02:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T07:02:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T07:02:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T07:02:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T07:02:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 183 k 2023-10-08T07:02:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T07:02:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T07:02:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T07:02:49.933 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T07:02:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T07:02:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 518 k 2023-10-08T07:02:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T07:02:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.9 M 2023-10-08T07:02:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T07:02:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T07:02:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T07:02:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T07:02:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T07:02:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T07:02:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T07:02:49.934 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T07:02:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T07:02:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T07:02:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T07:02:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T07:02:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T07:02:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T07:02:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T07:02:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T07:02:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 45 k 2023-10-08T07:02:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 125 k 2023-10-08T07:02:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T07:02:49.935 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T07:02:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T07:02:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T07:02:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T07:02:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T07:02:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T07:02:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T07:02:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T07:02:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T07:02:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T07:02:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T07:02:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T07:02:49.936 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T07:02:49.937 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T07:02:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T07:02:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T07:02:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T07:02:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T07:02:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T07:02:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T07:02:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T07:02:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T07:02:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T07:02:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T07:02:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T07:02:49.938 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T07:02:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T07:02:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T07:02:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T07:02:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T07:02:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T07:02:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T07:02:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T07:02:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T07:02:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T07:02:49.939 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:02:49.939 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2023-10-08T07:02:49.939 INFO:teuthology.orchestra.run.smithi086.stdout:======================================================================================================================= 2023-10-08T07:02:49.940 INFO:teuthology.orchestra.run.smithi086.stdout:Install 120 Packages 2023-10-08T07:02:49.940 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 2 Packages 2023-10-08T07:02:49.940 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:02:49.940 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 200 M 2023-10-08T07:02:49.940 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2023-10-08T07:02:49.963 INFO:teuthology.orchestra.run.smithi144.stdout:(4/122): ceph-base-18.0.0-6609.g9725b08f.el8.x8 8.4 MB/s | 5.4 MB 00:00 2023-10-08T07:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout:(5/122): ceph-mgr-18.0.0-6609.g9725b08f.el8.x86 7.8 MB/s | 1.6 MB 00:00 2023-10-08T07:02:50.287 INFO:teuthology.orchestra.run.smithi086.stdout:(1/122): ceph-18.0.0-6609.g9725b08f.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-10-08T07:02:50.505 INFO:teuthology.orchestra.run.smithi144.stdout:(6/122): ceph-mds-18.0.0-6609.g9725b08f.el8.x86 3.5 MB/s | 2.3 MB 00:00 2023-10-08T07:02:51.083 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T07:02:51.084 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T07:02:51.131 INFO:teuthology.orchestra.run.smithi144.stdout:(7/122): ceph-common-18.0.0-6609.g9725b08f.el8. 12 MB/s | 23 MB 00:01 2023-10-08T07:02:51.137 INFO:teuthology.orchestra.run.smithi086.stdout:(2/122): ceph-fuse-18.0.0-6609.g9725b08f.el8.x8 1.1 MB/s | 918 kB 00:00 2023-10-08T07:02:51.198 INFO:teuthology.orchestra.run.smithi144.stdout:(8/122): ceph-mon-18.0.0-6609.g9725b08f.el8.x86 4.5 MB/s | 4.6 MB 00:01 2023-10-08T07:02:51.240 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-10-08T07:02:51.253 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================================================= 2023-10-08T07:02:51.253 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2023-10-08T07:02:51.253 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================================================= 2023-10-08T07:02:51.253 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2023-10-08T07:02:51.253 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T07:02:51.253 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.4 k 2023-10-08T07:02:51.253 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 5.4 M 2023-10-08T07:02:51.254 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 918 k 2023-10-08T07:02:51.254 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 167 k 2023-10-08T07:02:51.254 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 1.6 M 2023-10-08T07:02:51.254 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 132 k 2023-10-08T07:02:51.254 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 1.8 M 2023-10-08T07:02:51.254 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 7.4 M 2023-10-08T07:02:51.254 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 47 k 2023-10-08T07:02:51.254 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 14 M 2023-10-08T07:02:51.254 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 49 M 2023-10-08T07:02:51.254 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 261 k 2023-10-08T07:02:51.255 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 190 k 2023-10-08T07:02:51.255 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T07:02:51.255 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T07:02:51.255 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T07:02:51.255 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 31 k 2023-10-08T07:02:51.255 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 839 k 2023-10-08T07:02:51.255 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 139 k 2023-10-08T07:02:51.255 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T07:02:51.255 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T07:02:51.255 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T07:02:51.256 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 197 k 2023-10-08T07:02:51.256 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 371 k 2023-10-08T07:02:51.256 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 364 k 2023-10-08T07:02:51.256 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 107 k 2023-10-08T07:02:51.256 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 94 k 2023-10-08T07:02:51.256 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.6 M 2023-10-08T07:02:51.256 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 179 k 2023-10-08T07:02:51.256 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T07:02:51.256 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2023-10-08T07:02:51.256 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T07:02:51.257 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T07:02:51.257 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2023-10-08T07:02:51.257 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T07:02:51.257 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 23 M 2023-10-08T07:02:51.257 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 23 k 2023-10-08T07:02:51.257 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 2.3 M 2023-10-08T07:02:51.257 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 242 k 2023-10-08T07:02:51.257 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 4.6 M 2023-10-08T07:02:51.257 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 18 M 2023-10-08T07:02:51.257 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 15 k 2023-10-08T07:02:51.257 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 24 k 2023-10-08T07:02:51.258 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T07:02:51.258 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T07:02:51.258 INFO:teuthology.orchestra.run.smithi017.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T07:02:51.258 INFO:teuthology.orchestra.run.smithi017.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T07:02:51.258 INFO:teuthology.orchestra.run.smithi017.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T07:02:51.258 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 183 k 2023-10-08T07:02:51.258 INFO:teuthology.orchestra.run.smithi017.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T07:02:51.258 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T07:02:51.259 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T07:02:51.259 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T07:02:51.259 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T07:02:51.259 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 518 k 2023-10-08T07:02:51.259 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T07:02:51.259 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.9 M 2023-10-08T07:02:51.259 INFO:teuthology.orchestra.run.smithi017.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T07:02:51.259 INFO:teuthology.orchestra.run.smithi017.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T07:02:51.259 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T07:02:51.259 INFO:teuthology.orchestra.run.smithi017.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T07:02:51.259 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T07:02:51.260 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T07:02:51.260 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T07:02:51.260 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T07:02:51.260 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T07:02:51.260 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T07:02:51.260 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T07:02:51.260 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T07:02:51.260 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T07:02:51.260 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T07:02:51.260 INFO:teuthology.orchestra.run.smithi017.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T07:02:51.261 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T07:02:51.261 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 45 k 2023-10-08T07:02:51.261 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 125 k 2023-10-08T07:02:51.261 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T07:02:51.261 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T07:02:51.261 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T07:02:51.261 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T07:02:51.261 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T07:02:51.261 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T07:02:51.261 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T07:02:51.261 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T07:02:51.261 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T07:02:51.262 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T07:02:51.262 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T07:02:51.262 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T07:02:51.262 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T07:02:51.262 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T07:02:51.262 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T07:02:51.262 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T07:02:51.262 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T07:02:51.262 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T07:02:51.262 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T07:02:51.263 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T07:02:51.263 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T07:02:51.263 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T07:02:51.263 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T07:02:51.263 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T07:02:51.263 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T07:02:51.263 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T07:02:51.263 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T07:02:51.263 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T07:02:51.263 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T07:02:51.263 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T07:02:51.264 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T07:02:51.264 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T07:02:51.264 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T07:02:51.264 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T07:02:51.264 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T07:02:51.264 INFO:teuthology.orchestra.run.smithi017.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T07:02:51.264 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T07:02:51.264 INFO:teuthology.orchestra.run.smithi017.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T07:02:51.264 INFO:teuthology.orchestra.run.smithi017.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T07:02:51.264 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T07:02:51.264 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T07:02:51.265 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T07:02:51.265 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T07:02:51.265 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T07:02:51.265 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T07:02:51.265 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T07:02:51.265 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T07:02:51.265 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T07:02:51.265 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:02:51.265 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2023-10-08T07:02:51.265 INFO:teuthology.orchestra.run.smithi017.stdout:======================================================================================================================= 2023-10-08T07:02:51.265 INFO:teuthology.orchestra.run.smithi017.stdout:Install 120 Packages 2023-10-08T07:02:51.266 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 2 Packages 2023-10-08T07:02:51.266 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:02:51.266 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 200 M 2023-10-08T07:02:51.266 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2023-10-08T07:02:51.273 INFO:teuthology.orchestra.run.smithi144.stdout:(9/122): ceph-selinux-18.0.0-6609.g9725b08f.el8 325 kB/s | 24 kB 00:00 2023-10-08T07:02:51.304 INFO:teuthology.orchestra.run.smithi086.stdout:(3/122): ceph-immutable-object-cache-18.0.0-660 1.0 MB/s | 167 kB 00:00 2023-10-08T07:02:51.749 INFO:teuthology.orchestra.run.smithi017.stdout:(1/122): ceph-18.0.0-6609.g9725b08f.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2023-10-08T07:02:52.240 INFO:teuthology.orchestra.run.smithi144.stdout:(10/122): ceph-radosgw-18.0.0-6609.g9725b08f.el 13 MB/s | 14 MB 00:01 2023-10-08T07:02:52.298 INFO:teuthology.orchestra.run.smithi144.stdout:(11/122): libcephfs-devel-18.0.0-6609.g9725b08f 534 kB/s | 31 kB 00:00 2023-10-08T07:02:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:(2/122): ceph-fuse-18.0.0-6609.g9725b08f.el8.x8 1.6 MB/s | 918 kB 00:00 2023-10-08T07:02:52.432 INFO:teuthology.orchestra.run.smithi144.stdout:(12/122): libcephfs2-18.0.0-6609.g9725b08f.el8. 6.1 MB/s | 839 kB 00:00 2023-10-08T07:02:52.441 INFO:teuthology.orchestra.run.smithi017.stdout:(3/122): ceph-immutable-object-cache-18.0.0-660 1.2 MB/s | 167 kB 00:00 2023-10-08T07:02:52.484 INFO:teuthology.orchestra.run.smithi086.stdout:(4/122): ceph-mds-18.0.0-6609.g9725b08f.el8.x86 2.0 MB/s | 2.3 MB 00:01 2023-10-08T07:02:52.499 INFO:teuthology.orchestra.run.smithi144.stdout:(13/122): libcephsqlite-18.0.0-6609.g9725b08f.e 2.7 MB/s | 183 kB 00:00 2023-10-08T07:02:52.515 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T07:02:52.517 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T07:02:52.583 INFO:teuthology.orchestra.run.smithi144.stdout:(14/122): librados-devel-18.0.0-6609.g9725b08f. 1.6 MB/s | 139 kB 00:00 2023-10-08T07:02:52.668 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2023-10-08T07:02:52.680 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================================================= 2023-10-08T07:02:52.680 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2023-10-08T07:02:52.681 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================================================= 2023-10-08T07:02:52.681 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2023-10-08T07:02:52.681 INFO:teuthology.orchestra.run.smithi033.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T07:02:52.681 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.4 k 2023-10-08T07:02:52.681 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 5.4 M 2023-10-08T07:02:52.681 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 918 k 2023-10-08T07:02:52.681 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 167 k 2023-10-08T07:02:52.681 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 1.6 M 2023-10-08T07:02:52.681 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 132 k 2023-10-08T07:02:52.682 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 1.8 M 2023-10-08T07:02:52.682 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 7.4 M 2023-10-08T07:02:52.682 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 47 k 2023-10-08T07:02:52.682 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 14 M 2023-10-08T07:02:52.682 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 49 M 2023-10-08T07:02:52.682 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 261 k 2023-10-08T07:02:52.682 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 190 k 2023-10-08T07:02:52.682 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T07:02:52.682 INFO:teuthology.orchestra.run.smithi033.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T07:02:52.682 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T07:02:52.683 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 31 k 2023-10-08T07:02:52.683 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 839 k 2023-10-08T07:02:52.683 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 139 k 2023-10-08T07:02:52.683 INFO:teuthology.orchestra.run.smithi033.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T07:02:52.683 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T07:02:52.683 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T07:02:52.683 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 197 k 2023-10-08T07:02:52.683 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 371 k 2023-10-08T07:02:52.683 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 364 k 2023-10-08T07:02:52.684 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 107 k 2023-10-08T07:02:52.684 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 94 k 2023-10-08T07:02:52.684 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.6 M 2023-10-08T07:02:52.684 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 179 k 2023-10-08T07:02:52.684 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T07:02:52.684 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2023-10-08T07:02:52.684 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T07:02:52.684 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 3.7 M 2023-10-08T07:02:52.684 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2023-10-08T07:02:52.684 INFO:teuthology.orchestra.run.smithi033.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T07:02:52.685 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 23 M 2023-10-08T07:02:52.685 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 23 k 2023-10-08T07:02:52.685 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 2.3 M 2023-10-08T07:02:52.685 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 242 k 2023-10-08T07:02:52.685 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 4.6 M 2023-10-08T07:02:52.685 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 18 M 2023-10-08T07:02:52.685 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6609.g9725b08f.el8 ceph-noarch 15 k 2023-10-08T07:02:52.685 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 24 k 2023-10-08T07:02:52.685 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T07:02:52.686 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T07:02:52.686 INFO:teuthology.orchestra.run.smithi033.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T07:02:52.686 INFO:teuthology.orchestra.run.smithi033.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T07:02:52.686 INFO:teuthology.orchestra.run.smithi033.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T07:02:52.686 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 183 k 2023-10-08T07:02:52.686 INFO:teuthology.orchestra.run.smithi033.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T07:02:52.686 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T07:02:52.686 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T07:02:52.686 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T07:02:52.687 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T07:02:52.687 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 518 k 2023-10-08T07:02:52.687 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T07:02:52.687 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 6.9 M 2023-10-08T07:02:52.687 INFO:teuthology.orchestra.run.smithi033.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T07:02:52.687 INFO:teuthology.orchestra.run.smithi033.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T07:02:52.687 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T07:02:52.687 INFO:teuthology.orchestra.run.smithi033.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T07:02:52.687 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T07:02:52.687 INFO:teuthology.orchestra.run.smithi033.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T07:02:52.687 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T07:02:52.688 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T07:02:52.688 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T07:02:52.688 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T07:02:52.688 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T07:02:52.688 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T07:02:52.688 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T07:02:52.688 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T07:02:52.688 INFO:teuthology.orchestra.run.smithi033.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T07:02:52.689 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T07:02:52.689 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 45 k 2023-10-08T07:02:52.689 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:18.0.0-6609.g9725b08f.el8 ceph 125 k 2023-10-08T07:02:52.689 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T07:02:52.689 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T07:02:52.689 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T07:02:52.689 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T07:02:52.690 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T07:02:52.690 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T07:02:52.690 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T07:02:52.690 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T07:02:52.690 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T07:02:52.690 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T07:02:52.690 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T07:02:52.690 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T07:02:52.690 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T07:02:52.691 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T07:02:52.691 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T07:02:52.691 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T07:02:52.691 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T07:02:52.691 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T07:02:52.691 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T07:02:52.691 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T07:02:52.691 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T07:02:52.691 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T07:02:52.691 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T07:02:52.692 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T07:02:52.692 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T07:02:52.692 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T07:02:52.692 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T07:02:52.692 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T07:02:52.692 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T07:02:52.692 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T07:02:52.692 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T07:02:52.693 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T07:02:52.693 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T07:02:52.693 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T07:02:52.693 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T07:02:52.693 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T07:02:52.693 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T07:02:52.693 INFO:teuthology.orchestra.run.smithi033.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T07:02:52.693 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T07:02:52.693 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T07:02:52.693 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T07:02:52.694 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T07:02:52.694 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T07:02:52.694 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T07:02:52.694 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T07:02:52.694 INFO:teuthology.orchestra.run.smithi033.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T07:02:52.694 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T07:02:52.694 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T07:02:52.694 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:02:52.694 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2023-10-08T07:02:52.695 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================================================= 2023-10-08T07:02:52.695 INFO:teuthology.orchestra.run.smithi033.stdout:Install 120 Packages 2023-10-08T07:02:52.695 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 2 Packages 2023-10-08T07:02:52.695 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:02:52.695 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 200 M 2023-10-08T07:02:52.696 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2023-10-08T07:02:52.733 INFO:teuthology.orchestra.run.smithi144.stdout:(15/122): libradosstriper1-18.0.0-6609.g9725b08 3.4 MB/s | 518 kB 00:00 2023-10-08T07:02:53.030 INFO:teuthology.orchestra.run.smithi086.stdout:(5/122): ceph-mgr-18.0.0-6609.g9725b08f.el8.x86 3.0 MB/s | 1.6 MB 00:00 2023-10-08T07:02:53.074 INFO:teuthology.orchestra.run.smithi033.stdout:(1/122): ceph-18.0.0-6609.g9725b08f.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-10-08T07:02:53.167 INFO:teuthology.orchestra.run.smithi017.stdout:(4/122): ceph-mds-18.0.0-6609.g9725b08f.el8.x86 3.2 MB/s | 2.3 MB 00:00 2023-10-08T07:02:53.263 INFO:teuthology.orchestra.run.smithi086.stdout:(6/122): ceph-base-18.0.0-6609.g9725b08f.el8.x8 1.7 MB/s | 5.4 MB 00:03 2023-10-08T07:02:53.784 INFO:teuthology.orchestra.run.smithi017.stdout:(5/122): ceph-mgr-18.0.0-6609.g9725b08f.el8.x86 2.6 MB/s | 1.6 MB 00:00 2023-10-08T07:02:53.867 INFO:teuthology.orchestra.run.smithi144.stdout:(16/122): librgw2-18.0.0-6609.g9725b08f.el8.x86 6.1 MB/s | 6.9 MB 00:01 2023-10-08T07:02:53.874 INFO:teuthology.orchestra.run.smithi033.stdout:(2/122): ceph-fuse-18.0.0-6609.g9725b08f.el8.x8 1.1 MB/s | 918 kB 00:00 2023-10-08T07:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout:(17/122): python3-ceph-argparse-18.0.0-6609.g97 539 kB/s | 45 kB 00:00 2023-10-08T07:02:54.024 INFO:teuthology.orchestra.run.smithi033.stdout:(3/122): ceph-immutable-object-cache-18.0.0-660 1.1 MB/s | 167 kB 00:00 2023-10-08T07:02:54.026 INFO:teuthology.orchestra.run.smithi017.stdout:(6/122): ceph-base-18.0.0-6609.g9725b08f.el8.x8 2.1 MB/s | 5.4 MB 00:02 2023-10-08T07:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout:(18/122): python3-ceph-common-18.0.0-6609.g9725 1.5 MB/s | 125 kB 00:00 2023-10-08T07:02:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:(19/122): python3-cephfs-18.0.0-6609.g9725b08f. 1.9 MB/s | 197 kB 00:00 2023-10-08T07:02:54.234 INFO:teuthology.orchestra.run.smithi144.stdout:(20/122): python3-rados-18.0.0-6609.g9725b08f.e 3.6 MB/s | 371 kB 00:00 2023-10-08T07:02:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:(21/122): python3-rbd-18.0.0-6609.g9725b08f.el8 3.6 MB/s | 364 kB 00:00 2023-10-08T07:02:54.438 INFO:teuthology.orchestra.run.smithi086.stdout:(7/122): ceph-mon-18.0.0-6609.g9725b08f.el8.x86 3.3 MB/s | 4.6 MB 00:01 2023-10-08T07:02:54.443 INFO:teuthology.orchestra.run.smithi144.stdout:(22/122): python3-rgw-18.0.0-6609.g9725b08f.el8 983 kB/s | 107 kB 00:00 2023-10-08T07:02:54.544 INFO:teuthology.orchestra.run.smithi144.stdout:(23/122): rbd-fuse-18.0.0-6609.g9725b08f.el8.x8 937 kB/s | 94 kB 00:00 2023-10-08T07:02:55.236 INFO:teuthology.orchestra.run.smithi144.stdout:(24/122): rbd-mirror-18.0.0-6609.g9725b08f.el8. 5.2 MB/s | 3.6 MB 00:00 2023-10-08T07:02:55.283 INFO:teuthology.orchestra.run.smithi033.stdout:(4/122): ceph-mds-18.0.0-6609.g9725b08f.el8.x86 1.8 MB/s | 2.3 MB 00:01 2023-10-08T07:02:55.294 INFO:teuthology.orchestra.run.smithi144.stdout:(25/122): rbd-nbd-18.0.0-6609.g9725b08f.el8.x86 3.0 MB/s | 179 kB 00:00 2023-10-08T07:02:55.301 INFO:teuthology.orchestra.run.smithi017.stdout:(7/122): ceph-mon-18.0.0-6609.g9725b08f.el8.x86 3.0 MB/s | 4.6 MB 00:01 2023-10-08T07:02:55.361 INFO:teuthology.orchestra.run.smithi144.stdout:(26/122): ceph-grafana-dashboards-18.0.0-6609.g 345 kB/s | 23 kB 00:00 2023-10-08T07:02:55.445 INFO:teuthology.orchestra.run.smithi144.stdout:(27/122): ceph-mgr-cephadm-18.0.0-6609.g9725b08 1.5 MB/s | 132 kB 00:00 2023-10-08T07:02:55.837 INFO:teuthology.orchestra.run.smithi144.stdout:(28/122): ceph-mgr-dashboard-18.0.0-6609.g9725b 4.5 MB/s | 1.8 MB 00:00 2023-10-08T07:02:56.217 INFO:teuthology.orchestra.run.smithi033.stdout:(5/122): ceph-mgr-18.0.0-6609.g9725b08f.el8.x86 1.7 MB/s | 1.6 MB 00:00 2023-10-08T07:02:57.270 INFO:teuthology.orchestra.run.smithi144.stdout:(29/122): ceph-mgr-diskprediction-local-18.0.0- 5.2 MB/s | 7.4 MB 00:01 2023-10-08T07:02:57.370 INFO:teuthology.orchestra.run.smithi144.stdout:(30/122): ceph-mgr-modules-core-18.0.0-6609.g97 2.4 MB/s | 242 kB 00:00 2023-10-08T07:02:57.454 INFO:teuthology.orchestra.run.smithi144.stdout:(31/122): ceph-mgr-rook-18.0.0-6609.g9725b08f.e 569 kB/s | 47 kB 00:00 2023-10-08T07:02:57.538 INFO:teuthology.orchestra.run.smithi144.stdout:(32/122): ceph-prometheus-alerts-18.0.0-6609.g9 174 kB/s | 15 kB 00:00 2023-10-08T07:02:57.629 INFO:teuthology.orchestra.run.smithi144.stdout:(33/122): ceph-volume-18.0.0-6609.g9725b08f.el8 2.8 MB/s | 261 kB 00:00 2023-10-08T07:02:57.722 INFO:teuthology.orchestra.run.smithi144.stdout:(34/122): cephadm-18.0.0-6609.g9725b08f.el8.noa 2.0 MB/s | 190 kB 00:00 2023-10-08T07:02:57.947 INFO:teuthology.orchestra.run.smithi144.stdout:(35/122): ceph-osd-18.0.0-6609.g9725b08f.el8.x8 2.4 MB/s | 18 MB 00:07 2023-10-08T07:02:58.097 INFO:teuthology.orchestra.run.smithi144.stdout:(36/122): gperftools-libs-2.7-9.el8.x86_64.rpm 816 kB/s | 306 kB 00:00 2023-10-08T07:02:58.156 INFO:teuthology.orchestra.run.smithi144.stdout:(37/122): liboath-2.6.2-3.el8.x86_64.rpm 282 kB/s | 59 kB 00:00 2023-10-08T07:02:58.181 INFO:teuthology.orchestra.run.smithi144.stdout:(38/122): libunwind-1.3.1-3.el8.x86_64.rpm 898 kB/s | 75 kB 00:00 2023-10-08T07:02:58.331 INFO:teuthology.orchestra.run.smithi144.stdout:(39/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 291 kB/s | 44 kB 00:00 2023-10-08T07:02:58.415 INFO:teuthology.orchestra.run.smithi144.stdout:(40/122): python3-asyncssh-2.7.0-2.el8.noarch.r 1.8 MB/s | 476 kB 00:00 2023-10-08T07:02:58.440 INFO:teuthology.orchestra.run.smithi144.stdout:(41/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-10-08T07:02:58.499 INFO:teuthology.orchestra.run.smithi144.stdout:(42/122): python3-cachetools-3.1.1-4.el8.noarch 395 kB/s | 33 kB 00:00 2023-10-08T07:02:58.533 INFO:teuthology.orchestra.run.smithi144.stdout:(43/122): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2023-10-08T07:02:58.542 INFO:teuthology.orchestra.run.smithi033.stdout:(6/122): ceph-mon-18.0.0-6609.g9725b08f.el8.x86 2.0 MB/s | 4.6 MB 00:02 2023-10-08T07:02:58.600 INFO:teuthology.orchestra.run.smithi144.stdout:(44/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-10-08T07:02:58.700 INFO:teuthology.orchestra.run.smithi144.stdout:(45/122): python3-google-auth-1.1.1-10.el8.noar 813 kB/s | 81 kB 00:00 2023-10-08T07:02:58.775 INFO:teuthology.orchestra.run.smithi144.stdout:(46/122): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-10-08T07:02:58.855 INFO:teuthology.orchestra.run.smithi086.stdout:(8/122): ceph-radosgw-18.0.0-6609.g9725b08f.el8 3.1 MB/s | 14 MB 00:04 2023-10-08T07:02:58.875 INFO:teuthology.orchestra.run.smithi144.stdout:(47/122): python3-jaraco-functools-2.0-4.el8.no 176 kB/s | 18 kB 00:00 2023-10-08T07:02:58.947 INFO:teuthology.orchestra.run.smithi086.stdout:(9/122): ceph-selinux-18.0.0-6609.g9725b08f.el8 267 kB/s | 24 kB 00:00 2023-10-08T07:02:59.067 INFO:teuthology.orchestra.run.smithi144.stdout:(48/122): python3-kubernetes-11.0.0-6.el8.noarc 6.1 MB/s | 1.2 MB 00:00 2023-10-08T07:02:59.093 INFO:teuthology.orchestra.run.smithi144.stdout:(49/122): python3-cherrypy-18.4.0-1.el8.noarch. 687 kB/s | 384 kB 00:00 2023-10-08T07:02:59.184 INFO:teuthology.orchestra.run.smithi033.stdout:(7/122): ceph-base-18.0.0-6609.g9725b08f.el8.x8 861 kB/s | 5.4 MB 00:06 2023-10-08T07:02:59.601 INFO:teuthology.orchestra.run.smithi017.stdout:(8/122): ceph-radosgw-18.0.0-6609.g9725b08f.el8 3.2 MB/s | 14 MB 00:04 2023-10-08T07:02:59.660 INFO:teuthology.orchestra.run.smithi017.stdout:(9/122): ceph-selinux-18.0.0-6609.g9725b08f.el8 421 kB/s | 24 kB 00:00 2023-10-08T07:03:00.035 INFO:teuthology.orchestra.run.smithi144.stdout:(50/122): ceph-test-18.0.0-6609.g9725b08f.el8.x 5.6 MB/s | 49 MB 00:08 2023-10-08T07:03:00.377 INFO:teuthology.orchestra.run.smithi017.stdout:(10/122): ceph-common-18.0.0-6609.g9725b08f.el8 2.5 MB/s | 23 MB 00:08 2023-10-08T07:03:00.435 INFO:teuthology.orchestra.run.smithi017.stdout:(11/122): libcephfs-devel-18.0.0-6609.g9725b08f 535 kB/s | 31 kB 00:00 2023-10-08T07:03:00.552 INFO:teuthology.orchestra.run.smithi144.stdout:(51/122): python3-more-itertools-7.2.0-3.el8.no 40 kB/s | 59 kB 00:01 2023-10-08T07:03:00.627 INFO:teuthology.orchestra.run.smithi144.stdout:(52/122): python3-natsort-7.1.1-2.el8.noarch.rp 102 kB/s | 60 kB 00:00 2023-10-08T07:03:00.694 INFO:teuthology.orchestra.run.smithi144.stdout:(53/122): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-10-08T07:03:00.711 INFO:teuthology.orchestra.run.smithi144.stdout:(54/122): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2023-10-08T07:03:00.719 INFO:teuthology.orchestra.run.smithi017.stdout:(12/122): libcephfs2-18.0.0-6609.g9725b08f.el8. 2.9 MB/s | 839 kB 00:00 2023-10-08T07:03:00.794 INFO:teuthology.orchestra.run.smithi017.stdout:(13/122): libcephsqlite-18.0.0-6609.g9725b08f.e 2.4 MB/s | 183 kB 00:00 2023-10-08T07:03:00.870 INFO:teuthology.orchestra.run.smithi017.stdout:(14/122): librados-devel-18.0.0-6609.g9725b08f. 1.8 MB/s | 139 kB 00:00 2023-10-08T07:03:00.920 INFO:teuthology.orchestra.run.smithi144.stdout:(55/122): python3-repoze-lru-0.7-6.el8.noarch.r 149 kB/s | 34 kB 00:00 2023-10-08T07:03:01.037 INFO:teuthology.orchestra.run.smithi144.stdout:(56/122): python3-rsa-4.9-2.el8.noarch.rpm 551 kB/s | 64 kB 00:00 2023-10-08T07:03:01.053 INFO:teuthology.orchestra.run.smithi017.stdout:(15/122): libradosstriper1-18.0.0-6609.g9725b08 2.8 MB/s | 518 kB 00:00 2023-10-08T07:03:01.137 INFO:teuthology.orchestra.run.smithi144.stdout:(57/122): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2023-10-08T07:03:01.212 INFO:teuthology.orchestra.run.smithi144.stdout:(58/122): python3-singledispatch-3.4.0.3-18.el8 319 kB/s | 24 kB 00:00 2023-10-08T07:03:01.304 INFO:teuthology.orchestra.run.smithi144.stdout:(59/122): python3-tempora-1.14.1-5.el8.noarch.r 319 kB/s | 29 kB 00:00 2023-10-08T07:03:01.479 INFO:teuthology.orchestra.run.smithi144.stdout:(60/122): python3-trustme-0.6.0-4.el8.noarch.rp 157 kB/s | 27 kB 00:00 2023-10-08T07:03:01.579 INFO:teuthology.orchestra.run.smithi144.stdout:(61/122): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-10-08T07:03:01.605 INFO:teuthology.orchestra.run.smithi144.stdout:(62/122): python3-routes-2.4.1-12.el8.noarch.rp 220 kB/s | 196 kB 00:00 2023-10-08T07:03:01.663 INFO:teuthology.orchestra.run.smithi144.stdout:(63/122): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-10-08T07:03:01.700 INFO:teuthology.orchestra.run.smithi033.stdout:(8/122): ceph-common-18.0.0-6609.g9725b08f.el8. 2.5 MB/s | 23 MB 00:08 2023-10-08T07:03:01.713 INFO:teuthology.orchestra.run.smithi144.stdout:(64/122): python3-websocket-client-0.56.0-5.el8 564 kB/s | 61 kB 00:00 2023-10-08T07:03:01.737 INFO:teuthology.orchestra.run.smithi017.stdout:(16/122): ceph-osd-18.0.0-6609.g9725b08f.el8.x8 2.3 MB/s | 18 MB 00:07 2023-10-08T07:03:01.795 INFO:teuthology.orchestra.run.smithi017.stdout:(17/122): python3-ceph-argparse-18.0.0-6609.g97 773 kB/s | 45 kB 00:00 2023-10-08T07:03:01.797 INFO:teuthology.orchestra.run.smithi144.stdout:(65/122): python3-webtest-2.0.33-1.el8.noarch.r 638 kB/s | 85 kB 00:00 2023-10-08T07:03:01.847 INFO:teuthology.orchestra.run.smithi144.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 172 kB/s | 23 kB 00:00 2023-10-08T07:03:01.862 INFO:teuthology.orchestra.run.smithi017.stdout:(18/122): python3-ceph-common-18.0.0-6609.g9725 1.8 MB/s | 125 kB 00:00 2023-10-08T07:03:01.864 INFO:teuthology.orchestra.run.smithi144.stdout:(67/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2023-10-08T07:03:01.887 INFO:teuthology.orchestra.run.smithi033.stdout:(9/122): ceph-selinux-18.0.0-6609.g9725b08f.el8 131 kB/s | 24 kB 00:00 2023-10-08T07:03:01.923 INFO:teuthology.orchestra.run.smithi144.stdout:(68/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 805 kB/s | 47 kB 00:00 2023-10-08T07:03:01.973 INFO:teuthology.orchestra.run.smithi144.stdout:(69/122): libselinux-devel-2.9-5.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2023-10-08T07:03:01.996 INFO:teuthology.orchestra.run.smithi017.stdout:(19/122): python3-cephfs-18.0.0-6609.g9725b08f. 1.4 MB/s | 197 kB 00:00 2023-10-08T07:03:02.024 INFO:teuthology.orchestra.run.smithi144.stdout:(70/122): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-10-08T07:03:02.049 INFO:teuthology.orchestra.run.smithi144.stdout:(71/122): python3-logutils-0.3.5-11.el8.noarch. 16 kB/s | 49 kB 00:02 2023-10-08T07:03:02.066 INFO:teuthology.orchestra.run.smithi144.stdout:(72/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-10-08T07:03:02.125 INFO:teuthology.orchestra.run.smithi144.stdout:(73/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 639 kB/s | 48 kB 00:00 2023-10-08T07:03:02.150 INFO:teuthology.orchestra.run.smithi144.stdout:(74/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-10-08T07:03:02.175 INFO:teuthology.orchestra.run.smithi144.stdout:(75/122): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2023-10-08T07:03:02.192 INFO:teuthology.orchestra.run.smithi144.stdout:(76/122): python3-pycparser-2.14-14.el8.noarch. 2.5 MB/s | 109 kB 00:00 2023-10-08T07:03:02.196 INFO:teuthology.orchestra.run.smithi017.stdout:(20/122): python3-rados-18.0.0-6609.g9725b08f.e 1.8 MB/s | 371 kB 00:00 2023-10-08T07:03:02.234 INFO:teuthology.orchestra.run.smithi144.stdout:(77/122): thrift-0.13.0-2.el8.x86_64.rpm 4.0 MB/s | 1.7 MB 00:00 2023-10-08T07:03:02.259 INFO:teuthology.orchestra.run.smithi144.stdout:(78/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-10-08T07:03:02.293 INFO:teuthology.orchestra.run.smithi144.stdout:(79/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.4 MB/s | 560 kB 00:00 2023-10-08T07:03:02.318 INFO:teuthology.orchestra.run.smithi144.stdout:(80/122): libaio-devel-0.3.112-1.el8.x86_64.rpm 223 kB/s | 19 kB 00:00 2023-10-08T07:03:02.338 INFO:teuthology.orchestra.run.smithi017.stdout:(21/122): python3-rbd-18.0.0-6609.g9725b08f.el8 2.5 MB/s | 364 kB 00:00 2023-10-08T07:03:02.343 INFO:teuthology.orchestra.run.smithi144.stdout:(81/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.9 MB/s | 155 kB 00:00 2023-10-08T07:03:02.369 INFO:teuthology.orchestra.run.smithi144.stdout:(82/122): libverto-devel-0.3.0-5.el8.x86_64.rpm 357 kB/s | 18 kB 00:00 2023-10-08T07:03:02.403 INFO:teuthology.orchestra.run.smithi144.stdout:(83/122): python3-cryptography-3.2.1-5.el8.x86_ 5.0 MB/s | 559 kB 00:00 2023-10-08T07:03:02.413 INFO:teuthology.orchestra.run.smithi017.stdout:(22/122): python3-rgw-18.0.0-6609.g9725b08f.el8 1.4 MB/s | 107 kB 00:00 2023-10-08T07:03:02.436 INFO:teuthology.orchestra.run.smithi144.stdout:(84/122): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-10-08T07:03:02.461 INFO:teuthology.orchestra.run.smithi144.stdout:(85/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-10-08T07:03:02.487 INFO:teuthology.orchestra.run.smithi144.stdout:(86/122): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-10-08T07:03:02.488 INFO:teuthology.orchestra.run.smithi017.stdout:(23/122): rbd-fuse-18.0.0-6609.g9725b08f.el8.x8 1.2 MB/s | 94 kB 00:00 2023-10-08T07:03:02.512 INFO:teuthology.orchestra.run.smithi144.stdout:(87/122): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-08T07:03:02.537 INFO:teuthology.orchestra.run.smithi144.stdout:(88/122): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-08T07:03:02.562 INFO:teuthology.orchestra.run.smithi144.stdout:(89/122): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-08T07:03:02.588 INFO:teuthology.orchestra.run.smithi144.stdout:(90/122): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-08T07:03:02.613 INFO:teuthology.orchestra.run.smithi144.stdout:(91/122): libcom_err-devel-1.45.6-4.el8.x86_64. 768 kB/s | 39 kB 00:00 2023-10-08T07:03:02.672 INFO:teuthology.orchestra.run.smithi144.stdout:(92/122): libgfortran-8.5.0-10.1.el8_6.x86_64.r 7.5 MB/s | 644 kB 00:00 2023-10-08T07:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout:(93/122): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.0 MB/s | 171 kB 00:00 2023-10-08T07:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout:(94/122): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.6 MB/s | 2.3 MB 00:00 2023-10-08T07:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout:(95/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-10-08T07:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout:(96/122): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-08T07:03:02.823 INFO:teuthology.orchestra.run.smithi144.stdout:(97/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-10-08T07:03:02.857 INFO:teuthology.orchestra.run.smithi144.stdout:(98/122): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-08T07:03:02.874 INFO:teuthology.orchestra.run.smithi144.stdout:(99/122): python3-markupsafe-0.23-19.el8.x86_64 768 kB/s | 39 kB 00:00 2023-10-08T07:03:02.889 INFO:teuthology.orchestra.run.smithi017.stdout:(24/122): librgw2-18.0.0-6609.g9725b08f.el8.x86 3.8 MB/s | 6.9 MB 00:01 2023-10-08T07:03:02.916 INFO:teuthology.orchestra.run.smithi144.stdout:(100/122): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-10-08T07:03:02.950 INFO:teuthology.orchestra.run.smithi144.stdout:(101/122): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-10-08T07:03:02.972 INFO:teuthology.orchestra.run.smithi017.stdout:(25/122): rbd-nbd-18.0.0-6609.g9725b08f.el8.x86 2.1 MB/s | 179 kB 00:00 2023-10-08T07:03:02.975 INFO:teuthology.orchestra.run.smithi144.stdout:(102/122): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-08T07:03:03.008 INFO:teuthology.orchestra.run.smithi144.stdout:(103/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-10-08T07:03:03.039 INFO:teuthology.orchestra.run.smithi017.stdout:(26/122): ceph-grafana-dashboards-18.0.0-6609.g 347 kB/s | 23 kB 00:00 2023-10-08T07:03:03.042 INFO:teuthology.orchestra.run.smithi144.stdout:(104/122): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-10-08T07:03:03.084 INFO:teuthology.orchestra.run.smithi144.stdout:(105/122): python3-jsonpatch-1.21-2.el8.noarch. 638 kB/s | 27 kB 00:00 2023-10-08T07:03:03.142 INFO:teuthology.orchestra.run.smithi144.stdout:(106/122): flex-2.6.1-9.el8.x86_64.rpm 5.4 MB/s | 320 kB 00:00 2023-10-08T07:03:03.156 INFO:teuthology.orchestra.run.smithi086.stdout:(10/122): ceph-osd-18.0.0-6609.g9725b08f.el8.x8 1.8 MB/s | 18 MB 00:09 2023-10-08T07:03:03.181 INFO:teuthology.orchestra.run.smithi017.stdout:(27/122): ceph-mgr-cephadm-18.0.0-6609.g9725b08 933 kB/s | 132 kB 00:00 2023-10-08T07:03:03.209 INFO:teuthology.orchestra.run.smithi144.stdout:(107/122): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-10-08T07:03:03.235 INFO:teuthology.orchestra.run.smithi144.stdout:(108/122): python3-prettytable-0.7.2-14.el8.noa 479 kB/s | 44 kB 00:00 2023-10-08T07:03:03.293 INFO:teuthology.orchestra.run.smithi144.stdout:(109/122): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-10-08T07:03:03.435 INFO:teuthology.orchestra.run.smithi144.stdout:(110/122): python3-scipy-1.0.0-21.module+el8.5. 18 MB/s | 14 MB 00:00 2023-10-08T07:03:03.439 INFO:teuthology.orchestra.run.smithi086.stdout:(11/122): libcephfs-devel-18.0.0-6609.g9725b08f 109 kB/s | 31 kB 00:00 2023-10-08T07:03:03.460 INFO:teuthology.orchestra.run.smithi144.stdout:(111/122): python3-numpy-f2py-1.14.3-10.el8.x86 1.3 MB/s | 225 kB 00:00 2023-10-08T07:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout:(112/122): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-10-08T07:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout:(113/122): python3-jsonpointer-1.10-11.el8.noar 398 kB/s | 20 kB 00:00 2023-10-08T07:03:03.536 INFO:teuthology.orchestra.run.smithi144.stdout:(114/122): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-10-08T07:03:03.604 INFO:teuthology.orchestra.run.smithi144.stdout:(115/122): python3-numpy-1.14.3-10.el8.x86_64.r 9.5 MB/s | 3.7 MB 00:00 2023-10-08T07:03:03.607 INFO:teuthology.orchestra.run.smithi017.stdout:(28/122): rbd-mirror-18.0.0-6609.g9725b08f.el8. 3.2 MB/s | 3.6 MB 00:01 2023-10-08T07:03:03.637 INFO:teuthology.orchestra.run.smithi144.stdout:(116/122): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2023-10-08T07:03:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:(29/122): ceph-mgr-dashboard-18.0.0-6609.g9725b 3.6 MB/s | 1.8 MB 00:00 2023-10-08T07:03:03.687 INFO:teuthology.orchestra.run.smithi144.stdout:(117/122): jq-1.6-3.el8.x86_64.rpm 4.0 MB/s | 202 kB 00:00 2023-10-08T07:03:03.701 INFO:teuthology.orchestra.run.smithi033.stdout:(10/122): ceph-osd-18.0.0-6609.g9725b08f.el8.x8 3.5 MB/s | 18 MB 00:05 2023-10-08T07:03:03.737 INFO:teuthology.orchestra.run.smithi144.stdout:(118/122): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-10-08T07:03:03.791 INFO:teuthology.orchestra.run.smithi017.stdout:(30/122): ceph-mgr-modules-core-18.0.0-6609.g97 1.9 MB/s | 242 kB 00:00 2023-10-08T07:03:03.801 INFO:teuthology.orchestra.run.smithi033.stdout:(11/122): libcephfs-devel-18.0.0-6609.g9725b08f 311 kB/s | 31 kB 00:00 2023-10-08T07:03:03.804 INFO:teuthology.orchestra.run.smithi144.stdout:(119/122): openblas-threads-0.3.15-3.el8.x86_64 18 MB/s | 4.9 MB 00:00 2023-10-08T07:03:03.849 INFO:teuthology.orchestra.run.smithi017.stdout:(31/122): ceph-mgr-rook-18.0.0-6609.g9725b08f.e 814 kB/s | 47 kB 00:00 2023-10-08T07:03:03.871 INFO:teuthology.orchestra.run.smithi144.stdout:(120/122): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-08T07:03:03.881 INFO:teuthology.orchestra.run.smithi086.stdout:(12/122): libcephfs2-18.0.0-6609.g9725b08f.el8. 1.9 MB/s | 839 kB 00:00 2023-10-08T07:03:03.924 INFO:teuthology.orchestra.run.smithi017.stdout:(32/122): ceph-prometheus-alerts-18.0.0-6609.g9 193 kB/s | 15 kB 00:00 2023-10-08T07:03:03.981 INFO:teuthology.orchestra.run.smithi086.stdout:(13/122): libcephsqlite-18.0.0-6609.g9725b08f.e 1.8 MB/s | 183 kB 00:00 2023-10-08T07:03:04.077 INFO:teuthology.orchestra.run.smithi033.stdout:(12/122): libcephfs2-18.0.0-6609.g9725b08f.el8. 3.0 MB/s | 839 kB 00:00 2023-10-08T07:03:04.100 INFO:teuthology.orchestra.run.smithi017.stdout:(33/122): ceph-volume-18.0.0-6609.g9725b08f.el8 1.5 MB/s | 261 kB 00:00 2023-10-08T07:03:04.106 INFO:teuthology.orchestra.run.smithi086.stdout:(14/122): librados-devel-18.0.0-6609.g9725b08f. 1.1 MB/s | 139 kB 00:00 2023-10-08T07:03:04.160 INFO:teuthology.orchestra.run.smithi033.stdout:(13/122): libcephsqlite-18.0.0-6609.g9725b08f.e 2.2 MB/s | 183 kB 00:00 2023-10-08T07:03:04.209 INFO:teuthology.orchestra.run.smithi017.stdout:(34/122): cephadm-18.0.0-6609.g9725b08f.el8.noa 1.7 MB/s | 190 kB 00:00 2023-10-08T07:03:04.351 INFO:teuthology.orchestra.run.smithi017.stdout:(35/122): gperftools-libs-2.7-9.el8.x86_64.rpm 2.1 MB/s | 306 kB 00:00 2023-10-08T07:03:04.382 INFO:teuthology.orchestra.run.smithi086.stdout:(15/122): libradosstriper1-18.0.0-6609.g9725b08 1.8 MB/s | 518 kB 00:00 2023-10-08T07:03:04.392 INFO:teuthology.orchestra.run.smithi017.stdout:(36/122): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-10-08T07:03:04.451 INFO:teuthology.orchestra.run.smithi017.stdout:(37/122): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-10-08T07:03:04.518 INFO:teuthology.orchestra.run.smithi017.stdout:(38/122): python3-asyncssh-2.7.0-2.el8.noarch.r 7.0 MB/s | 476 kB 00:00 2023-10-08T07:03:04.552 INFO:teuthology.orchestra.run.smithi017.stdout:(39/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.3 MB/s | 44 kB 00:00 2023-10-08T07:03:04.594 INFO:teuthology.orchestra.run.smithi017.stdout:(40/122): python3-beautifulsoup4-4.6.3-2.el8.1. 4.4 MB/s | 185 kB 00:00 2023-10-08T07:03:04.627 INFO:teuthology.orchestra.run.smithi017.stdout:(41/122): python3-cachetools-3.1.1-4.el8.noarch 997 kB/s | 33 kB 00:00 2023-10-08T07:03:04.661 INFO:teuthology.orchestra.run.smithi017.stdout:(42/122): python3-certifi-2018.10.15-7.el8.noar 489 kB/s | 16 kB 00:00 2023-10-08T07:03:04.680 INFO:teuthology.orchestra.run.smithi144.stdout:(121/122): librbd1-18.0.0-6609.g9725b08f.el8.x8 4.2 MB/s | 3.7 MB 00:00 2023-10-08T07:03:04.703 INFO:teuthology.orchestra.run.smithi017.stdout:(43/122): python3-cheroot-8.5.2-1.el8.noarch.rp 4.0 MB/s | 173 kB 00:00 2023-10-08T07:03:04.753 INFO:teuthology.orchestra.run.smithi017.stdout:(44/122): python3-cherrypy-18.4.0-1.el8.noarch. 7.5 MB/s | 384 kB 00:00 2023-10-08T07:03:04.757 INFO:teuthology.orchestra.run.smithi086.stdout:(16/122): ceph-common-18.0.0-6609.g9725b08f.el8 1.5 MB/s | 23 MB 00:14 2023-10-08T07:03:04.760 INFO:teuthology.orchestra.run.smithi033.stdout:(14/122): librados-devel-18.0.0-6609.g9725b08f. 231 kB/s | 139 kB 00:00 2023-10-08T07:03:04.787 INFO:teuthology.orchestra.run.smithi017.stdout:(45/122): python3-google-auth-1.1.1-10.el8.noar 2.4 MB/s | 81 kB 00:00 2023-10-08T07:03:04.829 INFO:teuthology.orchestra.run.smithi017.stdout:(46/122): python3-jaraco-6.2-6.el8.noarch.rpm 266 kB/s | 11 kB 00:00 2023-10-08T07:03:04.832 INFO:teuthology.orchestra.run.smithi086.stdout:(17/122): python3-ceph-argparse-18.0.0-6609.g97 599 kB/s | 45 kB 00:00 2023-10-08T07:03:04.879 INFO:teuthology.orchestra.run.smithi017.stdout:(47/122): python3-jaraco-functools-2.0-4.el8.no 352 kB/s | 18 kB 00:00 2023-10-08T07:03:04.946 INFO:teuthology.orchestra.run.smithi017.stdout:(48/122): python3-kubernetes-11.0.0-6.el8.noarc 18 MB/s | 1.2 MB 00:00 2023-10-08T07:03:04.982 INFO:teuthology.orchestra.run.smithi086.stdout:(18/122): python3-ceph-common-18.0.0-6609.g9725 838 kB/s | 125 kB 00:00 2023-10-08T07:03:04.989 INFO:teuthology.orchestra.run.smithi017.stdout:(49/122): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2023-10-08T07:03:05.030 INFO:teuthology.orchestra.run.smithi017.stdout:(50/122): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2023-10-08T07:03:05.072 INFO:teuthology.orchestra.run.smithi017.stdout:(51/122): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-10-08T07:03:05.114 INFO:teuthology.orchestra.run.smithi017.stdout:(52/122): python3-pecan-1.3.2-9.el8.noarch.rpm 6.7 MB/s | 283 kB 00:00 2023-10-08T07:03:05.133 INFO:teuthology.orchestra.run.smithi086.stdout:(19/122): python3-cephfs-18.0.0-6609.g9725b08f. 1.3 MB/s | 197 kB 00:00 2023-10-08T07:03:05.157 INFO:teuthology.orchestra.run.smithi017.stdout:(53/122): python3-portend-2.6-1.el8.noarch.rpm 375 kB/s | 16 kB 00:00 2023-10-08T07:03:05.198 INFO:teuthology.orchestra.run.smithi017.stdout:(54/122): python3-repoze-lru-0.7-6.el8.noarch.r 806 kB/s | 34 kB 00:00 2023-10-08T07:03:05.240 INFO:teuthology.orchestra.run.smithi017.stdout:(55/122): python3-routes-2.4.1-12.el8.noarch.rp 4.6 MB/s | 196 kB 00:00 2023-10-08T07:03:05.273 INFO:teuthology.orchestra.run.smithi017.stdout:(56/122): python3-rsa-4.9-2.el8.noarch.rpm 1.9 MB/s | 64 kB 00:00 2023-10-08T07:03:05.308 INFO:teuthology.orchestra.run.smithi086.stdout:(20/122): python3-rados-18.0.0-6609.g9725b08f.e 2.1 MB/s | 371 kB 00:00 2023-10-08T07:03:05.315 INFO:teuthology.orchestra.run.smithi017.stdout:(57/122): python3-simplegeneric-0.8.1-17.el8.no 452 kB/s | 19 kB 00:00 2023-10-08T07:03:05.352 INFO:teuthology.orchestra.run.smithi033.stdout:(15/122): libradosstriper1-18.0.0-6609.g9725b08 876 kB/s | 518 kB 00:00 2023-10-08T07:03:05.357 INFO:teuthology.orchestra.run.smithi017.stdout:(58/122): python3-singledispatch-3.4.0.3-18.el8 575 kB/s | 24 kB 00:00 2023-10-08T07:03:05.399 INFO:teuthology.orchestra.run.smithi017.stdout:(59/122): python3-tempora-1.14.1-5.el8.noarch.r 701 kB/s | 29 kB 00:00 2023-10-08T07:03:05.441 INFO:teuthology.orchestra.run.smithi017.stdout:(60/122): python3-trustme-0.6.0-4.el8.noarch.rp 664 kB/s | 27 kB 00:00 2023-10-08T07:03:05.475 INFO:teuthology.orchestra.run.smithi086.stdout:(21/122): python3-rbd-18.0.0-6609.g9725b08f.el8 2.1 MB/s | 364 kB 00:00 2023-10-08T07:03:05.483 INFO:teuthology.orchestra.run.smithi017.stdout:(61/122): python3-waitress-1.4.3-1.el8.noarch.r 6.0 MB/s | 255 kB 00:00 2023-10-08T07:03:05.525 INFO:teuthology.orchestra.run.smithi017.stdout:(62/122): python3-webob-1.8.5-1.el8.1.noarch.rp 5.9 MB/s | 251 kB 00:00 2023-10-08T07:03:05.530 INFO:teuthology.orchestra.run.smithi144.stdout:(122/122): librados2-18.0.0-6609.g9725b08f.el8. 2.1 MB/s | 3.7 MB 00:01 2023-10-08T07:03:05.532 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-10-08T07:03:05.533 INFO:teuthology.orchestra.run.smithi144.stdout:Total 12 MB/s | 200 MB 00:16 2023-10-08T07:03:05.550 INFO:teuthology.orchestra.run.smithi086.stdout:(22/122): python3-rgw-18.0.0-6609.g9725b08f.el8 1.4 MB/s | 107 kB 00:00 2023-10-08T07:03:05.567 INFO:teuthology.orchestra.run.smithi017.stdout:(63/122): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2023-10-08T07:03:05.569 INFO:teuthology.orchestra.run.smithi033.stdout:(16/122): ceph-radosgw-18.0.0-6609.g9725b08f.el 2.2 MB/s | 14 MB 00:06 2023-10-08T07:03:05.610 INFO:teuthology.orchestra.run.smithi017.stdout:(64/122): python3-webtest-2.0.33-1.el8.noarch.r 2.0 MB/s | 85 kB 00:00 2023-10-08T07:03:05.625 INFO:teuthology.orchestra.run.smithi086.stdout:(23/122): rbd-fuse-18.0.0-6609.g9725b08f.el8.x8 1.2 MB/s | 94 kB 00:00 2023-10-08T07:03:05.651 INFO:teuthology.orchestra.run.smithi017.stdout:(65/122): python3-zc-lockfile-2.0-2.el8.noarch. 554 kB/s | 23 kB 00:00 2023-10-08T07:03:05.681 INFO:teuthology.orchestra.run.smithi033.stdout:(17/122): python3-ceph-argparse-18.0.0-6609.g97 399 kB/s | 45 kB 00:00 2023-10-08T07:03:05.726 INFO:teuthology.orchestra.run.smithi017.stdout:(66/122): thrift-0.13.0-2.el8.x86_64.rpm 23 MB/s | 1.7 MB 00:00 2023-10-08T07:03:05.752 INFO:teuthology.orchestra.run.smithi017.stdout:(67/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-08T07:03:05.769 INFO:teuthology.orchestra.run.smithi033.stdout:(18/122): python3-ceph-common-18.0.0-6609.g9725 1.4 MB/s | 125 kB 00:00 2023-10-08T07:03:05.870 INFO:teuthology.orchestra.run.smithi033.stdout:(19/122): python3-cephfs-18.0.0-6609.g9725b08f. 1.9 MB/s | 197 kB 00:00 2023-10-08T07:03:06.045 INFO:teuthology.orchestra.run.smithi033.stdout:(20/122): python3-rados-18.0.0-6609.g9725b08f.e 2.1 MB/s | 371 kB 00:00 2023-10-08T07:03:06.069 INFO:teuthology.orchestra.run.smithi017.stdout:(68/122): python3-scipy-1.0.0-21.module+el8.5.0 43 MB/s | 14 MB 00:00 2023-10-08T07:03:06.161 INFO:teuthology.orchestra.run.smithi017.stdout:(69/122): ceph-mgr-diskprediction-local-18.0.0- 2.9 MB/s | 7.4 MB 00:02 2023-10-08T07:03:06.186 INFO:teuthology.orchestra.run.smithi017.stdout:(70/122): python3-pyasn1-modules-0.3.7-6.el8.no 945 kB/s | 110 kB 00:00 2023-10-08T07:03:06.195 INFO:teuthology.orchestra.run.smithi033.stdout:(21/122): python3-rbd-18.0.0-6609.g9725b08f.el8 2.4 MB/s | 364 kB 00:00 2023-10-08T07:03:06.228 INFO:teuthology.orchestra.run.smithi017.stdout:(71/122): python3-pytz-2017.2-9.el8.noarch.rpm 812 kB/s | 54 kB 00:00 2023-10-08T07:03:06.253 INFO:teuthology.orchestra.run.smithi017.stdout:(72/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-10-08T07:03:06.260 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-10-08T07:03:06.287 INFO:teuthology.orchestra.run.smithi017.stdout:(73/122): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-08T07:03:06.287 INFO:teuthology.orchestra.run.smithi033.stdout:(22/122): python3-rgw-18.0.0-6609.g9725b08f.el8 1.1 MB/s | 107 kB 00:00 2023-10-08T07:03:06.304 INFO:teuthology.orchestra.run.smithi017.stdout:(74/122): python3-markupsafe-0.23-19.el8.x86_64 773 kB/s | 39 kB 00:00 2023-10-08T07:03:06.346 INFO:teuthology.orchestra.run.smithi017.stdout:(75/122): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-10-08T07:03:06.371 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-10-08T07:03:06.372 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-10-08T07:03:06.379 INFO:teuthology.orchestra.run.smithi033.stdout:(23/122): rbd-fuse-18.0.0-6609.g9725b08f.el8.x8 1.0 MB/s | 94 kB 00:00 2023-10-08T07:03:06.379 INFO:teuthology.orchestra.run.smithi017.stdout:(76/122): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2023-10-08T07:03:06.405 INFO:teuthology.orchestra.run.smithi017.stdout:(77/122): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-08T07:03:06.426 INFO:teuthology.orchestra.run.smithi086.stdout:(24/122): librgw2-18.0.0-6609.g9725b08f.el8.x86 3.4 MB/s | 6.9 MB 00:02 2023-10-08T07:03:06.430 INFO:teuthology.orchestra.run.smithi017.stdout:(78/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-08T07:03:06.464 INFO:teuthology.orchestra.run.smithi017.stdout:(79/122): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-08T07:03:06.506 INFO:teuthology.orchestra.run.smithi017.stdout:(80/122): python3-jsonpatch-1.21-2.el8.noarch.r 638 kB/s | 27 kB 00:00 2023-10-08T07:03:06.526 INFO:teuthology.orchestra.run.smithi086.stdout:(25/122): rbd-nbd-18.0.0-6609.g9725b08f.el8.x86 1.8 MB/s | 179 kB 00:00 2023-10-08T07:03:06.548 INFO:teuthology.orchestra.run.smithi017.stdout:(81/122): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-08T07:03:06.581 INFO:teuthology.orchestra.run.smithi017.stdout:(82/122): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-10-08T07:03:06.626 INFO:teuthology.orchestra.run.smithi086.stdout:(26/122): ceph-grafana-dashboards-18.0.0-6609.g 230 kB/s | 23 kB 00:00 2023-10-08T07:03:06.656 INFO:teuthology.orchestra.run.smithi017.stdout:(83/122): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-10-08T07:03:06.676 INFO:teuthology.orchestra.run.smithi086.stdout:(27/122): rbd-mirror-18.0.0-6609.g9725b08f.el8. 3.4 MB/s | 3.6 MB 00:01 2023-10-08T07:03:06.698 INFO:teuthology.orchestra.run.smithi017.stdout:(84/122): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-10-08T07:03:06.702 INFO:teuthology.orchestra.run.smithi086.stdout:(28/122): ceph-mgr-cephadm-18.0.0-6609.g9725b08 1.7 MB/s | 132 kB 00:00 2023-10-08T07:03:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:(85/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-08T07:03:06.824 INFO:teuthology.orchestra.run.smithi017.stdout:(86/122): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-10-08T07:03:06.849 INFO:teuthology.orchestra.run.smithi017.stdout:(87/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-10-08T07:03:06.874 INFO:teuthology.orchestra.run.smithi017.stdout:(88/122): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-10-08T07:03:06.891 INFO:teuthology.orchestra.run.smithi017.stdout:(89/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-10-08T07:03:06.925 INFO:teuthology.orchestra.run.smithi017.stdout:(90/122): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-10-08T07:03:07.051 INFO:teuthology.orchestra.run.smithi017.stdout:(91/122): openblas-threads-0.3.15-3.el8.x86_64. 31 MB/s | 4.9 MB 00:00 2023-10-08T07:03:07.126 INFO:teuthology.orchestra.run.smithi017.stdout:(92/122): openblas-0.3.15-3.el8.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2023-10-08T07:03:07.151 INFO:teuthology.orchestra.run.smithi017.stdout:(93/122): jq-1.6-3.el8.x86_64.rpm 2.0 MB/s | 202 kB 00:00 2023-10-08T07:03:07.176 INFO:teuthology.orchestra.run.smithi017.stdout:(94/122): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-10-08T07:03:07.202 INFO:teuthology.orchestra.run.smithi017.stdout:(95/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 929 kB/s | 47 kB 00:00 2023-10-08T07:03:07.229 INFO:teuthology.orchestra.run.smithi017.stdout:(96/122): libselinux-devel-2.9-5.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2023-10-08T07:03:07.235 INFO:teuthology.orchestra.run.smithi086.stdout:(29/122): ceph-mgr-dashboard-18.0.0-6609.g9725b 3.2 MB/s | 1.8 MB 00:00 2023-10-08T07:03:07.252 INFO:teuthology.orchestra.run.smithi017.stdout:(97/122): python3-jwt-1.6.1-2.el8.noarch.rpm 847 kB/s | 43 kB 00:00 2023-10-08T07:03:07.277 INFO:teuthology.orchestra.run.smithi017.stdout:(98/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-08T07:03:07.303 INFO:teuthology.orchestra.run.smithi017.stdout:(99/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 958 kB/s | 48 kB 00:00 2023-10-08T07:03:07.328 INFO:teuthology.orchestra.run.smithi017.stdout:(100/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-08T07:03:07.353 INFO:teuthology.orchestra.run.smithi017.stdout:(101/122): python3-requests-oauthlib-1.0.0-1.el 847 kB/s | 43 kB 00:00 2023-10-08T07:03:07.360 INFO:teuthology.orchestra.run.smithi086.stdout:(30/122): ceph-mgr-modules-core-18.0.0-6609.g97 1.9 MB/s | 242 kB 00:00 2023-10-08T07:03:07.370 INFO:teuthology.orchestra.run.smithi017.stdout:(102/122): python3-pycparser-2.14-14.el8.noarch 2.5 MB/s | 109 kB 00:00 2023-10-08T07:03:07.395 INFO:teuthology.orchestra.run.smithi017.stdout:(103/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2023-10-08T07:03:07.416 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-10-08T07:03:07.419 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-10-08T07:03:07.429 INFO:teuthology.orchestra.run.smithi017.stdout:(104/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-10-08T07:03:07.446 INFO:teuthology.orchestra.run.smithi017.stdout:(105/122): libaio-devel-0.3.112-1.el8.x86_64.rp 371 kB/s | 19 kB 00:00 2023-10-08T07:03:07.453 INFO:teuthology.orchestra.run.smithi086.stdout:(31/122): ceph-mgr-rook-18.0.0-6609.g9725b08f.e 517 kB/s | 47 kB 00:00 2023-10-08T07:03:07.471 INFO:teuthology.orchestra.run.smithi017.stdout:(106/122): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-10-08T07:03:07.505 INFO:teuthology.orchestra.run.smithi017.stdout:(107/122): python3-cryptography-3.2.1-5.el8.x86 9.3 MB/s | 559 kB 00:00 2023-10-08T07:03:07.522 INFO:teuthology.orchestra.run.smithi017.stdout:(108/122): libverto-devel-0.3.0-5.el8.x86_64.rp 357 kB/s | 18 kB 00:00 2023-10-08T07:03:07.553 INFO:teuthology.orchestra.run.smithi086.stdout:(32/122): ceph-prometheus-alerts-18.0.0-6609.g9 145 kB/s | 15 kB 00:00 2023-10-08T07:03:07.554 INFO:teuthology.orchestra.run.smithi033.stdout:(24/122): rbd-mirror-18.0.0-6609.g9725b08f.el8. 3.0 MB/s | 3.6 MB 00:01 2023-10-08T07:03:07.555 INFO:teuthology.orchestra.run.smithi017.stdout:(109/122): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-10-08T07:03:07.589 INFO:teuthology.orchestra.run.smithi017.stdout:(110/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-10-08T07:03:07.623 INFO:teuthology.orchestra.run.smithi017.stdout:(111/122): xfsprogs-devel-5.0.0-10.el8.x86_64.r 2.1 MB/s | 72 kB 00:00 2023-10-08T07:03:07.653 INFO:teuthology.orchestra.run.smithi086.stdout:(33/122): ceph-volume-18.0.0-6609.g9725b08f.el8 2.6 MB/s | 261 kB 00:00 2023-10-08T07:03:07.654 INFO:teuthology.orchestra.run.smithi033.stdout:(25/122): rbd-nbd-18.0.0-6609.g9725b08f.el8.x86 1.8 MB/s | 179 kB 00:00 2023-10-08T07:03:07.673 INFO:teuthology.orchestra.run.smithi017.stdout:(112/122): openssl-devel-1.1.1k-7.el8_6.x86_64. 20 MB/s | 2.3 MB 00:00 2023-10-08T07:03:07.698 INFO:teuthology.orchestra.run.smithi017.stdout:(113/122): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-10-08T07:03:07.754 INFO:teuthology.orchestra.run.smithi017.stdout:(114/122): elfutils-libelf-devel-0.186-1.el8.x8 745 kB/s | 60 kB 00:00 2023-10-08T07:03:07.755 INFO:teuthology.orchestra.run.smithi033.stdout:(26/122): ceph-grafana-dashboards-18.0.0-6609.g 231 kB/s | 23 kB 00:00 2023-10-08T07:03:07.774 INFO:teuthology.orchestra.run.smithi086.stdout:(34/122): cephadm-18.0.0-6609.g9725b08f.el8.noa 1.5 MB/s | 190 kB 00:00 2023-10-08T07:03:07.782 INFO:teuthology.orchestra.run.smithi017.stdout:(115/122): libuuid-devel-2.32.1-35.el8.x86_64.r 1.1 MB/s | 98 kB 00:00 2023-10-08T07:03:07.807 INFO:teuthology.orchestra.run.smithi017.stdout:(116/122): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-08T07:03:07.833 INFO:teuthology.orchestra.run.smithi017.stdout:(117/122): libcom_err-devel-1.45.6-4.el8.x86_64 769 kB/s | 39 kB 00:00 2023-10-08T07:03:07.866 INFO:teuthology.orchestra.run.smithi017.stdout:(118/122): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-10-08T07:03:07.888 INFO:teuthology.orchestra.run.smithi033.stdout:(27/122): ceph-mgr-cephadm-18.0.0-6609.g9725b08 992 kB/s | 132 kB 00:00 2023-10-08T07:03:07.891 INFO:teuthology.orchestra.run.smithi017.stdout:(119/122): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-10-08T07:03:07.921 INFO:teuthology.orchestra.run.smithi086.stdout:(35/122): gperftools-libs-2.7-9.el8.x86_64.rpm 2.0 MB/s | 306 kB 00:00 2023-10-08T07:03:07.962 INFO:teuthology.orchestra.run.smithi086.stdout:(36/122): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-10-08T07:03:08.013 INFO:teuthology.orchestra.run.smithi086.stdout:(37/122): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-10-08T07:03:08.105 INFO:teuthology.orchestra.run.smithi086.stdout:(38/122): python3-asyncssh-2.7.0-2.el8.noarch.r 5.1 MB/s | 476 kB 00:00 2023-10-08T07:03:08.139 INFO:teuthology.orchestra.run.smithi086.stdout:(39/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.3 MB/s | 44 kB 00:00 2023-10-08T07:03:08.210 INFO:teuthology.orchestra.run.smithi086.stdout:(40/122): python3-beautifulsoup4-4.6.3-2.el8.1. 2.5 MB/s | 185 kB 00:00 2023-10-08T07:03:08.247 INFO:teuthology.orchestra.run.smithi086.stdout:(41/122): python3-cachetools-3.1.1-4.el8.noarch 890 kB/s | 33 kB 00:00 2023-10-08T07:03:08.281 INFO:teuthology.orchestra.run.smithi086.stdout:(42/122): python3-certifi-2018.10.15-7.el8.noar 489 kB/s | 16 kB 00:00 2023-10-08T07:03:08.323 INFO:teuthology.orchestra.run.smithi086.stdout:(43/122): python3-cheroot-8.5.2-1.el8.noarch.rp 4.1 MB/s | 173 kB 00:00 2023-10-08T07:03:08.373 INFO:teuthology.orchestra.run.smithi086.stdout:(44/122): python3-cherrypy-18.4.0-1.el8.noarch. 7.5 MB/s | 384 kB 00:00 2023-10-08T07:03:08.465 INFO:teuthology.orchestra.run.smithi086.stdout:(45/122): ceph-mgr-diskprediction-local-18.0.0- 4.2 MB/s | 7.4 MB 00:01 2023-10-08T07:03:08.489 INFO:teuthology.orchestra.run.smithi033.stdout:(28/122): librgw2-18.0.0-6609.g9725b08f.el8.x86 2.2 MB/s | 6.9 MB 00:03 2023-10-08T07:03:08.490 INFO:teuthology.orchestra.run.smithi086.stdout:(46/122): python3-google-auth-1.1.1-10.el8.noar 696 kB/s | 81 kB 00:00 2023-10-08T07:03:08.564 INFO:teuthology.orchestra.run.smithi033.stdout:(29/122): ceph-mgr-dashboard-18.0.0-6609.g9725b 2.6 MB/s | 1.8 MB 00:00 2023-10-08T07:03:08.723 INFO:teuthology.orchestra.run.smithi033.stdout:(30/122): ceph-mgr-modules-core-18.0.0-6609.g97 1.5 MB/s | 242 kB 00:00 2023-10-08T07:03:08.807 INFO:teuthology.orchestra.run.smithi033.stdout:(31/122): ceph-mgr-rook-18.0.0-6609.g9725b08f.e 569 kB/s | 47 kB 00:00 2023-10-08T07:03:08.899 INFO:teuthology.orchestra.run.smithi033.stdout:(32/122): ceph-prometheus-alerts-18.0.0-6609.g9 159 kB/s | 15 kB 00:00 2023-10-08T07:03:09.015 INFO:teuthology.orchestra.run.smithi033.stdout:(33/122): ceph-volume-18.0.0-6609.g9725b08f.el8 2.2 MB/s | 261 kB 00:00 2023-10-08T07:03:09.034 INFO:teuthology.orchestra.run.smithi017.stdout:(120/122): librbd1-18.0.0-6609.g9725b08f.el8.x8 3.2 MB/s | 3.7 MB 00:01 2023-10-08T07:03:09.091 INFO:teuthology.orchestra.run.smithi033.stdout:(34/122): cephadm-18.0.0-6609.g9725b08f.el8.noa 2.5 MB/s | 190 kB 00:00 2023-10-08T07:03:09.099 INFO:teuthology.orchestra.run.smithi086.stdout:(47/122): ceph-test-18.0.0-6609.g9725b08f.el8.x 4.8 MB/s | 49 MB 00:10 2023-10-08T07:03:09.292 INFO:teuthology.orchestra.run.smithi086.stdout:(48/122): python3-jaraco-6.2-6.el8.noarch.rpm 13 kB/s | 11 kB 00:00 2023-10-08T07:03:09.308 INFO:teuthology.orchestra.run.smithi086.stdout:(49/122): python3-jaraco-functools-2.0-4.el8.no 21 kB/s | 18 kB 00:00 2023-10-08T07:03:09.309 INFO:teuthology.orchestra.run.smithi017.stdout:(121/122): librados2-18.0.0-6609.g9725b08f.el8. 2.6 MB/s | 3.7 MB 00:01 2023-10-08T07:03:09.375 INFO:teuthology.orchestra.run.smithi086.stdout:(50/122): python3-logutils-0.3.5-11.el8.noarch. 583 kB/s | 49 kB 00:00 2023-10-08T07:03:09.399 INFO:teuthology.orchestra.run.smithi033.stdout:(35/122): gperftools-libs-2.7-9.el8.x86_64.rpm 993 kB/s | 306 kB 00:00 2023-10-08T07:03:09.400 INFO:teuthology.orchestra.run.smithi086.stdout:(51/122): python3-more-itertools-7.2.0-3.el8.no 641 kB/s | 59 kB 00:00 2023-10-08T07:03:09.425 INFO:teuthology.orchestra.run.smithi086.stdout:(52/122): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-10-08T07:03:09.466 INFO:teuthology.orchestra.run.smithi033.stdout:(36/122): liboath-2.6.2-3.el8.x86_64.rpm 884 kB/s | 59 kB 00:00 2023-10-08T07:03:09.467 INFO:teuthology.orchestra.run.smithi086.stdout:(53/122): python3-portend-2.6-1.el8.noarch.rpm 374 kB/s | 16 kB 00:00 2023-10-08T07:03:09.493 INFO:teuthology.orchestra.run.smithi086.stdout:(54/122): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-10-08T07:03:09.518 INFO:teuthology.orchestra.run.smithi086.stdout:(55/122): python3-repoze-lru-0.7-6.el8.noarch.r 671 kB/s | 34 kB 00:00 2023-10-08T07:03:09.533 INFO:teuthology.orchestra.run.smithi033.stdout:(37/122): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-10-08T07:03:09.568 INFO:teuthology.orchestra.run.smithi086.stdout:(56/122): python3-routes-2.4.1-12.el8.noarch.rp 2.6 MB/s | 196 kB 00:00 2023-10-08T07:03:09.594 INFO:teuthology.orchestra.run.smithi086.stdout:(57/122): python3-rsa-4.9-2.el8.noarch.rpm 853 kB/s | 64 kB 00:00 2023-10-08T07:03:09.620 INFO:teuthology.orchestra.run.smithi086.stdout:(58/122): python3-simplegeneric-0.8.1-17.el8.no 368 kB/s | 19 kB 00:00 2023-10-08T07:03:09.644 INFO:teuthology.orchestra.run.smithi086.stdout:(59/122): python3-singledispatch-3.4.0.3-18.el8 477 kB/s | 24 kB 00:00 2023-10-08T07:03:09.658 INFO:teuthology.orchestra.run.smithi033.stdout:(38/122): python3-asyncssh-2.7.0-2.el8.noarch.r 3.7 MB/s | 476 kB 00:00 2023-10-08T07:03:09.669 INFO:teuthology.orchestra.run.smithi086.stdout:(60/122): python3-tempora-1.14.1-5.el8.noarch.r 583 kB/s | 29 kB 00:00 2023-10-08T07:03:09.695 INFO:teuthology.orchestra.run.smithi086.stdout:(61/122): python3-trustme-0.6.0-4.el8.noarch.rp 551 kB/s | 27 kB 00:00 2023-10-08T07:03:09.729 INFO:teuthology.orchestra.run.smithi086.stdout:(62/122): python3-kubernetes-11.0.0-6.el8.noarc 1.9 MB/s | 1.2 MB 00:00 2023-10-08T07:03:09.753 INFO:teuthology.orchestra.run.smithi086.stdout:(63/122): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2023-10-08T07:03:09.770 INFO:teuthology.orchestra.run.smithi086.stdout:(64/122): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2023-10-08T07:03:09.796 INFO:teuthology.orchestra.run.smithi086.stdout:(65/122): python3-websocket-client-0.56.0-5.el8 914 kB/s | 61 kB 00:00 2023-10-08T07:03:09.830 INFO:teuthology.orchestra.run.smithi086.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 391 kB/s | 23 kB 00:00 2023-10-08T07:03:09.855 INFO:teuthology.orchestra.run.smithi086.stdout:(67/122): python3-webtest-2.0.33-1.el8.noarch.r 846 kB/s | 85 kB 00:00 2023-10-08T07:03:09.880 INFO:teuthology.orchestra.run.smithi086.stdout:(68/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-08T07:03:09.939 INFO:teuthology.orchestra.run.smithi086.stdout:(69/122): python3-pyasn1-modules-0.3.7-6.el8.no 2.0 MB/s | 110 kB 00:00 2023-10-08T07:03:10.012 INFO:teuthology.orchestra.run.smithi086.stdout:(70/122): python3-pytz-2017.2-9.el8.noarch.rpm 747 kB/s | 54 kB 00:00 2023-10-08T07:03:10.056 INFO:teuthology.orchestra.run.smithi086.stdout:(71/122): thrift-0.13.0-2.el8.x86_64.rpm 6.7 MB/s | 1.7 MB 00:00 2023-10-08T07:03:10.090 INFO:teuthology.orchestra.run.smithi086.stdout:(72/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.3 MB/s | 259 kB 00:00 2023-10-08T07:03:10.140 INFO:teuthology.orchestra.run.smithi086.stdout:(73/122): python3-markupsafe-0.23-19.el8.x86_64 874 kB/s | 39 kB 00:00 2023-10-08T07:03:10.167 INFO:teuthology.orchestra.run.smithi033.stdout:(39/122): ceph-test-18.0.0-6609.g9725b08f.el8.x 5.9 MB/s | 49 MB 00:08 2023-10-08T07:03:10.173 INFO:teuthology.orchestra.run.smithi086.stdout:(74/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2023-10-08T07:03:10.192 INFO:teuthology.orchestra.run.smithi033.stdout:(40/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 82 kB/s | 44 kB 00:00 2023-10-08T07:03:10.207 INFO:teuthology.orchestra.run.smithi086.stdout:(75/122): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-10-08T07:03:10.226 INFO:teuthology.orchestra.run.smithi017.stdout:(122/122): ceph-test-18.0.0-6609.g9725b08f.el8. 4.6 MB/s | 49 MB 00:10 2023-10-08T07:03:10.229 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2023-10-08T07:03:10.229 INFO:teuthology.orchestra.run.smithi017.stdout:Total 11 MB/s | 200 MB 00:18 2023-10-08T07:03:10.240 INFO:teuthology.orchestra.run.smithi086.stdout:(76/122): python3-jinja2-2.10.1-3.el8.noarch.rp 7.9 MB/s | 538 kB 00:00 2023-10-08T07:03:10.266 INFO:teuthology.orchestra.run.smithi086.stdout:(77/122): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-08T07:03:10.284 INFO:teuthology.orchestra.run.smithi033.stdout:(41/122): ceph-mgr-diskprediction-local-18.0.0- 4.1 MB/s | 7.4 MB 00:01 2023-10-08T07:03:10.291 INFO:teuthology.orchestra.run.smithi086.stdout:(78/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-08T07:03:10.310 INFO:teuthology.orchestra.run.smithi033.stdout:(42/122): python3-cachetools-3.1.1-4.el8.noarch 282 kB/s | 33 kB 00:00 2023-10-08T07:03:10.325 INFO:teuthology.orchestra.run.smithi086.stdout:(79/122): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-08T07:03:10.375 INFO:teuthology.orchestra.run.smithi086.stdout:(80/122): python3-jsonpatch-1.21-2.el8.noarch.r 532 kB/s | 27 kB 00:00 2023-10-08T07:03:10.376 INFO:teuthology.orchestra.run.smithi033.stdout:(43/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2023-10-08T07:03:10.439 INFO:teuthology.orchestra.run.smithi086.stdout:(81/122): flex-2.6.1-9.el8.x86_64.rpm 4.9 MB/s | 320 kB 00:00 2023-10-08T07:03:10.452 INFO:teuthology.orchestra.run.smithi033.stdout:(44/122): python3-certifi-2018.10.15-7.el8.noar 98 kB/s | 16 kB 00:00 2023-10-08T07:03:10.484 INFO:teuthology.orchestra.run.smithi086.stdout:(82/122): python3-prettytable-0.7.2-14.el8.noar 992 kB/s | 44 kB 00:00 2023-10-08T07:03:10.494 INFO:teuthology.orchestra.run.smithi033.stdout:(45/122): python3-beautifulsoup4-4.6.3-2.el8.1. 568 kB/s | 185 kB 00:00 2023-10-08T07:03:10.519 INFO:teuthology.orchestra.run.smithi033.stdout:(46/122): python3-cherrypy-18.4.0-1.el8.noarch. 2.6 MB/s | 384 kB 00:00 2023-10-08T07:03:10.553 INFO:teuthology.orchestra.run.smithi033.stdout:(47/122): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2023-10-08T07:03:10.567 INFO:teuthology.orchestra.run.smithi086.stdout:(83/122): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2023-10-08T07:03:10.578 INFO:teuthology.orchestra.run.smithi033.stdout:(48/122): python3-google-auth-1.1.1-10.el8.noar 646 kB/s | 81 kB 00:00 2023-10-08T07:03:10.603 INFO:teuthology.orchestra.run.smithi033.stdout:(49/122): python3-jaraco-functools-2.0-4.el8.no 210 kB/s | 18 kB 00:00 2023-10-08T07:03:10.609 INFO:teuthology.orchestra.run.smithi086.stdout:(84/122): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-10-08T07:03:10.645 INFO:teuthology.orchestra.run.smithi033.stdout:(50/122): python3-logutils-0.3.5-11.el8.noarch. 730 kB/s | 49 kB 00:00 2023-10-08T07:03:10.704 INFO:teuthology.orchestra.run.smithi033.stdout:(51/122): python3-kubernetes-11.0.0-6.el8.noarc 7.7 MB/s | 1.2 MB 00:00 2023-10-08T07:03:10.721 INFO:teuthology.orchestra.run.smithi033.stdout:(52/122): python3-more-itertools-7.2.0-3.el8.no 501 kB/s | 59 kB 00:00 2023-10-08T07:03:10.738 INFO:teuthology.orchestra.run.smithi033.stdout:(53/122): python3-natsort-7.1.1-2.el8.noarch.rp 653 kB/s | 60 kB 00:00 2023-10-08T07:03:10.743 INFO:teuthology.orchestra.run.smithi086.stdout:(85/122): python3-scipy-1.0.0-21.module+el8.5.0 15 MB/s | 14 MB 00:00 2023-10-08T07:03:10.768 INFO:teuthology.orchestra.run.smithi086.stdout:(86/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.4 MB/s | 225 kB 00:00 2023-10-08T07:03:10.780 INFO:teuthology.orchestra.run.smithi033.stdout:(54/122): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-10-08T07:03:10.793 INFO:teuthology.orchestra.run.smithi086.stdout:(87/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-08T07:03:10.796 INFO:teuthology.orchestra.run.smithi033.stdout:(55/122): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2023-10-08T07:03:10.813 INFO:teuthology.orchestra.run.smithi033.stdout:(56/122): python3-repoze-lru-0.7-6.el8.noarch.r 446 kB/s | 34 kB 00:00 2023-10-08T07:03:10.818 INFO:teuthology.orchestra.run.smithi086.stdout:(88/122): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-10-08T07:03:10.844 INFO:teuthology.orchestra.run.smithi086.stdout:(89/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-08T07:03:10.855 INFO:teuthology.orchestra.run.smithi033.stdout:(57/122): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2023-10-08T07:03:10.881 INFO:teuthology.orchestra.run.smithi033.stdout:(58/122): python3-rsa-4.9-2.el8.noarch.rpm 768 kB/s | 64 kB 00:00 2023-10-08T07:03:10.902 INFO:teuthology.orchestra.run.smithi086.stdout:(90/122): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-10-08T07:03:10.906 INFO:teuthology.orchestra.run.smithi033.stdout:(59/122): python3-simplegeneric-0.8.1-17.el8.no 202 kB/s | 19 kB 00:00 2023-10-08T07:03:10.951 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2023-10-08T07:03:10.961 INFO:teuthology.orchestra.run.smithi086.stdout:(91/122): python3-numpy-1.14.3-10.el8.x86_64.rp 7.8 MB/s | 3.7 MB 00:00 2023-10-08T07:03:10.963 INFO:teuthology.orchestra.run.smithi033.stdout:(60/122): python3-singledispatch-3.4.0.3-18.el8 224 kB/s | 24 kB 00:00 2023-10-08T07:03:11.003 INFO:teuthology.orchestra.run.smithi086.stdout:(92/122): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-08T07:03:11.045 INFO:teuthology.orchestra.run.smithi086.stdout:(93/122): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-08T07:03:11.070 INFO:teuthology.orchestra.run.smithi086.stdout:(94/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2023-10-08T07:03:11.073 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2023-10-08T07:03:11.073 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2023-10-08T07:03:11.098 INFO:teuthology.orchestra.run.smithi033.stdout:(61/122): python3-tempora-1.14.1-5.el8.noarch.r 134 kB/s | 29 kB 00:00 2023-10-08T07:03:11.123 INFO:teuthology.orchestra.run.smithi033.stdout:(62/122): python3-trustme-0.6.0-4.el8.noarch.rp 127 kB/s | 27 kB 00:00 2023-10-08T07:03:11.137 INFO:teuthology.orchestra.run.smithi086.stdout:(95/122): openblas-threads-0.3.15-3.el8.x86_64. 17 MB/s | 4.9 MB 00:00 2023-10-08T07:03:11.149 INFO:teuthology.orchestra.run.smithi033.stdout:(63/122): python3-waitress-1.4.3-1.el8.noarch.r 1.3 MB/s | 255 kB 00:00 2023-10-08T07:03:11.162 INFO:teuthology.orchestra.run.smithi086.stdout:(96/122): libselinux-devel-2.9-5.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2023-10-08T07:03:11.187 INFO:teuthology.orchestra.run.smithi086.stdout:(97/122): python3-jwt-1.6.1-2.el8.noarch.rpm 850 kB/s | 43 kB 00:00 2023-10-08T07:03:11.199 INFO:teuthology.orchestra.run.smithi033.stdout:(64/122): python3-websocket-client-0.56.0-5.el8 817 kB/s | 61 kB 00:00 2023-10-08T07:03:11.250 INFO:teuthology.orchestra.run.smithi033.stdout:(65/122): python3-webtest-2.0.33-1.el8.noarch.r 852 kB/s | 85 kB 00:00 2023-10-08T07:03:11.254 INFO:teuthology.orchestra.run.smithi086.stdout:(98/122): openblas-0.3.15-3.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-10-08T07:03:11.275 INFO:teuthology.orchestra.run.smithi033.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2023-10-08T07:03:11.280 INFO:teuthology.orchestra.run.smithi086.stdout:(99/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 521 kB/s | 48 kB 00:00 2023-10-08T07:03:11.300 INFO:teuthology.orchestra.run.smithi033.stdout:(67/122): python3-webob-1.8.5-1.el8.1.noarch.rp 1.4 MB/s | 251 kB 00:00 2023-10-08T07:03:11.325 INFO:teuthology.orchestra.run.smithi033.stdout:(68/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-08T07:03:11.330 INFO:teuthology.orchestra.run.smithi086.stdout:(100/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.3 MB/s | 220 kB 00:00 2023-10-08T07:03:11.356 INFO:teuthology.orchestra.run.smithi086.stdout:(101/122): libsepol-devel-2.9-3.el8.x86_64.rpm 865 kB/s | 87 kB 00:00 2023-10-08T07:03:11.381 INFO:teuthology.orchestra.run.smithi086.stdout:(102/122): python3-requests-oauthlib-1.0.0-1.el 425 kB/s | 43 kB 00:00 2023-10-08T07:03:11.384 INFO:teuthology.orchestra.run.smithi033.stdout:(69/122): thrift-0.13.0-2.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2023-10-08T07:03:11.398 INFO:teuthology.orchestra.run.smithi086.stdout:(103/122): python3-pycparser-2.14-14.el8.noarch 1.6 MB/s | 109 kB 00:00 2023-10-08T07:03:11.423 INFO:teuthology.orchestra.run.smithi086.stdout:(104/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.3 MB/s | 229 kB 00:00 2023-10-08T07:03:11.442 INFO:teuthology.orchestra.run.smithi033.stdout:(70/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2023-10-08T07:03:11.448 INFO:teuthology.orchestra.run.smithi086.stdout:(105/122): libaio-devel-0.3.112-1.el8.x86_64.rp 372 kB/s | 19 kB 00:00 2023-10-08T07:03:11.465 INFO:teuthology.orchestra.run.smithi086.stdout:(106/122): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-10-08T07:03:11.467 INFO:teuthology.orchestra.run.smithi033.stdout:(71/122): python3-pytz-2017.2-9.el8.noarch.rpm 723 kB/s | 54 kB 00:00 2023-10-08T07:03:11.490 INFO:teuthology.orchestra.run.smithi086.stdout:(107/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.0 MB/s | 560 kB 00:00 2023-10-08T07:03:11.516 INFO:teuthology.orchestra.run.smithi086.stdout:(108/122): libverto-devel-0.3.0-5.el8.x86_64.rp 356 kB/s | 18 kB 00:00 2023-10-08T07:03:11.526 INFO:teuthology.orchestra.run.smithi033.stdout:(72/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.0 MB/s | 259 kB 00:00 2023-10-08T07:03:11.557 INFO:teuthology.orchestra.run.smithi086.stdout:(109/122): python3-cryptography-3.2.1-5.el8.x86 5.0 MB/s | 559 kB 00:00 2023-10-08T07:03:11.560 INFO:teuthology.orchestra.run.smithi033.stdout:(73/122): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2023-10-08T07:03:11.583 INFO:teuthology.orchestra.run.smithi086.stdout:(110/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-10-08T07:03:11.585 INFO:teuthology.orchestra.run.smithi033.stdout:(74/122): python3-markupsafe-0.23-19.el8.x86_64 665 kB/s | 39 kB 00:00 2023-10-08T07:03:11.608 INFO:teuthology.orchestra.run.smithi086.stdout:(111/122): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-10-08T07:03:11.633 INFO:teuthology.orchestra.run.smithi086.stdout:(112/122): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-10-08T07:03:11.635 INFO:teuthology.orchestra.run.smithi033.stdout:(75/122): bison-3.0.4-10.el8.x86_64.rpm 8.9 MB/s | 688 kB 00:00 2023-10-08T07:03:11.659 INFO:teuthology.orchestra.run.smithi086.stdout:(113/122): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-08T07:03:11.669 INFO:teuthology.orchestra.run.smithi033.stdout:(76/122): python3-jinja2-2.10.1-3.el8.noarch.rp 6.3 MB/s | 538 kB 00:00 2023-10-08T07:03:11.684 INFO:teuthology.orchestra.run.smithi086.stdout:(114/122): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-08T07:03:11.694 INFO:teuthology.orchestra.run.smithi033.stdout:(77/122): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-08T07:03:11.709 INFO:teuthology.orchestra.run.smithi086.stdout:(115/122): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-08T07:03:11.719 INFO:teuthology.orchestra.run.smithi033.stdout:(78/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-08T07:03:11.768 INFO:teuthology.orchestra.run.smithi086.stdout:(116/122): zlib-devel-1.2.11-18.el8_5.x86_64.rp 690 kB/s | 58 kB 00:00 2023-10-08T07:03:11.790 INFO:teuthology.orchestra.run.smithi033.stdout:(79/122): automake-1.16.1-7.el8.noarch.rpm 7.3 MB/s | 713 kB 00:00 2023-10-08T07:03:11.793 INFO:teuthology.orchestra.run.smithi086.stdout:(117/122): libcom_err-devel-1.45.6-4.el8.x86_64 462 kB/s | 39 kB 00:00 2023-10-08T07:03:11.827 INFO:teuthology.orchestra.run.smithi086.stdout:(118/122): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-10-08T07:03:11.837 INFO:teuthology.orchestra.run.smithi033.stdout:(80/122): python3-jsonpatch-1.21-2.el8.noarch.r 567 kB/s | 27 kB 00:00 2023-10-08T07:03:11.843 INFO:teuthology.orchestra.run.smithi086.stdout:(119/122): libquadmath-8.5.0-10.1.el8_6.x86_64. 3.3 MB/s | 171 kB 00:00 2023-10-08T07:03:11.879 INFO:teuthology.orchestra.run.smithi033.stdout:(81/122): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-08T07:03:11.894 INFO:teuthology.orchestra.run.smithi086.stdout:(120/122): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.9 MB/s | 2.3 MB 00:00 2023-10-08T07:03:11.912 INFO:teuthology.orchestra.run.smithi033.stdout:(82/122): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-10-08T07:03:12.029 INFO:teuthology.orchestra.run.smithi033.stdout:(83/122): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-10-08T07:03:12.088 INFO:teuthology.orchestra.run.smithi033.stdout:(84/122): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-10-08T07:03:12.163 INFO:teuthology.orchestra.run.smithi033.stdout:(85/122): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-10-08T07:03:12.188 INFO:teuthology.orchestra.run.smithi033.stdout:(86/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-10-08T07:03:12.191 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2023-10-08T07:03:12.196 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2023-10-08T07:03:12.214 INFO:teuthology.orchestra.run.smithi033.stdout:(87/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-08T07:03:12.227 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-10-08T07:03:12.230 INFO:teuthology.orchestra.run.smithi033.stdout:(88/122): python3-jsonpointer-1.10-11.el8.noarc 479 kB/s | 20 kB 00:00 2023-10-08T07:03:12.256 INFO:teuthology.orchestra.run.smithi033.stdout:(89/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-10-08T07:03:12.277 INFO:teuthology.orchestra.run.smithi086.stdout:(121/122): librados2-18.0.0-6609.g9725b08f.el8. 8.3 MB/s | 3.7 MB 00:00 2023-10-08T07:03:12.298 INFO:teuthology.orchestra.run.smithi033.stdout:(90/122): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-10-08T07:03:12.452 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-10-08T07:03:12.527 INFO:teuthology.orchestra.run.smithi086.stdout:(122/122): librbd1-18.0.0-6609.g9725b08f.el8.x8 5.4 MB/s | 3.7 MB 00:00 2023-10-08T07:03:12.530 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2023-10-08T07:03:12.530 INFO:teuthology.orchestra.run.smithi086.stdout:Total 8.8 MB/s | 200 MB 00:22 2023-10-08T07:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-10-08T07:03:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/124 2023-10-08T07:03:12.807 INFO:teuthology.orchestra.run.smithi033.stdout:(91/122): python3-scipy-1.0.0-21.module+el8.5.0 9.1 MB/s | 14 MB 00:01 2023-10-08T07:03:12.849 INFO:teuthology.orchestra.run.smithi033.stdout:(92/122): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-08T07:03:12.932 INFO:teuthology.orchestra.run.smithi033.stdout:(93/122): librdkafka-0.11.4-3.el8.x86_64.rpm 4.2 MB/s | 354 kB 00:00 2023-10-08T07:03:12.940 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/124 2023-10-08T07:03:13.008 INFO:teuthology.orchestra.run.smithi033.stdout:(94/122): openblas-threads-0.3.15-3.el8.x86_64. 6.5 MB/s | 4.9 MB 00:00 2023-10-08T07:03:13.033 INFO:teuthology.orchestra.run.smithi033.stdout:(95/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 468 kB/s | 47 kB 00:00 2023-10-08T07:03:13.058 INFO:teuthology.orchestra.run.smithi033.stdout:(96/122): libselinux-devel-2.9-5.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2023-10-08T07:03:13.083 INFO:teuthology.orchestra.run.smithi033.stdout:(97/122): python3-jwt-1.6.1-2.el8.noarch.rpm 849 kB/s | 43 kB 00:00 2023-10-08T07:03:13.108 INFO:teuthology.orchestra.run.smithi033.stdout:(98/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-08T07:03:13.134 INFO:teuthology.orchestra.run.smithi033.stdout:(99/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 956 kB/s | 48 kB 00:00 2023-10-08T07:03:13.146 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-10-08T07:03:13.226 INFO:teuthology.orchestra.run.smithi033.stdout:(100/122): openblas-0.3.15-3.el8.x86_64.rpm 5.1 MB/s | 4.7 MB 00:00 2023-10-08T07:03:13.251 INFO:teuthology.orchestra.run.smithi033.stdout:(101/122): libsepol-devel-2.9-3.el8.x86_64.rpm 611 kB/s | 87 kB 00:00 2023-10-08T07:03:13.261 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2023-10-08T07:03:13.276 INFO:teuthology.orchestra.run.smithi033.stdout:(102/122): python3-requests-oauthlib-1.0.0-1.el 300 kB/s | 43 kB 00:00 2023-10-08T07:03:13.302 INFO:teuthology.orchestra.run.smithi033.stdout:(103/122): python3-pycparser-2.14-14.el8.noarch 1.4 MB/s | 109 kB 00:00 2023-10-08T07:03:13.327 INFO:teuthology.orchestra.run.smithi033.stdout:(104/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-10-08T07:03:13.352 INFO:teuthology.orchestra.run.smithi033.stdout:(105/122): libaio-devel-0.3.112-1.el8.x86_64.rp 374 kB/s | 19 kB 00:00 2023-10-08T07:03:13.373 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2023-10-08T07:03:13.373 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2023-10-08T07:03:13.377 INFO:teuthology.orchestra.run.smithi033.stdout:(106/122): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-10-08T07:03:13.411 INFO:teuthology.orchestra.run.smithi033.stdout:(107/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.1 MB/s | 560 kB 00:00 2023-10-08T07:03:13.463 INFO:teuthology.orchestra.run.smithi033.stdout:(108/122): libverto-devel-0.3.0-5.el8.x86_64.rp 212 kB/s | 18 kB 00:00 2023-10-08T07:03:13.503 INFO:teuthology.orchestra.run.smithi033.stdout:(109/122): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-10-08T07:03:13.529 INFO:teuthology.orchestra.run.smithi033.stdout:(110/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-10-08T07:03:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-10-08T07:03:13.554 INFO:teuthology.orchestra.run.smithi033.stdout:(111/122): pcre2-devel-10.32-2.el8.x86_64.rpm 4.1 MB/s | 605 kB 00:00 2023-10-08T07:03:13.579 INFO:teuthology.orchestra.run.smithi033.stdout:(112/122): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-10-08T07:03:13.596 INFO:teuthology.orchestra.run.smithi033.stdout:(113/122): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-08T07:03:13.638 INFO:teuthology.orchestra.run.smithi033.stdout:(114/122): elfutils-libelf-devel-0.186-1.el8.x8 1.0 MB/s | 60 kB 00:00 2023-10-08T07:03:13.663 INFO:teuthology.orchestra.run.smithi033.stdout:(115/122): libuuid-devel-2.32.1-35.el8.x86_64.r 1.4 MB/s | 98 kB 00:00 2023-10-08T07:03:13.689 INFO:teuthology.orchestra.run.smithi033.stdout:(116/122): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-08T07:03:13.735 INFO:teuthology.orchestra.run.smithi033.stdout:(117/122): libcom_err-devel-1.45.6-4.el8.x86_64 540 kB/s | 39 kB 00:00 2023-10-08T07:03:13.781 INFO:teuthology.orchestra.run.smithi033.stdout:(118/122): libgfortran-8.5.0-10.1.el8_6.x86_64. 6.9 MB/s | 644 kB 00:00 2023-10-08T07:03:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 5/124 2023-10-08T07:03:13.806 INFO:teuthology.orchestra.run.smithi033.stdout:(119/122): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.4 MB/s | 171 kB 00:00 2023-10-08T07:03:13.865 INFO:teuthology.orchestra.run.smithi033.stdout:(120/122): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.4 MB/s | 2.3 MB 00:00 2023-10-08T07:03:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 5/124 2023-10-08T07:03:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T07:03:14.407 INFO:teuthology.orchestra.run.smithi033.stdout:(121/122): librados2-18.0.0-6609.g9725b08f.el8. 6.0 MB/s | 3.7 MB 00:00 2023-10-08T07:03:14.453 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2023-10-08T07:03:14.464 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2023-10-08T07:03:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T07:03:14.682 INFO:teuthology.orchestra.run.smithi033.stdout:(122/122): librbd1-18.0.0-6609.g9725b08f.el8.x8 4.2 MB/s | 3.7 MB 00:00 2023-10-08T07:03:14.685 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2023-10-08T07:03:14.685 INFO:teuthology.orchestra.run.smithi033.stdout:Total 9.1 MB/s | 200 MB 00:21 2023-10-08T07:03:14.696 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T07:03:14.792 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T07:03:14.959 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T07:03:15.157 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/124 2023-10-08T07:03:15.365 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-10-08T07:03:15.428 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2023-10-08T07:03:15.544 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-10-08T07:03:15.550 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2023-10-08T07:03:15.550 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2023-10-08T07:03:15.712 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T07:03:15.806 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T07:03:16.262 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T07:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T07:03:16.599 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/124 2023-10-08T07:03:16.660 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2023-10-08T07:03:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2023-10-08T07:03:16.802 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 15/124 2023-10-08T07:03:16.897 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2023-10-08T07:03:16.976 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 16/124 2023-10-08T07:03:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-10-08T07:03:17.120 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-10-08T07:03:17.239 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-10-08T07:03:17.263 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-10-08T07:03:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-10-08T07:03:17.477 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/124 2023-10-08T07:03:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/124 2023-10-08T07:03:17.785 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/124 2023-10-08T07:03:17.993 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-10-08T07:03:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-10-08T07:03:18.203 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-10-08T07:03:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-10-08T07:03:18.610 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T07:03:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-10-08T07:03:18.986 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.15-3.el8.x86_64 20/124 2023-10-08T07:03:19.045 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T07:03:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2023-10-08T07:03:19.226 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T07:03:19.338 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-10-08T07:03:19.390 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T07:03:19.549 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-10-08T07:03:19.697 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 20/124 2023-10-08T07:03:19.760 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T07:03:19.860 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T07:03:19.977 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 21/124 2023-10-08T07:03:20.057 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/124 2023-10-08T07:03:20.099 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T07:03:20.168 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 22/124 2023-10-08T07:03:20.224 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/124 2023-10-08T07:03:20.357 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/124 2023-10-08T07:03:20.365 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-10-08T07:03:20.380 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-10-08T07:03:20.551 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 24/124 2023-10-08T07:03:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-10-08T07:03:20.599 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-10-08T07:03:20.689 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 25/124 2023-10-08T07:03:20.743 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T07:03:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T07:03:20.898 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 26/124 2023-10-08T07:03:20.992 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-10-08T07:03:21.026 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T07:03:21.086 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-10-08T07:03:21.102 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T07:03:21.207 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T07:03:21.267 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-10-08T07:03:21.417 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-10-08T07:03:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-10-08T07:03:21.617 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T07:03:21.840 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T07:03:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2023-10-08T07:03:21.975 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T07:03:22.202 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-10-08T07:03:22.211 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-10-08T07:03:22.215 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T07:03:22.316 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T07:03:22.351 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-10-08T07:03:22.410 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-10-08T07:03:22.528 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T07:03:22.639 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/124 2023-10-08T07:03:22.743 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-10-08T07:03:22.804 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/124 2023-10-08T07:03:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-10-08T07:03:22.947 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-10-08T07:03:22.968 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/124 2023-10-08T07:03:22.984 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-10-08T07:03:23.165 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T07:03:23.187 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-10-08T07:03:23.193 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.15-3.el8.x86_64 17/124 2023-10-08T07:03:23.271 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T07:03:23.478 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T07:03:23.565 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T07:03:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-10-08T07:03:23.715 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-10-08T07:03:23.854 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-10-08T07:03:23.856 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 28/124 2023-10-08T07:03:23.940 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 17/124 2023-10-08T07:03:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-10-08T07:03:24.137 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T07:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/124 2023-10-08T07:03:24.190 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 18/124 2023-10-08T07:03:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 19/124 2023-10-08T07:03:24.438 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/124 2023-10-08T07:03:24.562 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T07:03:24.614 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 20/124 2023-10-08T07:03:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/124 2023-10-08T07:03:24.666 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-10-08T07:03:24.754 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T07:03:24.799 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 21/124 2023-10-08T07:03:24.840 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-10-08T07:03:24.864 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-10-08T07:03:24.877 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T07:03:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/124 2023-10-08T07:03:25.056 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-10-08T07:03:25.070 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T07:03:25.172 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T07:03:25.257 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 34/124 2023-10-08T07:03:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 35/124 2023-10-08T07:03:25.440 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-10-08T07:03:25.453 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T07:03:25.475 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-10-08T07:03:25.593 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 36/124 2023-10-08T07:03:25.639 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.15-3.el8.x86_64 17/124 2023-10-08T07:03:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 24/124 2023-10-08T07:03:25.683 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-10-08T07:03:25.768 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 37/124 2023-10-08T07:03:25.913 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 25/124 2023-10-08T07:03:25.943 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-10-08T07:03:25.980 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 38/124 2023-10-08T07:03:26.095 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T07:03:26.189 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.1-7.el8.noarch 39/124 2023-10-08T07:03:26.213 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T07:03:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 40/124 2023-10-08T07:03:26.366 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 17/124 2023-10-08T07:03:26.379 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T07:03:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 40/124 2023-10-08T07:03:26.482 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 13/124 2023-10-08T07:03:26.595 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-10-08T07:03:26.654 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 18/124 2023-10-08T07:03:26.656 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jq-1.6-3.el8.x86_64 41/124 2023-10-08T07:03:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-10-08T07:03:26.831 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 42/124 2023-10-08T07:03:26.874 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 26/124 2023-10-08T07:03:26.878 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-10-08T07:03:26.884 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 19/124 2023-10-08T07:03:27.002 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 43/124 2023-10-08T07:03:27.151 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 20/124 2023-10-08T07:03:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 44/124 2023-10-08T07:03:27.247 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 27/124 2023-10-08T07:03:27.337 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 21/124 2023-10-08T07:03:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.7-15.el8.x86_64 45/124 2023-10-08T07:03:27.528 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-10-08T07:03:27.531 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 28/124 2023-10-08T07:03:27.554 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 46/124 2023-10-08T07:03:27.588 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/124 2023-10-08T07:03:27.695 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-10-08T07:03:27.769 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/124 2023-10-08T07:03:27.781 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 47/124 2023-10-08T07:03:27.800 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-10-08T07:03:27.992 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-10-08T07:03:27.995 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 24/124 2023-10-08T07:03:28.005 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 48/124 2023-10-08T07:03:28.133 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 25/124 2023-10-08T07:03:28.316 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-10-08T07:03:28.369 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 49/124 2023-10-08T07:03:28.562 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.15-3.el8.x86_64 17/124 2023-10-08T07:03:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 50/124 2023-10-08T07:03:28.896 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 51/124 2023-10-08T07:03:29.053 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 26/124 2023-10-08T07:03:29.165 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 52/124 2023-10-08T07:03:29.299 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 17/124 2023-10-08T07:03:29.396 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 27/124 2023-10-08T07:03:29.398 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 53/124 2023-10-08T07:03:29.577 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 18/124 2023-10-08T07:03:29.716 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 28/124 2023-10-08T07:03:29.719 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 54/124 2023-10-08T07:03:29.803 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 19/124 2023-10-08T07:03:29.855 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-10-08T07:03:29.934 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 55/124 2023-10-08T07:03:30.003 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/124 2023-10-08T07:03:30.016 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 20/124 2023-10-08T07:03:30.136 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 56/124 2023-10-08T07:03:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/124 2023-10-08T07:03:30.206 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-10-08T07:03:30.219 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 21/124 2023-10-08T07:03:30.330 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 57/124 2023-10-08T07:03:30.382 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-10-08T07:03:30.465 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/124 2023-10-08T07:03:30.535 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/124 2023-10-08T07:03:30.571 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-10-08T07:03:30.704 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/124 2023-10-08T07:03:30.727 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-10-08T07:03:30.756 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 34/124 2023-10-08T07:03:30.918 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 24/124 2023-10-08T07:03:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 35/124 2023-10-08T07:03:31.012 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/124 2023-10-08T07:03:31.048 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 25/124 2023-10-08T07:03:31.136 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 36/124 2023-10-08T07:03:31.278 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 37/124 2023-10-08T07:03:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 61/124 2023-10-08T07:03:31.453 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.7-15.el8.x86_64 38/124 2023-10-08T07:03:31.573 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 62/124 2023-10-08T07:03:31.588 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 39/124 2023-10-08T07:03:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 63/124 2023-10-08T07:03:31.827 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 40/124 2023-10-08T07:03:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-10-08T07:03:31.964 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-10-08T07:03:32.009 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 26/124 2023-10-08T07:03:32.034 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 41/124 2023-10-08T07:03:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-10-08T07:03:32.290 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/124 2023-10-08T07:03:32.334 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 27/124 2023-10-08T07:03:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-10-08T07:03:32.417 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 42/124 2023-10-08T07:03:32.483 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-10-08T07:03:32.582 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-10-08T07:03:32.636 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 28/124 2023-10-08T07:03:32.682 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-10-08T07:03:32.747 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-10-08T07:03:32.747 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 43/124 2023-10-08T07:03:32.852 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 34/124 2023-10-08T07:03:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-10-08T07:03:32.933 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/124 2023-10-08T07:03:32.945 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 44/124 2023-10-08T07:03:33.001 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 35/124 2023-10-08T07:03:33.117 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-10-08T07:03:33.161 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 45/124 2023-10-08T07:03:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-10-08T07:03:33.208 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 36/124 2023-10-08T07:03:33.320 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-10-08T07:03:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 46/124 2023-10-08T07:03:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 37/124 2023-10-08T07:03:33.535 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-10-08T07:03:33.591 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.7-15.el8.x86_64 38/124 2023-10-08T07:03:33.668 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 47/124 2023-10-08T07:03:33.678 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-10-08T07:03:33.734 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 39/124 2023-10-08T07:03:33.807 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-10-08T07:03:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 48/124 2023-10-08T07:03:33.966 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 40/124 2023-10-08T07:03:34.038 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-10-08T07:03:34.072 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 49/124 2023-10-08T07:03:34.171 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 41/124 2023-10-08T07:03:34.262 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-10-08T07:03:34.283 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 50/124 2023-10-08T07:03:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/124 2023-10-08T07:03:34.458 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-10-08T07:03:34.561 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 42/124 2023-10-08T07:03:34.654 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/124 2023-10-08T07:03:34.723 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-10-08T07:03:34.883 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 43/124 2023-10-08T07:03:34.933 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-10-08T07:03:34.940 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/124 2023-10-08T07:03:35.056 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-10-08T07:03:35.074 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 44/124 2023-10-08T07:03:35.107 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-10-08T07:03:35.189 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 54/124 2023-10-08T07:03:35.318 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 45/124 2023-10-08T07:03:35.344 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-10-08T07:03:35.397 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/124 2023-10-08T07:03:35.416 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 55/124 2023-10-08T07:03:35.526 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 46/124 2023-10-08T07:03:35.806 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 56/124 2023-10-08T07:03:35.807 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-10-08T07:03:35.824 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 57/124 2023-10-08T07:03:35.831 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 47/124 2023-10-08T07:03:35.874 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-10-08T07:03:35.983 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 58/124 2023-10-08T07:03:36.058 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 34/124 2023-10-08T07:03:36.129 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 48/124 2023-10-08T07:03:36.211 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 59/124 2023-10-08T07:03:36.265 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 35/124 2023-10-08T07:03:36.289 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 49/124 2023-10-08T07:03:36.420 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.1-7.el8.noarch 60/124 2023-10-08T07:03:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-10-08T07:03:36.463 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 36/124 2023-10-08T07:03:36.485 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 50/124 2023-10-08T07:03:36.607 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 61/124 2023-10-08T07:03:37.334 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-10-08T07:03:37.335 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-10-08T07:03:37.335 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-10-08T07:03:37.335 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/124 2023-10-08T07:03:37.335 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/124 2023-10-08T07:03:37.335 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/124 2023-10-08T07:03:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 37/124 2023-10-08T07:03:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.7-15.el8.x86_64 38/124 2023-10-08T07:03:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 39/124 2023-10-08T07:03:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 40/124 2023-10-08T07:03:37.336 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 61/124 2023-10-08T07:03:37.336 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : jq-1.6-3.el8.x86_64 62/124 2023-10-08T07:03:37.336 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 63/124 2023-10-08T07:03:37.336 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-10-08T07:03:37.398 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-10-08T07:03:37.416 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 54/124 2023-10-08T07:03:37.487 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 41/124 2023-10-08T07:03:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-10-08T07:03:37.805 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-10-08T07:03:37.805 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 55/124 2023-10-08T07:03:37.805 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-10-08T07:03:37.854 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 42/124 2023-10-08T07:03:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-10-08T07:03:37.911 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 56/124 2023-10-08T07:03:38.070 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 57/124 2023-10-08T07:03:38.071 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-10-08T07:03:38.190 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 43/124 2023-10-08T07:03:38.229 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 58/124 2023-10-08T07:03:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-10-08T07:03:38.413 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 44/124 2023-10-08T07:03:38.445 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-10-08T07:03:38.493 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 59/124 2023-10-08T07:03:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-10-08T07:03:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-10-08T07:03:38.671 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 45/124 2023-10-08T07:03:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T07:03:38.722 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : automake-1.16.1-7.el8.noarch 60/124 2023-10-08T07:03:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T07:03:38.829 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-10-08T07:03:38.896 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 61/124 2023-10-08T07:03:38.917 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 90/124 2023-10-08T07:03:38.917 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 46/124 2023-10-08T07:03:38.980 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 61/124 2023-10-08T07:03:38.986 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-10-08T07:03:39.130 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-10-08T07:03:39.223 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 47/124 2023-10-08T07:03:39.233 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jq-1.6-3.el8.x86_64 62/124 2023-10-08T07:03:39.324 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-10-08T07:03:39.389 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 63/124 2023-10-08T07:03:39.518 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 48/124 2023-10-08T07:03:39.546 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-10-08T07:03:39.563 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-10-08T07:03:39.728 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 49/124 2023-10-08T07:03:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-10-08T07:03:39.748 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-10-08T07:03:39.969 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-10-08T07:03:39.991 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 50/124 2023-10-08T07:03:40.020 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-10-08T07:03:40.167 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/124 2023-10-08T07:03:40.182 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-10-08T07:03:40.261 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-10-08T07:03:40.349 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-10-08T07:03:40.357 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/124 2023-10-08T07:03:40.425 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-10-08T07:03:40.565 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-10-08T07:03:40.598 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-10-08T07:03:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/124 2023-10-08T07:03:40.787 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-10-08T07:03:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 54/124 2023-10-08T07:03:41.015 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-10-08T07:03:41.198 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-10-08T07:03:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 55/124 2023-10-08T07:03:41.364 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-10-08T07:03:41.492 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 56/124 2023-10-08T07:03:41.510 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-10-08T07:03:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 57/124 2023-10-08T07:03:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-10-08T07:03:41.722 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-10-08T07:03:41.843 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 58/124 2023-10-08T07:03:41.980 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-10-08T07:03:41.983 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-10-08T07:03:42.168 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-10-08T07:03:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-10-08T07:03:42.220 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 59/124 2023-10-08T07:03:42.441 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-10-08T07:03:42.448 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : automake-1.16.1-7.el8.noarch 60/124 2023-10-08T07:03:42.518 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-10-08T07:03:42.607 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T07:03:42.619 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-10-08T07:03:42.634 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 61/124 2023-10-08T07:03:42.714 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 61/124 2023-10-08T07:03:42.776 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-10-08T07:03:42.819 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-10-08T07:03:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T07:03:42.960 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jq-1.6-3.el8.x86_64 62/124 2023-10-08T07:03:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-10-08T07:03:43.013 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-10-08T07:03:43.170 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 63/124 2023-10-08T07:03:43.386 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-10-08T07:03:43.418 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T07:03:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-10-08T07:03:43.698 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T07:03:43.776 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T07:03:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-10-08T07:03:43.880 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-10-08T07:03:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T07:03:43.990 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T07:03:44.067 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T07:03:44.101 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-10-08T07:03:44.107 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-10-08T07:03:44.249 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 90/124 2023-10-08T07:03:44.290 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-10-08T07:03:44.357 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-10-08T07:03:44.472 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-10-08T07:03:44.637 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-10-08T07:03:44.673 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-10-08T07:03:44.899 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-10-08T07:03:44.920 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-10-08T07:03:45.123 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-10-08T07:03:45.160 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-10-08T07:03:45.262 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-10-08T07:03:45.330 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-10-08T07:03:45.432 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-10-08T07:03:45.677 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-10-08T07:03:45.939 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-10-08T07:03:46.144 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-10-08T07:03:46.157 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-10-08T07:03:46.362 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T07:03:46.417 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T07:03:46.430 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-10-08T07:03:46.571 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 90/124 2023-10-08T07:03:46.672 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-10-08T07:03:46.843 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-10-08T07:03:47.074 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-10-08T07:03:48.220 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T07:03:48.274 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-10-08T07:03:48.432 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T07:03:48.573 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-10-08T07:03:48.865 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-10-08T07:03:49.063 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T07:03:49.213 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-10-08T07:03:49.316 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T07:03:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T07:03:49.528 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-10-08T07:03:49.531 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T07:03:49.715 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-10-08T07:03:50.370 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T07:03:50.579 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T07:03:50.609 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-10-08T07:03:50.766 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T07:03:50.841 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 89/124 2023-10-08T07:03:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 90/124 2023-10-08T07:03:51.335 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T07:03:51.672 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T07:03:51.754 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T07:03:51.886 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T07:03:55.073 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T07:03:55.869 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T07:03:56.500 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 91/124 2023-10-08T07:03:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T07:03:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 92/124 2023-10-08T07:03:57.049 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T07:04:02.547 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T07:04:02.547 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2023-10-08T07:04:02.547 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2023-10-08T07:04:02.547 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-10-08T07:04:02.547 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /run 2023-10-08T07:04:02.547 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2023-10-08T07:04:02.547 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2023-10-08T07:04:02.547 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2023-10-08T07:04:02.547 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2023-10-08T07:04:02.548 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-10-08T07:04:02.548 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:02.896 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T07:04:04.491 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T07:04:04.645 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T07:04:04.871 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T07:04:05.020 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T07:04:05.478 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T07:04:05.654 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T07:04:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T07:04:07.357 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T07:04:07.547 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T07:04:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 99/124 2023-10-08T07:04:07.869 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 100/124 2023-10-08T07:04:08.086 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T07:04:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T07:04:08.577 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T07:04:08.940 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T07:04:08.940 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2023-10-08T07:04:08.940 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2023-10-08T07:04:08.940 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /dev 2023-10-08T07:04:08.940 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /run 2023-10-08T07:04:08.941 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2023-10-08T07:04:08.941 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2023-10-08T07:04:08.941 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2023-10-08T07:04:08.941 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2023-10-08T07:04:08.941 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /dev 2023-10-08T07:04:08.941 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:09.313 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T07:04:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T07:04:09.719 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T07:04:09.811 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T07:04:10.202 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 104/124 2023-10-08T07:04:10.369 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T07:04:10.404 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T07:04:10.586 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T07:04:10.597 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T07:04:10.762 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T07:04:10.762 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2023-10-08T07:04:10.762 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2023-10-08T07:04:10.763 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /dev 2023-10-08T07:04:10.763 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /run 2023-10-08T07:04:10.763 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2023-10-08T07:04:10.763 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2023-10-08T07:04:10.763 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2023-10-08T07:04:10.763 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2023-10-08T07:04:10.763 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /dev 2023-10-08T07:04:10.763 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:11.025 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T07:04:11.117 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T07:04:11.189 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T07:04:11.430 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T07:04:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T07:04:11.934 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 107/124 2023-10-08T07:04:12.083 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T07:04:12.148 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T07:04:12.182 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T07:04:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T07:04:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T07:04:12.327 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T07:04:12.687 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T07:04:12.714 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T07:04:12.836 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T07:04:12.869 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T07:04:13.110 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T07:04:13.250 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T07:04:13.726 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T07:04:13.902 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T07:04:13.918 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T07:04:14.071 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T07:04:14.274 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T07:04:14.401 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 99/124 2023-10-08T07:04:14.598 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 100/124 2023-10-08T07:04:14.769 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T07:04:14.996 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T07:04:15.321 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T07:04:15.698 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T07:04:15.879 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T07:04:15.981 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 99/124 2023-10-08T07:04:16.190 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 100/124 2023-10-08T07:04:16.344 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T07:04:16.367 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T07:04:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T07:04:16.573 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T07:04:16.587 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T07:04:16.688 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 93/124 2023-10-08T07:04:16.688 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2023-10-08T07:04:16.688 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2023-10-08T07:04:16.688 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /dev 2023-10-08T07:04:16.688 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /run 2023-10-08T07:04:16.688 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2023-10-08T07:04:16.688 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2023-10-08T07:04:16.689 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2023-10-08T07:04:16.689 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2023-10-08T07:04:16.689 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /dev 2023-10-08T07:04:16.689 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:16.885 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T07:04:16.939 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 104/124 2023-10-08T07:04:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T07:04:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T07:04:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T07:04:17.319 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T07:04:17.330 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T07:04:17.480 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T07:04:17.844 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T07:04:18.033 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T07:04:18.123 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T07:04:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 111/124 2023-10-08T07:04:18.543 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 104/124 2023-10-08T07:04:18.729 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 107/124 2023-10-08T07:04:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-10-08T07:04:18.760 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T07:04:18.768 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 94/124 2023-10-08T07:04:18.795 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T07:04:18.891 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 113/124 2023-10-08T07:04:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T07:04:18.966 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T07:04:18.977 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T07:04:18.978 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T07:04:19.011 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T07:04:19.112 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 114/124 2023-10-08T07:04:19.169 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T07:04:19.215 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 95/124 2023-10-08T07:04:19.267 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/124 2023-10-08T07:04:19.280 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/124 2023-10-08T07:04:19.354 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T07:04:19.464 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 116/124 2023-10-08T07:04:19.550 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T07:04:19.635 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-10-08T07:04:19.736 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T07:04:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 118/124 2023-10-08T07:04:19.842 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 96/124 2023-10-08T07:04:20.023 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 119/124 2023-10-08T07:04:20.037 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T07:04:20.056 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 97/124 2023-10-08T07:04:20.184 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/124 2023-10-08T07:04:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/124 2023-10-08T07:04:20.316 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 107/124 2023-10-08T07:04:20.426 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/124 2023-10-08T07:04:20.438 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/124 2023-10-08T07:04:20.561 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 122/124 2023-10-08T07:04:20.561 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T07:04:20.572 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T07:04:20.606 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T07:04:20.733 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T07:04:20.745 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T07:04:20.746 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T07:04:21.092 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T07:04:21.233 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T07:04:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T07:04:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 1/124 2023-10-08T07:04:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2/124 2023-10-08T07:04:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 3/124 2023-10-08T07:04:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 4/124 2023-10-08T07:04:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 5/124 2023-10-08T07:04:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T07:04:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T07:04:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T07:04:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T07:04:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 10/124 2023-10-08T07:04:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 11/124 2023-10-08T07:04:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T07:04:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 13/124 2023-10-08T07:04:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 14/124 2023-10-08T07:04:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 15/124 2023-10-08T07:04:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 16/124 2023-10-08T07:04:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 17/124 2023-10-08T07:04:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 18/124 2023-10-08T07:04:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 19/124 2023-10-08T07:04:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 20/124 2023-10-08T07:04:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 21/124 2023-10-08T07:04:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 22/124 2023-10-08T07:04:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 23/124 2023-10-08T07:04:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 24/124 2023-10-08T07:04:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 25/124 2023-10-08T07:04:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 26/124 2023-10-08T07:04:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 27/124 2023-10-08T07:04:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 28/124 2023-10-08T07:04:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 29/124 2023-10-08T07:04:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 30/124 2023-10-08T07:04:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 31/124 2023-10-08T07:04:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 32/124 2023-10-08T07:04:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 33/124 2023-10-08T07:04:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 34/124 2023-10-08T07:04:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 35/124 2023-10-08T07:04:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 36/124 2023-10-08T07:04:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-10-08T07:04:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-10-08T07:04:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-10-08T07:04:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-10-08T07:04:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-10-08T07:04:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-10-08T07:04:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-10-08T07:04:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-10-08T07:04:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-10-08T07:04:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-10-08T07:04:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-10-08T07:04:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-10-08T07:04:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-10-08T07:04:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-10-08T07:04:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-10-08T07:04:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-10-08T07:04:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-10-08T07:04:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-10-08T07:04:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-10-08T07:04:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-10-08T07:04:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-10-08T07:04:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-10-08T07:04:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-10-08T07:04:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-10-08T07:04:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-10-08T07:04:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-10-08T07:04:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-10-08T07:04:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-10-08T07:04:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-10-08T07:04:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-10-08T07:04:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-10-08T07:04:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-10-08T07:04:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-10-08T07:04:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 70/124 2023-10-08T07:04:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 71/124 2023-10-08T07:04:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 72/124 2023-10-08T07:04:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 73/124 2023-10-08T07:04:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 74/124 2023-10-08T07:04:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/124 2023-10-08T07:04:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/124 2023-10-08T07:04:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 77/124 2023-10-08T07:04:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 78/124 2023-10-08T07:04:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 79/124 2023-10-08T07:04:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 80/124 2023-10-08T07:04:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 81/124 2023-10-08T07:04:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 82/124 2023-10-08T07:04:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 83/124 2023-10-08T07:04:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 84/124 2023-10-08T07:04:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 85/124 2023-10-08T07:04:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 86/124 2023-10-08T07:04:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 87/124 2023-10-08T07:04:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 88/124 2023-10-08T07:04:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 89/124 2023-10-08T07:04:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 90/124 2023-10-08T07:04:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 91/124 2023-10-08T07:04:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 92/124 2023-10-08T07:04:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 93/124 2023-10-08T07:04:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 94/124 2023-10-08T07:04:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 95/124 2023-10-08T07:04:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 96/124 2023-10-08T07:04:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 97/124 2023-10-08T07:04:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 98/124 2023-10-08T07:04:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 99/124 2023-10-08T07:04:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 100/124 2023-10-08T07:04:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.0.4-10.el8.x86_64 101/124 2023-10-08T07:04:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 102/124 2023-10-08T07:04:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 103/124 2023-10-08T07:04:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 104/124 2023-10-08T07:04:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.1-7.el8.noarch 105/124 2023-10-08T07:04:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 106/124 2023-10-08T07:04:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 107/124 2023-10-08T07:04:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.1-9.el8.x86_64 108/124 2023-10-08T07:04:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 109/124 2023-10-08T07:04:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 110/124 2023-10-08T07:04:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 111/124 2023-10-08T07:04:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 112/124 2023-10-08T07:04:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 113/124 2023-10-08T07:04:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 114/124 2023-10-08T07:04:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 115/124 2023-10-08T07:04:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 116/124 2023-10-08T07:04:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 117/124 2023-10-08T07:04:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 118/124 2023-10-08T07:04:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jq-1.6-3.el8.x86_64 119/124 2023-10-08T07:04:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 120/124 2023-10-08T07:04:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 121/124 2023-10-08T07:04:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-10-08T07:04:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 123/124 2023-10-08T07:04:22.043 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T07:04:22.301 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 98/124 2023-10-08T07:04:22.401 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 99/124 2023-10-08T07:04:22.625 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 100/124 2023-10-08T07:04:22.869 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T07:04:23.097 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 101/124 2023-10-08T07:04:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T07:04:24.082 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T07:04:24.082 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:47 ago on Sun 08 Oct 2023 07:02:37 AM UTC. 2023-10-08T07:04:24.446 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 102/124 2023-10-08T07:04:24.610 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T07:04:24.708 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 103/124 2023-10-08T07:04:24.798 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T07:04:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 111/124 2023-10-08T07:04:25.099 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 104/124 2023-10-08T07:04:25.307 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T07:04:25.343 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/124 2023-10-08T07:04:25.344 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 105/124 2023-10-08T07:04:25.568 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T07:04:25.580 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 106/124 2023-10-08T07:04:25.886 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T07:04:26.065 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/124 2023-10-08T07:04:26.205 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 111/124 2023-10-08T07:04:26.348 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/124 2023-10-08T07:04:26.485 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 113/124 2023-10-08T07:04:26.651 INFO:teuthology.orchestra.run.smithi144.stdout:Installed products updated. 2023-10-08T07:04:26.676 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 114/124 2023-10-08T07:04:26.872 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 115/124 2023-10-08T07:04:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:26.875 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2023-10-08T07:04:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.875 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.875 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2023-10-08T07:04:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T07:04:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T07:04:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.876 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.877 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T07:04:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T07:04:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T07:04:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T07:04:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: jq-1.6-3.el8.x86_64 2023-10-08T07:04:26.878 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T07:04:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T07:04:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T07:04:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T07:04:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T07:04:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T07:04:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T07:04:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T07:04:26.879 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T07:04:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T07:04:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T07:04:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T07:04:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T07:04:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T07:04:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T07:04:26.880 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T07:04:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T07:04:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T07:04:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T07:04:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T07:04:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T07:04:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T07:04:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T07:04:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T07:04:26.881 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T07:04:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T07:04:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T07:04:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T07:04:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.882 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T07:04:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T07:04:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T07:04:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T07:04:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T07:04:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T07:04:26.883 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T07:04:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T07:04:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T07:04:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T07:04:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T07:04:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T07:04:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T07:04:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T07:04:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T07:04:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T07:04:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T07:04:26.885 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T07:04:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T07:04:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T07:04:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T07:04:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T07:04:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T07:04:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T07:04:26.886 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T07:04:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T07:04:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T07:04:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T07:04:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T07:04:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.887 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T07:04:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T07:04:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T07:04:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T07:04:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T07:04:26.888 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T07:04:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T07:04:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T07:04:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T07:04:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T07:04:26.889 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T07:04:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T07:04:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T07:04:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T07:04:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T07:04:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:26.890 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T07:04:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T07:04:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T07:04:26.891 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T07:04:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T07:04:26.892 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:26.892 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-10-08T07:04:27.007 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 107/124 2023-10-08T07:04:27.011 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/124 2023-10-08T07:04:27.039 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 116/124 2023-10-08T07:04:27.060 DEBUG:teuthology.parallel:result is None 2023-10-08T07:04:27.186 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-10-08T07:04:27.268 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T07:04:27.304 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 108/124 2023-10-08T07:04:27.319 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 113/124 2023-10-08T07:04:27.378 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 118/124 2023-10-08T07:04:27.491 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 114/124 2023-10-08T07:04:27.536 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 119/124 2023-10-08T07:04:27.611 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T07:04:27.652 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 115/124 2023-10-08T07:04:27.755 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/124 2023-10-08T07:04:27.828 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 116/124 2023-10-08T07:04:27.909 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/124 2023-10-08T07:04:27.974 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-10-08T07:04:27.993 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6609.g9725b 109/124 2023-10-08T07:04:27.997 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/124 2023-10-08T07:04:28.169 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T07:04:28.183 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 118/124 2023-10-08T07:04:28.184 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/124 2023-10-08T07:04:28.199 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/124 2023-10-08T07:04:28.199 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T07:04:28.391 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 119/124 2023-10-08T07:04:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T07:04:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T07:04:28.577 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/124 2023-10-08T07:04:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/124 2023-10-08T07:04:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/124 2023-10-08T07:04:29.023 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/124 2023-10-08T07:04:29.036 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/124 2023-10-08T07:04:29.036 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T07:04:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T07:04:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 1/124 2023-10-08T07:04:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2/124 2023-10-08T07:04:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 3/124 2023-10-08T07:04:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 4/124 2023-10-08T07:04:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 5/124 2023-10-08T07:04:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T07:04:29.155 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T07:04:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T07:04:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T07:04:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 10/124 2023-10-08T07:04:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 11/124 2023-10-08T07:04:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T07:04:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 13/124 2023-10-08T07:04:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 14/124 2023-10-08T07:04:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 15/124 2023-10-08T07:04:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 16/124 2023-10-08T07:04:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 17/124 2023-10-08T07:04:29.156 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 18/124 2023-10-08T07:04:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 19/124 2023-10-08T07:04:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 20/124 2023-10-08T07:04:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 21/124 2023-10-08T07:04:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 22/124 2023-10-08T07:04:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 23/124 2023-10-08T07:04:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 24/124 2023-10-08T07:04:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 25/124 2023-10-08T07:04:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 26/124 2023-10-08T07:04:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 27/124 2023-10-08T07:04:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 28/124 2023-10-08T07:04:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 29/124 2023-10-08T07:04:29.157 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 30/124 2023-10-08T07:04:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 31/124 2023-10-08T07:04:29.158 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 32/124 2023-10-08T07:04:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 33/124 2023-10-08T07:04:29.165 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 34/124 2023-10-08T07:04:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 35/124 2023-10-08T07:04:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 36/124 2023-10-08T07:04:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-10-08T07:04:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-10-08T07:04:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-10-08T07:04:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-10-08T07:04:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-10-08T07:04:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-10-08T07:04:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-10-08T07:04:29.166 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-10-08T07:04:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-10-08T07:04:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-10-08T07:04:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-10-08T07:04:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-10-08T07:04:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-10-08T07:04:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-10-08T07:04:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-10-08T07:04:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-10-08T07:04:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-10-08T07:04:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-10-08T07:04:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-10-08T07:04:29.167 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-10-08T07:04:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-10-08T07:04:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-10-08T07:04:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-10-08T07:04:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-10-08T07:04:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-10-08T07:04:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-10-08T07:04:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-10-08T07:04:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-10-08T07:04:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-10-08T07:04:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-10-08T07:04:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-10-08T07:04:29.168 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-10-08T07:04:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-10-08T07:04:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 70/124 2023-10-08T07:04:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 71/124 2023-10-08T07:04:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 72/124 2023-10-08T07:04:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 73/124 2023-10-08T07:04:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 74/124 2023-10-08T07:04:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 75/124 2023-10-08T07:04:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.0.4-10.el8.x86_64 76/124 2023-10-08T07:04:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 77/124 2023-10-08T07:04:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 78/124 2023-10-08T07:04:29.169 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 79/124 2023-10-08T07:04:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.1-7.el8.noarch 80/124 2023-10-08T07:04:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 81/124 2023-10-08T07:04:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 82/124 2023-10-08T07:04:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.1-9.el8.x86_64 83/124 2023-10-08T07:04:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/124 2023-10-08T07:04:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 85/124 2023-10-08T07:04:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 86/124 2023-10-08T07:04:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 87/124 2023-10-08T07:04:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 88/124 2023-10-08T07:04:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 89/124 2023-10-08T07:04:29.170 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 90/124 2023-10-08T07:04:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/124 2023-10-08T07:04:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 92/124 2023-10-08T07:04:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 93/124 2023-10-08T07:04:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : jq-1.6-3.el8.x86_64 94/124 2023-10-08T07:04:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 95/124 2023-10-08T07:04:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 96/124 2023-10-08T07:04:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 97/124 2023-10-08T07:04:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/124 2023-10-08T07:04:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 99/124 2023-10-08T07:04:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 100/124 2023-10-08T07:04:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 101/124 2023-10-08T07:04:29.171 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 102/124 2023-10-08T07:04:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 103/124 2023-10-08T07:04:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 104/124 2023-10-08T07:04:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 105/124 2023-10-08T07:04:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 106/124 2023-10-08T07:04:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 107/124 2023-10-08T07:04:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 108/124 2023-10-08T07:04:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 109/124 2023-10-08T07:04:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 110/124 2023-10-08T07:04:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 111/124 2023-10-08T07:04:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-10-08T07:04:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 113/124 2023-10-08T07:04:29.172 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 114/124 2023-10-08T07:04:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 115/124 2023-10-08T07:04:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 116/124 2023-10-08T07:04:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/124 2023-10-08T07:04:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/124 2023-10-08T07:04:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 119/124 2023-10-08T07:04:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 120/124 2023-10-08T07:04:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 121/124 2023-10-08T07:04:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-10-08T07:04:29.173 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 123/124 2023-10-08T07:04:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T07:04:29.243 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T07:04:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T07:04:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 1/124 2023-10-08T07:04:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2/124 2023-10-08T07:04:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 3/124 2023-10-08T07:04:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 4/124 2023-10-08T07:04:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 5/124 2023-10-08T07:04:29.943 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T07:04:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T07:04:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T07:04:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T07:04:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 10/124 2023-10-08T07:04:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 11/124 2023-10-08T07:04:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T07:04:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 13/124 2023-10-08T07:04:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 14/124 2023-10-08T07:04:29.944 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 15/124 2023-10-08T07:04:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 16/124 2023-10-08T07:04:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 17/124 2023-10-08T07:04:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 18/124 2023-10-08T07:04:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 19/124 2023-10-08T07:04:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 20/124 2023-10-08T07:04:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 21/124 2023-10-08T07:04:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 22/124 2023-10-08T07:04:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 23/124 2023-10-08T07:04:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 24/124 2023-10-08T07:04:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 25/124 2023-10-08T07:04:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 26/124 2023-10-08T07:04:29.945 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 27/124 2023-10-08T07:04:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 28/124 2023-10-08T07:04:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 29/124 2023-10-08T07:04:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 30/124 2023-10-08T07:04:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 31/124 2023-10-08T07:04:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 32/124 2023-10-08T07:04:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 33/124 2023-10-08T07:04:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 34/124 2023-10-08T07:04:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 35/124 2023-10-08T07:04:29.946 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 36/124 2023-10-08T07:04:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-10-08T07:04:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-10-08T07:04:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-10-08T07:04:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-10-08T07:04:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-10-08T07:04:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-10-08T07:04:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-10-08T07:04:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-10-08T07:04:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-10-08T07:04:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-10-08T07:04:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-10-08T07:04:29.947 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-10-08T07:04:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-10-08T07:04:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-10-08T07:04:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-10-08T07:04:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-10-08T07:04:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-10-08T07:04:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-10-08T07:04:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-10-08T07:04:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-10-08T07:04:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-10-08T07:04:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-10-08T07:04:29.948 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-10-08T07:04:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-10-08T07:04:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-10-08T07:04:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-10-08T07:04:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-10-08T07:04:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-10-08T07:04:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-10-08T07:04:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-10-08T07:04:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-10-08T07:04:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-10-08T07:04:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-10-08T07:04:29.949 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 70/124 2023-10-08T07:04:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 71/124 2023-10-08T07:04:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 72/124 2023-10-08T07:04:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 73/124 2023-10-08T07:04:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 74/124 2023-10-08T07:04:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 75/124 2023-10-08T07:04:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : bison-3.0.4-10.el8.x86_64 76/124 2023-10-08T07:04:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 77/124 2023-10-08T07:04:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 78/124 2023-10-08T07:04:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 79/124 2023-10-08T07:04:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : automake-1.16.1-7.el8.noarch 80/124 2023-10-08T07:04:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 81/124 2023-10-08T07:04:29.950 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 82/124 2023-10-08T07:04:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flex-2.6.1-9.el8.x86_64 83/124 2023-10-08T07:04:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/124 2023-10-08T07:04:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 85/124 2023-10-08T07:04:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 86/124 2023-10-08T07:04:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 87/124 2023-10-08T07:04:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 88/124 2023-10-08T07:04:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 89/124 2023-10-08T07:04:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 90/124 2023-10-08T07:04:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/124 2023-10-08T07:04:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 92/124 2023-10-08T07:04:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 93/124 2023-10-08T07:04:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jq-1.6-3.el8.x86_64 94/124 2023-10-08T07:04:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 95/124 2023-10-08T07:04:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 96/124 2023-10-08T07:04:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 97/124 2023-10-08T07:04:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/124 2023-10-08T07:04:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 99/124 2023-10-08T07:04:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 100/124 2023-10-08T07:04:29.952 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 101/124 2023-10-08T07:04:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 102/124 2023-10-08T07:04:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 103/124 2023-10-08T07:04:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 104/124 2023-10-08T07:04:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 105/124 2023-10-08T07:04:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 106/124 2023-10-08T07:04:29.953 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 107/124 2023-10-08T07:04:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 108/124 2023-10-08T07:04:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 109/124 2023-10-08T07:04:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 110/124 2023-10-08T07:04:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 111/124 2023-10-08T07:04:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-10-08T07:04:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 113/124 2023-10-08T07:04:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 114/124 2023-10-08T07:04:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 115/124 2023-10-08T07:04:29.954 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 116/124 2023-10-08T07:04:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/124 2023-10-08T07:04:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/124 2023-10-08T07:04:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 119/124 2023-10-08T07:04:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 120/124 2023-10-08T07:04:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 121/124 2023-10-08T07:04:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-10-08T07:04:29.955 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 123/124 2023-10-08T07:04:31.855 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T07:04:31.856 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:53 ago on Sun 08 Oct 2023 07:02:38 AM UTC. 2023-10-08T07:04:32.713 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T07:04:32.713 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:54 ago on Sun 08 Oct 2023 07:02:38 AM UTC. 2023-10-08T07:04:33.115 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 110/124 2023-10-08T07:04:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 111/124 2023-10-08T07:04:33.617 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/124 2023-10-08T07:04:34.346 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/124 2023-10-08T07:04:34.663 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 113/124 2023-10-08T07:04:34.789 INFO:teuthology.orchestra.run.smithi017.stdout:Installed products updated. 2023-10-08T07:04:34.818 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 114/124 2023-10-08T07:04:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:35.037 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2023-10-08T07:04:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.038 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2023-10-08T07:04:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T07:04:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T07:04:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T07:04:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T07:04:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T07:04:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T07:04:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: jq-1.6-3.el8.x86_64 2023-10-08T07:04:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T07:04:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T07:04:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T07:04:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T07:04:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T07:04:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T07:04:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T07:04:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T07:04:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T07:04:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T07:04:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T07:04:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T07:04:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T07:04:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T07:04:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T07:04:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T07:04:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T07:04:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T07:04:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T07:04:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T07:04:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T07:04:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T07:04:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T07:04:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T07:04:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T07:04:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T07:04:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T07:04:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T07:04:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T07:04:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T07:04:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T07:04:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T07:04:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T07:04:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T07:04:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T07:04:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T07:04:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T07:04:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T07:04:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T07:04:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T07:04:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T07:04:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T07:04:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T07:04:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T07:04:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T07:04:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T07:04:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T07:04:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T07:04:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T07:04:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T07:04:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T07:04:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T07:04:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T07:04:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T07:04:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T07:04:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T07:04:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T07:04:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T07:04:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T07:04:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T07:04:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T07:04:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T07:04:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T07:04:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T07:04:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T07:04:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T07:04:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T07:04:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T07:04:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T07:04:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T07:04:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T07:04:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T07:04:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T07:04:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T07:04:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T07:04:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T07:04:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T07:04:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:35.051 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-10-08T07:04:35.052 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 115/124 2023-10-08T07:04:35.233 DEBUG:teuthology.parallel:result is None 2023-10-08T07:04:35.256 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 116/124 2023-10-08T07:04:35.395 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-10-08T07:04:35.558 INFO:teuthology.orchestra.run.smithi086.stdout:Installed products updated. 2023-10-08T07:04:35.619 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 118/124 2023-10-08T07:04:35.777 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:35.777 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2023-10-08T07:04:35.777 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.777 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.777 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2023-10-08T07:04:35.777 INFO:teuthology.orchestra.run.smithi086.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T07:04:35.778 INFO:teuthology.orchestra.run.smithi086.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T07:04:35.778 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.778 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.778 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.778 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.778 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.778 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.778 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.778 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.778 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.778 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.779 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.779 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.779 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.779 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.779 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.779 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.779 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.779 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.779 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.779 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.779 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:35.780 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T07:04:35.780 INFO:teuthology.orchestra.run.smithi086.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T07:04:35.780 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T07:04:35.780 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T07:04:35.780 INFO:teuthology.orchestra.run.smithi086.stdout: jq-1.6-3.el8.x86_64 2023-10-08T07:04:35.780 INFO:teuthology.orchestra.run.smithi086.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T07:04:35.780 INFO:teuthology.orchestra.run.smithi086.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T07:04:35.780 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T07:04:35.781 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.781 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.781 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.781 INFO:teuthology.orchestra.run.smithi086.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T07:04:35.781 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T07:04:35.781 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T07:04:35.781 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T07:04:35.781 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T07:04:35.781 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.781 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.781 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T07:04:35.782 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.782 INFO:teuthology.orchestra.run.smithi086.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T07:04:35.782 INFO:teuthology.orchestra.run.smithi086.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T07:04:35.782 INFO:teuthology.orchestra.run.smithi086.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T07:04:35.782 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T07:04:35.782 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T07:04:35.782 INFO:teuthology.orchestra.run.smithi086.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T07:04:35.782 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T07:04:35.782 INFO:teuthology.orchestra.run.smithi086.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T07:04:35.782 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T07:04:35.783 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T07:04:35.783 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T07:04:35.783 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T07:04:35.783 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T07:04:35.786 INFO:teuthology.orchestra.run.smithi086.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T07:04:35.786 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T07:04:35.786 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T07:04:35.786 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T07:04:35.786 INFO:teuthology.orchestra.run.smithi086.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T07:04:35.787 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T07:04:35.787 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.787 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.787 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.787 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T07:04:35.787 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T07:04:35.787 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T07:04:35.787 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T07:04:35.787 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T07:04:35.787 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T07:04:35.788 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T07:04:35.788 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T07:04:35.788 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T07:04:35.788 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T07:04:35.788 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T07:04:35.788 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T07:04:35.788 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T07:04:35.788 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T07:04:35.788 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T07:04:35.788 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T07:04:35.788 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T07:04:35.788 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T07:04:35.789 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T07:04:35.789 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T07:04:35.789 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T07:04:35.789 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T07:04:35.789 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T07:04:35.789 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T07:04:35.789 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T07:04:35.789 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T07:04:35.789 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T07:04:35.789 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T07:04:35.789 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T07:04:35.790 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.790 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.790 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T07:04:35.790 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T07:04:35.790 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.790 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T07:04:35.791 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T07:04:35.791 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T07:04:35.791 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T07:04:35.791 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T07:04:35.791 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T07:04:35.791 INFO:teuthology.orchestra.run.smithi086.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T07:04:35.792 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T07:04:35.792 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T07:04:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T07:04:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T07:04:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T07:04:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T07:04:35.795 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T07:04:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T07:04:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T07:04:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T07:04:35.796 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T07:04:35.797 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:35.797 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2023-10-08T07:04:35.810 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 119/124 2023-10-08T07:04:35.956 DEBUG:teuthology.parallel:result is None 2023-10-08T07:04:35.980 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/124 2023-10-08T07:04:36.309 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/124 2023-10-08T07:04:36.404 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/124 2023-10-08T07:04:36.617 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/124 2023-10-08T07:04:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/124 2023-10-08T07:04:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T07:04:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-10-08T07:04:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T07:04:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T07:04:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 1/124 2023-10-08T07:04:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2/124 2023-10-08T07:04:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 3/124 2023-10-08T07:04:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 4/124 2023-10-08T07:04:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6609.g9725b 5/124 2023-10-08T07:04:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 6/124 2023-10-08T07:04:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 7/124 2023-10-08T07:04:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 8/124 2023-10-08T07:04:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 9/124 2023-10-08T07:04:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 10/124 2023-10-08T07:04:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 11/124 2023-10-08T07:04:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 12/124 2023-10-08T07:04:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_ 13/124 2023-10-08T07:04:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 14/124 2023-10-08T07:04:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 15/124 2023-10-08T07:04:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_6 16/124 2023-10-08T07:04:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86 17/124 2023-10-08T07:04:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 18/124 2023-10-08T07:04:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el 19/124 2023-10-08T07:04:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:18.0.0-6609.g9725b08f.el8. 20/124 2023-10-08T07:04:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_6 21/124 2023-10-08T07:04:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 22/124 2023-10-08T07:04:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 23/124 2023-10-08T07:04:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 24/124 2023-10-08T07:04:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 25/124 2023-10-08T07:04:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 26/124 2023-10-08T07:04:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 27/124 2023-10-08T07:04:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f. 28/124 2023-10-08T07:04:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noa 29/124 2023-10-08T07:04:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.n 30/124 2023-10-08T07:04:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6609.g972 31/124 2023-10-08T07:04:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el 32/124 2023-10-08T07:04:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 33/124 2023-10-08T07:04:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.e 34/124 2023-10-08T07:04:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 35/124 2023-10-08T07:04:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 36/124 2023-10-08T07:04:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-10-08T07:04:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-10-08T07:04:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-10-08T07:04:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-10-08T07:04:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-10-08T07:04:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-10-08T07:04:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-10-08T07:04:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-10-08T07:04:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-10-08T07:04:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-10-08T07:04:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-10-08T07:04:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-10-08T07:04:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-10-08T07:04:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-10-08T07:04:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-10-08T07:04:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-10-08T07:04:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-10-08T07:04:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-10-08T07:04:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-10-08T07:04:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-10-08T07:04:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-10-08T07:04:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-10-08T07:04:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-10-08T07:04:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-10-08T07:04:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-10-08T07:04:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-10-08T07:04:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-10-08T07:04:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-10-08T07:04:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-10-08T07:04:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-10-08T07:04:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-10-08T07:04:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-10-08T07:04:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-10-08T07:04:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 70/124 2023-10-08T07:04:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 71/124 2023-10-08T07:04:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 72/124 2023-10-08T07:04:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 73/124 2023-10-08T07:04:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 74/124 2023-10-08T07:04:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 75/124 2023-10-08T07:04:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : bison-3.0.4-10.el8.x86_64 76/124 2023-10-08T07:04:37.612 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 77/124 2023-10-08T07:04:37.612 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 78/124 2023-10-08T07:04:37.612 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 79/124 2023-10-08T07:04:37.612 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : automake-1.16.1-7.el8.noarch 80/124 2023-10-08T07:04:37.612 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 81/124 2023-10-08T07:04:37.612 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 82/124 2023-10-08T07:04:37.612 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flex-2.6.1-9.el8.x86_64 83/124 2023-10-08T07:04:37.612 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/124 2023-10-08T07:04:37.612 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 85/124 2023-10-08T07:04:37.612 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 86/124 2023-10-08T07:04:37.613 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 87/124 2023-10-08T07:04:37.613 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 88/124 2023-10-08T07:04:37.613 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 89/124 2023-10-08T07:04:37.613 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 90/124 2023-10-08T07:04:37.613 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/124 2023-10-08T07:04:37.613 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 92/124 2023-10-08T07:04:37.613 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 93/124 2023-10-08T07:04:37.613 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jq-1.6-3.el8.x86_64 94/124 2023-10-08T07:04:37.613 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 95/124 2023-10-08T07:04:37.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 96/124 2023-10-08T07:04:37.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 97/124 2023-10-08T07:04:37.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/124 2023-10-08T07:04:37.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 99/124 2023-10-08T07:04:37.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 100/124 2023-10-08T07:04:37.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 101/124 2023-10-08T07:04:37.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 102/124 2023-10-08T07:04:37.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 103/124 2023-10-08T07:04:37.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 104/124 2023-10-08T07:04:37.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 105/124 2023-10-08T07:04:37.614 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 106/124 2023-10-08T07:04:37.615 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 107/124 2023-10-08T07:04:37.615 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 108/124 2023-10-08T07:04:37.615 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 109/124 2023-10-08T07:04:37.615 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 110/124 2023-10-08T07:04:37.615 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 111/124 2023-10-08T07:04:37.615 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-10-08T07:04:37.615 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 113/124 2023-10-08T07:04:37.615 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 114/124 2023-10-08T07:04:37.615 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 115/124 2023-10-08T07:04:37.615 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 116/124 2023-10-08T07:04:37.616 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/124 2023-10-08T07:04:37.616 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/124 2023-10-08T07:04:37.616 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 119/124 2023-10-08T07:04:37.616 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 120/124 2023-10-08T07:04:37.616 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 121/124 2023-10-08T07:04:37.616 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-10-08T07:04:37.616 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 123/124 2023-10-08T07:04:40.306 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-10-08T07:04:40.306 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:00 ago on Sun 08 Oct 2023 07:02:40 AM UTC. 2023-10-08T07:04:44.302 INFO:teuthology.orchestra.run.smithi033.stdout:Installed products updated. 2023-10-08T07:04:44.539 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:44.540 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2023-10-08T07:04:44.540 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.540 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.540 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2023-10-08T07:04:44.540 INFO:teuthology.orchestra.run.smithi033.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T07:04:44.540 INFO:teuthology.orchestra.run.smithi033.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T07:04:44.540 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.540 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.541 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.541 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.541 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:44.541 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.541 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.541 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.541 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:44.541 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:44.541 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:44.541 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:44.541 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:44.542 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.542 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.542 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:44.542 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.542 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.542 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.542 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:44.542 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:18.0.0-6609.g9725b08f.el8.noarch 2023-10-08T07:04:44.542 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T07:04:44.542 INFO:teuthology.orchestra.run.smithi033.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T07:04:44.542 INFO:teuthology.orchestra.run.smithi033.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T07:04:44.543 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T07:04:44.543 INFO:teuthology.orchestra.run.smithi033.stdout: jq-1.6-3.el8.x86_64 2023-10-08T07:04:44.543 INFO:teuthology.orchestra.run.smithi033.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T07:04:44.543 INFO:teuthology.orchestra.run.smithi033.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T07:04:44.543 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T07:04:44.543 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.543 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.543 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.543 INFO:teuthology.orchestra.run.smithi033.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T07:04:44.543 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T07:04:44.543 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T07:04:44.544 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T07:04:44.544 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T07:04:44.544 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.544 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.544 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T07:04:44.544 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.544 INFO:teuthology.orchestra.run.smithi033.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T07:04:44.544 INFO:teuthology.orchestra.run.smithi033.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T07:04:44.544 INFO:teuthology.orchestra.run.smithi033.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T07:04:44.544 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T07:04:44.544 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T07:04:44.544 INFO:teuthology.orchestra.run.smithi033.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T07:04:44.545 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T07:04:44.545 INFO:teuthology.orchestra.run.smithi033.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T07:04:44.545 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T07:04:44.545 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T07:04:44.545 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T07:04:44.545 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T07:04:44.545 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T07:04:44.545 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T07:04:44.545 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T07:04:44.545 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T07:04:44.546 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T07:04:44.546 INFO:teuthology.orchestra.run.smithi033.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T07:04:44.546 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T07:04:44.546 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.546 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.546 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.546 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T07:04:44.546 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T07:04:44.546 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T07:04:44.546 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T07:04:44.547 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T07:04:44.547 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T07:04:44.547 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T07:04:44.547 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T07:04:44.547 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T07:04:44.547 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T07:04:44.547 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T07:04:44.547 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T07:04:44.547 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T07:04:44.547 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T07:04:44.547 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T07:04:44.547 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T07:04:44.548 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T07:04:44.548 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T07:04:44.548 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T07:04:44.548 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T07:04:44.548 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T07:04:44.548 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T07:04:44.548 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T07:04:44.548 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T07:04:44.548 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T07:04:44.548 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T07:04:44.548 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T07:04:44.549 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T07:04:44.549 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T07:04:44.549 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.549 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.549 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T07:04:44.549 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T07:04:44.549 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.549 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T07:04:44.549 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T07:04:44.549 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T07:04:44.549 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T07:04:44.549 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T07:04:44.550 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T07:04:44.550 INFO:teuthology.orchestra.run.smithi033.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T07:04:44.550 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T07:04:44.550 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T07:04:44.550 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T07:04:44.550 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T07:04:44.550 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T07:04:44.550 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T07:04:44.550 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.550 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.550 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:18.0.0-6609.g9725b08f.el8.x86_64 2023-10-08T07:04:44.550 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T07:04:44.551 INFO:teuthology.orchestra.run.smithi033.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T07:04:44.551 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T07:04:44.551 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T07:04:44.551 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T07:04:44.551 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:44.551 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2023-10-08T07:04:44.735 DEBUG:teuthology.parallel:result is None 2023-10-08T07:04:44.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T07:04:44.878 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T07:04:44.908 INFO:teuthology.orchestra.run.smithi017.stdout:18.0.0-6609.g9725b08f.el8 2023-10-08T07:04:44.908 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6609.g9725b08f.el8 2023-10-08T07:04:44.908 INFO:teuthology.task.install:The correct ceph version 18.0.0-6609.g9725b08f is installed. 2023-10-08T07:04:44.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T07:04:45.051 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T07:04:45.076 INFO:teuthology.orchestra.run.smithi033.stdout:18.0.0-6609.g9725b08f.el8 2023-10-08T07:04:45.076 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6609.g9725b08f.el8 2023-10-08T07:04:45.076 INFO:teuthology.task.install:The correct ceph version 18.0.0-6609.g9725b08f is installed. 2023-10-08T07:04:45.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T07:04:45.292 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T07:04:45.321 INFO:teuthology.orchestra.run.smithi086.stdout:18.0.0-6609.g9725b08f.el8 2023-10-08T07:04:45.321 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6609.g9725b08f.el8 2023-10-08T07:04:45.321 INFO:teuthology.task.install:The correct ceph version 18.0.0-6609.g9725b08f is installed. 2023-10-08T07:04:45.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T07:04:45.462 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T07:04:45.492 INFO:teuthology.orchestra.run.smithi144.stdout:18.0.0-6609.g9725b08f.el8 2023-10-08T07:04:45.492 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6609.g9725b08f.el8 2023-10-08T07:04:45.492 INFO:teuthology.task.install:The correct ceph version 18.0.0-6609.g9725b08f is installed. 2023-10-08T07:04:45.493 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T07:04:45.493 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:04:45.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T07:04:45.544 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-08T07:04:45.544 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T07:04:45.594 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-08T07:04:45.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T07:04:45.641 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T07:04:45.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T07:04:45.689 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T07:04:45.689 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:04:45.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T07:04:45.723 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T07:04:45.796 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-08T07:04:45.796 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T07:04:45.830 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T07:04:45.901 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-08T07:04:45.901 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T07:04:45.933 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T07:04:46.003 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T07:04:46.003 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T07:04:46.036 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T07:04:46.106 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T07:04:46.106 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:04:46.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T07:04:46.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T07:04:46.212 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-08T07:04:46.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T07:04:46.245 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T07:04:46.318 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-08T07:04:46.318 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T07:04:46.350 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T07:04:46.420 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T07:04:46.420 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T07:04:46.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T07:04:46.522 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T07:04:46.522 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:04:46.522 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T07:04:46.556 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T07:04:46.629 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-08T07:04:46.629 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T07:04:46.663 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T07:04:46.736 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-08T07:04:46.736 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T07:04:46.767 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T07:04:46.838 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T07:04:46.838 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T07:04:46.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T07:04:46.939 INFO:teuthology.run_tasks:Running task ceph... 2023-10-08T07:04:47.008 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-08T07:04:47.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2023-10-08T07:04:47.011 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /var/log/ceph 2023-10-08T07:04:47.015 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2023-10-08T07:04:47.018 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2023-10-08T07:04:47.048 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-08T07:04:47.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T07:04:47.084 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T07:04:47.087 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T07:04:47.089 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T07:04:47.118 INFO:tasks.ceph:Creating extra log directories... 2023-10-08T07:04:47.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T07:04:47.155 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T07:04:47.160 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T07:04:47.162 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T07:04:47.200 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-08T07:04:47.200 INFO:tasks.ceph:config {'conf': {'global': {'osd_pg_log_dups_tracked': 10000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-08T07:04:47.201 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414', 'branch': 'main', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7417414', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'osd_pg_log_dups_tracked': 10000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 9064, 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'powercycle', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'targets': {'smithi017.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi033.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsync-tester.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-07_14:08:36', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-08T07:04:47.201 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T07:04:47.227 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T07:04:47.230 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T07:04:47.232 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T07:04:47.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T07:04:47.287 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T07:04:47.290 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T07:04:47.293 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T07:04:47.320 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-08T07:04:47.320 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T07:04:47.376 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T07:04:47.376 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2023-10-08T07:04:47.435 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T07:04:47.435 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T07:04:47.435 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 389936 Links: 1 2023-10-08T07:04:47.435 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:04:47.435 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T07:04:47.435 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2023-10-08 07:04:37.308132081 +0000 2023-10-08T07:04:47.435 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2023-10-08 07:01:51.713776761 +0000 2023-10-08T07:04:47.435 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2023-10-08 07:01:51.713776761 +0000 2023-10-08T07:04:47.435 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2023-10-08T07:04:47.436 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T07:04:47.503 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2023-10-08T07:04:47.503 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2023-10-08T07:04:47.503 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000314649 s, 1.6 MB/s 2023-10-08T07:04:47.504 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T07:04:47.563 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2023-10-08T07:04:47.623 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T07:04:47.623 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T07:04:47.623 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 394425 Links: 1 2023-10-08T07:04:47.623 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:04:47.623 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T07:04:47.623 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2023-10-08 07:04:37.308132081 +0000 2023-10-08T07:04:47.623 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2023-10-08 07:01:52.285766938 +0000 2023-10-08T07:04:47.623 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2023-10-08 07:01:52.285766938 +0000 2023-10-08T07:04:47.623 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2023-10-08T07:04:47.624 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T07:04:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2023-10-08T07:04:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2023-10-08T07:04:47.692 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000240969 s, 2.1 MB/s 2023-10-08T07:04:47.693 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T07:04:47.752 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2023-10-08T07:04:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T07:04:47.812 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T07:04:47.812 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 394502 Links: 1 2023-10-08T07:04:47.812 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:04:47.812 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T07:04:47.812 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2023-10-08 07:04:37.308132081 +0000 2023-10-08T07:04:47.812 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2023-10-08 07:01:52.800758093 +0000 2023-10-08T07:04:47.812 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2023-10-08 07:01:52.800758093 +0000 2023-10-08T07:04:47.812 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2023-10-08T07:04:47.812 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T07:04:47.879 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2023-10-08T07:04:47.879 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2023-10-08T07:04:47.879 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000307998 s, 1.7 MB/s 2023-10-08T07:04:47.880 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T07:04:47.939 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2023-10-08T07:04:47.997 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T07:04:47.997 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T07:04:47.997 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 392697 Links: 1 2023-10-08T07:04:47.997 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:04:47.997 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T07:04:47.997 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2023-10-08 07:04:37.308132081 +0000 2023-10-08T07:04:47.997 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2023-10-08 07:01:53.306749403 +0000 2023-10-08T07:04:47.997 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2023-10-08 07:01:53.306749403 +0000 2023-10-08T07:04:47.998 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2023-10-08T07:04:47.998 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T07:04:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2023-10-08T07:04:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2023-10-08T07:04:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.00018717 s, 2.7 MB/s 2023-10-08T07:04:48.066 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T07:04:48.126 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-10-08T07:04:48.126 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-08T07:04:48.126 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T07:04:48.147 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T07:04:48.147 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2023-10-08T07:04:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T07:04:48.208 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T07:04:48.208 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 386831 Links: 1 2023-10-08T07:04:48.209 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:04:48.209 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T07:04:48.209 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-10-08 07:04:29.663061897 +0000 2023-10-08T07:04:48.209 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-10-08 07:01:30.222561876 +0000 2023-10-08T07:04:48.210 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-10-08 07:01:30.222561876 +0000 2023-10-08T07:04:48.210 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-10-08T07:04:48.210 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T07:04:48.278 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-10-08T07:04:48.278 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-10-08T07:04:48.278 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000288328 s, 1.8 MB/s 2023-10-08T07:04:48.279 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T07:04:48.340 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2023-10-08T07:04:48.398 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T07:04:48.398 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T07:04:48.399 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 394672 Links: 1 2023-10-08T07:04:48.399 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:04:48.399 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T07:04:48.399 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-10-08 07:04:29.663061897 +0000 2023-10-08T07:04:48.399 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-10-08 07:01:30.856547494 +0000 2023-10-08T07:04:48.399 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-10-08 07:01:30.856547494 +0000 2023-10-08T07:04:48.399 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-10-08T07:04:48.399 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T07:04:48.466 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-10-08T07:04:48.466 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-10-08T07:04:48.466 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000300994 s, 1.7 MB/s 2023-10-08T07:04:48.467 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T07:04:48.526 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2023-10-08T07:04:48.584 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T07:04:48.584 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T07:04:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 392114 Links: 1 2023-10-08T07:04:48.584 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:04:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T07:04:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-10-08 07:04:29.663061897 +0000 2023-10-08T07:04:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-10-08 07:01:31.389535404 +0000 2023-10-08T07:04:48.585 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-10-08 07:01:31.389535404 +0000 2023-10-08T07:04:48.585 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-10-08T07:04:48.586 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T07:04:48.650 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-10-08T07:04:48.650 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-10-08T07:04:48.650 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000235056 s, 2.2 MB/s 2023-10-08T07:04:48.652 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T07:04:48.710 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2023-10-08T07:04:48.767 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T07:04:48.767 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T07:04:48.767 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 390766 Links: 1 2023-10-08T07:04:48.767 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:04:48.767 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T07:04:48.767 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2023-10-08 07:04:29.663061897 +0000 2023-10-08T07:04:48.767 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2023-10-08 07:01:31.916523449 +0000 2023-10-08T07:04:48.768 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2023-10-08 07:01:31.916523449 +0000 2023-10-08T07:04:48.768 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2023-10-08T07:04:48.768 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T07:04:48.832 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2023-10-08T07:04:48.832 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2023-10-08T07:04:48.832 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000223586 s, 2.3 MB/s 2023-10-08T07:04:48.834 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T07:04:48.891 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-10-08T07:04:48.891 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T07:04:48.892 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T07:04:48.912 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T07:04:48.912 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2023-10-08T07:04:48.972 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T07:04:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T07:04:48.973 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 395284 Links: 1 2023-10-08T07:04:48.973 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:04:48.974 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T07:04:48.974 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-08 07:04:21.163063086 +0000 2023-10-08T07:04:48.974 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-08 07:01:33.611239692 +0000 2023-10-08T07:04:48.974 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-08 07:01:33.611239692 +0000 2023-10-08T07:04:48.974 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-08T07:04:48.975 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T07:04:49.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-08T07:04:49.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-08T07:04:49.043 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000288417 s, 1.8 MB/s 2023-10-08T07:04:49.044 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T07:04:49.103 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2023-10-08T07:04:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T07:04:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T07:04:49.163 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 393465 Links: 1 2023-10-08T07:04:49.163 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:04:49.164 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T07:04:49.164 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-08 07:04:21.163063086 +0000 2023-10-08T07:04:49.164 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-08 07:01:34.113231490 +0000 2023-10-08T07:04:49.164 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-08 07:01:34.113231490 +0000 2023-10-08T07:04:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-08T07:04:49.165 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T07:04:49.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-08T07:04:49.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-08T07:04:49.231 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000265426 s, 1.9 MB/s 2023-10-08T07:04:49.233 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T07:04:49.292 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2023-10-08T07:04:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T07:04:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T07:04:49.351 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 386615 Links: 1 2023-10-08T07:04:49.351 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:04:49.351 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T07:04:49.351 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-08 07:04:21.164063069 +0000 2023-10-08T07:04:49.351 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-08 07:01:34.626223110 +0000 2023-10-08T07:04:49.351 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-08 07:01:34.626223110 +0000 2023-10-08T07:04:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-08T07:04:49.352 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T07:04:49.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-08T07:04:49.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-08T07:04:49.417 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000242061 s, 2.1 MB/s 2023-10-08T07:04:49.418 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T07:04:49.477 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2023-10-08T07:04:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T07:04:49.535 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T07:04:49.535 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 389110 Links: 1 2023-10-08T07:04:49.535 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:04:49.535 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T07:04:49.536 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-08 07:04:21.164063069 +0000 2023-10-08T07:04:49.536 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-08 07:01:35.117215088 +0000 2023-10-08T07:04:49.536 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-08 07:01:35.117215088 +0000 2023-10-08T07:04:49.536 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-08T07:04:49.536 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T07:04:49.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-08T07:04:49.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-08T07:04:49.603 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000177794 s, 2.9 MB/s 2023-10-08T07:04:49.603 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T07:04:49.662 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-10-08T07:04:49.663 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-10-08T07:04:49.663 INFO:tasks.ceph:Generating config... 2023-10-08T07:04:49.665 INFO:tasks.ceph:[global] osd_pg_log_dups_tracked = 10000 2023-10-08T07:04:49.665 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-08T07:04:49.665 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-08T07:04:49.665 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-08T07:04:49.665 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-08T07:04:49.666 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-08T07:04:49.666 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-08T07:04:49.666 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-08T07:04:49.666 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2023-10-08T07:04:49.666 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-08T07:04:49.667 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-08T07:04:49.667 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-08T07:04:49.667 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-08T07:04:49.668 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-08T07:04:49.668 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-08T07:04:49.668 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-08T07:04:49.668 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-08T07:04:49.669 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-08T07:04:49.669 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-08T07:04:49.669 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-10-08T07:04:49.669 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-08T07:04:49.670 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-10-08T07:04:49.670 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-08T07:04:49.670 INFO:tasks.ceph:Setting up mon.a... 2023-10-08T07:04:49.670 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-08T07:04:49.827 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2023-10-08T07:04:49.831 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-08T07:04:49.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T07:04:49.941 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17'), ('mon.b', '[v2:172.21.15.17:3301,v1:172.21.15.17:6790]'), ('mon.c', '[v2:172.21.15.17:3302,v1:172.21.15.17:6791]')] 2023-10-08T07:04:49.942 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],[v2:172.21.15.17:3302,v1:172.21.15.17:6791]', 'osd_pg_log_dups_tracked': 10000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2023-10-08T07:04:49.943 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:04:49.943 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T07:04:50.000 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.17 --addv b '[v2:172.21.15.17:3301,v1:172.21.15.17:6790]' --addv c '[v2:172.21.15.17:3302,v1:172.21.15.17:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-08T07:04:50.091 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-08T07:04:50.091 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid bb50b5dc-93de-4177-9c34-354ea3b007d0 2023-10-08T07:04:50.091 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = pacific 2023-10-08T07:04:50.091 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2023-10-08T07:04:50.091 INFO:teuthology.orchestra.run.smithi017.stdout:fsid bb50b5dc-93de-4177-9c34-354ea3b007d0 2023-10-08T07:04:50.091 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2023-10-08T07:04:50.091009+0000 2023-10-08T07:04:50.091 INFO:teuthology.orchestra.run.smithi017.stdout:created 2023-10-08T07:04:50.091009+0000 2023-10-08T07:04:50.091 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 16 (pacific) 2023-10-08T07:04:50.091 INFO:teuthology.orchestra.run.smithi017.stdout:election_strategy: 1 2023-10-08T07:04:50.092 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2023-10-08T07:04:50.092 INFO:teuthology.orchestra.run.smithi017.stdout:1: [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] mon.b 2023-10-08T07:04:50.092 INFO:teuthology.orchestra.run.smithi017.stdout:2: [v2:172.21.15.17:3302/0,v1:172.21.15.17:6791/0] mon.c 2023-10-08T07:04:50.092 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-08T07:04:50.093 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T07:04:50.111 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bb50b5dc-93de-4177-9c34-354ea3b007d0... 2023-10-08T07:04:50.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T07:04:50.154 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T07:04:50.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T07:04:50.159 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T07:04:50.199 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2023-10-08T07:04:50.199 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2023-10-08T07:04:50.200 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T07:04:50.200 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2023-10-08T07:04:50.200 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.200 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2023-10-08T07:04:50.200 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.200 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2023-10-08T07:04:50.200 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.200 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2023-10-08T07:04:50.200 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2023-10-08T07:04:50.200 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.200 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2023-10-08T07:04:50.201 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2023-10-08T07:04:50.202 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2023-10-08T07:04:50.202 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2023-10-08T07:04:50.202 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2023-10-08T07:04:50.202 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2023-10-08T07:04:50.202 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T07:04:50.202 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T07:04:50.202 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2023-10-08T07:04:50.202 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.202 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T07:04:50.202 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.202 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2023-10-08T07:04:50.202 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2023-10-08T07:04:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2023-10-08T07:04:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2023-10-08T07:04:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2023-10-08T07:04:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],[v2:172.21.15.17:3302,v1:172.21.15.17:6791]" 2023-10-08T07:04:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pg_log_dups_tracked = 10000 2023-10-08T07:04:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = bb50b5dc-93de-4177-9c34-354ea3b007d0 2023-10-08T07:04:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.203 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2023-10-08T07:04:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2023-10-08T07:04:50.203 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2023-10-08T07:04:50.204 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2023-10-08T07:04:50.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.205 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2023-10-08T07:04:50.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.205 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2023-10-08T07:04:50.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.205 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2023-10-08T07:04:50.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.205 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2023-10-08T07:04:50.205 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2023-10-08T07:04:50.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.205 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2023-10-08T07:04:50.205 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2023-10-08T07:04:50.206 INFO:teuthology.orchestra.run.smithi017.stdout: bdev async discard = True 2023-10-08T07:04:50.206 INFO:teuthology.orchestra.run.smithi017.stdout: bdev enable discard = True 2023-10-08T07:04:50.206 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore allocator = stupid 2023-10-08T07:04:50.206 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2023-10-08T07:04:50.206 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2023-10-08T07:04:50.206 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 1/20 2023-10-08T07:04:50.206 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 1/20 2023-10-08T07:04:50.206 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-10-08T07:04:50.206 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2023-10-08T07:04:50.206 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 4/10 2023-10-08T07:04:50.206 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T07:04:50.207 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2023-10-08T07:04:50.207 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2023-10-08T07:04:50.207 INFO:teuthology.orchestra.run.smithi017.stdout: osd blocked scrub grace period = 3600 2023-10-08T07:04:50.207 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2023-10-08T07:04:50.207 INFO:teuthology.orchestra.run.smithi017.stdout: osd max markdown count = 1000 2023-10-08T07:04:50.207 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2023-10-08T07:04:50.207 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.207 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2023-10-08T07:04:50.207 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-10-08T07:04:50.207 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2023-10-08T07:04:50.207 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2023-10-08T07:04:50.207 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2023-10-08T07:04:50.208 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2023-10-08T07:04:50.209 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2023-10-08T07:04:50.209 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2023-10-08T07:04:50.209 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.209 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T07:04:50.209 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T07:04:50.209 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T07:04:50.209 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.209 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T07:04:50.209 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T07:04:50.209 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T07:04:50.209 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.209 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2023-10-08T07:04:50.210 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2023-10-08T07:04:50.210 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.210 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2023-10-08T07:04:50.210 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:04:50.210 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2023-10-08T07:04:50.210 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2023-10-08T07:04:50.210 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2023-10-08T07:04:50.210 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2023-10-08T07:04:50.210 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T07:04:50.210 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T07:04:50.210 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2023-10-08T07:04:50.210 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2023-10-08T07:04:50.211 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2023-10-08T07:04:50.211 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2023-10-08T07:04:50.211 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2023-10-08T07:04:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2023-10-08T07:04:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T07:04:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2023-10-08T07:04:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2023-10-08T07:04:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2023-10-08T07:04:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2023-10-08T07:04:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2023-10-08T07:04:50.212 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2023-10-08T07:04:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2023-10-08T07:04:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T07:04:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2023-10-08T07:04:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T07:04:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T07:04:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2023-10-08T07:04:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.213 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2023-10-08T07:04:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2023-10-08T07:04:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2023-10-08T07:04:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2023-10-08T07:04:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2023-10-08T07:04:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2023-10-08T07:04:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2023-10-08T07:04:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T07:04:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T07:04:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2023-10-08T07:04:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T07:04:50.214 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2023-10-08T07:04:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2023-10-08T07:04:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2023-10-08T07:04:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2023-10-08T07:04:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2023-10-08T07:04:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],[v2:172.21.15.17:3302,v1:172.21.15.17:6791]" 2023-10-08T07:04:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pg_log_dups_tracked = 10000 2023-10-08T07:04:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = bb50b5dc-93de-4177-9c34-354ea3b007d0 2023-10-08T07:04:50.215 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.216 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2023-10-08T07:04:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2023-10-08T07:04:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2023-10-08T07:04:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2023-10-08T07:04:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2023-10-08T07:04:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2023-10-08T07:04:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2023-10-08T07:04:50.216 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2023-10-08T07:04:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2023-10-08T07:04:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2023-10-08T07:04:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2023-10-08T07:04:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2023-10-08T07:04:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2023-10-08T07:04:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2023-10-08T07:04:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.217 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2023-10-08T07:04:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2023-10-08T07:04:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2023-10-08T07:04:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2023-10-08T07:04:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2023-10-08T07:04:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: bdev async discard = True 2023-10-08T07:04:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: bdev enable discard = True 2023-10-08T07:04:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore allocator = stupid 2023-10-08T07:04:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2023-10-08T07:04:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2023-10-08T07:04:50.218 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 1/20 2023-10-08T07:04:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 1/20 2023-10-08T07:04:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-10-08T07:04:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2023-10-08T07:04:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 4/10 2023-10-08T07:04:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T07:04:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2023-10-08T07:04:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2023-10-08T07:04:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: osd blocked scrub grace period = 3600 2023-10-08T07:04:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2023-10-08T07:04:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: osd max markdown count = 1000 2023-10-08T07:04:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2023-10-08T07:04:50.219 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.220 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2023-10-08T07:04:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-10-08T07:04:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2023-10-08T07:04:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2023-10-08T07:04:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2023-10-08T07:04:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2023-10-08T07:04:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2023-10-08T07:04:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2023-10-08T07:04:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.220 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2023-10-08T07:04:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2023-10-08T07:04:50.220 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2023-10-08T07:04:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2023-10-08T07:04:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2023-10-08T07:04:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2023-10-08T07:04:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2023-10-08T07:04:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2023-10-08T07:04:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2023-10-08T07:04:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2023-10-08T07:04:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2023-10-08T07:04:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T07:04:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T07:04:50.221 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T07:04:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T07:04:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T07:04:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T07:04:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2023-10-08T07:04:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2023-10-08T07:04:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2023-10-08T07:04:50.222 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-10-08T07:04:50.222 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2023-10-08T07:04:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2023-10-08T07:04:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2023-10-08T07:04:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2023-10-08T07:04:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T07:04:50.223 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T07:04:50.223 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2023-10-08T07:04:50.223 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2023-10-08T07:04:50.223 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2023-10-08T07:04:50.223 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2023-10-08T07:04:50.223 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2023-10-08T07:04:50.223 INFO:teuthology.orchestra.run.smithi033.stdout: chdir = "" 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: auth supported = cephx 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: filestore xattr use omap = true 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: mon clock drift allowed = 1.000 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: osd crush chooseleaf type = 0 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: auth debug = true 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on old message = true 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on bug = true 2023-10-08T07:04:50.224 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.225 INFO:teuthology.orchestra.run.smithi033.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T07:04:50.225 INFO:teuthology.orchestra.run.smithi033.stdout: mon pg warn max object skew = 0 2023-10-08T07:04:50.225 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.225 INFO:teuthology.orchestra.run.smithi033.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T07:04:50.225 INFO:teuthology.orchestra.run.smithi033.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T07:04:50.225 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.225 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default size = 2 2023-10-08T07:04:50.225 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.225 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow primary affinity = true 2023-10-08T07:04:50.225 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow pg remap = true 2023-10-08T07:04:50.225 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on legacy crush tunables = false 2023-10-08T07:04:50.226 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on crush straw calc version zero = false 2023-10-08T07:04:50.226 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on no sortbitwise = false 2023-10-08T07:04:50.226 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on osd down out interval zero = false 2023-10-08T07:04:50.226 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on too few osds = false 2023-10-08T07:04:50.226 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T07:04:50.226 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T07:04:50.226 INFO:teuthology.orchestra.run.smithi033.stdout: mon_allow_pool_size_one = true 2023-10-08T07:04:50.226 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.226 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T07:04:50.226 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.226 INFO:teuthology.orchestra.run.smithi033.stdout: osd default data pool replay window = 5 2023-10-08T07:04:50.227 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.227 INFO:teuthology.orchestra.run.smithi033.stdout: mon allow pool delete = true 2023-10-08T07:04:50.227 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.227 INFO:teuthology.orchestra.run.smithi033.stdout: mon cluster log file level = debug 2023-10-08T07:04:50.227 INFO:teuthology.orchestra.run.smithi033.stdout: debug asserts on shutdown = true 2023-10-08T07:04:50.227 INFO:teuthology.orchestra.run.smithi033.stdout: mon health detail to clog = false 2023-10-08T07:04:50.227 INFO:teuthology.orchestra.run.smithi033.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],[v2:172.21.15.17:3302,v1:172.21.15.17:6791]" 2023-10-08T07:04:50.227 INFO:teuthology.orchestra.run.smithi033.stdout: osd_pg_log_dups_tracked = 10000 2023-10-08T07:04:50.227 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = bb50b5dc-93de-4177-9c34-354ea3b007d0 2023-10-08T07:04:50.227 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.227 INFO:teuthology.orchestra.run.smithi033.stdout:[osd] 2023-10-08T07:04:50.227 INFO:teuthology.orchestra.run.smithi033.stdout: osd journal size = 100 2023-10-08T07:04:50.228 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.228 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub load threshold = 5.0 2023-10-08T07:04:50.228 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub max interval = 600 2023-10-08T07:04:50.228 INFO:teuthology.orchestra.run.smithi033.stdout: osd mclock profile = high_recovery_ops 2023-10-08T07:04:50.228 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.228 INFO:teuthology.orchestra.run.smithi033.stdout: osd recover clone overlap = true 2023-10-08T07:04:50.228 INFO:teuthology.orchestra.run.smithi033.stdout: osd recovery max chunk = 1048576 2023-10-08T07:04:50.228 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.228 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug shutdown = true 2023-10-08T07:04:50.228 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug op order = true 2023-10-08T07:04:50.228 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug verify stray on activate = true 2023-10-08T07:04:50.228 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.229 INFO:teuthology.orchestra.run.smithi033.stdout: osd open classes on start = true 2023-10-08T07:04:50.229 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug pg log writeout = true 2023-10-08T07:04:50.229 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.229 INFO:teuthology.orchestra.run.smithi033.stdout: osd deep scrub update digest min age = 30 2023-10-08T07:04:50.229 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.229 INFO:teuthology.orchestra.run.smithi033.stdout: osd map max advance = 10 2023-10-08T07:04:50.229 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.229 INFO:teuthology.orchestra.run.smithi033.stdout: journal zero on create = true 2023-10-08T07:04:50.229 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.229 INFO:teuthology.orchestra.run.smithi033.stdout: filestore ondisk finisher threads = 3 2023-10-08T07:04:50.229 INFO:teuthology.orchestra.run.smithi033.stdout: filestore apply finisher threads = 3 2023-10-08T07:04:50.229 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.230 INFO:teuthology.orchestra.run.smithi033.stdout: bdev debug aio = true 2023-10-08T07:04:50.230 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug misdirected ops = true 2023-10-08T07:04:50.230 INFO:teuthology.orchestra.run.smithi033.stdout: bdev async discard = True 2023-10-08T07:04:50.230 INFO:teuthology.orchestra.run.smithi033.stdout: bdev enable discard = True 2023-10-08T07:04:50.230 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore allocator = stupid 2023-10-08T07:04:50.230 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore block size = 96636764160 2023-10-08T07:04:50.230 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore fsck on mount = True 2023-10-08T07:04:50.230 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluefs = 1/20 2023-10-08T07:04:50.230 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluestore = 1/20 2023-10-08T07:04:50.230 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-08T07:04:50.230 INFO:teuthology.orchestra.run.smithi033.stdout: debug osd = 20 2023-10-08T07:04:50.230 INFO:teuthology.orchestra.run.smithi033.stdout: debug rocksdb = 4/10 2023-10-08T07:04:50.231 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T07:04:50.231 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd full ratio = 0.9 2023-10-08T07:04:50.231 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd nearfull ratio = 0.8 2023-10-08T07:04:50.231 INFO:teuthology.orchestra.run.smithi033.stdout: osd blocked scrub grace period = 3600 2023-10-08T07:04:50.231 INFO:teuthology.orchestra.run.smithi033.stdout: osd failsafe full ratio = 0.95 2023-10-08T07:04:50.231 INFO:teuthology.orchestra.run.smithi033.stdout: osd max markdown count = 1000 2023-10-08T07:04:50.231 INFO:teuthology.orchestra.run.smithi033.stdout: osd objectstore = bluestore 2023-10-08T07:04:50.231 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.231 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr] 2023-10-08T07:04:50.231 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-08T07:04:50.231 INFO:teuthology.orchestra.run.smithi033.stdout: debug mgr = 20 2023-10-08T07:04:50.231 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2023-10-08T07:04:50.232 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2023-10-08T07:04:50.232 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2023-10-08T07:04:50.232 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2023-10-08T07:04:50.232 INFO:teuthology.orchestra.run.smithi033.stdout: mgr/telemetry/nag = false 2023-10-08T07:04:50.232 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.232 INFO:teuthology.orchestra.run.smithi033.stdout:[mon] 2023-10-08T07:04:50.232 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-08T07:04:50.232 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2023-10-08T07:04:50.232 INFO:teuthology.orchestra.run.smithi033.stdout: debug paxos = 20 2023-10-08T07:04:50.232 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2023-10-08T07:04:50.232 INFO:teuthology.orchestra.run.smithi033.stdout: mon data avail warn = 5 2023-10-08T07:04:50.233 INFO:teuthology.orchestra.run.smithi033.stdout: mon mgr mkfs grace = 240 2023-10-08T07:04:50.233 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2023-10-08T07:04:50.233 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd reporter subtree level = osd 2023-10-08T07:04:50.233 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd prime pg temp = true 2023-10-08T07:04:50.233 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2023-10-08T07:04:50.233 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.233 INFO:teuthology.orchestra.run.smithi033.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T07:04:50.233 INFO:teuthology.orchestra.run.smithi033.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T07:04:50.233 INFO:teuthology.orchestra.run.smithi033.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T07:04:50.233 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.234 INFO:teuthology.orchestra.run.smithi033.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T07:04:50.234 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T07:04:50.234 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T07:04:50.234 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.234 INFO:teuthology.orchestra.run.smithi033.stdout: # 1m isn't quite enough 2023-10-08T07:04:50.234 INFO:teuthology.orchestra.run.smithi033.stdout: mon_down_mkfs_grace = 2m 2023-10-08T07:04:50.234 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.234 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_filestore_osds = false 2023-10-08T07:04:50.234 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-08T07:04:50.234 INFO:teuthology.orchestra.run.smithi033.stdout:[client] 2023-10-08T07:04:50.234 INFO:teuthology.orchestra.run.smithi033.stdout: rgw cache enabled = true 2023-10-08T07:04:50.234 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable ops log = true 2023-10-08T07:04:50.235 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable usage log = true 2023-10-08T07:04:50.235 INFO:teuthology.orchestra.run.smithi033.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T07:04:50.235 INFO:teuthology.orchestra.run.smithi033.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T07:04:50.235 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.a] 2023-10-08T07:04:50.235 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.b] 2023-10-08T07:04:50.235 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.c] 2023-10-08T07:04:50.235 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2023-10-08T07:04:50.237 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2023-10-08T07:04:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2023-10-08T07:04:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T07:04:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2023-10-08T07:04:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2023-10-08T07:04:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2023-10-08T07:04:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2023-10-08T07:04:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2023-10-08T07:04:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2023-10-08T07:04:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2023-10-08T07:04:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T07:04:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2023-10-08T07:04:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T07:04:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T07:04:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2023-10-08T07:04:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2023-10-08T07:04:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2023-10-08T07:04:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2023-10-08T07:04:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2023-10-08T07:04:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2023-10-08T07:04:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2023-10-08T07:04:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2023-10-08T07:04:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T07:04:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T07:04:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2023-10-08T07:04:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T07:04:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2023-10-08T07:04:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2023-10-08T07:04:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2023-10-08T07:04:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2023-10-08T07:04:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2023-10-08T07:04:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],[v2:172.21.15.17:3302,v1:172.21.15.17:6791]" 2023-10-08T07:04:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pg_log_dups_tracked = 10000 2023-10-08T07:04:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = bb50b5dc-93de-4177-9c34-354ea3b007d0 2023-10-08T07:04:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.242 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2023-10-08T07:04:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2023-10-08T07:04:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2023-10-08T07:04:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2023-10-08T07:04:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2023-10-08T07:04:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2023-10-08T07:04:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2023-10-08T07:04:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2023-10-08T07:04:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2023-10-08T07:04:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2023-10-08T07:04:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2023-10-08T07:04:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2023-10-08T07:04:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2023-10-08T07:04:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2023-10-08T07:04:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2023-10-08T07:04:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2023-10-08T07:04:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2023-10-08T07:04:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2023-10-08T07:04:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2023-10-08T07:04:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: bdev async discard = True 2023-10-08T07:04:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: bdev enable discard = True 2023-10-08T07:04:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore allocator = stupid 2023-10-08T07:04:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2023-10-08T07:04:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2023-10-08T07:04:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 1/20 2023-10-08T07:04:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 1/20 2023-10-08T07:04:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 4/10 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: osd blocked scrub grace period = 3600 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: osd max markdown count = 1000 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-08T07:04:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2023-10-08T07:04:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-10-08T07:04:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-10-08T07:04:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-10-08T07:04:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-10-08T07:04:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2023-10-08T07:04:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.246 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2023-10-08T07:04:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-08T07:04:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-10-08T07:04:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2023-10-08T07:04:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-10-08T07:04:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2023-10-08T07:04:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2023-10-08T07:04:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-10-08T07:04:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2023-10-08T07:04:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2023-10-08T07:04:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-10-08T07:04:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T07:04:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T07:04:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T07:04:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T07:04:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T07:04:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T07:04:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2023-10-08T07:04:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2023-10-08T07:04:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2023-10-08T07:04:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T07:04:50.248 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2023-10-08T07:04:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2023-10-08T07:04:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2023-10-08T07:04:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2023-10-08T07:04:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T07:04:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T07:04:50.249 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2023-10-08T07:04:50.249 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2023-10-08T07:04:50.249 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2023-10-08T07:04:50.249 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2023-10-08T07:04:50.249 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-08T07:04:50.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-08T07:04:50.348 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-08T07:04:50.348 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:04:50.349 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-08T07:04:50.365 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:04:50.365 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-08T07:04:50.421 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2023-10-08T07:04:50.421 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:04:50.421 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T07:04:50.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T07:04:50.526 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:04:50.526 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T07:04:50.624 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi033.front.sepia.ceph.com 2023-10-08T07:04:50.624 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-08T07:04:50.624 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T07:04:50.625 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T07:04:50.670 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-08T07:04:50.670 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T07:04:50.729 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2023-10-08T07:04:50.729 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-08T07:04:50.730 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T07:04:50.730 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T07:04:50.773 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-08T07:04:50.773 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T07:04:50.833 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T07:04:50.833 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T07:04:50.833 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T07:04:50.833 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T07:04:50.877 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T07:04:50.877 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T07:04:50.935 INFO:tasks.ceph:Setting up mon nodes... 2023-10-08T07:04:50.936 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-08T07:04:50.936 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T07:04:51.001 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T07:04:51.004 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T07:04:51.063 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T07:04:51.066 INFO:tasks.ceph:Setting up mds nodes... 2023-10-08T07:04:51.066 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T07:04:51.121 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T07:04:51.124 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-08T07:04:51.392 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-08T07:04:51.392 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T07:04:51.437 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-08T07:04:51.451 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-08T07:04:51.451 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-10-08T07:04:51.451 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-08T07:04:51.485 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-10-08T07:04:51.485 INFO:tasks.ceph:role: osd.0 2023-10-08T07:04:51.485 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com 2023-10-08T07:04:51.485 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T07:04:51.565 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T07:04:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T07:04:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T07:04:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T07:04:51.565 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T07:04:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2023-10-08T07:04:51.565 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T07:04:51.565 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T07:04:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T07:04:51.565 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T07:04:51.993 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2023-10-08T07:04:51.995 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2023-10-08T07:04:51.995 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-08T07:04:52.167 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-08T07:04:52.208 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T07:04:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-08T07:04:52.662+0000 7feec2e42640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-08T07:04:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-08T07:04:52.662+0000 7feec2e42640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-08T07:04:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-08T07:04:52.662+0000 7feec2e42640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T07:04:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-08T07:04:52.662+0000 7feec2e42640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T07:04:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-08T07:04:52.662+0000 7feec2e42640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T07:04:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-08T07:04:52.663+0000 7feec2e42640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-08T07:04:55.574 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-08T07:04:55.615 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-08T07:04:55.648 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-10-08T07:04:55.648 INFO:tasks.ceph:role: osd.1 2023-10-08T07:04:55.648 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2023-10-08T07:04:55.648 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T07:04:55.726 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T07:04:55.726 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T07:04:55.726 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T07:04:55.726 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T07:04:55.727 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T07:04:55.727 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2023-10-08T07:04:55.727 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T07:04:55.727 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T07:04:55.727 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T07:04:55.727 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T07:04:56.168 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2023-10-08T07:04:56.170 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2023-10-08T07:04:56.171 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-10-08T07:04:56.363 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-08T07:04:56.399 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T07:04:56.536 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-08T07:04:56.535+0000 7f6f0b28b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-08T07:04:56.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-08T07:04:56.535+0000 7f6f0b28b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-08T07:04:56.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-08T07:04:56.535+0000 7f6f0b28b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T07:04:56.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-08T07:04:56.535+0000 7f6f0b28b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T07:04:56.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-08T07:04:56.535+0000 7f6f0b28b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T07:04:56.537 INFO:teuthology.orchestra.run.smithi086.stderr:2023-10-08T07:04:56.536+0000 7f6f0b28b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-08T07:04:59.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-08T07:04:59.527 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-08T07:04:59.561 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-10-08T07:04:59.561 INFO:tasks.ceph:role: osd.2 2023-10-08T07:04:59.561 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T07:04:59.561 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T07:04:59.640 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T07:04:59.641 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T07:04:59.641 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T07:04:59.641 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-08T07:04:59.641 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T07:04:59.641 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-10-08T07:04:59.641 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T07:04:59.641 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T07:04:59.641 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T07:04:59.641 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T07:05:00.074 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-10-08T07:05:00.076 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-10-08T07:05:00.076 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-10-08T07:05:00.253 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-08T07:05:00.290 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T07:05:00.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T07:05:00.438+0000 7fc7fdaf6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-08T07:05:00.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T07:05:00.440+0000 7fc7fdaf6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-08T07:05:00.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T07:05:00.440+0000 7fc7fdaf6640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T07:05:00.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T07:05:00.440+0000 7fc7fdaf6640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T07:05:00.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T07:05:00.440+0000 7fc7fdaf6640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T07:05:00.443 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T07:05:00.442+0000 7fc7fdaf6640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-08T07:05:03.323 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-08T07:05:03.386 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-08T07:05:03.386 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:05:03.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-08T07:05:03.420 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:05:03.420 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-08T07:05:03.491 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:05:03.491 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-08T07:05:03.562 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-08T07:05:03.562 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-08T07:05:03.596 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-08T07:05:03.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-08T07:05:03.628 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T07:05:03.628 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-08T07:05:03.659 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:05:03.659 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-08T07:05:03.678 INFO:tasks.ceph:Adding keys to all mons... 2023-10-08T07:05:03.678 DEBUG:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T07:05:03.745 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2023-10-08T07:05:03.745 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCTVCJlo7MUABAAIjC+5vlCDvnW2e9JF8qZIg== 2023-10-08T07:05:03.745 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.y] 2023-10-08T07:05:03.746 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCTVCJlq6rJAxAA8t3/BnBlp9IGYaQXMKNlpQ== 2023-10-08T07:05:03.746 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2023-10-08T07:05:03.746 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCTVCJlutRGBxAAuDlNXyRLpnVpIJagAzzrJg== 2023-10-08T07:05:03.746 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2023-10-08T07:05:03.746 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCUVCJlkOCQJxAAhxixU+KR4pd3kx/OwZ7NNQ== 2023-10-08T07:05:03.746 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2023-10-08T07:05:03.746 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCYVCJlwM76HxAAftkqy+vQbBpTakIcvL2dDQ== 2023-10-08T07:05:03.746 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2023-10-08T07:05:03.746 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCcVCJlJrQwGhAAsVAPbMy/IVV223N41+sEow== 2023-10-08T07:05:03.746 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-10-08T07:05:03.746 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCTVCJl848bGhAAYP+tOjPZqozQgKHKOAtNRg== 2023-10-08T07:05:03.747 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T07:05:03.844 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T07:05:03.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T07:05:03.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T07:05:04.011 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T07:05:04.065 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T07:05:04.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T07:05:04.176 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-08T07:05:04.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-08T07:05:04.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T07:05:04.342 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-08T07:05:04.368 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-08T07:05:04.436 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T07:05:04.535 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-08T07:05:04.563 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-08T07:05:04.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T07:05:04.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-08T07:05:04.756 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T07:05:04.813 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-08T07:05:04.813 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-08T07:05:04.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-08T07:05:04.855 INFO:tasks.ceph.mon.a:Started 2023-10-08T07:05:04.856 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-08T07:05:04.856 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-08T07:05:04.857 INFO:tasks.ceph.mon.b:Started 2023-10-08T07:05:04.858 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-08T07:05:04.858 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-08T07:05:04.859 INFO:tasks.ceph.mon.c:Started 2023-10-08T07:05:04.859 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-08T07:05:04.860 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-08T07:05:04.860 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-08T07:05:04.862 INFO:tasks.ceph.mgr.x:Started 2023-10-08T07:05:04.862 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T07:05:04.862 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T07:05:04.864 INFO:tasks.ceph.mgr.y:Started 2023-10-08T07:05:04.864 INFO:tasks.ceph:Setting crush tunables to default 2023-10-08T07:05:04.865 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2023-10-08T07:05:10.358 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2023-10-08T07:05:10.370 INFO:tasks.ceph:check_enable_crimson: False 2023-10-08T07:05:10.370 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-08T07:05:10.371 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-08T07:05:10.371 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-08T07:05:10.389 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:10.388+0000 7f4c97725200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T07:05:10.404 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2023-10-08T07:05:10.405 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-08T07:05:10.436 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T07:05:10.436 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-08T07:05:10.458 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:10.457+0000 7f4c97725200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T07:05:10.467 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new ba776b12-56dd-4565-ab87-300e9dcd9f20 0 2023-10-08T07:05:10.538 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:10.537+0000 7f4c97725200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T07:05:10.621 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:10.619+0000 7f4c97725200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T07:05:10.725 INFO:teuthology.orchestra.run.smithi144.stdout:0 2023-10-08T07:05:10.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 69c35118-ff9d-4847-ba6c-37d3e9805dbe 1 2023-10-08T07:05:10.771 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:10.770+0000 7f4c97725200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T07:05:10.946 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-08T07:05:10.959 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 98332c95-54f9-4263-a295-d2a753d9f200 2 2023-10-08T07:05:11.079 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:11.077+0000 7fe424774200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T07:05:11.150 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:11.149+0000 7fe424774200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T07:05:11.170 INFO:teuthology.orchestra.run.smithi144.stdout:2 2023-10-08T07:05:11.182 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-08T07:05:11.182 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-08T07:05:11.185 INFO:tasks.ceph.osd.0:Started 2023-10-08T07:05:11.185 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T07:05:11.185 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T07:05:11.187 INFO:tasks.ceph.osd.1:Started 2023-10-08T07:05:11.187 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T07:05:11.188 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T07:05:11.190 INFO:tasks.ceph.osd.2:Started 2023-10-08T07:05:11.190 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:11.194 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:11.193+0000 7f4c97725200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T07:05:11.229 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:11.227+0000 7fe424774200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T07:05:11.319 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:11.318+0000 7fe424774200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T07:05:11.324 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:11.323+0000 7f4c97725200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T07:05:11.418 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:11.419 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:11.167705+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:11.432 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-08T07:05:11.432 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-08T07:05:11.484 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:11.483+0000 7fe424774200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T07:05:11.498 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:11.497+0000 7f4c97725200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T07:05:11.585 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:11.584+0000 7f4c97725200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T07:05:11.735 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:11.785 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:11.784+0000 7efe794fe640 -1 Falling back to public interface 2023-10-08T07:05:11.790 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:11.789+0000 7f8988796640 -1 Falling back to public interface 2023-10-08T07:05:11.793 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:11.792+0000 7f11ec7aa640 -1 Falling back to public interface 2023-10-08T07:05:11.836 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:11.835+0000 7fe424774200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T07:05:11.930 INFO:teuthology.misc.health.smithi017.stdout: 2023-10-08T07:05:11.931 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":5,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:11.167705+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:11.942 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-10-08T07:05:11.960 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:11.959+0000 7fe424774200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T07:05:12.038 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:12.037+0000 7fe424774200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T07:05:12.124 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:12.123+0000 7fe424774200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T07:05:12.144 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:12.143+0000 7f4c97725200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T07:05:12.522 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:12.521+0000 7fe424774200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T07:05:12.942 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:12.941+0000 7f4c97725200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T07:05:13.056 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:13.055+0000 7f4c97725200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T07:05:13.205 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:13.204+0000 7fe424774200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T07:05:13.279 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:13.278+0000 7fe424774200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T07:05:13.794 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:13.792+0000 7f4c97725200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T07:05:13.880 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:13.879+0000 7f4c97725200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T07:05:13.959 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:13.958+0000 7fe424774200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T07:05:14.030 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:14.029+0000 7f4c97725200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T07:05:14.041 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:14.040+0000 7fe424774200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T07:05:14.195 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:14.193+0000 7fe424774200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T07:05:14.294 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:14.292+0000 7f4c97725200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T07:05:14.450 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:14.449+0000 7fe424774200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T07:05:14.516 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:14.515+0000 7f4c97725200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T07:05:14.529 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:14.528+0000 7fe424774200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T07:05:14.663 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:14.662+0000 7f4c97725200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T07:05:14.811 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:14.809+0000 7fe424774200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T07:05:14.897 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:14.896+0000 7f4c97725200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T07:05:15.045 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:15.044+0000 7fe424774200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T07:05:15.063 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:15.062+0000 7f4c97725200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T07:05:15.189 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:15.188+0000 7f4c97725200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T07:05:15.204 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:15.202+0000 7fe424774200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T07:05:15.254 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:15.253+0000 7efe794fe640 -1 osd.2 0 log_to_monitors true 2023-10-08T07:05:15.265 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:15.264+0000 7f11ec7aa640 -1 osd.0 0 log_to_monitors true 2023-10-08T07:05:15.265 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:15.266+0000 7f8988796640 -1 osd.1 0 log_to_monitors true 2023-10-08T07:05:15.330 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:15.329+0000 7fe424774200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T07:05:15.495 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:15.494+0000 7fe424774200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T07:05:15.530 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:15.529+0000 7f4c97725200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T07:05:15.641 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:15.640+0000 7f4c97725200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T07:05:15.771 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:15.770+0000 7fe424774200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T07:05:15.841 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:15.840+0000 7f4c97725200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T07:05:15.941 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:15.940+0000 7fe424774200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T07:05:16.481 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:16.481+0000 7f4c97725200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T07:05:16.509 INFO:tasks.ceph.mgr.x.smithi017.stderr:2023-10-08T07:05:16.509+0000 7fe424774200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T07:05:17.510 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:17.509+0000 7f4c4f689700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-08T07:05:17.510 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:05:17.510+0000 7f4c4f689700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T07:05:17.957 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:17.956+0000 7f897c34d700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T07:05:17.980 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:17.979+0000 7f8974728700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T07:05:18.120 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:18.119+0000 7f11e1b64700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T07:05:18.136 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:18.135+0000 7f11d873c700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T07:05:18.245 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:18.260 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:18.260+0000 7efe6d0b5700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T07:05:18.278 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:18.278+0000 7efe65490700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T07:05:18.585 INFO:teuthology.misc.health.smithi017.stdout: 2023-10-08T07:05:18.585 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":7,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:16.986875+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:18.598 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-10-08T07:05:24.900 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:25.241 INFO:teuthology.misc.health.smithi017.stdout: 2023-10-08T07:05:25.241 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":12,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:23.275026+0000","last_up_change":"2023-10-08T07:05:18.991889+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:25.255 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-10-08T07:05:25.255 INFO:tasks.ceph:Creating RBD pool 2023-10-08T07:05:25.255 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-08T07:05:26.290 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'rbd' created 2023-10-08T07:05:26.303 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-08T07:05:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-08T07:05:27.308 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-08T07:05:27.308 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T07:05:27.309 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T07:05:27.311 INFO:tasks.ceph.mds.a:Started 2023-10-08T07:05:27.311 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-08T07:05:27.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:27.398 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-10-08T07:05:27.658 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:27.658 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":14,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:27.283161+0000","last_up_change":"2023-10-08T07:05:18.991889+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:27.672 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T07:05:20.557481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T07:05:25.624853+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T07:05:27.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T07:05:28.009 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-08T07:05:28.023 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-08T07:05:28.364 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-08T07:05:28.378 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T07:05:28.757 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:28.758 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6803/122402808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":122402808},{"type":"v1","addr":"172.21.15.17:6803","nonce":122402808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T07:05:28.760 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2023-10-08T07:05:28.772 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:29.107 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":15,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:28.287777+0000","last_up_change":"2023-10-08T07:05:18.991889+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:29.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T07:05:20.557481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T07:05:25.624853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T07:05:29.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T07:05:29.460 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-08T07:05:29.474 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-08T07:05:29.813 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-08T07:05:29.827 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T07:05:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:30.166 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-10-08T07:05:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-10-08T07:05:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-10-08T07:05:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 2, 2023-10-08T07:05:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": "rbd" 2023-10-08T07:05:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:30.167 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-10-08T07:05:30.180 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T07:05:30.180 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T07:05:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-10-08T07:05:31.316 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T07:05:32.311 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-10-08T07:05:32.325 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T07:05:33.318 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 3 and data pool 4 2023-10-08T07:05:33.333 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:33.677 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:33.678 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":18,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:32.715791+0000","last_up_change":"2023-10-08T07:05:18.991889+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:33.692 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:34.028 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:34.028 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":18,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:32.715791+0000","last_up_change":"2023-10-08T07:05:18.991889+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:34.042 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T07:05:35.337 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-08T07:05:35.337 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T07:05:36.339 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-08T07:05:36.340 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T07:05:36.720 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:36.720 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T07:05:32.716095+0000","modified":"2023-10-08T07:05:35.730191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6803/122402808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":122402808},{"type":"v1","addr":"172.21.15.17:6803","nonce":122402808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T07:05:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2023-10-08T07:05:36.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:37.071 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:37.071 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:34.310228+0000","last_up_change":"2023-10-08T07:05:18.991889+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:37.085 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T07:05:37.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:05:37.420 INFO:tasks.ceph.mds.a.smithi017.stderr:2023-10-08T07:05:37.418+0000 7f607837c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T07:05:37.432 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:37.434 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:05:37.441 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-08T07:05:36.502974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91084,"kb_used_data":1688,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024436,"statfs":{"total":289910292480,"available":289817022464,"internally_reserved":0,"allocated":1728512,"data_stored":1349441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":91483475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.203501"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361123+0000","last_change":"2023-10-08T07:05:33.319747+0000","last_active":"2023-10-08T07:05:34.361123+0000","last_peered":"2023-10-08T07:05:34.361123+0000","last_clean":"2023-10-08T07:05:34.361123+0000","last_became_active":"2023-10-08T07:05:33.318115+0000","last_became_peered":"2023-10-08T07:05:33.318115+0000","last_unstale":"2023-10-08T07:05:34.361123+0000","last_undegraded":"2023-10-08T07:05:34.361123+0000","last_fullsized":"2023-10-08T07:05:34.361123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360608+0000","last_change":"2023-10-08T07:05:33.322480+0000","last_active":"2023-10-08T07:05:34.360608+0000","last_peered":"2023-10-08T07:05:34.360608+0000","last_clean":"2023-10-08T07:05:34.360608+0000","last_became_active":"2023-10-08T07:05:33.322153+0000","last_became_peered":"2023-10-08T07:05:33.322153+0000","last_unstale":"2023-10-08T07:05:34.360608+0000","last_undegraded":"2023-10-08T07:05:34.360608+0000","last_fullsized":"2023-10-08T07:05:34.360608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:33.325067+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:33.323439+0000","last_became_peered":"2023-10-08T07:05:33.323439+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:18.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320530+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:05:34.320530+0000","last_peered":"2023-10-08T07:05:34.320530+0000","last_clean":"2023-10-08T07:05:34.320530+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:05:34.320530+0000","last_undegraded":"2023-10-08T07:05:34.320530+0000","last_fullsized":"2023-10-08T07:05:34.320530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360128+0000","last_change":"2023-10-08T07:05:33.321314+0000","last_active":"2023-10-08T07:05:34.360128+0000","last_peered":"2023-10-08T07:05:34.360128+0000","last_clean":"2023-10-08T07:05:34.360128+0000","last_became_active":"2023-10-08T07:05:33.320841+0000","last_became_peered":"2023-10-08T07:05:33.320841+0000","last_unstale":"2023-10-08T07:05:34.360128+0000","last_undegraded":"2023-10-08T07:05:34.360128+0000","last_fullsized":"2023-10-08T07:05:34.360128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319725+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:05:34.319725+0000","last_peered":"2023-10-08T07:05:34.319725+0000","last_clean":"2023-10-08T07:05:34.319725+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:05:34.319725+0000","last_undegraded":"2023-10-08T07:05:34.319725+0000","last_fullsized":"2023-10-08T07:05:34.319725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319443+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:05:34.319443+0000","last_peered":"2023-10-08T07:05:34.319443+0000","last_clean":"2023-10-08T07:05:34.319443+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:05:34.319443+0000","last_undegraded":"2023-10-08T07:05:34.319443+0000","last_fullsized":"2023-10-08T07:05:34.319443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319238+0000","last_change":"2023-10-08T07:05:33.327740+0000","last_active":"2023-10-08T07:05:34.319238+0000","last_peered":"2023-10-08T07:05:34.319238+0000","last_clean":"2023-10-08T07:05:34.319238+0000","last_became_active":"2023-10-08T07:05:33.325912+0000","last_became_peered":"2023-10-08T07:05:33.325912+0000","last_unstale":"2023-10-08T07:05:34.319238+0000","last_undegraded":"2023-10-08T07:05:34.319238+0000","last_fullsized":"2023-10-08T07:05:34.319238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319837+0000","last_change":"2023-10-08T07:05:33.322628+0000","last_active":"2023-10-08T07:05:34.319837+0000","last_peered":"2023-10-08T07:05:34.319837+0000","last_clean":"2023-10-08T07:05:34.319837+0000","last_became_active":"2023-10-08T07:05:33.321816+0000","last_became_peered":"2023-10-08T07:05:33.321816+0000","last_unstale":"2023-10-08T07:05:34.319837+0000","last_undegraded":"2023-10-08T07:05:34.319837+0000","last_fullsized":"2023-10-08T07:05:34.319837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360894+0000","last_change":"2023-10-08T07:05:33.322098+0000","last_active":"2023-10-08T07:05:34.360894+0000","last_peered":"2023-10-08T07:05:34.360894+0000","last_clean":"2023-10-08T07:05:34.360894+0000","last_became_active":"2023-10-08T07:05:33.321208+0000","last_became_peered":"2023-10-08T07:05:33.321208+0000","last_unstale":"2023-10-08T07:05:34.360894+0000","last_undegraded":"2023-10-08T07:05:34.360894+0000","last_fullsized":"2023-10-08T07:05:34.360894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320139+0000","last_change":"2023-10-08T07:05:33.328140+0000","last_active":"2023-10-08T07:05:34.320139+0000","last_peered":"2023-10-08T07:05:34.320139+0000","last_clean":"2023-10-08T07:05:34.320139+0000","last_became_active":"2023-10-08T07:05:33.327595+0000","last_became_peered":"2023-10-08T07:05:33.327595+0000","last_unstale":"2023-10-08T07:05:34.320139+0000","last_undegraded":"2023-10-08T07:05:34.320139+0000","last_fullsized":"2023-10-08T07:05:34.320139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360113+0000","last_change":"2023-10-08T07:05:33.329834+0000","last_active":"2023-10-08T07:05:34.360113+0000","last_peered":"2023-10-08T07:05:34.360113+0000","last_clean":"2023-10-08T07:05:34.360113+0000","last_became_active":"2023-10-08T07:05:33.329357+0000","last_became_peered":"2023-10-08T07:05:33.329357+0000","last_unstale":"2023-10-08T07:05:34.360113+0000","last_undegraded":"2023-10-08T07:05:34.360113+0000","last_fullsized":"2023-10-08T07:05:34.360113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360010+0000","last_change":"2023-10-08T07:05:33.319643+0000","last_active":"2023-10-08T07:05:34.360010+0000","last_peered":"2023-10-08T07:05:34.360010+0000","last_clean":"2023-10-08T07:05:34.360010+0000","last_became_active":"2023-10-08T07:05:33.318659+0000","last_became_peered":"2023-10-08T07:05:33.318659+0000","last_unstale":"2023-10-08T07:05:34.360010+0000","last_undegraded":"2023-10-08T07:05:34.360010+0000","last_fullsized":"2023-10-08T07:05:34.360010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320295+0000","last_change":"2023-10-08T07:05:33.318491+0000","last_active":"2023-10-08T07:05:34.320295+0000","last_peered":"2023-10-08T07:05:34.320295+0000","last_clean":"2023-10-08T07:05:34.320295+0000","last_became_active":"2023-10-08T07:05:33.317703+0000","last_became_peered":"2023-10-08T07:05:33.317703+0000","last_unstale":"2023-10-08T07:05:34.320295+0000","last_undegraded":"2023-10-08T07:05:34.320295+0000","last_fullsized":"2023-10-08T07:05:34.320295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.319294+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.318364+0000","last_became_peered":"2023-10-08T07:05:33.318364+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319517+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:05:34.319517+0000","last_peered":"2023-10-08T07:05:34.319517+0000","last_clean":"2023-10-08T07:05:34.319517+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:05:34.319517+0000","last_undegraded":"2023-10-08T07:05:34.319517+0000","last_fullsized":"2023-10-08T07:05:34.319517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319930+0000","last_change":"2023-10-08T07:05:33.317287+0000","last_active":"2023-10-08T07:05:34.319930+0000","last_peered":"2023-10-08T07:05:34.319930+0000","last_clean":"2023-10-08T07:05:34.319930+0000","last_became_active":"2023-10-08T07:05:33.316483+0000","last_became_peered":"2023-10-08T07:05:33.316483+0000","last_unstale":"2023-10-08T07:05:34.319930+0000","last_undegraded":"2023-10-08T07:05:34.319930+0000","last_fullsized":"2023-10-08T07:05:34.319930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361063+0000","last_change":"2023-10-08T07:05:33.321088+0000","last_active":"2023-10-08T07:05:34.361063+0000","last_peered":"2023-10-08T07:05:34.361063+0000","last_clean":"2023-10-08T07:05:34.361063+0000","last_became_active":"2023-10-08T07:05:33.319541+0000","last_became_peered":"2023-10-08T07:05:33.319541+0000","last_unstale":"2023-10-08T07:05:34.361063+0000","last_undegraded":"2023-10-08T07:05:34.361063+0000","last_fullsized":"2023-10-08T07:05:34.361063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319536+0000","last_change":"2023-10-08T07:05:33.322110+0000","last_active":"2023-10-08T07:05:34.319536+0000","last_peered":"2023-10-08T07:05:34.319536+0000","last_clean":"2023-10-08T07:05:34.319536+0000","last_became_active":"2023-10-08T07:05:33.321780+0000","last_became_peered":"2023-10-08T07:05:33.321780+0000","last_unstale":"2023-10-08T07:05:34.319536+0000","last_undegraded":"2023-10-08T07:05:34.319536+0000","last_fullsized":"2023-10-08T07:05:34.319536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320412+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:05:34.320412+0000","last_peered":"2023-10-08T07:05:34.320412+0000","last_clean":"2023-10-08T07:05:34.320412+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:05:34.320412+0000","last_undegraded":"2023-10-08T07:05:34.320412+0000","last_fullsized":"2023-10-08T07:05:34.320412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319754+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:05:34.319754+0000","last_peered":"2023-10-08T07:05:34.319754+0000","last_clean":"2023-10-08T07:05:34.319754+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:05:34.319754+0000","last_undegraded":"2023-10-08T07:05:34.319754+0000","last_fullsized":"2023-10-08T07:05:34.319754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360008+0000","last_change":"2023-10-08T07:05:33.326970+0000","last_active":"2023-10-08T07:05:34.360008+0000","last_peered":"2023-10-08T07:05:34.360008+0000","last_clean":"2023-10-08T07:05:34.360008+0000","last_became_active":"2023-10-08T07:05:33.326650+0000","last_became_peered":"2023-10-08T07:05:33.326650+0000","last_unstale":"2023-10-08T07:05:34.360008+0000","last_undegraded":"2023-10-08T07:05:34.360008+0000","last_fullsized":"2023-10-08T07:05:34.360008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319095+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:05:34.319095+0000","last_peered":"2023-10-08T07:05:34.319095+0000","last_clean":"2023-10-08T07:05:34.319095+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:05:34.319095+0000","last_undegraded":"2023-10-08T07:05:34.319095+0000","last_fullsized":"2023-10-08T07:05:34.319095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360261+0000","last_change":"2023-10-08T07:05:33.319759+0000","last_active":"2023-10-08T07:05:34.360261+0000","last_peered":"2023-10-08T07:05:34.360261+0000","last_clean":"2023-10-08T07:05:34.360261+0000","last_became_active":"2023-10-08T07:05:33.318507+0000","last_became_peered":"2023-10-08T07:05:33.318507+0000","last_unstale":"2023-10-08T07:05:34.360261+0000","last_undegraded":"2023-10-08T07:05:34.360261+0000","last_fullsized":"2023-10-08T07:05:34.360261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361101+0000","last_change":"2023-10-08T07:05:33.317560+0000","last_active":"2023-10-08T07:05:34.361101+0000","last_peered":"2023-10-08T07:05:34.361101+0000","last_clean":"2023-10-08T07:05:34.361101+0000","last_became_active":"2023-10-08T07:05:33.316906+0000","last_became_peered":"2023-10-08T07:05:33.316906+0000","last_unstale":"2023-10-08T07:05:34.361101+0000","last_undegraded":"2023-10-08T07:05:34.361101+0000","last_fullsized":"2023-10-08T07:05:34.361101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320043+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:05:34.320043+0000","last_peered":"2023-10-08T07:05:34.320043+0000","last_clean":"2023-10-08T07:05:34.320043+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:05:34.320043+0000","last_undegraded":"2023-10-08T07:05:34.320043+0000","last_fullsized":"2023-10-08T07:05:34.320043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320344+0000","last_change":"2023-10-08T07:05:33.326267+0000","last_active":"2023-10-08T07:05:34.320344+0000","last_peered":"2023-10-08T07:05:34.320344+0000","last_clean":"2023-10-08T07:05:34.320344+0000","last_became_active":"2023-10-08T07:05:33.324579+0000","last_became_peered":"2023-10-08T07:05:33.324579+0000","last_unstale":"2023-10-08T07:05:34.320344+0000","last_undegraded":"2023-10-08T07:05:34.320344+0000","last_fullsized":"2023-10-08T07:05:34.320344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359920+0000","last_change":"2023-10-08T07:05:32.320295+0000","last_active":"2023-10-08T07:05:34.359920+0000","last_peered":"2023-10-08T07:05:34.359920+0000","last_clean":"2023-10-08T07:05:34.359920+0000","last_became_active":"2023-10-08T07:05:32.320044+0000","last_became_peered":"2023-10-08T07:05:32.320044+0000","last_unstale":"2023-10-08T07:05:34.359920+0000","last_undegraded":"2023-10-08T07:05:34.359920+0000","last_fullsized":"2023-10-08T07:05:34.359920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:44.690611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360949+0000","last_change":"2023-10-08T07:05:33.329921+0000","last_active":"2023-10-08T07:05:34.360949+0000","last_peered":"2023-10-08T07:05:34.360949+0000","last_clean":"2023-10-08T07:05:34.360949+0000","last_became_active":"2023-10-08T07:05:33.329346+0000","last_became_peered":"2023-10-08T07:05:33.329346+0000","last_unstale":"2023-10-08T07:05:34.360949+0000","last_undegraded":"2023-10-08T07:05:34.360949+0000","last_fullsized":"2023-10-08T07:05:34.360949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319260+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:05:34.319260+0000","last_peered":"2023-10-08T07:05:34.319260+0000","last_clean":"2023-10-08T07:05:34.319260+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:05:34.319260+0000","last_undegraded":"2023-10-08T07:05:34.319260+0000","last_fullsized":"2023-10-08T07:05:34.319260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319829+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:05:34.319829+0000","last_peered":"2023-10-08T07:05:34.319829+0000","last_clean":"2023-10-08T07:05:34.319829+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:05:34.319829+0000","last_undegraded":"2023-10-08T07:05:34.319829+0000","last_fullsized":"2023-10-08T07:05:34.319829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319123+0000","last_change":"2023-10-08T07:05:32.315935+0000","last_active":"2023-10-08T07:05:34.319123+0000","last_peered":"2023-10-08T07:05:34.319123+0000","last_clean":"2023-10-08T07:05:34.319123+0000","last_became_active":"2023-10-08T07:05:32.315661+0000","last_became_peered":"2023-10-08T07:05:32.315661+0000","last_unstale":"2023-10-08T07:05:34.319123+0000","last_undegraded":"2023-10-08T07:05:34.319123+0000","last_fullsized":"2023-10-08T07:05:34.319123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:01:05.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361026+0000","last_change":"2023-10-08T07:05:33.330068+0000","last_active":"2023-10-08T07:05:34.361026+0000","last_peered":"2023-10-08T07:05:34.361026+0000","last_clean":"2023-10-08T07:05:34.361026+0000","last_became_active":"2023-10-08T07:05:33.329169+0000","last_became_peered":"2023-10-08T07:05:33.329169+0000","last_unstale":"2023-10-08T07:05:34.361026+0000","last_undegraded":"2023-10-08T07:05:34.361026+0000","last_fullsized":"2023-10-08T07:05:34.361026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:05:34.320135+0000","last_peered":"2023-10-08T07:05:34.320135+0000","last_clean":"2023-10-08T07:05:34.320135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:05:34.320135+0000","last_undegraded":"2023-10-08T07:05:34.320135+0000","last_fullsized":"2023-10-08T07:05:34.320135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318813+0000","last_change":"2023-10-08T07:05:33.316496+0000","last_active":"2023-10-08T07:05:34.318813+0000","last_peered":"2023-10-08T07:05:34.318813+0000","last_clean":"2023-10-08T07:05:34.318813+0000","last_became_active":"2023-10-08T07:05:33.316084+0000","last_became_peered":"2023-10-08T07:05:33.316084+0000","last_unstale":"2023-10-08T07:05:34.318813+0000","last_undegraded":"2023-10-08T07:05:34.318813+0000","last_fullsized":"2023-10-08T07:05:34.318813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320455+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:05:34.320455+0000","last_peered":"2023-10-08T07:05:34.320455+0000","last_clean":"2023-10-08T07:05:34.320455+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:05:34.320455+0000","last_undegraded":"2023-10-08T07:05:34.320455+0000","last_fullsized":"2023-10-08T07:05:34.320455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319317+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:05:34.319317+0000","last_peered":"2023-10-08T07:05:34.319317+0000","last_clean":"2023-10-08T07:05:34.319317+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:05:34.319317+0000","last_undegraded":"2023-10-08T07:05:34.319317+0000","last_fullsized":"2023-10-08T07:05:34.319317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360636+0000","last_change":"2023-10-08T07:05:32.323201+0000","last_active":"2023-10-08T07:05:34.360636+0000","last_peered":"2023-10-08T07:05:34.360636+0000","last_clean":"2023-10-08T07:05:34.360636+0000","last_became_active":"2023-10-08T07:05:32.322864+0000","last_became_peered":"2023-10-08T07:05:32.322864+0000","last_unstale":"2023-10-08T07:05:34.360636+0000","last_undegraded":"2023-10-08T07:05:34.360636+0000","last_fullsized":"2023-10-08T07:05:34.360636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:40.093124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319535+0000","last_change":"2023-10-08T07:05:33.317114+0000","last_active":"2023-10-08T07:05:34.319535+0000","last_peered":"2023-10-08T07:05:34.319535+0000","last_clean":"2023-10-08T07:05:34.319535+0000","last_became_active":"2023-10-08T07:05:33.316390+0000","last_became_peered":"2023-10-08T07:05:33.316390+0000","last_unstale":"2023-10-08T07:05:34.319535+0000","last_undegraded":"2023-10-08T07:05:34.319535+0000","last_fullsized":"2023-10-08T07:05:34.319535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320136+0000","last_change":"2023-10-08T07:05:32.319510+0000","last_active":"2023-10-08T07:05:34.320136+0000","last_peered":"2023-10-08T07:05:34.320136+0000","last_clean":"2023-10-08T07:05:34.320136+0000","last_became_active":"2023-10-08T07:05:32.319209+0000","last_became_peered":"2023-10-08T07:05:32.319209+0000","last_unstale":"2023-10-08T07:05:34.320136+0000","last_undegraded":"2023-10-08T07:05:34.320136+0000","last_fullsized":"2023-10-08T07:05:34.320136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:28.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320332+0000","last_change":"2023-10-08T07:05:33.317137+0000","last_active":"2023-10-08T07:05:34.320332+0000","last_peered":"2023-10-08T07:05:34.320332+0000","last_clean":"2023-10-08T07:05:34.320332+0000","last_became_active":"2023-10-08T07:05:33.316562+0000","last_became_peered":"2023-10-08T07:05:33.316562+0000","last_unstale":"2023-10-08T07:05:34.320332+0000","last_undegraded":"2023-10-08T07:05:34.320332+0000","last_fullsized":"2023-10-08T07:05:34.320332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:41.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320369+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:05:34.320369+0000","last_peered":"2023-10-08T07:05:34.320369+0000","last_clean":"2023-10-08T07:05:34.320369+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:05:34.320369+0000","last_undegraded":"2023-10-08T07:05:34.320369+0000","last_fullsized":"2023-10-08T07:05:34.320369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360395+0000","last_change":"2023-10-08T07:05:33.322201+0000","last_active":"2023-10-08T07:05:34.360395+0000","last_peered":"2023-10-08T07:05:34.360395+0000","last_clean":"2023-10-08T07:05:34.360395+0000","last_became_active":"2023-10-08T07:05:33.321826+0000","last_became_peered":"2023-10-08T07:05:33.321826+0000","last_unstale":"2023-10-08T07:05:34.360395+0000","last_undegraded":"2023-10-08T07:05:34.360395+0000","last_fullsized":"2023-10-08T07:05:34.360395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319178+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:05:34.319178+0000","last_peered":"2023-10-08T07:05:34.319178+0000","last_clean":"2023-10-08T07:05:34.319178+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:05:34.319178+0000","last_undegraded":"2023-10-08T07:05:34.319178+0000","last_fullsized":"2023-10-08T07:05:34.319178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360947+0000","last_change":"2023-10-08T07:05:33.317545+0000","last_active":"2023-10-08T07:05:34.360947+0000","last_peered":"2023-10-08T07:05:34.360947+0000","last_clean":"2023-10-08T07:05:34.360947+0000","last_became_active":"2023-10-08T07:05:33.317134+0000","last_became_peered":"2023-10-08T07:05:33.317134+0000","last_unstale":"2023-10-08T07:05:34.360947+0000","last_undegraded":"2023-10-08T07:05:34.360947+0000","last_fullsized":"2023-10-08T07:05:34.360947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359736+0000","last_change":"2023-10-08T07:05:32.323406+0000","last_active":"2023-10-08T07:05:34.359736+0000","last_peered":"2023-10-08T07:05:34.359736+0000","last_clean":"2023-10-08T07:05:34.359736+0000","last_became_active":"2023-10-08T07:05:32.323040+0000","last_became_peered":"2023-10-08T07:05:32.323040+0000","last_unstale":"2023-10-08T07:05:34.359736+0000","last_undegraded":"2023-10-08T07:05:34.359736+0000","last_fullsized":"2023-10-08T07:05:34.359736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319639+0000","last_change":"2023-10-08T07:05:32.319220+0000","last_active":"2023-10-08T07:05:34.319639+0000","last_peered":"2023-10-08T07:05:34.319639+0000","last_clean":"2023-10-08T07:05:34.319639+0000","last_became_active":"2023-10-08T07:05:32.318838+0000","last_became_peered":"2023-10-08T07:05:32.318838+0000","last_unstale":"2023-10-08T07:05:34.319639+0000","last_undegraded":"2023-10-08T07:05:34.319639+0000","last_fullsized":"2023-10-08T07:05:34.319639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:32:59.940325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320271+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:05:34.320271+0000","last_peered":"2023-10-08T07:05:34.320271+0000","last_clean":"2023-10-08T07:05:34.320271+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:05:34.320271+0000","last_undegraded":"2023-10-08T07:05:34.320271+0000","last_fullsized":"2023-10-08T07:05:34.320271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320776+0000","last_change":"2023-10-08T07:05:32.319446+0000","last_active":"2023-10-08T07:05:34.320776+0000","last_peered":"2023-10-08T07:05:34.320776+0000","last_clean":"2023-10-08T07:05:34.320776+0000","last_became_active":"2023-10-08T07:05:32.319019+0000","last_became_peered":"2023-10-08T07:05:32.319019+0000","last_unstale":"2023-10-08T07:05:34.320776+0000","last_undegraded":"2023-10-08T07:05:34.320776+0000","last_fullsized":"2023-10-08T07:05:34.320776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:56.843162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359487+0000","last_change":"2023-10-08T07:05:33.330217+0000","last_active":"2023-10-08T07:05:34.359487+0000","last_peered":"2023-10-08T07:05:34.359487+0000","last_clean":"2023-10-08T07:05:34.359487+0000","last_became_active":"2023-10-08T07:05:33.329639+0000","last_became_peered":"2023-10-08T07:05:33.329639+0000","last_unstale":"2023-10-08T07:05:34.359487+0000","last_undegraded":"2023-10-08T07:05:34.359487+0000","last_fullsized":"2023-10-08T07:05:34.359487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:21.715645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360604+0000","last_change":"2023-10-08T07:05:32.323481+0000","last_active":"2023-10-08T07:05:34.360604+0000","last_peered":"2023-10-08T07:05:34.360604+0000","last_clean":"2023-10-08T07:05:34.360604+0000","last_became_active":"2023-10-08T07:05:32.323243+0000","last_became_peered":"2023-10-08T07:05:32.323243+0000","last_unstale":"2023-10-08T07:05:34.360604+0000","last_undegraded":"2023-10-08T07:05:34.360604+0000","last_fullsized":"2023-10-08T07:05:34.360604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359906+0000","last_change":"2023-10-08T07:05:33.318539+0000","last_active":"2023-10-08T07:05:34.359906+0000","last_peered":"2023-10-08T07:05:34.359906+0000","last_clean":"2023-10-08T07:05:34.359906+0000","last_became_active":"2023-10-08T07:05:33.317371+0000","last_became_peered":"2023-10-08T07:05:33.317371+0000","last_unstale":"2023-10-08T07:05:34.359906+0000","last_undegraded":"2023-10-08T07:05:34.359906+0000","last_fullsized":"2023-10-08T07:05:34.359906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:00.945202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320279+0000","last_change":"2023-10-08T07:05:32.321744+0000","last_active":"2023-10-08T07:05:34.320279+0000","last_peered":"2023-10-08T07:05:34.320279+0000","last_clean":"2023-10-08T07:05:34.320279+0000","last_became_active":"2023-10-08T07:05:32.321482+0000","last_became_peered":"2023-10-08T07:05:32.321482+0000","last_unstale":"2023-10-08T07:05:34.320279+0000","last_undegraded":"2023-10-08T07:05:34.320279+0000","last_fullsized":"2023-10-08T07:05:34.320279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:13.789778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320018+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:05:34.320018+0000","last_peered":"2023-10-08T07:05:34.320018+0000","last_clean":"2023-10-08T07:05:34.320018+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:05:34.320018+0000","last_undegraded":"2023-10-08T07:05:34.320018+0000","last_fullsized":"2023-10-08T07:05:34.320018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319626+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:05:34.319626+0000","last_peered":"2023-10-08T07:05:34.319626+0000","last_clean":"2023-10-08T07:05:34.319626+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:05:34.319626+0000","last_undegraded":"2023-10-08T07:05:34.319626+0000","last_fullsized":"2023-10-08T07:05:34.319626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319559+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:05:34.319559+0000","last_peered":"2023-10-08T07:05:34.319559+0000","last_clean":"2023-10-08T07:05:34.319559+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:05:34.319559+0000","last_undegraded":"2023-10-08T07:05:34.319559+0000","last_fullsized":"2023-10-08T07:05:34.319559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319350+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:05:34.319350+0000","last_peered":"2023-10-08T07:05:34.319350+0000","last_clean":"2023-10-08T07:05:34.319350+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:05:34.319350+0000","last_undegraded":"2023-10-08T07:05:34.319350+0000","last_fullsized":"2023-10-08T07:05:34.319350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319602+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:05:34.319602+0000","last_peered":"2023-10-08T07:05:34.319602+0000","last_clean":"2023-10-08T07:05:34.319602+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:05:34.319602+0000","last_undegraded":"2023-10-08T07:05:34.319602+0000","last_fullsized":"2023-10-08T07:05:34.319602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320680+0000","last_change":"2023-10-08T07:05:33.319933+0000","last_active":"2023-10-08T07:05:34.320680+0000","last_peered":"2023-10-08T07:05:34.320680+0000","last_clean":"2023-10-08T07:05:34.320680+0000","last_became_active":"2023-10-08T07:05:33.317937+0000","last_became_peered":"2023-10-08T07:05:33.317937+0000","last_unstale":"2023-10-08T07:05:34.320680+0000","last_undegraded":"2023-10-08T07:05:34.320680+0000","last_fullsized":"2023-10-08T07:05:34.320680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:57:42.074994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359555+0000","last_change":"2023-10-08T07:05:32.323415+0000","last_active":"2023-10-08T07:05:34.359555+0000","last_peered":"2023-10-08T07:05:34.359555+0000","last_clean":"2023-10-08T07:05:34.359555+0000","last_became_active":"2023-10-08T07:05:32.322910+0000","last_became_peered":"2023-10-08T07:05:32.322910+0000","last_unstale":"2023-10-08T07:05:34.359555+0000","last_undegraded":"2023-10-08T07:05:34.359555+0000","last_fullsized":"2023-10-08T07:05:34.359555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320553+0000","last_change":"2023-10-08T07:05:33.325994+0000","last_active":"2023-10-08T07:05:34.320553+0000","last_peered":"2023-10-08T07:05:34.320553+0000","last_clean":"2023-10-08T07:05:34.320553+0000","last_became_active":"2023-10-08T07:05:33.324865+0000","last_became_peered":"2023-10-08T07:05:33.324865+0000","last_unstale":"2023-10-08T07:05:34.320553+0000","last_undegraded":"2023-10-08T07:05:34.320553+0000","last_fullsized":"2023-10-08T07:05:34.320553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:14.142601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359677+0000","last_change":"2023-10-08T07:05:32.320359+0000","last_active":"2023-10-08T07:05:34.359677+0000","last_peered":"2023-10-08T07:05:34.359677+0000","last_clean":"2023-10-08T07:05:34.359677+0000","last_became_active":"2023-10-08T07:05:32.320137+0000","last_became_peered":"2023-10-08T07:05:32.320137+0000","last_unstale":"2023-10-08T07:05:34.359677+0000","last_undegraded":"2023-10-08T07:05:34.359677+0000","last_fullsized":"2023-10-08T07:05:34.359677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:32.366341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320091+0000","last_change":"2023-10-08T07:05:33.322861+0000","last_active":"2023-10-08T07:05:34.320091+0000","last_peered":"2023-10-08T07:05:34.320091+0000","last_clean":"2023-10-08T07:05:34.320091+0000","last_became_active":"2023-10-08T07:05:33.322450+0000","last_became_peered":"2023-10-08T07:05:33.322450+0000","last_unstale":"2023-10-08T07:05:34.320091+0000","last_undegraded":"2023-10-08T07:05:34.320091+0000","last_fullsized":"2023-10-08T07:05:34.320091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309081+0000","last_change":"2023-10-08T07:05:27.295597+0000","last_active":"2023-10-08T07:05:33.309081+0000","last_peered":"2023-10-08T07:05:33.309081+0000","last_clean":"2023-10-08T07:05:33.309081+0000","last_became_active":"2023-10-08T07:05:27.295265+0000","last_became_peered":"2023-10-08T07:05:27.295265+0000","last_unstale":"2023-10-08T07:05:33.309081+0000","last_undegraded":"2023-10-08T07:05:33.309081+0000","last_fullsized":"2023-10-08T07:05:33.309081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:50.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360046+0000","last_change":"2023-10-08T07:05:33.326797+0000","last_active":"2023-10-08T07:05:34.360046+0000","last_peered":"2023-10-08T07:05:34.360046+0000","last_clean":"2023-10-08T07:05:34.360046+0000","last_became_active":"2023-10-08T07:05:33.326518+0000","last_became_peered":"2023-10-08T07:05:33.326518+0000","last_unstale":"2023-10-08T07:05:34.360046+0000","last_undegraded":"2023-10-08T07:05:34.360046+0000","last_fullsized":"2023-10-08T07:05:34.360046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318961+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:05:33.318961+0000","last_peered":"2023-10-08T07:05:33.318961+0000","last_clean":"2023-10-08T07:05:33.318961+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:05:33.318961+0000","last_undegraded":"2023-10-08T07:05:33.318961+0000","last_fullsized":"2023-10-08T07:05:33.318961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320087+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:05:34.320087+0000","last_peered":"2023-10-08T07:05:34.320087+0000","last_clean":"2023-10-08T07:05:34.320087+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:05:34.320087+0000","last_undegraded":"2023-10-08T07:05:34.320087+0000","last_fullsized":"2023-10-08T07:05:34.320087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319579+0000","last_change":"2023-10-08T07:05:33.322164+0000","last_active":"2023-10-08T07:05:34.319579+0000","last_peered":"2023-10-08T07:05:34.319579+0000","last_clean":"2023-10-08T07:05:34.319579+0000","last_became_active":"2023-10-08T07:05:33.321757+0000","last_became_peered":"2023-10-08T07:05:33.321757+0000","last_unstale":"2023-10-08T07:05:34.319579+0000","last_undegraded":"2023-10-08T07:05:34.319579+0000","last_fullsized":"2023-10-08T07:05:34.319579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.308287+0000","last_change":"2023-10-08T07:05:27.295991+0000","last_active":"2023-10-08T07:05:33.308287+0000","last_peered":"2023-10-08T07:05:33.308287+0000","last_clean":"2023-10-08T07:05:33.308287+0000","last_became_active":"2023-10-08T07:05:27.295727+0000","last_became_peered":"2023-10-08T07:05:27.295727+0000","last_unstale":"2023-10-08T07:05:33.308287+0000","last_undegraded":"2023-10-08T07:05:33.308287+0000","last_fullsized":"2023-10-08T07:05:33.308287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:54.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359567+0000","last_change":"2023-10-08T07:05:32.323161+0000","last_active":"2023-10-08T07:05:34.359567+0000","last_peered":"2023-10-08T07:05:34.359567+0000","last_clean":"2023-10-08T07:05:34.359567+0000","last_became_active":"2023-10-08T07:05:32.322832+0000","last_became_peered":"2023-10-08T07:05:32.322832+0000","last_unstale":"2023-10-08T07:05:34.359567+0000","last_undegraded":"2023-10-08T07:05:34.359567+0000","last_fullsized":"2023-10-08T07:05:34.359567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320239+0000","last_change":"2023-10-08T07:05:33.323204+0000","last_active":"2023-10-08T07:05:34.320239+0000","last_peered":"2023-10-08T07:05:34.320239+0000","last_clean":"2023-10-08T07:05:34.320239+0000","last_became_active":"2023-10-08T07:05:33.322899+0000","last_became_peered":"2023-10-08T07:05:33.322899+0000","last_unstale":"2023-10-08T07:05:34.320239+0000","last_undegraded":"2023-10-08T07:05:34.320239+0000","last_fullsized":"2023-10-08T07:05:34.320239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319302+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:05:33.319302+0000","last_peered":"2023-10-08T07:05:33.319302+0000","last_clean":"2023-10-08T07:05:33.319302+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:05:33.319302+0000","last_undegraded":"2023-10-08T07:05:33.319302+0000","last_fullsized":"2023-10-08T07:05:33.319302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318604+0000","last_change":"2023-10-08T07:05:22.277737+0000","last_active":"2023-10-08T07:05:33.318604+0000","last_peered":"2023-10-08T07:05:33.318604+0000","last_clean":"2023-10-08T07:05:33.318604+0000","last_became_active":"2023-10-08T07:05:22.277417+0000","last_became_peered":"2023-10-08T07:05:22.277417+0000","last_unstale":"2023-10-08T07:05:33.318604+0000","last_undegraded":"2023-10-08T07:05:33.318604+0000","last_fullsized":"2023-10-08T07:05:33.318604+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:10.186804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318995+0000","last_change":"2023-10-08T07:05:32.316756+0000","last_active":"2023-10-08T07:05:34.318995+0000","last_peered":"2023-10-08T07:05:34.318995+0000","last_clean":"2023-10-08T07:05:34.318995+0000","last_became_active":"2023-10-08T07:05:32.316340+0000","last_became_peered":"2023-10-08T07:05:32.316340+0000","last_unstale":"2023-10-08T07:05:34.318995+0000","last_undegraded":"2023-10-08T07:05:34.318995+0000","last_fullsized":"2023-10-08T07:05:34.318995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:46:34.838960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320659+0000","last_change":"2023-10-08T07:05:33.318964+0000","last_active":"2023-10-08T07:05:34.320659+0000","last_peered":"2023-10-08T07:05:34.320659+0000","last_clean":"2023-10-08T07:05:34.320659+0000","last_became_active":"2023-10-08T07:05:33.317866+0000","last_became_peered":"2023-10-08T07:05:33.317866+0000","last_unstale":"2023-10-08T07:05:34.320659+0000","last_undegraded":"2023-10-08T07:05:34.320659+0000","last_fullsized":"2023-10-08T07:05:34.320659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:47.306558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319045+0000","last_change":"2023-10-08T07:05:27.295425+0000","last_active":"2023-10-08T07:05:33.319045+0000","last_peered":"2023-10-08T07:05:33.319045+0000","last_clean":"2023-10-08T07:05:33.319045+0000","last_became_active":"2023-10-08T07:05:27.295157+0000","last_became_peered":"2023-10-08T07:05:27.295157+0000","last_unstale":"2023-10-08T07:05:33.319045+0000","last_undegraded":"2023-10-08T07:05:33.319045+0000","last_fullsized":"2023-10-08T07:05:33.319045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:06.192882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318796+0000","last_change":"2023-10-08T07:05:32.317723+0000","last_active":"2023-10-08T07:05:34.318796+0000","last_peered":"2023-10-08T07:05:34.318796+0000","last_clean":"2023-10-08T07:05:34.318796+0000","last_became_active":"2023-10-08T07:05:32.317444+0000","last_became_peered":"2023-10-08T07:05:32.317444+0000","last_unstale":"2023-10-08T07:05:34.318796+0000","last_undegraded":"2023-10-08T07:05:34.318796+0000","last_fullsized":"2023-10-08T07:05:34.318796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:29.242830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360897+0000","last_change":"2023-10-08T07:05:33.321497+0000","last_active":"2023-10-08T07:05:34.360897+0000","last_peered":"2023-10-08T07:05:34.360897+0000","last_clean":"2023-10-08T07:05:34.360897+0000","last_became_active":"2023-10-08T07:05:33.319658+0000","last_became_peered":"2023-10-08T07:05:33.319658+0000","last_unstale":"2023-10-08T07:05:34.360897+0000","last_undegraded":"2023-10-08T07:05:34.360897+0000","last_fullsized":"2023-10-08T07:05:34.360897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.314076+0000","last_change":"2023-10-08T07:05:27.298597+0000","last_active":"2023-10-08T07:05:33.314076+0000","last_peered":"2023-10-08T07:05:33.314076+0000","last_clean":"2023-10-08T07:05:33.314076+0000","last_became_active":"2023-10-08T07:05:27.298355+0000","last_became_peered":"2023-10-08T07:05:27.298355+0000","last_unstale":"2023-10-08T07:05:33.314076+0000","last_undegraded":"2023-10-08T07:05:33.314076+0000","last_fullsized":"2023-10-08T07:05:33.314076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:06.241475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319456+0000","last_change":"2023-10-08T07:05:32.319605+0000","last_active":"2023-10-08T07:05:34.319456+0000","last_peered":"2023-10-08T07:05:34.319456+0000","last_clean":"2023-10-08T07:05:34.319456+0000","last_became_active":"2023-10-08T07:05:32.319244+0000","last_became_peered":"2023-10-08T07:05:32.319244+0000","last_unstale":"2023-10-08T07:05:34.319456+0000","last_undegraded":"2023-10-08T07:05:34.319456+0000","last_fullsized":"2023-10-08T07:05:34.319456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:25.991992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360213+0000","last_change":"2023-10-08T07:05:33.327112+0000","last_active":"2023-10-08T07:05:34.360213+0000","last_peered":"2023-10-08T07:05:34.360213+0000","last_clean":"2023-10-08T07:05:34.360213+0000","last_became_active":"2023-10-08T07:05:33.326816+0000","last_became_peered":"2023-10-08T07:05:33.326816+0000","last_unstale":"2023-10-08T07:05:34.360213+0000","last_undegraded":"2023-10-08T07:05:34.360213+0000","last_fullsized":"2023-10-08T07:05:34.360213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:32.319875+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:32.319385+0000","last_became_peered":"2023-10-08T07:05:32.319385+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309753+0000","last_change":"2023-10-08T07:05:27.295537+0000","last_active":"2023-10-08T07:05:33.309753+0000","last_peered":"2023-10-08T07:05:33.309753+0000","last_clean":"2023-10-08T07:05:33.309753+0000","last_became_active":"2023-10-08T07:05:27.295234+0000","last_became_peered":"2023-10-08T07:05:27.295234+0000","last_unstale":"2023-10-08T07:05:33.309753+0000","last_undegraded":"2023-10-08T07:05:33.309753+0000","last_fullsized":"2023-10-08T07:05:33.309753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:22.951187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318736+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:05:34.318736+0000","last_peered":"2023-10-08T07:05:34.318736+0000","last_clean":"2023-10-08T07:05:34.318736+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:05:34.318736+0000","last_undegraded":"2023-10-08T07:05:34.318736+0000","last_fullsized":"2023-10-08T07:05:34.318736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.325045+0000","last_change":"2023-10-08T07:05:27.295945+0000","last_active":"2023-10-08T07:05:33.325045+0000","last_peered":"2023-10-08T07:05:33.325045+0000","last_clean":"2023-10-08T07:05:33.325045+0000","last_became_active":"2023-10-08T07:05:27.295726+0000","last_became_peered":"2023-10-08T07:05:27.295726+0000","last_unstale":"2023-10-08T07:05:33.325045+0000","last_undegraded":"2023-10-08T07:05:33.325045+0000","last_fullsized":"2023-10-08T07:05:33.325045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:55.040889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319781+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:05:34.319781+0000","last_peered":"2023-10-08T07:05:34.319781+0000","last_clean":"2023-10-08T07:05:34.319781+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:05:34.319781+0000","last_undegraded":"2023-10-08T07:05:34.319781+0000","last_fullsized":"2023-10-08T07:05:34.319781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359840+0000","last_change":"2023-10-08T07:05:33.326621+0000","last_active":"2023-10-08T07:05:34.359840+0000","last_peered":"2023-10-08T07:05:34.359840+0000","last_clean":"2023-10-08T07:05:34.359840+0000","last_became_active":"2023-10-08T07:05:33.326272+0000","last_became_peered":"2023-10-08T07:05:33.326272+0000","last_unstale":"2023-10-08T07:05:34.359840+0000","last_undegraded":"2023-10-08T07:05:34.359840+0000","last_fullsized":"2023-10-08T07:05:34.359840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:31.752188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359963+0000","last_change":"2023-10-08T07:05:32.323175+0000","last_active":"2023-10-08T07:05:34.359963+0000","last_peered":"2023-10-08T07:05:34.359963+0000","last_clean":"2023-10-08T07:05:34.359963+0000","last_became_active":"2023-10-08T07:05:32.322814+0000","last_became_peered":"2023-10-08T07:05:32.322814+0000","last_unstale":"2023-10-08T07:05:34.359963+0000","last_undegraded":"2023-10-08T07:05:34.359963+0000","last_fullsized":"2023-10-08T07:05:34.359963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360537+0000","last_change":"2023-10-08T07:05:33.318398+0000","last_active":"2023-10-08T07:05:34.360537+0000","last_peered":"2023-10-08T07:05:34.360537+0000","last_clean":"2023-10-08T07:05:34.360537+0000","last_became_active":"2023-10-08T07:05:33.317478+0000","last_became_peered":"2023-10-08T07:05:33.317478+0000","last_unstale":"2023-10-08T07:05:34.360537+0000","last_undegraded":"2023-10-08T07:05:34.360537+0000","last_fullsized":"2023-10-08T07:05:34.360537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320059+0000","last_change":"2023-10-08T07:05:32.320603+0000","last_active":"2023-10-08T07:05:34.320059+0000","last_peered":"2023-10-08T07:05:34.320059+0000","last_clean":"2023-10-08T07:05:34.320059+0000","last_became_active":"2023-10-08T07:05:32.320262+0000","last_became_peered":"2023-10-08T07:05:32.320262+0000","last_unstale":"2023-10-08T07:05:34.320059+0000","last_undegraded":"2023-10-08T07:05:34.320059+0000","last_fullsized":"2023-10-08T07:05:34.320059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:09.249029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319954+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:05:34.319954+0000","last_peered":"2023-10-08T07:05:34.319954+0000","last_clean":"2023-10-08T07:05:34.319954+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:05:34.319954+0000","last_undegraded":"2023-10-08T07:05:34.319954+0000","last_fullsized":"2023-10-08T07:05:34.319954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360795+0000","last_change":"2023-10-08T07:05:32.323143+0000","last_active":"2023-10-08T07:05:34.360795+0000","last_peered":"2023-10-08T07:05:34.360795+0000","last_clean":"2023-10-08T07:05:34.360795+0000","last_became_active":"2023-10-08T07:05:32.322789+0000","last_became_peered":"2023-10-08T07:05:32.322789+0000","last_unstale":"2023-10-08T07:05:34.360795+0000","last_undegraded":"2023-10-08T07:05:34.360795+0000","last_fullsized":"2023-10-08T07:05:34.360795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:03.978136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319826+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:05:34.319826+0000","last_peered":"2023-10-08T07:05:34.319826+0000","last_clean":"2023-10-08T07:05:34.319826+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:05:34.319826+0000","last_undegraded":"2023-10-08T07:05:34.319826+0000","last_fullsized":"2023-10-08T07:05:34.319826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319964+0000","last_change":"2023-10-08T07:05:32.319462+0000","last_active":"2023-10-08T07:05:34.319964+0000","last_peered":"2023-10-08T07:05:34.319964+0000","last_clean":"2023-10-08T07:05:34.319964+0000","last_became_active":"2023-10-08T07:05:32.318951+0000","last_became_peered":"2023-10-08T07:05:32.318951+0000","last_unstale":"2023-10-08T07:05:34.319964+0000","last_undegraded":"2023-10-08T07:05:34.319964+0000","last_fullsized":"2023-10-08T07:05:34.319964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360006+0000","last_change":"2023-10-08T07:05:33.319869+0000","last_active":"2023-10-08T07:05:34.360006+0000","last_peered":"2023-10-08T07:05:34.360006+0000","last_clean":"2023-10-08T07:05:34.360006+0000","last_became_active":"2023-10-08T07:05:33.318241+0000","last_became_peered":"2023-10-08T07:05:33.318241+0000","last_unstale":"2023-10-08T07:05:34.360006+0000","last_undegraded":"2023-10-08T07:05:34.360006+0000","last_fullsized":"2023-10-08T07:05:34.360006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320049+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:05:34.320049+0000","last_peered":"2023-10-08T07:05:34.320049+0000","last_clean":"2023-10-08T07:05:34.320049+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:05:34.320049+0000","last_undegraded":"2023-10-08T07:05:34.320049+0000","last_fullsized":"2023-10-08T07:05:34.320049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320180+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:05:34.320180+0000","last_peered":"2023-10-08T07:05:34.320180+0000","last_clean":"2023-10-08T07:05:34.320180+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:05:34.320180+0000","last_undegraded":"2023-10-08T07:05:34.320180+0000","last_fullsized":"2023-10-08T07:05:34.320180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319653+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:05:34.319653+0000","last_peered":"2023-10-08T07:05:34.319653+0000","last_clean":"2023-10-08T07:05:34.319653+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:05:34.319653+0000","last_undegraded":"2023-10-08T07:05:34.319653+0000","last_fullsized":"2023-10-08T07:05:34.319653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319038+0000","last_change":"2023-10-08T07:05:33.322006+0000","last_active":"2023-10-08T07:05:34.319038+0000","last_peered":"2023-10-08T07:05:34.319038+0000","last_clean":"2023-10-08T07:05:34.319038+0000","last_became_active":"2023-10-08T07:05:33.321639+0000","last_became_peered":"2023-10-08T07:05:33.321639+0000","last_unstale":"2023-10-08T07:05:34.319038+0000","last_undegraded":"2023-10-08T07:05:34.319038+0000","last_fullsized":"2023-10-08T07:05:34.319038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360201+0000","last_change":"2023-10-08T07:05:33.329906+0000","last_active":"2023-10-08T07:05:34.360201+0000","last_peered":"2023-10-08T07:05:34.360201+0000","last_clean":"2023-10-08T07:05:34.360201+0000","last_became_active":"2023-10-08T07:05:33.329615+0000","last_became_peered":"2023-10-08T07:05:33.329615+0000","last_unstale":"2023-10-08T07:05:34.360201+0000","last_undegraded":"2023-10-08T07:05:34.360201+0000","last_fullsized":"2023-10-08T07:05:34.360201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319571+0000","last_change":"2023-10-08T07:05:33.316573+0000","last_active":"2023-10-08T07:05:34.319571+0000","last_peered":"2023-10-08T07:05:34.319571+0000","last_clean":"2023-10-08T07:05:34.319571+0000","last_became_active":"2023-10-08T07:05:33.316193+0000","last_became_peered":"2023-10-08T07:05:33.316193+0000","last_unstale":"2023-10-08T07:05:34.319571+0000","last_undegraded":"2023-10-08T07:05:34.319571+0000","last_fullsized":"2023-10-08T07:05:34.319571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360585+0000","last_change":"2023-10-08T07:05:33.320077+0000","last_active":"2023-10-08T07:05:34.360585+0000","last_peered":"2023-10-08T07:05:34.360585+0000","last_clean":"2023-10-08T07:05:34.360585+0000","last_became_active":"2023-10-08T07:05:33.319392+0000","last_became_peered":"2023-10-08T07:05:33.319392+0000","last_unstale":"2023-10-08T07:05:34.360585+0000","last_undegraded":"2023-10-08T07:05:34.360585+0000","last_fullsized":"2023-10-08T07:05:34.360585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":53710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":650475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":774144,"data_stored":645256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:05:37.449 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:05:37.825 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:37.826 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:05:37.836 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-08T07:05:36.502974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91084,"kb_used_data":1688,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024436,"statfs":{"total":289910292480,"available":289817022464,"internally_reserved":0,"allocated":1728512,"data_stored":1349441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":91483475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.203501"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361123+0000","last_change":"2023-10-08T07:05:33.319747+0000","last_active":"2023-10-08T07:05:34.361123+0000","last_peered":"2023-10-08T07:05:34.361123+0000","last_clean":"2023-10-08T07:05:34.361123+0000","last_became_active":"2023-10-08T07:05:33.318115+0000","last_became_peered":"2023-10-08T07:05:33.318115+0000","last_unstale":"2023-10-08T07:05:34.361123+0000","last_undegraded":"2023-10-08T07:05:34.361123+0000","last_fullsized":"2023-10-08T07:05:34.361123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360608+0000","last_change":"2023-10-08T07:05:33.322480+0000","last_active":"2023-10-08T07:05:34.360608+0000","last_peered":"2023-10-08T07:05:34.360608+0000","last_clean":"2023-10-08T07:05:34.360608+0000","last_became_active":"2023-10-08T07:05:33.322153+0000","last_became_peered":"2023-10-08T07:05:33.322153+0000","last_unstale":"2023-10-08T07:05:34.360608+0000","last_undegraded":"2023-10-08T07:05:34.360608+0000","last_fullsized":"2023-10-08T07:05:34.360608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:33.325067+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:33.323439+0000","last_became_peered":"2023-10-08T07:05:33.323439+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:18.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320530+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:05:34.320530+0000","last_peered":"2023-10-08T07:05:34.320530+0000","last_clean":"2023-10-08T07:05:34.320530+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:05:34.320530+0000","last_undegraded":"2023-10-08T07:05:34.320530+0000","last_fullsized":"2023-10-08T07:05:34.320530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360128+0000","last_change":"2023-10-08T07:05:33.321314+0000","last_active":"2023-10-08T07:05:34.360128+0000","last_peered":"2023-10-08T07:05:34.360128+0000","last_clean":"2023-10-08T07:05:34.360128+0000","last_became_active":"2023-10-08T07:05:33.320841+0000","last_became_peered":"2023-10-08T07:05:33.320841+0000","last_unstale":"2023-10-08T07:05:34.360128+0000","last_undegraded":"2023-10-08T07:05:34.360128+0000","last_fullsized":"2023-10-08T07:05:34.360128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319725+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:05:34.319725+0000","last_peered":"2023-10-08T07:05:34.319725+0000","last_clean":"2023-10-08T07:05:34.319725+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:05:34.319725+0000","last_undegraded":"2023-10-08T07:05:34.319725+0000","last_fullsized":"2023-10-08T07:05:34.319725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319443+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:05:34.319443+0000","last_peered":"2023-10-08T07:05:34.319443+0000","last_clean":"2023-10-08T07:05:34.319443+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:05:34.319443+0000","last_undegraded":"2023-10-08T07:05:34.319443+0000","last_fullsized":"2023-10-08T07:05:34.319443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319238+0000","last_change":"2023-10-08T07:05:33.327740+0000","last_active":"2023-10-08T07:05:34.319238+0000","last_peered":"2023-10-08T07:05:34.319238+0000","last_clean":"2023-10-08T07:05:34.319238+0000","last_became_active":"2023-10-08T07:05:33.325912+0000","last_became_peered":"2023-10-08T07:05:33.325912+0000","last_unstale":"2023-10-08T07:05:34.319238+0000","last_undegraded":"2023-10-08T07:05:34.319238+0000","last_fullsized":"2023-10-08T07:05:34.319238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319837+0000","last_change":"2023-10-08T07:05:33.322628+0000","last_active":"2023-10-08T07:05:34.319837+0000","last_peered":"2023-10-08T07:05:34.319837+0000","last_clean":"2023-10-08T07:05:34.319837+0000","last_became_active":"2023-10-08T07:05:33.321816+0000","last_became_peered":"2023-10-08T07:05:33.321816+0000","last_unstale":"2023-10-08T07:05:34.319837+0000","last_undegraded":"2023-10-08T07:05:34.319837+0000","last_fullsized":"2023-10-08T07:05:34.319837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360894+0000","last_change":"2023-10-08T07:05:33.322098+0000","last_active":"2023-10-08T07:05:34.360894+0000","last_peered":"2023-10-08T07:05:34.360894+0000","last_clean":"2023-10-08T07:05:34.360894+0000","last_became_active":"2023-10-08T07:05:33.321208+0000","last_became_peered":"2023-10-08T07:05:33.321208+0000","last_unstale":"2023-10-08T07:05:34.360894+0000","last_undegraded":"2023-10-08T07:05:34.360894+0000","last_fullsized":"2023-10-08T07:05:34.360894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320139+0000","last_change":"2023-10-08T07:05:33.328140+0000","last_active":"2023-10-08T07:05:34.320139+0000","last_peered":"2023-10-08T07:05:34.320139+0000","last_clean":"2023-10-08T07:05:34.320139+0000","last_became_active":"2023-10-08T07:05:33.327595+0000","last_became_peered":"2023-10-08T07:05:33.327595+0000","last_unstale":"2023-10-08T07:05:34.320139+0000","last_undegraded":"2023-10-08T07:05:34.320139+0000","last_fullsized":"2023-10-08T07:05:34.320139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360113+0000","last_change":"2023-10-08T07:05:33.329834+0000","last_active":"2023-10-08T07:05:34.360113+0000","last_peered":"2023-10-08T07:05:34.360113+0000","last_clean":"2023-10-08T07:05:34.360113+0000","last_became_active":"2023-10-08T07:05:33.329357+0000","last_became_peered":"2023-10-08T07:05:33.329357+0000","last_unstale":"2023-10-08T07:05:34.360113+0000","last_undegraded":"2023-10-08T07:05:34.360113+0000","last_fullsized":"2023-10-08T07:05:34.360113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360010+0000","last_change":"2023-10-08T07:05:33.319643+0000","last_active":"2023-10-08T07:05:34.360010+0000","last_peered":"2023-10-08T07:05:34.360010+0000","last_clean":"2023-10-08T07:05:34.360010+0000","last_became_active":"2023-10-08T07:05:33.318659+0000","last_became_peered":"2023-10-08T07:05:33.318659+0000","last_unstale":"2023-10-08T07:05:34.360010+0000","last_undegraded":"2023-10-08T07:05:34.360010+0000","last_fullsized":"2023-10-08T07:05:34.360010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320295+0000","last_change":"2023-10-08T07:05:33.318491+0000","last_active":"2023-10-08T07:05:34.320295+0000","last_peered":"2023-10-08T07:05:34.320295+0000","last_clean":"2023-10-08T07:05:34.320295+0000","last_became_active":"2023-10-08T07:05:33.317703+0000","last_became_peered":"2023-10-08T07:05:33.317703+0000","last_unstale":"2023-10-08T07:05:34.320295+0000","last_undegraded":"2023-10-08T07:05:34.320295+0000","last_fullsized":"2023-10-08T07:05:34.320295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.319294+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.318364+0000","last_became_peered":"2023-10-08T07:05:33.318364+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319517+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:05:34.319517+0000","last_peered":"2023-10-08T07:05:34.319517+0000","last_clean":"2023-10-08T07:05:34.319517+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:05:34.319517+0000","last_undegraded":"2023-10-08T07:05:34.319517+0000","last_fullsized":"2023-10-08T07:05:34.319517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319930+0000","last_change":"2023-10-08T07:05:33.317287+0000","last_active":"2023-10-08T07:05:34.319930+0000","last_peered":"2023-10-08T07:05:34.319930+0000","last_clean":"2023-10-08T07:05:34.319930+0000","last_became_active":"2023-10-08T07:05:33.316483+0000","last_became_peered":"2023-10-08T07:05:33.316483+0000","last_unstale":"2023-10-08T07:05:34.319930+0000","last_undegraded":"2023-10-08T07:05:34.319930+0000","last_fullsized":"2023-10-08T07:05:34.319930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361063+0000","last_change":"2023-10-08T07:05:33.321088+0000","last_active":"2023-10-08T07:05:34.361063+0000","last_peered":"2023-10-08T07:05:34.361063+0000","last_clean":"2023-10-08T07:05:34.361063+0000","last_became_active":"2023-10-08T07:05:33.319541+0000","last_became_peered":"2023-10-08T07:05:33.319541+0000","last_unstale":"2023-10-08T07:05:34.361063+0000","last_undegraded":"2023-10-08T07:05:34.361063+0000","last_fullsized":"2023-10-08T07:05:34.361063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319536+0000","last_change":"2023-10-08T07:05:33.322110+0000","last_active":"2023-10-08T07:05:34.319536+0000","last_peered":"2023-10-08T07:05:34.319536+0000","last_clean":"2023-10-08T07:05:34.319536+0000","last_became_active":"2023-10-08T07:05:33.321780+0000","last_became_peered":"2023-10-08T07:05:33.321780+0000","last_unstale":"2023-10-08T07:05:34.319536+0000","last_undegraded":"2023-10-08T07:05:34.319536+0000","last_fullsized":"2023-10-08T07:05:34.319536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320412+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:05:34.320412+0000","last_peered":"2023-10-08T07:05:34.320412+0000","last_clean":"2023-10-08T07:05:34.320412+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:05:34.320412+0000","last_undegraded":"2023-10-08T07:05:34.320412+0000","last_fullsized":"2023-10-08T07:05:34.320412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319754+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:05:34.319754+0000","last_peered":"2023-10-08T07:05:34.319754+0000","last_clean":"2023-10-08T07:05:34.319754+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:05:34.319754+0000","last_undegraded":"2023-10-08T07:05:34.319754+0000","last_fullsized":"2023-10-08T07:05:34.319754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360008+0000","last_change":"2023-10-08T07:05:33.326970+0000","last_active":"2023-10-08T07:05:34.360008+0000","last_peered":"2023-10-08T07:05:34.360008+0000","last_clean":"2023-10-08T07:05:34.360008+0000","last_became_active":"2023-10-08T07:05:33.326650+0000","last_became_peered":"2023-10-08T07:05:33.326650+0000","last_unstale":"2023-10-08T07:05:34.360008+0000","last_undegraded":"2023-10-08T07:05:34.360008+0000","last_fullsized":"2023-10-08T07:05:34.360008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319095+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:05:34.319095+0000","last_peered":"2023-10-08T07:05:34.319095+0000","last_clean":"2023-10-08T07:05:34.319095+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:05:34.319095+0000","last_undegraded":"2023-10-08T07:05:34.319095+0000","last_fullsized":"2023-10-08T07:05:34.319095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360261+0000","last_change":"2023-10-08T07:05:33.319759+0000","last_active":"2023-10-08T07:05:34.360261+0000","last_peered":"2023-10-08T07:05:34.360261+0000","last_clean":"2023-10-08T07:05:34.360261+0000","last_became_active":"2023-10-08T07:05:33.318507+0000","last_became_peered":"2023-10-08T07:05:33.318507+0000","last_unstale":"2023-10-08T07:05:34.360261+0000","last_undegraded":"2023-10-08T07:05:34.360261+0000","last_fullsized":"2023-10-08T07:05:34.360261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361101+0000","last_change":"2023-10-08T07:05:33.317560+0000","last_active":"2023-10-08T07:05:34.361101+0000","last_peered":"2023-10-08T07:05:34.361101+0000","last_clean":"2023-10-08T07:05:34.361101+0000","last_became_active":"2023-10-08T07:05:33.316906+0000","last_became_peered":"2023-10-08T07:05:33.316906+0000","last_unstale":"2023-10-08T07:05:34.361101+0000","last_undegraded":"2023-10-08T07:05:34.361101+0000","last_fullsized":"2023-10-08T07:05:34.361101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320043+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:05:34.320043+0000","last_peered":"2023-10-08T07:05:34.320043+0000","last_clean":"2023-10-08T07:05:34.320043+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:05:34.320043+0000","last_undegraded":"2023-10-08T07:05:34.320043+0000","last_fullsized":"2023-10-08T07:05:34.320043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320344+0000","last_change":"2023-10-08T07:05:33.326267+0000","last_active":"2023-10-08T07:05:34.320344+0000","last_peered":"2023-10-08T07:05:34.320344+0000","last_clean":"2023-10-08T07:05:34.320344+0000","last_became_active":"2023-10-08T07:05:33.324579+0000","last_became_peered":"2023-10-08T07:05:33.324579+0000","last_unstale":"2023-10-08T07:05:34.320344+0000","last_undegraded":"2023-10-08T07:05:34.320344+0000","last_fullsized":"2023-10-08T07:05:34.320344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359920+0000","last_change":"2023-10-08T07:05:32.320295+0000","last_active":"2023-10-08T07:05:34.359920+0000","last_peered":"2023-10-08T07:05:34.359920+0000","last_clean":"2023-10-08T07:05:34.359920+0000","last_became_active":"2023-10-08T07:05:32.320044+0000","last_became_peered":"2023-10-08T07:05:32.320044+0000","last_unstale":"2023-10-08T07:05:34.359920+0000","last_undegraded":"2023-10-08T07:05:34.359920+0000","last_fullsized":"2023-10-08T07:05:34.359920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:44.690611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360949+0000","last_change":"2023-10-08T07:05:33.329921+0000","last_active":"2023-10-08T07:05:34.360949+0000","last_peered":"2023-10-08T07:05:34.360949+0000","last_clean":"2023-10-08T07:05:34.360949+0000","last_became_active":"2023-10-08T07:05:33.329346+0000","last_became_peered":"2023-10-08T07:05:33.329346+0000","last_unstale":"2023-10-08T07:05:34.360949+0000","last_undegraded":"2023-10-08T07:05:34.360949+0000","last_fullsized":"2023-10-08T07:05:34.360949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319260+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:05:34.319260+0000","last_peered":"2023-10-08T07:05:34.319260+0000","last_clean":"2023-10-08T07:05:34.319260+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:05:34.319260+0000","last_undegraded":"2023-10-08T07:05:34.319260+0000","last_fullsized":"2023-10-08T07:05:34.319260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319829+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:05:34.319829+0000","last_peered":"2023-10-08T07:05:34.319829+0000","last_clean":"2023-10-08T07:05:34.319829+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:05:34.319829+0000","last_undegraded":"2023-10-08T07:05:34.319829+0000","last_fullsized":"2023-10-08T07:05:34.319829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319123+0000","last_change":"2023-10-08T07:05:32.315935+0000","last_active":"2023-10-08T07:05:34.319123+0000","last_peered":"2023-10-08T07:05:34.319123+0000","last_clean":"2023-10-08T07:05:34.319123+0000","last_became_active":"2023-10-08T07:05:32.315661+0000","last_became_peered":"2023-10-08T07:05:32.315661+0000","last_unstale":"2023-10-08T07:05:34.319123+0000","last_undegraded":"2023-10-08T07:05:34.319123+0000","last_fullsized":"2023-10-08T07:05:34.319123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:01:05.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361026+0000","last_change":"2023-10-08T07:05:33.330068+0000","last_active":"2023-10-08T07:05:34.361026+0000","last_peered":"2023-10-08T07:05:34.361026+0000","last_clean":"2023-10-08T07:05:34.361026+0000","last_became_active":"2023-10-08T07:05:33.329169+0000","last_became_peered":"2023-10-08T07:05:33.329169+0000","last_unstale":"2023-10-08T07:05:34.361026+0000","last_undegraded":"2023-10-08T07:05:34.361026+0000","last_fullsized":"2023-10-08T07:05:34.361026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:05:34.320135+0000","last_peered":"2023-10-08T07:05:34.320135+0000","last_clean":"2023-10-08T07:05:34.320135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:05:34.320135+0000","last_undegraded":"2023-10-08T07:05:34.320135+0000","last_fullsized":"2023-10-08T07:05:34.320135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318813+0000","last_change":"2023-10-08T07:05:33.316496+0000","last_active":"2023-10-08T07:05:34.318813+0000","last_peered":"2023-10-08T07:05:34.318813+0000","last_clean":"2023-10-08T07:05:34.318813+0000","last_became_active":"2023-10-08T07:05:33.316084+0000","last_became_peered":"2023-10-08T07:05:33.316084+0000","last_unstale":"2023-10-08T07:05:34.318813+0000","last_undegraded":"2023-10-08T07:05:34.318813+0000","last_fullsized":"2023-10-08T07:05:34.318813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320455+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:05:34.320455+0000","last_peered":"2023-10-08T07:05:34.320455+0000","last_clean":"2023-10-08T07:05:34.320455+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:05:34.320455+0000","last_undegraded":"2023-10-08T07:05:34.320455+0000","last_fullsized":"2023-10-08T07:05:34.320455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319317+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:05:34.319317+0000","last_peered":"2023-10-08T07:05:34.319317+0000","last_clean":"2023-10-08T07:05:34.319317+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:05:34.319317+0000","last_undegraded":"2023-10-08T07:05:34.319317+0000","last_fullsized":"2023-10-08T07:05:34.319317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360636+0000","last_change":"2023-10-08T07:05:32.323201+0000","last_active":"2023-10-08T07:05:34.360636+0000","last_peered":"2023-10-08T07:05:34.360636+0000","last_clean":"2023-10-08T07:05:34.360636+0000","last_became_active":"2023-10-08T07:05:32.322864+0000","last_became_peered":"2023-10-08T07:05:32.322864+0000","last_unstale":"2023-10-08T07:05:34.360636+0000","last_undegraded":"2023-10-08T07:05:34.360636+0000","last_fullsized":"2023-10-08T07:05:34.360636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:40.093124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319535+0000","last_change":"2023-10-08T07:05:33.317114+0000","last_active":"2023-10-08T07:05:34.319535+0000","last_peered":"2023-10-08T07:05:34.319535+0000","last_clean":"2023-10-08T07:05:34.319535+0000","last_became_active":"2023-10-08T07:05:33.316390+0000","last_became_peered":"2023-10-08T07:05:33.316390+0000","last_unstale":"2023-10-08T07:05:34.319535+0000","last_undegraded":"2023-10-08T07:05:34.319535+0000","last_fullsized":"2023-10-08T07:05:34.319535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320136+0000","last_change":"2023-10-08T07:05:32.319510+0000","last_active":"2023-10-08T07:05:34.320136+0000","last_peered":"2023-10-08T07:05:34.320136+0000","last_clean":"2023-10-08T07:05:34.320136+0000","last_became_active":"2023-10-08T07:05:32.319209+0000","last_became_peered":"2023-10-08T07:05:32.319209+0000","last_unstale":"2023-10-08T07:05:34.320136+0000","last_undegraded":"2023-10-08T07:05:34.320136+0000","last_fullsized":"2023-10-08T07:05:34.320136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:28.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320332+0000","last_change":"2023-10-08T07:05:33.317137+0000","last_active":"2023-10-08T07:05:34.320332+0000","last_peered":"2023-10-08T07:05:34.320332+0000","last_clean":"2023-10-08T07:05:34.320332+0000","last_became_active":"2023-10-08T07:05:33.316562+0000","last_became_peered":"2023-10-08T07:05:33.316562+0000","last_unstale":"2023-10-08T07:05:34.320332+0000","last_undegraded":"2023-10-08T07:05:34.320332+0000","last_fullsized":"2023-10-08T07:05:34.320332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:41.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320369+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:05:34.320369+0000","last_peered":"2023-10-08T07:05:34.320369+0000","last_clean":"2023-10-08T07:05:34.320369+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:05:34.320369+0000","last_undegraded":"2023-10-08T07:05:34.320369+0000","last_fullsized":"2023-10-08T07:05:34.320369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360395+0000","last_change":"2023-10-08T07:05:33.322201+0000","last_active":"2023-10-08T07:05:34.360395+0000","last_peered":"2023-10-08T07:05:34.360395+0000","last_clean":"2023-10-08T07:05:34.360395+0000","last_became_active":"2023-10-08T07:05:33.321826+0000","last_became_peered":"2023-10-08T07:05:33.321826+0000","last_unstale":"2023-10-08T07:05:34.360395+0000","last_undegraded":"2023-10-08T07:05:34.360395+0000","last_fullsized":"2023-10-08T07:05:34.360395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319178+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:05:34.319178+0000","last_peered":"2023-10-08T07:05:34.319178+0000","last_clean":"2023-10-08T07:05:34.319178+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:05:34.319178+0000","last_undegraded":"2023-10-08T07:05:34.319178+0000","last_fullsized":"2023-10-08T07:05:34.319178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360947+0000","last_change":"2023-10-08T07:05:33.317545+0000","last_active":"2023-10-08T07:05:34.360947+0000","last_peered":"2023-10-08T07:05:34.360947+0000","last_clean":"2023-10-08T07:05:34.360947+0000","last_became_active":"2023-10-08T07:05:33.317134+0000","last_became_peered":"2023-10-08T07:05:33.317134+0000","last_unstale":"2023-10-08T07:05:34.360947+0000","last_undegraded":"2023-10-08T07:05:34.360947+0000","last_fullsized":"2023-10-08T07:05:34.360947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359736+0000","last_change":"2023-10-08T07:05:32.323406+0000","last_active":"2023-10-08T07:05:34.359736+0000","last_peered":"2023-10-08T07:05:34.359736+0000","last_clean":"2023-10-08T07:05:34.359736+0000","last_became_active":"2023-10-08T07:05:32.323040+0000","last_became_peered":"2023-10-08T07:05:32.323040+0000","last_unstale":"2023-10-08T07:05:34.359736+0000","last_undegraded":"2023-10-08T07:05:34.359736+0000","last_fullsized":"2023-10-08T07:05:34.359736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319639+0000","last_change":"2023-10-08T07:05:32.319220+0000","last_active":"2023-10-08T07:05:34.319639+0000","last_peered":"2023-10-08T07:05:34.319639+0000","last_clean":"2023-10-08T07:05:34.319639+0000","last_became_active":"2023-10-08T07:05:32.318838+0000","last_became_peered":"2023-10-08T07:05:32.318838+0000","last_unstale":"2023-10-08T07:05:34.319639+0000","last_undegraded":"2023-10-08T07:05:34.319639+0000","last_fullsized":"2023-10-08T07:05:34.319639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:32:59.940325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320271+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:05:34.320271+0000","last_peered":"2023-10-08T07:05:34.320271+0000","last_clean":"2023-10-08T07:05:34.320271+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:05:34.320271+0000","last_undegraded":"2023-10-08T07:05:34.320271+0000","last_fullsized":"2023-10-08T07:05:34.320271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320776+0000","last_change":"2023-10-08T07:05:32.319446+0000","last_active":"2023-10-08T07:05:34.320776+0000","last_peered":"2023-10-08T07:05:34.320776+0000","last_clean":"2023-10-08T07:05:34.320776+0000","last_became_active":"2023-10-08T07:05:32.319019+0000","last_became_peered":"2023-10-08T07:05:32.319019+0000","last_unstale":"2023-10-08T07:05:34.320776+0000","last_undegraded":"2023-10-08T07:05:34.320776+0000","last_fullsized":"2023-10-08T07:05:34.320776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:56.843162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359487+0000","last_change":"2023-10-08T07:05:33.330217+0000","last_active":"2023-10-08T07:05:34.359487+0000","last_peered":"2023-10-08T07:05:34.359487+0000","last_clean":"2023-10-08T07:05:34.359487+0000","last_became_active":"2023-10-08T07:05:33.329639+0000","last_became_peered":"2023-10-08T07:05:33.329639+0000","last_unstale":"2023-10-08T07:05:34.359487+0000","last_undegraded":"2023-10-08T07:05:34.359487+0000","last_fullsized":"2023-10-08T07:05:34.359487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:21.715645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360604+0000","last_change":"2023-10-08T07:05:32.323481+0000","last_active":"2023-10-08T07:05:34.360604+0000","last_peered":"2023-10-08T07:05:34.360604+0000","last_clean":"2023-10-08T07:05:34.360604+0000","last_became_active":"2023-10-08T07:05:32.323243+0000","last_became_peered":"2023-10-08T07:05:32.323243+0000","last_unstale":"2023-10-08T07:05:34.360604+0000","last_undegraded":"2023-10-08T07:05:34.360604+0000","last_fullsized":"2023-10-08T07:05:34.360604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359906+0000","last_change":"2023-10-08T07:05:33.318539+0000","last_active":"2023-10-08T07:05:34.359906+0000","last_peered":"2023-10-08T07:05:34.359906+0000","last_clean":"2023-10-08T07:05:34.359906+0000","last_became_active":"2023-10-08T07:05:33.317371+0000","last_became_peered":"2023-10-08T07:05:33.317371+0000","last_unstale":"2023-10-08T07:05:34.359906+0000","last_undegraded":"2023-10-08T07:05:34.359906+0000","last_fullsized":"2023-10-08T07:05:34.359906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:00.945202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320279+0000","last_change":"2023-10-08T07:05:32.321744+0000","last_active":"2023-10-08T07:05:34.320279+0000","last_peered":"2023-10-08T07:05:34.320279+0000","last_clean":"2023-10-08T07:05:34.320279+0000","last_became_active":"2023-10-08T07:05:32.321482+0000","last_became_peered":"2023-10-08T07:05:32.321482+0000","last_unstale":"2023-10-08T07:05:34.320279+0000","last_undegraded":"2023-10-08T07:05:34.320279+0000","last_fullsized":"2023-10-08T07:05:34.320279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:13.789778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320018+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:05:34.320018+0000","last_peered":"2023-10-08T07:05:34.320018+0000","last_clean":"2023-10-08T07:05:34.320018+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:05:34.320018+0000","last_undegraded":"2023-10-08T07:05:34.320018+0000","last_fullsized":"2023-10-08T07:05:34.320018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319626+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:05:34.319626+0000","last_peered":"2023-10-08T07:05:34.319626+0000","last_clean":"2023-10-08T07:05:34.319626+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:05:34.319626+0000","last_undegraded":"2023-10-08T07:05:34.319626+0000","last_fullsized":"2023-10-08T07:05:34.319626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319559+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:05:34.319559+0000","last_peered":"2023-10-08T07:05:34.319559+0000","last_clean":"2023-10-08T07:05:34.319559+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:05:34.319559+0000","last_undegraded":"2023-10-08T07:05:34.319559+0000","last_fullsized":"2023-10-08T07:05:34.319559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319350+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:05:34.319350+0000","last_peered":"2023-10-08T07:05:34.319350+0000","last_clean":"2023-10-08T07:05:34.319350+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:05:34.319350+0000","last_undegraded":"2023-10-08T07:05:34.319350+0000","last_fullsized":"2023-10-08T07:05:34.319350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319602+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:05:34.319602+0000","last_peered":"2023-10-08T07:05:34.319602+0000","last_clean":"2023-10-08T07:05:34.319602+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:05:34.319602+0000","last_undegraded":"2023-10-08T07:05:34.319602+0000","last_fullsized":"2023-10-08T07:05:34.319602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320680+0000","last_change":"2023-10-08T07:05:33.319933+0000","last_active":"2023-10-08T07:05:34.320680+0000","last_peered":"2023-10-08T07:05:34.320680+0000","last_clean":"2023-10-08T07:05:34.320680+0000","last_became_active":"2023-10-08T07:05:33.317937+0000","last_became_peered":"2023-10-08T07:05:33.317937+0000","last_unstale":"2023-10-08T07:05:34.320680+0000","last_undegraded":"2023-10-08T07:05:34.320680+0000","last_fullsized":"2023-10-08T07:05:34.320680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:57:42.074994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359555+0000","last_change":"2023-10-08T07:05:32.323415+0000","last_active":"2023-10-08T07:05:34.359555+0000","last_peered":"2023-10-08T07:05:34.359555+0000","last_clean":"2023-10-08T07:05:34.359555+0000","last_became_active":"2023-10-08T07:05:32.322910+0000","last_became_peered":"2023-10-08T07:05:32.322910+0000","last_unstale":"2023-10-08T07:05:34.359555+0000","last_undegraded":"2023-10-08T07:05:34.359555+0000","last_fullsized":"2023-10-08T07:05:34.359555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320553+0000","last_change":"2023-10-08T07:05:33.325994+0000","last_active":"2023-10-08T07:05:34.320553+0000","last_peered":"2023-10-08T07:05:34.320553+0000","last_clean":"2023-10-08T07:05:34.320553+0000","last_became_active":"2023-10-08T07:05:33.324865+0000","last_became_peered":"2023-10-08T07:05:33.324865+0000","last_unstale":"2023-10-08T07:05:34.320553+0000","last_undegraded":"2023-10-08T07:05:34.320553+0000","last_fullsized":"2023-10-08T07:05:34.320553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:14.142601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359677+0000","last_change":"2023-10-08T07:05:32.320359+0000","last_active":"2023-10-08T07:05:34.359677+0000","last_peered":"2023-10-08T07:05:34.359677+0000","last_clean":"2023-10-08T07:05:34.359677+0000","last_became_active":"2023-10-08T07:05:32.320137+0000","last_became_peered":"2023-10-08T07:05:32.320137+0000","last_unstale":"2023-10-08T07:05:34.359677+0000","last_undegraded":"2023-10-08T07:05:34.359677+0000","last_fullsized":"2023-10-08T07:05:34.359677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:32.366341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320091+0000","last_change":"2023-10-08T07:05:33.322861+0000","last_active":"2023-10-08T07:05:34.320091+0000","last_peered":"2023-10-08T07:05:34.320091+0000","last_clean":"2023-10-08T07:05:34.320091+0000","last_became_active":"2023-10-08T07:05:33.322450+0000","last_became_peered":"2023-10-08T07:05:33.322450+0000","last_unstale":"2023-10-08T07:05:34.320091+0000","last_undegraded":"2023-10-08T07:05:34.320091+0000","last_fullsized":"2023-10-08T07:05:34.320091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309081+0000","last_change":"2023-10-08T07:05:27.295597+0000","last_active":"2023-10-08T07:05:33.309081+0000","last_peered":"2023-10-08T07:05:33.309081+0000","last_clean":"2023-10-08T07:05:33.309081+0000","last_became_active":"2023-10-08T07:05:27.295265+0000","last_became_peered":"2023-10-08T07:05:27.295265+0000","last_unstale":"2023-10-08T07:05:33.309081+0000","last_undegraded":"2023-10-08T07:05:33.309081+0000","last_fullsized":"2023-10-08T07:05:33.309081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:50.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360046+0000","last_change":"2023-10-08T07:05:33.326797+0000","last_active":"2023-10-08T07:05:34.360046+0000","last_peered":"2023-10-08T07:05:34.360046+0000","last_clean":"2023-10-08T07:05:34.360046+0000","last_became_active":"2023-10-08T07:05:33.326518+0000","last_became_peered":"2023-10-08T07:05:33.326518+0000","last_unstale":"2023-10-08T07:05:34.360046+0000","last_undegraded":"2023-10-08T07:05:34.360046+0000","last_fullsized":"2023-10-08T07:05:34.360046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318961+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:05:33.318961+0000","last_peered":"2023-10-08T07:05:33.318961+0000","last_clean":"2023-10-08T07:05:33.318961+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:05:33.318961+0000","last_undegraded":"2023-10-08T07:05:33.318961+0000","last_fullsized":"2023-10-08T07:05:33.318961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320087+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:05:34.320087+0000","last_peered":"2023-10-08T07:05:34.320087+0000","last_clean":"2023-10-08T07:05:34.320087+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:05:34.320087+0000","last_undegraded":"2023-10-08T07:05:34.320087+0000","last_fullsized":"2023-10-08T07:05:34.320087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319579+0000","last_change":"2023-10-08T07:05:33.322164+0000","last_active":"2023-10-08T07:05:34.319579+0000","last_peered":"2023-10-08T07:05:34.319579+0000","last_clean":"2023-10-08T07:05:34.319579+0000","last_became_active":"2023-10-08T07:05:33.321757+0000","last_became_peered":"2023-10-08T07:05:33.321757+0000","last_unstale":"2023-10-08T07:05:34.319579+0000","last_undegraded":"2023-10-08T07:05:34.319579+0000","last_fullsized":"2023-10-08T07:05:34.319579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.308287+0000","last_change":"2023-10-08T07:05:27.295991+0000","last_active":"2023-10-08T07:05:33.308287+0000","last_peered":"2023-10-08T07:05:33.308287+0000","last_clean":"2023-10-08T07:05:33.308287+0000","last_became_active":"2023-10-08T07:05:27.295727+0000","last_became_peered":"2023-10-08T07:05:27.295727+0000","last_unstale":"2023-10-08T07:05:33.308287+0000","last_undegraded":"2023-10-08T07:05:33.308287+0000","last_fullsized":"2023-10-08T07:05:33.308287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:54.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359567+0000","last_change":"2023-10-08T07:05:32.323161+0000","last_active":"2023-10-08T07:05:34.359567+0000","last_peered":"2023-10-08T07:05:34.359567+0000","last_clean":"2023-10-08T07:05:34.359567+0000","last_became_active":"2023-10-08T07:05:32.322832+0000","last_became_peered":"2023-10-08T07:05:32.322832+0000","last_unstale":"2023-10-08T07:05:34.359567+0000","last_undegraded":"2023-10-08T07:05:34.359567+0000","last_fullsized":"2023-10-08T07:05:34.359567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320239+0000","last_change":"2023-10-08T07:05:33.323204+0000","last_active":"2023-10-08T07:05:34.320239+0000","last_peered":"2023-10-08T07:05:34.320239+0000","last_clean":"2023-10-08T07:05:34.320239+0000","last_became_active":"2023-10-08T07:05:33.322899+0000","last_became_peered":"2023-10-08T07:05:33.322899+0000","last_unstale":"2023-10-08T07:05:34.320239+0000","last_undegraded":"2023-10-08T07:05:34.320239+0000","last_fullsized":"2023-10-08T07:05:34.320239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319302+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:05:33.319302+0000","last_peered":"2023-10-08T07:05:33.319302+0000","last_clean":"2023-10-08T07:05:33.319302+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:05:33.319302+0000","last_undegraded":"2023-10-08T07:05:33.319302+0000","last_fullsized":"2023-10-08T07:05:33.319302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318604+0000","last_change":"2023-10-08T07:05:22.277737+0000","last_active":"2023-10-08T07:05:33.318604+0000","last_peered":"2023-10-08T07:05:33.318604+0000","last_clean":"2023-10-08T07:05:33.318604+0000","last_became_active":"2023-10-08T07:05:22.277417+0000","last_became_peered":"2023-10-08T07:05:22.277417+0000","last_unstale":"2023-10-08T07:05:33.318604+0000","last_undegraded":"2023-10-08T07:05:33.318604+0000","last_fullsized":"2023-10-08T07:05:33.318604+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:10.186804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318995+0000","last_change":"2023-10-08T07:05:32.316756+0000","last_active":"2023-10-08T07:05:34.318995+0000","last_peered":"2023-10-08T07:05:34.318995+0000","last_clean":"2023-10-08T07:05:34.318995+0000","last_became_active":"2023-10-08T07:05:32.316340+0000","last_became_peered":"2023-10-08T07:05:32.316340+0000","last_unstale":"2023-10-08T07:05:34.318995+0000","last_undegraded":"2023-10-08T07:05:34.318995+0000","last_fullsized":"2023-10-08T07:05:34.318995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:46:34.838960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320659+0000","last_change":"2023-10-08T07:05:33.318964+0000","last_active":"2023-10-08T07:05:34.320659+0000","last_peered":"2023-10-08T07:05:34.320659+0000","last_clean":"2023-10-08T07:05:34.320659+0000","last_became_active":"2023-10-08T07:05:33.317866+0000","last_became_peered":"2023-10-08T07:05:33.317866+0000","last_unstale":"2023-10-08T07:05:34.320659+0000","last_undegraded":"2023-10-08T07:05:34.320659+0000","last_fullsized":"2023-10-08T07:05:34.320659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:47.306558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319045+0000","last_change":"2023-10-08T07:05:27.295425+0000","last_active":"2023-10-08T07:05:33.319045+0000","last_peered":"2023-10-08T07:05:33.319045+0000","last_clean":"2023-10-08T07:05:33.319045+0000","last_became_active":"2023-10-08T07:05:27.295157+0000","last_became_peered":"2023-10-08T07:05:27.295157+0000","last_unstale":"2023-10-08T07:05:33.319045+0000","last_undegraded":"2023-10-08T07:05:33.319045+0000","last_fullsized":"2023-10-08T07:05:33.319045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:06.192882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318796+0000","last_change":"2023-10-08T07:05:32.317723+0000","last_active":"2023-10-08T07:05:34.318796+0000","last_peered":"2023-10-08T07:05:34.318796+0000","last_clean":"2023-10-08T07:05:34.318796+0000","last_became_active":"2023-10-08T07:05:32.317444+0000","last_became_peered":"2023-10-08T07:05:32.317444+0000","last_unstale":"2023-10-08T07:05:34.318796+0000","last_undegraded":"2023-10-08T07:05:34.318796+0000","last_fullsized":"2023-10-08T07:05:34.318796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:29.242830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360897+0000","last_change":"2023-10-08T07:05:33.321497+0000","last_active":"2023-10-08T07:05:34.360897+0000","last_peered":"2023-10-08T07:05:34.360897+0000","last_clean":"2023-10-08T07:05:34.360897+0000","last_became_active":"2023-10-08T07:05:33.319658+0000","last_became_peered":"2023-10-08T07:05:33.319658+0000","last_unstale":"2023-10-08T07:05:34.360897+0000","last_undegraded":"2023-10-08T07:05:34.360897+0000","last_fullsized":"2023-10-08T07:05:34.360897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.314076+0000","last_change":"2023-10-08T07:05:27.298597+0000","last_active":"2023-10-08T07:05:33.314076+0000","last_peered":"2023-10-08T07:05:33.314076+0000","last_clean":"2023-10-08T07:05:33.314076+0000","last_became_active":"2023-10-08T07:05:27.298355+0000","last_became_peered":"2023-10-08T07:05:27.298355+0000","last_unstale":"2023-10-08T07:05:33.314076+0000","last_undegraded":"2023-10-08T07:05:33.314076+0000","last_fullsized":"2023-10-08T07:05:33.314076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:06.241475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319456+0000","last_change":"2023-10-08T07:05:32.319605+0000","last_active":"2023-10-08T07:05:34.319456+0000","last_peered":"2023-10-08T07:05:34.319456+0000","last_clean":"2023-10-08T07:05:34.319456+0000","last_became_active":"2023-10-08T07:05:32.319244+0000","last_became_peered":"2023-10-08T07:05:32.319244+0000","last_unstale":"2023-10-08T07:05:34.319456+0000","last_undegraded":"2023-10-08T07:05:34.319456+0000","last_fullsized":"2023-10-08T07:05:34.319456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:25.991992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360213+0000","last_change":"2023-10-08T07:05:33.327112+0000","last_active":"2023-10-08T07:05:34.360213+0000","last_peered":"2023-10-08T07:05:34.360213+0000","last_clean":"2023-10-08T07:05:34.360213+0000","last_became_active":"2023-10-08T07:05:33.326816+0000","last_became_peered":"2023-10-08T07:05:33.326816+0000","last_unstale":"2023-10-08T07:05:34.360213+0000","last_undegraded":"2023-10-08T07:05:34.360213+0000","last_fullsized":"2023-10-08T07:05:34.360213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:32.319875+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:32.319385+0000","last_became_peered":"2023-10-08T07:05:32.319385+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309753+0000","last_change":"2023-10-08T07:05:27.295537+0000","last_active":"2023-10-08T07:05:33.309753+0000","last_peered":"2023-10-08T07:05:33.309753+0000","last_clean":"2023-10-08T07:05:33.309753+0000","last_became_active":"2023-10-08T07:05:27.295234+0000","last_became_peered":"2023-10-08T07:05:27.295234+0000","last_unstale":"2023-10-08T07:05:33.309753+0000","last_undegraded":"2023-10-08T07:05:33.309753+0000","last_fullsized":"2023-10-08T07:05:33.309753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:22.951187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318736+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:05:34.318736+0000","last_peered":"2023-10-08T07:05:34.318736+0000","last_clean":"2023-10-08T07:05:34.318736+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:05:34.318736+0000","last_undegraded":"2023-10-08T07:05:34.318736+0000","last_fullsized":"2023-10-08T07:05:34.318736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.325045+0000","last_change":"2023-10-08T07:05:27.295945+0000","last_active":"2023-10-08T07:05:33.325045+0000","last_peered":"2023-10-08T07:05:33.325045+0000","last_clean":"2023-10-08T07:05:33.325045+0000","last_became_active":"2023-10-08T07:05:27.295726+0000","last_became_peered":"2023-10-08T07:05:27.295726+0000","last_unstale":"2023-10-08T07:05:33.325045+0000","last_undegraded":"2023-10-08T07:05:33.325045+0000","last_fullsized":"2023-10-08T07:05:33.325045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:55.040889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319781+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:05:34.319781+0000","last_peered":"2023-10-08T07:05:34.319781+0000","last_clean":"2023-10-08T07:05:34.319781+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:05:34.319781+0000","last_undegraded":"2023-10-08T07:05:34.319781+0000","last_fullsized":"2023-10-08T07:05:34.319781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359840+0000","last_change":"2023-10-08T07:05:33.326621+0000","last_active":"2023-10-08T07:05:34.359840+0000","last_peered":"2023-10-08T07:05:34.359840+0000","last_clean":"2023-10-08T07:05:34.359840+0000","last_became_active":"2023-10-08T07:05:33.326272+0000","last_became_peered":"2023-10-08T07:05:33.326272+0000","last_unstale":"2023-10-08T07:05:34.359840+0000","last_undegraded":"2023-10-08T07:05:34.359840+0000","last_fullsized":"2023-10-08T07:05:34.359840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:31.752188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359963+0000","last_change":"2023-10-08T07:05:32.323175+0000","last_active":"2023-10-08T07:05:34.359963+0000","last_peered":"2023-10-08T07:05:34.359963+0000","last_clean":"2023-10-08T07:05:34.359963+0000","last_became_active":"2023-10-08T07:05:32.322814+0000","last_became_peered":"2023-10-08T07:05:32.322814+0000","last_unstale":"2023-10-08T07:05:34.359963+0000","last_undegraded":"2023-10-08T07:05:34.359963+0000","last_fullsized":"2023-10-08T07:05:34.359963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360537+0000","last_change":"2023-10-08T07:05:33.318398+0000","last_active":"2023-10-08T07:05:34.360537+0000","last_peered":"2023-10-08T07:05:34.360537+0000","last_clean":"2023-10-08T07:05:34.360537+0000","last_became_active":"2023-10-08T07:05:33.317478+0000","last_became_peered":"2023-10-08T07:05:33.317478+0000","last_unstale":"2023-10-08T07:05:34.360537+0000","last_undegraded":"2023-10-08T07:05:34.360537+0000","last_fullsized":"2023-10-08T07:05:34.360537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320059+0000","last_change":"2023-10-08T07:05:32.320603+0000","last_active":"2023-10-08T07:05:34.320059+0000","last_peered":"2023-10-08T07:05:34.320059+0000","last_clean":"2023-10-08T07:05:34.320059+0000","last_became_active":"2023-10-08T07:05:32.320262+0000","last_became_peered":"2023-10-08T07:05:32.320262+0000","last_unstale":"2023-10-08T07:05:34.320059+0000","last_undegraded":"2023-10-08T07:05:34.320059+0000","last_fullsized":"2023-10-08T07:05:34.320059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:09.249029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319954+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:05:34.319954+0000","last_peered":"2023-10-08T07:05:34.319954+0000","last_clean":"2023-10-08T07:05:34.319954+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:05:34.319954+0000","last_undegraded":"2023-10-08T07:05:34.319954+0000","last_fullsized":"2023-10-08T07:05:34.319954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360795+0000","last_change":"2023-10-08T07:05:32.323143+0000","last_active":"2023-10-08T07:05:34.360795+0000","last_peered":"2023-10-08T07:05:34.360795+0000","last_clean":"2023-10-08T07:05:34.360795+0000","last_became_active":"2023-10-08T07:05:32.322789+0000","last_became_peered":"2023-10-08T07:05:32.322789+0000","last_unstale":"2023-10-08T07:05:34.360795+0000","last_undegraded":"2023-10-08T07:05:34.360795+0000","last_fullsized":"2023-10-08T07:05:34.360795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:03.978136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319826+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:05:34.319826+0000","last_peered":"2023-10-08T07:05:34.319826+0000","last_clean":"2023-10-08T07:05:34.319826+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:05:34.319826+0000","last_undegraded":"2023-10-08T07:05:34.319826+0000","last_fullsized":"2023-10-08T07:05:34.319826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319964+0000","last_change":"2023-10-08T07:05:32.319462+0000","last_active":"2023-10-08T07:05:34.319964+0000","last_peered":"2023-10-08T07:05:34.319964+0000","last_clean":"2023-10-08T07:05:34.319964+0000","last_became_active":"2023-10-08T07:05:32.318951+0000","last_became_peered":"2023-10-08T07:05:32.318951+0000","last_unstale":"2023-10-08T07:05:34.319964+0000","last_undegraded":"2023-10-08T07:05:34.319964+0000","last_fullsized":"2023-10-08T07:05:34.319964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360006+0000","last_change":"2023-10-08T07:05:33.319869+0000","last_active":"2023-10-08T07:05:34.360006+0000","last_peered":"2023-10-08T07:05:34.360006+0000","last_clean":"2023-10-08T07:05:34.360006+0000","last_became_active":"2023-10-08T07:05:33.318241+0000","last_became_peered":"2023-10-08T07:05:33.318241+0000","last_unstale":"2023-10-08T07:05:34.360006+0000","last_undegraded":"2023-10-08T07:05:34.360006+0000","last_fullsized":"2023-10-08T07:05:34.360006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320049+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:05:34.320049+0000","last_peered":"2023-10-08T07:05:34.320049+0000","last_clean":"2023-10-08T07:05:34.320049+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:05:34.320049+0000","last_undegraded":"2023-10-08T07:05:34.320049+0000","last_fullsized":"2023-10-08T07:05:34.320049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320180+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:05:34.320180+0000","last_peered":"2023-10-08T07:05:34.320180+0000","last_clean":"2023-10-08T07:05:34.320180+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:05:34.320180+0000","last_undegraded":"2023-10-08T07:05:34.320180+0000","last_fullsized":"2023-10-08T07:05:34.320180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319653+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:05:34.319653+0000","last_peered":"2023-10-08T07:05:34.319653+0000","last_clean":"2023-10-08T07:05:34.319653+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:05:34.319653+0000","last_undegraded":"2023-10-08T07:05:34.319653+0000","last_fullsized":"2023-10-08T07:05:34.319653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319038+0000","last_change":"2023-10-08T07:05:33.322006+0000","last_active":"2023-10-08T07:05:34.319038+0000","last_peered":"2023-10-08T07:05:34.319038+0000","last_clean":"2023-10-08T07:05:34.319038+0000","last_became_active":"2023-10-08T07:05:33.321639+0000","last_became_peered":"2023-10-08T07:05:33.321639+0000","last_unstale":"2023-10-08T07:05:34.319038+0000","last_undegraded":"2023-10-08T07:05:34.319038+0000","last_fullsized":"2023-10-08T07:05:34.319038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360201+0000","last_change":"2023-10-08T07:05:33.329906+0000","last_active":"2023-10-08T07:05:34.360201+0000","last_peered":"2023-10-08T07:05:34.360201+0000","last_clean":"2023-10-08T07:05:34.360201+0000","last_became_active":"2023-10-08T07:05:33.329615+0000","last_became_peered":"2023-10-08T07:05:33.329615+0000","last_unstale":"2023-10-08T07:05:34.360201+0000","last_undegraded":"2023-10-08T07:05:34.360201+0000","last_fullsized":"2023-10-08T07:05:34.360201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319571+0000","last_change":"2023-10-08T07:05:33.316573+0000","last_active":"2023-10-08T07:05:34.319571+0000","last_peered":"2023-10-08T07:05:34.319571+0000","last_clean":"2023-10-08T07:05:34.319571+0000","last_became_active":"2023-10-08T07:05:33.316193+0000","last_became_peered":"2023-10-08T07:05:33.316193+0000","last_unstale":"2023-10-08T07:05:34.319571+0000","last_undegraded":"2023-10-08T07:05:34.319571+0000","last_fullsized":"2023-10-08T07:05:34.319571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360585+0000","last_change":"2023-10-08T07:05:33.320077+0000","last_active":"2023-10-08T07:05:34.360585+0000","last_peered":"2023-10-08T07:05:34.360585+0000","last_clean":"2023-10-08T07:05:34.360585+0000","last_became_active":"2023-10-08T07:05:33.319392+0000","last_became_peered":"2023-10-08T07:05:33.319392+0000","last_unstale":"2023-10-08T07:05:34.360585+0000","last_undegraded":"2023-10-08T07:05:34.360585+0000","last_fullsized":"2023-10-08T07:05:34.360585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":53710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":650475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":774144,"data_stored":645256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:05:37.842 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T07:05:37.843 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T07:05:37.843 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-08T07:05:37.843 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T07:05:37.844 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-08T07:05:38.276 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:38.289 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3921165191},{"type":"v1","addr":"172.21.15.17:6801","nonce":3921165191}]},"active_addr":"172.21.15.17:6801/3921165191","active_change":"2023-10-08T07:05:16.494698+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4125,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1055363234}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2729107976}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2146180682}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2815505079}]}]} 2023-10-08T07:05:38.294 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-08T07:05:38.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T07:05:38.295 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:38.638 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:34.310228+0000","last_up_change":"2023-10-08T07:05:18.991889+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:38.652 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T07:05:38.653 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:38.988 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:38.988 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:34.310228+0000","last_up_change":"2023-10-08T07:05:18.991889+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:39.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T07:05:39.003 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T07:05:39.003 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T07:05:39.184 INFO:teuthology.orchestra.run.smithi017.stdout:34359738373 2023-10-08T07:05:39.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T07:05:39.188 INFO:teuthology.orchestra.run.smithi017.stdout:34359738374 2023-10-08T07:05:39.188 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T07:05:39.200 INFO:teuthology.orchestra.run.smithi017.stdout:34359738374 2023-10-08T07:05:39.201 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T07:05:39.533 INFO:teuthology.orchestra.run.smithi017.stdout:34359738372 2023-10-08T07:05:39.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2023-10-08T07:05:39.592 INFO:teuthology.orchestra.run.smithi017.stdout:34359738373 2023-10-08T07:05:39.597 INFO:teuthology.orchestra.run.smithi017.stdout:34359738373 2023-10-08T07:05:39.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2023-10-08T07:05:39.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2023-10-08T07:05:40.548 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T07:05:40.609 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T07:05:40.613 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T07:05:40.918 INFO:teuthology.orchestra.run.smithi017.stdout:34359738372 2023-10-08T07:05:40.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2023-10-08T07:05:40.965 INFO:teuthology.orchestra.run.smithi017.stdout:34359738373 2023-10-08T07:05:40.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2023-10-08T07:05:41.006 INFO:teuthology.orchestra.run.smithi017.stdout:34359738373 2023-10-08T07:05:41.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2023-10-08T07:05:41.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T07:05:41.981 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T07:05:42.021 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T07:05:42.311 INFO:teuthology.orchestra.run.smithi017.stdout:34359738374 2023-10-08T07:05:42.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738374 for osd.2 2023-10-08T07:05:42.326 DEBUG:teuthology.parallel:result is None 2023-10-08T07:05:42.354 INFO:teuthology.orchestra.run.smithi017.stdout:34359738375 2023-10-08T07:05:42.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738375 for osd.0 2023-10-08T07:05:42.372 DEBUG:teuthology.parallel:result is None 2023-10-08T07:05:42.409 INFO:teuthology.orchestra.run.smithi017.stdout:34359738375 2023-10-08T07:05:42.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738375 for osd.1 2023-10-08T07:05:42.424 DEBUG:teuthology.parallel:result is None 2023-10-08T07:05:42.424 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T07:05:42.424 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:05:42.806 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:05:42.819 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-10-08T07:05:42.504509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91108,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024412,"statfs":{"total":289910292480,"available":289816997888,"internally_reserved":0,"allocated":1744896,"data_stored":1358647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":91483475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.197666"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361123+0000","last_change":"2023-10-08T07:05:33.319747+0000","last_active":"2023-10-08T07:05:34.361123+0000","last_peered":"2023-10-08T07:05:34.361123+0000","last_clean":"2023-10-08T07:05:34.361123+0000","last_became_active":"2023-10-08T07:05:33.318115+0000","last_became_peered":"2023-10-08T07:05:33.318115+0000","last_unstale":"2023-10-08T07:05:34.361123+0000","last_undegraded":"2023-10-08T07:05:34.361123+0000","last_fullsized":"2023-10-08T07:05:34.361123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360608+0000","last_change":"2023-10-08T07:05:33.322480+0000","last_active":"2023-10-08T07:05:34.360608+0000","last_peered":"2023-10-08T07:05:34.360608+0000","last_clean":"2023-10-08T07:05:34.360608+0000","last_became_active":"2023-10-08T07:05:33.322153+0000","last_became_peered":"2023-10-08T07:05:33.322153+0000","last_unstale":"2023-10-08T07:05:34.360608+0000","last_undegraded":"2023-10-08T07:05:34.360608+0000","last_fullsized":"2023-10-08T07:05:34.360608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:33.325067+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:33.323439+0000","last_became_peered":"2023-10-08T07:05:33.323439+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:18.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320530+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:05:34.320530+0000","last_peered":"2023-10-08T07:05:34.320530+0000","last_clean":"2023-10-08T07:05:34.320530+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:05:34.320530+0000","last_undegraded":"2023-10-08T07:05:34.320530+0000","last_fullsized":"2023-10-08T07:05:34.320530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360128+0000","last_change":"2023-10-08T07:05:33.321314+0000","last_active":"2023-10-08T07:05:34.360128+0000","last_peered":"2023-10-08T07:05:34.360128+0000","last_clean":"2023-10-08T07:05:34.360128+0000","last_became_active":"2023-10-08T07:05:33.320841+0000","last_became_peered":"2023-10-08T07:05:33.320841+0000","last_unstale":"2023-10-08T07:05:34.360128+0000","last_undegraded":"2023-10-08T07:05:34.360128+0000","last_fullsized":"2023-10-08T07:05:34.360128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319725+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:05:34.319725+0000","last_peered":"2023-10-08T07:05:34.319725+0000","last_clean":"2023-10-08T07:05:34.319725+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:05:34.319725+0000","last_undegraded":"2023-10-08T07:05:34.319725+0000","last_fullsized":"2023-10-08T07:05:34.319725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319443+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:05:34.319443+0000","last_peered":"2023-10-08T07:05:34.319443+0000","last_clean":"2023-10-08T07:05:34.319443+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:05:34.319443+0000","last_undegraded":"2023-10-08T07:05:34.319443+0000","last_fullsized":"2023-10-08T07:05:34.319443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319238+0000","last_change":"2023-10-08T07:05:33.327740+0000","last_active":"2023-10-08T07:05:34.319238+0000","last_peered":"2023-10-08T07:05:34.319238+0000","last_clean":"2023-10-08T07:05:34.319238+0000","last_became_active":"2023-10-08T07:05:33.325912+0000","last_became_peered":"2023-10-08T07:05:33.325912+0000","last_unstale":"2023-10-08T07:05:34.319238+0000","last_undegraded":"2023-10-08T07:05:34.319238+0000","last_fullsized":"2023-10-08T07:05:34.319238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319837+0000","last_change":"2023-10-08T07:05:33.322628+0000","last_active":"2023-10-08T07:05:34.319837+0000","last_peered":"2023-10-08T07:05:34.319837+0000","last_clean":"2023-10-08T07:05:34.319837+0000","last_became_active":"2023-10-08T07:05:33.321816+0000","last_became_peered":"2023-10-08T07:05:33.321816+0000","last_unstale":"2023-10-08T07:05:34.319837+0000","last_undegraded":"2023-10-08T07:05:34.319837+0000","last_fullsized":"2023-10-08T07:05:34.319837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360894+0000","last_change":"2023-10-08T07:05:33.322098+0000","last_active":"2023-10-08T07:05:34.360894+0000","last_peered":"2023-10-08T07:05:34.360894+0000","last_clean":"2023-10-08T07:05:34.360894+0000","last_became_active":"2023-10-08T07:05:33.321208+0000","last_became_peered":"2023-10-08T07:05:33.321208+0000","last_unstale":"2023-10-08T07:05:34.360894+0000","last_undegraded":"2023-10-08T07:05:34.360894+0000","last_fullsized":"2023-10-08T07:05:34.360894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320139+0000","last_change":"2023-10-08T07:05:33.328140+0000","last_active":"2023-10-08T07:05:34.320139+0000","last_peered":"2023-10-08T07:05:34.320139+0000","last_clean":"2023-10-08T07:05:34.320139+0000","last_became_active":"2023-10-08T07:05:33.327595+0000","last_became_peered":"2023-10-08T07:05:33.327595+0000","last_unstale":"2023-10-08T07:05:34.320139+0000","last_undegraded":"2023-10-08T07:05:34.320139+0000","last_fullsized":"2023-10-08T07:05:34.320139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360113+0000","last_change":"2023-10-08T07:05:33.329834+0000","last_active":"2023-10-08T07:05:34.360113+0000","last_peered":"2023-10-08T07:05:34.360113+0000","last_clean":"2023-10-08T07:05:34.360113+0000","last_became_active":"2023-10-08T07:05:33.329357+0000","last_became_peered":"2023-10-08T07:05:33.329357+0000","last_unstale":"2023-10-08T07:05:34.360113+0000","last_undegraded":"2023-10-08T07:05:34.360113+0000","last_fullsized":"2023-10-08T07:05:34.360113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360010+0000","last_change":"2023-10-08T07:05:33.319643+0000","last_active":"2023-10-08T07:05:34.360010+0000","last_peered":"2023-10-08T07:05:34.360010+0000","last_clean":"2023-10-08T07:05:34.360010+0000","last_became_active":"2023-10-08T07:05:33.318659+0000","last_became_peered":"2023-10-08T07:05:33.318659+0000","last_unstale":"2023-10-08T07:05:34.360010+0000","last_undegraded":"2023-10-08T07:05:34.360010+0000","last_fullsized":"2023-10-08T07:05:34.360010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320295+0000","last_change":"2023-10-08T07:05:33.318491+0000","last_active":"2023-10-08T07:05:34.320295+0000","last_peered":"2023-10-08T07:05:34.320295+0000","last_clean":"2023-10-08T07:05:34.320295+0000","last_became_active":"2023-10-08T07:05:33.317703+0000","last_became_peered":"2023-10-08T07:05:33.317703+0000","last_unstale":"2023-10-08T07:05:34.320295+0000","last_undegraded":"2023-10-08T07:05:34.320295+0000","last_fullsized":"2023-10-08T07:05:34.320295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.319294+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.318364+0000","last_became_peered":"2023-10-08T07:05:33.318364+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319517+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:05:34.319517+0000","last_peered":"2023-10-08T07:05:34.319517+0000","last_clean":"2023-10-08T07:05:34.319517+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:05:34.319517+0000","last_undegraded":"2023-10-08T07:05:34.319517+0000","last_fullsized":"2023-10-08T07:05:34.319517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319930+0000","last_change":"2023-10-08T07:05:33.317287+0000","last_active":"2023-10-08T07:05:34.319930+0000","last_peered":"2023-10-08T07:05:34.319930+0000","last_clean":"2023-10-08T07:05:34.319930+0000","last_became_active":"2023-10-08T07:05:33.316483+0000","last_became_peered":"2023-10-08T07:05:33.316483+0000","last_unstale":"2023-10-08T07:05:34.319930+0000","last_undegraded":"2023-10-08T07:05:34.319930+0000","last_fullsized":"2023-10-08T07:05:34.319930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361063+0000","last_change":"2023-10-08T07:05:33.321088+0000","last_active":"2023-10-08T07:05:34.361063+0000","last_peered":"2023-10-08T07:05:34.361063+0000","last_clean":"2023-10-08T07:05:34.361063+0000","last_became_active":"2023-10-08T07:05:33.319541+0000","last_became_peered":"2023-10-08T07:05:33.319541+0000","last_unstale":"2023-10-08T07:05:34.361063+0000","last_undegraded":"2023-10-08T07:05:34.361063+0000","last_fullsized":"2023-10-08T07:05:34.361063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319536+0000","last_change":"2023-10-08T07:05:33.322110+0000","last_active":"2023-10-08T07:05:34.319536+0000","last_peered":"2023-10-08T07:05:34.319536+0000","last_clean":"2023-10-08T07:05:34.319536+0000","last_became_active":"2023-10-08T07:05:33.321780+0000","last_became_peered":"2023-10-08T07:05:33.321780+0000","last_unstale":"2023-10-08T07:05:34.319536+0000","last_undegraded":"2023-10-08T07:05:34.319536+0000","last_fullsized":"2023-10-08T07:05:34.319536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320412+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:05:34.320412+0000","last_peered":"2023-10-08T07:05:34.320412+0000","last_clean":"2023-10-08T07:05:34.320412+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:05:34.320412+0000","last_undegraded":"2023-10-08T07:05:34.320412+0000","last_fullsized":"2023-10-08T07:05:34.320412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319754+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:05:34.319754+0000","last_peered":"2023-10-08T07:05:34.319754+0000","last_clean":"2023-10-08T07:05:34.319754+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:05:34.319754+0000","last_undegraded":"2023-10-08T07:05:34.319754+0000","last_fullsized":"2023-10-08T07:05:34.319754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360008+0000","last_change":"2023-10-08T07:05:33.326970+0000","last_active":"2023-10-08T07:05:34.360008+0000","last_peered":"2023-10-08T07:05:34.360008+0000","last_clean":"2023-10-08T07:05:34.360008+0000","last_became_active":"2023-10-08T07:05:33.326650+0000","last_became_peered":"2023-10-08T07:05:33.326650+0000","last_unstale":"2023-10-08T07:05:34.360008+0000","last_undegraded":"2023-10-08T07:05:34.360008+0000","last_fullsized":"2023-10-08T07:05:34.360008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319095+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:05:34.319095+0000","last_peered":"2023-10-08T07:05:34.319095+0000","last_clean":"2023-10-08T07:05:34.319095+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:05:34.319095+0000","last_undegraded":"2023-10-08T07:05:34.319095+0000","last_fullsized":"2023-10-08T07:05:34.319095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360261+0000","last_change":"2023-10-08T07:05:33.319759+0000","last_active":"2023-10-08T07:05:34.360261+0000","last_peered":"2023-10-08T07:05:34.360261+0000","last_clean":"2023-10-08T07:05:34.360261+0000","last_became_active":"2023-10-08T07:05:33.318507+0000","last_became_peered":"2023-10-08T07:05:33.318507+0000","last_unstale":"2023-10-08T07:05:34.360261+0000","last_undegraded":"2023-10-08T07:05:34.360261+0000","last_fullsized":"2023-10-08T07:05:34.360261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361101+0000","last_change":"2023-10-08T07:05:33.317560+0000","last_active":"2023-10-08T07:05:34.361101+0000","last_peered":"2023-10-08T07:05:34.361101+0000","last_clean":"2023-10-08T07:05:34.361101+0000","last_became_active":"2023-10-08T07:05:33.316906+0000","last_became_peered":"2023-10-08T07:05:33.316906+0000","last_unstale":"2023-10-08T07:05:34.361101+0000","last_undegraded":"2023-10-08T07:05:34.361101+0000","last_fullsized":"2023-10-08T07:05:34.361101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320043+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:05:34.320043+0000","last_peered":"2023-10-08T07:05:34.320043+0000","last_clean":"2023-10-08T07:05:34.320043+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:05:34.320043+0000","last_undegraded":"2023-10-08T07:05:34.320043+0000","last_fullsized":"2023-10-08T07:05:34.320043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320344+0000","last_change":"2023-10-08T07:05:33.326267+0000","last_active":"2023-10-08T07:05:34.320344+0000","last_peered":"2023-10-08T07:05:34.320344+0000","last_clean":"2023-10-08T07:05:34.320344+0000","last_became_active":"2023-10-08T07:05:33.324579+0000","last_became_peered":"2023-10-08T07:05:33.324579+0000","last_unstale":"2023-10-08T07:05:34.320344+0000","last_undegraded":"2023-10-08T07:05:34.320344+0000","last_fullsized":"2023-10-08T07:05:34.320344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359920+0000","last_change":"2023-10-08T07:05:32.320295+0000","last_active":"2023-10-08T07:05:34.359920+0000","last_peered":"2023-10-08T07:05:34.359920+0000","last_clean":"2023-10-08T07:05:34.359920+0000","last_became_active":"2023-10-08T07:05:32.320044+0000","last_became_peered":"2023-10-08T07:05:32.320044+0000","last_unstale":"2023-10-08T07:05:34.359920+0000","last_undegraded":"2023-10-08T07:05:34.359920+0000","last_fullsized":"2023-10-08T07:05:34.359920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:44.690611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360949+0000","last_change":"2023-10-08T07:05:33.329921+0000","last_active":"2023-10-08T07:05:34.360949+0000","last_peered":"2023-10-08T07:05:34.360949+0000","last_clean":"2023-10-08T07:05:34.360949+0000","last_became_active":"2023-10-08T07:05:33.329346+0000","last_became_peered":"2023-10-08T07:05:33.329346+0000","last_unstale":"2023-10-08T07:05:34.360949+0000","last_undegraded":"2023-10-08T07:05:34.360949+0000","last_fullsized":"2023-10-08T07:05:34.360949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319260+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:05:34.319260+0000","last_peered":"2023-10-08T07:05:34.319260+0000","last_clean":"2023-10-08T07:05:34.319260+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:05:34.319260+0000","last_undegraded":"2023-10-08T07:05:34.319260+0000","last_fullsized":"2023-10-08T07:05:34.319260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319829+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:05:34.319829+0000","last_peered":"2023-10-08T07:05:34.319829+0000","last_clean":"2023-10-08T07:05:34.319829+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:05:34.319829+0000","last_undegraded":"2023-10-08T07:05:34.319829+0000","last_fullsized":"2023-10-08T07:05:34.319829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319123+0000","last_change":"2023-10-08T07:05:32.315935+0000","last_active":"2023-10-08T07:05:34.319123+0000","last_peered":"2023-10-08T07:05:34.319123+0000","last_clean":"2023-10-08T07:05:34.319123+0000","last_became_active":"2023-10-08T07:05:32.315661+0000","last_became_peered":"2023-10-08T07:05:32.315661+0000","last_unstale":"2023-10-08T07:05:34.319123+0000","last_undegraded":"2023-10-08T07:05:34.319123+0000","last_fullsized":"2023-10-08T07:05:34.319123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:01:05.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361026+0000","last_change":"2023-10-08T07:05:33.330068+0000","last_active":"2023-10-08T07:05:34.361026+0000","last_peered":"2023-10-08T07:05:34.361026+0000","last_clean":"2023-10-08T07:05:34.361026+0000","last_became_active":"2023-10-08T07:05:33.329169+0000","last_became_peered":"2023-10-08T07:05:33.329169+0000","last_unstale":"2023-10-08T07:05:34.361026+0000","last_undegraded":"2023-10-08T07:05:34.361026+0000","last_fullsized":"2023-10-08T07:05:34.361026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:05:34.320135+0000","last_peered":"2023-10-08T07:05:34.320135+0000","last_clean":"2023-10-08T07:05:34.320135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:05:34.320135+0000","last_undegraded":"2023-10-08T07:05:34.320135+0000","last_fullsized":"2023-10-08T07:05:34.320135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318813+0000","last_change":"2023-10-08T07:05:33.316496+0000","last_active":"2023-10-08T07:05:34.318813+0000","last_peered":"2023-10-08T07:05:34.318813+0000","last_clean":"2023-10-08T07:05:34.318813+0000","last_became_active":"2023-10-08T07:05:33.316084+0000","last_became_peered":"2023-10-08T07:05:33.316084+0000","last_unstale":"2023-10-08T07:05:34.318813+0000","last_undegraded":"2023-10-08T07:05:34.318813+0000","last_fullsized":"2023-10-08T07:05:34.318813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320455+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:05:34.320455+0000","last_peered":"2023-10-08T07:05:34.320455+0000","last_clean":"2023-10-08T07:05:34.320455+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:05:34.320455+0000","last_undegraded":"2023-10-08T07:05:34.320455+0000","last_fullsized":"2023-10-08T07:05:34.320455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319317+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:05:34.319317+0000","last_peered":"2023-10-08T07:05:34.319317+0000","last_clean":"2023-10-08T07:05:34.319317+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:05:34.319317+0000","last_undegraded":"2023-10-08T07:05:34.319317+0000","last_fullsized":"2023-10-08T07:05:34.319317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360636+0000","last_change":"2023-10-08T07:05:32.323201+0000","last_active":"2023-10-08T07:05:34.360636+0000","last_peered":"2023-10-08T07:05:34.360636+0000","last_clean":"2023-10-08T07:05:34.360636+0000","last_became_active":"2023-10-08T07:05:32.322864+0000","last_became_peered":"2023-10-08T07:05:32.322864+0000","last_unstale":"2023-10-08T07:05:34.360636+0000","last_undegraded":"2023-10-08T07:05:34.360636+0000","last_fullsized":"2023-10-08T07:05:34.360636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:40.093124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319535+0000","last_change":"2023-10-08T07:05:33.317114+0000","last_active":"2023-10-08T07:05:34.319535+0000","last_peered":"2023-10-08T07:05:34.319535+0000","last_clean":"2023-10-08T07:05:34.319535+0000","last_became_active":"2023-10-08T07:05:33.316390+0000","last_became_peered":"2023-10-08T07:05:33.316390+0000","last_unstale":"2023-10-08T07:05:34.319535+0000","last_undegraded":"2023-10-08T07:05:34.319535+0000","last_fullsized":"2023-10-08T07:05:34.319535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320136+0000","last_change":"2023-10-08T07:05:32.319510+0000","last_active":"2023-10-08T07:05:34.320136+0000","last_peered":"2023-10-08T07:05:34.320136+0000","last_clean":"2023-10-08T07:05:34.320136+0000","last_became_active":"2023-10-08T07:05:32.319209+0000","last_became_peered":"2023-10-08T07:05:32.319209+0000","last_unstale":"2023-10-08T07:05:34.320136+0000","last_undegraded":"2023-10-08T07:05:34.320136+0000","last_fullsized":"2023-10-08T07:05:34.320136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:28.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320332+0000","last_change":"2023-10-08T07:05:33.317137+0000","last_active":"2023-10-08T07:05:34.320332+0000","last_peered":"2023-10-08T07:05:34.320332+0000","last_clean":"2023-10-08T07:05:34.320332+0000","last_became_active":"2023-10-08T07:05:33.316562+0000","last_became_peered":"2023-10-08T07:05:33.316562+0000","last_unstale":"2023-10-08T07:05:34.320332+0000","last_undegraded":"2023-10-08T07:05:34.320332+0000","last_fullsized":"2023-10-08T07:05:34.320332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:41.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320369+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:05:34.320369+0000","last_peered":"2023-10-08T07:05:34.320369+0000","last_clean":"2023-10-08T07:05:34.320369+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:05:34.320369+0000","last_undegraded":"2023-10-08T07:05:34.320369+0000","last_fullsized":"2023-10-08T07:05:34.320369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360395+0000","last_change":"2023-10-08T07:05:33.322201+0000","last_active":"2023-10-08T07:05:34.360395+0000","last_peered":"2023-10-08T07:05:34.360395+0000","last_clean":"2023-10-08T07:05:34.360395+0000","last_became_active":"2023-10-08T07:05:33.321826+0000","last_became_peered":"2023-10-08T07:05:33.321826+0000","last_unstale":"2023-10-08T07:05:34.360395+0000","last_undegraded":"2023-10-08T07:05:34.360395+0000","last_fullsized":"2023-10-08T07:05:34.360395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319178+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:05:34.319178+0000","last_peered":"2023-10-08T07:05:34.319178+0000","last_clean":"2023-10-08T07:05:34.319178+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:05:34.319178+0000","last_undegraded":"2023-10-08T07:05:34.319178+0000","last_fullsized":"2023-10-08T07:05:34.319178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360947+0000","last_change":"2023-10-08T07:05:33.317545+0000","last_active":"2023-10-08T07:05:34.360947+0000","last_peered":"2023-10-08T07:05:34.360947+0000","last_clean":"2023-10-08T07:05:34.360947+0000","last_became_active":"2023-10-08T07:05:33.317134+0000","last_became_peered":"2023-10-08T07:05:33.317134+0000","last_unstale":"2023-10-08T07:05:34.360947+0000","last_undegraded":"2023-10-08T07:05:34.360947+0000","last_fullsized":"2023-10-08T07:05:34.360947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359736+0000","last_change":"2023-10-08T07:05:32.323406+0000","last_active":"2023-10-08T07:05:34.359736+0000","last_peered":"2023-10-08T07:05:34.359736+0000","last_clean":"2023-10-08T07:05:34.359736+0000","last_became_active":"2023-10-08T07:05:32.323040+0000","last_became_peered":"2023-10-08T07:05:32.323040+0000","last_unstale":"2023-10-08T07:05:34.359736+0000","last_undegraded":"2023-10-08T07:05:34.359736+0000","last_fullsized":"2023-10-08T07:05:34.359736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319639+0000","last_change":"2023-10-08T07:05:32.319220+0000","last_active":"2023-10-08T07:05:34.319639+0000","last_peered":"2023-10-08T07:05:34.319639+0000","last_clean":"2023-10-08T07:05:34.319639+0000","last_became_active":"2023-10-08T07:05:32.318838+0000","last_became_peered":"2023-10-08T07:05:32.318838+0000","last_unstale":"2023-10-08T07:05:34.319639+0000","last_undegraded":"2023-10-08T07:05:34.319639+0000","last_fullsized":"2023-10-08T07:05:34.319639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:32:59.940325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320271+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:05:34.320271+0000","last_peered":"2023-10-08T07:05:34.320271+0000","last_clean":"2023-10-08T07:05:34.320271+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:05:34.320271+0000","last_undegraded":"2023-10-08T07:05:34.320271+0000","last_fullsized":"2023-10-08T07:05:34.320271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320776+0000","last_change":"2023-10-08T07:05:32.319446+0000","last_active":"2023-10-08T07:05:34.320776+0000","last_peered":"2023-10-08T07:05:34.320776+0000","last_clean":"2023-10-08T07:05:34.320776+0000","last_became_active":"2023-10-08T07:05:32.319019+0000","last_became_peered":"2023-10-08T07:05:32.319019+0000","last_unstale":"2023-10-08T07:05:34.320776+0000","last_undegraded":"2023-10-08T07:05:34.320776+0000","last_fullsized":"2023-10-08T07:05:34.320776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:56.843162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359487+0000","last_change":"2023-10-08T07:05:33.330217+0000","last_active":"2023-10-08T07:05:34.359487+0000","last_peered":"2023-10-08T07:05:34.359487+0000","last_clean":"2023-10-08T07:05:34.359487+0000","last_became_active":"2023-10-08T07:05:33.329639+0000","last_became_peered":"2023-10-08T07:05:33.329639+0000","last_unstale":"2023-10-08T07:05:34.359487+0000","last_undegraded":"2023-10-08T07:05:34.359487+0000","last_fullsized":"2023-10-08T07:05:34.359487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:21.715645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360604+0000","last_change":"2023-10-08T07:05:32.323481+0000","last_active":"2023-10-08T07:05:34.360604+0000","last_peered":"2023-10-08T07:05:34.360604+0000","last_clean":"2023-10-08T07:05:34.360604+0000","last_became_active":"2023-10-08T07:05:32.323243+0000","last_became_peered":"2023-10-08T07:05:32.323243+0000","last_unstale":"2023-10-08T07:05:34.360604+0000","last_undegraded":"2023-10-08T07:05:34.360604+0000","last_fullsized":"2023-10-08T07:05:34.360604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359906+0000","last_change":"2023-10-08T07:05:33.318539+0000","last_active":"2023-10-08T07:05:34.359906+0000","last_peered":"2023-10-08T07:05:34.359906+0000","last_clean":"2023-10-08T07:05:34.359906+0000","last_became_active":"2023-10-08T07:05:33.317371+0000","last_became_peered":"2023-10-08T07:05:33.317371+0000","last_unstale":"2023-10-08T07:05:34.359906+0000","last_undegraded":"2023-10-08T07:05:34.359906+0000","last_fullsized":"2023-10-08T07:05:34.359906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:00.945202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320279+0000","last_change":"2023-10-08T07:05:32.321744+0000","last_active":"2023-10-08T07:05:34.320279+0000","last_peered":"2023-10-08T07:05:34.320279+0000","last_clean":"2023-10-08T07:05:34.320279+0000","last_became_active":"2023-10-08T07:05:32.321482+0000","last_became_peered":"2023-10-08T07:05:32.321482+0000","last_unstale":"2023-10-08T07:05:34.320279+0000","last_undegraded":"2023-10-08T07:05:34.320279+0000","last_fullsized":"2023-10-08T07:05:34.320279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:13.789778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320018+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:05:34.320018+0000","last_peered":"2023-10-08T07:05:34.320018+0000","last_clean":"2023-10-08T07:05:34.320018+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:05:34.320018+0000","last_undegraded":"2023-10-08T07:05:34.320018+0000","last_fullsized":"2023-10-08T07:05:34.320018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319626+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:05:34.319626+0000","last_peered":"2023-10-08T07:05:34.319626+0000","last_clean":"2023-10-08T07:05:34.319626+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:05:34.319626+0000","last_undegraded":"2023-10-08T07:05:34.319626+0000","last_fullsized":"2023-10-08T07:05:34.319626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319559+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:05:34.319559+0000","last_peered":"2023-10-08T07:05:34.319559+0000","last_clean":"2023-10-08T07:05:34.319559+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:05:34.319559+0000","last_undegraded":"2023-10-08T07:05:34.319559+0000","last_fullsized":"2023-10-08T07:05:34.319559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319350+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:05:34.319350+0000","last_peered":"2023-10-08T07:05:34.319350+0000","last_clean":"2023-10-08T07:05:34.319350+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:05:34.319350+0000","last_undegraded":"2023-10-08T07:05:34.319350+0000","last_fullsized":"2023-10-08T07:05:34.319350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319602+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:05:34.319602+0000","last_peered":"2023-10-08T07:05:34.319602+0000","last_clean":"2023-10-08T07:05:34.319602+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:05:34.319602+0000","last_undegraded":"2023-10-08T07:05:34.319602+0000","last_fullsized":"2023-10-08T07:05:34.319602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320680+0000","last_change":"2023-10-08T07:05:33.319933+0000","last_active":"2023-10-08T07:05:34.320680+0000","last_peered":"2023-10-08T07:05:34.320680+0000","last_clean":"2023-10-08T07:05:34.320680+0000","last_became_active":"2023-10-08T07:05:33.317937+0000","last_became_peered":"2023-10-08T07:05:33.317937+0000","last_unstale":"2023-10-08T07:05:34.320680+0000","last_undegraded":"2023-10-08T07:05:34.320680+0000","last_fullsized":"2023-10-08T07:05:34.320680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:57:42.074994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359555+0000","last_change":"2023-10-08T07:05:32.323415+0000","last_active":"2023-10-08T07:05:34.359555+0000","last_peered":"2023-10-08T07:05:34.359555+0000","last_clean":"2023-10-08T07:05:34.359555+0000","last_became_active":"2023-10-08T07:05:32.322910+0000","last_became_peered":"2023-10-08T07:05:32.322910+0000","last_unstale":"2023-10-08T07:05:34.359555+0000","last_undegraded":"2023-10-08T07:05:34.359555+0000","last_fullsized":"2023-10-08T07:05:34.359555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320553+0000","last_change":"2023-10-08T07:05:33.325994+0000","last_active":"2023-10-08T07:05:34.320553+0000","last_peered":"2023-10-08T07:05:34.320553+0000","last_clean":"2023-10-08T07:05:34.320553+0000","last_became_active":"2023-10-08T07:05:33.324865+0000","last_became_peered":"2023-10-08T07:05:33.324865+0000","last_unstale":"2023-10-08T07:05:34.320553+0000","last_undegraded":"2023-10-08T07:05:34.320553+0000","last_fullsized":"2023-10-08T07:05:34.320553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:14.142601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359677+0000","last_change":"2023-10-08T07:05:32.320359+0000","last_active":"2023-10-08T07:05:34.359677+0000","last_peered":"2023-10-08T07:05:34.359677+0000","last_clean":"2023-10-08T07:05:34.359677+0000","last_became_active":"2023-10-08T07:05:32.320137+0000","last_became_peered":"2023-10-08T07:05:32.320137+0000","last_unstale":"2023-10-08T07:05:34.359677+0000","last_undegraded":"2023-10-08T07:05:34.359677+0000","last_fullsized":"2023-10-08T07:05:34.359677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:32.366341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320091+0000","last_change":"2023-10-08T07:05:33.322861+0000","last_active":"2023-10-08T07:05:34.320091+0000","last_peered":"2023-10-08T07:05:34.320091+0000","last_clean":"2023-10-08T07:05:34.320091+0000","last_became_active":"2023-10-08T07:05:33.322450+0000","last_became_peered":"2023-10-08T07:05:33.322450+0000","last_unstale":"2023-10-08T07:05:34.320091+0000","last_undegraded":"2023-10-08T07:05:34.320091+0000","last_fullsized":"2023-10-08T07:05:34.320091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309081+0000","last_change":"2023-10-08T07:05:27.295597+0000","last_active":"2023-10-08T07:05:33.309081+0000","last_peered":"2023-10-08T07:05:33.309081+0000","last_clean":"2023-10-08T07:05:33.309081+0000","last_became_active":"2023-10-08T07:05:27.295265+0000","last_became_peered":"2023-10-08T07:05:27.295265+0000","last_unstale":"2023-10-08T07:05:33.309081+0000","last_undegraded":"2023-10-08T07:05:33.309081+0000","last_fullsized":"2023-10-08T07:05:33.309081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:50.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360046+0000","last_change":"2023-10-08T07:05:33.326797+0000","last_active":"2023-10-08T07:05:34.360046+0000","last_peered":"2023-10-08T07:05:34.360046+0000","last_clean":"2023-10-08T07:05:34.360046+0000","last_became_active":"2023-10-08T07:05:33.326518+0000","last_became_peered":"2023-10-08T07:05:33.326518+0000","last_unstale":"2023-10-08T07:05:34.360046+0000","last_undegraded":"2023-10-08T07:05:34.360046+0000","last_fullsized":"2023-10-08T07:05:34.360046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318961+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:05:33.318961+0000","last_peered":"2023-10-08T07:05:33.318961+0000","last_clean":"2023-10-08T07:05:33.318961+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:05:33.318961+0000","last_undegraded":"2023-10-08T07:05:33.318961+0000","last_fullsized":"2023-10-08T07:05:33.318961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320087+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:05:34.320087+0000","last_peered":"2023-10-08T07:05:34.320087+0000","last_clean":"2023-10-08T07:05:34.320087+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:05:34.320087+0000","last_undegraded":"2023-10-08T07:05:34.320087+0000","last_fullsized":"2023-10-08T07:05:34.320087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319579+0000","last_change":"2023-10-08T07:05:33.322164+0000","last_active":"2023-10-08T07:05:34.319579+0000","last_peered":"2023-10-08T07:05:34.319579+0000","last_clean":"2023-10-08T07:05:34.319579+0000","last_became_active":"2023-10-08T07:05:33.321757+0000","last_became_peered":"2023-10-08T07:05:33.321757+0000","last_unstale":"2023-10-08T07:05:34.319579+0000","last_undegraded":"2023-10-08T07:05:34.319579+0000","last_fullsized":"2023-10-08T07:05:34.319579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.308287+0000","last_change":"2023-10-08T07:05:27.295991+0000","last_active":"2023-10-08T07:05:33.308287+0000","last_peered":"2023-10-08T07:05:33.308287+0000","last_clean":"2023-10-08T07:05:33.308287+0000","last_became_active":"2023-10-08T07:05:27.295727+0000","last_became_peered":"2023-10-08T07:05:27.295727+0000","last_unstale":"2023-10-08T07:05:33.308287+0000","last_undegraded":"2023-10-08T07:05:33.308287+0000","last_fullsized":"2023-10-08T07:05:33.308287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:54.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359567+0000","last_change":"2023-10-08T07:05:32.323161+0000","last_active":"2023-10-08T07:05:34.359567+0000","last_peered":"2023-10-08T07:05:34.359567+0000","last_clean":"2023-10-08T07:05:34.359567+0000","last_became_active":"2023-10-08T07:05:32.322832+0000","last_became_peered":"2023-10-08T07:05:32.322832+0000","last_unstale":"2023-10-08T07:05:34.359567+0000","last_undegraded":"2023-10-08T07:05:34.359567+0000","last_fullsized":"2023-10-08T07:05:34.359567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320239+0000","last_change":"2023-10-08T07:05:33.323204+0000","last_active":"2023-10-08T07:05:34.320239+0000","last_peered":"2023-10-08T07:05:34.320239+0000","last_clean":"2023-10-08T07:05:34.320239+0000","last_became_active":"2023-10-08T07:05:33.322899+0000","last_became_peered":"2023-10-08T07:05:33.322899+0000","last_unstale":"2023-10-08T07:05:34.320239+0000","last_undegraded":"2023-10-08T07:05:34.320239+0000","last_fullsized":"2023-10-08T07:05:34.320239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319302+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:05:33.319302+0000","last_peered":"2023-10-08T07:05:33.319302+0000","last_clean":"2023-10-08T07:05:33.319302+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:05:33.319302+0000","last_undegraded":"2023-10-08T07:05:33.319302+0000","last_fullsized":"2023-10-08T07:05:33.319302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318604+0000","last_change":"2023-10-08T07:05:22.277737+0000","last_active":"2023-10-08T07:05:33.318604+0000","last_peered":"2023-10-08T07:05:33.318604+0000","last_clean":"2023-10-08T07:05:33.318604+0000","last_became_active":"2023-10-08T07:05:22.277417+0000","last_became_peered":"2023-10-08T07:05:22.277417+0000","last_unstale":"2023-10-08T07:05:33.318604+0000","last_undegraded":"2023-10-08T07:05:33.318604+0000","last_fullsized":"2023-10-08T07:05:33.318604+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:10.186804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318995+0000","last_change":"2023-10-08T07:05:32.316756+0000","last_active":"2023-10-08T07:05:34.318995+0000","last_peered":"2023-10-08T07:05:34.318995+0000","last_clean":"2023-10-08T07:05:34.318995+0000","last_became_active":"2023-10-08T07:05:32.316340+0000","last_became_peered":"2023-10-08T07:05:32.316340+0000","last_unstale":"2023-10-08T07:05:34.318995+0000","last_undegraded":"2023-10-08T07:05:34.318995+0000","last_fullsized":"2023-10-08T07:05:34.318995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:46:34.838960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320659+0000","last_change":"2023-10-08T07:05:33.318964+0000","last_active":"2023-10-08T07:05:34.320659+0000","last_peered":"2023-10-08T07:05:34.320659+0000","last_clean":"2023-10-08T07:05:34.320659+0000","last_became_active":"2023-10-08T07:05:33.317866+0000","last_became_peered":"2023-10-08T07:05:33.317866+0000","last_unstale":"2023-10-08T07:05:34.320659+0000","last_undegraded":"2023-10-08T07:05:34.320659+0000","last_fullsized":"2023-10-08T07:05:34.320659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:47.306558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319045+0000","last_change":"2023-10-08T07:05:27.295425+0000","last_active":"2023-10-08T07:05:33.319045+0000","last_peered":"2023-10-08T07:05:33.319045+0000","last_clean":"2023-10-08T07:05:33.319045+0000","last_became_active":"2023-10-08T07:05:27.295157+0000","last_became_peered":"2023-10-08T07:05:27.295157+0000","last_unstale":"2023-10-08T07:05:33.319045+0000","last_undegraded":"2023-10-08T07:05:33.319045+0000","last_fullsized":"2023-10-08T07:05:33.319045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:06.192882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318796+0000","last_change":"2023-10-08T07:05:32.317723+0000","last_active":"2023-10-08T07:05:34.318796+0000","last_peered":"2023-10-08T07:05:34.318796+0000","last_clean":"2023-10-08T07:05:34.318796+0000","last_became_active":"2023-10-08T07:05:32.317444+0000","last_became_peered":"2023-10-08T07:05:32.317444+0000","last_unstale":"2023-10-08T07:05:34.318796+0000","last_undegraded":"2023-10-08T07:05:34.318796+0000","last_fullsized":"2023-10-08T07:05:34.318796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:29.242830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360897+0000","last_change":"2023-10-08T07:05:33.321497+0000","last_active":"2023-10-08T07:05:34.360897+0000","last_peered":"2023-10-08T07:05:34.360897+0000","last_clean":"2023-10-08T07:05:34.360897+0000","last_became_active":"2023-10-08T07:05:33.319658+0000","last_became_peered":"2023-10-08T07:05:33.319658+0000","last_unstale":"2023-10-08T07:05:34.360897+0000","last_undegraded":"2023-10-08T07:05:34.360897+0000","last_fullsized":"2023-10-08T07:05:34.360897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.314076+0000","last_change":"2023-10-08T07:05:27.298597+0000","last_active":"2023-10-08T07:05:33.314076+0000","last_peered":"2023-10-08T07:05:33.314076+0000","last_clean":"2023-10-08T07:05:33.314076+0000","last_became_active":"2023-10-08T07:05:27.298355+0000","last_became_peered":"2023-10-08T07:05:27.298355+0000","last_unstale":"2023-10-08T07:05:33.314076+0000","last_undegraded":"2023-10-08T07:05:33.314076+0000","last_fullsized":"2023-10-08T07:05:33.314076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:06.241475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319456+0000","last_change":"2023-10-08T07:05:32.319605+0000","last_active":"2023-10-08T07:05:34.319456+0000","last_peered":"2023-10-08T07:05:34.319456+0000","last_clean":"2023-10-08T07:05:34.319456+0000","last_became_active":"2023-10-08T07:05:32.319244+0000","last_became_peered":"2023-10-08T07:05:32.319244+0000","last_unstale":"2023-10-08T07:05:34.319456+0000","last_undegraded":"2023-10-08T07:05:34.319456+0000","last_fullsized":"2023-10-08T07:05:34.319456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:25.991992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360213+0000","last_change":"2023-10-08T07:05:33.327112+0000","last_active":"2023-10-08T07:05:34.360213+0000","last_peered":"2023-10-08T07:05:34.360213+0000","last_clean":"2023-10-08T07:05:34.360213+0000","last_became_active":"2023-10-08T07:05:33.326816+0000","last_became_peered":"2023-10-08T07:05:33.326816+0000","last_unstale":"2023-10-08T07:05:34.360213+0000","last_undegraded":"2023-10-08T07:05:34.360213+0000","last_fullsized":"2023-10-08T07:05:34.360213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:32.319875+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:32.319385+0000","last_became_peered":"2023-10-08T07:05:32.319385+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309753+0000","last_change":"2023-10-08T07:05:27.295537+0000","last_active":"2023-10-08T07:05:33.309753+0000","last_peered":"2023-10-08T07:05:33.309753+0000","last_clean":"2023-10-08T07:05:33.309753+0000","last_became_active":"2023-10-08T07:05:27.295234+0000","last_became_peered":"2023-10-08T07:05:27.295234+0000","last_unstale":"2023-10-08T07:05:33.309753+0000","last_undegraded":"2023-10-08T07:05:33.309753+0000","last_fullsized":"2023-10-08T07:05:33.309753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:22.951187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318736+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:05:34.318736+0000","last_peered":"2023-10-08T07:05:34.318736+0000","last_clean":"2023-10-08T07:05:34.318736+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:05:34.318736+0000","last_undegraded":"2023-10-08T07:05:34.318736+0000","last_fullsized":"2023-10-08T07:05:34.318736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.325045+0000","last_change":"2023-10-08T07:05:27.295945+0000","last_active":"2023-10-08T07:05:33.325045+0000","last_peered":"2023-10-08T07:05:33.325045+0000","last_clean":"2023-10-08T07:05:33.325045+0000","last_became_active":"2023-10-08T07:05:27.295726+0000","last_became_peered":"2023-10-08T07:05:27.295726+0000","last_unstale":"2023-10-08T07:05:33.325045+0000","last_undegraded":"2023-10-08T07:05:33.325045+0000","last_fullsized":"2023-10-08T07:05:33.325045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:55.040889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.506403+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:05:34.506403+0000","last_peered":"2023-10-08T07:05:34.506403+0000","last_clean":"2023-10-08T07:05:34.506403+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:05:34.506403+0000","last_undegraded":"2023-10-08T07:05:34.506403+0000","last_fullsized":"2023-10-08T07:05:34.506403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359840+0000","last_change":"2023-10-08T07:05:33.326621+0000","last_active":"2023-10-08T07:05:34.359840+0000","last_peered":"2023-10-08T07:05:34.359840+0000","last_clean":"2023-10-08T07:05:34.359840+0000","last_became_active":"2023-10-08T07:05:33.326272+0000","last_became_peered":"2023-10-08T07:05:33.326272+0000","last_unstale":"2023-10-08T07:05:34.359840+0000","last_undegraded":"2023-10-08T07:05:34.359840+0000","last_fullsized":"2023-10-08T07:05:34.359840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:31.752188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359963+0000","last_change":"2023-10-08T07:05:32.323175+0000","last_active":"2023-10-08T07:05:34.359963+0000","last_peered":"2023-10-08T07:05:34.359963+0000","last_clean":"2023-10-08T07:05:34.359963+0000","last_became_active":"2023-10-08T07:05:32.322814+0000","last_became_peered":"2023-10-08T07:05:32.322814+0000","last_unstale":"2023-10-08T07:05:34.359963+0000","last_undegraded":"2023-10-08T07:05:34.359963+0000","last_fullsized":"2023-10-08T07:05:34.359963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360537+0000","last_change":"2023-10-08T07:05:33.318398+0000","last_active":"2023-10-08T07:05:34.360537+0000","last_peered":"2023-10-08T07:05:34.360537+0000","last_clean":"2023-10-08T07:05:34.360537+0000","last_became_active":"2023-10-08T07:05:33.317478+0000","last_became_peered":"2023-10-08T07:05:33.317478+0000","last_unstale":"2023-10-08T07:05:34.360537+0000","last_undegraded":"2023-10-08T07:05:34.360537+0000","last_fullsized":"2023-10-08T07:05:34.360537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320059+0000","last_change":"2023-10-08T07:05:32.320603+0000","last_active":"2023-10-08T07:05:34.320059+0000","last_peered":"2023-10-08T07:05:34.320059+0000","last_clean":"2023-10-08T07:05:34.320059+0000","last_became_active":"2023-10-08T07:05:32.320262+0000","last_became_peered":"2023-10-08T07:05:32.320262+0000","last_unstale":"2023-10-08T07:05:34.320059+0000","last_undegraded":"2023-10-08T07:05:34.320059+0000","last_fullsized":"2023-10-08T07:05:34.320059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:09.249029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319954+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:05:34.319954+0000","last_peered":"2023-10-08T07:05:34.319954+0000","last_clean":"2023-10-08T07:05:34.319954+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:05:34.319954+0000","last_undegraded":"2023-10-08T07:05:34.319954+0000","last_fullsized":"2023-10-08T07:05:34.319954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360795+0000","last_change":"2023-10-08T07:05:32.323143+0000","last_active":"2023-10-08T07:05:34.360795+0000","last_peered":"2023-10-08T07:05:34.360795+0000","last_clean":"2023-10-08T07:05:34.360795+0000","last_became_active":"2023-10-08T07:05:32.322789+0000","last_became_peered":"2023-10-08T07:05:32.322789+0000","last_unstale":"2023-10-08T07:05:34.360795+0000","last_undegraded":"2023-10-08T07:05:34.360795+0000","last_fullsized":"2023-10-08T07:05:34.360795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:03.978136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319826+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:05:34.319826+0000","last_peered":"2023-10-08T07:05:34.319826+0000","last_clean":"2023-10-08T07:05:34.319826+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:05:34.319826+0000","last_undegraded":"2023-10-08T07:05:34.319826+0000","last_fullsized":"2023-10-08T07:05:34.319826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319964+0000","last_change":"2023-10-08T07:05:32.319462+0000","last_active":"2023-10-08T07:05:34.319964+0000","last_peered":"2023-10-08T07:05:34.319964+0000","last_clean":"2023-10-08T07:05:34.319964+0000","last_became_active":"2023-10-08T07:05:32.318951+0000","last_became_peered":"2023-10-08T07:05:32.318951+0000","last_unstale":"2023-10-08T07:05:34.319964+0000","last_undegraded":"2023-10-08T07:05:34.319964+0000","last_fullsized":"2023-10-08T07:05:34.319964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360006+0000","last_change":"2023-10-08T07:05:33.319869+0000","last_active":"2023-10-08T07:05:34.360006+0000","last_peered":"2023-10-08T07:05:34.360006+0000","last_clean":"2023-10-08T07:05:34.360006+0000","last_became_active":"2023-10-08T07:05:33.318241+0000","last_became_peered":"2023-10-08T07:05:33.318241+0000","last_unstale":"2023-10-08T07:05:34.360006+0000","last_undegraded":"2023-10-08T07:05:34.360006+0000","last_fullsized":"2023-10-08T07:05:34.360006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320049+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:05:34.320049+0000","last_peered":"2023-10-08T07:05:34.320049+0000","last_clean":"2023-10-08T07:05:34.320049+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:05:34.320049+0000","last_undegraded":"2023-10-08T07:05:34.320049+0000","last_fullsized":"2023-10-08T07:05:34.320049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320180+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:05:34.320180+0000","last_peered":"2023-10-08T07:05:34.320180+0000","last_clean":"2023-10-08T07:05:34.320180+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:05:34.320180+0000","last_undegraded":"2023-10-08T07:05:34.320180+0000","last_fullsized":"2023-10-08T07:05:34.320180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319653+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:05:34.319653+0000","last_peered":"2023-10-08T07:05:34.319653+0000","last_clean":"2023-10-08T07:05:34.319653+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:05:34.319653+0000","last_undegraded":"2023-10-08T07:05:34.319653+0000","last_fullsized":"2023-10-08T07:05:34.319653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319038+0000","last_change":"2023-10-08T07:05:33.322006+0000","last_active":"2023-10-08T07:05:34.319038+0000","last_peered":"2023-10-08T07:05:34.319038+0000","last_clean":"2023-10-08T07:05:34.319038+0000","last_became_active":"2023-10-08T07:05:33.321639+0000","last_became_peered":"2023-10-08T07:05:33.321639+0000","last_unstale":"2023-10-08T07:05:34.319038+0000","last_undegraded":"2023-10-08T07:05:34.319038+0000","last_fullsized":"2023-10-08T07:05:34.319038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360201+0000","last_change":"2023-10-08T07:05:33.329906+0000","last_active":"2023-10-08T07:05:34.360201+0000","last_peered":"2023-10-08T07:05:34.360201+0000","last_clean":"2023-10-08T07:05:34.360201+0000","last_became_active":"2023-10-08T07:05:33.329615+0000","last_became_peered":"2023-10-08T07:05:33.329615+0000","last_unstale":"2023-10-08T07:05:34.360201+0000","last_undegraded":"2023-10-08T07:05:34.360201+0000","last_fullsized":"2023-10-08T07:05:34.360201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319571+0000","last_change":"2023-10-08T07:05:33.316573+0000","last_active":"2023-10-08T07:05:34.319571+0000","last_peered":"2023-10-08T07:05:34.319571+0000","last_clean":"2023-10-08T07:05:34.319571+0000","last_became_active":"2023-10-08T07:05:33.316193+0000","last_became_peered":"2023-10-08T07:05:33.316193+0000","last_unstale":"2023-10-08T07:05:34.319571+0000","last_undegraded":"2023-10-08T07:05:34.319571+0000","last_fullsized":"2023-10-08T07:05:34.319571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360585+0000","last_change":"2023-10-08T07:05:33.320077+0000","last_active":"2023-10-08T07:05:34.360585+0000","last_peered":"2023-10-08T07:05:34.360585+0000","last_clean":"2023-10-08T07:05:34.360585+0000","last_became_active":"2023-10-08T07:05:33.319392+0000","last_became_peered":"2023-10-08T07:05:33.319392+0000","last_unstale":"2023-10-08T07:05:34.360585+0000","last_undegraded":"2023-10-08T07:05:34.360585+0000","last_fullsized":"2023-10-08T07:05:34.360585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":650475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":649859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:05:42.827 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:05:43.200 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:43.202 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:05:43.212 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-10-08T07:05:42.504509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91108,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024412,"statfs":{"total":289910292480,"available":289816997888,"internally_reserved":0,"allocated":1744896,"data_stored":1358647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":91483475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.197666"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361123+0000","last_change":"2023-10-08T07:05:33.319747+0000","last_active":"2023-10-08T07:05:34.361123+0000","last_peered":"2023-10-08T07:05:34.361123+0000","last_clean":"2023-10-08T07:05:34.361123+0000","last_became_active":"2023-10-08T07:05:33.318115+0000","last_became_peered":"2023-10-08T07:05:33.318115+0000","last_unstale":"2023-10-08T07:05:34.361123+0000","last_undegraded":"2023-10-08T07:05:34.361123+0000","last_fullsized":"2023-10-08T07:05:34.361123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360608+0000","last_change":"2023-10-08T07:05:33.322480+0000","last_active":"2023-10-08T07:05:34.360608+0000","last_peered":"2023-10-08T07:05:34.360608+0000","last_clean":"2023-10-08T07:05:34.360608+0000","last_became_active":"2023-10-08T07:05:33.322153+0000","last_became_peered":"2023-10-08T07:05:33.322153+0000","last_unstale":"2023-10-08T07:05:34.360608+0000","last_undegraded":"2023-10-08T07:05:34.360608+0000","last_fullsized":"2023-10-08T07:05:34.360608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:33.325067+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:33.323439+0000","last_became_peered":"2023-10-08T07:05:33.323439+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:18.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320530+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:05:34.320530+0000","last_peered":"2023-10-08T07:05:34.320530+0000","last_clean":"2023-10-08T07:05:34.320530+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:05:34.320530+0000","last_undegraded":"2023-10-08T07:05:34.320530+0000","last_fullsized":"2023-10-08T07:05:34.320530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360128+0000","last_change":"2023-10-08T07:05:33.321314+0000","last_active":"2023-10-08T07:05:34.360128+0000","last_peered":"2023-10-08T07:05:34.360128+0000","last_clean":"2023-10-08T07:05:34.360128+0000","last_became_active":"2023-10-08T07:05:33.320841+0000","last_became_peered":"2023-10-08T07:05:33.320841+0000","last_unstale":"2023-10-08T07:05:34.360128+0000","last_undegraded":"2023-10-08T07:05:34.360128+0000","last_fullsized":"2023-10-08T07:05:34.360128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319725+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:05:34.319725+0000","last_peered":"2023-10-08T07:05:34.319725+0000","last_clean":"2023-10-08T07:05:34.319725+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:05:34.319725+0000","last_undegraded":"2023-10-08T07:05:34.319725+0000","last_fullsized":"2023-10-08T07:05:34.319725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319443+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:05:34.319443+0000","last_peered":"2023-10-08T07:05:34.319443+0000","last_clean":"2023-10-08T07:05:34.319443+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:05:34.319443+0000","last_undegraded":"2023-10-08T07:05:34.319443+0000","last_fullsized":"2023-10-08T07:05:34.319443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319238+0000","last_change":"2023-10-08T07:05:33.327740+0000","last_active":"2023-10-08T07:05:34.319238+0000","last_peered":"2023-10-08T07:05:34.319238+0000","last_clean":"2023-10-08T07:05:34.319238+0000","last_became_active":"2023-10-08T07:05:33.325912+0000","last_became_peered":"2023-10-08T07:05:33.325912+0000","last_unstale":"2023-10-08T07:05:34.319238+0000","last_undegraded":"2023-10-08T07:05:34.319238+0000","last_fullsized":"2023-10-08T07:05:34.319238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319837+0000","last_change":"2023-10-08T07:05:33.322628+0000","last_active":"2023-10-08T07:05:34.319837+0000","last_peered":"2023-10-08T07:05:34.319837+0000","last_clean":"2023-10-08T07:05:34.319837+0000","last_became_active":"2023-10-08T07:05:33.321816+0000","last_became_peered":"2023-10-08T07:05:33.321816+0000","last_unstale":"2023-10-08T07:05:34.319837+0000","last_undegraded":"2023-10-08T07:05:34.319837+0000","last_fullsized":"2023-10-08T07:05:34.319837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360894+0000","last_change":"2023-10-08T07:05:33.322098+0000","last_active":"2023-10-08T07:05:34.360894+0000","last_peered":"2023-10-08T07:05:34.360894+0000","last_clean":"2023-10-08T07:05:34.360894+0000","last_became_active":"2023-10-08T07:05:33.321208+0000","last_became_peered":"2023-10-08T07:05:33.321208+0000","last_unstale":"2023-10-08T07:05:34.360894+0000","last_undegraded":"2023-10-08T07:05:34.360894+0000","last_fullsized":"2023-10-08T07:05:34.360894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320139+0000","last_change":"2023-10-08T07:05:33.328140+0000","last_active":"2023-10-08T07:05:34.320139+0000","last_peered":"2023-10-08T07:05:34.320139+0000","last_clean":"2023-10-08T07:05:34.320139+0000","last_became_active":"2023-10-08T07:05:33.327595+0000","last_became_peered":"2023-10-08T07:05:33.327595+0000","last_unstale":"2023-10-08T07:05:34.320139+0000","last_undegraded":"2023-10-08T07:05:34.320139+0000","last_fullsized":"2023-10-08T07:05:34.320139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360113+0000","last_change":"2023-10-08T07:05:33.329834+0000","last_active":"2023-10-08T07:05:34.360113+0000","last_peered":"2023-10-08T07:05:34.360113+0000","last_clean":"2023-10-08T07:05:34.360113+0000","last_became_active":"2023-10-08T07:05:33.329357+0000","last_became_peered":"2023-10-08T07:05:33.329357+0000","last_unstale":"2023-10-08T07:05:34.360113+0000","last_undegraded":"2023-10-08T07:05:34.360113+0000","last_fullsized":"2023-10-08T07:05:34.360113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360010+0000","last_change":"2023-10-08T07:05:33.319643+0000","last_active":"2023-10-08T07:05:34.360010+0000","last_peered":"2023-10-08T07:05:34.360010+0000","last_clean":"2023-10-08T07:05:34.360010+0000","last_became_active":"2023-10-08T07:05:33.318659+0000","last_became_peered":"2023-10-08T07:05:33.318659+0000","last_unstale":"2023-10-08T07:05:34.360010+0000","last_undegraded":"2023-10-08T07:05:34.360010+0000","last_fullsized":"2023-10-08T07:05:34.360010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320295+0000","last_change":"2023-10-08T07:05:33.318491+0000","last_active":"2023-10-08T07:05:34.320295+0000","last_peered":"2023-10-08T07:05:34.320295+0000","last_clean":"2023-10-08T07:05:34.320295+0000","last_became_active":"2023-10-08T07:05:33.317703+0000","last_became_peered":"2023-10-08T07:05:33.317703+0000","last_unstale":"2023-10-08T07:05:34.320295+0000","last_undegraded":"2023-10-08T07:05:34.320295+0000","last_fullsized":"2023-10-08T07:05:34.320295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.319294+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.318364+0000","last_became_peered":"2023-10-08T07:05:33.318364+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319517+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:05:34.319517+0000","last_peered":"2023-10-08T07:05:34.319517+0000","last_clean":"2023-10-08T07:05:34.319517+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:05:34.319517+0000","last_undegraded":"2023-10-08T07:05:34.319517+0000","last_fullsized":"2023-10-08T07:05:34.319517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319930+0000","last_change":"2023-10-08T07:05:33.317287+0000","last_active":"2023-10-08T07:05:34.319930+0000","last_peered":"2023-10-08T07:05:34.319930+0000","last_clean":"2023-10-08T07:05:34.319930+0000","last_became_active":"2023-10-08T07:05:33.316483+0000","last_became_peered":"2023-10-08T07:05:33.316483+0000","last_unstale":"2023-10-08T07:05:34.319930+0000","last_undegraded":"2023-10-08T07:05:34.319930+0000","last_fullsized":"2023-10-08T07:05:34.319930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361063+0000","last_change":"2023-10-08T07:05:33.321088+0000","last_active":"2023-10-08T07:05:34.361063+0000","last_peered":"2023-10-08T07:05:34.361063+0000","last_clean":"2023-10-08T07:05:34.361063+0000","last_became_active":"2023-10-08T07:05:33.319541+0000","last_became_peered":"2023-10-08T07:05:33.319541+0000","last_unstale":"2023-10-08T07:05:34.361063+0000","last_undegraded":"2023-10-08T07:05:34.361063+0000","last_fullsized":"2023-10-08T07:05:34.361063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319536+0000","last_change":"2023-10-08T07:05:33.322110+0000","last_active":"2023-10-08T07:05:34.319536+0000","last_peered":"2023-10-08T07:05:34.319536+0000","last_clean":"2023-10-08T07:05:34.319536+0000","last_became_active":"2023-10-08T07:05:33.321780+0000","last_became_peered":"2023-10-08T07:05:33.321780+0000","last_unstale":"2023-10-08T07:05:34.319536+0000","last_undegraded":"2023-10-08T07:05:34.319536+0000","last_fullsized":"2023-10-08T07:05:34.319536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320412+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:05:34.320412+0000","last_peered":"2023-10-08T07:05:34.320412+0000","last_clean":"2023-10-08T07:05:34.320412+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:05:34.320412+0000","last_undegraded":"2023-10-08T07:05:34.320412+0000","last_fullsized":"2023-10-08T07:05:34.320412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319754+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:05:34.319754+0000","last_peered":"2023-10-08T07:05:34.319754+0000","last_clean":"2023-10-08T07:05:34.319754+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:05:34.319754+0000","last_undegraded":"2023-10-08T07:05:34.319754+0000","last_fullsized":"2023-10-08T07:05:34.319754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360008+0000","last_change":"2023-10-08T07:05:33.326970+0000","last_active":"2023-10-08T07:05:34.360008+0000","last_peered":"2023-10-08T07:05:34.360008+0000","last_clean":"2023-10-08T07:05:34.360008+0000","last_became_active":"2023-10-08T07:05:33.326650+0000","last_became_peered":"2023-10-08T07:05:33.326650+0000","last_unstale":"2023-10-08T07:05:34.360008+0000","last_undegraded":"2023-10-08T07:05:34.360008+0000","last_fullsized":"2023-10-08T07:05:34.360008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319095+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:05:34.319095+0000","last_peered":"2023-10-08T07:05:34.319095+0000","last_clean":"2023-10-08T07:05:34.319095+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:05:34.319095+0000","last_undegraded":"2023-10-08T07:05:34.319095+0000","last_fullsized":"2023-10-08T07:05:34.319095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360261+0000","last_change":"2023-10-08T07:05:33.319759+0000","last_active":"2023-10-08T07:05:34.360261+0000","last_peered":"2023-10-08T07:05:34.360261+0000","last_clean":"2023-10-08T07:05:34.360261+0000","last_became_active":"2023-10-08T07:05:33.318507+0000","last_became_peered":"2023-10-08T07:05:33.318507+0000","last_unstale":"2023-10-08T07:05:34.360261+0000","last_undegraded":"2023-10-08T07:05:34.360261+0000","last_fullsized":"2023-10-08T07:05:34.360261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361101+0000","last_change":"2023-10-08T07:05:33.317560+0000","last_active":"2023-10-08T07:05:34.361101+0000","last_peered":"2023-10-08T07:05:34.361101+0000","last_clean":"2023-10-08T07:05:34.361101+0000","last_became_active":"2023-10-08T07:05:33.316906+0000","last_became_peered":"2023-10-08T07:05:33.316906+0000","last_unstale":"2023-10-08T07:05:34.361101+0000","last_undegraded":"2023-10-08T07:05:34.361101+0000","last_fullsized":"2023-10-08T07:05:34.361101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320043+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:05:34.320043+0000","last_peered":"2023-10-08T07:05:34.320043+0000","last_clean":"2023-10-08T07:05:34.320043+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:05:34.320043+0000","last_undegraded":"2023-10-08T07:05:34.320043+0000","last_fullsized":"2023-10-08T07:05:34.320043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320344+0000","last_change":"2023-10-08T07:05:33.326267+0000","last_active":"2023-10-08T07:05:34.320344+0000","last_peered":"2023-10-08T07:05:34.320344+0000","last_clean":"2023-10-08T07:05:34.320344+0000","last_became_active":"2023-10-08T07:05:33.324579+0000","last_became_peered":"2023-10-08T07:05:33.324579+0000","last_unstale":"2023-10-08T07:05:34.320344+0000","last_undegraded":"2023-10-08T07:05:34.320344+0000","last_fullsized":"2023-10-08T07:05:34.320344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359920+0000","last_change":"2023-10-08T07:05:32.320295+0000","last_active":"2023-10-08T07:05:34.359920+0000","last_peered":"2023-10-08T07:05:34.359920+0000","last_clean":"2023-10-08T07:05:34.359920+0000","last_became_active":"2023-10-08T07:05:32.320044+0000","last_became_peered":"2023-10-08T07:05:32.320044+0000","last_unstale":"2023-10-08T07:05:34.359920+0000","last_undegraded":"2023-10-08T07:05:34.359920+0000","last_fullsized":"2023-10-08T07:05:34.359920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:44.690611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360949+0000","last_change":"2023-10-08T07:05:33.329921+0000","last_active":"2023-10-08T07:05:34.360949+0000","last_peered":"2023-10-08T07:05:34.360949+0000","last_clean":"2023-10-08T07:05:34.360949+0000","last_became_active":"2023-10-08T07:05:33.329346+0000","last_became_peered":"2023-10-08T07:05:33.329346+0000","last_unstale":"2023-10-08T07:05:34.360949+0000","last_undegraded":"2023-10-08T07:05:34.360949+0000","last_fullsized":"2023-10-08T07:05:34.360949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319260+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:05:34.319260+0000","last_peered":"2023-10-08T07:05:34.319260+0000","last_clean":"2023-10-08T07:05:34.319260+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:05:34.319260+0000","last_undegraded":"2023-10-08T07:05:34.319260+0000","last_fullsized":"2023-10-08T07:05:34.319260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319829+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:05:34.319829+0000","last_peered":"2023-10-08T07:05:34.319829+0000","last_clean":"2023-10-08T07:05:34.319829+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:05:34.319829+0000","last_undegraded":"2023-10-08T07:05:34.319829+0000","last_fullsized":"2023-10-08T07:05:34.319829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319123+0000","last_change":"2023-10-08T07:05:32.315935+0000","last_active":"2023-10-08T07:05:34.319123+0000","last_peered":"2023-10-08T07:05:34.319123+0000","last_clean":"2023-10-08T07:05:34.319123+0000","last_became_active":"2023-10-08T07:05:32.315661+0000","last_became_peered":"2023-10-08T07:05:32.315661+0000","last_unstale":"2023-10-08T07:05:34.319123+0000","last_undegraded":"2023-10-08T07:05:34.319123+0000","last_fullsized":"2023-10-08T07:05:34.319123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:01:05.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361026+0000","last_change":"2023-10-08T07:05:33.330068+0000","last_active":"2023-10-08T07:05:34.361026+0000","last_peered":"2023-10-08T07:05:34.361026+0000","last_clean":"2023-10-08T07:05:34.361026+0000","last_became_active":"2023-10-08T07:05:33.329169+0000","last_became_peered":"2023-10-08T07:05:33.329169+0000","last_unstale":"2023-10-08T07:05:34.361026+0000","last_undegraded":"2023-10-08T07:05:34.361026+0000","last_fullsized":"2023-10-08T07:05:34.361026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:05:34.320135+0000","last_peered":"2023-10-08T07:05:34.320135+0000","last_clean":"2023-10-08T07:05:34.320135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:05:34.320135+0000","last_undegraded":"2023-10-08T07:05:34.320135+0000","last_fullsized":"2023-10-08T07:05:34.320135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318813+0000","last_change":"2023-10-08T07:05:33.316496+0000","last_active":"2023-10-08T07:05:34.318813+0000","last_peered":"2023-10-08T07:05:34.318813+0000","last_clean":"2023-10-08T07:05:34.318813+0000","last_became_active":"2023-10-08T07:05:33.316084+0000","last_became_peered":"2023-10-08T07:05:33.316084+0000","last_unstale":"2023-10-08T07:05:34.318813+0000","last_undegraded":"2023-10-08T07:05:34.318813+0000","last_fullsized":"2023-10-08T07:05:34.318813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320455+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:05:34.320455+0000","last_peered":"2023-10-08T07:05:34.320455+0000","last_clean":"2023-10-08T07:05:34.320455+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:05:34.320455+0000","last_undegraded":"2023-10-08T07:05:34.320455+0000","last_fullsized":"2023-10-08T07:05:34.320455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319317+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:05:34.319317+0000","last_peered":"2023-10-08T07:05:34.319317+0000","last_clean":"2023-10-08T07:05:34.319317+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:05:34.319317+0000","last_undegraded":"2023-10-08T07:05:34.319317+0000","last_fullsized":"2023-10-08T07:05:34.319317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360636+0000","last_change":"2023-10-08T07:05:32.323201+0000","last_active":"2023-10-08T07:05:34.360636+0000","last_peered":"2023-10-08T07:05:34.360636+0000","last_clean":"2023-10-08T07:05:34.360636+0000","last_became_active":"2023-10-08T07:05:32.322864+0000","last_became_peered":"2023-10-08T07:05:32.322864+0000","last_unstale":"2023-10-08T07:05:34.360636+0000","last_undegraded":"2023-10-08T07:05:34.360636+0000","last_fullsized":"2023-10-08T07:05:34.360636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:40.093124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319535+0000","last_change":"2023-10-08T07:05:33.317114+0000","last_active":"2023-10-08T07:05:34.319535+0000","last_peered":"2023-10-08T07:05:34.319535+0000","last_clean":"2023-10-08T07:05:34.319535+0000","last_became_active":"2023-10-08T07:05:33.316390+0000","last_became_peered":"2023-10-08T07:05:33.316390+0000","last_unstale":"2023-10-08T07:05:34.319535+0000","last_undegraded":"2023-10-08T07:05:34.319535+0000","last_fullsized":"2023-10-08T07:05:34.319535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320136+0000","last_change":"2023-10-08T07:05:32.319510+0000","last_active":"2023-10-08T07:05:34.320136+0000","last_peered":"2023-10-08T07:05:34.320136+0000","last_clean":"2023-10-08T07:05:34.320136+0000","last_became_active":"2023-10-08T07:05:32.319209+0000","last_became_peered":"2023-10-08T07:05:32.319209+0000","last_unstale":"2023-10-08T07:05:34.320136+0000","last_undegraded":"2023-10-08T07:05:34.320136+0000","last_fullsized":"2023-10-08T07:05:34.320136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:28.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320332+0000","last_change":"2023-10-08T07:05:33.317137+0000","last_active":"2023-10-08T07:05:34.320332+0000","last_peered":"2023-10-08T07:05:34.320332+0000","last_clean":"2023-10-08T07:05:34.320332+0000","last_became_active":"2023-10-08T07:05:33.316562+0000","last_became_peered":"2023-10-08T07:05:33.316562+0000","last_unstale":"2023-10-08T07:05:34.320332+0000","last_undegraded":"2023-10-08T07:05:34.320332+0000","last_fullsized":"2023-10-08T07:05:34.320332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:41.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320369+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:05:34.320369+0000","last_peered":"2023-10-08T07:05:34.320369+0000","last_clean":"2023-10-08T07:05:34.320369+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:05:34.320369+0000","last_undegraded":"2023-10-08T07:05:34.320369+0000","last_fullsized":"2023-10-08T07:05:34.320369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360395+0000","last_change":"2023-10-08T07:05:33.322201+0000","last_active":"2023-10-08T07:05:34.360395+0000","last_peered":"2023-10-08T07:05:34.360395+0000","last_clean":"2023-10-08T07:05:34.360395+0000","last_became_active":"2023-10-08T07:05:33.321826+0000","last_became_peered":"2023-10-08T07:05:33.321826+0000","last_unstale":"2023-10-08T07:05:34.360395+0000","last_undegraded":"2023-10-08T07:05:34.360395+0000","last_fullsized":"2023-10-08T07:05:34.360395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319178+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:05:34.319178+0000","last_peered":"2023-10-08T07:05:34.319178+0000","last_clean":"2023-10-08T07:05:34.319178+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:05:34.319178+0000","last_undegraded":"2023-10-08T07:05:34.319178+0000","last_fullsized":"2023-10-08T07:05:34.319178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360947+0000","last_change":"2023-10-08T07:05:33.317545+0000","last_active":"2023-10-08T07:05:34.360947+0000","last_peered":"2023-10-08T07:05:34.360947+0000","last_clean":"2023-10-08T07:05:34.360947+0000","last_became_active":"2023-10-08T07:05:33.317134+0000","last_became_peered":"2023-10-08T07:05:33.317134+0000","last_unstale":"2023-10-08T07:05:34.360947+0000","last_undegraded":"2023-10-08T07:05:34.360947+0000","last_fullsized":"2023-10-08T07:05:34.360947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359736+0000","last_change":"2023-10-08T07:05:32.323406+0000","last_active":"2023-10-08T07:05:34.359736+0000","last_peered":"2023-10-08T07:05:34.359736+0000","last_clean":"2023-10-08T07:05:34.359736+0000","last_became_active":"2023-10-08T07:05:32.323040+0000","last_became_peered":"2023-10-08T07:05:32.323040+0000","last_unstale":"2023-10-08T07:05:34.359736+0000","last_undegraded":"2023-10-08T07:05:34.359736+0000","last_fullsized":"2023-10-08T07:05:34.359736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319639+0000","last_change":"2023-10-08T07:05:32.319220+0000","last_active":"2023-10-08T07:05:34.319639+0000","last_peered":"2023-10-08T07:05:34.319639+0000","last_clean":"2023-10-08T07:05:34.319639+0000","last_became_active":"2023-10-08T07:05:32.318838+0000","last_became_peered":"2023-10-08T07:05:32.318838+0000","last_unstale":"2023-10-08T07:05:34.319639+0000","last_undegraded":"2023-10-08T07:05:34.319639+0000","last_fullsized":"2023-10-08T07:05:34.319639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:32:59.940325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320271+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:05:34.320271+0000","last_peered":"2023-10-08T07:05:34.320271+0000","last_clean":"2023-10-08T07:05:34.320271+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:05:34.320271+0000","last_undegraded":"2023-10-08T07:05:34.320271+0000","last_fullsized":"2023-10-08T07:05:34.320271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320776+0000","last_change":"2023-10-08T07:05:32.319446+0000","last_active":"2023-10-08T07:05:34.320776+0000","last_peered":"2023-10-08T07:05:34.320776+0000","last_clean":"2023-10-08T07:05:34.320776+0000","last_became_active":"2023-10-08T07:05:32.319019+0000","last_became_peered":"2023-10-08T07:05:32.319019+0000","last_unstale":"2023-10-08T07:05:34.320776+0000","last_undegraded":"2023-10-08T07:05:34.320776+0000","last_fullsized":"2023-10-08T07:05:34.320776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:56.843162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359487+0000","last_change":"2023-10-08T07:05:33.330217+0000","last_active":"2023-10-08T07:05:34.359487+0000","last_peered":"2023-10-08T07:05:34.359487+0000","last_clean":"2023-10-08T07:05:34.359487+0000","last_became_active":"2023-10-08T07:05:33.329639+0000","last_became_peered":"2023-10-08T07:05:33.329639+0000","last_unstale":"2023-10-08T07:05:34.359487+0000","last_undegraded":"2023-10-08T07:05:34.359487+0000","last_fullsized":"2023-10-08T07:05:34.359487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:21.715645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360604+0000","last_change":"2023-10-08T07:05:32.323481+0000","last_active":"2023-10-08T07:05:34.360604+0000","last_peered":"2023-10-08T07:05:34.360604+0000","last_clean":"2023-10-08T07:05:34.360604+0000","last_became_active":"2023-10-08T07:05:32.323243+0000","last_became_peered":"2023-10-08T07:05:32.323243+0000","last_unstale":"2023-10-08T07:05:34.360604+0000","last_undegraded":"2023-10-08T07:05:34.360604+0000","last_fullsized":"2023-10-08T07:05:34.360604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359906+0000","last_change":"2023-10-08T07:05:33.318539+0000","last_active":"2023-10-08T07:05:34.359906+0000","last_peered":"2023-10-08T07:05:34.359906+0000","last_clean":"2023-10-08T07:05:34.359906+0000","last_became_active":"2023-10-08T07:05:33.317371+0000","last_became_peered":"2023-10-08T07:05:33.317371+0000","last_unstale":"2023-10-08T07:05:34.359906+0000","last_undegraded":"2023-10-08T07:05:34.359906+0000","last_fullsized":"2023-10-08T07:05:34.359906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:00.945202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320279+0000","last_change":"2023-10-08T07:05:32.321744+0000","last_active":"2023-10-08T07:05:34.320279+0000","last_peered":"2023-10-08T07:05:34.320279+0000","last_clean":"2023-10-08T07:05:34.320279+0000","last_became_active":"2023-10-08T07:05:32.321482+0000","last_became_peered":"2023-10-08T07:05:32.321482+0000","last_unstale":"2023-10-08T07:05:34.320279+0000","last_undegraded":"2023-10-08T07:05:34.320279+0000","last_fullsized":"2023-10-08T07:05:34.320279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:13.789778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320018+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:05:34.320018+0000","last_peered":"2023-10-08T07:05:34.320018+0000","last_clean":"2023-10-08T07:05:34.320018+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:05:34.320018+0000","last_undegraded":"2023-10-08T07:05:34.320018+0000","last_fullsized":"2023-10-08T07:05:34.320018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319626+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:05:34.319626+0000","last_peered":"2023-10-08T07:05:34.319626+0000","last_clean":"2023-10-08T07:05:34.319626+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:05:34.319626+0000","last_undegraded":"2023-10-08T07:05:34.319626+0000","last_fullsized":"2023-10-08T07:05:34.319626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319559+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:05:34.319559+0000","last_peered":"2023-10-08T07:05:34.319559+0000","last_clean":"2023-10-08T07:05:34.319559+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:05:34.319559+0000","last_undegraded":"2023-10-08T07:05:34.319559+0000","last_fullsized":"2023-10-08T07:05:34.319559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319350+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:05:34.319350+0000","last_peered":"2023-10-08T07:05:34.319350+0000","last_clean":"2023-10-08T07:05:34.319350+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:05:34.319350+0000","last_undegraded":"2023-10-08T07:05:34.319350+0000","last_fullsized":"2023-10-08T07:05:34.319350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319602+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:05:34.319602+0000","last_peered":"2023-10-08T07:05:34.319602+0000","last_clean":"2023-10-08T07:05:34.319602+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:05:34.319602+0000","last_undegraded":"2023-10-08T07:05:34.319602+0000","last_fullsized":"2023-10-08T07:05:34.319602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320680+0000","last_change":"2023-10-08T07:05:33.319933+0000","last_active":"2023-10-08T07:05:34.320680+0000","last_peered":"2023-10-08T07:05:34.320680+0000","last_clean":"2023-10-08T07:05:34.320680+0000","last_became_active":"2023-10-08T07:05:33.317937+0000","last_became_peered":"2023-10-08T07:05:33.317937+0000","last_unstale":"2023-10-08T07:05:34.320680+0000","last_undegraded":"2023-10-08T07:05:34.320680+0000","last_fullsized":"2023-10-08T07:05:34.320680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:57:42.074994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359555+0000","last_change":"2023-10-08T07:05:32.323415+0000","last_active":"2023-10-08T07:05:34.359555+0000","last_peered":"2023-10-08T07:05:34.359555+0000","last_clean":"2023-10-08T07:05:34.359555+0000","last_became_active":"2023-10-08T07:05:32.322910+0000","last_became_peered":"2023-10-08T07:05:32.322910+0000","last_unstale":"2023-10-08T07:05:34.359555+0000","last_undegraded":"2023-10-08T07:05:34.359555+0000","last_fullsized":"2023-10-08T07:05:34.359555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320553+0000","last_change":"2023-10-08T07:05:33.325994+0000","last_active":"2023-10-08T07:05:34.320553+0000","last_peered":"2023-10-08T07:05:34.320553+0000","last_clean":"2023-10-08T07:05:34.320553+0000","last_became_active":"2023-10-08T07:05:33.324865+0000","last_became_peered":"2023-10-08T07:05:33.324865+0000","last_unstale":"2023-10-08T07:05:34.320553+0000","last_undegraded":"2023-10-08T07:05:34.320553+0000","last_fullsized":"2023-10-08T07:05:34.320553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:14.142601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359677+0000","last_change":"2023-10-08T07:05:32.320359+0000","last_active":"2023-10-08T07:05:34.359677+0000","last_peered":"2023-10-08T07:05:34.359677+0000","last_clean":"2023-10-08T07:05:34.359677+0000","last_became_active":"2023-10-08T07:05:32.320137+0000","last_became_peered":"2023-10-08T07:05:32.320137+0000","last_unstale":"2023-10-08T07:05:34.359677+0000","last_undegraded":"2023-10-08T07:05:34.359677+0000","last_fullsized":"2023-10-08T07:05:34.359677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:32.366341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320091+0000","last_change":"2023-10-08T07:05:33.322861+0000","last_active":"2023-10-08T07:05:34.320091+0000","last_peered":"2023-10-08T07:05:34.320091+0000","last_clean":"2023-10-08T07:05:34.320091+0000","last_became_active":"2023-10-08T07:05:33.322450+0000","last_became_peered":"2023-10-08T07:05:33.322450+0000","last_unstale":"2023-10-08T07:05:34.320091+0000","last_undegraded":"2023-10-08T07:05:34.320091+0000","last_fullsized":"2023-10-08T07:05:34.320091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309081+0000","last_change":"2023-10-08T07:05:27.295597+0000","last_active":"2023-10-08T07:05:33.309081+0000","last_peered":"2023-10-08T07:05:33.309081+0000","last_clean":"2023-10-08T07:05:33.309081+0000","last_became_active":"2023-10-08T07:05:27.295265+0000","last_became_peered":"2023-10-08T07:05:27.295265+0000","last_unstale":"2023-10-08T07:05:33.309081+0000","last_undegraded":"2023-10-08T07:05:33.309081+0000","last_fullsized":"2023-10-08T07:05:33.309081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:50.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360046+0000","last_change":"2023-10-08T07:05:33.326797+0000","last_active":"2023-10-08T07:05:34.360046+0000","last_peered":"2023-10-08T07:05:34.360046+0000","last_clean":"2023-10-08T07:05:34.360046+0000","last_became_active":"2023-10-08T07:05:33.326518+0000","last_became_peered":"2023-10-08T07:05:33.326518+0000","last_unstale":"2023-10-08T07:05:34.360046+0000","last_undegraded":"2023-10-08T07:05:34.360046+0000","last_fullsized":"2023-10-08T07:05:34.360046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318961+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:05:33.318961+0000","last_peered":"2023-10-08T07:05:33.318961+0000","last_clean":"2023-10-08T07:05:33.318961+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:05:33.318961+0000","last_undegraded":"2023-10-08T07:05:33.318961+0000","last_fullsized":"2023-10-08T07:05:33.318961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320087+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:05:34.320087+0000","last_peered":"2023-10-08T07:05:34.320087+0000","last_clean":"2023-10-08T07:05:34.320087+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:05:34.320087+0000","last_undegraded":"2023-10-08T07:05:34.320087+0000","last_fullsized":"2023-10-08T07:05:34.320087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319579+0000","last_change":"2023-10-08T07:05:33.322164+0000","last_active":"2023-10-08T07:05:34.319579+0000","last_peered":"2023-10-08T07:05:34.319579+0000","last_clean":"2023-10-08T07:05:34.319579+0000","last_became_active":"2023-10-08T07:05:33.321757+0000","last_became_peered":"2023-10-08T07:05:33.321757+0000","last_unstale":"2023-10-08T07:05:34.319579+0000","last_undegraded":"2023-10-08T07:05:34.319579+0000","last_fullsized":"2023-10-08T07:05:34.319579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.308287+0000","last_change":"2023-10-08T07:05:27.295991+0000","last_active":"2023-10-08T07:05:33.308287+0000","last_peered":"2023-10-08T07:05:33.308287+0000","last_clean":"2023-10-08T07:05:33.308287+0000","last_became_active":"2023-10-08T07:05:27.295727+0000","last_became_peered":"2023-10-08T07:05:27.295727+0000","last_unstale":"2023-10-08T07:05:33.308287+0000","last_undegraded":"2023-10-08T07:05:33.308287+0000","last_fullsized":"2023-10-08T07:05:33.308287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:54.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359567+0000","last_change":"2023-10-08T07:05:32.323161+0000","last_active":"2023-10-08T07:05:34.359567+0000","last_peered":"2023-10-08T07:05:34.359567+0000","last_clean":"2023-10-08T07:05:34.359567+0000","last_became_active":"2023-10-08T07:05:32.322832+0000","last_became_peered":"2023-10-08T07:05:32.322832+0000","last_unstale":"2023-10-08T07:05:34.359567+0000","last_undegraded":"2023-10-08T07:05:34.359567+0000","last_fullsized":"2023-10-08T07:05:34.359567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320239+0000","last_change":"2023-10-08T07:05:33.323204+0000","last_active":"2023-10-08T07:05:34.320239+0000","last_peered":"2023-10-08T07:05:34.320239+0000","last_clean":"2023-10-08T07:05:34.320239+0000","last_became_active":"2023-10-08T07:05:33.322899+0000","last_became_peered":"2023-10-08T07:05:33.322899+0000","last_unstale":"2023-10-08T07:05:34.320239+0000","last_undegraded":"2023-10-08T07:05:34.320239+0000","last_fullsized":"2023-10-08T07:05:34.320239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319302+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:05:33.319302+0000","last_peered":"2023-10-08T07:05:33.319302+0000","last_clean":"2023-10-08T07:05:33.319302+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:05:33.319302+0000","last_undegraded":"2023-10-08T07:05:33.319302+0000","last_fullsized":"2023-10-08T07:05:33.319302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318604+0000","last_change":"2023-10-08T07:05:22.277737+0000","last_active":"2023-10-08T07:05:33.318604+0000","last_peered":"2023-10-08T07:05:33.318604+0000","last_clean":"2023-10-08T07:05:33.318604+0000","last_became_active":"2023-10-08T07:05:22.277417+0000","last_became_peered":"2023-10-08T07:05:22.277417+0000","last_unstale":"2023-10-08T07:05:33.318604+0000","last_undegraded":"2023-10-08T07:05:33.318604+0000","last_fullsized":"2023-10-08T07:05:33.318604+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:10.186804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318995+0000","last_change":"2023-10-08T07:05:32.316756+0000","last_active":"2023-10-08T07:05:34.318995+0000","last_peered":"2023-10-08T07:05:34.318995+0000","last_clean":"2023-10-08T07:05:34.318995+0000","last_became_active":"2023-10-08T07:05:32.316340+0000","last_became_peered":"2023-10-08T07:05:32.316340+0000","last_unstale":"2023-10-08T07:05:34.318995+0000","last_undegraded":"2023-10-08T07:05:34.318995+0000","last_fullsized":"2023-10-08T07:05:34.318995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:46:34.838960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320659+0000","last_change":"2023-10-08T07:05:33.318964+0000","last_active":"2023-10-08T07:05:34.320659+0000","last_peered":"2023-10-08T07:05:34.320659+0000","last_clean":"2023-10-08T07:05:34.320659+0000","last_became_active":"2023-10-08T07:05:33.317866+0000","last_became_peered":"2023-10-08T07:05:33.317866+0000","last_unstale":"2023-10-08T07:05:34.320659+0000","last_undegraded":"2023-10-08T07:05:34.320659+0000","last_fullsized":"2023-10-08T07:05:34.320659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:47.306558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319045+0000","last_change":"2023-10-08T07:05:27.295425+0000","last_active":"2023-10-08T07:05:33.319045+0000","last_peered":"2023-10-08T07:05:33.319045+0000","last_clean":"2023-10-08T07:05:33.319045+0000","last_became_active":"2023-10-08T07:05:27.295157+0000","last_became_peered":"2023-10-08T07:05:27.295157+0000","last_unstale":"2023-10-08T07:05:33.319045+0000","last_undegraded":"2023-10-08T07:05:33.319045+0000","last_fullsized":"2023-10-08T07:05:33.319045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:06.192882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318796+0000","last_change":"2023-10-08T07:05:32.317723+0000","last_active":"2023-10-08T07:05:34.318796+0000","last_peered":"2023-10-08T07:05:34.318796+0000","last_clean":"2023-10-08T07:05:34.318796+0000","last_became_active":"2023-10-08T07:05:32.317444+0000","last_became_peered":"2023-10-08T07:05:32.317444+0000","last_unstale":"2023-10-08T07:05:34.318796+0000","last_undegraded":"2023-10-08T07:05:34.318796+0000","last_fullsized":"2023-10-08T07:05:34.318796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:29.242830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360897+0000","last_change":"2023-10-08T07:05:33.321497+0000","last_active":"2023-10-08T07:05:34.360897+0000","last_peered":"2023-10-08T07:05:34.360897+0000","last_clean":"2023-10-08T07:05:34.360897+0000","last_became_active":"2023-10-08T07:05:33.319658+0000","last_became_peered":"2023-10-08T07:05:33.319658+0000","last_unstale":"2023-10-08T07:05:34.360897+0000","last_undegraded":"2023-10-08T07:05:34.360897+0000","last_fullsized":"2023-10-08T07:05:34.360897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.314076+0000","last_change":"2023-10-08T07:05:27.298597+0000","last_active":"2023-10-08T07:05:33.314076+0000","last_peered":"2023-10-08T07:05:33.314076+0000","last_clean":"2023-10-08T07:05:33.314076+0000","last_became_active":"2023-10-08T07:05:27.298355+0000","last_became_peered":"2023-10-08T07:05:27.298355+0000","last_unstale":"2023-10-08T07:05:33.314076+0000","last_undegraded":"2023-10-08T07:05:33.314076+0000","last_fullsized":"2023-10-08T07:05:33.314076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:06.241475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319456+0000","last_change":"2023-10-08T07:05:32.319605+0000","last_active":"2023-10-08T07:05:34.319456+0000","last_peered":"2023-10-08T07:05:34.319456+0000","last_clean":"2023-10-08T07:05:34.319456+0000","last_became_active":"2023-10-08T07:05:32.319244+0000","last_became_peered":"2023-10-08T07:05:32.319244+0000","last_unstale":"2023-10-08T07:05:34.319456+0000","last_undegraded":"2023-10-08T07:05:34.319456+0000","last_fullsized":"2023-10-08T07:05:34.319456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:25.991992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360213+0000","last_change":"2023-10-08T07:05:33.327112+0000","last_active":"2023-10-08T07:05:34.360213+0000","last_peered":"2023-10-08T07:05:34.360213+0000","last_clean":"2023-10-08T07:05:34.360213+0000","last_became_active":"2023-10-08T07:05:33.326816+0000","last_became_peered":"2023-10-08T07:05:33.326816+0000","last_unstale":"2023-10-08T07:05:34.360213+0000","last_undegraded":"2023-10-08T07:05:34.360213+0000","last_fullsized":"2023-10-08T07:05:34.360213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:32.319875+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:32.319385+0000","last_became_peered":"2023-10-08T07:05:32.319385+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309753+0000","last_change":"2023-10-08T07:05:27.295537+0000","last_active":"2023-10-08T07:05:33.309753+0000","last_peered":"2023-10-08T07:05:33.309753+0000","last_clean":"2023-10-08T07:05:33.309753+0000","last_became_active":"2023-10-08T07:05:27.295234+0000","last_became_peered":"2023-10-08T07:05:27.295234+0000","last_unstale":"2023-10-08T07:05:33.309753+0000","last_undegraded":"2023-10-08T07:05:33.309753+0000","last_fullsized":"2023-10-08T07:05:33.309753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:22.951187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318736+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:05:34.318736+0000","last_peered":"2023-10-08T07:05:34.318736+0000","last_clean":"2023-10-08T07:05:34.318736+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:05:34.318736+0000","last_undegraded":"2023-10-08T07:05:34.318736+0000","last_fullsized":"2023-10-08T07:05:34.318736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.325045+0000","last_change":"2023-10-08T07:05:27.295945+0000","last_active":"2023-10-08T07:05:33.325045+0000","last_peered":"2023-10-08T07:05:33.325045+0000","last_clean":"2023-10-08T07:05:33.325045+0000","last_became_active":"2023-10-08T07:05:27.295726+0000","last_became_peered":"2023-10-08T07:05:27.295726+0000","last_unstale":"2023-10-08T07:05:33.325045+0000","last_undegraded":"2023-10-08T07:05:33.325045+0000","last_fullsized":"2023-10-08T07:05:33.325045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:55.040889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.506403+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:05:34.506403+0000","last_peered":"2023-10-08T07:05:34.506403+0000","last_clean":"2023-10-08T07:05:34.506403+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:05:34.506403+0000","last_undegraded":"2023-10-08T07:05:34.506403+0000","last_fullsized":"2023-10-08T07:05:34.506403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359840+0000","last_change":"2023-10-08T07:05:33.326621+0000","last_active":"2023-10-08T07:05:34.359840+0000","last_peered":"2023-10-08T07:05:34.359840+0000","last_clean":"2023-10-08T07:05:34.359840+0000","last_became_active":"2023-10-08T07:05:33.326272+0000","last_became_peered":"2023-10-08T07:05:33.326272+0000","last_unstale":"2023-10-08T07:05:34.359840+0000","last_undegraded":"2023-10-08T07:05:34.359840+0000","last_fullsized":"2023-10-08T07:05:34.359840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:31.752188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359963+0000","last_change":"2023-10-08T07:05:32.323175+0000","last_active":"2023-10-08T07:05:34.359963+0000","last_peered":"2023-10-08T07:05:34.359963+0000","last_clean":"2023-10-08T07:05:34.359963+0000","last_became_active":"2023-10-08T07:05:32.322814+0000","last_became_peered":"2023-10-08T07:05:32.322814+0000","last_unstale":"2023-10-08T07:05:34.359963+0000","last_undegraded":"2023-10-08T07:05:34.359963+0000","last_fullsized":"2023-10-08T07:05:34.359963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360537+0000","last_change":"2023-10-08T07:05:33.318398+0000","last_active":"2023-10-08T07:05:34.360537+0000","last_peered":"2023-10-08T07:05:34.360537+0000","last_clean":"2023-10-08T07:05:34.360537+0000","last_became_active":"2023-10-08T07:05:33.317478+0000","last_became_peered":"2023-10-08T07:05:33.317478+0000","last_unstale":"2023-10-08T07:05:34.360537+0000","last_undegraded":"2023-10-08T07:05:34.360537+0000","last_fullsized":"2023-10-08T07:05:34.360537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320059+0000","last_change":"2023-10-08T07:05:32.320603+0000","last_active":"2023-10-08T07:05:34.320059+0000","last_peered":"2023-10-08T07:05:34.320059+0000","last_clean":"2023-10-08T07:05:34.320059+0000","last_became_active":"2023-10-08T07:05:32.320262+0000","last_became_peered":"2023-10-08T07:05:32.320262+0000","last_unstale":"2023-10-08T07:05:34.320059+0000","last_undegraded":"2023-10-08T07:05:34.320059+0000","last_fullsized":"2023-10-08T07:05:34.320059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:09.249029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319954+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:05:34.319954+0000","last_peered":"2023-10-08T07:05:34.319954+0000","last_clean":"2023-10-08T07:05:34.319954+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:05:34.319954+0000","last_undegraded":"2023-10-08T07:05:34.319954+0000","last_fullsized":"2023-10-08T07:05:34.319954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360795+0000","last_change":"2023-10-08T07:05:32.323143+0000","last_active":"2023-10-08T07:05:34.360795+0000","last_peered":"2023-10-08T07:05:34.360795+0000","last_clean":"2023-10-08T07:05:34.360795+0000","last_became_active":"2023-10-08T07:05:32.322789+0000","last_became_peered":"2023-10-08T07:05:32.322789+0000","last_unstale":"2023-10-08T07:05:34.360795+0000","last_undegraded":"2023-10-08T07:05:34.360795+0000","last_fullsized":"2023-10-08T07:05:34.360795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:03.978136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319826+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:05:34.319826+0000","last_peered":"2023-10-08T07:05:34.319826+0000","last_clean":"2023-10-08T07:05:34.319826+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:05:34.319826+0000","last_undegraded":"2023-10-08T07:05:34.319826+0000","last_fullsized":"2023-10-08T07:05:34.319826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319964+0000","last_change":"2023-10-08T07:05:32.319462+0000","last_active":"2023-10-08T07:05:34.319964+0000","last_peered":"2023-10-08T07:05:34.319964+0000","last_clean":"2023-10-08T07:05:34.319964+0000","last_became_active":"2023-10-08T07:05:32.318951+0000","last_became_peered":"2023-10-08T07:05:32.318951+0000","last_unstale":"2023-10-08T07:05:34.319964+0000","last_undegraded":"2023-10-08T07:05:34.319964+0000","last_fullsized":"2023-10-08T07:05:34.319964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360006+0000","last_change":"2023-10-08T07:05:33.319869+0000","last_active":"2023-10-08T07:05:34.360006+0000","last_peered":"2023-10-08T07:05:34.360006+0000","last_clean":"2023-10-08T07:05:34.360006+0000","last_became_active":"2023-10-08T07:05:33.318241+0000","last_became_peered":"2023-10-08T07:05:33.318241+0000","last_unstale":"2023-10-08T07:05:34.360006+0000","last_undegraded":"2023-10-08T07:05:34.360006+0000","last_fullsized":"2023-10-08T07:05:34.360006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320049+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:05:34.320049+0000","last_peered":"2023-10-08T07:05:34.320049+0000","last_clean":"2023-10-08T07:05:34.320049+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:05:34.320049+0000","last_undegraded":"2023-10-08T07:05:34.320049+0000","last_fullsized":"2023-10-08T07:05:34.320049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320180+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:05:34.320180+0000","last_peered":"2023-10-08T07:05:34.320180+0000","last_clean":"2023-10-08T07:05:34.320180+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:05:34.320180+0000","last_undegraded":"2023-10-08T07:05:34.320180+0000","last_fullsized":"2023-10-08T07:05:34.320180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319653+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:05:34.319653+0000","last_peered":"2023-10-08T07:05:34.319653+0000","last_clean":"2023-10-08T07:05:34.319653+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:05:34.319653+0000","last_undegraded":"2023-10-08T07:05:34.319653+0000","last_fullsized":"2023-10-08T07:05:34.319653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319038+0000","last_change":"2023-10-08T07:05:33.322006+0000","last_active":"2023-10-08T07:05:34.319038+0000","last_peered":"2023-10-08T07:05:34.319038+0000","last_clean":"2023-10-08T07:05:34.319038+0000","last_became_active":"2023-10-08T07:05:33.321639+0000","last_became_peered":"2023-10-08T07:05:33.321639+0000","last_unstale":"2023-10-08T07:05:34.319038+0000","last_undegraded":"2023-10-08T07:05:34.319038+0000","last_fullsized":"2023-10-08T07:05:34.319038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360201+0000","last_change":"2023-10-08T07:05:33.329906+0000","last_active":"2023-10-08T07:05:34.360201+0000","last_peered":"2023-10-08T07:05:34.360201+0000","last_clean":"2023-10-08T07:05:34.360201+0000","last_became_active":"2023-10-08T07:05:33.329615+0000","last_became_peered":"2023-10-08T07:05:33.329615+0000","last_unstale":"2023-10-08T07:05:34.360201+0000","last_undegraded":"2023-10-08T07:05:34.360201+0000","last_fullsized":"2023-10-08T07:05:34.360201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319571+0000","last_change":"2023-10-08T07:05:33.316573+0000","last_active":"2023-10-08T07:05:34.319571+0000","last_peered":"2023-10-08T07:05:34.319571+0000","last_clean":"2023-10-08T07:05:34.319571+0000","last_became_active":"2023-10-08T07:05:33.316193+0000","last_became_peered":"2023-10-08T07:05:33.316193+0000","last_unstale":"2023-10-08T07:05:34.319571+0000","last_undegraded":"2023-10-08T07:05:34.319571+0000","last_fullsized":"2023-10-08T07:05:34.319571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360585+0000","last_change":"2023-10-08T07:05:33.320077+0000","last_active":"2023-10-08T07:05:34.360585+0000","last_peered":"2023-10-08T07:05:34.360585+0000","last_clean":"2023-10-08T07:05:34.360585+0000","last_became_active":"2023-10-08T07:05:33.319392+0000","last_became_peered":"2023-10-08T07:05:33.319392+0000","last_unstale":"2023-10-08T07:05:34.360585+0000","last_undegraded":"2023-10-08T07:05:34.360585+0000","last_fullsized":"2023-10-08T07:05:34.360585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":650475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":649859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:05:43.218 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T07:05:43.218 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T07:05:43.218 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-08T07:05:43.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-08T07:05:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:43.638 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T07:05:43.652 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-08T07:05:43.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:43.986 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:43.986 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:34.310228+0000","last_up_change":"2023-10-08T07:05:18.991889+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:44.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T07:05:20.557481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T07:05:25.624853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T07:05:30.549393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T07:05:31.693934+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T07:05:44.000 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T07:05:44.336 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-08T07:05:44.352 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-08T07:05:44.688 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-08T07:05:44.702 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T07:05:45.041 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-08T07:05:45.055 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T07:05:45.395 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-08T07:05:45.409 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T07:05:45.793 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:45.793 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T07:05:32.716095+0000","modified":"2023-10-08T07:05:35.730191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6803/122402808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":122402808},{"type":"v1","addr":"172.21.15.17:6803","nonce":122402808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T07:05:45.796 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2023-10-08T07:05:45.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:46.144 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:46.145 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:34.310228+0000","last_up_change":"2023-10-08T07:05:18.991889+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:46.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T07:05:20.557481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T07:05:25.624853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T07:05:30.549393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T07:05:31.693934+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T07:05:46.159 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T07:05:46.500 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-08T07:05:46.514 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-08T07:05:46.854 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-08T07:05:46.868 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T07:05:47.205 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-08T07:05:47.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T07:05:47.559 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-08T07:05:47.574 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T07:05:47.961 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:47.961 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T07:05:32.716095+0000","modified":"2023-10-08T07:05:35.730191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6803/122402808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":122402808},{"type":"v1","addr":"172.21.15.17:6803","nonce":122402808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T07:05:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2023-10-08T07:05:47.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:05:48.314 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:48.314 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:05:34.310228+0000","last_up_change":"2023-10-08T07:05:18.991889+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:05:48.328 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T07:05:48.708 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:48.708 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T07:05:32.716095+0000","modified":"2023-10-08T07:05:35.730191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6803/122402808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":122402808},{"type":"v1","addr":"172.21.15.17:6803","nonce":122402808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T07:05:48.711 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2023-10-08T07:05:48.823 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T07:05:32.716095+0000', 'modified': '2023-10-08T07:05:35.730191+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4186': {'gid': 4186, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6803/122402808', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6802', 'nonce': 122402808}, {'type': 'v1', 'addr': '172.21.15.17:6803', 'nonce': 122402808}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T07:05:48.823 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T07:05:48.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T07:05:48.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-08T07:05:48.961+0000 7f44e77fe700 0 client.4465 ms_handle_reset on v2:172.21.15.17:6802/122402808 2023-10-08T07:05:48.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-08T07:05:48.984+0000 7f44e77fe700 0 client.4638 ms_handle_reset on v2:172.21.15.17:6802/122402808 2023-10-08T07:05:48.985 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-08T07:05:48.986 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "bb50b5dc-93de-4177-9c34-354ea3b007d0", 2023-10-08T07:05:48.986 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-10-08T07:05:48.986 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4186, 2023-10-08T07:05:48.986 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-08T07:05:48.986 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-08T07:05:48.986 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-08T07:05:48.986 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 15.674385447000001, 2023-10-08T07:05:48.986 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 6, 2023-10-08T07:05:48.986 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 19, 2023-10-08T07:05:48.986 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 19, 2023-10-08T07:05:48.987 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 21.585819024999999 2023-10-08T07:05:48.987 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-08T07:05:48.998 INFO:teuthology.run_tasks:Running task thrashosds... 2023-10-08T07:05:49.010 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-10-08T07:05:49.010 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'osd_pg_log_dups_tracked': 10000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}} 2023-10-08T07:05:49.010 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2023-10-08T07:05:49.010 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2023-10-08T07:05:49.011 DEBUG:teuthology.orchestra.run.smithi017:> sync 2023-10-08T07:05:49.189 DEBUG:teuthology.orchestra.run.smithi033:> sync 2023-10-08T07:05:49.311 DEBUG:teuthology.orchestra.run.smithi086:> sync 2023-10-08T07:05:49.471 DEBUG:teuthology.orchestra.run.smithi144:> sync 2023-10-08T07:05:49.645 DEBUG:tasks.thrashosds:checking console status of smithi017 2023-10-08T07:05:49.645 DEBUG:teuthology.orchestra.console.smithi017:Waiting for login prompt 2023-10-08T07:05:49.645 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi017 2023-10-08T07:05:49.820 DEBUG:teuthology.orchestra.console.smithi017:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-10-08T07:05:49.821 DEBUG:teuthology.orchestra.console.smithi017:expect after: smithi017 login: 2023-10-08T07:05:49.873 DEBUG:teuthology.orchestra.console.smithi017:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi017 login: [disconnect] 2023-10-08T07:05:49.973 DEBUG:tasks.thrashosds:checking console status of smithi033 2023-10-08T07:05:49.974 DEBUG:teuthology.orchestra.console.smithi033:Waiting for login prompt 2023-10-08T07:05:49.974 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi033 2023-10-08T07:05:50.161 DEBUG:teuthology.orchestra.console.smithi033:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-10-08T07:05:50.162 DEBUG:teuthology.orchestra.console.smithi033:expect after: smithi033 login: 2023-10-08T07:05:50.214 DEBUG:teuthology.orchestra.console.smithi033:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi033 login: [disconnect] 2023-10-08T07:05:50.315 DEBUG:tasks.thrashosds:checking console status of smithi086 2023-10-08T07:05:50.315 DEBUG:teuthology.orchestra.console.smithi086:Waiting for login prompt 2023-10-08T07:05:50.315 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi086 2023-10-08T07:05:50.464 DEBUG:teuthology.orchestra.console.smithi086:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-10-08T07:05:50.465 DEBUG:teuthology.orchestra.console.smithi086:expect after: smithi086 login: 2023-10-08T07:05:50.518 DEBUG:teuthology.orchestra.console.smithi086:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi086 login: [disconnect] 2023-10-08T07:05:50.620 DEBUG:tasks.thrashosds:checking console status of smithi144 2023-10-08T07:05:50.620 DEBUG:teuthology.orchestra.console.smithi144:Waiting for login prompt 2023-10-08T07:05:50.620 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi144 2023-10-08T07:05:50.793 DEBUG:teuthology.orchestra.console.smithi144:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-10-08T07:05:50.793 DEBUG:teuthology.orchestra.console.smithi144:expect after: smithi144 login: 2023-10-08T07:05:50.847 DEBUG:teuthology.orchestra.console.smithi144:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi144 login: [disconnect] 2023-10-08T07:05:50.948 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-10-08T07:05:51.318 INFO:tasks.thrashosds:Beginning thrashosds... 2023-10-08T07:05:51.318 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T07:05:51.319 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:05:51.661 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:51.663 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:05:51.672 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-08T07:05:50.506017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91108,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024412,"statfs":{"total":289910292480,"available":289816997888,"internally_reserved":0,"allocated":1744896,"data_stored":1358647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":91483475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002616"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361123+0000","last_change":"2023-10-08T07:05:33.319747+0000","last_active":"2023-10-08T07:05:34.361123+0000","last_peered":"2023-10-08T07:05:34.361123+0000","last_clean":"2023-10-08T07:05:34.361123+0000","last_became_active":"2023-10-08T07:05:33.318115+0000","last_became_peered":"2023-10-08T07:05:33.318115+0000","last_unstale":"2023-10-08T07:05:34.361123+0000","last_undegraded":"2023-10-08T07:05:34.361123+0000","last_fullsized":"2023-10-08T07:05:34.361123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360608+0000","last_change":"2023-10-08T07:05:33.322480+0000","last_active":"2023-10-08T07:05:34.360608+0000","last_peered":"2023-10-08T07:05:34.360608+0000","last_clean":"2023-10-08T07:05:34.360608+0000","last_became_active":"2023-10-08T07:05:33.322153+0000","last_became_peered":"2023-10-08T07:05:33.322153+0000","last_unstale":"2023-10-08T07:05:34.360608+0000","last_undegraded":"2023-10-08T07:05:34.360608+0000","last_fullsized":"2023-10-08T07:05:34.360608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:33.325067+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:33.323439+0000","last_became_peered":"2023-10-08T07:05:33.323439+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:18.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320530+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:05:34.320530+0000","last_peered":"2023-10-08T07:05:34.320530+0000","last_clean":"2023-10-08T07:05:34.320530+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:05:34.320530+0000","last_undegraded":"2023-10-08T07:05:34.320530+0000","last_fullsized":"2023-10-08T07:05:34.320530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360128+0000","last_change":"2023-10-08T07:05:33.321314+0000","last_active":"2023-10-08T07:05:34.360128+0000","last_peered":"2023-10-08T07:05:34.360128+0000","last_clean":"2023-10-08T07:05:34.360128+0000","last_became_active":"2023-10-08T07:05:33.320841+0000","last_became_peered":"2023-10-08T07:05:33.320841+0000","last_unstale":"2023-10-08T07:05:34.360128+0000","last_undegraded":"2023-10-08T07:05:34.360128+0000","last_fullsized":"2023-10-08T07:05:34.360128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319725+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:05:34.319725+0000","last_peered":"2023-10-08T07:05:34.319725+0000","last_clean":"2023-10-08T07:05:34.319725+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:05:34.319725+0000","last_undegraded":"2023-10-08T07:05:34.319725+0000","last_fullsized":"2023-10-08T07:05:34.319725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319443+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:05:34.319443+0000","last_peered":"2023-10-08T07:05:34.319443+0000","last_clean":"2023-10-08T07:05:34.319443+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:05:34.319443+0000","last_undegraded":"2023-10-08T07:05:34.319443+0000","last_fullsized":"2023-10-08T07:05:34.319443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319238+0000","last_change":"2023-10-08T07:05:33.327740+0000","last_active":"2023-10-08T07:05:34.319238+0000","last_peered":"2023-10-08T07:05:34.319238+0000","last_clean":"2023-10-08T07:05:34.319238+0000","last_became_active":"2023-10-08T07:05:33.325912+0000","last_became_peered":"2023-10-08T07:05:33.325912+0000","last_unstale":"2023-10-08T07:05:34.319238+0000","last_undegraded":"2023-10-08T07:05:34.319238+0000","last_fullsized":"2023-10-08T07:05:34.319238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319837+0000","last_change":"2023-10-08T07:05:33.322628+0000","last_active":"2023-10-08T07:05:34.319837+0000","last_peered":"2023-10-08T07:05:34.319837+0000","last_clean":"2023-10-08T07:05:34.319837+0000","last_became_active":"2023-10-08T07:05:33.321816+0000","last_became_peered":"2023-10-08T07:05:33.321816+0000","last_unstale":"2023-10-08T07:05:34.319837+0000","last_undegraded":"2023-10-08T07:05:34.319837+0000","last_fullsized":"2023-10-08T07:05:34.319837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360894+0000","last_change":"2023-10-08T07:05:33.322098+0000","last_active":"2023-10-08T07:05:34.360894+0000","last_peered":"2023-10-08T07:05:34.360894+0000","last_clean":"2023-10-08T07:05:34.360894+0000","last_became_active":"2023-10-08T07:05:33.321208+0000","last_became_peered":"2023-10-08T07:05:33.321208+0000","last_unstale":"2023-10-08T07:05:34.360894+0000","last_undegraded":"2023-10-08T07:05:34.360894+0000","last_fullsized":"2023-10-08T07:05:34.360894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320139+0000","last_change":"2023-10-08T07:05:33.328140+0000","last_active":"2023-10-08T07:05:34.320139+0000","last_peered":"2023-10-08T07:05:34.320139+0000","last_clean":"2023-10-08T07:05:34.320139+0000","last_became_active":"2023-10-08T07:05:33.327595+0000","last_became_peered":"2023-10-08T07:05:33.327595+0000","last_unstale":"2023-10-08T07:05:34.320139+0000","last_undegraded":"2023-10-08T07:05:34.320139+0000","last_fullsized":"2023-10-08T07:05:34.320139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360113+0000","last_change":"2023-10-08T07:05:33.329834+0000","last_active":"2023-10-08T07:05:34.360113+0000","last_peered":"2023-10-08T07:05:34.360113+0000","last_clean":"2023-10-08T07:05:34.360113+0000","last_became_active":"2023-10-08T07:05:33.329357+0000","last_became_peered":"2023-10-08T07:05:33.329357+0000","last_unstale":"2023-10-08T07:05:34.360113+0000","last_undegraded":"2023-10-08T07:05:34.360113+0000","last_fullsized":"2023-10-08T07:05:34.360113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360010+0000","last_change":"2023-10-08T07:05:33.319643+0000","last_active":"2023-10-08T07:05:34.360010+0000","last_peered":"2023-10-08T07:05:34.360010+0000","last_clean":"2023-10-08T07:05:34.360010+0000","last_became_active":"2023-10-08T07:05:33.318659+0000","last_became_peered":"2023-10-08T07:05:33.318659+0000","last_unstale":"2023-10-08T07:05:34.360010+0000","last_undegraded":"2023-10-08T07:05:34.360010+0000","last_fullsized":"2023-10-08T07:05:34.360010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320295+0000","last_change":"2023-10-08T07:05:33.318491+0000","last_active":"2023-10-08T07:05:34.320295+0000","last_peered":"2023-10-08T07:05:34.320295+0000","last_clean":"2023-10-08T07:05:34.320295+0000","last_became_active":"2023-10-08T07:05:33.317703+0000","last_became_peered":"2023-10-08T07:05:33.317703+0000","last_unstale":"2023-10-08T07:05:34.320295+0000","last_undegraded":"2023-10-08T07:05:34.320295+0000","last_fullsized":"2023-10-08T07:05:34.320295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.319294+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.318364+0000","last_became_peered":"2023-10-08T07:05:33.318364+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319517+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:05:34.319517+0000","last_peered":"2023-10-08T07:05:34.319517+0000","last_clean":"2023-10-08T07:05:34.319517+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:05:34.319517+0000","last_undegraded":"2023-10-08T07:05:34.319517+0000","last_fullsized":"2023-10-08T07:05:34.319517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319930+0000","last_change":"2023-10-08T07:05:33.317287+0000","last_active":"2023-10-08T07:05:34.319930+0000","last_peered":"2023-10-08T07:05:34.319930+0000","last_clean":"2023-10-08T07:05:34.319930+0000","last_became_active":"2023-10-08T07:05:33.316483+0000","last_became_peered":"2023-10-08T07:05:33.316483+0000","last_unstale":"2023-10-08T07:05:34.319930+0000","last_undegraded":"2023-10-08T07:05:34.319930+0000","last_fullsized":"2023-10-08T07:05:34.319930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361063+0000","last_change":"2023-10-08T07:05:33.321088+0000","last_active":"2023-10-08T07:05:34.361063+0000","last_peered":"2023-10-08T07:05:34.361063+0000","last_clean":"2023-10-08T07:05:34.361063+0000","last_became_active":"2023-10-08T07:05:33.319541+0000","last_became_peered":"2023-10-08T07:05:33.319541+0000","last_unstale":"2023-10-08T07:05:34.361063+0000","last_undegraded":"2023-10-08T07:05:34.361063+0000","last_fullsized":"2023-10-08T07:05:34.361063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319536+0000","last_change":"2023-10-08T07:05:33.322110+0000","last_active":"2023-10-08T07:05:34.319536+0000","last_peered":"2023-10-08T07:05:34.319536+0000","last_clean":"2023-10-08T07:05:34.319536+0000","last_became_active":"2023-10-08T07:05:33.321780+0000","last_became_peered":"2023-10-08T07:05:33.321780+0000","last_unstale":"2023-10-08T07:05:34.319536+0000","last_undegraded":"2023-10-08T07:05:34.319536+0000","last_fullsized":"2023-10-08T07:05:34.319536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320412+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:05:34.320412+0000","last_peered":"2023-10-08T07:05:34.320412+0000","last_clean":"2023-10-08T07:05:34.320412+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:05:34.320412+0000","last_undegraded":"2023-10-08T07:05:34.320412+0000","last_fullsized":"2023-10-08T07:05:34.320412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319754+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:05:34.319754+0000","last_peered":"2023-10-08T07:05:34.319754+0000","last_clean":"2023-10-08T07:05:34.319754+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:05:34.319754+0000","last_undegraded":"2023-10-08T07:05:34.319754+0000","last_fullsized":"2023-10-08T07:05:34.319754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360008+0000","last_change":"2023-10-08T07:05:33.326970+0000","last_active":"2023-10-08T07:05:34.360008+0000","last_peered":"2023-10-08T07:05:34.360008+0000","last_clean":"2023-10-08T07:05:34.360008+0000","last_became_active":"2023-10-08T07:05:33.326650+0000","last_became_peered":"2023-10-08T07:05:33.326650+0000","last_unstale":"2023-10-08T07:05:34.360008+0000","last_undegraded":"2023-10-08T07:05:34.360008+0000","last_fullsized":"2023-10-08T07:05:34.360008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319095+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:05:34.319095+0000","last_peered":"2023-10-08T07:05:34.319095+0000","last_clean":"2023-10-08T07:05:34.319095+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:05:34.319095+0000","last_undegraded":"2023-10-08T07:05:34.319095+0000","last_fullsized":"2023-10-08T07:05:34.319095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360261+0000","last_change":"2023-10-08T07:05:33.319759+0000","last_active":"2023-10-08T07:05:34.360261+0000","last_peered":"2023-10-08T07:05:34.360261+0000","last_clean":"2023-10-08T07:05:34.360261+0000","last_became_active":"2023-10-08T07:05:33.318507+0000","last_became_peered":"2023-10-08T07:05:33.318507+0000","last_unstale":"2023-10-08T07:05:34.360261+0000","last_undegraded":"2023-10-08T07:05:34.360261+0000","last_fullsized":"2023-10-08T07:05:34.360261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361101+0000","last_change":"2023-10-08T07:05:33.317560+0000","last_active":"2023-10-08T07:05:34.361101+0000","last_peered":"2023-10-08T07:05:34.361101+0000","last_clean":"2023-10-08T07:05:34.361101+0000","last_became_active":"2023-10-08T07:05:33.316906+0000","last_became_peered":"2023-10-08T07:05:33.316906+0000","last_unstale":"2023-10-08T07:05:34.361101+0000","last_undegraded":"2023-10-08T07:05:34.361101+0000","last_fullsized":"2023-10-08T07:05:34.361101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320043+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:05:34.320043+0000","last_peered":"2023-10-08T07:05:34.320043+0000","last_clean":"2023-10-08T07:05:34.320043+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:05:34.320043+0000","last_undegraded":"2023-10-08T07:05:34.320043+0000","last_fullsized":"2023-10-08T07:05:34.320043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320344+0000","last_change":"2023-10-08T07:05:33.326267+0000","last_active":"2023-10-08T07:05:34.320344+0000","last_peered":"2023-10-08T07:05:34.320344+0000","last_clean":"2023-10-08T07:05:34.320344+0000","last_became_active":"2023-10-08T07:05:33.324579+0000","last_became_peered":"2023-10-08T07:05:33.324579+0000","last_unstale":"2023-10-08T07:05:34.320344+0000","last_undegraded":"2023-10-08T07:05:34.320344+0000","last_fullsized":"2023-10-08T07:05:34.320344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359920+0000","last_change":"2023-10-08T07:05:32.320295+0000","last_active":"2023-10-08T07:05:34.359920+0000","last_peered":"2023-10-08T07:05:34.359920+0000","last_clean":"2023-10-08T07:05:34.359920+0000","last_became_active":"2023-10-08T07:05:32.320044+0000","last_became_peered":"2023-10-08T07:05:32.320044+0000","last_unstale":"2023-10-08T07:05:34.359920+0000","last_undegraded":"2023-10-08T07:05:34.359920+0000","last_fullsized":"2023-10-08T07:05:34.359920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:44.690611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360949+0000","last_change":"2023-10-08T07:05:33.329921+0000","last_active":"2023-10-08T07:05:34.360949+0000","last_peered":"2023-10-08T07:05:34.360949+0000","last_clean":"2023-10-08T07:05:34.360949+0000","last_became_active":"2023-10-08T07:05:33.329346+0000","last_became_peered":"2023-10-08T07:05:33.329346+0000","last_unstale":"2023-10-08T07:05:34.360949+0000","last_undegraded":"2023-10-08T07:05:34.360949+0000","last_fullsized":"2023-10-08T07:05:34.360949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319260+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:05:34.319260+0000","last_peered":"2023-10-08T07:05:34.319260+0000","last_clean":"2023-10-08T07:05:34.319260+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:05:34.319260+0000","last_undegraded":"2023-10-08T07:05:34.319260+0000","last_fullsized":"2023-10-08T07:05:34.319260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319829+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:05:34.319829+0000","last_peered":"2023-10-08T07:05:34.319829+0000","last_clean":"2023-10-08T07:05:34.319829+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:05:34.319829+0000","last_undegraded":"2023-10-08T07:05:34.319829+0000","last_fullsized":"2023-10-08T07:05:34.319829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319123+0000","last_change":"2023-10-08T07:05:32.315935+0000","last_active":"2023-10-08T07:05:34.319123+0000","last_peered":"2023-10-08T07:05:34.319123+0000","last_clean":"2023-10-08T07:05:34.319123+0000","last_became_active":"2023-10-08T07:05:32.315661+0000","last_became_peered":"2023-10-08T07:05:32.315661+0000","last_unstale":"2023-10-08T07:05:34.319123+0000","last_undegraded":"2023-10-08T07:05:34.319123+0000","last_fullsized":"2023-10-08T07:05:34.319123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:01:05.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361026+0000","last_change":"2023-10-08T07:05:33.330068+0000","last_active":"2023-10-08T07:05:34.361026+0000","last_peered":"2023-10-08T07:05:34.361026+0000","last_clean":"2023-10-08T07:05:34.361026+0000","last_became_active":"2023-10-08T07:05:33.329169+0000","last_became_peered":"2023-10-08T07:05:33.329169+0000","last_unstale":"2023-10-08T07:05:34.361026+0000","last_undegraded":"2023-10-08T07:05:34.361026+0000","last_fullsized":"2023-10-08T07:05:34.361026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:05:34.320135+0000","last_peered":"2023-10-08T07:05:34.320135+0000","last_clean":"2023-10-08T07:05:34.320135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:05:34.320135+0000","last_undegraded":"2023-10-08T07:05:34.320135+0000","last_fullsized":"2023-10-08T07:05:34.320135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318813+0000","last_change":"2023-10-08T07:05:33.316496+0000","last_active":"2023-10-08T07:05:34.318813+0000","last_peered":"2023-10-08T07:05:34.318813+0000","last_clean":"2023-10-08T07:05:34.318813+0000","last_became_active":"2023-10-08T07:05:33.316084+0000","last_became_peered":"2023-10-08T07:05:33.316084+0000","last_unstale":"2023-10-08T07:05:34.318813+0000","last_undegraded":"2023-10-08T07:05:34.318813+0000","last_fullsized":"2023-10-08T07:05:34.318813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320455+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:05:34.320455+0000","last_peered":"2023-10-08T07:05:34.320455+0000","last_clean":"2023-10-08T07:05:34.320455+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:05:34.320455+0000","last_undegraded":"2023-10-08T07:05:34.320455+0000","last_fullsized":"2023-10-08T07:05:34.320455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319317+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:05:34.319317+0000","last_peered":"2023-10-08T07:05:34.319317+0000","last_clean":"2023-10-08T07:05:34.319317+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:05:34.319317+0000","last_undegraded":"2023-10-08T07:05:34.319317+0000","last_fullsized":"2023-10-08T07:05:34.319317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360636+0000","last_change":"2023-10-08T07:05:32.323201+0000","last_active":"2023-10-08T07:05:34.360636+0000","last_peered":"2023-10-08T07:05:34.360636+0000","last_clean":"2023-10-08T07:05:34.360636+0000","last_became_active":"2023-10-08T07:05:32.322864+0000","last_became_peered":"2023-10-08T07:05:32.322864+0000","last_unstale":"2023-10-08T07:05:34.360636+0000","last_undegraded":"2023-10-08T07:05:34.360636+0000","last_fullsized":"2023-10-08T07:05:34.360636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:40.093124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319535+0000","last_change":"2023-10-08T07:05:33.317114+0000","last_active":"2023-10-08T07:05:34.319535+0000","last_peered":"2023-10-08T07:05:34.319535+0000","last_clean":"2023-10-08T07:05:34.319535+0000","last_became_active":"2023-10-08T07:05:33.316390+0000","last_became_peered":"2023-10-08T07:05:33.316390+0000","last_unstale":"2023-10-08T07:05:34.319535+0000","last_undegraded":"2023-10-08T07:05:34.319535+0000","last_fullsized":"2023-10-08T07:05:34.319535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320136+0000","last_change":"2023-10-08T07:05:32.319510+0000","last_active":"2023-10-08T07:05:34.320136+0000","last_peered":"2023-10-08T07:05:34.320136+0000","last_clean":"2023-10-08T07:05:34.320136+0000","last_became_active":"2023-10-08T07:05:32.319209+0000","last_became_peered":"2023-10-08T07:05:32.319209+0000","last_unstale":"2023-10-08T07:05:34.320136+0000","last_undegraded":"2023-10-08T07:05:34.320136+0000","last_fullsized":"2023-10-08T07:05:34.320136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:28.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320332+0000","last_change":"2023-10-08T07:05:33.317137+0000","last_active":"2023-10-08T07:05:34.320332+0000","last_peered":"2023-10-08T07:05:34.320332+0000","last_clean":"2023-10-08T07:05:34.320332+0000","last_became_active":"2023-10-08T07:05:33.316562+0000","last_became_peered":"2023-10-08T07:05:33.316562+0000","last_unstale":"2023-10-08T07:05:34.320332+0000","last_undegraded":"2023-10-08T07:05:34.320332+0000","last_fullsized":"2023-10-08T07:05:34.320332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:41.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320369+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:05:34.320369+0000","last_peered":"2023-10-08T07:05:34.320369+0000","last_clean":"2023-10-08T07:05:34.320369+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:05:34.320369+0000","last_undegraded":"2023-10-08T07:05:34.320369+0000","last_fullsized":"2023-10-08T07:05:34.320369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360395+0000","last_change":"2023-10-08T07:05:33.322201+0000","last_active":"2023-10-08T07:05:34.360395+0000","last_peered":"2023-10-08T07:05:34.360395+0000","last_clean":"2023-10-08T07:05:34.360395+0000","last_became_active":"2023-10-08T07:05:33.321826+0000","last_became_peered":"2023-10-08T07:05:33.321826+0000","last_unstale":"2023-10-08T07:05:34.360395+0000","last_undegraded":"2023-10-08T07:05:34.360395+0000","last_fullsized":"2023-10-08T07:05:34.360395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319178+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:05:34.319178+0000","last_peered":"2023-10-08T07:05:34.319178+0000","last_clean":"2023-10-08T07:05:34.319178+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:05:34.319178+0000","last_undegraded":"2023-10-08T07:05:34.319178+0000","last_fullsized":"2023-10-08T07:05:34.319178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360947+0000","last_change":"2023-10-08T07:05:33.317545+0000","last_active":"2023-10-08T07:05:34.360947+0000","last_peered":"2023-10-08T07:05:34.360947+0000","last_clean":"2023-10-08T07:05:34.360947+0000","last_became_active":"2023-10-08T07:05:33.317134+0000","last_became_peered":"2023-10-08T07:05:33.317134+0000","last_unstale":"2023-10-08T07:05:34.360947+0000","last_undegraded":"2023-10-08T07:05:34.360947+0000","last_fullsized":"2023-10-08T07:05:34.360947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359736+0000","last_change":"2023-10-08T07:05:32.323406+0000","last_active":"2023-10-08T07:05:34.359736+0000","last_peered":"2023-10-08T07:05:34.359736+0000","last_clean":"2023-10-08T07:05:34.359736+0000","last_became_active":"2023-10-08T07:05:32.323040+0000","last_became_peered":"2023-10-08T07:05:32.323040+0000","last_unstale":"2023-10-08T07:05:34.359736+0000","last_undegraded":"2023-10-08T07:05:34.359736+0000","last_fullsized":"2023-10-08T07:05:34.359736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319639+0000","last_change":"2023-10-08T07:05:32.319220+0000","last_active":"2023-10-08T07:05:34.319639+0000","last_peered":"2023-10-08T07:05:34.319639+0000","last_clean":"2023-10-08T07:05:34.319639+0000","last_became_active":"2023-10-08T07:05:32.318838+0000","last_became_peered":"2023-10-08T07:05:32.318838+0000","last_unstale":"2023-10-08T07:05:34.319639+0000","last_undegraded":"2023-10-08T07:05:34.319639+0000","last_fullsized":"2023-10-08T07:05:34.319639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:32:59.940325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320271+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:05:34.320271+0000","last_peered":"2023-10-08T07:05:34.320271+0000","last_clean":"2023-10-08T07:05:34.320271+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:05:34.320271+0000","last_undegraded":"2023-10-08T07:05:34.320271+0000","last_fullsized":"2023-10-08T07:05:34.320271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320776+0000","last_change":"2023-10-08T07:05:32.319446+0000","last_active":"2023-10-08T07:05:34.320776+0000","last_peered":"2023-10-08T07:05:34.320776+0000","last_clean":"2023-10-08T07:05:34.320776+0000","last_became_active":"2023-10-08T07:05:32.319019+0000","last_became_peered":"2023-10-08T07:05:32.319019+0000","last_unstale":"2023-10-08T07:05:34.320776+0000","last_undegraded":"2023-10-08T07:05:34.320776+0000","last_fullsized":"2023-10-08T07:05:34.320776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:56.843162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359487+0000","last_change":"2023-10-08T07:05:33.330217+0000","last_active":"2023-10-08T07:05:34.359487+0000","last_peered":"2023-10-08T07:05:34.359487+0000","last_clean":"2023-10-08T07:05:34.359487+0000","last_became_active":"2023-10-08T07:05:33.329639+0000","last_became_peered":"2023-10-08T07:05:33.329639+0000","last_unstale":"2023-10-08T07:05:34.359487+0000","last_undegraded":"2023-10-08T07:05:34.359487+0000","last_fullsized":"2023-10-08T07:05:34.359487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:21.715645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360604+0000","last_change":"2023-10-08T07:05:32.323481+0000","last_active":"2023-10-08T07:05:34.360604+0000","last_peered":"2023-10-08T07:05:34.360604+0000","last_clean":"2023-10-08T07:05:34.360604+0000","last_became_active":"2023-10-08T07:05:32.323243+0000","last_became_peered":"2023-10-08T07:05:32.323243+0000","last_unstale":"2023-10-08T07:05:34.360604+0000","last_undegraded":"2023-10-08T07:05:34.360604+0000","last_fullsized":"2023-10-08T07:05:34.360604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359906+0000","last_change":"2023-10-08T07:05:33.318539+0000","last_active":"2023-10-08T07:05:34.359906+0000","last_peered":"2023-10-08T07:05:34.359906+0000","last_clean":"2023-10-08T07:05:34.359906+0000","last_became_active":"2023-10-08T07:05:33.317371+0000","last_became_peered":"2023-10-08T07:05:33.317371+0000","last_unstale":"2023-10-08T07:05:34.359906+0000","last_undegraded":"2023-10-08T07:05:34.359906+0000","last_fullsized":"2023-10-08T07:05:34.359906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:00.945202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320279+0000","last_change":"2023-10-08T07:05:32.321744+0000","last_active":"2023-10-08T07:05:34.320279+0000","last_peered":"2023-10-08T07:05:34.320279+0000","last_clean":"2023-10-08T07:05:34.320279+0000","last_became_active":"2023-10-08T07:05:32.321482+0000","last_became_peered":"2023-10-08T07:05:32.321482+0000","last_unstale":"2023-10-08T07:05:34.320279+0000","last_undegraded":"2023-10-08T07:05:34.320279+0000","last_fullsized":"2023-10-08T07:05:34.320279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:13.789778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320018+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:05:34.320018+0000","last_peered":"2023-10-08T07:05:34.320018+0000","last_clean":"2023-10-08T07:05:34.320018+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:05:34.320018+0000","last_undegraded":"2023-10-08T07:05:34.320018+0000","last_fullsized":"2023-10-08T07:05:34.320018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319626+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:05:34.319626+0000","last_peered":"2023-10-08T07:05:34.319626+0000","last_clean":"2023-10-08T07:05:34.319626+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:05:34.319626+0000","last_undegraded":"2023-10-08T07:05:34.319626+0000","last_fullsized":"2023-10-08T07:05:34.319626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319559+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:05:34.319559+0000","last_peered":"2023-10-08T07:05:34.319559+0000","last_clean":"2023-10-08T07:05:34.319559+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:05:34.319559+0000","last_undegraded":"2023-10-08T07:05:34.319559+0000","last_fullsized":"2023-10-08T07:05:34.319559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319350+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:05:34.319350+0000","last_peered":"2023-10-08T07:05:34.319350+0000","last_clean":"2023-10-08T07:05:34.319350+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:05:34.319350+0000","last_undegraded":"2023-10-08T07:05:34.319350+0000","last_fullsized":"2023-10-08T07:05:34.319350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319602+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:05:34.319602+0000","last_peered":"2023-10-08T07:05:34.319602+0000","last_clean":"2023-10-08T07:05:34.319602+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:05:34.319602+0000","last_undegraded":"2023-10-08T07:05:34.319602+0000","last_fullsized":"2023-10-08T07:05:34.319602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320680+0000","last_change":"2023-10-08T07:05:33.319933+0000","last_active":"2023-10-08T07:05:34.320680+0000","last_peered":"2023-10-08T07:05:34.320680+0000","last_clean":"2023-10-08T07:05:34.320680+0000","last_became_active":"2023-10-08T07:05:33.317937+0000","last_became_peered":"2023-10-08T07:05:33.317937+0000","last_unstale":"2023-10-08T07:05:34.320680+0000","last_undegraded":"2023-10-08T07:05:34.320680+0000","last_fullsized":"2023-10-08T07:05:34.320680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:57:42.074994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359555+0000","last_change":"2023-10-08T07:05:32.323415+0000","last_active":"2023-10-08T07:05:34.359555+0000","last_peered":"2023-10-08T07:05:34.359555+0000","last_clean":"2023-10-08T07:05:34.359555+0000","last_became_active":"2023-10-08T07:05:32.322910+0000","last_became_peered":"2023-10-08T07:05:32.322910+0000","last_unstale":"2023-10-08T07:05:34.359555+0000","last_undegraded":"2023-10-08T07:05:34.359555+0000","last_fullsized":"2023-10-08T07:05:34.359555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320553+0000","last_change":"2023-10-08T07:05:33.325994+0000","last_active":"2023-10-08T07:05:34.320553+0000","last_peered":"2023-10-08T07:05:34.320553+0000","last_clean":"2023-10-08T07:05:34.320553+0000","last_became_active":"2023-10-08T07:05:33.324865+0000","last_became_peered":"2023-10-08T07:05:33.324865+0000","last_unstale":"2023-10-08T07:05:34.320553+0000","last_undegraded":"2023-10-08T07:05:34.320553+0000","last_fullsized":"2023-10-08T07:05:34.320553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:14.142601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359677+0000","last_change":"2023-10-08T07:05:32.320359+0000","last_active":"2023-10-08T07:05:34.359677+0000","last_peered":"2023-10-08T07:05:34.359677+0000","last_clean":"2023-10-08T07:05:34.359677+0000","last_became_active":"2023-10-08T07:05:32.320137+0000","last_became_peered":"2023-10-08T07:05:32.320137+0000","last_unstale":"2023-10-08T07:05:34.359677+0000","last_undegraded":"2023-10-08T07:05:34.359677+0000","last_fullsized":"2023-10-08T07:05:34.359677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:32.366341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320091+0000","last_change":"2023-10-08T07:05:33.322861+0000","last_active":"2023-10-08T07:05:34.320091+0000","last_peered":"2023-10-08T07:05:34.320091+0000","last_clean":"2023-10-08T07:05:34.320091+0000","last_became_active":"2023-10-08T07:05:33.322450+0000","last_became_peered":"2023-10-08T07:05:33.322450+0000","last_unstale":"2023-10-08T07:05:34.320091+0000","last_undegraded":"2023-10-08T07:05:34.320091+0000","last_fullsized":"2023-10-08T07:05:34.320091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309081+0000","last_change":"2023-10-08T07:05:27.295597+0000","last_active":"2023-10-08T07:05:33.309081+0000","last_peered":"2023-10-08T07:05:33.309081+0000","last_clean":"2023-10-08T07:05:33.309081+0000","last_became_active":"2023-10-08T07:05:27.295265+0000","last_became_peered":"2023-10-08T07:05:27.295265+0000","last_unstale":"2023-10-08T07:05:33.309081+0000","last_undegraded":"2023-10-08T07:05:33.309081+0000","last_fullsized":"2023-10-08T07:05:33.309081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:50.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360046+0000","last_change":"2023-10-08T07:05:33.326797+0000","last_active":"2023-10-08T07:05:34.360046+0000","last_peered":"2023-10-08T07:05:34.360046+0000","last_clean":"2023-10-08T07:05:34.360046+0000","last_became_active":"2023-10-08T07:05:33.326518+0000","last_became_peered":"2023-10-08T07:05:33.326518+0000","last_unstale":"2023-10-08T07:05:34.360046+0000","last_undegraded":"2023-10-08T07:05:34.360046+0000","last_fullsized":"2023-10-08T07:05:34.360046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318961+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:05:33.318961+0000","last_peered":"2023-10-08T07:05:33.318961+0000","last_clean":"2023-10-08T07:05:33.318961+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:05:33.318961+0000","last_undegraded":"2023-10-08T07:05:33.318961+0000","last_fullsized":"2023-10-08T07:05:33.318961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320087+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:05:34.320087+0000","last_peered":"2023-10-08T07:05:34.320087+0000","last_clean":"2023-10-08T07:05:34.320087+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:05:34.320087+0000","last_undegraded":"2023-10-08T07:05:34.320087+0000","last_fullsized":"2023-10-08T07:05:34.320087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319579+0000","last_change":"2023-10-08T07:05:33.322164+0000","last_active":"2023-10-08T07:05:34.319579+0000","last_peered":"2023-10-08T07:05:34.319579+0000","last_clean":"2023-10-08T07:05:34.319579+0000","last_became_active":"2023-10-08T07:05:33.321757+0000","last_became_peered":"2023-10-08T07:05:33.321757+0000","last_unstale":"2023-10-08T07:05:34.319579+0000","last_undegraded":"2023-10-08T07:05:34.319579+0000","last_fullsized":"2023-10-08T07:05:34.319579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.308287+0000","last_change":"2023-10-08T07:05:27.295991+0000","last_active":"2023-10-08T07:05:33.308287+0000","last_peered":"2023-10-08T07:05:33.308287+0000","last_clean":"2023-10-08T07:05:33.308287+0000","last_became_active":"2023-10-08T07:05:27.295727+0000","last_became_peered":"2023-10-08T07:05:27.295727+0000","last_unstale":"2023-10-08T07:05:33.308287+0000","last_undegraded":"2023-10-08T07:05:33.308287+0000","last_fullsized":"2023-10-08T07:05:33.308287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:54.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359567+0000","last_change":"2023-10-08T07:05:32.323161+0000","last_active":"2023-10-08T07:05:34.359567+0000","last_peered":"2023-10-08T07:05:34.359567+0000","last_clean":"2023-10-08T07:05:34.359567+0000","last_became_active":"2023-10-08T07:05:32.322832+0000","last_became_peered":"2023-10-08T07:05:32.322832+0000","last_unstale":"2023-10-08T07:05:34.359567+0000","last_undegraded":"2023-10-08T07:05:34.359567+0000","last_fullsized":"2023-10-08T07:05:34.359567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320239+0000","last_change":"2023-10-08T07:05:33.323204+0000","last_active":"2023-10-08T07:05:34.320239+0000","last_peered":"2023-10-08T07:05:34.320239+0000","last_clean":"2023-10-08T07:05:34.320239+0000","last_became_active":"2023-10-08T07:05:33.322899+0000","last_became_peered":"2023-10-08T07:05:33.322899+0000","last_unstale":"2023-10-08T07:05:34.320239+0000","last_undegraded":"2023-10-08T07:05:34.320239+0000","last_fullsized":"2023-10-08T07:05:34.320239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319302+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:05:33.319302+0000","last_peered":"2023-10-08T07:05:33.319302+0000","last_clean":"2023-10-08T07:05:33.319302+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:05:33.319302+0000","last_undegraded":"2023-10-08T07:05:33.319302+0000","last_fullsized":"2023-10-08T07:05:33.319302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318604+0000","last_change":"2023-10-08T07:05:22.277737+0000","last_active":"2023-10-08T07:05:33.318604+0000","last_peered":"2023-10-08T07:05:33.318604+0000","last_clean":"2023-10-08T07:05:33.318604+0000","last_became_active":"2023-10-08T07:05:22.277417+0000","last_became_peered":"2023-10-08T07:05:22.277417+0000","last_unstale":"2023-10-08T07:05:33.318604+0000","last_undegraded":"2023-10-08T07:05:33.318604+0000","last_fullsized":"2023-10-08T07:05:33.318604+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:10.186804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318995+0000","last_change":"2023-10-08T07:05:32.316756+0000","last_active":"2023-10-08T07:05:34.318995+0000","last_peered":"2023-10-08T07:05:34.318995+0000","last_clean":"2023-10-08T07:05:34.318995+0000","last_became_active":"2023-10-08T07:05:32.316340+0000","last_became_peered":"2023-10-08T07:05:32.316340+0000","last_unstale":"2023-10-08T07:05:34.318995+0000","last_undegraded":"2023-10-08T07:05:34.318995+0000","last_fullsized":"2023-10-08T07:05:34.318995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:46:34.838960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320659+0000","last_change":"2023-10-08T07:05:33.318964+0000","last_active":"2023-10-08T07:05:34.320659+0000","last_peered":"2023-10-08T07:05:34.320659+0000","last_clean":"2023-10-08T07:05:34.320659+0000","last_became_active":"2023-10-08T07:05:33.317866+0000","last_became_peered":"2023-10-08T07:05:33.317866+0000","last_unstale":"2023-10-08T07:05:34.320659+0000","last_undegraded":"2023-10-08T07:05:34.320659+0000","last_fullsized":"2023-10-08T07:05:34.320659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:47.306558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319045+0000","last_change":"2023-10-08T07:05:27.295425+0000","last_active":"2023-10-08T07:05:33.319045+0000","last_peered":"2023-10-08T07:05:33.319045+0000","last_clean":"2023-10-08T07:05:33.319045+0000","last_became_active":"2023-10-08T07:05:27.295157+0000","last_became_peered":"2023-10-08T07:05:27.295157+0000","last_unstale":"2023-10-08T07:05:33.319045+0000","last_undegraded":"2023-10-08T07:05:33.319045+0000","last_fullsized":"2023-10-08T07:05:33.319045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:06.192882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318796+0000","last_change":"2023-10-08T07:05:32.317723+0000","last_active":"2023-10-08T07:05:34.318796+0000","last_peered":"2023-10-08T07:05:34.318796+0000","last_clean":"2023-10-08T07:05:34.318796+0000","last_became_active":"2023-10-08T07:05:32.317444+0000","last_became_peered":"2023-10-08T07:05:32.317444+0000","last_unstale":"2023-10-08T07:05:34.318796+0000","last_undegraded":"2023-10-08T07:05:34.318796+0000","last_fullsized":"2023-10-08T07:05:34.318796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:29.242830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360897+0000","last_change":"2023-10-08T07:05:33.321497+0000","last_active":"2023-10-08T07:05:34.360897+0000","last_peered":"2023-10-08T07:05:34.360897+0000","last_clean":"2023-10-08T07:05:34.360897+0000","last_became_active":"2023-10-08T07:05:33.319658+0000","last_became_peered":"2023-10-08T07:05:33.319658+0000","last_unstale":"2023-10-08T07:05:34.360897+0000","last_undegraded":"2023-10-08T07:05:34.360897+0000","last_fullsized":"2023-10-08T07:05:34.360897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.314076+0000","last_change":"2023-10-08T07:05:27.298597+0000","last_active":"2023-10-08T07:05:33.314076+0000","last_peered":"2023-10-08T07:05:33.314076+0000","last_clean":"2023-10-08T07:05:33.314076+0000","last_became_active":"2023-10-08T07:05:27.298355+0000","last_became_peered":"2023-10-08T07:05:27.298355+0000","last_unstale":"2023-10-08T07:05:33.314076+0000","last_undegraded":"2023-10-08T07:05:33.314076+0000","last_fullsized":"2023-10-08T07:05:33.314076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:06.241475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319456+0000","last_change":"2023-10-08T07:05:32.319605+0000","last_active":"2023-10-08T07:05:34.319456+0000","last_peered":"2023-10-08T07:05:34.319456+0000","last_clean":"2023-10-08T07:05:34.319456+0000","last_became_active":"2023-10-08T07:05:32.319244+0000","last_became_peered":"2023-10-08T07:05:32.319244+0000","last_unstale":"2023-10-08T07:05:34.319456+0000","last_undegraded":"2023-10-08T07:05:34.319456+0000","last_fullsized":"2023-10-08T07:05:34.319456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:25.991992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360213+0000","last_change":"2023-10-08T07:05:33.327112+0000","last_active":"2023-10-08T07:05:34.360213+0000","last_peered":"2023-10-08T07:05:34.360213+0000","last_clean":"2023-10-08T07:05:34.360213+0000","last_became_active":"2023-10-08T07:05:33.326816+0000","last_became_peered":"2023-10-08T07:05:33.326816+0000","last_unstale":"2023-10-08T07:05:34.360213+0000","last_undegraded":"2023-10-08T07:05:34.360213+0000","last_fullsized":"2023-10-08T07:05:34.360213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:32.319875+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:32.319385+0000","last_became_peered":"2023-10-08T07:05:32.319385+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309753+0000","last_change":"2023-10-08T07:05:27.295537+0000","last_active":"2023-10-08T07:05:33.309753+0000","last_peered":"2023-10-08T07:05:33.309753+0000","last_clean":"2023-10-08T07:05:33.309753+0000","last_became_active":"2023-10-08T07:05:27.295234+0000","last_became_peered":"2023-10-08T07:05:27.295234+0000","last_unstale":"2023-10-08T07:05:33.309753+0000","last_undegraded":"2023-10-08T07:05:33.309753+0000","last_fullsized":"2023-10-08T07:05:33.309753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:22.951187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318736+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:05:34.318736+0000","last_peered":"2023-10-08T07:05:34.318736+0000","last_clean":"2023-10-08T07:05:34.318736+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:05:34.318736+0000","last_undegraded":"2023-10-08T07:05:34.318736+0000","last_fullsized":"2023-10-08T07:05:34.318736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.325045+0000","last_change":"2023-10-08T07:05:27.295945+0000","last_active":"2023-10-08T07:05:33.325045+0000","last_peered":"2023-10-08T07:05:33.325045+0000","last_clean":"2023-10-08T07:05:33.325045+0000","last_became_active":"2023-10-08T07:05:27.295726+0000","last_became_peered":"2023-10-08T07:05:27.295726+0000","last_unstale":"2023-10-08T07:05:33.325045+0000","last_undegraded":"2023-10-08T07:05:33.325045+0000","last_fullsized":"2023-10-08T07:05:33.325045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:55.040889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.506403+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:05:34.506403+0000","last_peered":"2023-10-08T07:05:34.506403+0000","last_clean":"2023-10-08T07:05:34.506403+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:05:34.506403+0000","last_undegraded":"2023-10-08T07:05:34.506403+0000","last_fullsized":"2023-10-08T07:05:34.506403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359840+0000","last_change":"2023-10-08T07:05:33.326621+0000","last_active":"2023-10-08T07:05:34.359840+0000","last_peered":"2023-10-08T07:05:34.359840+0000","last_clean":"2023-10-08T07:05:34.359840+0000","last_became_active":"2023-10-08T07:05:33.326272+0000","last_became_peered":"2023-10-08T07:05:33.326272+0000","last_unstale":"2023-10-08T07:05:34.359840+0000","last_undegraded":"2023-10-08T07:05:34.359840+0000","last_fullsized":"2023-10-08T07:05:34.359840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:31.752188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359963+0000","last_change":"2023-10-08T07:05:32.323175+0000","last_active":"2023-10-08T07:05:34.359963+0000","last_peered":"2023-10-08T07:05:34.359963+0000","last_clean":"2023-10-08T07:05:34.359963+0000","last_became_active":"2023-10-08T07:05:32.322814+0000","last_became_peered":"2023-10-08T07:05:32.322814+0000","last_unstale":"2023-10-08T07:05:34.359963+0000","last_undegraded":"2023-10-08T07:05:34.359963+0000","last_fullsized":"2023-10-08T07:05:34.359963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360537+0000","last_change":"2023-10-08T07:05:33.318398+0000","last_active":"2023-10-08T07:05:34.360537+0000","last_peered":"2023-10-08T07:05:34.360537+0000","last_clean":"2023-10-08T07:05:34.360537+0000","last_became_active":"2023-10-08T07:05:33.317478+0000","last_became_peered":"2023-10-08T07:05:33.317478+0000","last_unstale":"2023-10-08T07:05:34.360537+0000","last_undegraded":"2023-10-08T07:05:34.360537+0000","last_fullsized":"2023-10-08T07:05:34.360537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320059+0000","last_change":"2023-10-08T07:05:32.320603+0000","last_active":"2023-10-08T07:05:34.320059+0000","last_peered":"2023-10-08T07:05:34.320059+0000","last_clean":"2023-10-08T07:05:34.320059+0000","last_became_active":"2023-10-08T07:05:32.320262+0000","last_became_peered":"2023-10-08T07:05:32.320262+0000","last_unstale":"2023-10-08T07:05:34.320059+0000","last_undegraded":"2023-10-08T07:05:34.320059+0000","last_fullsized":"2023-10-08T07:05:34.320059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:09.249029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319954+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:05:34.319954+0000","last_peered":"2023-10-08T07:05:34.319954+0000","last_clean":"2023-10-08T07:05:34.319954+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:05:34.319954+0000","last_undegraded":"2023-10-08T07:05:34.319954+0000","last_fullsized":"2023-10-08T07:05:34.319954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360795+0000","last_change":"2023-10-08T07:05:32.323143+0000","last_active":"2023-10-08T07:05:34.360795+0000","last_peered":"2023-10-08T07:05:34.360795+0000","last_clean":"2023-10-08T07:05:34.360795+0000","last_became_active":"2023-10-08T07:05:32.322789+0000","last_became_peered":"2023-10-08T07:05:32.322789+0000","last_unstale":"2023-10-08T07:05:34.360795+0000","last_undegraded":"2023-10-08T07:05:34.360795+0000","last_fullsized":"2023-10-08T07:05:34.360795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:03.978136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319826+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:05:34.319826+0000","last_peered":"2023-10-08T07:05:34.319826+0000","last_clean":"2023-10-08T07:05:34.319826+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:05:34.319826+0000","last_undegraded":"2023-10-08T07:05:34.319826+0000","last_fullsized":"2023-10-08T07:05:34.319826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319964+0000","last_change":"2023-10-08T07:05:32.319462+0000","last_active":"2023-10-08T07:05:34.319964+0000","last_peered":"2023-10-08T07:05:34.319964+0000","last_clean":"2023-10-08T07:05:34.319964+0000","last_became_active":"2023-10-08T07:05:32.318951+0000","last_became_peered":"2023-10-08T07:05:32.318951+0000","last_unstale":"2023-10-08T07:05:34.319964+0000","last_undegraded":"2023-10-08T07:05:34.319964+0000","last_fullsized":"2023-10-08T07:05:34.319964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360006+0000","last_change":"2023-10-08T07:05:33.319869+0000","last_active":"2023-10-08T07:05:34.360006+0000","last_peered":"2023-10-08T07:05:34.360006+0000","last_clean":"2023-10-08T07:05:34.360006+0000","last_became_active":"2023-10-08T07:05:33.318241+0000","last_became_peered":"2023-10-08T07:05:33.318241+0000","last_unstale":"2023-10-08T07:05:34.360006+0000","last_undegraded":"2023-10-08T07:05:34.360006+0000","last_fullsized":"2023-10-08T07:05:34.360006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320049+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:05:34.320049+0000","last_peered":"2023-10-08T07:05:34.320049+0000","last_clean":"2023-10-08T07:05:34.320049+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:05:34.320049+0000","last_undegraded":"2023-10-08T07:05:34.320049+0000","last_fullsized":"2023-10-08T07:05:34.320049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320180+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:05:34.320180+0000","last_peered":"2023-10-08T07:05:34.320180+0000","last_clean":"2023-10-08T07:05:34.320180+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:05:34.320180+0000","last_undegraded":"2023-10-08T07:05:34.320180+0000","last_fullsized":"2023-10-08T07:05:34.320180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319653+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:05:34.319653+0000","last_peered":"2023-10-08T07:05:34.319653+0000","last_clean":"2023-10-08T07:05:34.319653+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:05:34.319653+0000","last_undegraded":"2023-10-08T07:05:34.319653+0000","last_fullsized":"2023-10-08T07:05:34.319653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319038+0000","last_change":"2023-10-08T07:05:33.322006+0000","last_active":"2023-10-08T07:05:34.319038+0000","last_peered":"2023-10-08T07:05:34.319038+0000","last_clean":"2023-10-08T07:05:34.319038+0000","last_became_active":"2023-10-08T07:05:33.321639+0000","last_became_peered":"2023-10-08T07:05:33.321639+0000","last_unstale":"2023-10-08T07:05:34.319038+0000","last_undegraded":"2023-10-08T07:05:34.319038+0000","last_fullsized":"2023-10-08T07:05:34.319038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360201+0000","last_change":"2023-10-08T07:05:33.329906+0000","last_active":"2023-10-08T07:05:34.360201+0000","last_peered":"2023-10-08T07:05:34.360201+0000","last_clean":"2023-10-08T07:05:34.360201+0000","last_became_active":"2023-10-08T07:05:33.329615+0000","last_became_peered":"2023-10-08T07:05:33.329615+0000","last_unstale":"2023-10-08T07:05:34.360201+0000","last_undegraded":"2023-10-08T07:05:34.360201+0000","last_fullsized":"2023-10-08T07:05:34.360201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319571+0000","last_change":"2023-10-08T07:05:33.316573+0000","last_active":"2023-10-08T07:05:34.319571+0000","last_peered":"2023-10-08T07:05:34.319571+0000","last_clean":"2023-10-08T07:05:34.319571+0000","last_became_active":"2023-10-08T07:05:33.316193+0000","last_became_peered":"2023-10-08T07:05:33.316193+0000","last_unstale":"2023-10-08T07:05:34.319571+0000","last_undegraded":"2023-10-08T07:05:34.319571+0000","last_fullsized":"2023-10-08T07:05:34.319571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360585+0000","last_change":"2023-10-08T07:05:33.320077+0000","last_active":"2023-10-08T07:05:34.360585+0000","last_peered":"2023-10-08T07:05:34.360585+0000","last_clean":"2023-10-08T07:05:34.360585+0000","last_became_active":"2023-10-08T07:05:33.319392+0000","last_became_peered":"2023-10-08T07:05:33.319392+0000","last_unstale":"2023-10-08T07:05:34.360585+0000","last_undegraded":"2023-10-08T07:05:34.360585+0000","last_fullsized":"2023-10-08T07:05:34.360585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":650475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":649859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:05:51.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:05:52.059 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:52.062 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:05:52.067 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-08T07:05:50.506017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91108,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024412,"statfs":{"total":289910292480,"available":289816997888,"internally_reserved":0,"allocated":1744896,"data_stored":1358647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":91483475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002616"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361123+0000","last_change":"2023-10-08T07:05:33.319747+0000","last_active":"2023-10-08T07:05:34.361123+0000","last_peered":"2023-10-08T07:05:34.361123+0000","last_clean":"2023-10-08T07:05:34.361123+0000","last_became_active":"2023-10-08T07:05:33.318115+0000","last_became_peered":"2023-10-08T07:05:33.318115+0000","last_unstale":"2023-10-08T07:05:34.361123+0000","last_undegraded":"2023-10-08T07:05:34.361123+0000","last_fullsized":"2023-10-08T07:05:34.361123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360608+0000","last_change":"2023-10-08T07:05:33.322480+0000","last_active":"2023-10-08T07:05:34.360608+0000","last_peered":"2023-10-08T07:05:34.360608+0000","last_clean":"2023-10-08T07:05:34.360608+0000","last_became_active":"2023-10-08T07:05:33.322153+0000","last_became_peered":"2023-10-08T07:05:33.322153+0000","last_unstale":"2023-10-08T07:05:34.360608+0000","last_undegraded":"2023-10-08T07:05:34.360608+0000","last_fullsized":"2023-10-08T07:05:34.360608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:33.325067+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:33.323439+0000","last_became_peered":"2023-10-08T07:05:33.323439+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:18.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320530+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:05:34.320530+0000","last_peered":"2023-10-08T07:05:34.320530+0000","last_clean":"2023-10-08T07:05:34.320530+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:05:34.320530+0000","last_undegraded":"2023-10-08T07:05:34.320530+0000","last_fullsized":"2023-10-08T07:05:34.320530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360128+0000","last_change":"2023-10-08T07:05:33.321314+0000","last_active":"2023-10-08T07:05:34.360128+0000","last_peered":"2023-10-08T07:05:34.360128+0000","last_clean":"2023-10-08T07:05:34.360128+0000","last_became_active":"2023-10-08T07:05:33.320841+0000","last_became_peered":"2023-10-08T07:05:33.320841+0000","last_unstale":"2023-10-08T07:05:34.360128+0000","last_undegraded":"2023-10-08T07:05:34.360128+0000","last_fullsized":"2023-10-08T07:05:34.360128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319725+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:05:34.319725+0000","last_peered":"2023-10-08T07:05:34.319725+0000","last_clean":"2023-10-08T07:05:34.319725+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:05:34.319725+0000","last_undegraded":"2023-10-08T07:05:34.319725+0000","last_fullsized":"2023-10-08T07:05:34.319725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319443+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:05:34.319443+0000","last_peered":"2023-10-08T07:05:34.319443+0000","last_clean":"2023-10-08T07:05:34.319443+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:05:34.319443+0000","last_undegraded":"2023-10-08T07:05:34.319443+0000","last_fullsized":"2023-10-08T07:05:34.319443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319238+0000","last_change":"2023-10-08T07:05:33.327740+0000","last_active":"2023-10-08T07:05:34.319238+0000","last_peered":"2023-10-08T07:05:34.319238+0000","last_clean":"2023-10-08T07:05:34.319238+0000","last_became_active":"2023-10-08T07:05:33.325912+0000","last_became_peered":"2023-10-08T07:05:33.325912+0000","last_unstale":"2023-10-08T07:05:34.319238+0000","last_undegraded":"2023-10-08T07:05:34.319238+0000","last_fullsized":"2023-10-08T07:05:34.319238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319837+0000","last_change":"2023-10-08T07:05:33.322628+0000","last_active":"2023-10-08T07:05:34.319837+0000","last_peered":"2023-10-08T07:05:34.319837+0000","last_clean":"2023-10-08T07:05:34.319837+0000","last_became_active":"2023-10-08T07:05:33.321816+0000","last_became_peered":"2023-10-08T07:05:33.321816+0000","last_unstale":"2023-10-08T07:05:34.319837+0000","last_undegraded":"2023-10-08T07:05:34.319837+0000","last_fullsized":"2023-10-08T07:05:34.319837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360894+0000","last_change":"2023-10-08T07:05:33.322098+0000","last_active":"2023-10-08T07:05:34.360894+0000","last_peered":"2023-10-08T07:05:34.360894+0000","last_clean":"2023-10-08T07:05:34.360894+0000","last_became_active":"2023-10-08T07:05:33.321208+0000","last_became_peered":"2023-10-08T07:05:33.321208+0000","last_unstale":"2023-10-08T07:05:34.360894+0000","last_undegraded":"2023-10-08T07:05:34.360894+0000","last_fullsized":"2023-10-08T07:05:34.360894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320139+0000","last_change":"2023-10-08T07:05:33.328140+0000","last_active":"2023-10-08T07:05:34.320139+0000","last_peered":"2023-10-08T07:05:34.320139+0000","last_clean":"2023-10-08T07:05:34.320139+0000","last_became_active":"2023-10-08T07:05:33.327595+0000","last_became_peered":"2023-10-08T07:05:33.327595+0000","last_unstale":"2023-10-08T07:05:34.320139+0000","last_undegraded":"2023-10-08T07:05:34.320139+0000","last_fullsized":"2023-10-08T07:05:34.320139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360113+0000","last_change":"2023-10-08T07:05:33.329834+0000","last_active":"2023-10-08T07:05:34.360113+0000","last_peered":"2023-10-08T07:05:34.360113+0000","last_clean":"2023-10-08T07:05:34.360113+0000","last_became_active":"2023-10-08T07:05:33.329357+0000","last_became_peered":"2023-10-08T07:05:33.329357+0000","last_unstale":"2023-10-08T07:05:34.360113+0000","last_undegraded":"2023-10-08T07:05:34.360113+0000","last_fullsized":"2023-10-08T07:05:34.360113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360010+0000","last_change":"2023-10-08T07:05:33.319643+0000","last_active":"2023-10-08T07:05:34.360010+0000","last_peered":"2023-10-08T07:05:34.360010+0000","last_clean":"2023-10-08T07:05:34.360010+0000","last_became_active":"2023-10-08T07:05:33.318659+0000","last_became_peered":"2023-10-08T07:05:33.318659+0000","last_unstale":"2023-10-08T07:05:34.360010+0000","last_undegraded":"2023-10-08T07:05:34.360010+0000","last_fullsized":"2023-10-08T07:05:34.360010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320295+0000","last_change":"2023-10-08T07:05:33.318491+0000","last_active":"2023-10-08T07:05:34.320295+0000","last_peered":"2023-10-08T07:05:34.320295+0000","last_clean":"2023-10-08T07:05:34.320295+0000","last_became_active":"2023-10-08T07:05:33.317703+0000","last_became_peered":"2023-10-08T07:05:33.317703+0000","last_unstale":"2023-10-08T07:05:34.320295+0000","last_undegraded":"2023-10-08T07:05:34.320295+0000","last_fullsized":"2023-10-08T07:05:34.320295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.319294+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.318364+0000","last_became_peered":"2023-10-08T07:05:33.318364+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319517+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:05:34.319517+0000","last_peered":"2023-10-08T07:05:34.319517+0000","last_clean":"2023-10-08T07:05:34.319517+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:05:34.319517+0000","last_undegraded":"2023-10-08T07:05:34.319517+0000","last_fullsized":"2023-10-08T07:05:34.319517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319930+0000","last_change":"2023-10-08T07:05:33.317287+0000","last_active":"2023-10-08T07:05:34.319930+0000","last_peered":"2023-10-08T07:05:34.319930+0000","last_clean":"2023-10-08T07:05:34.319930+0000","last_became_active":"2023-10-08T07:05:33.316483+0000","last_became_peered":"2023-10-08T07:05:33.316483+0000","last_unstale":"2023-10-08T07:05:34.319930+0000","last_undegraded":"2023-10-08T07:05:34.319930+0000","last_fullsized":"2023-10-08T07:05:34.319930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361063+0000","last_change":"2023-10-08T07:05:33.321088+0000","last_active":"2023-10-08T07:05:34.361063+0000","last_peered":"2023-10-08T07:05:34.361063+0000","last_clean":"2023-10-08T07:05:34.361063+0000","last_became_active":"2023-10-08T07:05:33.319541+0000","last_became_peered":"2023-10-08T07:05:33.319541+0000","last_unstale":"2023-10-08T07:05:34.361063+0000","last_undegraded":"2023-10-08T07:05:34.361063+0000","last_fullsized":"2023-10-08T07:05:34.361063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319536+0000","last_change":"2023-10-08T07:05:33.322110+0000","last_active":"2023-10-08T07:05:34.319536+0000","last_peered":"2023-10-08T07:05:34.319536+0000","last_clean":"2023-10-08T07:05:34.319536+0000","last_became_active":"2023-10-08T07:05:33.321780+0000","last_became_peered":"2023-10-08T07:05:33.321780+0000","last_unstale":"2023-10-08T07:05:34.319536+0000","last_undegraded":"2023-10-08T07:05:34.319536+0000","last_fullsized":"2023-10-08T07:05:34.319536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320412+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:05:34.320412+0000","last_peered":"2023-10-08T07:05:34.320412+0000","last_clean":"2023-10-08T07:05:34.320412+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:05:34.320412+0000","last_undegraded":"2023-10-08T07:05:34.320412+0000","last_fullsized":"2023-10-08T07:05:34.320412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319754+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:05:34.319754+0000","last_peered":"2023-10-08T07:05:34.319754+0000","last_clean":"2023-10-08T07:05:34.319754+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:05:34.319754+0000","last_undegraded":"2023-10-08T07:05:34.319754+0000","last_fullsized":"2023-10-08T07:05:34.319754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360008+0000","last_change":"2023-10-08T07:05:33.326970+0000","last_active":"2023-10-08T07:05:34.360008+0000","last_peered":"2023-10-08T07:05:34.360008+0000","last_clean":"2023-10-08T07:05:34.360008+0000","last_became_active":"2023-10-08T07:05:33.326650+0000","last_became_peered":"2023-10-08T07:05:33.326650+0000","last_unstale":"2023-10-08T07:05:34.360008+0000","last_undegraded":"2023-10-08T07:05:34.360008+0000","last_fullsized":"2023-10-08T07:05:34.360008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319095+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:05:34.319095+0000","last_peered":"2023-10-08T07:05:34.319095+0000","last_clean":"2023-10-08T07:05:34.319095+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:05:34.319095+0000","last_undegraded":"2023-10-08T07:05:34.319095+0000","last_fullsized":"2023-10-08T07:05:34.319095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360261+0000","last_change":"2023-10-08T07:05:33.319759+0000","last_active":"2023-10-08T07:05:34.360261+0000","last_peered":"2023-10-08T07:05:34.360261+0000","last_clean":"2023-10-08T07:05:34.360261+0000","last_became_active":"2023-10-08T07:05:33.318507+0000","last_became_peered":"2023-10-08T07:05:33.318507+0000","last_unstale":"2023-10-08T07:05:34.360261+0000","last_undegraded":"2023-10-08T07:05:34.360261+0000","last_fullsized":"2023-10-08T07:05:34.360261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361101+0000","last_change":"2023-10-08T07:05:33.317560+0000","last_active":"2023-10-08T07:05:34.361101+0000","last_peered":"2023-10-08T07:05:34.361101+0000","last_clean":"2023-10-08T07:05:34.361101+0000","last_became_active":"2023-10-08T07:05:33.316906+0000","last_became_peered":"2023-10-08T07:05:33.316906+0000","last_unstale":"2023-10-08T07:05:34.361101+0000","last_undegraded":"2023-10-08T07:05:34.361101+0000","last_fullsized":"2023-10-08T07:05:34.361101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320043+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:05:34.320043+0000","last_peered":"2023-10-08T07:05:34.320043+0000","last_clean":"2023-10-08T07:05:34.320043+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:05:34.320043+0000","last_undegraded":"2023-10-08T07:05:34.320043+0000","last_fullsized":"2023-10-08T07:05:34.320043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320344+0000","last_change":"2023-10-08T07:05:33.326267+0000","last_active":"2023-10-08T07:05:34.320344+0000","last_peered":"2023-10-08T07:05:34.320344+0000","last_clean":"2023-10-08T07:05:34.320344+0000","last_became_active":"2023-10-08T07:05:33.324579+0000","last_became_peered":"2023-10-08T07:05:33.324579+0000","last_unstale":"2023-10-08T07:05:34.320344+0000","last_undegraded":"2023-10-08T07:05:34.320344+0000","last_fullsized":"2023-10-08T07:05:34.320344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359920+0000","last_change":"2023-10-08T07:05:32.320295+0000","last_active":"2023-10-08T07:05:34.359920+0000","last_peered":"2023-10-08T07:05:34.359920+0000","last_clean":"2023-10-08T07:05:34.359920+0000","last_became_active":"2023-10-08T07:05:32.320044+0000","last_became_peered":"2023-10-08T07:05:32.320044+0000","last_unstale":"2023-10-08T07:05:34.359920+0000","last_undegraded":"2023-10-08T07:05:34.359920+0000","last_fullsized":"2023-10-08T07:05:34.359920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:44.690611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360949+0000","last_change":"2023-10-08T07:05:33.329921+0000","last_active":"2023-10-08T07:05:34.360949+0000","last_peered":"2023-10-08T07:05:34.360949+0000","last_clean":"2023-10-08T07:05:34.360949+0000","last_became_active":"2023-10-08T07:05:33.329346+0000","last_became_peered":"2023-10-08T07:05:33.329346+0000","last_unstale":"2023-10-08T07:05:34.360949+0000","last_undegraded":"2023-10-08T07:05:34.360949+0000","last_fullsized":"2023-10-08T07:05:34.360949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319260+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:05:34.319260+0000","last_peered":"2023-10-08T07:05:34.319260+0000","last_clean":"2023-10-08T07:05:34.319260+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:05:34.319260+0000","last_undegraded":"2023-10-08T07:05:34.319260+0000","last_fullsized":"2023-10-08T07:05:34.319260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319829+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:05:34.319829+0000","last_peered":"2023-10-08T07:05:34.319829+0000","last_clean":"2023-10-08T07:05:34.319829+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:05:34.319829+0000","last_undegraded":"2023-10-08T07:05:34.319829+0000","last_fullsized":"2023-10-08T07:05:34.319829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319123+0000","last_change":"2023-10-08T07:05:32.315935+0000","last_active":"2023-10-08T07:05:34.319123+0000","last_peered":"2023-10-08T07:05:34.319123+0000","last_clean":"2023-10-08T07:05:34.319123+0000","last_became_active":"2023-10-08T07:05:32.315661+0000","last_became_peered":"2023-10-08T07:05:32.315661+0000","last_unstale":"2023-10-08T07:05:34.319123+0000","last_undegraded":"2023-10-08T07:05:34.319123+0000","last_fullsized":"2023-10-08T07:05:34.319123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:01:05.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361026+0000","last_change":"2023-10-08T07:05:33.330068+0000","last_active":"2023-10-08T07:05:34.361026+0000","last_peered":"2023-10-08T07:05:34.361026+0000","last_clean":"2023-10-08T07:05:34.361026+0000","last_became_active":"2023-10-08T07:05:33.329169+0000","last_became_peered":"2023-10-08T07:05:33.329169+0000","last_unstale":"2023-10-08T07:05:34.361026+0000","last_undegraded":"2023-10-08T07:05:34.361026+0000","last_fullsized":"2023-10-08T07:05:34.361026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:05:34.320135+0000","last_peered":"2023-10-08T07:05:34.320135+0000","last_clean":"2023-10-08T07:05:34.320135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:05:34.320135+0000","last_undegraded":"2023-10-08T07:05:34.320135+0000","last_fullsized":"2023-10-08T07:05:34.320135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318813+0000","last_change":"2023-10-08T07:05:33.316496+0000","last_active":"2023-10-08T07:05:34.318813+0000","last_peered":"2023-10-08T07:05:34.318813+0000","last_clean":"2023-10-08T07:05:34.318813+0000","last_became_active":"2023-10-08T07:05:33.316084+0000","last_became_peered":"2023-10-08T07:05:33.316084+0000","last_unstale":"2023-10-08T07:05:34.318813+0000","last_undegraded":"2023-10-08T07:05:34.318813+0000","last_fullsized":"2023-10-08T07:05:34.318813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320455+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:05:34.320455+0000","last_peered":"2023-10-08T07:05:34.320455+0000","last_clean":"2023-10-08T07:05:34.320455+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:05:34.320455+0000","last_undegraded":"2023-10-08T07:05:34.320455+0000","last_fullsized":"2023-10-08T07:05:34.320455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319317+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:05:34.319317+0000","last_peered":"2023-10-08T07:05:34.319317+0000","last_clean":"2023-10-08T07:05:34.319317+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:05:34.319317+0000","last_undegraded":"2023-10-08T07:05:34.319317+0000","last_fullsized":"2023-10-08T07:05:34.319317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360636+0000","last_change":"2023-10-08T07:05:32.323201+0000","last_active":"2023-10-08T07:05:34.360636+0000","last_peered":"2023-10-08T07:05:34.360636+0000","last_clean":"2023-10-08T07:05:34.360636+0000","last_became_active":"2023-10-08T07:05:32.322864+0000","last_became_peered":"2023-10-08T07:05:32.322864+0000","last_unstale":"2023-10-08T07:05:34.360636+0000","last_undegraded":"2023-10-08T07:05:34.360636+0000","last_fullsized":"2023-10-08T07:05:34.360636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:40.093124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319535+0000","last_change":"2023-10-08T07:05:33.317114+0000","last_active":"2023-10-08T07:05:34.319535+0000","last_peered":"2023-10-08T07:05:34.319535+0000","last_clean":"2023-10-08T07:05:34.319535+0000","last_became_active":"2023-10-08T07:05:33.316390+0000","last_became_peered":"2023-10-08T07:05:33.316390+0000","last_unstale":"2023-10-08T07:05:34.319535+0000","last_undegraded":"2023-10-08T07:05:34.319535+0000","last_fullsized":"2023-10-08T07:05:34.319535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320136+0000","last_change":"2023-10-08T07:05:32.319510+0000","last_active":"2023-10-08T07:05:34.320136+0000","last_peered":"2023-10-08T07:05:34.320136+0000","last_clean":"2023-10-08T07:05:34.320136+0000","last_became_active":"2023-10-08T07:05:32.319209+0000","last_became_peered":"2023-10-08T07:05:32.319209+0000","last_unstale":"2023-10-08T07:05:34.320136+0000","last_undegraded":"2023-10-08T07:05:34.320136+0000","last_fullsized":"2023-10-08T07:05:34.320136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:28.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320332+0000","last_change":"2023-10-08T07:05:33.317137+0000","last_active":"2023-10-08T07:05:34.320332+0000","last_peered":"2023-10-08T07:05:34.320332+0000","last_clean":"2023-10-08T07:05:34.320332+0000","last_became_active":"2023-10-08T07:05:33.316562+0000","last_became_peered":"2023-10-08T07:05:33.316562+0000","last_unstale":"2023-10-08T07:05:34.320332+0000","last_undegraded":"2023-10-08T07:05:34.320332+0000","last_fullsized":"2023-10-08T07:05:34.320332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:41.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320369+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:05:34.320369+0000","last_peered":"2023-10-08T07:05:34.320369+0000","last_clean":"2023-10-08T07:05:34.320369+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:05:34.320369+0000","last_undegraded":"2023-10-08T07:05:34.320369+0000","last_fullsized":"2023-10-08T07:05:34.320369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360395+0000","last_change":"2023-10-08T07:05:33.322201+0000","last_active":"2023-10-08T07:05:34.360395+0000","last_peered":"2023-10-08T07:05:34.360395+0000","last_clean":"2023-10-08T07:05:34.360395+0000","last_became_active":"2023-10-08T07:05:33.321826+0000","last_became_peered":"2023-10-08T07:05:33.321826+0000","last_unstale":"2023-10-08T07:05:34.360395+0000","last_undegraded":"2023-10-08T07:05:34.360395+0000","last_fullsized":"2023-10-08T07:05:34.360395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319178+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:05:34.319178+0000","last_peered":"2023-10-08T07:05:34.319178+0000","last_clean":"2023-10-08T07:05:34.319178+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:05:34.319178+0000","last_undegraded":"2023-10-08T07:05:34.319178+0000","last_fullsized":"2023-10-08T07:05:34.319178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360947+0000","last_change":"2023-10-08T07:05:33.317545+0000","last_active":"2023-10-08T07:05:34.360947+0000","last_peered":"2023-10-08T07:05:34.360947+0000","last_clean":"2023-10-08T07:05:34.360947+0000","last_became_active":"2023-10-08T07:05:33.317134+0000","last_became_peered":"2023-10-08T07:05:33.317134+0000","last_unstale":"2023-10-08T07:05:34.360947+0000","last_undegraded":"2023-10-08T07:05:34.360947+0000","last_fullsized":"2023-10-08T07:05:34.360947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359736+0000","last_change":"2023-10-08T07:05:32.323406+0000","last_active":"2023-10-08T07:05:34.359736+0000","last_peered":"2023-10-08T07:05:34.359736+0000","last_clean":"2023-10-08T07:05:34.359736+0000","last_became_active":"2023-10-08T07:05:32.323040+0000","last_became_peered":"2023-10-08T07:05:32.323040+0000","last_unstale":"2023-10-08T07:05:34.359736+0000","last_undegraded":"2023-10-08T07:05:34.359736+0000","last_fullsized":"2023-10-08T07:05:34.359736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319639+0000","last_change":"2023-10-08T07:05:32.319220+0000","last_active":"2023-10-08T07:05:34.319639+0000","last_peered":"2023-10-08T07:05:34.319639+0000","last_clean":"2023-10-08T07:05:34.319639+0000","last_became_active":"2023-10-08T07:05:32.318838+0000","last_became_peered":"2023-10-08T07:05:32.318838+0000","last_unstale":"2023-10-08T07:05:34.319639+0000","last_undegraded":"2023-10-08T07:05:34.319639+0000","last_fullsized":"2023-10-08T07:05:34.319639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:32:59.940325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320271+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:05:34.320271+0000","last_peered":"2023-10-08T07:05:34.320271+0000","last_clean":"2023-10-08T07:05:34.320271+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:05:34.320271+0000","last_undegraded":"2023-10-08T07:05:34.320271+0000","last_fullsized":"2023-10-08T07:05:34.320271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320776+0000","last_change":"2023-10-08T07:05:32.319446+0000","last_active":"2023-10-08T07:05:34.320776+0000","last_peered":"2023-10-08T07:05:34.320776+0000","last_clean":"2023-10-08T07:05:34.320776+0000","last_became_active":"2023-10-08T07:05:32.319019+0000","last_became_peered":"2023-10-08T07:05:32.319019+0000","last_unstale":"2023-10-08T07:05:34.320776+0000","last_undegraded":"2023-10-08T07:05:34.320776+0000","last_fullsized":"2023-10-08T07:05:34.320776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:56.843162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359487+0000","last_change":"2023-10-08T07:05:33.330217+0000","last_active":"2023-10-08T07:05:34.359487+0000","last_peered":"2023-10-08T07:05:34.359487+0000","last_clean":"2023-10-08T07:05:34.359487+0000","last_became_active":"2023-10-08T07:05:33.329639+0000","last_became_peered":"2023-10-08T07:05:33.329639+0000","last_unstale":"2023-10-08T07:05:34.359487+0000","last_undegraded":"2023-10-08T07:05:34.359487+0000","last_fullsized":"2023-10-08T07:05:34.359487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:21.715645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360604+0000","last_change":"2023-10-08T07:05:32.323481+0000","last_active":"2023-10-08T07:05:34.360604+0000","last_peered":"2023-10-08T07:05:34.360604+0000","last_clean":"2023-10-08T07:05:34.360604+0000","last_became_active":"2023-10-08T07:05:32.323243+0000","last_became_peered":"2023-10-08T07:05:32.323243+0000","last_unstale":"2023-10-08T07:05:34.360604+0000","last_undegraded":"2023-10-08T07:05:34.360604+0000","last_fullsized":"2023-10-08T07:05:34.360604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359906+0000","last_change":"2023-10-08T07:05:33.318539+0000","last_active":"2023-10-08T07:05:34.359906+0000","last_peered":"2023-10-08T07:05:34.359906+0000","last_clean":"2023-10-08T07:05:34.359906+0000","last_became_active":"2023-10-08T07:05:33.317371+0000","last_became_peered":"2023-10-08T07:05:33.317371+0000","last_unstale":"2023-10-08T07:05:34.359906+0000","last_undegraded":"2023-10-08T07:05:34.359906+0000","last_fullsized":"2023-10-08T07:05:34.359906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:00.945202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320279+0000","last_change":"2023-10-08T07:05:32.321744+0000","last_active":"2023-10-08T07:05:34.320279+0000","last_peered":"2023-10-08T07:05:34.320279+0000","last_clean":"2023-10-08T07:05:34.320279+0000","last_became_active":"2023-10-08T07:05:32.321482+0000","last_became_peered":"2023-10-08T07:05:32.321482+0000","last_unstale":"2023-10-08T07:05:34.320279+0000","last_undegraded":"2023-10-08T07:05:34.320279+0000","last_fullsized":"2023-10-08T07:05:34.320279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:13.789778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320018+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:05:34.320018+0000","last_peered":"2023-10-08T07:05:34.320018+0000","last_clean":"2023-10-08T07:05:34.320018+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:05:34.320018+0000","last_undegraded":"2023-10-08T07:05:34.320018+0000","last_fullsized":"2023-10-08T07:05:34.320018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319626+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:05:34.319626+0000","last_peered":"2023-10-08T07:05:34.319626+0000","last_clean":"2023-10-08T07:05:34.319626+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:05:34.319626+0000","last_undegraded":"2023-10-08T07:05:34.319626+0000","last_fullsized":"2023-10-08T07:05:34.319626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319559+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:05:34.319559+0000","last_peered":"2023-10-08T07:05:34.319559+0000","last_clean":"2023-10-08T07:05:34.319559+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:05:34.319559+0000","last_undegraded":"2023-10-08T07:05:34.319559+0000","last_fullsized":"2023-10-08T07:05:34.319559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319350+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:05:34.319350+0000","last_peered":"2023-10-08T07:05:34.319350+0000","last_clean":"2023-10-08T07:05:34.319350+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:05:34.319350+0000","last_undegraded":"2023-10-08T07:05:34.319350+0000","last_fullsized":"2023-10-08T07:05:34.319350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319602+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:05:34.319602+0000","last_peered":"2023-10-08T07:05:34.319602+0000","last_clean":"2023-10-08T07:05:34.319602+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:05:34.319602+0000","last_undegraded":"2023-10-08T07:05:34.319602+0000","last_fullsized":"2023-10-08T07:05:34.319602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320680+0000","last_change":"2023-10-08T07:05:33.319933+0000","last_active":"2023-10-08T07:05:34.320680+0000","last_peered":"2023-10-08T07:05:34.320680+0000","last_clean":"2023-10-08T07:05:34.320680+0000","last_became_active":"2023-10-08T07:05:33.317937+0000","last_became_peered":"2023-10-08T07:05:33.317937+0000","last_unstale":"2023-10-08T07:05:34.320680+0000","last_undegraded":"2023-10-08T07:05:34.320680+0000","last_fullsized":"2023-10-08T07:05:34.320680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:57:42.074994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359555+0000","last_change":"2023-10-08T07:05:32.323415+0000","last_active":"2023-10-08T07:05:34.359555+0000","last_peered":"2023-10-08T07:05:34.359555+0000","last_clean":"2023-10-08T07:05:34.359555+0000","last_became_active":"2023-10-08T07:05:32.322910+0000","last_became_peered":"2023-10-08T07:05:32.322910+0000","last_unstale":"2023-10-08T07:05:34.359555+0000","last_undegraded":"2023-10-08T07:05:34.359555+0000","last_fullsized":"2023-10-08T07:05:34.359555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320553+0000","last_change":"2023-10-08T07:05:33.325994+0000","last_active":"2023-10-08T07:05:34.320553+0000","last_peered":"2023-10-08T07:05:34.320553+0000","last_clean":"2023-10-08T07:05:34.320553+0000","last_became_active":"2023-10-08T07:05:33.324865+0000","last_became_peered":"2023-10-08T07:05:33.324865+0000","last_unstale":"2023-10-08T07:05:34.320553+0000","last_undegraded":"2023-10-08T07:05:34.320553+0000","last_fullsized":"2023-10-08T07:05:34.320553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:14.142601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359677+0000","last_change":"2023-10-08T07:05:32.320359+0000","last_active":"2023-10-08T07:05:34.359677+0000","last_peered":"2023-10-08T07:05:34.359677+0000","last_clean":"2023-10-08T07:05:34.359677+0000","last_became_active":"2023-10-08T07:05:32.320137+0000","last_became_peered":"2023-10-08T07:05:32.320137+0000","last_unstale":"2023-10-08T07:05:34.359677+0000","last_undegraded":"2023-10-08T07:05:34.359677+0000","last_fullsized":"2023-10-08T07:05:34.359677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:32.366341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320091+0000","last_change":"2023-10-08T07:05:33.322861+0000","last_active":"2023-10-08T07:05:34.320091+0000","last_peered":"2023-10-08T07:05:34.320091+0000","last_clean":"2023-10-08T07:05:34.320091+0000","last_became_active":"2023-10-08T07:05:33.322450+0000","last_became_peered":"2023-10-08T07:05:33.322450+0000","last_unstale":"2023-10-08T07:05:34.320091+0000","last_undegraded":"2023-10-08T07:05:34.320091+0000","last_fullsized":"2023-10-08T07:05:34.320091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309081+0000","last_change":"2023-10-08T07:05:27.295597+0000","last_active":"2023-10-08T07:05:33.309081+0000","last_peered":"2023-10-08T07:05:33.309081+0000","last_clean":"2023-10-08T07:05:33.309081+0000","last_became_active":"2023-10-08T07:05:27.295265+0000","last_became_peered":"2023-10-08T07:05:27.295265+0000","last_unstale":"2023-10-08T07:05:33.309081+0000","last_undegraded":"2023-10-08T07:05:33.309081+0000","last_fullsized":"2023-10-08T07:05:33.309081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:50.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360046+0000","last_change":"2023-10-08T07:05:33.326797+0000","last_active":"2023-10-08T07:05:34.360046+0000","last_peered":"2023-10-08T07:05:34.360046+0000","last_clean":"2023-10-08T07:05:34.360046+0000","last_became_active":"2023-10-08T07:05:33.326518+0000","last_became_peered":"2023-10-08T07:05:33.326518+0000","last_unstale":"2023-10-08T07:05:34.360046+0000","last_undegraded":"2023-10-08T07:05:34.360046+0000","last_fullsized":"2023-10-08T07:05:34.360046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318961+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:05:33.318961+0000","last_peered":"2023-10-08T07:05:33.318961+0000","last_clean":"2023-10-08T07:05:33.318961+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:05:33.318961+0000","last_undegraded":"2023-10-08T07:05:33.318961+0000","last_fullsized":"2023-10-08T07:05:33.318961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320087+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:05:34.320087+0000","last_peered":"2023-10-08T07:05:34.320087+0000","last_clean":"2023-10-08T07:05:34.320087+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:05:34.320087+0000","last_undegraded":"2023-10-08T07:05:34.320087+0000","last_fullsized":"2023-10-08T07:05:34.320087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319579+0000","last_change":"2023-10-08T07:05:33.322164+0000","last_active":"2023-10-08T07:05:34.319579+0000","last_peered":"2023-10-08T07:05:34.319579+0000","last_clean":"2023-10-08T07:05:34.319579+0000","last_became_active":"2023-10-08T07:05:33.321757+0000","last_became_peered":"2023-10-08T07:05:33.321757+0000","last_unstale":"2023-10-08T07:05:34.319579+0000","last_undegraded":"2023-10-08T07:05:34.319579+0000","last_fullsized":"2023-10-08T07:05:34.319579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.308287+0000","last_change":"2023-10-08T07:05:27.295991+0000","last_active":"2023-10-08T07:05:33.308287+0000","last_peered":"2023-10-08T07:05:33.308287+0000","last_clean":"2023-10-08T07:05:33.308287+0000","last_became_active":"2023-10-08T07:05:27.295727+0000","last_became_peered":"2023-10-08T07:05:27.295727+0000","last_unstale":"2023-10-08T07:05:33.308287+0000","last_undegraded":"2023-10-08T07:05:33.308287+0000","last_fullsized":"2023-10-08T07:05:33.308287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:54.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359567+0000","last_change":"2023-10-08T07:05:32.323161+0000","last_active":"2023-10-08T07:05:34.359567+0000","last_peered":"2023-10-08T07:05:34.359567+0000","last_clean":"2023-10-08T07:05:34.359567+0000","last_became_active":"2023-10-08T07:05:32.322832+0000","last_became_peered":"2023-10-08T07:05:32.322832+0000","last_unstale":"2023-10-08T07:05:34.359567+0000","last_undegraded":"2023-10-08T07:05:34.359567+0000","last_fullsized":"2023-10-08T07:05:34.359567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320239+0000","last_change":"2023-10-08T07:05:33.323204+0000","last_active":"2023-10-08T07:05:34.320239+0000","last_peered":"2023-10-08T07:05:34.320239+0000","last_clean":"2023-10-08T07:05:34.320239+0000","last_became_active":"2023-10-08T07:05:33.322899+0000","last_became_peered":"2023-10-08T07:05:33.322899+0000","last_unstale":"2023-10-08T07:05:34.320239+0000","last_undegraded":"2023-10-08T07:05:34.320239+0000","last_fullsized":"2023-10-08T07:05:34.320239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319302+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:05:33.319302+0000","last_peered":"2023-10-08T07:05:33.319302+0000","last_clean":"2023-10-08T07:05:33.319302+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:05:33.319302+0000","last_undegraded":"2023-10-08T07:05:33.319302+0000","last_fullsized":"2023-10-08T07:05:33.319302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318604+0000","last_change":"2023-10-08T07:05:22.277737+0000","last_active":"2023-10-08T07:05:33.318604+0000","last_peered":"2023-10-08T07:05:33.318604+0000","last_clean":"2023-10-08T07:05:33.318604+0000","last_became_active":"2023-10-08T07:05:22.277417+0000","last_became_peered":"2023-10-08T07:05:22.277417+0000","last_unstale":"2023-10-08T07:05:33.318604+0000","last_undegraded":"2023-10-08T07:05:33.318604+0000","last_fullsized":"2023-10-08T07:05:33.318604+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:10.186804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318995+0000","last_change":"2023-10-08T07:05:32.316756+0000","last_active":"2023-10-08T07:05:34.318995+0000","last_peered":"2023-10-08T07:05:34.318995+0000","last_clean":"2023-10-08T07:05:34.318995+0000","last_became_active":"2023-10-08T07:05:32.316340+0000","last_became_peered":"2023-10-08T07:05:32.316340+0000","last_unstale":"2023-10-08T07:05:34.318995+0000","last_undegraded":"2023-10-08T07:05:34.318995+0000","last_fullsized":"2023-10-08T07:05:34.318995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:46:34.838960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320659+0000","last_change":"2023-10-08T07:05:33.318964+0000","last_active":"2023-10-08T07:05:34.320659+0000","last_peered":"2023-10-08T07:05:34.320659+0000","last_clean":"2023-10-08T07:05:34.320659+0000","last_became_active":"2023-10-08T07:05:33.317866+0000","last_became_peered":"2023-10-08T07:05:33.317866+0000","last_unstale":"2023-10-08T07:05:34.320659+0000","last_undegraded":"2023-10-08T07:05:34.320659+0000","last_fullsized":"2023-10-08T07:05:34.320659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:47.306558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319045+0000","last_change":"2023-10-08T07:05:27.295425+0000","last_active":"2023-10-08T07:05:33.319045+0000","last_peered":"2023-10-08T07:05:33.319045+0000","last_clean":"2023-10-08T07:05:33.319045+0000","last_became_active":"2023-10-08T07:05:27.295157+0000","last_became_peered":"2023-10-08T07:05:27.295157+0000","last_unstale":"2023-10-08T07:05:33.319045+0000","last_undegraded":"2023-10-08T07:05:33.319045+0000","last_fullsized":"2023-10-08T07:05:33.319045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:06.192882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318796+0000","last_change":"2023-10-08T07:05:32.317723+0000","last_active":"2023-10-08T07:05:34.318796+0000","last_peered":"2023-10-08T07:05:34.318796+0000","last_clean":"2023-10-08T07:05:34.318796+0000","last_became_active":"2023-10-08T07:05:32.317444+0000","last_became_peered":"2023-10-08T07:05:32.317444+0000","last_unstale":"2023-10-08T07:05:34.318796+0000","last_undegraded":"2023-10-08T07:05:34.318796+0000","last_fullsized":"2023-10-08T07:05:34.318796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:29.242830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360897+0000","last_change":"2023-10-08T07:05:33.321497+0000","last_active":"2023-10-08T07:05:34.360897+0000","last_peered":"2023-10-08T07:05:34.360897+0000","last_clean":"2023-10-08T07:05:34.360897+0000","last_became_active":"2023-10-08T07:05:33.319658+0000","last_became_peered":"2023-10-08T07:05:33.319658+0000","last_unstale":"2023-10-08T07:05:34.360897+0000","last_undegraded":"2023-10-08T07:05:34.360897+0000","last_fullsized":"2023-10-08T07:05:34.360897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.314076+0000","last_change":"2023-10-08T07:05:27.298597+0000","last_active":"2023-10-08T07:05:33.314076+0000","last_peered":"2023-10-08T07:05:33.314076+0000","last_clean":"2023-10-08T07:05:33.314076+0000","last_became_active":"2023-10-08T07:05:27.298355+0000","last_became_peered":"2023-10-08T07:05:27.298355+0000","last_unstale":"2023-10-08T07:05:33.314076+0000","last_undegraded":"2023-10-08T07:05:33.314076+0000","last_fullsized":"2023-10-08T07:05:33.314076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:06.241475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319456+0000","last_change":"2023-10-08T07:05:32.319605+0000","last_active":"2023-10-08T07:05:34.319456+0000","last_peered":"2023-10-08T07:05:34.319456+0000","last_clean":"2023-10-08T07:05:34.319456+0000","last_became_active":"2023-10-08T07:05:32.319244+0000","last_became_peered":"2023-10-08T07:05:32.319244+0000","last_unstale":"2023-10-08T07:05:34.319456+0000","last_undegraded":"2023-10-08T07:05:34.319456+0000","last_fullsized":"2023-10-08T07:05:34.319456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:25.991992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360213+0000","last_change":"2023-10-08T07:05:33.327112+0000","last_active":"2023-10-08T07:05:34.360213+0000","last_peered":"2023-10-08T07:05:34.360213+0000","last_clean":"2023-10-08T07:05:34.360213+0000","last_became_active":"2023-10-08T07:05:33.326816+0000","last_became_peered":"2023-10-08T07:05:33.326816+0000","last_unstale":"2023-10-08T07:05:34.360213+0000","last_undegraded":"2023-10-08T07:05:34.360213+0000","last_fullsized":"2023-10-08T07:05:34.360213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:32.319875+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:32.319385+0000","last_became_peered":"2023-10-08T07:05:32.319385+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309753+0000","last_change":"2023-10-08T07:05:27.295537+0000","last_active":"2023-10-08T07:05:33.309753+0000","last_peered":"2023-10-08T07:05:33.309753+0000","last_clean":"2023-10-08T07:05:33.309753+0000","last_became_active":"2023-10-08T07:05:27.295234+0000","last_became_peered":"2023-10-08T07:05:27.295234+0000","last_unstale":"2023-10-08T07:05:33.309753+0000","last_undegraded":"2023-10-08T07:05:33.309753+0000","last_fullsized":"2023-10-08T07:05:33.309753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:22.951187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318736+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:05:34.318736+0000","last_peered":"2023-10-08T07:05:34.318736+0000","last_clean":"2023-10-08T07:05:34.318736+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:05:34.318736+0000","last_undegraded":"2023-10-08T07:05:34.318736+0000","last_fullsized":"2023-10-08T07:05:34.318736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.325045+0000","last_change":"2023-10-08T07:05:27.295945+0000","last_active":"2023-10-08T07:05:33.325045+0000","last_peered":"2023-10-08T07:05:33.325045+0000","last_clean":"2023-10-08T07:05:33.325045+0000","last_became_active":"2023-10-08T07:05:27.295726+0000","last_became_peered":"2023-10-08T07:05:27.295726+0000","last_unstale":"2023-10-08T07:05:33.325045+0000","last_undegraded":"2023-10-08T07:05:33.325045+0000","last_fullsized":"2023-10-08T07:05:33.325045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:55.040889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.506403+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:05:34.506403+0000","last_peered":"2023-10-08T07:05:34.506403+0000","last_clean":"2023-10-08T07:05:34.506403+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:05:34.506403+0000","last_undegraded":"2023-10-08T07:05:34.506403+0000","last_fullsized":"2023-10-08T07:05:34.506403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359840+0000","last_change":"2023-10-08T07:05:33.326621+0000","last_active":"2023-10-08T07:05:34.359840+0000","last_peered":"2023-10-08T07:05:34.359840+0000","last_clean":"2023-10-08T07:05:34.359840+0000","last_became_active":"2023-10-08T07:05:33.326272+0000","last_became_peered":"2023-10-08T07:05:33.326272+0000","last_unstale":"2023-10-08T07:05:34.359840+0000","last_undegraded":"2023-10-08T07:05:34.359840+0000","last_fullsized":"2023-10-08T07:05:34.359840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:31.752188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359963+0000","last_change":"2023-10-08T07:05:32.323175+0000","last_active":"2023-10-08T07:05:34.359963+0000","last_peered":"2023-10-08T07:05:34.359963+0000","last_clean":"2023-10-08T07:05:34.359963+0000","last_became_active":"2023-10-08T07:05:32.322814+0000","last_became_peered":"2023-10-08T07:05:32.322814+0000","last_unstale":"2023-10-08T07:05:34.359963+0000","last_undegraded":"2023-10-08T07:05:34.359963+0000","last_fullsized":"2023-10-08T07:05:34.359963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360537+0000","last_change":"2023-10-08T07:05:33.318398+0000","last_active":"2023-10-08T07:05:34.360537+0000","last_peered":"2023-10-08T07:05:34.360537+0000","last_clean":"2023-10-08T07:05:34.360537+0000","last_became_active":"2023-10-08T07:05:33.317478+0000","last_became_peered":"2023-10-08T07:05:33.317478+0000","last_unstale":"2023-10-08T07:05:34.360537+0000","last_undegraded":"2023-10-08T07:05:34.360537+0000","last_fullsized":"2023-10-08T07:05:34.360537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320059+0000","last_change":"2023-10-08T07:05:32.320603+0000","last_active":"2023-10-08T07:05:34.320059+0000","last_peered":"2023-10-08T07:05:34.320059+0000","last_clean":"2023-10-08T07:05:34.320059+0000","last_became_active":"2023-10-08T07:05:32.320262+0000","last_became_peered":"2023-10-08T07:05:32.320262+0000","last_unstale":"2023-10-08T07:05:34.320059+0000","last_undegraded":"2023-10-08T07:05:34.320059+0000","last_fullsized":"2023-10-08T07:05:34.320059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:09.249029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319954+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:05:34.319954+0000","last_peered":"2023-10-08T07:05:34.319954+0000","last_clean":"2023-10-08T07:05:34.319954+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:05:34.319954+0000","last_undegraded":"2023-10-08T07:05:34.319954+0000","last_fullsized":"2023-10-08T07:05:34.319954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360795+0000","last_change":"2023-10-08T07:05:32.323143+0000","last_active":"2023-10-08T07:05:34.360795+0000","last_peered":"2023-10-08T07:05:34.360795+0000","last_clean":"2023-10-08T07:05:34.360795+0000","last_became_active":"2023-10-08T07:05:32.322789+0000","last_became_peered":"2023-10-08T07:05:32.322789+0000","last_unstale":"2023-10-08T07:05:34.360795+0000","last_undegraded":"2023-10-08T07:05:34.360795+0000","last_fullsized":"2023-10-08T07:05:34.360795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:03.978136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319826+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:05:34.319826+0000","last_peered":"2023-10-08T07:05:34.319826+0000","last_clean":"2023-10-08T07:05:34.319826+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:05:34.319826+0000","last_undegraded":"2023-10-08T07:05:34.319826+0000","last_fullsized":"2023-10-08T07:05:34.319826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319964+0000","last_change":"2023-10-08T07:05:32.319462+0000","last_active":"2023-10-08T07:05:34.319964+0000","last_peered":"2023-10-08T07:05:34.319964+0000","last_clean":"2023-10-08T07:05:34.319964+0000","last_became_active":"2023-10-08T07:05:32.318951+0000","last_became_peered":"2023-10-08T07:05:32.318951+0000","last_unstale":"2023-10-08T07:05:34.319964+0000","last_undegraded":"2023-10-08T07:05:34.319964+0000","last_fullsized":"2023-10-08T07:05:34.319964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360006+0000","last_change":"2023-10-08T07:05:33.319869+0000","last_active":"2023-10-08T07:05:34.360006+0000","last_peered":"2023-10-08T07:05:34.360006+0000","last_clean":"2023-10-08T07:05:34.360006+0000","last_became_active":"2023-10-08T07:05:33.318241+0000","last_became_peered":"2023-10-08T07:05:33.318241+0000","last_unstale":"2023-10-08T07:05:34.360006+0000","last_undegraded":"2023-10-08T07:05:34.360006+0000","last_fullsized":"2023-10-08T07:05:34.360006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320049+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:05:34.320049+0000","last_peered":"2023-10-08T07:05:34.320049+0000","last_clean":"2023-10-08T07:05:34.320049+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:05:34.320049+0000","last_undegraded":"2023-10-08T07:05:34.320049+0000","last_fullsized":"2023-10-08T07:05:34.320049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320180+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:05:34.320180+0000","last_peered":"2023-10-08T07:05:34.320180+0000","last_clean":"2023-10-08T07:05:34.320180+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:05:34.320180+0000","last_undegraded":"2023-10-08T07:05:34.320180+0000","last_fullsized":"2023-10-08T07:05:34.320180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319653+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:05:34.319653+0000","last_peered":"2023-10-08T07:05:34.319653+0000","last_clean":"2023-10-08T07:05:34.319653+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:05:34.319653+0000","last_undegraded":"2023-10-08T07:05:34.319653+0000","last_fullsized":"2023-10-08T07:05:34.319653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319038+0000","last_change":"2023-10-08T07:05:33.322006+0000","last_active":"2023-10-08T07:05:34.319038+0000","last_peered":"2023-10-08T07:05:34.319038+0000","last_clean":"2023-10-08T07:05:34.319038+0000","last_became_active":"2023-10-08T07:05:33.321639+0000","last_became_peered":"2023-10-08T07:05:33.321639+0000","last_unstale":"2023-10-08T07:05:34.319038+0000","last_undegraded":"2023-10-08T07:05:34.319038+0000","last_fullsized":"2023-10-08T07:05:34.319038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360201+0000","last_change":"2023-10-08T07:05:33.329906+0000","last_active":"2023-10-08T07:05:34.360201+0000","last_peered":"2023-10-08T07:05:34.360201+0000","last_clean":"2023-10-08T07:05:34.360201+0000","last_became_active":"2023-10-08T07:05:33.329615+0000","last_became_peered":"2023-10-08T07:05:33.329615+0000","last_unstale":"2023-10-08T07:05:34.360201+0000","last_undegraded":"2023-10-08T07:05:34.360201+0000","last_fullsized":"2023-10-08T07:05:34.360201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319571+0000","last_change":"2023-10-08T07:05:33.316573+0000","last_active":"2023-10-08T07:05:34.319571+0000","last_peered":"2023-10-08T07:05:34.319571+0000","last_clean":"2023-10-08T07:05:34.319571+0000","last_became_active":"2023-10-08T07:05:33.316193+0000","last_became_peered":"2023-10-08T07:05:33.316193+0000","last_unstale":"2023-10-08T07:05:34.319571+0000","last_undegraded":"2023-10-08T07:05:34.319571+0000","last_fullsized":"2023-10-08T07:05:34.319571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360585+0000","last_change":"2023-10-08T07:05:33.320077+0000","last_active":"2023-10-08T07:05:34.360585+0000","last_peered":"2023-10-08T07:05:34.360585+0000","last_clean":"2023-10-08T07:05:34.360585+0000","last_became_active":"2023-10-08T07:05:33.319392+0000","last_became_peered":"2023-10-08T07:05:33.319392+0000","last_unstale":"2023-10-08T07:05:34.360585+0000","last_undegraded":"2023-10-08T07:05:34.360585+0000","last_fullsized":"2023-10-08T07:05:34.360585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":650475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":649859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:05:52.074 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T07:05:52.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-10-08T07:05:52.444 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 19 2023-10-08T07:05:52.444 INFO:teuthology.orchestra.run.smithi017.stdout:fsid bb50b5dc-93de-4177-9c34-354ea3b007d0 2023-10-08T07:05:52.444 INFO:teuthology.orchestra.run.smithi017.stdout:created 2023-10-08T07:05:10.233885+0000 2023-10-08T07:05:52.444 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2023-10-08T07:05:34.310228+0000 2023-10-08T07:05:52.444 INFO:teuthology.orchestra.run.smithi017.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-08T07:05:52.444 INFO:teuthology.orchestra.run.smithi017.stdout:crush_version 4 2023-10-08T07:05:52.444 INFO:teuthology.orchestra.run.smithi017.stdout:full_ratio 0.95 2023-10-08T07:05:52.444 INFO:teuthology.orchestra.run.smithi017.stdout:backfillfull_ratio 0.9 2023-10-08T07:05:52.445 INFO:teuthology.orchestra.run.smithi017.stdout:nearfull_ratio 0.85 2023-10-08T07:05:52.445 INFO:teuthology.orchestra.run.smithi017.stdout:require_min_compat_client luminous 2023-10-08T07:05:52.445 INFO:teuthology.orchestra.run.smithi017.stdout:min_compat_client jewel 2023-10-08T07:05:52.445 INFO:teuthology.orchestra.run.smithi017.stdout:require_osd_release reef 2023-10-08T07:05:52.445 INFO:teuthology.orchestra.run.smithi017.stdout:stretch_mode_enabled false 2023-10-08T07:05:52.445 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2023-10-08T07:05:52.445 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2023-10-08T07:05:52.445 INFO:teuthology.orchestra.run.smithi017.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2023-10-08T07:05:52.445 INFO:teuthology.orchestra.run.smithi017.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2023-10-08T07:05:52.445 INFO:teuthology.orchestra.run.smithi017.stdout:max_osd 3 2023-10-08T07:05:52.445 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6800/1203223037,v1:172.21.15.33:6801/1203223037] [v2:172.21.15.33:6802/1203223037,v1:172.21.15.33:6803/1203223037] exists,up ba776b12-56dd-4565-ab87-300e9dcd9f20 2023-10-08T07:05:52.445 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6800/1966312605,v1:172.21.15.86:6801/1966312605] [v2:172.21.15.86:6802/1966312605,v1:172.21.15.86:6803/1966312605] exists,up 69c35118-ff9d-4847-ba6c-37d3e9805dbe 2023-10-08T07:05:52.446 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6800/3675215989,v1:172.21.15.144:6801/3675215989] [v2:172.21.15.144:6802/3675215989,v1:172.21.15.144:6803/3675215989] exists,up 98332c95-54f9-4263-a295-d2a753d9f200 2023-10-08T07:05:52.458 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6800/1203223037,v1:172.21.15.33:6801/1203223037] [v2:172.21.15.33:6802/1203223037,v1:172.21.15.33:6803/1203223037] exists,up ba776b12-56dd-4565-ab87-300e9dcd9f20', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6800/1966312605,v1:172.21.15.86:6801/1966312605] [v2:172.21.15.86:6802/1966312605,v1:172.21.15.86:6803/1966312605] exists,up 69c35118-ff9d-4847-ba6c-37d3e9805dbe', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6800/3675215989,v1:172.21.15.144:6801/3675215989] [v2:172.21.15.144:6802/3675215989,v1:172.21.15.144:6803/3675215989] exists,up 98332c95-54f9-4263-a295-d2a753d9f200'] 2023-10-08T07:05:52.459 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-10-08T07:05:52.585 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-08T07:05:52.585 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mon.a", 2023-10-08T07:05:52.585 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster": "ceph", 2023-10-08T07:05:52.585 INFO:teuthology.orchestra.run.smithi017.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-10-08T07:05:52.585 INFO:teuthology.orchestra.run.smithi017.stdout: "admin_socket_mode": "", 2023-10-08T07:05:52.586 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-10-08T07:05:52.586 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_client_required": "cephx, none", 2023-10-08T07:05:52.586 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_cluster_required": "cephx", 2023-10-08T07:05:52.586 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_debug": "true", 2023-10-08T07:05:52.586 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-10-08T07:05:52.586 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-10-08T07:05:52.586 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_service_required": "cephx", 2023-10-08T07:05:52.586 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_service_ticket_ttl": "240.000000", 2023-10-08T07:05:52.586 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_supported": "cephx", 2023-10-08T07:05:52.586 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio": "true", 2023-10-08T07:05:52.586 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio_max_queue_depth": "1024", 2023-10-08T07:05:52.587 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio_poll_ms": "250", 2023-10-08T07:05:52.587 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio_reap_max": "16", 2023-10-08T07:05:52.587 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_async_discard": "false", 2023-10-08T07:05:52.587 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_block_size": "4096", 2023-10-08T07:05:52.587 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_aio": "false", 2023-10-08T07:05:52.587 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-10-08T07:05:52.587 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-10-08T07:05:52.587 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_inflight_ios": "false", 2023-10-08T07:05:52.587 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_enable_discard": "false", 2023-10-08T07:05:52.587 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_flock_retry": "3", 2023-10-08T07:05:52.587 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_flock_retry_interval": "0.100000", 2023-10-08T07:05:52.587 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_inject_crash": "0", 2023-10-08T07:05:52.588 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_inject_crash_flush_delay": "2", 2023-10-08T07:05:52.588 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_ioring": "false", 2023-10-08T07:05:52.588 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_ioring_hipri": "false", 2023-10-08T07:05:52.588 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_ioring_sqthread_poll": "false", 2023-10-08T07:05:52.588 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-10-08T07:05:52.588 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_read_buffer_alignment": "4096", 2023-10-08T07:05:52.588 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-10-08T07:05:52.588 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_type": "", 2023-10-08T07:05:52.588 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_alloc_size": "1048576", 2023-10-08T07:05:52.588 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_allocator": "hybrid", 2023-10-08T07:05:52.588 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_buffered_io": "true", 2023-10-08T07:05:52.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_check_for_zeros": "false", 2023-10-08T07:05:52.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_check_volume_selector_often": "false", 2023-10-08T07:05:52.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-10-08T07:05:52.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_compact_log_sync": "false", 2023-10-08T07:05:52.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2023-10-08T07:05:52.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-10-08T07:05:52.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_log_compact_min_size": "16777216", 2023-10-08T07:05:52.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_log_replay_check_allocations": "true", 2023-10-08T07:05:52.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_max_log_runway": "4194304", 2023-10-08T07:05:52.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_max_prefetch": "1048576", 2023-10-08T07:05:52.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_min_flush_size": "524288", 2023-10-08T07:05:52.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_min_log_runway": "1048576", 2023-10-08T07:05:52.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_replay_recovery": "false", 2023-10-08T07:05:52.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-10-08T07:05:52.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_shared_alloc_size": "65536", 2023-10-08T07:05:52.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_sync_write": "false", 2023-10-08T07:05:52.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-10-08T07:05:52.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-10-08T07:05:52.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-10-08T07:05:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_allocation_from_file": "true", 2023-10-08T07:05:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_allocator": "hybrid", 2023-10-08T07:05:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-10-08T07:05:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-10-08T07:05:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-10-08T07:05:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-10-08T07:05:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-10-08T07:05:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-10-08T07:05:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blobid_prealloc": "10240", 2023-10-08T07:05:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_create": "true", 2023-10-08T07:05:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_db_create": "false", 2023-10-08T07:05:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_db_path": "", 2023-10-08T07:05:52.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_db_size": "0", 2023-10-08T07:05:52.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_path": "", 2023-10-08T07:05:52.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_preallocate_file": "false", 2023-10-08T07:05:52.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_size": "107374182400", 2023-10-08T07:05:52.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_wal_create": "false", 2023-10-08T07:05:52.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_wal_path": "", 2023-10-08T07:05:52.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_wal_size": "100663296", 2023-10-08T07:05:52.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs": "true", 2023-10-08T07:05:52.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-10-08T07:05:52.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs_env_mirror": "false", 2023-10-08T07:05:52.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-10-08T07:05:52.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-10-08T07:05:52.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-10-08T07:05:52.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-10-08T07:05:52.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-10-08T07:05:52.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-10-08T07:05:52.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_autotune": "true", 2023-10-08T07:05:52.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-10-08T07:05:52.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-10-08T07:05:52.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-10-08T07:05:52.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-10-08T07:05:52.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_size": "0", 2023-10-08T07:05:52.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-10-08T07:05:52.594 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-10-08T07:05:52.594 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-10-08T07:05:52.594 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-10-08T07:05:52.594 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_type": "2q", 2023-10-08T07:05:52.594 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-10-08T07:05:52.594 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_clone_cow": "true", 2023-10-08T07:05:52.594 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_algorithm": "snappy", 2023-10-08T07:05:52.594 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_max_blob_size": "0", 2023-10-08T07:05:52.594 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-10-08T07:05:52.594 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-10-08T07:05:52.594 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_min_blob_size": "0", 2023-10-08T07:05:52.595 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-10-08T07:05:52.595 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-10-08T07:05:52.595 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_mode": "none", 2023-10-08T07:05:52.595 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-10-08T07:05:52.595 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_csum_type": "crc32c", 2023-10-08T07:05:52.595 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_enforce_settings": "default", 2023-10-08T07:05:52.595 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_freelist": "false", 2023-10-08T07:05:52.595 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_fsck_abort": "false", 2023-10-08T07:05:52.595 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2023-10-08T07:05:52.595 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-10-08T07:05:52.595 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_read_err": "false", 2023-10-08T07:05:52.596 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_legacy_omap": "false", 2023-10-08T07:05:52.596 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-10-08T07:05:52.596 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-10-08T07:05:52.596 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-10-08T07:05:52.596 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-10-08T07:05:52.596 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_prefill": "0.000000", 2023-10-08T07:05:52.596 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-10-08T07:05:52.596 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-10-08T07:05:52.596 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-10-08T07:05:52.596 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_small_allocations": "0", 2023-10-08T07:05:52.596 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-10-08T07:05:52.596 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_default_buffered_read": "true", 2023-10-08T07:05:52.597 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_default_buffered_write": "false", 2023-10-08T07:05:52.597 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_deferred_batch_ops": "0", 2023-10-08T07:05:52.597 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-10-08T07:05:52.597 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-10-08T07:05:52.597 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_elastic_shared_blobs": "true", 2023-10-08T07:05:52.597 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-10-08T07:05:52.597 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-10-08T07:05:52.597 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-10-08T07:05:52.597 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-10-08T07:05:52.597 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-10-08T07:05:52.597 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fail_eio": "false", 2023-10-08T07:05:52.597 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-10-08T07:05:52.598 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-10-08T07:05:52.598 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-10-08T07:05:52.598 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-10-08T07:05:52.598 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mkfs": "true", 2023-10-08T07:05:52.598 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-10-08T07:05:52.598 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mount": "false", 2023-10-08T07:05:52.598 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-10-08T07:05:52.598 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_umount": "false", 2023-10-08T07:05:52.598 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-10-08T07:05:52.598 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-10-08T07:05:52.598 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-10-08T07:05:52.598 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-10-08T07:05:52.601 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-10-08T07:05:52.601 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-10-08T07:05:52.602 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-10-08T07:05:52.602 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-10-08T07:05:52.602 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_ignore_data_csum": "false", 2023-10-08T07:05:52.602 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-10-08T07:05:52.602 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_kvbackend": "rocksdb", 2023-10-08T07:05:52.602 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-10-08T07:05:52.602 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-10-08T07:05:52.602 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_log_op_age": "5.000000", 2023-10-08T07:05:52.602 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_alloc_size": "0", 2023-10-08T07:05:52.602 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_blob_size": "0", 2023-10-08T07:05:52.602 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-10-08T07:05:52.602 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-10-08T07:05:52.603 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_defer_interval": "3.000000", 2023-10-08T07:05:52.603 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_deferred_txc": "32", 2023-10-08T07:05:52.603 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_min_alloc_size": "0", 2023-10-08T07:05:52.603 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-10-08T07:05:52.603 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-10-08T07:05:52.603 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_nid_prealloc": "1024", 2023-10-08T07:05:52.603 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_prefer_deferred_size": "0", 2023-10-08T07:05:52.603 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-10-08T07:05:52.603 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-10-08T07:05:52.603 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_qfsck_on_mount": "true", 2023-10-08T07:05:52.603 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_retry_disk_reads": "3", 2023-10-08T07:05:52.604 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_cf": "true", 2023-10-08T07:05:52.604 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2023-10-08T07:05:52.604 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2023-10-08T07:05:52.604 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_options_annex": "", 2023-10-08T07:05:52.604 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_coremask": "0x1", 2023-10-08T07:05:52.604 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_io_sleep": "5", 2023-10-08T07:05:52.604 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_max_io_completion": "0", 2023-10-08T07:05:52.604 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_mem": "512", 2023-10-08T07:05:52.604 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_sync_submit_transaction": "false", 2023-10-08T07:05:52.604 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_bytes": "67108864", 2023-10-08T07:05:52.604 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_cost_per_io": "0", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_tracing": "false", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_volume_selection_reserved": "0", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-10-08T07:05:52.605 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-10-08T07:05:52.606 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-10-08T07:05:52.606 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_zero_block_detection": "false", 2023-10-08T07:05:52.606 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-10-08T07:05:52.606 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_action_update_interval": "2", 2023-10-08T07:05:52.606 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-10-08T07:05:52.606 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-10-08T07:05:52.606 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-10-08T07:05:52.606 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-10-08T07:05:52.606 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_mount_timeout": "10", 2023-10-08T07:05:52.606 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-10-08T07:05:52.606 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-10-08T07:05:52.607 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-10-08T07:05:52.607 INFO:teuthology.orchestra.run.smithi017.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-10-08T07:05:52.607 INFO:teuthology.orchestra.run.smithi017.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-10-08T07:05:52.607 INFO:teuthology.orchestra.run.smithi017.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-10-08T07:05:52.607 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_cluster_require_signatures": "false", 2023-10-08T07:05:52.607 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_cluster_require_version": "2", 2023-10-08T07:05:52.607 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_require_signatures": "false", 2023-10-08T07:05:52.607 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_require_version": "2", 2023-10-08T07:05:52.607 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_service_require_signatures": "false", 2023-10-08T07:05:52.607 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_service_require_version": "2", 2023-10-08T07:05:52.607 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_sign_messages": "true", 2023-10-08T07:05:52.607 INFO:teuthology.orchestra.run.smithi017.stdout: "chdir": "", 2023-10-08T07:05:52.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_acl_type": "", 2023-10-08T07:05:52.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_asio_thread_count": "2", 2023-10-08T07:05:52.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_cache_mid": "0.750000", 2023-10-08T07:05:52.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_cache_size": "16384", 2023-10-08T07:05:52.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_caps_release_delay": "5", 2023-10-08T07:05:52.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_check_pool_perm": "true", 2023-10-08T07:05:52.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_collect_and_send_global_metrics": "false", 2023-10-08T07:05:52.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_force_sync_read": "false", 2023-10-08T07:05:52.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_getattr_caps": "false", 2023-10-08T07:05:52.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_inject_tick_delay": "0", 2023-10-08T07:05:52.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-10-08T07:05:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_die_on_failed_remount": "false", 2023-10-08T07:05:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_dirsize_rbytes": "true", 2023-10-08T07:05:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_force_lazyio": "false", 2023-10-08T07:05:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_fs": "", 2023-10-08T07:05:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_inject_fixed_oldest_tid": "false", 2023-10-08T07:05:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_inject_release_failure": "false", 2023-10-08T07:05:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_max_inline_size": "4096", 2023-10-08T07:05:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_max_retries_on_remount_failure": "5", 2023-10-08T07:05:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mds_namespace": "", 2023-10-08T07:05:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_metadata": "", 2023-10-08T07:05:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mount_gid": "-1", 2023-10-08T07:05:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mount_timeout": "300", 2023-10-08T07:05:52.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mount_uid": "-1", 2023-10-08T07:05:52.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mountpoint": "/", 2023-10-08T07:05:52.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_notify_timeout": "10", 2023-10-08T07:05:52.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc": "true", 2023-10-08T07:05:52.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_max_dirty": "104857600", 2023-10-08T07:05:52.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_max_dirty_age": "5.000000", 2023-10-08T07:05:52.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_max_objects": "1000", 2023-10-08T07:05:52.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_size": "209715200", 2023-10-08T07:05:52.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_target_dirty": "8388608", 2023-10-08T07:05:52.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_permissions": "true", 2023-10-08T07:05:52.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_quota": "true", 2023-10-08T07:05:52.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_quota_df": "true", 2023-10-08T07:05:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_readahead_max_bytes": "0", 2023-10-08T07:05:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_readahead_max_periods": "4", 2023-10-08T07:05:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_readahead_min": "131072", 2023-10-08T07:05:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_reconnect_stale": "false", 2023-10-08T07:05:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_shutdown_timeout": "30", 2023-10-08T07:05:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_snapdir": ".snap", 2023-10-08T07:05:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_tick_interval": "1", 2023-10-08T07:05:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_trace": "", 2023-10-08T07:05:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_try_dentry_invalidate": "false", 2023-10-08T07:05:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_use_faked_inos": "false", 2023-10-08T07:05:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_use_random_mds": "false", 2023-10-08T07:05:52.611 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_graylog": "false", 2023-10-08T07:05:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-10-08T07:05:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_graylog_port": "12201", 2023-10-08T07:05:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_monitors": "default=true", 2023-10-08T07:05:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_syslog": "false", 2023-10-08T07:05:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-10-08T07:05:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_syslog_level": "info", 2023-10-08T07:05:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "-", 2023-10-08T07:05:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_network": "", 2023-10-08T07:05:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_network_interface": "", 2023-10-08T07:05:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zlib_isal": "false", 2023-10-08T07:05:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zlib_level": "5", 2023-10-08T07:05:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zlib_winsize": "-15", 2023-10-08T07:05:52.613 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zstd_level": "1", 2023-10-08T07:05:52.613 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2023-10-08T07:05:52.613 INFO:teuthology.orchestra.run.smithi017.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-10-08T07:05:52.613 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_alien_op_num_threads": "6", 2023-10-08T07:05:52.613 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_alien_thread_cpu_cores": "", 2023-10-08T07:05:52.613 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_osd_obc_lru_size": "10", 2023-10-08T07:05:52.613 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-10-08T07:05:52.613 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_seastar_smp": "1", 2023-10-08T07:05:52.613 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_location": "", 2023-10-08T07:05:52.613 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_location_hook": "", 2023-10-08T07:05:52.613 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_location_hook_timeout": "10", 2023-10-08T07:05:52.614 INFO:teuthology.orchestra.run.smithi017.stdout: "daemonize": "false", 2023-10-08T07:05:52.614 INFO:teuthology.orchestra.run.smithi017.stdout: "daos_pool": "tank", 2023-10-08T07:05:52.614 INFO:teuthology.orchestra.run.smithi017.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2023-10-08T07:05:52.614 INFO:teuthology.orchestra.run.smithi017.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2023-10-08T07:05:52.614 INFO:teuthology.orchestra.run.smithi017.stdout: "dbstore_db_name_prefix": "dbstore", 2023-10-08T07:05:52.614 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_alienstore": "0/5", 2023-10-08T07:05:52.614 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_allow_any_pool_priority": "false", 2023-10-08T07:05:52.614 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_asok": "1/5", 2023-10-08T07:05:52.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_asok_assert_abort": "false", 2023-10-08T07:05:52.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_asserts_on_shutdown": "true", 2023-10-08T07:05:52.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_auth": "20/20", 2023-10-08T07:05:52.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_bdev": "1/3", 2023-10-08T07:05:52.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_bluefs": "1/5", 2023-10-08T07:05:52.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_bluestore": "1/5", 2023-10-08T07:05:52.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_buffer": "0/1", 2023-10-08T07:05:52.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_ceph_exporter": "1/5", 2023-10-08T07:05:52.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_cephfs_mirror": "0/5", 2023-10-08T07:05:52.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_cephsqlite": "0/5", 2023-10-08T07:05:52.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_client": "0/5", 2023-10-08T07:05:52.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_compressor": "1/5", 2023-10-08T07:05:52.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_context": "0/1", 2023-10-08T07:05:52.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_crush": "1/1", 2023-10-08T07:05:52.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_crypto": "1/5", 2023-10-08T07:05:52.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_cyanstore": "0/5", 2023-10-08T07:05:52.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_deliberately_leak_memory": "false", 2023-10-08T07:05:52.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_disable_randomized_ping": "false", 2023-10-08T07:05:52.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_dpdk": "1/5", 2023-10-08T07:05:52.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_eventtrace": "1/5", 2023-10-08T07:05:52.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_filer": "0/1", 2023-10-08T07:05:52.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_filestore": "1/3", 2023-10-08T07:05:52.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_finisher": "1/1", 2023-10-08T07:05:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_fuse": "1/5", 2023-10-08T07:05:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_heartbeat_testing_span": "0", 2023-10-08T07:05:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_heartbeatmap": "1/5", 2023-10-08T07:05:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_immutable_obj_cache": "0/5", 2023-10-08T07:05:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_javaclient": "1/5", 2023-10-08T07:05:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_journal": "1/3", 2023-10-08T07:05:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_journaler": "0/5", 2023-10-08T07:05:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_kstore": "1/5", 2023-10-08T07:05:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_lockdep": "0/1", 2023-10-08T07:05:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mclock": "1/5", 2023-10-08T07:05:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds": "1/5", 2023-10-08T07:05:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_balancer": "1/5", 2023-10-08T07:05:52.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_locker": "1/5", 2023-10-08T07:05:52.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_log": "1/5", 2023-10-08T07:05:52.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_log_expire": "1/5", 2023-10-08T07:05:52.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_migrator": "1/5", 2023-10-08T07:05:52.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_memstore": "1/5", 2023-10-08T07:05:52.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mgr": "2/5", 2023-10-08T07:05:52.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mgrc": "1/5", 2023-10-08T07:05:52.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mon": "20/20", 2023-10-08T07:05:52.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_monc": "0/10", 2023-10-08T07:05:52.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_ms": "1/1", 2023-10-08T07:05:52.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_none": "0/5", 2023-10-08T07:05:52.618 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_objclass": "0/5", 2023-10-08T07:05:52.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_objectcacher": "0/5", 2023-10-08T07:05:52.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_objecter": "0/1", 2023-10-08T07:05:52.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_optracker": "0/5", 2023-10-08T07:05:52.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_osd": "1/5", 2023-10-08T07:05:52.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_paxos": "20/20", 2023-10-08T07:05:52.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_perfcounter": "1/5", 2023-10-08T07:05:52.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_prioritycache": "1/5", 2023-10-08T07:05:52.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rados": "0/5", 2023-10-08T07:05:52.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd": "0/5", 2023-10-08T07:05:52.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd_mirror": "0/5", 2023-10-08T07:05:52.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd_pwl": "0/5", 2023-10-08T07:05:52.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd_replay": "0/5", 2023-10-08T07:05:52.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_refs": "0/0", 2023-10-08T07:05:52.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_reserver": "1/1", 2023-10-08T07:05:52.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw": "1/5", 2023-10-08T07:05:52.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_access": "1/5", 2023-10-08T07:05:52.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_datacache": "1/5", 2023-10-08T07:05:52.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_dbstore": "1/5", 2023-10-08T07:05:52.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_flight": "1/5", 2023-10-08T07:05:52.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_sync": "1/5", 2023-10-08T07:05:52.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rocksdb": "4/5", 2023-10-08T07:05:52.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore": "0/5", 2023-10-08T07:05:52.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_backref": "0/5", 2023-10-08T07:05:52.620 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_cache": "0/5", 2023-10-08T07:05:52.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_cleaner": "0/5", 2023-10-08T07:05:52.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_device": "0/5", 2023-10-08T07:05:52.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_epm": "0/5", 2023-10-08T07:05:52.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_fixedkv_tree": "0/5", 2023-10-08T07:05:52.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_journal": "0/5", 2023-10-08T07:05:52.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_lba": "0/5", 2023-10-08T07:05:52.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_odata": "0/5", 2023-10-08T07:05:52.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_omap": "0/5", 2023-10-08T07:05:52.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_onode": "0/5", 2023-10-08T07:05:52.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_t": "0/5", 2023-10-08T07:05:52.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_tm": "0/5", 2023-10-08T07:05:52.621 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_striper": "0/1", 2023-10-08T07:05:52.622 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_test": "0/5", 2023-10-08T07:05:52.622 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_throttle": "1/1", 2023-10-08T07:05:52.622 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_timer": "0/1", 2023-10-08T07:05:52.622 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_tp": "0/5", 2023-10-08T07:05:52.622 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_trace": "1/5", 2023-10-08T07:05:52.622 INFO:teuthology.orchestra.run.smithi017.stdout: "defer_client_eviction_on_laggy_osds": "true", 2023-10-08T07:05:52.622 INFO:teuthology.orchestra.run.smithi017.stdout: "device_failure_prediction_mode": "none", 2023-10-08T07:05:52.622 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-10-08T07:05:52.622 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2023-10-08T07:05:52.622 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_graylog": "false", 2023-10-08T07:05:52.622 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_journald": "false", 2023-10-08T07:05:52.623 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_stderr": "true", 2023-10-08T07:05:52.623 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_syslog": "false", 2023-10-08T07:05:52.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event_tracing": "false", 2023-10-08T07:05:52.623 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_addr": "0.0.0.0", 2023-10-08T07:05:52.623 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_http_port": "9926", 2023-10-08T07:05:52.623 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_prio_limit": "5", 2023-10-08T07:05:52.623 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_sock_dir": "/var/run/ceph/", 2023-10-08T07:05:52.623 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_sort_metrics": "true", 2023-10-08T07:05:52.623 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_stats_period": "5", 2023-10-08T07:05:52.623 INFO:teuthology.orchestra.run.smithi017.stdout: "fake_statfs_for_testing": "0", 2023-10-08T07:05:52.623 INFO:teuthology.orchestra.run.smithi017.stdout: "fatal_signal_handlers": "true", 2023-10-08T07:05:52.623 INFO:teuthology.orchestra.run.smithi017.stdout: "filer_max_purge_ops": "10", 2023-10-08T07:05:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: "filer_max_truncate_ops": "128", 2023-10-08T07:05:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_apply_finisher_threads": "1", 2023-10-08T07:05:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_blackhole": "false", 2023-10-08T07:05:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_btrfs_clone_range": "true", 2023-10-08T07:05:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_btrfs_snap": "true", 2023-10-08T07:05:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_caller_concurrency": "10", 2023-10-08T07:05:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_collect_device_partition_information": "true", 2023-10-08T07:05:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_commit_timeout": "600.000000", 2023-10-08T07:05:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_inject_read_err": "false", 2023-10-08T07:05:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_omap_check": "false", 2023-10-08T07:05:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_random_read_err": "0.000000", 2023-10-08T07:05:52.624 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_verify_split": "false", 2023-10-08T07:05:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_dump_file": "", 2023-10-08T07:05:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-10-08T07:05:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-10-08T07:05:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fadvise": "true", 2023-10-08T07:05:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fail_eio": "true", 2023-10-08T07:05:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fd_cache_shards": "16", 2023-10-08T07:05:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fd_cache_size": "128", 2023-10-08T07:05:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fiemap": "false", 2023-10-08T07:05:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fiemap_threshold": "4096", 2023-10-08T07:05:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-10-08T07:05:52.625 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_index_retry_probability": "0.000000", 2023-10-08T07:05:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_inject_stall": "0", 2023-10-08T07:05:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_journal_parallel": "false", 2023-10-08T07:05:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_journal_trailing": "false", 2023-10-08T07:05:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_journal_writeahead": "false", 2023-10-08T07:05:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_kill_at": "0", 2023-10-08T07:05:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-10-08T07:05:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size": "0", 2023-10-08T07:05:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-10-08T07:05:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-10-08T07:05:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-10-08T07:05:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs": "0", 2023-10-08T07:05:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-10-08T07:05:52.627 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs_other": "2", 2023-10-08T07:05:52.627 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-10-08T07:05:52.627 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_sync_interval": "5.000000", 2023-10-08T07:05:52.627 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size": "0", 2023-10-08T07:05:52.627 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-10-08T07:05:52.627 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-10-08T07:05:52.627 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-10-08T07:05:52.627 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_merge_threshold": "-10", 2023-10-08T07:05:52.627 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_min_sync_interval": "0.010000", 2023-10-08T07:05:52.627 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_odsync_write": "false", 2023-10-08T07:05:52.627 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_omap_backend": "rocksdb", 2023-10-08T07:05:52.627 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_omap_backend_path": "", 2023-10-08T07:05:52.628 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_omap_header_cache_size": "1024", 2023-10-08T07:05:52.628 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_ondisk_finisher_threads": "1", 2023-10-08T07:05:52.628 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-10-08T07:05:52.628 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_op_thread_timeout": "60", 2023-10-08T07:05:52.628 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_op_threads": "2", 2023-10-08T07:05:52.628 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_punch_hole": "false", 2023-10-08T07:05:52.628 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-10-08T07:05:52.628 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-10-08T07:05:52.628 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-10-08T07:05:52.628 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-10-08T07:05:52.628 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-10-08T07:05:52.628 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_bytes": "104857600", 2023-10-08T07:05:52.629 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-10-08T07:05:52.629 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-10-08T07:05:52.629 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-10-08T07:05:52.629 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_ops": "50", 2023-10-08T07:05:52.629 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-10-08T07:05:52.629 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_seek_data_hole": "false", 2023-10-08T07:05:52.629 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_sloppy_crc": "false", 2023-10-08T07:05:52.629 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-10-08T07:05:52.629 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_splice": "false", 2023-10-08T07:05:52.629 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_split_multiple": "2", 2023-10-08T07:05:52.629 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_split_rand_factor": "20", 2023-10-08T07:05:52.629 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_update_to": "1000", 2023-10-08T07:05:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-10-08T07:05:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-10-08T07:05:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-10-08T07:05:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-10-08T07:05:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-10-08T07:05:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-10-08T07:05:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_enable": "true", 2023-10-08T07:05:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-10-08T07:05:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-10-08T07:05:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-10-08T07:05:52.630 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-10-08T07:05:52.631 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-10-08T07:05:52.631 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-10-08T07:05:52.631 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_xfs_extsize": "false", 2023-10-08T07:05:52.631 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_zfs_snap": "false", 2023-10-08T07:05:52.631 INFO:teuthology.orchestra.run.smithi017.stdout: "fio_dir": "/tmp/fio", 2023-10-08T07:05:52.631 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "bb50b5dc-93de-4177-9c34-354ea3b007d0", 2023-10-08T07:05:52.631 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_allow_other": "true", 2023-10-08T07:05:52.631 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_atomic_o_trunc": "true", 2023-10-08T07:05:52.631 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_big_writes": "true", 2023-10-08T07:05:52.631 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_debug": "false", 2023-10-08T07:05:52.631 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_default_permissions": "false", 2023-10-08T07:05:52.631 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_disable_pagecache": "false", 2023-10-08T07:05:52.632 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_max_write": "0", 2023-10-08T07:05:52.632 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_multithreaded": "true", 2023-10-08T07:05:52.632 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_require_active_mds": "true", 2023-10-08T07:05:52.632 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_set_user_groups": "true", 2023-10-08T07:05:52.632 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_splice_move": "true", 2023-10-08T07:05:52.632 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_splice_read": "true", 2023-10-08T07:05:52.632 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_splice_write": "true", 2023-10-08T07:05:52.632 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_syncfs_on_mksnap": "true", 2023-10-08T07:05:52.632 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_use_invalidate_cb": "true", 2023-10-08T07:05:52.632 INFO:teuthology.orchestra.run.smithi017.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-10-08T07:05:52.632 INFO:teuthology.orchestra.run.smithi017.stdout: "gss_target_name": "ceph", 2023-10-08T07:05:52.632 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_file": "", 2023-10-08T07:05:52.633 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_inject_failure": "0", 2023-10-08T07:05:52.633 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_interval": "5", 2023-10-08T07:05:52.633 INFO:teuthology.orchestra.run.smithi017.stdout: "host": "smithi017", 2023-10-08T07:05:52.633 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-10-08T07:05:52.633 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-10-08T07:05:52.633 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_max_size": "1073741824", 2023-10-08T07:05:52.633 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-10-08T07:05:52.633 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-10-08T07:05:52.633 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-10-08T07:05:52.633 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-10-08T07:05:52.633 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-10-08T07:05:52.633 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-10-08T07:05:52.634 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-10-08T07:05:52.634 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-10-08T07:05:52.634 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-10-08T07:05:52.634 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_watermark": "0.900000", 2023-10-08T07:05:52.634 INFO:teuthology.orchestra.run.smithi017.stdout: "inject_early_sigterm": "false", 2023-10-08T07:05:52.634 INFO:teuthology.orchestra.run.smithi017.stdout: "jaeger_agent_port": "6799", 2023-10-08T07:05:52.634 INFO:teuthology.orchestra.run.smithi017.stdout: "jaeger_tracing_enable": "false", 2023-10-08T07:05:52.634 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_aio": "true", 2023-10-08T07:05:52.634 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_align_min_size": "65536", 2023-10-08T07:05:52.634 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_block_align": "true", 2023-10-08T07:05:52.634 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_block_size": "4096", 2023-10-08T07:05:52.635 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_dio": "true", 2023-10-08T07:05:52.635 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_discard": "false", 2023-10-08T07:05:52.635 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_force_aio": "false", 2023-10-08T07:05:52.635 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_ignore_corruption": "false", 2023-10-08T07:05:52.635 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_max_write_bytes": "10485760", 2023-10-08T07:05:52.635 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_max_write_entries": "100", 2023-10-08T07:05:52.635 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_replay_from": "0", 2023-10-08T07:05:52.635 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_high_multiple": "0.000000", 2023-10-08T07:05:52.635 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-10-08T07:05:52.635 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-10-08T07:05:52.635 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_max_multiple": "0.000000", 2023-10-08T07:05:52.635 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_write_header_frequency": "0", 2023-10-08T07:05:52.636 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_zero_on_create": "false", 2023-10-08T07:05:52.636 INFO:teuthology.orchestra.run.smithi017.stdout: "journaler_prefetch_periods": "10", 2023-10-08T07:05:52.636 INFO:teuthology.orchestra.run.smithi017.stdout: "journaler_prezero_periods": "5", 2023-10-08T07:05:52.636 INFO:teuthology.orchestra.run.smithi017.stdout: "journaler_write_head_interval": "15", 2023-10-08T07:05:52.636 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "", 2023-10-08T07:05:52.636 INFO:teuthology.orchestra.run.smithi017.stdout: "keyfile": "", 2023-10-08T07:05:52.636 INFO:teuthology.orchestra.run.smithi017.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-10-08T07:05:52.636 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_backend": "rocksdb", 2023-10-08T07:05:52.636 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_default_stripe_size": "65536", 2023-10-08T07:05:52.636 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_fsck_on_mount": "false", 2023-10-08T07:05:52.636 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_fsck_on_mount_deep": "true", 2023-10-08T07:05:52.636 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_max_bytes": "67108864", 2023-10-08T07:05:52.637 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_max_ops": "512", 2023-10-08T07:05:52.637 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_nid_prealloc": "1024", 2023-10-08T07:05:52.637 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_onode_map_size": "1024", 2023-10-08T07:05:52.637 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-10-08T07:05:52.637 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_sync_submit_transaction": "false", 2023-10-08T07:05:52.637 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_sync_transaction": "false", 2023-10-08T07:05:52.637 INFO:teuthology.orchestra.run.smithi017.stdout: "librados_thread_count": "2", 2023-10-08T07:05:52.637 INFO:teuthology.orchestra.run.smithi017.stdout: "lockdep": "false", 2023-10-08T07:05:52.637 INFO:teuthology.orchestra.run.smithi017.stdout: "lockdep_force_backtrace": "false", 2023-10-08T07:05:52.637 INFO:teuthology.orchestra.run.smithi017.stdout: "log_coarse_timestamps": "true", 2023-10-08T07:05:52.637 INFO:teuthology.orchestra.run.smithi017.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-10-08T07:05:52.637 INFO:teuthology.orchestra.run.smithi017.stdout: "log_flush_on_exit": "false", 2023-10-08T07:05:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_graylog_host": "127.0.0.1", 2023-10-08T07:05:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_graylog_port": "12201", 2023-10-08T07:05:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_max_new": "1000", 2023-10-08T07:05:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_max_recent": "10000", 2023-10-08T07:05:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_stderr_prefix": "", 2023-10-08T07:05:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_stop_at_utilization": "0.970000", 2023-10-08T07:05:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": "true", 2023-10-08T07:05:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_graylog": "false", 2023-10-08T07:05:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_journald": "false", 2023-10-08T07:05:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_stderr": "false", 2023-10-08T07:05:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_syslog": "false", 2023-10-08T07:05:52.638 INFO:teuthology.orchestra.run.smithi017.stdout: "max_rotating_auth_attempts": "10", 2023-10-08T07:05:52.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2023-10-08T07:05:52.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_action_on_write_error": "1", 2023-10-08T07:05:52.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_alternate_name_max": "8192", 2023-10-08T07:05:52.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_asio_thread_count": "2", 2023-10-08T07:05:52.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_export_pin": "true", 2023-10-08T07:05:52.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_dirs": "true", 2023-10-08T07:05:52.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-10-08T07:05:52.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_interval": "5", 2023-10-08T07:05:52.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_size_max": "100000", 2023-10-08T07:05:52.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_idle_threshold": "0.000000", 2023-10-08T07:05:52.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_interval": "10", 2023-10-08T07:05:52.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_max": "-1", 2023-10-08T07:05:52.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_max_until": "-1", 2023-10-08T07:05:52.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_merge_size": "50", 2023-10-08T07:05:52.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_midchunk": "0.300000", 2023-10-08T07:05:52.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_min_rebalance": "0.100000", 2023-10-08T07:05:52.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_min_start": "0.200000", 2023-10-08T07:05:52.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_minchunk": "0.001000", 2023-10-08T07:05:52.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_mode": "0", 2023-10-08T07:05:52.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_need_max": "1.200000", 2023-10-08T07:05:52.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_need_min": "0.800000", 2023-10-08T07:05:52.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_overload_epochs": "2", 2023-10-08T07:05:52.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-10-08T07:05:52.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_sample_interval": "3.000000", 2023-10-08T07:05:52.641 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_bits": "3", 2023-10-08T07:05:52.641 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_rd": "25000.000000", 2023-10-08T07:05:52.641 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_size": "10000", 2023-10-08T07:05:52.641 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_wr": "10000.000000", 2023-10-08T07:05:52.641 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_target_decay": "10.000000", 2023-10-08T07:05:52.641 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-10-08T07:05:52.641 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_beacon_grace": "15.000000", 2023-10-08T07:05:52.641 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_beacon_interval": "4.000000", 2023-10-08T07:05:52.641 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_beacon_mon_down_grace": "60", 2023-10-08T07:05:52.641 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_memory_limit": "4294967296", 2023-10-08T07:05:52.641 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_mid": "0.700000", 2023-10-08T07:05:52.641 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_release_free_interval": "10", 2023-10-08T07:05:52.642 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_reservation": "0.050000", 2023-10-08T07:05:52.642 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-10-08T07:05:52.642 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_trim_interval": "1", 2023-10-08T07:05:52.642 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_trim_threshold": "262144", 2023-10-08T07:05:52.642 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-10-08T07:05:52.642 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-10-08T07:05:52.642 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_client_delegate_inos_pct": "0", 2023-10-08T07:05:52.642 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_client_prealloc_inos": "1000", 2023-10-08T07:05:52.642 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-10-08T07:05:52.642 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_connect_bootstrapping": "false", 2023-10-08T07:05:52.642 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_damage_table_max_entries": "10000", 2023-10-08T07:05:52.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-10-08T07:05:52.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_auth_pins": "false", 2023-10-08T07:05:52.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_frag": "false", 2023-10-08T07:05:52.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_scatterstat": "false", 2023-10-08T07:05:52.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_subtrees": "false", 2023-10-08T07:05:52.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_decay_halflife": "5.000000", 2023-10-08T07:05:52.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_default_dir_hash": "2", 2023-10-08T07:05:52.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_defer_session_stale": "true", 2023-10-08T07:05:52.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_deny_all_reconnect": "false", 2023-10-08T07:05:52.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_keys_per_op": "16384", 2023-10-08T07:05:52.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_max_commit_size": "10", 2023-10-08T07:05:52.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_max_entries": "0", 2023-10-08T07:05:52.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_prefetch": "true", 2023-10-08T07:05:52.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dirstat_min_interval": "1.000000", 2023-10-08T07:05:52.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_after_rejoin": "false", 2023-10-08T07:05:52.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_on_map": "false", 2023-10-08T07:05:52.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_threshold_file": "0", 2023-10-08T07:05:52.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-10-08T07:05:52.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_early_reply": "true", 2023-10-08T07:05:52.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_enable_op_tracker": "true", 2023-10-08T07:05:52.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_enforce_unique_name": "true", 2023-10-08T07:05:52.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_distributed": "true", 2023-10-08T07:05:52.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-10-08T07:05:52.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_random": "true", 2023-10-08T07:05:52.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-10-08T07:05:52.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_extraordinary_events_dump_interval": "0", 2023-10-08T07:05:52.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_forward_all_requests_to_auth": "false", 2023-10-08T07:05:52.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-10-08T07:05:52.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_fscrypt_last_block_max_size": "4096", 2023-10-08T07:05:52.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_go_bad_corrupt_dentry": "true", 2023-10-08T07:05:52.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-10-08T07:05:52.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_health_cache_threshold": "1.500000", 2023-10-08T07:05:52.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_health_summarize_threshold": "10", 2023-10-08T07:05:52.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_heartbeat_grace": "15.000000", 2023-10-08T07:05:52.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_heartbeat_reset_grace": "1000", 2023-10-08T07:05:52.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_health_dummy": "false", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_migrator_session_race": "false", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_skip_replaying_inotable": "false", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_join_fs": "", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_journal_format": "1", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_create_at": "0", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_export_at": "0", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_import_at": "0", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_journal_at": "0", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_journal_expire_at": "0", 2023-10-08T07:05:52.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_journal_replay_at": "0", 2023-10-08T07:05:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_link_at": "0", 2023-10-08T07:05:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_mdstable_at": "0", 2023-10-08T07:05:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_openc_at": "0", 2023-10-08T07:05:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_rename_at": "0", 2023-10-08T07:05:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_shutdown_at": "0", 2023-10-08T07:05:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_skip_replaying_inotable": "false", 2023-10-08T07:05:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_event_large_threshold": "524288", 2023-10-08T07:05:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_events_per_segment": "1024", 2023-10-08T07:05:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_major_segment_event_ratio": "12", 2023-10-08T07:05:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_max_events": "-1", 2023-10-08T07:05:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_max_segments": "128", 2023-10-08T07:05:52.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_pause": "false", 2023-10-08T07:05:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_segment_size": "0", 2023-10-08T07:05:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_skip_corrupt_events": "false", 2023-10-08T07:05:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_skip_unbounded_events": "false", 2023-10-08T07:05:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_warn_factor": "2.000000", 2023-10-08T07:05:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_caps_per_client": "1048576", 2023-10-08T07:05:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_completed_flushes": "100000", 2023-10-08T07:05:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_completed_requests": "100000", 2023-10-08T07:05:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_export_size": "20971520", 2023-10-08T07:05:52.649 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_file_recover": "32", 2023-10-08T07:05:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_purge_files": "64", 2023-10-08T07:05:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_purge_ops": "8192", 2023-10-08T07:05:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-10-08T07:05:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-10-08T07:05:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_snaps_per_dir": "100", 2023-10-08T07:05:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_metrics_update_interval": "2", 2023-10-08T07:05:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_min_caps_per_client": "100", 2023-10-08T07:05:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_min_caps_working_set": "10000", 2023-10-08T07:05:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-10-08T07:05:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_numa_node": "-1", 2023-10-08T07:05:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-10-08T07:05:52.650 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_complaint_time": "30.000000", 2023-10-08T07:05:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_duration": "600", 2023-10-08T07:05:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_size": "20", 2023-10-08T07:05:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_slow_op_size": "20", 2023-10-08T07:05:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_slow_op_threshold": "10", 2023-10-08T07:05:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_log_threshold": "5", 2023-10-08T07:05:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_ping_grace": "15", 2023-10-08T07:05:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_ping_interval": "5", 2023-10-08T07:05:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-10-08T07:05:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-10-08T07:05:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_max_caps": "30000", 2023-10-08T07:05:52.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-10-08T07:05:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_max_decay_threshold": "131072", 2023-10-08T07:05:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-10-08T07:05:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_warning_threshold": "262144", 2023-10-08T07:05:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_reconnect_timeout": "45.000000", 2023-10-08T07:05:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_replay_interval": "1.000000", 2023-10-08T07:05:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-10-08T07:05:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-10-08T07:05:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_root_ino_gid": "0", 2023-10-08T07:05:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_root_ino_uid": "0", 2023-10-08T07:05:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-10-08T07:05:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_blocklist_on_evict": "true", 2023-10-08T07:05:52.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_blocklist_on_timeout": "true", 2023-10-08T07:05:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-10-08T07:05:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-10-08T07:05:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2023-10-08T07:05:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cap_acquisition_throttle": "100000", 2023-10-08T07:05:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-10-08T07:05:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_metadata_threshold": "16777216", 2023-10-08T07:05:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-10-08T07:05:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_shutdown_check": "0", 2023-10-08T07:05:52.653 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_skip_ino": "0", 2023-10-08T07:05:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sleep_rank_change": "0.000000", 2023-10-08T07:05:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_snap_max_uid": "4294967294", 2023-10-08T07:05:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_snap_min_uid": "0", 2023-10-08T07:05:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_snap_rstat": "false", 2023-10-08T07:05:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_standby_replay_damaged": "false", 2023-10-08T07:05:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_symlink_recovery": "true", 2023-10-08T07:05:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_task_status_update_interval": "2.000000", 2023-10-08T07:05:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_thrash_exports": "0", 2023-10-08T07:05:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_thrash_fragments": "0", 2023-10-08T07:05:52.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_tick_interval": "5.000000", 2023-10-08T07:05:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_valgrind_exit": "false", 2023-10-08T07:05:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_verify_backtrace": "1", 2023-10-08T07:05:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_verify_scatter": "false", 2023-10-08T07:05:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_wipe_ino_prealloc": "false", 2023-10-08T07:05:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_wipe_sessions": "false", 2023-10-08T07:05:52.655 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool_debug": "false", 2023-10-08T07:05:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_debug_omit_block_device_write": "false", 2023-10-08T07:05:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_device_bytes": "1073741824", 2023-10-08T07:05:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_page_set": "false", 2023-10-08T07:05:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_page_size": "65536", 2023-10-08T07:05:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_client_bytes": "134217728", 2023-10-08T07:05:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_client_messages": "512", 2023-10-08T07:05:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-10-08T07:05:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_connect_retry_interval": "1.000000", 2023-10-08T07:05:52.656 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-10-08T07:05:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-10-08T07:05:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_disabled_modules": "", 2023-10-08T07:05:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-10-08T07:05:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_max_pg_num_change": "128", 2023-10-08T07:05:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mds_bytes": "134217728", 2023-10-08T07:05:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mds_messages": "128", 2023-10-08T07:05:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-10-08T07:05:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mon_bytes": "134217728", 2023-10-08T07:05:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mon_messages": "128", 2023-10-08T07:05:52.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_osd_bytes": "536870912", 2023-10-08T07:05:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_osd_messages": "8192", 2023-10-08T07:05:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_pool": "true", 2023-10-08T07:05:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_service_beacon_grace": "60.000000", 2023-10-08T07:05:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_standby_modules": "true", 2023-10-08T07:05:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_stats_period": "5", 2023-10-08T07:05:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_stats_threshold": "5", 2023-10-08T07:05:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_tick_period": "2", 2023-10-08T07:05:52.658 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-10-08T07:05:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_accept_timeout_factor": "2.000000", 2023-10-08T07:05:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_allow_pool_delete": "true", 2023-10-08T07:05:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_allow_pool_size_one": "true", 2023-10-08T07:05:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_auth_validate_all_caps": "true", 2023-10-08T07:05:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-10-08T07:05:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-10-08T07:05:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_bytes": "104857600", 2023-10-08T07:05:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_directed_command_retry": "2", 2023-10-08T07:05:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval": "3.000000", 2023-10-08T07:05:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-10-08T07:05:52.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-10-08T07:05:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-10-08T07:05:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_parallel": "3", 2023-10-08T07:05:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_log_interval": "1.000000", 2023-10-08T07:05:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-10-08T07:05:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_ping_interval": "10.000000", 2023-10-08T07:05:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_ping_timeout": "30.000000", 2023-10-08T07:05:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_target_rank": "-1", 2023-10-08T07:05:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_clock_drift_allowed": "1.000000", 2023-10-08T07:05:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-10-08T07:05:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-10-08T07:05:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_file_level": "debug", 2023-10-08T07:05:52.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_file": "true", 2023-10-08T07:05:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_graylog": "false", 2023-10-08T07:05:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-10-08T07:05:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-10-08T07:05:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_journald": "false", 2023-10-08T07:05:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_stderr": "false", 2023-10-08T07:05:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-10-08T07:05:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-10-08T07:05:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-10-08T07:05:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_compact_on_bootstrap": "false", 2023-10-08T07:05:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_compact_on_start": "false", 2023-10-08T07:05:52.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_compact_on_trim": "true", 2023-10-08T07:05:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_con_tracker_persist_interval": "10", 2023-10-08T07:05:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_con_tracker_score_halflife": "43200", 2023-10-08T07:05:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_config_key_max_entry_size": "65536", 2023-10-08T07:05:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cpu_threads": "4", 2023-10-08T07:05:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_crush_min_required_version": "hammer", 2023-10-08T07:05:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_daemon_bytes": "419430400", 2023-10-08T07:05:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-10-08T07:05:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data_avail_crit": "5", 2023-10-08T07:05:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data_avail_warn": "5", 2023-10-08T07:05:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data_size_warn": "16106127360", 2023-10-08T07:05:52.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_block_osdmap_trim": "false", 2023-10-08T07:05:52.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-10-08T07:05:52.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_dump_json": "false", 2023-10-08T07:05:52.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-10-08T07:05:52.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_dump_transactions": "false", 2023-10-08T07:05:52.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_extra_checks": "false", 2023-10-08T07:05:52.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-10-08T07:05:52.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-10-08T07:05:52.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_require_quincy": "false", 2023-10-08T07:05:52.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_require_reef": "false", 2023-10-08T07:05:52.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-10-08T07:05:52.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_delta_reset_interval": "10.000000", 2023-10-08T07:05:52.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_dns_srv_name": "ceph-mon", 2023-10-08T07:05:52.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_down_mkfs_grace": "120", 2023-10-08T07:05:52.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_election_default_strategy": "1", 2023-10-08T07:05:52.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_election_timeout": "5.000000", 2023-10-08T07:05:52.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-10-08T07:05:52.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_elector_ping_divisor": "2", 2023-10-08T07:05:52.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_elector_ping_timeout": "2.000000", 2023-10-08T07:05:52.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_enable_op_tracker": "true", 2023-10-08T07:05:52.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_fake_pool_delete": "false", 2023-10-08T07:05:52.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_force_quorum_join": "false", 2023-10-08T07:05:52.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_globalid_prealloc": "10000", 2023-10-08T07:05:52.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_detail_to_clog": "false", 2023-10-08T07:05:52.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_log_update_period": "5", 2023-10-08T07:05:52.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_max_detail": "50", 2023-10-08T07:05:52.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_to_clog": "true", 2023-10-08T07:05:52.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_to_clog_interval": "600", 2023-10-08T07:05:52.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-10-08T07:05:52.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_host": "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],[v2:172.21.15.17:3302,v1:172.21.15.17:6791]", 2023-10-08T07:05:52.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_host_override": "", 2023-10-08T07:05:52.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_initial_members": "", 2023-10-08T07:05:52.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-10-08T07:05:52.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-10-08T07:05:52.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-10-08T07:05:52.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-10-08T07:05:52.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_keyvaluedb": "rocksdb", 2023-10-08T07:05:52.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_lease": "5.000000", 2023-10-08T07:05:52.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-10-08T07:05:52.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-10-08T07:05:52.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_log_full_interval": "50", 2023-10-08T07:05:52.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_log_max": "10000", 2023-10-08T07:05:52.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_log_max_summary": "50", 2023-10-08T07:05:52.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_log_entries_per_event": "4096", 2023-10-08T07:05:52.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_log_epochs": "500", 2023-10-08T07:05:52.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_mdsmap_epochs": "500", 2023-10-08T07:05:52.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_mgrmap_epochs": "500", 2023-10-08T07:05:52.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_osd": "10000", 2023-10-08T07:05:52.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_pg_per_osd": "10000", 2023-10-08T07:05:52.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_pool_pg_num": "65536", 2023-10-08T07:05:52.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-10-08T07:05:52.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-10-08T07:05:52.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mds_force_trim_to": "0", 2023-10-08T07:05:52.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mds_skip_sanity": "false", 2023-10-08T07:05:52.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_memory_autotune": "true", 2023-10-08T07:05:52.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_memory_target": "2147483648", 2023-10-08T07:05:52.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_beacon_grace": "30", 2023-10-08T07:05:52.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-10-08T07:05:52.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_digest_period": "5", 2023-10-08T07:05:52.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_inactive_grace": "60", 2023-10-08T07:05:52.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_mkfs_grace": "240", 2023-10-08T07:05:52.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-10-08T07:05:52.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_min_osdmap_epochs": "500", 2023-10-08T07:05:52.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_complaint_time": "30", 2023-10-08T07:05:52.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_duration": "600", 2023-10-08T07:05:52.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_size": "20", 2023-10-08T07:05:52.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_slow_op_size": "20", 2023-10-08T07:05:52.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_slow_op_threshold": "10", 2023-10-08T07:05:52.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_log_threshold": "5", 2023-10-08T07:05:52.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-10-08T07:05:52.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-10-08T07:05:52.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-10-08T07:05:52.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_auto_mark_in": "false", 2023-10-08T07:05:52.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_auto_mark_new_in": "true", 2023-10-08T07:05:52.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-10-08T07:05:52.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-10-08T07:05:52.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_cache_size": "500", 2023-10-08T07:05:52.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_cache_size_min": "134217728", 2023-10-08T07:05:52.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_crush_smoke_test": "true", 2023-10-08T07:05:52.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_destroyed_out_interval": "600", 2023-10-08T07:05:52.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_down_out_interval": "600", 2023-10-08T07:05:52.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-10-08T07:05:52.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-10-08T07:05:52.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_force_trim_to": "0", 2023-10-08T07:05:52.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_full_ratio": "0.950000", 2023-10-08T07:05:52.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-10-08T07:05:52.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_laggy_halflife": "3600", 2023-10-08T07:05:52.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_laggy_max_interval": "300", 2023-10-08T07:05:52.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_laggy_weight": "0.300000", 2023-10-08T07:05:52.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-10-08T07:05:52.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_max_creating_pgs": "1024", 2023-10-08T07:05:52.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_max_initial_pgs": "1024", 2023-10-08T07:05:52.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_min_down_reporters": "2", 2023-10-08T07:05:52.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-10-08T07:05:52.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-10-08T07:05:52.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-10-08T07:05:52.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_prime_pg_temp": "true", 2023-10-08T07:05:52.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-10-08T07:05:52.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-10-08T07:05:52.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_report_timeout": "900", 2023-10-08T07:05:52.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-10-08T07:05:52.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-10-08T07:05:52.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_warn_num_repaired": "10", 2023-10-08T07:05:52.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_warn_op_age": "32.000000", 2023-10-08T07:05:52.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-10-08T07:05:52.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_interval": "10", 2023-10-08T07:05:52.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_min": "10000", 2023-10-08T07:05:52.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_txsize": "100", 2023-10-08T07:05:52.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-10-08T07:05:52.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_stuck_threshold": "60", 2023-10-08T07:05:52.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-10-08T07:05:52.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_min_objects": "10000", 2023-10-08T07:05:52.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_min_per_osd": "0", 2023-10-08T07:05:52.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-10-08T07:05:52.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pool_quota_crit_threshold": "0", 2023-10-08T07:05:52.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pool_quota_warn_threshold": "0", 2023-10-08T07:05:52.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_probe_timeout": "2.000000", 2023-10-08T07:05:52.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_max_change": "0.050000", 2023-10-08T07:05:52.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_max_osds": "4", 2023-10-08T07:05:52.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-10-08T07:05:52.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-10-08T07:05:52.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-10-08T07:05:52.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-10-08T07:05:52.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-10-08T07:05:52.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_interval": "86400", 2023-10-08T07:05:52.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_max_keys": "100", 2023-10-08T07:05:52.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_timeout": "300", 2023-10-08T07:05:52.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_session_timeout": "300", 2023-10-08T07:05:52.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_smart_report_timeout": "5", 2023-10-08T07:05:52.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stat_smooth_intervals": "6", 2023-10-08T07:05:52.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-10-08T07:05:52.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_pool_min_size": "2", 2023-10-08T07:05:52.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_pool_size": "4", 2023-10-08T07:05:52.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-10-08T07:05:52.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_subscribe_interval": "86400.000000", 2023-10-08T07:05:52.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_debug": "false", 2023-10-08T07:05:52.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_max_payload_keys": "2000", 2023-10-08T07:05:52.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_max_payload_size": "1048576", 2023-10-08T07:05:52.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_provider_kill_at": "0", 2023-10-08T07:05:52.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_requester_kill_at": "0", 2023-10-08T07:05:52.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_timeout": "60.000000", 2023-10-08T07:05:52.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_target_pg_per_osd": "100", 2023-10-08T07:05:52.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_tick_interval": "5", 2023-10-08T07:05:52.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_timecheck_interval": "300.000000", 2023-10-08T07:05:52.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-10-08T07:05:52.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_use_min_delay_socket": "false", 2023-10-08T07:05:52.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_older_version_delay": "604800", 2023-10-08T07:05:52.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-10-08T07:05:52.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-10-08T07:05:52.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-10-08T07:05:52.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_filestore_osds": "false", 2023-10-08T07:05:52.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-10-08T07:05:52.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-10-08T07:05:52.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-10-08T07:05:52.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_misplaced": "false", 2023-10-08T07:05:52.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-10-08T07:05:52.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_older_version": "true", 2023-10-08T07:05:52.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-10-08T07:05:52.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_pool_no_app": "true", 2023-10-08T07:05:52.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-10-08T07:05:52.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-10-08T07:05:52.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-10-08T07:05:52.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-10-08T07:05:52.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_too_few_osds": "false", 2023-10-08T07:05:52.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-10-08T07:05:52.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-10-08T07:05:52.677 INFO:teuthology.orchestra.run.smithi017.stdout: "monmap": "", 2023-10-08T07:05:52.677 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-10-08T07:05:52.677 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2023-10-08T07:05:52.677 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2023-10-08T07:05:52.677 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-10-08T07:05:52.677 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2023-10-08T07:05:52.678 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2023-10-08T07:05:52.678 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_tracing_enabled": "false", 2023-10-08T07:05:52.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_op_threads": "3", 2023-10-08T07:05:52.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_buffer_size": "131072", 2023-10-08T07:05:52.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_cm": "false", 2023-10-08T07:05:52.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_device_name": "", 2023-10-08T07:05:52.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_dscp": "96", 2023-10-08T07:05:52.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-10-08T07:05:52.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_gid_idx": "0", 2023-10-08T07:05:52.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_local_gid": "", 2023-10-08T07:05:52.678 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_polling_us": "1000", 2023-10-08T07:05:52.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_port_num": "1", 2023-10-08T07:05:52.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-10-08T07:05:52.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-10-08T07:05:52.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_roce_ver": "1", 2023-10-08T07:05:52.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_send_buffers": "1024", 2023-10-08T07:05:52.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_sl": "3", 2023-10-08T07:05:52.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_support_srq": "true", 2023-10-08T07:05:52.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_type": "ib", 2023-10-08T07:05:52.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_reap_threshold": "5", 2023-10-08T07:05:52.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_before_connect": "false", 2023-10-08T07:05:52.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_ipv4": "true", 2023-10-08T07:05:52.679 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_ipv6": "false", 2023-10-08T07:05:52.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_msgr1": "true", 2023-10-08T07:05:52.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_msgr2": "true", 2023-10-08T07:05:52.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_port_max": "7568", 2023-10-08T07:05:52.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_port_min": "6800", 2023-10-08T07:05:52.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_prefer_ipv4": "false", 2023-10-08T07:05:52.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_retry_count": "3", 2023-10-08T07:05:52.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_retry_delay": "5", 2023-10-08T07:05:52.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_client": "false", 2023-10-08T07:05:52.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_mds": "false", 2023-10-08T07:05:52.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_mgr": "false", 2023-10-08T07:05:52.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_mon": "false", 2023-10-08T07:05:52.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_osd": "false", 2023-10-08T07:05:52.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_client_mode": "crc secure", 2023-10-08T07:05:52.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_cluster_mode": "crc secure", 2023-10-08T07:05:52.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_cluster_type": "", 2023-10-08T07:05:52.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_compress_secure": "false", 2023-10-08T07:05:52.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_connection_idle_timeout": "900", 2023-10-08T07:05:52.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_connection_ready_timeout": "10", 2023-10-08T07:05:52.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_crc_data": "true", 2023-10-08T07:05:52.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_crc_header": "true", 2023-10-08T07:05:52.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_bad_msg": "false", 2023-10-08T07:05:52.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_bug": "true", 2023-10-08T07:05:52.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_old_message": "true", 2023-10-08T07:05:52.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_skipped_message": "false", 2023-10-08T07:05:52.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_unhandled_msg": "false", 2023-10-08T07:05:52.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-10-08T07:05:52.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_coremask": "0xF", 2023-10-08T07:05:52.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-10-08T07:05:52.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_devs_allowlist": "", 2023-10-08T07:05:52.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_enable_tso": "true", 2023-10-08T07:05:52.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-10-08T07:05:52.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-10-08T07:05:52.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_hugepages": "", 2023-10-08T07:05:52.682 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_hw_flow_control": "true", 2023-10-08T07:05:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-10-08T07:05:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_lro": "true", 2023-10-08T07:05:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_memory_channel": "4", 2023-10-08T07:05:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-10-08T07:05:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_pmd": "", 2023-10-08T07:05:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_port_id": "0", 2023-10-08T07:05:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-10-08T07:05:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dump_corrupt_message_level": "1", 2023-10-08T07:05:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dump_on_send": "false", 2023-10-08T07:05:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_initial_backoff": "0.200000", 2023-10-08T07:05:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_delay_max": "1.000000", 2023-10-08T07:05:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_delay_probability": "0.000000", 2023-10-08T07:05:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_delay_type": "", 2023-10-08T07:05:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_internal_delays": "0.000000", 2023-10-08T07:05:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_network_congestion": "0", 2023-10-08T07:05:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_socket_failures": "0", 2023-10-08T07:05:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_learn_addr_from_peer": "true", 2023-10-08T07:05:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_max_accept_failures": "4", 2023-10-08T07:05:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_max_backoff": "15.000000", 2023-10-08T07:05:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_mon_client_mode": "secure crc", 2023-10-08T07:05:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_mon_cluster_mode": "secure crc", 2023-10-08T07:05:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_mon_service_mode": "secure crc", 2023-10-08T07:05:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_osd_compress_min_size": "1024", 2023-10-08T07:05:52.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_osd_compress_mode": "none", 2023-10-08T07:05:52.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_osd_compression_algorithm": "snappy", 2023-10-08T07:05:52.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2023-10-08T07:05:52.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_pq_min_cost": "65536", 2023-10-08T07:05:52.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_public_type": "", 2023-10-08T07:05:52.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_service_mode": "crc secure", 2023-10-08T07:05:52.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_listen_backlog": "512", 2023-10-08T07:05:52.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_nodelay": "true", 2023-10-08T07:05:52.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_prefetch_max_size": "4096", 2023-10-08T07:05:52.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_rcvbuf": "0", 2023-10-08T07:05:52.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_type": "async+posix", 2023-10-08T07:05:52.686 INFO:teuthology.orchestra.run.smithi017.stdout: "no_config_file": "false", 2023-10-08T07:05:52.686 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_completion_locks_per_session": "32", 2023-10-08T07:05:52.686 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_debug_inject_relock_delay": "false", 2023-10-08T07:05:52.686 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_inflight_op_bytes": "104857600", 2023-10-08T07:05:52.686 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_inflight_ops": "1024", 2023-10-08T07:05:52.686 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_inject_no_watch_ping": "false", 2023-10-08T07:05:52.686 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_retry_writes_after_first_reply": "false", 2023-10-08T07:05:52.686 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_tick_interval": "5.000000", 2023-10-08T07:05:52.686 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_timeout": "10.000000", 2023-10-08T07:05:52.686 INFO:teuthology.orchestra.run.smithi017.stdout: "objectstore_blackhole": "false", 2023-10-08T07:05:52.686 INFO:teuthology.orchestra.run.smithi017.stdout: "openssl_engine_opts": "", 2023-10-08T07:05:52.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_delay_time": "5.000000", 2023-10-08T07:05:52.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_hist_halflife": "1000", 2023-10-08T07:05:52.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_max_low_ops": "2", 2023-10-08T07:05:52.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_max_ops": "4", 2023-10-08T07:05:52.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_min_evict_effort": "0.100000", 2023-10-08T07:05:52.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_quantize_effort": "0.100000", 2023-10-08T07:05:52.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_slop": "0.020000", 2023-10-08T07:05:52.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_aggregated_slow_ops_logging": "true", 2023-10-08T07:05:52.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_allow_recovery_below_min_size": "true", 2023-10-08T07:05:52.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_asio_thread_count": "2", 2023-10-08T07:05:52.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_async_recovery_min_cost": "100", 2023-10-08T07:05:52.687 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_auto_mark_unfound_lost": "false", 2023-10-08T07:05:52.688 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backfill_retry_interval": "30.000000", 2023-10-08T07:05:52.688 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backfill_scan_max": "512", 2023-10-08T07:05:52.688 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backfill_scan_min": "64", 2023-10-08T07:05:52.688 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backoff_on_degraded": "false", 2023-10-08T07:05:52.688 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backoff_on_peering": "false", 2023-10-08T07:05:52.688 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backoff_on_unfound": "true", 2023-10-08T07:05:52.688 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_beacon_report_interval": "300", 2023-10-08T07:05:52.688 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_duration": "30", 2023-10-08T07:05:52.688 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_large_size_max_throughput": "104857600", 2023-10-08T07:05:52.688 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_max_block_size": "67108864", 2023-10-08T07:05:52.688 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_small_size_max_iops": "100", 2023-10-08T07:05:52.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_blkin_trace_all": "false", 2023-10-08T07:05:52.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_blocked_scrub_grace_period": "120", 2023-10-08T07:05:52.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2023-10-08T07:05:52.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2023-10-08T07:05:52.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2023-10-08T07:05:52.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_check_for_log_corruption": "false", 2023-10-08T07:05:52.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_check_max_object_name_len_on_startup": "true", 2023-10-08T07:05:52.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-10-08T07:05:52.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2023-10-08T07:05:52.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-10-08T07:05:52.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_update_on_start": "true", 2023-10-08T07:05:52.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_message_cap": "256", 2023-10-08T07:05:52.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_message_size_cap": "524288000", 2023-10-08T07:05:52.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_op_priority": "63", 2023-10-08T07:05:52.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_watch_timeout": "30", 2023-10-08T07:05:52.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_command_max_records": "256", 2023-10-08T07:05:52.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_compact_on_start": "false", 2023-10-08T07:05:52.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_copyfrom_max_chunk": "8388608", 2023-10-08T07:05:52.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_chooseleaf_type": "0", 2023-10-08T07:05:52.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_initial_weight": "-1.000000", 2023-10-08T07:05:52.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_update_on_start": "true", 2023-10-08T07:05:52.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_update_weight_set": "true", 2023-10-08T07:05:52.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2023-10-08T07:05:52.690 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2023-10-08T07:05:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2023-10-08T07:05:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_drop_ping_duration": "0", 2023-10-08T07:05:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_drop_ping_probability": "0.000000", 2023-10-08T07:05:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_feed_pullee": "-1", 2023-10-08T07:05:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_inject_copyfrom_error": "false", 2023-10-08T07:05:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2023-10-08T07:05:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2023-10-08T07:05:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_misdirected_ops": "false", 2023-10-08T07:05:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_no_acting_change": "false", 2023-10-08T07:05:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_no_purge_strays": "false", 2023-10-08T07:05:52.691 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_op_order": "false", 2023-10-08T07:05:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_pg_log_writeout": "false", 2023-10-08T07:05:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_pretend_recovery_active": "false", 2023-10-08T07:05:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_random_push_read_error": "0.000000", 2023-10-08T07:05:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2023-10-08T07:05:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_shutdown": "false", 2023-10-08T07:05:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2023-10-08T07:05:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2023-10-08T07:05:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_cached_snaps": "false", 2023-10-08T07:05:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_missing_on_start": "false", 2023-10-08T07:05:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_snaps": "false", 2023-10-08T07:05:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_stray_on_activate": "false", 2023-10-08T07:05:52.692 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_interval": "604800.000000", 2023-10-08T07:05:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_keys": "1024", 2023-10-08T07:05:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2023-10-08T07:05:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2023-10-08T07:05:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2023-10-08T07:05:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_stride": "524288", 2023-10-08T07:05:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2023-10-08T07:05:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_default_data_pool_replay_window": "5", 2023-10-08T07:05:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_default_notify_timeout": "30", 2023-10-08T07:05:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep": "0.000000", 2023-10-08T07:05:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep_hdd": "5.000000", 2023-10-08T07:05:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep_hybrid": "1.000000", 2023-10-08T07:05:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep_ssd": "1.000000", 2023-10-08T07:05:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_discard_disconnected_ops": "true", 2023-10-08T07:05:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_enable_op_tracker": "true", 2023-10-08T07:05:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2023-10-08T07:05:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_extblkdev_plugins": "vdo", 2023-10-08T07:05:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_failsafe_full_ratio": "0.970000", 2023-10-08T07:05:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_fail_on_connection_refused": "true", 2023-10-08T07:05:52.694 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_info": "true", 2023-10-08T07:05:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_shutdown": "true", 2023-10-08T07:05:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_shutdown_notify_mon": "true", 2023-10-08T07:05:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_shutdown_timeout": "15", 2023-10-08T07:05:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_find_best_info_ignore_history_les": "false", 2023-10-08T07:05:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_force_auth_primary_missing_objects": "100", 2023-10-08T07:05:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2023-10-08T07:05:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_function_tracing": "false", 2023-10-08T07:05:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_grace": "20", 2023-10-08T07:05:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_interval": "6", 2023-10-08T07:05:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2023-10-08T07:05:52.695 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_min_peers": "10", 2023-10-08T07:05:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_min_size": "2000", 2023-10-08T07:05:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_stale": "600", 2023-10-08T07:05:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2023-10-08T07:05:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_hit_set_max_size": "100000", 2023-10-08T07:05:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_hit_set_min_size": "1000", 2023-10-08T07:05:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_hit_set_namespace": ".ceph-internal", 2023-10-08T07:05:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_ignore_stale_divergent_priors": "false", 2023-10-08T07:05:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2023-10-08T07:05:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_inject_failure_on_pg_removal": "false", 2023-10-08T07:05:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2023-10-08T07:05:52.696 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_journal_flush_on_shutdown": "true", 2023-10-08T07:05:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_journal_size": "5120", 2023-10-08T07:05:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_kill_backfill_at": "0", 2023-10-08T07:05:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_loop_before_reset_tphandle": "64", 2023-10-08T07:05:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_cache_size": "50", 2023-10-08T07:05:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_dedup": "true", 2023-10-08T07:05:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_message_max": "40", 2023-10-08T07:05:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_message_max_bytes": "10485760", 2023-10-08T07:05:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_share_max_epochs": "40", 2023-10-08T07:05:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_attr_name_len": "100", 2023-10-08T07:05:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_attr_size": "0", 2023-10-08T07:05:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_backfills": "1", 2023-10-08T07:05:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_markdown_count": "5", 2023-10-08T07:05:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_markdown_period": "600", 2023-10-08T07:05:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_object_name_len": "2048", 2023-10-08T07:05:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_object_namespace_len": "256", 2023-10-08T07:05:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_object_size": "134217728", 2023-10-08T07:05:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2023-10-08T07:05:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_omap_entries_per_request": "1024", 2023-10-08T07:05:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pg_blocked_by": "16", 2023-10-08T07:05:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pg_log_entries": "10000", 2023-10-08T07:05:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2023-10-08T07:05:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pgls": "1024", 2023-10-08T07:05:52.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_push_cost": "8388608", 2023-10-08T07:05:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_push_objects": "10", 2023-10-08T07:05:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_scrubs": "3", 2023-10-08T07:05:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2023-10-08T07:05:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_trimming_pgs": "2", 2023-10-08T07:05:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_write_op_reply_len": "64", 2023-10-08T07:05:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_write_size": "90", 2023-10-08T07:05:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2023-10-08T07:05:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2023-10-08T07:05:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2023-10-08T07:05:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2023-10-08T07:05:52.699 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2023-10-08T07:05:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2023-10-08T07:05:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2023-10-08T07:05:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_override_recovery_settings": "false", 2023-10-08T07:05:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_profile": "balanced", 2023-10-08T07:05:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2023-10-08T07:05:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2023-10-08T07:05:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2023-10-08T07:05:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2023-10-08T07:05:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2023-10-08T07:05:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2023-10-08T07:05:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2023-10-08T07:05:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2023-10-08T07:05:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2023-10-08T07:05:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_client_wgt": "1", 2023-10-08T07:05:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_skip_benchmark": "false", 2023-10-08T07:05:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_base": "805306368", 2023-10-08T07:05:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_cache_min": "134217728", 2023-10-08T07:05:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_cache_resize_interval": "1.000000", 2023-10-08T07:05:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_expected_fragmentation": "0.150000", 2023-10-08T07:05:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_target": "4294967296", 2023-10-08T07:05:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_target_autotune": "false", 2023-10-08T07:05:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2023-10-08T07:05:52.701 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_min_pg_log_entries": "250", 2023-10-08T07:05:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_min_recovery_priority": "0", 2023-10-08T07:05:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_heartbeat_interval": "30", 2023-10-08T07:05:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2023-10-08T07:05:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_report_interval": "5", 2023-10-08T07:05:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_report_max_in_flight": "2", 2023-10-08T07:05:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_shutdown_timeout": "5.000000", 2023-10-08T07:05:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_num_cache_shards": "32", 2023-10-08T07:05:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_num_op_tracker_shard": "32", 2023-10-08T07:05:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_numa_auto_affinity": "true", 2023-10-08T07:05:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_numa_node": "-1", 2023-10-08T07:05:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_numa_prefer_iface": "true", 2023-10-08T07:05:52.702 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_object_clean_region_max_num_intervals": "10", 2023-10-08T07:05:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objecter_finishers": "1", 2023-10-08T07:05:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore": "bluestore", 2023-10-08T07:05:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore_fuse": "false", 2023-10-08T07:05:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore_tracing": "false", 2023-10-08T07:05:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_complaint_time": "30.000000", 2023-10-08T07:05:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_duration": "600", 2023-10-08T07:05:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_size": "20", 2023-10-08T07:05:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_slow_op_size": "20", 2023-10-08T07:05:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2023-10-08T07:05:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_log_threshold": "5", 2023-10-08T07:05:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_shards": "0", 2023-10-08T07:05:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_shards_hdd": "5", 2023-10-08T07:05:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_shards_ssd": "8", 2023-10-08T07:05:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_threads_per_shard": "0", 2023-10-08T07:05:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2023-10-08T07:05:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2023-10-08T07:05:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2023-10-08T07:05:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_pq_min_cost": "65536", 2023-10-08T07:05:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_queue": "mclock_scheduler", 2023-10-08T07:05:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_queue_cut_off": "high", 2023-10-08T07:05:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_thread_suicide_timeout": "150", 2023-10-08T07:05:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_thread_timeout": "15", 2023-10-08T07:05:52.704 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_open_classes_on_start": "true", 2023-10-08T07:05:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_os_flags": "0", 2023-10-08T07:05:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_peering_op_priority": "255", 2023-10-08T07:05:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_delete_cost": "1048576", 2023-10-08T07:05:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_delete_priority": "5", 2023-10-08T07:05:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2023-10-08T07:05:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2023-10-08T07:05:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_log_dups_tracked": "10000", 2023-10-08T07:05:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_log_trim_max": "10000", 2023-10-08T07:05:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_log_trim_min": "100", 2023-10-08T07:05:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2023-10-08T07:05:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_object_context_cache_count": "64", 2023-10-08T07:05:52.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_stat_report_interval_max": "500", 2023-10-08T07:05:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2023-10-08T07:05:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_min_evict_age": "0", 2023-10-08T07:05:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_min_flush_age": "0", 2023-10-08T07:05:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2023-10-08T07:05:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2023-10-08T07:05:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2023-10-08T07:05:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_crimson": "false", 2023-10-08T07:05:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_crush_rule": "-1", 2023-10-08T07:05:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_ec_fast_read": "false", 2023-10-08T07:05:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2023-10-08T07:05:52.706 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_bulk": "false", 2023-10-08T07:05:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_hashpspool": "true", 2023-10-08T07:05:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_nodelete": "false", 2023-10-08T07:05:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_nopgchange": "false", 2023-10-08T07:05:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_nosizechange": "false", 2023-10-08T07:05:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flags": "0", 2023-10-08T07:05:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2023-10-08T07:05:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_min_size": "0", 2023-10-08T07:05:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2023-10-08T07:05:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_pg_num": "32", 2023-10-08T07:05:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_pgp_num": "0", 2023-10-08T07:05:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2023-10-08T07:05:52.707 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_size": "2", 2023-10-08T07:05:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_type": "replicated", 2023-10-08T07:05:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2023-10-08T07:05:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_use_gmt_hitset": "true", 2023-10-08T07:05:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_push_per_object_cost": "1000", 2023-10-08T07:05:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_read_ec_check_for_errors": "false", 2023-10-08T07:05:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recover_clone_overlap": "true", 2023-10-08T07:05:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recover_clone_overlap_limit": "10", 2023-10-08T07:05:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_cost": "20971520", 2023-10-08T07:05:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_delay_start": "0.000000", 2023-10-08T07:05:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_active": "0", 2023-10-08T07:05:52.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_active_hdd": "3", 2023-10-08T07:05:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_active_ssd": "10", 2023-10-08T07:05:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_chunk": "8388608", 2023-10-08T07:05:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2023-10-08T07:05:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_single_start": "1", 2023-10-08T07:05:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_op_priority": "3", 2023-10-08T07:05:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_op_warn_multiple": "16", 2023-10-08T07:05:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_priority": "5", 2023-10-08T07:05:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_retry_interval": "30.000000", 2023-10-08T07:05:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep": "0.000000", 2023-10-08T07:05:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep_hdd": "0.100000", 2023-10-08T07:05:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2023-10-08T07:05:52.709 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep_ssd": "0.000000", 2023-10-08T07:05:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_repair_during_recovery": "false", 2023-10-08T07:05:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_requested_scrub_priority": "120", 2023-10-08T07:05:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2023-10-08T07:05:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_rollback_to_cluster_snap": "", 2023-10-08T07:05:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_auto_repair": "false", 2023-10-08T07:05:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_auto_repair_num_errors": "5", 2023-10-08T07:05:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_backoff_ratio": "0.660000", 2023-10-08T07:05:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_begin_hour": "0", 2023-10-08T07:05:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_begin_week_day": "0", 2023-10-08T07:05:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_chunk_max": "25", 2023-10-08T07:05:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_chunk_min": "5", 2023-10-08T07:05:52.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_cost": "52428800", 2023-10-08T07:05:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_during_recovery": "false", 2023-10-08T07:05:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_end_hour": "0", 2023-10-08T07:05:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_end_week_day": "0", 2023-10-08T07:05:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_event_cost": "4096", 2023-10-08T07:05:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_extended_sleep": "0.000000", 2023-10-08T07:05:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2023-10-08T07:05:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_invalid_stats": "true", 2023-10-08T07:05:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_load_threshold": "0.500000", 2023-10-08T07:05:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_max_interval": "604800.000000", 2023-10-08T07:05:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_max_preemptions": "5", 2023-10-08T07:05:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_min_interval": "86400.000000", 2023-10-08T07:05:52.711 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_priority": "5", 2023-10-08T07:05:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_reservation_timeout": "5000", 2023-10-08T07:05:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_sleep": "0.000000", 2023-10-08T07:05:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_slow_reservation_response": "2200", 2023-10-08T07:05:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_shallow_scrub_chunk_max": "100", 2023-10-08T07:05:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_shallow_scrub_chunk_min": "50", 2023-10-08T07:05:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_shutdown_pgref_assert": "false", 2023-10-08T07:05:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_skip_data_digest": "false", 2023-10-08T07:05:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_smart_report_timeout": "5", 2023-10-08T07:05:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_cost": "1048576", 2023-10-08T07:05:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_priority": "5", 2023-10-08T07:05:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep": "0.000000", 2023-10-08T07:05:52.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2023-10-08T07:05:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2023-10-08T07:05:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2023-10-08T07:05:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_stats_update_period_not_scrubbing": "120", 2023-10-08T07:05:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_stats_update_period_scrubbing": "15", 2023-10-08T07:05:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2023-10-08T07:05:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_target_transaction_size": "30", 2023-10-08T07:05:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_count": "4", 2023-10-08T07:05:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2023-10-08T07:05:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2023-10-08T07:05:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2023-10-08T07:05:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2023-10-08T07:05:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2023-10-08T07:05:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2023-10-08T07:05:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_mode": "writeback", 2023-10-08T07:05:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2023-10-08T07:05:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_promote_max_objects_sec": "25", 2023-10-08T07:05:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tracing": "false", 2023-10-08T07:05:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_use_stale_snap": "false", 2023-10-08T07:05:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2023-10-08T07:05:52.714 INFO:teuthology.orchestra.run.smithi017.stdout: "osdc_blkin_trace_all": "false", 2023-10-08T07:05:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_kill_at": "0", 2023-10-08T07:05:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_max_join_drift": "10", 2023-10-08T07:05:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_min": "500", 2023-10-08T07:05:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_min_wait": "0.050000", 2023-10-08T07:05:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_propose_interval": "1.000000", 2023-10-08T07:05:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_service_trim_max": "500", 2023-10-08T07:05:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_service_trim_max_multiplier": "20", 2023-10-08T07:05:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_service_trim_min": "250", 2023-10-08T07:05:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_stash_full_interval": "25", 2023-10-08T07:05:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_trim_max": "500", 2023-10-08T07:05:52.715 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_trim_min": "250", 2023-10-08T07:05:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "perf": "true", 2023-10-08T07:05:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2023-10-08T07:05:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin_crypto_accelerator": "crypto_isal", 2023-10-08T07:05:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin_dir": "/usr/lib64/ceph", 2023-10-08T07:05:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "-", 2023-10-08T07:05:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrv": "", 2023-10-08T07:05:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "public_bind_addr": "-", 2023-10-08T07:05:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "public_network": "", 2023-10-08T07:05:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "public_network_interface": "", 2023-10-08T07:05:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "qat_compressor_enabled": "false", 2023-10-08T07:05:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "qat_compressor_session_max_number": "256", 2023-10-08T07:05:52.716 INFO:teuthology.orchestra.run.smithi017.stdout: "rados_mon_op_timeout": "0", 2023-10-08T07:05:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rados_osd_op_timeout": "0", 2023-10-08T07:05:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rados_tracing": "false", 2023-10-08T07:05:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_atime_update_interval": "60", 2023-10-08T07:05:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2023-10-08T07:05:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_balance_parent_reads": "false", 2023-10-08T07:05:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_balance_snap_reads": "false", 2023-10-08T07:05:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_blkin_trace_all": "false", 2023-10-08T07:05:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_blocklist_expire_seconds": "0", 2023-10-08T07:05:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_blocklist_on_break_lock": "true", 2023-10-08T07:05:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache": "true", 2023-10-08T07:05:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_block_writes_upfront": "false", 2023-10-08T07:05:52.717 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_max_dirty": "25165824", 2023-10-08T07:05:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_max_dirty_age": "1.000000", 2023-10-08T07:05:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_max_dirty_object": "0", 2023-10-08T07:05:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_policy": "writearound", 2023-10-08T07:05:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_size": "33554432", 2023-10-08T07:05:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_target_dirty": "16777216", 2023-10-08T07:05:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_writethrough_until_flush": "true", 2023-10-08T07:05:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_clone_copy_on_read": "false", 2023-10-08T07:05:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_compression_hint": "none", 2023-10-08T07:05:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_concurrent_management_ops": "10", 2023-10-08T07:05:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_config_pool_override_update_timestamp": "0", 2023-10-08T07:05:52.718 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_clone_format": "auto", 2023-10-08T07:05:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_data_pool": "", 2023-10-08T07:05:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_features": "61", 2023-10-08T07:05:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_format": "2", 2023-10-08T07:05:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_map_options": "", 2023-10-08T07:05:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_order": "22", 2023-10-08T07:05:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_pool": "rbd", 2023-10-08T07:05:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2023-10-08T07:05:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_stripe_count": "0", 2023-10-08T07:05:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_stripe_unit": "0", 2023-10-08T07:05:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_disable_zero_copy_writes": "true", 2023-10-08T07:05:52.719 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_discard_granularity_bytes": "65536", 2023-10-08T07:05:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_discard_on_zeroed_write_same": "true", 2023-10-08T07:05:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_enable_alloc_hint": "true", 2023-10-08T07:05:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2023-10-08T07:05:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_io_scheduler": "simple", 2023-10-08T07:05:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2023-10-08T07:05:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_commit_age": "5.000000", 2023-10-08T07:05:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2023-10-08T07:05:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_max_payload_bytes": "16384", 2023-10-08T07:05:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_flush_age": "0.000000", 2023-10-08T07:05:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_flush_bytes": "1048576", 2023-10-08T07:05:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_flush_interval": "0", 2023-10-08T07:05:52.720 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2023-10-08T07:05:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2023-10-08T07:05:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_order": "24", 2023-10-08T07:05:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_pool": "", 2023-10-08T07:05:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_splay_width": "4", 2023-10-08T07:05:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_localize_parent_reads": "false", 2023-10-08T07:05:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_localize_snap_reads": "false", 2023-10-08T07:05:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2023-10-08T07:05:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2023-10-08T07:05:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2023-10-08T07:05:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2023-10-08T07:05:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2023-10-08T07:05:52.721 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2023-10-08T07:05:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_type": "simple", 2023-10-08T07:05:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2023-10-08T07:05:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_state_check_interval": "30", 2023-10-08T07:05:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2023-10-08T07:05:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2023-10-08T07:05:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2023-10-08T07:05:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2023-10-08T07:05:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2023-10-08T07:05:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_autotune": "true", 2023-10-08T07:05:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_base": "805306368", 2023-10-08T07:05:52.722 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2023-10-08T07:05:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_cache_min": "134217728", 2023-10-08T07:05:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2023-10-08T07:05:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2023-10-08T07:05:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_target": "4294967296", 2023-10-08T07:05:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_perf_stats_prio": "5", 2023-10-08T07:05:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2023-10-08T07:05:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2023-10-08T07:05:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_delete_delay": "0", 2023-10-08T07:05:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2023-10-08T07:05:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_replay_delay": "0", 2023-10-08T07:05:52.723 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2023-10-08T07:05:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2023-10-08T07:05:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_move_to_trash_on_remove": "false", 2023-10-08T07:05:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2023-10-08T07:05:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mtime_update_interval": "60", 2023-10-08T07:05:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_non_blocking_aio": "true", 2023-10-08T07:05:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_op_thread_timeout": "60", 2023-10-08T07:05:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_op_threads": "1", 2023-10-08T07:05:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_parent_cache_enabled": "false", 2023-10-08T07:05:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_persistent_cache_mode": "disabled", 2023-10-08T07:05:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_persistent_cache_path": "/tmp", 2023-10-08T07:05:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_persistent_cache_size": "1073741824", 2023-10-08T07:05:52.724 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_plugins": "", 2023-10-08T07:05:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_bps_burst": "0", 2023-10-08T07:05:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_bps_burst_seconds": "1", 2023-10-08T07:05:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_bps_limit": "0", 2023-10-08T07:05:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_exclude_ops": "0", 2023-10-08T07:05:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_iops_burst": "0", 2023-10-08T07:05:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_iops_burst_seconds": "1", 2023-10-08T07:05:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_iops_limit": "0", 2023-10-08T07:05:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_bps_burst": "0", 2023-10-08T07:05:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2023-10-08T07:05:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_bps_limit": "0", 2023-10-08T07:05:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_iops_burst": "0", 2023-10-08T07:05:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2023-10-08T07:05:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_iops_limit": "0", 2023-10-08T07:05:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_schedule_tick_min": "50", 2023-10-08T07:05:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_bps_burst": "0", 2023-10-08T07:05:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2023-10-08T07:05:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_bps_limit": "0", 2023-10-08T07:05:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_iops_burst": "0", 2023-10-08T07:05:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2023-10-08T07:05:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_iops_limit": "0", 2023-10-08T07:05:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_quiesce_notification_attempts": "10", 2023-10-08T07:05:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_read_from_replica_policy": "default", 2023-10-08T07:05:52.726 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2023-10-08T07:05:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_readahead_max_bytes": "524288", 2023-10-08T07:05:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_readahead_trigger_requests": "10", 2023-10-08T07:05:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_request_timed_out_seconds": "30", 2023-10-08T07:05:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_skip_partial_discard": "true", 2023-10-08T07:05:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2023-10-08T07:05:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_tracing": "false", 2023-10-08T07:05:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_validate_names": "true", 2023-10-08T07:05:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_validate_pool": "true", 2023-10-08T07:05:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "restapi_base_url": "", 2023-10-08T07:05:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "restapi_log_level": "", 2023-10-08T07:05:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_acl_grants_max_num": "100", 2023-10-08T07:05:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_admin_entry": "admin", 2023-10-08T07:05:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2023-10-08T07:05:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_backend_store": "rados", 2023-10-08T07:05:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_barbican_url": "", 2023-10-08T07:05:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_beast_enable_async": "true", 2023-10-08T07:05:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2023-10-08T07:05:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_default_quota_max_size": "-1", 2023-10-08T07:05:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_index_max_aio": "128", 2023-10-08T07:05:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2023-10-08T07:05:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_quota_cache_size": "10000", 2023-10-08T07:05:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_quota_ttl": "600", 2023-10-08T07:05:52.728 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_sync_spawn_window": "20", 2023-10-08T07:05:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cache_enabled": "true", 2023-10-08T07:05:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cache_expiry_interval": "900", 2023-10-08T07:05:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cache_lru_size": "10000", 2023-10-08T07:05:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_config_store": "rados", 2023-10-08T07:05:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_content_length_compat": "false", 2023-10-08T07:05:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_copy_obj_progress": "true", 2023-10-08T07:05:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2023-10-08T07:05:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cors_rules_max_num": "100", 2023-10-08T07:05:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cross_domain_policy": "", 2023-10-08T07:05:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_default_encryption_key": "", 2023-10-08T07:05:52.729 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_addr": "", 2023-10-08T07:05:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_ca_path": "", 2023-10-08T07:05:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_client_cert": "", 2023-10-08T07:05:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_client_key": "", 2023-10-08T07:05:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_kms_key_template": "", 2023-10-08T07:05:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_password": "", 2023-10-08T07:05:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2023-10-08T07:05:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_username": "", 2023-10-08T07:05:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_require_ssl": "true", 2023-10-08T07:05:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2023-10-08T07:05:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2023-10-08T07:05:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_backend": "vault", 2023-10-08T07:05:52.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2023-10-08T07:05:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2023-10-08T07:05:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2023-10-08T07:05:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2023-10-08T07:05:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2023-10-08T07:05:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2023-10-08T07:05:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2023-10-08T07:05:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2023-10-08T07:05:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2023-10-08T07:05:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2023-10-08T07:05:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2023-10-08T07:05:52.731 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_suppress_logs": "true", 2023-10-08T07:05:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_addr": "", 2023-10-08T07:05:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_auth": "token", 2023-10-08T07:05:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_namespace": "", 2023-10-08T07:05:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_prefix": "", 2023-10-08T07:05:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_secret_engine": "transit", 2023-10-08T07:05:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_ssl_cacert": "", 2023-10-08T07:05:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2023-10-08T07:05:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2023-10-08T07:05:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_token_file": "", 2023-10-08T07:05:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_verify_ssl": "true", 2023-10-08T07:05:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_buffersize": "524288", 2023-10-08T07:05:52.732 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_low_speed_limit": "1024", 2023-10-08T07:05:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_low_speed_time": "300", 2023-10-08T07:05:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_tcp_keepalive": "0", 2023-10-08T07:05:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_wait_timeout_ms": "1000", 2023-10-08T07:05:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2023-10-08T07:05:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2023-10-08T07:05:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2023-10-08T07:05:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2023-10-08T07:05:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_fadvise": "4", 2023-10-08T07:05:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2023-10-08T07:05:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_libaio_aio_num": "64", 2023-10-08T07:05:52.733 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_libaio_aio_threads": "20", 2023-10-08T07:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_host": "127.0.0.1", 2023-10-08T07:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_port": "6379", 2023-10-08T07:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2023-10-08T07:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_changes_size": "1000", 2023-10-08T07:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_num_shards": "128", 2023-10-08T07:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_obj_prefix": "data_log", 2023-10-08T07:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_window": "30", 2023-10-08T07:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_notify_interval_msec": "0", 2023-10-08T07:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_sync_poll_interval": "20", 2023-10-08T07:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_sync_spawn_window": "20", 2023-10-08T07:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2023-10-08T07:05:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_debug_inject_set_olh_err": "0", 2023-10-08T07:05:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_data_log_backing": "fifo", 2023-10-08T07:05:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_realm_info_oid": "default.realm", 2023-10-08T07:05:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_region_info_oid": "default.region", 2023-10-08T07:05:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_zone_info_oid": "default.zone", 2023-10-08T07:05:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2023-10-08T07:05:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_defer_to_bucket_acls": "", 2023-10-08T07:05:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_delete_multi_obj_max_num": "1000", 2023-10-08T07:05:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_admin_lim": "0.000000", 2023-10-08T07:05:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_admin_res": "100.000000", 2023-10-08T07:05:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2023-10-08T07:05:52.735 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_auth_lim": "0.000000", 2023-10-08T07:05:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_auth_res": "200.000000", 2023-10-08T07:05:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2023-10-08T07:05:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_data_lim": "0.000000", 2023-10-08T07:05:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_data_res": "500.000000", 2023-10-08T07:05:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_data_wgt": "500.000000", 2023-10-08T07:05:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2023-10-08T07:05:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_metadata_res": "500.000000", 2023-10-08T07:05:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2023-10-08T07:05:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dns_name": "", 2023-10-08T07:05:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dns_s3website_name": "", 2023-10-08T07:05:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dynamic_resharding": "true", 2023-10-08T07:05:52.736 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2023-10-08T07:05:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_gc_threads": "true", 2023-10-08T07:05:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_lc_threads": "true", 2023-10-08T07:05:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_ops_log": "false", 2023-10-08T07:05:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_quota_threads": "true", 2023-10-08T07:05:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_static_website": "false", 2023-10-08T07:05:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_usage_log": "false", 2023-10-08T07:05:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enforce_swift_acls": "true", 2023-10-08T07:05:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_exit_timeout_secs": "120", 2023-10-08T07:05:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_expose_bucket": "false", 2023-10-08T07:05:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_extended_http_attrs": "", 2023-10-08T07:05:52.737 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_filter": "none", 2023-10-08T07:05:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2023-10-08T07:05:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_frontends": "beast port=7480", 2023-10-08T07:05:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_concurrent_io": "10", 2023-10-08T07:05:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_deferred": "50", 2023-10-08T07:05:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2023-10-08T07:05:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_objs": "32", 2023-10-08T07:05:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_queue_size": "134213632", 2023-10-08T07:05:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_trim_chunk": "16", 2023-10-08T07:05:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_obj_min_wait": "7200", 2023-10-08T07:05:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_processor_max_time": "3600", 2023-10-08T07:05:52.738 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_processor_period": "3600", 2023-10-08T07:05:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_get_obj_max_req_size": "4194304", 2023-10-08T07:05:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_get_obj_window_size": "16777216", 2023-10-08T07:05:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_healthcheck_disabling_path": "", 2023-10-08T07:05:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ignore_get_invalid_range": "false", 2023-10-08T07:05:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_init_timeout": "300", 2023-10-08T07:05:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2023-10-08T07:05:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2023-10-08T07:05:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_accepted_admin_roles": "", 2023-10-08T07:05:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_accepted_reader_roles": "", 2023-10-08T07:05:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2023-10-08T07:05:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_domain": "", 2023-10-08T07:05:52.739 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_password": "", 2023-10-08T07:05:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_password_path": "", 2023-10-08T07:05:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_project": "", 2023-10-08T07:05:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_tenant": "", 2023-10-08T07:05:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_token": "", 2023-10-08T07:05:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_token_path": "", 2023-10-08T07:05:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_user": "", 2023-10-08T07:05:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_api_version": "2", 2023-10-08T07:05:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_domain": "", 2023-10-08T07:05:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_password": "", 2023-10-08T07:05:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_project": "", 2023-10-08T07:05:52.740 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_tenant": "", 2023-10-08T07:05:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_user": "", 2023-10-08T07:05:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2023-10-08T07:05:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_implicit_tenants": "false", 2023-10-08T07:05:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2023-10-08T07:05:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_service_token_enabled": "false", 2023-10-08T07:05:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_token_cache_size": "10000", 2023-10-08T07:05:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_url": "", 2023-10-08T07:05:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_verify_ssl": "true", 2023-10-08T07:05:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_debug_interval": "-1", 2023-10-08T07:05:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_lock_max_time": "90", 2023-10-08T07:05:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_objs": "32", 2023-10-08T07:05:52.741 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_rules": "1000", 2023-10-08T07:05:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_worker": "3", 2023-10-08T07:05:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_wp_worker": "3", 2023-10-08T07:05:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_thread_delay": "0", 2023-10-08T07:05:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2023-10-08T07:05:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_dnattr": "uid", 2023-10-08T07:05:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2023-10-08T07:05:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_searchfilter": "", 2023-10-08T07:05:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2023-10-08T07:05:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_uri": "ldaps://", 2023-10-08T07:05:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2023-10-08T07:05:52.742 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_list_bucket_min_readahead": "1000", 2023-10-08T07:05:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_list_buckets_max_chunk": "1000", 2023-10-08T07:05:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_http_headers": "", 2023-10-08T07:05:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_nonexistent_bucket": "false", 2023-10-08T07:05:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2023-10-08T07:05:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_object_name_utc": "false", 2023-10-08T07:05:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lua_max_memory_per_state": "128000", 2023-10-08T07:05:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2023-10-08T07:05:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_attr_name_len": "0", 2023-10-08T07:05:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_attr_size": "0", 2023-10-08T07:05:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_attrs_num_in_req": "0", 2023-10-08T07:05:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_chunk_size": "4194304", 2023-10-08T07:05:52.743 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_concurrent_requests": "1024", 2023-10-08T07:05:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2023-10-08T07:05:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_dynamic_shards": "1999", 2023-10-08T07:05:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_listing_results": "1000", 2023-10-08T07:05:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_notify_retries": "10", 2023-10-08T07:05:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_objs_per_shard": "100000", 2023-10-08T07:05:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_put_param_size": "1048576", 2023-10-08T07:05:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_put_size": "5368709120", 2023-10-08T07:05:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_slo_entries": "1000", 2023-10-08T07:05:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_md_log_max_shards": "64", 2023-10-08T07:05:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_md_notify_interval_msec": "200", 2023-10-08T07:05:52.744 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_meta_sync_poll_interval": "20", 2023-10-08T07:05:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_meta_sync_spawn_window": "20", 2023-10-08T07:05:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_mime_types_file": "/etc/mime.types", 2023-10-08T07:05:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_mp_lock_max_time": "600", 2023-10-08T07:05:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_multi_obj_del_max_aio": "16", 2023-10-08T07:05:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_multipart_min_part_size": "5242880", 2023-10-08T07:05:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_multipart_part_upload_limit": "10000", 2023-10-08T07:05:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_fhcache_partitions": "3", 2023-10-08T07:05:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_fhcache_size": "2017", 2023-10-08T07:05:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_frontends": "rgw-nfs", 2023-10-08T07:05:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2023-10-08T07:05:52.745 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_lru_lanes": "5", 2023-10-08T07:05:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_max_gc": "300", 2023-10-08T07:05:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_namespace_expire_secs": "300", 2023-10-08T07:05:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_gc_threads": "false", 2023-10-08T07:05:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_lc_threads": "false", 2023-10-08T07:05:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_quota_threads": "false", 2023-10-08T07:05:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_sync_thread": "false", 2023-10-08T07:05:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_s3_fast_attrs": "false", 2023-10-08T07:05:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_write_completion_interval_s": "10", 2023-10-08T07:05:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_num_async_rados_threads": "32", 2023-10-08T07:05:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_num_control_oids": "8", 2023-10-08T07:05:52.746 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_numa_node": "-1", 2023-10-08T07:05:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_obj_stripe_size": "4194304", 2023-10-08T07:05:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_obj_tombstone_cache_size": "1000", 2023-10-08T07:05:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_objexp_chunk_size": "100", 2023-10-08T07:05:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_objexp_gc_interval": "600", 2023-10-08T07:05:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_objexp_hints_num_shards": "127", 2023-10-08T07:05:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_olh_pending_timeout_sec": "3600", 2023-10-08T07:05:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_op_thread_suicide_timeout": "0", 2023-10-08T07:05:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_op_thread_timeout": "600", 2023-10-08T07:05:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_op_tracing": "false", 2023-10-08T07:05:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_opa_token": "", 2023-10-08T07:05:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_opa_url": "", 2023-10-08T07:05:52.747 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_opa_verify_ssl": "true", 2023-10-08T07:05:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_data_backlog": "5242880", 2023-10-08T07:05:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2023-10-08T07:05:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_rados": "false", 2023-10-08T07:05:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_socket_path": "", 2023-10-08T07:05:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_override_bucket_index_max_shards": "0", 2023-10-08T07:05:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2023-10-08T07:05:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2023-10-08T07:05:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_push_interval": "2.000000", 2023-10-08T07:05:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_push_interval_max": "30.000000", 2023-10-08T07:05:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_root_pool": ".rgw.root", 2023-10-08T07:05:52.748 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_policy_reject_invalid_principals": "true", 2023-10-08T07:05:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2023-10-08T07:05:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_cache_lanes": "3", 2023-10-08T07:05:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_cache_lmdb_count": "3", 2023-10-08T07:05:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_cache_max_buckets": "100", 2023-10-08T07:05:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_cache_partitions": "3", 2023-10-08T07:05:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2023-10-08T07:05:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_print_continue": "true", 2023-10-08T07:05:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_print_prohibited_content_length": "false", 2023-10-08T07:05:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_put_obj_max_window_size": "67108864", 2023-10-08T07:05:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_put_obj_min_window_size": "16777216", 2023-10-08T07:05:52.749 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2023-10-08T07:05:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rados_pool_recovery_priority": "5", 2023-10-08T07:05:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rados_tracing": "false", 2023-10-08T07:05:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_realm": "", 2023-10-08T07:05:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_realm_id": "", 2023-10-08T07:05:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_realm_root_pool": ".rgw.root", 2023-10-08T07:05:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_region": "", 2023-10-08T07:05:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_region_root_pool": ".rgw.root", 2023-10-08T07:05:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_relaxed_region_enforcement": "false", 2023-10-08T07:05:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_relaxed_s3_bucket_names": "false", 2023-10-08T07:05:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2023-10-08T07:05:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_request_uri": "", 2023-10-08T07:05:52.750 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_batch_size": "64", 2023-10-08T07:05:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_bucket_lock_duration": "360", 2023-10-08T07:05:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_max_aio": "128", 2023-10-08T07:05:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_num_logs": "16", 2023-10-08T07:05:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_thread_interval": "600", 2023-10-08T07:05:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_resolve_cname": "false", 2023-10-08T07:05:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rest_getusage_op_compat": "false", 2023-10-08T07:05:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_run_sync_thread": "true", 2023-10-08T07:05:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_order": "sts, external, local", 2023-10-08T07:05:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_keystone": "false", 2023-10-08T07:05:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_ldap": "false", 2023-10-08T07:05:52.751 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_rados": "true", 2023-10-08T07:05:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_sts": "false", 2023-10-08T07:05:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_client_max_sig_ver": "-1", 2023-10-08T07:05:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_success_create_obj_status": "0", 2023-10-08T07:05:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_safe_max_objects_per_shard": "102400", 2023-10-08T07:05:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_scheduler_type": "throttler", 2023-10-08T07:05:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_script_uri": "", 2023-10-08T07:05:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_service_provider_name": "", 2023-10-08T07:05:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_shard_warning_threshold": "90.000000", 2023-10-08T07:05:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_client_id": "", 2023-10-08T07:05:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_client_secret": "", 2023-10-08T07:05:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_entry": "sts", 2023-10-08T07:05:52.752 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_key": "sts", 2023-10-08T07:05:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_max_session_duration": "43200", 2023-10-08T07:05:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_min_session_duration": "900", 2023-10-08T07:05:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_token_introspection_url": "", 2023-10-08T07:05:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_account_in_url": "false", 2023-10-08T07:05:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_auth_entry": "auth", 2023-10-08T07:05:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_auth_url": "", 2023-10-08T07:05:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_custom_header": "", 2023-10-08T07:05:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_enforce_content_length": "false", 2023-10-08T07:05:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_need_stats": "true", 2023-10-08T07:05:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_tenant_name": "", 2023-10-08T07:05:52.753 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_token_expiration": "86400", 2023-10-08T07:05:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_url": "", 2023-10-08T07:05:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_url_prefix": "swift", 2023-10-08T07:05:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_versioning_enabled": "false", 2023-10-08T07:05:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2023-10-08T07:05:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2023-10-08T07:05:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_lease_period": "120", 2023-10-08T07:05:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2023-10-08T07:05:52.754 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_interval": "1200", 2023-10-08T07:05:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_max_buckets": "16", 2023-10-08T07:05:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2023-10-08T07:05:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2023-10-08T07:05:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_obj_etag_verify": "false", 2023-10-08T07:05:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_trace_history_size": "4096", 2023-10-08T07:05:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_trace_per_node_log_size": "32", 2023-10-08T07:05:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2023-10-08T07:05:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_thread_pool_size": "512", 2023-10-08T07:05:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_topic_persistency_max_retries": "0", 2023-10-08T07:05:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_topic_persistency_sleep_duration": "0", 2023-10-08T07:05:52.755 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_topic_persistency_time_to_live": "0", 2023-10-08T07:05:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_comment": "", 2023-10-08T07:05:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_createby": "", 2023-10-08T07:05:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_encoding": "", 2023-10-08T07:05:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_flag": "false", 2023-10-08T07:05:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_max_size": "5368709120", 2023-10-08T07:05:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_origin": "", 2023-10-08T07:05:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_sha_unit": "524288", 2023-10-08T07:05:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_tracker": "", 2023-10-08T07:05:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_trust_forwarded_https": "false", 2023-10-08T07:05:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_log_flush_threshold": "1024", 2023-10-08T07:05:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_log_tick_interval": "30", 2023-10-08T07:05:52.756 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_max_shards": "32", 2023-10-08T07:05:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_max_user_shards": "1", 2023-10-08T07:05:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_use_opa_authz": "false", 2023-10-08T07:05:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_default_quota_max_objects": "-1", 2023-10-08T07:05:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_default_quota_max_size": "-1", 2023-10-08T07:05:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_max_buckets": "1000", 2023-10-08T07:05:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_policies_max_num": "100", 2023-10-08T07:05:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2023-10-08T07:05:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_sync_idle_users": "false", 2023-10-08T07:05:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_sync_interval": "86400", 2023-10-08T07:05:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_sync_wait_time": "86400", 2023-10-08T07:05:52.757 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_unique_email": "true", 2023-10-08T07:05:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_verify_ssl": "true", 2023-10-08T07:05:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_website_routing_rules_max_num": "50", 2023-10-08T07:05:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zone": "", 2023-10-08T07:05:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zone_id": "", 2023-10-08T07:05:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zone_root_pool": ".rgw.root", 2023-10-08T07:05:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zonegroup": "", 2023-10-08T07:05:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zonegroup_id": "", 2023-10-08T07:05:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2023-10-08T07:05:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "rgwlc_auto_session_clear": "true", 2023-10-08T07:05:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "rgwlc_skip_bucket_step": "false", 2023-10-08T07:05:52.758 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_block_size": "4096", 2023-10-08T07:05:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_bloom_bits_per_key": "20", 2023-10-08T07:05:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2023-10-08T07:05:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2023-10-08T07:05:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_row_ratio": "0.000000", 2023-10-08T07:05:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_shard_bits": "4", 2023-10-08T07:05:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_size": "536870912", 2023-10-08T07:05:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_type": "binned_lru", 2023-10-08T07:05:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cf_compact_on_deletion": "true", 2023-10-08T07:05:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2023-10-08T07:05:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2023-10-08T07:05:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_collect_compaction_stats": "false", 2023-10-08T07:05:52.759 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_collect_extended_stats": "false", 2023-10-08T07:05:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_collect_memory_stats": "false", 2023-10-08T07:05:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_delete_range_threshold": "1048576", 2023-10-08T07:05:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_index_type": "binary_search", 2023-10-08T07:05:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_log_to_ceph_log": "true", 2023-10-08T07:05:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_metadata_block_size": "4096", 2023-10-08T07:05:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_partition_filters": "false", 2023-10-08T07:05:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_perf": "false", 2023-10-08T07:05:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2023-10-08T07:05:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "rotating_keys_bootstrap_timeout": "30", 2023-10-08T07:05:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "rotating_keys_renewal_timeout": "10", 2023-10-08T07:05:52.760 INFO:teuthology.orchestra.run.smithi017.stdout: "run_dir": "/var/run/ceph", 2023-10-08T07:05:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_block_create": "true", 2023-10-08T07:05:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_cache_lru_size": "67108864", 2023-10-08T07:05:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_cbjournal_size": "5368709120", 2023-10-08T07:05:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_default_max_object_size": "16777216", 2023-10-08T07:05:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_default_object_metadata_reservation": "16777216", 2023-10-08T07:05:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_device_size": "53687091200", 2023-10-08T07:05:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_batch_capacity": "16", 2023-10-08T07:05:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_batch_flush_size": "16777216", 2023-10-08T07:05:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2023-10-08T07:05:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_iodepth_limit": "5", 2023-10-08T07:05:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_main_device_type": "SSD", 2023-10-08T07:05:52.761 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_max_concurrent_transactions": "8", 2023-10-08T07:05:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2023-10-08T07:05:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2023-10-08T07:05:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2023-10-08T07:05:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_obj_data_write_amplification": "1.250000", 2023-10-08T07:05:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_segment_size": "67108864", 2023-10-08T07:05:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "set_keepcaps": "false", 2023-10-08T07:05:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "setgroup": "", 2023-10-08T07:05:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "setuser": "", 2023-10-08T07:05:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "setuser_match_path": "", 2023-10-08T07:05:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_misplaced_ratio": "0.050000", 2023-10-08T07:05:52.762 INFO:teuthology.orchestra.run.smithi017.stdout: "thp": "false", 2023-10-08T07:05:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: "threadpool_default_timeout": "60", 2023-10-08T07:05:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: "threadpool_empty_queue_max_wait": "2", 2023-10-08T07:05:52.763 INFO:teuthology.orchestra.run.smithi017.stdout: "throttler_perf_counter": "true" 2023-10-08T07:05:52.763 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-08T07:05:52.765 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2023-10-08T07:05:52.903 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a: {} 2023-10-08T07:05:52.912 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b: {} 2023-10-08T07:05:52.922 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c: {} 2023-10-08T07:05:52.923 INFO:teuthology.orchestra.run.smithi017.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-10-08T07:05:52.924 INFO:teuthology.orchestra.run.smithi017.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-10-08T07:05:52.924 INFO:teuthology.orchestra.run.smithi017.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-10-08T07:05:52.934 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2023-10-08T07:05:52.935 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-08T07:05:52.962 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-08T07:05:52.963 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-08T07:05:52.963 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-08T07:05:52.963 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T07:05:52.963 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T07:05:52.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:52.964 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-08T07:05:52.964 INFO:tasks.thrashosds.thrasher:starting do_thrash 2023-10-08T07:05:52.965 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T07:05:52.965 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T07:05:52.965 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-10-08T07:05:52.965 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-10-08T07:05:52.965 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2023-10-08T07:05:52.966 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2023-10-08T07:05:52.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:05:52.966 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2023-10-08T07:05:52.967 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:05:52.967 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2023-10-08T07:05:52.967 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T07:05:52.969 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:52.966+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:52.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:52.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-10-08T07:05:53.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:05:53.064 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2023-10-08T07:05:53.064 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-08T07:05:53.065 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T07:05:53.067 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:53.067+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:53.114 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:05:53.114 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:05:53.115 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:05:53.115 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:05:53.125 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:05:53.142 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:05:53.163 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:05:53.170 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:53.169+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:53.184 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:05:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:05:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T07:05:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:05:53.258 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:53.258 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:53.268 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:05:53.309 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:53.308+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:53.333 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-08T07:05:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 19, 2023-10-08T07:05:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "bb50b5dc-93de-4177-9c34-354ea3b007d0", 2023-10-08T07:05:53.333 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-10-08T07:05:10.233885+0000", 2023-10-08T07:05:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-10-08T07:05:34.310228+0000", 2023-10-08T07:05:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-10-08T07:05:18.991889+0000", 2023-10-08T07:05:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-10-08T07:05:11.167705+0000", 2023-10-08T07:05:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T07:05:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5799936, 2023-10-08T07:05:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-10-08T07:05:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-10-08T07:05:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-10-08T07:05:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-10-08T07:05:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-10-08T07:05:53.334 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-08T07:05:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-10-08T07:05:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.94999998807907104, 2023-10-08T07:05:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-08T07:05:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-08T07:05:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-10-08T07:05:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 4, 2023-10-08T07:05:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 3, 2023-10-08T07:05:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-10-08T07:05:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-10-08T07:05:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-10-08T07:05:53.335 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-10-08T07:05:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-10-08T07:05:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-10-08T07:05:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-10-08T07:05:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-10-08T07:05:20.557481+0000", 2023-10-08T07:05:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-08T07:05:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-10-08T07:05:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-10-08T07:05:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-10-08T07:05:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-10-08T07:05:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-10-08T07:05:53.336 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-10-08T07:05:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-10-08T07:05:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T07:05:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T07:05:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-10-08T07:05:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-10-08T07:05:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-10-08T07:05:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-10-08T07:05:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-10-08T07:05:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-10-08T07:05:53.337 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-10-08T07:05:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-10-08T07:05:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-10-08T07:05:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-10-08T07:05:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-10-08T07:05:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-10-08T07:05:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-10-08T07:05:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-10-08T07:05:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.338 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "12", 2023-10-08T07:05:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-10-08T07:05:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T07:05:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T07:05:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-10-08T07:05:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-10-08T07:05:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-10-08T07:05:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-10-08T07:05:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-10-08T07:05:53.339 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-10-08T07:05:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-10-08T07:05:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-10-08T07:05:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-10-08T07:05:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-10-08T07:05:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-10-08T07:05:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-10-08T07:05:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-10-08T07:05:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-10-08T07:05:53.340 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-10-08T07:05:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T07:05:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T07:05:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T07:05:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-10-08T07:05:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-10-08T07:05:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-10-08T07:05:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-10-08T07:05:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-10-08T07:05:53.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-10-08T07:05:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-10-08T07:05:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-10-08T07:05:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-10-08T07:05:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-10-08T07:05:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T07:05:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-10-08T07:05:53.342 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-10-08T07:05:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-10-08T07:05:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-10-08T07:05:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-10-08T07:05:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-10-08T07:05:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-10-08T07:05:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-10-08T07:05:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-10-08T07:05:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-10-08T07:05:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.343 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-10-08T07:05:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 2.9900000095367432, 2023-10-08T07:05:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 2.9900000095367432, 2023-10-08T07:05:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.67000001668930054, 2023-10-08T07:05:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 2, 2023-10-08T07:05:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 2, 2023-10-08T07:05:53.344 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-10-08T07:05:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-10-08T07:05:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-10-08T07:05:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-10-08T07:05:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-10-08T07:05:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-10-08T07:05:25.624853+0000", 2023-10-08T07:05:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-08T07:05:53.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-10-08T07:05:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-10-08T07:05:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-10-08T07:05:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-10-08T07:05:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-10-08T07:05:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-10-08T07:05:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-10-08T07:05:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T07:05:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T07:05:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-10-08T07:05:53.346 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-10-08T07:05:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-10-08T07:05:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-10-08T07:05:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-10-08T07:05:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-10-08T07:05:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-10-08T07:05:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-10-08T07:05:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-10-08T07:05:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-10-08T07:05:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-10-08T07:05:53.347 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-10-08T07:05:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-10-08T07:05:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-10-08T07:05:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "15", 2023-10-08T07:05:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-10-08T07:05:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T07:05:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T07:05:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-10-08T07:05:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-10-08T07:05:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-10-08T07:05:53.348 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-10-08T07:05:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-10-08T07:05:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-10-08T07:05:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-10-08T07:05:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-10-08T07:05:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-10-08T07:05:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-10-08T07:05:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-10-08T07:05:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-10-08T07:05:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-10-08T07:05:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-10-08T07:05:53.349 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-10-08T07:05:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T07:05:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T07:05:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T07:05:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-10-08T07:05:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-10-08T07:05:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-10-08T07:05:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-10-08T07:05:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-10-08T07:05:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-10-08T07:05:53.350 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-10-08T07:05:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-10-08T07:05:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-10-08T07:05:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-10-08T07:05:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T07:05:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-10-08T07:05:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-10-08T07:05:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-10-08T07:05:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-10-08T07:05:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-10-08T07:05:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-10-08T07:05:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-10-08T07:05:53.351 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-10-08T07:05:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-10-08T07:05:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5, 2023-10-08T07:05:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5, 2023-10-08T07:05:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-10-08T07:05:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.5, 2023-10-08T07:05:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.5, 2023-10-08T07:05:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-10-08T07:05:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-10-08T07:05:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-10-08T07:05:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2023-10-08T07:05:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-10-08T07:05:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-10-08T07:05:30.549393+0000", 2023-10-08T07:05:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-08T07:05:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-10-08T07:05:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-10-08T07:05:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-10-08T07:05:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-10-08T07:05:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-10-08T07:05:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-10-08T07:05:53.353 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-10-08T07:05:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T07:05:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T07:05:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-10-08T07:05:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-10-08T07:05:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-10-08T07:05:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-10-08T07:05:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-10-08T07:05:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-10-08T07:05:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-10-08T07:05:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-10-08T07:05:53.354 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-10-08T07:05:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-10-08T07:05:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-10-08T07:05:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-10-08T07:05:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-10-08T07:05:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-10-08T07:05:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.355 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "18", 2023-10-08T07:05:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-10-08T07:05:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T07:05:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T07:05:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-10-08T07:05:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-10-08T07:05:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-10-08T07:05:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-10-08T07:05:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-10-08T07:05:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-10-08T07:05:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-10-08T07:05:53.356 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-10-08T07:05:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-10-08T07:05:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-10-08T07:05:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-10-08T07:05:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-10-08T07:05:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-10-08T07:05:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-10-08T07:05:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-10-08T07:05:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T07:05:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T07:05:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T07:05:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-10-08T07:05:53.357 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-10-08T07:05:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-10-08T07:05:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-10-08T07:05:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-10-08T07:05:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-10-08T07:05:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-10-08T07:05:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-10-08T07:05:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-10-08T07:05:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-10-08T07:05:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T07:05:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-10-08T07:05:53.358 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-10-08T07:05:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-10-08T07:05:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-10-08T07:05:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-10-08T07:05:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-10-08T07:05:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-10-08T07:05:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-10-08T07:05:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-10-08T07:05:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-10-08T07:05:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-10-08T07:05:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-10-08T07:05:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-10-08T07:05:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.1299999952316284, 2023-10-08T07:05:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.1299999952316284, 2023-10-08T07:05:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-10-08T07:05:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-08T07:05:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-08T07:05:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-10-08T07:05:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-10-08T07:05:53.360 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-10-08T07:05:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 4, 2023-10-08T07:05:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-10-08T07:05:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-10-08T07:05:31.693934+0000", 2023-10-08T07:05:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-08T07:05:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-10-08T07:05:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-10-08T07:05:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-10-08T07:05:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-10-08T07:05:53.361 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-10-08T07:05:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-10-08T07:05:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-10-08T07:05:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T07:05:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T07:05:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-10-08T07:05:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-10-08T07:05:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-10-08T07:05:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-10-08T07:05:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-10-08T07:05:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-10-08T07:05:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-10-08T07:05:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-10-08T07:05:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-10-08T07:05:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-10-08T07:05:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-10-08T07:05:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-10-08T07:05:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-10-08T07:05:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-10-08T07:05:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "19", 2023-10-08T07:05:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-10-08T07:05:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T07:05:53.363 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T07:05:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-10-08T07:05:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-10-08T07:05:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-10-08T07:05:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-10-08T07:05:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-10-08T07:05:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-10-08T07:05:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-10-08T07:05:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-10-08T07:05:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-10-08T07:05:53.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-10-08T07:05:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-10-08T07:05:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-10-08T07:05:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-10-08T07:05:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-10-08T07:05:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-10-08T07:05:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T07:05:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T07:05:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T07:05:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-10-08T07:05:53.365 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-10-08T07:05:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-10-08T07:05:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-10-08T07:05:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-10-08T07:05:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-10-08T07:05:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-10-08T07:05:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-10-08T07:05:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-10-08T07:05:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-10-08T07:05:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T07:05:53.366 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-10-08T07:05:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-10-08T07:05:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-10-08T07:05:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-10-08T07:05:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-10-08T07:05:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-10-08T07:05:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-10-08T07:05:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T07:05:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-10-08T07:05:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-10-08T07:05:53.367 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-10-08T07:05:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-10-08T07:05:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.1299999952316284, 2023-10-08T07:05:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.1299999952316284, 2023-10-08T07:05:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 1, 2023-10-08T07:05:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-08T07:05:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-08T07:05:53.368 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-10-08T07:05:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-10-08T07:05:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-10-08T07:05:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-08T07:05:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-10-08T07:05:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-10-08T07:05:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "ba776b12-56dd-4565-ab87-300e9dcd9f20", 2023-10-08T07:05:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-10-08T07:05:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-10-08T07:05:53.369 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-10-08T07:05:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-10-08T07:05:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-10-08T07:05:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-10-08T07:05:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 8, 2023-10-08T07:05:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 17, 2023-10-08T07:05:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-10-08T07:05:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-10-08T07:05:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-10-08T07:05:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:05:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:05:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6800", 2023-10-08T07:05:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:05:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6801", 2023-10-08T07:05:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:05:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-10-08T07:05:53.371 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:05:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:05:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6802", 2023-10-08T07:05:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:05:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6803", 2023-10-08T07:05:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:05:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.372 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-10-08T07:05:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:05:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:05:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6806", 2023-10-08T07:05:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:05:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6807", 2023-10-08T07:05:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:05:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-10-08T07:05:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:05:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:05:53.374 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6804", 2023-10-08T07:05:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:05:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6805", 2023-10-08T07:05:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:05:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.33:6801/1203223037", 2023-10-08T07:05:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.33:6803/1203223037", 2023-10-08T07:05:53.375 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.33:6807/1203223037", 2023-10-08T07:05:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.33:6805/1203223037", 2023-10-08T07:05:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-10-08T07:05:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-10-08T07:05:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-10-08T07:05:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-10-08T07:05:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "69c35118-ff9d-4847-ba6c-37d3e9805dbe", 2023-10-08T07:05:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-10-08T07:05:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-10-08T07:05:53.376 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-10-08T07:05:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-10-08T07:05:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-10-08T07:05:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-10-08T07:05:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 8, 2023-10-08T07:05:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 17, 2023-10-08T07:05:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-10-08T07:05:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-10-08T07:05:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-10-08T07:05:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:05:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:05:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6800", 2023-10-08T07:05:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:05:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6801", 2023-10-08T07:05:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:05:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-10-08T07:05:53.378 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:05:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:05:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6802", 2023-10-08T07:05:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:05:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6803", 2023-10-08T07:05:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:05:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.379 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-10-08T07:05:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:05:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:05:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6806", 2023-10-08T07:05:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:05:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6807", 2023-10-08T07:05:53.380 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:05:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-10-08T07:05:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:05:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:05:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6804", 2023-10-08T07:05:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:05:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6805", 2023-10-08T07:05:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:05:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6801/1966312605", 2023-10-08T07:05:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6803/1966312605", 2023-10-08T07:05:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6807/1966312605", 2023-10-08T07:05:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6805/1966312605", 2023-10-08T07:05:53.382 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-10-08T07:05:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-10-08T07:05:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-10-08T07:05:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-10-08T07:05:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "98332c95-54f9-4263-a295-d2a753d9f200", 2023-10-08T07:05:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-10-08T07:05:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-10-08T07:05:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-10-08T07:05:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-10-08T07:05:53.383 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-10-08T07:05:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-10-08T07:05:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 8, 2023-10-08T07:05:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 17, 2023-10-08T07:05:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-10-08T07:05:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-10-08T07:05:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-10-08T07:05:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:05:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:05:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6800", 2023-10-08T07:05:53.384 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:05:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6801", 2023-10-08T07:05:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:05:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-10-08T07:05:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:05:53.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:05:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6802", 2023-10-08T07:05:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:05:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6803", 2023-10-08T07:05:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:05:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.386 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-10-08T07:05:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:05:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:05:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6806", 2023-10-08T07:05:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:05:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6807", 2023-10-08T07:05:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:05:53.387 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-10-08T07:05:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:05:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:05:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6804", 2023-10-08T07:05:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:05:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:53.388 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6805", 2023-10-08T07:05:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:05:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.144:6801/3675215989", 2023-10-08T07:05:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.144:6803/3675215989", 2023-10-08T07:05:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.144:6807/3675215989", 2023-10-08T07:05:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.144:6805/3675215989", 2023-10-08T07:05:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-10-08T07:05:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-10-08T07:05:53.389 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-10-08T07:05:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:05:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-08T07:05:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-10-08T07:05:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-10-08T07:05:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-10-08T07:05:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-10-08T07:05:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-10-08T07:05:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-10-08T07:05:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-10-08T07:05:53.390 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-10-08T07:05:16.224774+0000", 2023-10-08T07:05:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-10-08T07:05:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-10-08T07:05:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-10-08T07:05:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-10-08T07:05:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-10-08T07:05:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-10-08T07:05:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-10-08T07:05:53.391 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-10-08T07:05:16.302627+0000", 2023-10-08T07:05:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-10-08T07:05:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:05:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-10-08T07:05:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-10-08T07:05:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-10-08T07:05:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-10-08T07:05:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-10-08T07:05:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-10-08T07:05:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-10-08T07:05:16.248056+0000", 2023-10-08T07:05:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-10-08T07:05:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-08T07:05:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-10-08T07:05:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-10-08T07:05:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-10-08T07:05:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-10-08T07:05:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-10-08T07:05:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-10-08T07:05:53.393 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-10-08T07:05:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-10-08T07:05:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-10-08T07:05:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-10-08T07:05:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-10-08T07:05:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-10-08T07:05:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-10-08T07:05:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-10-08T07:05:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-10-08T07:05:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-10-08T07:05:53.394 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-10-08T07:05:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-10-08T07:05:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-10-08T07:05:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-10-08T07:05:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-10-08T07:05:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-10-08T07:05:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-10-08T07:05:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-10-08T07:05:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-10-08T07:05:53.395 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:53.395 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-08T07:05:53.397 INFO:tasks.thrashosds.thrasher:j is {'epoch': 19, 'fsid': 'bb50b5dc-93de-4177-9c34-354ea3b007d0', 'created': '2023-10-08T07:05:10.233885+0000', 'modified': '2023-10-08T07:05:34.310228+0000', 'last_up_change': '2023-10-08T07:05:18.991889+0000', 'last_in_change': '2023-10-08T07:05:11.167705+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T07:05:20.557481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T07:05:25.624853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T07:05:30.549393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T07:05:31.693934+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'ba776b12-56dd-4565-ab87-300e9dcd9f20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6800', 'nonce': 1203223037}, {'type': 'v1', 'addr': '172.21.15.33:6801', 'nonce': 1203223037}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6802', 'nonce': 1203223037}, {'type': 'v1', 'addr': '172.21.15.33:6803', 'nonce': 1203223037}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6806', 'nonce': 1203223037}, {'type': 'v1', 'addr': '172.21.15.33:6807', 'nonce': 1203223037}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6804', 'nonce': 1203223037}, {'type': 'v1', 'addr': '172.21.15.33:6805', 'nonce': 1203223037}]}, 'public_addr': '172.21.15.33:6801/1203223037', 'cluster_addr': '172.21.15.33:6803/1203223037', 'heartbeat_back_addr': '172.21.15.33:6807/1203223037', 'heartbeat_front_addr': '172.21.15.33:6805/1203223037', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '69c35118-ff9d-4847-ba6c-37d3e9805dbe', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6800', 'nonce': 1966312605}, {'type': 'v1', 'addr': '172.21.15.86:6801', 'nonce': 1966312605}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6802', 'nonce': 1966312605}, {'type': 'v1', 'addr': '172.21.15.86:6803', 'nonce': 1966312605}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6806', 'nonce': 1966312605}, {'type': 'v1', 'addr': '172.21.15.86:6807', 'nonce': 1966312605}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6804', 'nonce': 1966312605}, {'type': 'v1', 'addr': '172.21.15.86:6805', 'nonce': 1966312605}]}, 'public_addr': '172.21.15.86:6801/1966312605', 'cluster_addr': '172.21.15.86:6803/1966312605', 'heartbeat_back_addr': '172.21.15.86:6807/1966312605', 'heartbeat_front_addr': '172.21.15.86:6805/1966312605', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '98332c95-54f9-4263-a295-d2a753d9f200', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 3675215989}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 3675215989}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 3675215989}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 3675215989}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 3675215989}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 3675215989}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 3675215989}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 3675215989}]}, 'public_addr': '172.21.15.144:6801/3675215989', 'cluster_addr': '172.21.15.144:6803/3675215989', 'heartbeat_back_addr': '172.21.15.144:6807/3675215989', 'heartbeat_front_addr': '172.21.15.144:6805/3675215989', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T07:05:16.224774+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T07:05:16.302627+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T07:05:16.248056+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-10-08T07:05:53.397 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:05:53.398 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:53.396+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:53.441 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:53.441 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:53.451 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:05:53.498 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:53.497+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:53.502 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T07:05:53.517 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T07:05:53.517 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T07:05:53.518 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-10-08T07:05:53.518 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T07:05:53.518 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T07:05:53.518 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T07:05:53.518 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T07:05:53.518 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T07:05:53.518 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T07:05:53.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:53.519 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-10-08T07:05:53.537 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T07:05:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T07:05:53.537 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T07:05:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-08T07:05:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-10-08T07:05:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-08T07:05:53.538 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T07:05:53.538 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-10-08T07:05:53.539 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T07:05:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-10-08T07:05:53.539 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T07:05:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-10-08T07:05:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T07:05:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42359sec preferred_lft 42359sec 2023-10-08T07:05:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-10-08T07:05:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-08T07:05:53.540 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T07:05:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-10-08T07:05:53.541 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T07:05:53.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:53.542 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-08T07:05:53.544 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-08T07:05:53.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2023-10-08T07:05:53.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2023-10-08T07:05:53.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2023-10-08T07:05:53.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T07:05:53.545 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-08T07:05:53.591 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:53.591 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:53.598 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:53.597+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:53.601 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:05:53.699 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:53.698+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:53.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:53.744 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T07:05:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:05:53.750 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:05:53.764 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-10-08T07:05:52.506712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91108,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024412,"statfs":{"total":289910292480,"available":289816997888,"internally_reserved":0,"allocated":1744896,"data_stored":1358647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":91483475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002907"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361123+0000","last_change":"2023-10-08T07:05:33.319747+0000","last_active":"2023-10-08T07:05:34.361123+0000","last_peered":"2023-10-08T07:05:34.361123+0000","last_clean":"2023-10-08T07:05:34.361123+0000","last_became_active":"2023-10-08T07:05:33.318115+0000","last_became_peered":"2023-10-08T07:05:33.318115+0000","last_unstale":"2023-10-08T07:05:34.361123+0000","last_undegraded":"2023-10-08T07:05:34.361123+0000","last_fullsized":"2023-10-08T07:05:34.361123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360608+0000","last_change":"2023-10-08T07:05:33.322480+0000","last_active":"2023-10-08T07:05:34.360608+0000","last_peered":"2023-10-08T07:05:34.360608+0000","last_clean":"2023-10-08T07:05:34.360608+0000","last_became_active":"2023-10-08T07:05:33.322153+0000","last_became_peered":"2023-10-08T07:05:33.322153+0000","last_unstale":"2023-10-08T07:05:34.360608+0000","last_undegraded":"2023-10-08T07:05:34.360608+0000","last_fullsized":"2023-10-08T07:05:34.360608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:33.325067+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:33.323439+0000","last_became_peered":"2023-10-08T07:05:33.323439+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:18.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320530+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:05:34.320530+0000","last_peered":"2023-10-08T07:05:34.320530+0000","last_clean":"2023-10-08T07:05:34.320530+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:05:34.320530+0000","last_undegraded":"2023-10-08T07:05:34.320530+0000","last_fullsized":"2023-10-08T07:05:34.320530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360128+0000","last_change":"2023-10-08T07:05:33.321314+0000","last_active":"2023-10-08T07:05:34.360128+0000","last_peered":"2023-10-08T07:05:34.360128+0000","last_clean":"2023-10-08T07:05:34.360128+0000","last_became_active":"2023-10-08T07:05:33.320841+0000","last_became_peered":"2023-10-08T07:05:33.320841+0000","last_unstale":"2023-10-08T07:05:34.360128+0000","last_undegraded":"2023-10-08T07:05:34.360128+0000","last_fullsized":"2023-10-08T07:05:34.360128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319725+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:05:34.319725+0000","last_peered":"2023-10-08T07:05:34.319725+0000","last_clean":"2023-10-08T07:05:34.319725+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:05:34.319725+0000","last_undegraded":"2023-10-08T07:05:34.319725+0000","last_fullsized":"2023-10-08T07:05:34.319725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319443+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:05:34.319443+0000","last_peered":"2023-10-08T07:05:34.319443+0000","last_clean":"2023-10-08T07:05:34.319443+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:05:34.319443+0000","last_undegraded":"2023-10-08T07:05:34.319443+0000","last_fullsized":"2023-10-08T07:05:34.319443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319238+0000","last_change":"2023-10-08T07:05:33.327740+0000","last_active":"2023-10-08T07:05:34.319238+0000","last_peered":"2023-10-08T07:05:34.319238+0000","last_clean":"2023-10-08T07:05:34.319238+0000","last_became_active":"2023-10-08T07:05:33.325912+0000","last_became_peered":"2023-10-08T07:05:33.325912+0000","last_unstale":"2023-10-08T07:05:34.319238+0000","last_undegraded":"2023-10-08T07:05:34.319238+0000","last_fullsized":"2023-10-08T07:05:34.319238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319837+0000","last_change":"2023-10-08T07:05:33.322628+0000","last_active":"2023-10-08T07:05:34.319837+0000","last_peered":"2023-10-08T07:05:34.319837+0000","last_clean":"2023-10-08T07:05:34.319837+0000","last_became_active":"2023-10-08T07:05:33.321816+0000","last_became_peered":"2023-10-08T07:05:33.321816+0000","last_unstale":"2023-10-08T07:05:34.319837+0000","last_undegraded":"2023-10-08T07:05:34.319837+0000","last_fullsized":"2023-10-08T07:05:34.319837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360894+0000","last_change":"2023-10-08T07:05:33.322098+0000","last_active":"2023-10-08T07:05:34.360894+0000","last_peered":"2023-10-08T07:05:34.360894+0000","last_clean":"2023-10-08T07:05:34.360894+0000","last_became_active":"2023-10-08T07:05:33.321208+0000","last_became_peered":"2023-10-08T07:05:33.321208+0000","last_unstale":"2023-10-08T07:05:34.360894+0000","last_undegraded":"2023-10-08T07:05:34.360894+0000","last_fullsized":"2023-10-08T07:05:34.360894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320139+0000","last_change":"2023-10-08T07:05:33.328140+0000","last_active":"2023-10-08T07:05:34.320139+0000","last_peered":"2023-10-08T07:05:34.320139+0000","last_clean":"2023-10-08T07:05:34.320139+0000","last_became_active":"2023-10-08T07:05:33.327595+0000","last_became_peered":"2023-10-08T07:05:33.327595+0000","last_unstale":"2023-10-08T07:05:34.320139+0000","last_undegraded":"2023-10-08T07:05:34.320139+0000","last_fullsized":"2023-10-08T07:05:34.320139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360113+0000","last_change":"2023-10-08T07:05:33.329834+0000","last_active":"2023-10-08T07:05:34.360113+0000","last_peered":"2023-10-08T07:05:34.360113+0000","last_clean":"2023-10-08T07:05:34.360113+0000","last_became_active":"2023-10-08T07:05:33.329357+0000","last_became_peered":"2023-10-08T07:05:33.329357+0000","last_unstale":"2023-10-08T07:05:34.360113+0000","last_undegraded":"2023-10-08T07:05:34.360113+0000","last_fullsized":"2023-10-08T07:05:34.360113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360010+0000","last_change":"2023-10-08T07:05:33.319643+0000","last_active":"2023-10-08T07:05:34.360010+0000","last_peered":"2023-10-08T07:05:34.360010+0000","last_clean":"2023-10-08T07:05:34.360010+0000","last_became_active":"2023-10-08T07:05:33.318659+0000","last_became_peered":"2023-10-08T07:05:33.318659+0000","last_unstale":"2023-10-08T07:05:34.360010+0000","last_undegraded":"2023-10-08T07:05:34.360010+0000","last_fullsized":"2023-10-08T07:05:34.360010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320295+0000","last_change":"2023-10-08T07:05:33.318491+0000","last_active":"2023-10-08T07:05:34.320295+0000","last_peered":"2023-10-08T07:05:34.320295+0000","last_clean":"2023-10-08T07:05:34.320295+0000","last_became_active":"2023-10-08T07:05:33.317703+0000","last_became_peered":"2023-10-08T07:05:33.317703+0000","last_unstale":"2023-10-08T07:05:34.320295+0000","last_undegraded":"2023-10-08T07:05:34.320295+0000","last_fullsized":"2023-10-08T07:05:34.320295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.319294+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.318364+0000","last_became_peered":"2023-10-08T07:05:33.318364+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319517+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:05:34.319517+0000","last_peered":"2023-10-08T07:05:34.319517+0000","last_clean":"2023-10-08T07:05:34.319517+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:05:34.319517+0000","last_undegraded":"2023-10-08T07:05:34.319517+0000","last_fullsized":"2023-10-08T07:05:34.319517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319930+0000","last_change":"2023-10-08T07:05:33.317287+0000","last_active":"2023-10-08T07:05:34.319930+0000","last_peered":"2023-10-08T07:05:34.319930+0000","last_clean":"2023-10-08T07:05:34.319930+0000","last_became_active":"2023-10-08T07:05:33.316483+0000","last_became_peered":"2023-10-08T07:05:33.316483+0000","last_unstale":"2023-10-08T07:05:34.319930+0000","last_undegraded":"2023-10-08T07:05:34.319930+0000","last_fullsized":"2023-10-08T07:05:34.319930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361063+0000","last_change":"2023-10-08T07:05:33.321088+0000","last_active":"2023-10-08T07:05:34.361063+0000","last_peered":"2023-10-08T07:05:34.361063+0000","last_clean":"2023-10-08T07:05:34.361063+0000","last_became_active":"2023-10-08T07:05:33.319541+0000","last_became_peered":"2023-10-08T07:05:33.319541+0000","last_unstale":"2023-10-08T07:05:34.361063+0000","last_undegraded":"2023-10-08T07:05:34.361063+0000","last_fullsized":"2023-10-08T07:05:34.361063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319536+0000","last_change":"2023-10-08T07:05:33.322110+0000","last_active":"2023-10-08T07:05:34.319536+0000","last_peered":"2023-10-08T07:05:34.319536+0000","last_clean":"2023-10-08T07:05:34.319536+0000","last_became_active":"2023-10-08T07:05:33.321780+0000","last_became_peered":"2023-10-08T07:05:33.321780+0000","last_unstale":"2023-10-08T07:05:34.319536+0000","last_undegraded":"2023-10-08T07:05:34.319536+0000","last_fullsized":"2023-10-08T07:05:34.319536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320412+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:05:34.320412+0000","last_peered":"2023-10-08T07:05:34.320412+0000","last_clean":"2023-10-08T07:05:34.320412+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:05:34.320412+0000","last_undegraded":"2023-10-08T07:05:34.320412+0000","last_fullsized":"2023-10-08T07:05:34.320412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319754+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:05:34.319754+0000","last_peered":"2023-10-08T07:05:34.319754+0000","last_clean":"2023-10-08T07:05:34.319754+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:05:34.319754+0000","last_undegraded":"2023-10-08T07:05:34.319754+0000","last_fullsized":"2023-10-08T07:05:34.319754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360008+0000","last_change":"2023-10-08T07:05:33.326970+0000","last_active":"2023-10-08T07:05:34.360008+0000","last_peered":"2023-10-08T07:05:34.360008+0000","last_clean":"2023-10-08T07:05:34.360008+0000","last_became_active":"2023-10-08T07:05:33.326650+0000","last_became_peered":"2023-10-08T07:05:33.326650+0000","last_unstale":"2023-10-08T07:05:34.360008+0000","last_undegraded":"2023-10-08T07:05:34.360008+0000","last_fullsized":"2023-10-08T07:05:34.360008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319095+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:05:34.319095+0000","last_peered":"2023-10-08T07:05:34.319095+0000","last_clean":"2023-10-08T07:05:34.319095+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:05:34.319095+0000","last_undegraded":"2023-10-08T07:05:34.319095+0000","last_fullsized":"2023-10-08T07:05:34.319095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360261+0000","last_change":"2023-10-08T07:05:33.319759+0000","last_active":"2023-10-08T07:05:34.360261+0000","last_peered":"2023-10-08T07:05:34.360261+0000","last_clean":"2023-10-08T07:05:34.360261+0000","last_became_active":"2023-10-08T07:05:33.318507+0000","last_became_peered":"2023-10-08T07:05:33.318507+0000","last_unstale":"2023-10-08T07:05:34.360261+0000","last_undegraded":"2023-10-08T07:05:34.360261+0000","last_fullsized":"2023-10-08T07:05:34.360261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361101+0000","last_change":"2023-10-08T07:05:33.317560+0000","last_active":"2023-10-08T07:05:34.361101+0000","last_peered":"2023-10-08T07:05:34.361101+0000","last_clean":"2023-10-08T07:05:34.361101+0000","last_became_active":"2023-10-08T07:05:33.316906+0000","last_became_peered":"2023-10-08T07:05:33.316906+0000","last_unstale":"2023-10-08T07:05:34.361101+0000","last_undegraded":"2023-10-08T07:05:34.361101+0000","last_fullsized":"2023-10-08T07:05:34.361101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320043+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:05:34.320043+0000","last_peered":"2023-10-08T07:05:34.320043+0000","last_clean":"2023-10-08T07:05:34.320043+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:05:34.320043+0000","last_undegraded":"2023-10-08T07:05:34.320043+0000","last_fullsized":"2023-10-08T07:05:34.320043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320344+0000","last_change":"2023-10-08T07:05:33.326267+0000","last_active":"2023-10-08T07:05:34.320344+0000","last_peered":"2023-10-08T07:05:34.320344+0000","last_clean":"2023-10-08T07:05:34.320344+0000","last_became_active":"2023-10-08T07:05:33.324579+0000","last_became_peered":"2023-10-08T07:05:33.324579+0000","last_unstale":"2023-10-08T07:05:34.320344+0000","last_undegraded":"2023-10-08T07:05:34.320344+0000","last_fullsized":"2023-10-08T07:05:34.320344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359920+0000","last_change":"2023-10-08T07:05:32.320295+0000","last_active":"2023-10-08T07:05:34.359920+0000","last_peered":"2023-10-08T07:05:34.359920+0000","last_clean":"2023-10-08T07:05:34.359920+0000","last_became_active":"2023-10-08T07:05:32.320044+0000","last_became_peered":"2023-10-08T07:05:32.320044+0000","last_unstale":"2023-10-08T07:05:34.359920+0000","last_undegraded":"2023-10-08T07:05:34.359920+0000","last_fullsized":"2023-10-08T07:05:34.359920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:44.690611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360949+0000","last_change":"2023-10-08T07:05:33.329921+0000","last_active":"2023-10-08T07:05:34.360949+0000","last_peered":"2023-10-08T07:05:34.360949+0000","last_clean":"2023-10-08T07:05:34.360949+0000","last_became_active":"2023-10-08T07:05:33.329346+0000","last_became_peered":"2023-10-08T07:05:33.329346+0000","last_unstale":"2023-10-08T07:05:34.360949+0000","last_undegraded":"2023-10-08T07:05:34.360949+0000","last_fullsized":"2023-10-08T07:05:34.360949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319260+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:05:34.319260+0000","last_peered":"2023-10-08T07:05:34.319260+0000","last_clean":"2023-10-08T07:05:34.319260+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:05:34.319260+0000","last_undegraded":"2023-10-08T07:05:34.319260+0000","last_fullsized":"2023-10-08T07:05:34.319260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319829+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:05:34.319829+0000","last_peered":"2023-10-08T07:05:34.319829+0000","last_clean":"2023-10-08T07:05:34.319829+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:05:34.319829+0000","last_undegraded":"2023-10-08T07:05:34.319829+0000","last_fullsized":"2023-10-08T07:05:34.319829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319123+0000","last_change":"2023-10-08T07:05:32.315935+0000","last_active":"2023-10-08T07:05:34.319123+0000","last_peered":"2023-10-08T07:05:34.319123+0000","last_clean":"2023-10-08T07:05:34.319123+0000","last_became_active":"2023-10-08T07:05:32.315661+0000","last_became_peered":"2023-10-08T07:05:32.315661+0000","last_unstale":"2023-10-08T07:05:34.319123+0000","last_undegraded":"2023-10-08T07:05:34.319123+0000","last_fullsized":"2023-10-08T07:05:34.319123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:01:05.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.361026+0000","last_change":"2023-10-08T07:05:33.330068+0000","last_active":"2023-10-08T07:05:34.361026+0000","last_peered":"2023-10-08T07:05:34.361026+0000","last_clean":"2023-10-08T07:05:34.361026+0000","last_became_active":"2023-10-08T07:05:33.329169+0000","last_became_peered":"2023-10-08T07:05:33.329169+0000","last_unstale":"2023-10-08T07:05:34.361026+0000","last_undegraded":"2023-10-08T07:05:34.361026+0000","last_fullsized":"2023-10-08T07:05:34.361026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:05:34.320135+0000","last_peered":"2023-10-08T07:05:34.320135+0000","last_clean":"2023-10-08T07:05:34.320135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:05:34.320135+0000","last_undegraded":"2023-10-08T07:05:34.320135+0000","last_fullsized":"2023-10-08T07:05:34.320135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318813+0000","last_change":"2023-10-08T07:05:33.316496+0000","last_active":"2023-10-08T07:05:34.318813+0000","last_peered":"2023-10-08T07:05:34.318813+0000","last_clean":"2023-10-08T07:05:34.318813+0000","last_became_active":"2023-10-08T07:05:33.316084+0000","last_became_peered":"2023-10-08T07:05:33.316084+0000","last_unstale":"2023-10-08T07:05:34.318813+0000","last_undegraded":"2023-10-08T07:05:34.318813+0000","last_fullsized":"2023-10-08T07:05:34.318813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320455+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:05:34.320455+0000","last_peered":"2023-10-08T07:05:34.320455+0000","last_clean":"2023-10-08T07:05:34.320455+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:05:34.320455+0000","last_undegraded":"2023-10-08T07:05:34.320455+0000","last_fullsized":"2023-10-08T07:05:34.320455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319317+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:05:34.319317+0000","last_peered":"2023-10-08T07:05:34.319317+0000","last_clean":"2023-10-08T07:05:34.319317+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:05:34.319317+0000","last_undegraded":"2023-10-08T07:05:34.319317+0000","last_fullsized":"2023-10-08T07:05:34.319317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360636+0000","last_change":"2023-10-08T07:05:32.323201+0000","last_active":"2023-10-08T07:05:34.360636+0000","last_peered":"2023-10-08T07:05:34.360636+0000","last_clean":"2023-10-08T07:05:34.360636+0000","last_became_active":"2023-10-08T07:05:32.322864+0000","last_became_peered":"2023-10-08T07:05:32.322864+0000","last_unstale":"2023-10-08T07:05:34.360636+0000","last_undegraded":"2023-10-08T07:05:34.360636+0000","last_fullsized":"2023-10-08T07:05:34.360636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:40.093124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319535+0000","last_change":"2023-10-08T07:05:33.317114+0000","last_active":"2023-10-08T07:05:34.319535+0000","last_peered":"2023-10-08T07:05:34.319535+0000","last_clean":"2023-10-08T07:05:34.319535+0000","last_became_active":"2023-10-08T07:05:33.316390+0000","last_became_peered":"2023-10-08T07:05:33.316390+0000","last_unstale":"2023-10-08T07:05:34.319535+0000","last_undegraded":"2023-10-08T07:05:34.319535+0000","last_fullsized":"2023-10-08T07:05:34.319535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320136+0000","last_change":"2023-10-08T07:05:32.319510+0000","last_active":"2023-10-08T07:05:34.320136+0000","last_peered":"2023-10-08T07:05:34.320136+0000","last_clean":"2023-10-08T07:05:34.320136+0000","last_became_active":"2023-10-08T07:05:32.319209+0000","last_became_peered":"2023-10-08T07:05:32.319209+0000","last_unstale":"2023-10-08T07:05:34.320136+0000","last_undegraded":"2023-10-08T07:05:34.320136+0000","last_fullsized":"2023-10-08T07:05:34.320136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:28.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320332+0000","last_change":"2023-10-08T07:05:33.317137+0000","last_active":"2023-10-08T07:05:34.320332+0000","last_peered":"2023-10-08T07:05:34.320332+0000","last_clean":"2023-10-08T07:05:34.320332+0000","last_became_active":"2023-10-08T07:05:33.316562+0000","last_became_peered":"2023-10-08T07:05:33.316562+0000","last_unstale":"2023-10-08T07:05:34.320332+0000","last_undegraded":"2023-10-08T07:05:34.320332+0000","last_fullsized":"2023-10-08T07:05:34.320332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:41.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320369+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:05:34.320369+0000","last_peered":"2023-10-08T07:05:34.320369+0000","last_clean":"2023-10-08T07:05:34.320369+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:05:34.320369+0000","last_undegraded":"2023-10-08T07:05:34.320369+0000","last_fullsized":"2023-10-08T07:05:34.320369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360395+0000","last_change":"2023-10-08T07:05:33.322201+0000","last_active":"2023-10-08T07:05:34.360395+0000","last_peered":"2023-10-08T07:05:34.360395+0000","last_clean":"2023-10-08T07:05:34.360395+0000","last_became_active":"2023-10-08T07:05:33.321826+0000","last_became_peered":"2023-10-08T07:05:33.321826+0000","last_unstale":"2023-10-08T07:05:34.360395+0000","last_undegraded":"2023-10-08T07:05:34.360395+0000","last_fullsized":"2023-10-08T07:05:34.360395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319178+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:05:34.319178+0000","last_peered":"2023-10-08T07:05:34.319178+0000","last_clean":"2023-10-08T07:05:34.319178+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:05:34.319178+0000","last_undegraded":"2023-10-08T07:05:34.319178+0000","last_fullsized":"2023-10-08T07:05:34.319178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360947+0000","last_change":"2023-10-08T07:05:33.317545+0000","last_active":"2023-10-08T07:05:34.360947+0000","last_peered":"2023-10-08T07:05:34.360947+0000","last_clean":"2023-10-08T07:05:34.360947+0000","last_became_active":"2023-10-08T07:05:33.317134+0000","last_became_peered":"2023-10-08T07:05:33.317134+0000","last_unstale":"2023-10-08T07:05:34.360947+0000","last_undegraded":"2023-10-08T07:05:34.360947+0000","last_fullsized":"2023-10-08T07:05:34.360947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359736+0000","last_change":"2023-10-08T07:05:32.323406+0000","last_active":"2023-10-08T07:05:34.359736+0000","last_peered":"2023-10-08T07:05:34.359736+0000","last_clean":"2023-10-08T07:05:34.359736+0000","last_became_active":"2023-10-08T07:05:32.323040+0000","last_became_peered":"2023-10-08T07:05:32.323040+0000","last_unstale":"2023-10-08T07:05:34.359736+0000","last_undegraded":"2023-10-08T07:05:34.359736+0000","last_fullsized":"2023-10-08T07:05:34.359736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319639+0000","last_change":"2023-10-08T07:05:32.319220+0000","last_active":"2023-10-08T07:05:34.319639+0000","last_peered":"2023-10-08T07:05:34.319639+0000","last_clean":"2023-10-08T07:05:34.319639+0000","last_became_active":"2023-10-08T07:05:32.318838+0000","last_became_peered":"2023-10-08T07:05:32.318838+0000","last_unstale":"2023-10-08T07:05:34.319639+0000","last_undegraded":"2023-10-08T07:05:34.319639+0000","last_fullsized":"2023-10-08T07:05:34.319639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:32:59.940325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320271+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:05:34.320271+0000","last_peered":"2023-10-08T07:05:34.320271+0000","last_clean":"2023-10-08T07:05:34.320271+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:05:34.320271+0000","last_undegraded":"2023-10-08T07:05:34.320271+0000","last_fullsized":"2023-10-08T07:05:34.320271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320776+0000","last_change":"2023-10-08T07:05:32.319446+0000","last_active":"2023-10-08T07:05:34.320776+0000","last_peered":"2023-10-08T07:05:34.320776+0000","last_clean":"2023-10-08T07:05:34.320776+0000","last_became_active":"2023-10-08T07:05:32.319019+0000","last_became_peered":"2023-10-08T07:05:32.319019+0000","last_unstale":"2023-10-08T07:05:34.320776+0000","last_undegraded":"2023-10-08T07:05:34.320776+0000","last_fullsized":"2023-10-08T07:05:34.320776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:56.843162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359487+0000","last_change":"2023-10-08T07:05:33.330217+0000","last_active":"2023-10-08T07:05:34.359487+0000","last_peered":"2023-10-08T07:05:34.359487+0000","last_clean":"2023-10-08T07:05:34.359487+0000","last_became_active":"2023-10-08T07:05:33.329639+0000","last_became_peered":"2023-10-08T07:05:33.329639+0000","last_unstale":"2023-10-08T07:05:34.359487+0000","last_undegraded":"2023-10-08T07:05:34.359487+0000","last_fullsized":"2023-10-08T07:05:34.359487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:21.715645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360604+0000","last_change":"2023-10-08T07:05:32.323481+0000","last_active":"2023-10-08T07:05:34.360604+0000","last_peered":"2023-10-08T07:05:34.360604+0000","last_clean":"2023-10-08T07:05:34.360604+0000","last_became_active":"2023-10-08T07:05:32.323243+0000","last_became_peered":"2023-10-08T07:05:32.323243+0000","last_unstale":"2023-10-08T07:05:34.360604+0000","last_undegraded":"2023-10-08T07:05:34.360604+0000","last_fullsized":"2023-10-08T07:05:34.360604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359906+0000","last_change":"2023-10-08T07:05:33.318539+0000","last_active":"2023-10-08T07:05:34.359906+0000","last_peered":"2023-10-08T07:05:34.359906+0000","last_clean":"2023-10-08T07:05:34.359906+0000","last_became_active":"2023-10-08T07:05:33.317371+0000","last_became_peered":"2023-10-08T07:05:33.317371+0000","last_unstale":"2023-10-08T07:05:34.359906+0000","last_undegraded":"2023-10-08T07:05:34.359906+0000","last_fullsized":"2023-10-08T07:05:34.359906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:00.945202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320279+0000","last_change":"2023-10-08T07:05:32.321744+0000","last_active":"2023-10-08T07:05:34.320279+0000","last_peered":"2023-10-08T07:05:34.320279+0000","last_clean":"2023-10-08T07:05:34.320279+0000","last_became_active":"2023-10-08T07:05:32.321482+0000","last_became_peered":"2023-10-08T07:05:32.321482+0000","last_unstale":"2023-10-08T07:05:34.320279+0000","last_undegraded":"2023-10-08T07:05:34.320279+0000","last_fullsized":"2023-10-08T07:05:34.320279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:13.789778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320018+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:05:34.320018+0000","last_peered":"2023-10-08T07:05:34.320018+0000","last_clean":"2023-10-08T07:05:34.320018+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:05:34.320018+0000","last_undegraded":"2023-10-08T07:05:34.320018+0000","last_fullsized":"2023-10-08T07:05:34.320018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319626+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:05:34.319626+0000","last_peered":"2023-10-08T07:05:34.319626+0000","last_clean":"2023-10-08T07:05:34.319626+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:05:34.319626+0000","last_undegraded":"2023-10-08T07:05:34.319626+0000","last_fullsized":"2023-10-08T07:05:34.319626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319559+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:05:34.319559+0000","last_peered":"2023-10-08T07:05:34.319559+0000","last_clean":"2023-10-08T07:05:34.319559+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:05:34.319559+0000","last_undegraded":"2023-10-08T07:05:34.319559+0000","last_fullsized":"2023-10-08T07:05:34.319559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319350+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:05:34.319350+0000","last_peered":"2023-10-08T07:05:34.319350+0000","last_clean":"2023-10-08T07:05:34.319350+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:05:34.319350+0000","last_undegraded":"2023-10-08T07:05:34.319350+0000","last_fullsized":"2023-10-08T07:05:34.319350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319981+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:05:34.319981+0000","last_peered":"2023-10-08T07:05:34.319981+0000","last_clean":"2023-10-08T07:05:34.319981+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:05:34.319981+0000","last_undegraded":"2023-10-08T07:05:34.319981+0000","last_fullsized":"2023-10-08T07:05:34.319981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319602+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:05:34.319602+0000","last_peered":"2023-10-08T07:05:34.319602+0000","last_clean":"2023-10-08T07:05:34.319602+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:05:34.319602+0000","last_undegraded":"2023-10-08T07:05:34.319602+0000","last_fullsized":"2023-10-08T07:05:34.319602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320680+0000","last_change":"2023-10-08T07:05:33.319933+0000","last_active":"2023-10-08T07:05:34.320680+0000","last_peered":"2023-10-08T07:05:34.320680+0000","last_clean":"2023-10-08T07:05:34.320680+0000","last_became_active":"2023-10-08T07:05:33.317937+0000","last_became_peered":"2023-10-08T07:05:33.317937+0000","last_unstale":"2023-10-08T07:05:34.320680+0000","last_undegraded":"2023-10-08T07:05:34.320680+0000","last_fullsized":"2023-10-08T07:05:34.320680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:57:42.074994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359555+0000","last_change":"2023-10-08T07:05:32.323415+0000","last_active":"2023-10-08T07:05:34.359555+0000","last_peered":"2023-10-08T07:05:34.359555+0000","last_clean":"2023-10-08T07:05:34.359555+0000","last_became_active":"2023-10-08T07:05:32.322910+0000","last_became_peered":"2023-10-08T07:05:32.322910+0000","last_unstale":"2023-10-08T07:05:34.359555+0000","last_undegraded":"2023-10-08T07:05:34.359555+0000","last_fullsized":"2023-10-08T07:05:34.359555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320553+0000","last_change":"2023-10-08T07:05:33.325994+0000","last_active":"2023-10-08T07:05:34.320553+0000","last_peered":"2023-10-08T07:05:34.320553+0000","last_clean":"2023-10-08T07:05:34.320553+0000","last_became_active":"2023-10-08T07:05:33.324865+0000","last_became_peered":"2023-10-08T07:05:33.324865+0000","last_unstale":"2023-10-08T07:05:34.320553+0000","last_undegraded":"2023-10-08T07:05:34.320553+0000","last_fullsized":"2023-10-08T07:05:34.320553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:14.142601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359677+0000","last_change":"2023-10-08T07:05:32.320359+0000","last_active":"2023-10-08T07:05:34.359677+0000","last_peered":"2023-10-08T07:05:34.359677+0000","last_clean":"2023-10-08T07:05:34.359677+0000","last_became_active":"2023-10-08T07:05:32.320137+0000","last_became_peered":"2023-10-08T07:05:32.320137+0000","last_unstale":"2023-10-08T07:05:34.359677+0000","last_undegraded":"2023-10-08T07:05:34.359677+0000","last_fullsized":"2023-10-08T07:05:34.359677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:32.366341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320091+0000","last_change":"2023-10-08T07:05:33.322861+0000","last_active":"2023-10-08T07:05:34.320091+0000","last_peered":"2023-10-08T07:05:34.320091+0000","last_clean":"2023-10-08T07:05:34.320091+0000","last_became_active":"2023-10-08T07:05:33.322450+0000","last_became_peered":"2023-10-08T07:05:33.322450+0000","last_unstale":"2023-10-08T07:05:34.320091+0000","last_undegraded":"2023-10-08T07:05:34.320091+0000","last_fullsized":"2023-10-08T07:05:34.320091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309081+0000","last_change":"2023-10-08T07:05:27.295597+0000","last_active":"2023-10-08T07:05:33.309081+0000","last_peered":"2023-10-08T07:05:33.309081+0000","last_clean":"2023-10-08T07:05:33.309081+0000","last_became_active":"2023-10-08T07:05:27.295265+0000","last_became_peered":"2023-10-08T07:05:27.295265+0000","last_unstale":"2023-10-08T07:05:33.309081+0000","last_undegraded":"2023-10-08T07:05:33.309081+0000","last_fullsized":"2023-10-08T07:05:33.309081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:50.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320457+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:05:34.320457+0000","last_peered":"2023-10-08T07:05:34.320457+0000","last_clean":"2023-10-08T07:05:34.320457+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:05:34.320457+0000","last_undegraded":"2023-10-08T07:05:34.320457+0000","last_fullsized":"2023-10-08T07:05:34.320457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360046+0000","last_change":"2023-10-08T07:05:33.326797+0000","last_active":"2023-10-08T07:05:34.360046+0000","last_peered":"2023-10-08T07:05:34.360046+0000","last_clean":"2023-10-08T07:05:34.360046+0000","last_became_active":"2023-10-08T07:05:33.326518+0000","last_became_peered":"2023-10-08T07:05:33.326518+0000","last_unstale":"2023-10-08T07:05:34.360046+0000","last_undegraded":"2023-10-08T07:05:34.360046+0000","last_fullsized":"2023-10-08T07:05:34.360046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318961+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:05:33.318961+0000","last_peered":"2023-10-08T07:05:33.318961+0000","last_clean":"2023-10-08T07:05:33.318961+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:05:33.318961+0000","last_undegraded":"2023-10-08T07:05:33.318961+0000","last_fullsized":"2023-10-08T07:05:33.318961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320087+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:05:34.320087+0000","last_peered":"2023-10-08T07:05:34.320087+0000","last_clean":"2023-10-08T07:05:34.320087+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:05:34.320087+0000","last_undegraded":"2023-10-08T07:05:34.320087+0000","last_fullsized":"2023-10-08T07:05:34.320087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319579+0000","last_change":"2023-10-08T07:05:33.322164+0000","last_active":"2023-10-08T07:05:34.319579+0000","last_peered":"2023-10-08T07:05:34.319579+0000","last_clean":"2023-10-08T07:05:34.319579+0000","last_became_active":"2023-10-08T07:05:33.321757+0000","last_became_peered":"2023-10-08T07:05:33.321757+0000","last_unstale":"2023-10-08T07:05:34.319579+0000","last_undegraded":"2023-10-08T07:05:34.319579+0000","last_fullsized":"2023-10-08T07:05:34.319579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.308287+0000","last_change":"2023-10-08T07:05:27.295991+0000","last_active":"2023-10-08T07:05:33.308287+0000","last_peered":"2023-10-08T07:05:33.308287+0000","last_clean":"2023-10-08T07:05:33.308287+0000","last_became_active":"2023-10-08T07:05:27.295727+0000","last_became_peered":"2023-10-08T07:05:27.295727+0000","last_unstale":"2023-10-08T07:05:33.308287+0000","last_undegraded":"2023-10-08T07:05:33.308287+0000","last_fullsized":"2023-10-08T07:05:33.308287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:54.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359567+0000","last_change":"2023-10-08T07:05:32.323161+0000","last_active":"2023-10-08T07:05:34.359567+0000","last_peered":"2023-10-08T07:05:34.359567+0000","last_clean":"2023-10-08T07:05:34.359567+0000","last_became_active":"2023-10-08T07:05:32.322832+0000","last_became_peered":"2023-10-08T07:05:32.322832+0000","last_unstale":"2023-10-08T07:05:34.359567+0000","last_undegraded":"2023-10-08T07:05:34.359567+0000","last_fullsized":"2023-10-08T07:05:34.359567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320239+0000","last_change":"2023-10-08T07:05:33.323204+0000","last_active":"2023-10-08T07:05:34.320239+0000","last_peered":"2023-10-08T07:05:34.320239+0000","last_clean":"2023-10-08T07:05:34.320239+0000","last_became_active":"2023-10-08T07:05:33.322899+0000","last_became_peered":"2023-10-08T07:05:33.322899+0000","last_unstale":"2023-10-08T07:05:34.320239+0000","last_undegraded":"2023-10-08T07:05:34.320239+0000","last_fullsized":"2023-10-08T07:05:34.320239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319302+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:05:33.319302+0000","last_peered":"2023-10-08T07:05:33.319302+0000","last_clean":"2023-10-08T07:05:33.319302+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:05:33.319302+0000","last_undegraded":"2023-10-08T07:05:33.319302+0000","last_fullsized":"2023-10-08T07:05:33.319302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.318604+0000","last_change":"2023-10-08T07:05:22.277737+0000","last_active":"2023-10-08T07:05:33.318604+0000","last_peered":"2023-10-08T07:05:33.318604+0000","last_clean":"2023-10-08T07:05:33.318604+0000","last_became_active":"2023-10-08T07:05:22.277417+0000","last_became_peered":"2023-10-08T07:05:22.277417+0000","last_unstale":"2023-10-08T07:05:33.318604+0000","last_undegraded":"2023-10-08T07:05:33.318604+0000","last_fullsized":"2023-10-08T07:05:33.318604+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:10.186804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318995+0000","last_change":"2023-10-08T07:05:32.316756+0000","last_active":"2023-10-08T07:05:34.318995+0000","last_peered":"2023-10-08T07:05:34.318995+0000","last_clean":"2023-10-08T07:05:34.318995+0000","last_became_active":"2023-10-08T07:05:32.316340+0000","last_became_peered":"2023-10-08T07:05:32.316340+0000","last_unstale":"2023-10-08T07:05:34.318995+0000","last_undegraded":"2023-10-08T07:05:34.318995+0000","last_fullsized":"2023-10-08T07:05:34.318995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:46:34.838960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320659+0000","last_change":"2023-10-08T07:05:33.318964+0000","last_active":"2023-10-08T07:05:34.320659+0000","last_peered":"2023-10-08T07:05:34.320659+0000","last_clean":"2023-10-08T07:05:34.320659+0000","last_became_active":"2023-10-08T07:05:33.317866+0000","last_became_peered":"2023-10-08T07:05:33.317866+0000","last_unstale":"2023-10-08T07:05:34.320659+0000","last_undegraded":"2023-10-08T07:05:34.320659+0000","last_fullsized":"2023-10-08T07:05:34.320659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:47.306558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.319045+0000","last_change":"2023-10-08T07:05:27.295425+0000","last_active":"2023-10-08T07:05:33.319045+0000","last_peered":"2023-10-08T07:05:33.319045+0000","last_clean":"2023-10-08T07:05:33.319045+0000","last_became_active":"2023-10-08T07:05:27.295157+0000","last_became_peered":"2023-10-08T07:05:27.295157+0000","last_unstale":"2023-10-08T07:05:33.319045+0000","last_undegraded":"2023-10-08T07:05:33.319045+0000","last_fullsized":"2023-10-08T07:05:33.319045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:06.192882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318796+0000","last_change":"2023-10-08T07:05:32.317723+0000","last_active":"2023-10-08T07:05:34.318796+0000","last_peered":"2023-10-08T07:05:34.318796+0000","last_clean":"2023-10-08T07:05:34.318796+0000","last_became_active":"2023-10-08T07:05:32.317444+0000","last_became_peered":"2023-10-08T07:05:32.317444+0000","last_unstale":"2023-10-08T07:05:34.318796+0000","last_undegraded":"2023-10-08T07:05:34.318796+0000","last_fullsized":"2023-10-08T07:05:34.318796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:29.242830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360897+0000","last_change":"2023-10-08T07:05:33.321497+0000","last_active":"2023-10-08T07:05:34.360897+0000","last_peered":"2023-10-08T07:05:34.360897+0000","last_clean":"2023-10-08T07:05:34.360897+0000","last_became_active":"2023-10-08T07:05:33.319658+0000","last_became_peered":"2023-10-08T07:05:33.319658+0000","last_unstale":"2023-10-08T07:05:34.360897+0000","last_undegraded":"2023-10-08T07:05:34.360897+0000","last_fullsized":"2023-10-08T07:05:34.360897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.314076+0000","last_change":"2023-10-08T07:05:27.298597+0000","last_active":"2023-10-08T07:05:33.314076+0000","last_peered":"2023-10-08T07:05:33.314076+0000","last_clean":"2023-10-08T07:05:33.314076+0000","last_became_active":"2023-10-08T07:05:27.298355+0000","last_became_peered":"2023-10-08T07:05:27.298355+0000","last_unstale":"2023-10-08T07:05:33.314076+0000","last_undegraded":"2023-10-08T07:05:33.314076+0000","last_fullsized":"2023-10-08T07:05:33.314076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:06.241475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319456+0000","last_change":"2023-10-08T07:05:32.319605+0000","last_active":"2023-10-08T07:05:34.319456+0000","last_peered":"2023-10-08T07:05:34.319456+0000","last_clean":"2023-10-08T07:05:34.319456+0000","last_became_active":"2023-10-08T07:05:32.319244+0000","last_became_peered":"2023-10-08T07:05:32.319244+0000","last_unstale":"2023-10-08T07:05:34.319456+0000","last_undegraded":"2023-10-08T07:05:34.319456+0000","last_fullsized":"2023-10-08T07:05:34.319456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:25.991992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360213+0000","last_change":"2023-10-08T07:05:33.327112+0000","last_active":"2023-10-08T07:05:34.360213+0000","last_peered":"2023-10-08T07:05:34.360213+0000","last_clean":"2023-10-08T07:05:34.360213+0000","last_became_active":"2023-10-08T07:05:33.326816+0000","last_became_peered":"2023-10-08T07:05:33.326816+0000","last_unstale":"2023-10-08T07:05:34.360213+0000","last_undegraded":"2023-10-08T07:05:34.360213+0000","last_fullsized":"2023-10-08T07:05:34.360213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319943+0000","last_change":"2023-10-08T07:05:32.319875+0000","last_active":"2023-10-08T07:05:34.319943+0000","last_peered":"2023-10-08T07:05:34.319943+0000","last_clean":"2023-10-08T07:05:34.319943+0000","last_became_active":"2023-10-08T07:05:32.319385+0000","last_became_peered":"2023-10-08T07:05:32.319385+0000","last_unstale":"2023-10-08T07:05:34.319943+0000","last_undegraded":"2023-10-08T07:05:34.319943+0000","last_fullsized":"2023-10-08T07:05:34.319943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.309753+0000","last_change":"2023-10-08T07:05:27.295537+0000","last_active":"2023-10-08T07:05:33.309753+0000","last_peered":"2023-10-08T07:05:33.309753+0000","last_clean":"2023-10-08T07:05:33.309753+0000","last_became_active":"2023-10-08T07:05:27.295234+0000","last_became_peered":"2023-10-08T07:05:27.295234+0000","last_unstale":"2023-10-08T07:05:33.309753+0000","last_undegraded":"2023-10-08T07:05:33.309753+0000","last_fullsized":"2023-10-08T07:05:33.309753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:22.951187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.318736+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:05:34.318736+0000","last_peered":"2023-10-08T07:05:34.318736+0000","last_clean":"2023-10-08T07:05:34.318736+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:05:34.318736+0000","last_undegraded":"2023-10-08T07:05:34.318736+0000","last_fullsized":"2023-10-08T07:05:34.318736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-08T07:05:33.325045+0000","last_change":"2023-10-08T07:05:27.295945+0000","last_active":"2023-10-08T07:05:33.325045+0000","last_peered":"2023-10-08T07:05:33.325045+0000","last_clean":"2023-10-08T07:05:33.325045+0000","last_became_active":"2023-10-08T07:05:27.295726+0000","last_became_peered":"2023-10-08T07:05:27.295726+0000","last_unstale":"2023-10-08T07:05:33.325045+0000","last_undegraded":"2023-10-08T07:05:33.325045+0000","last_fullsized":"2023-10-08T07:05:33.325045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:55.040889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.506403+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:05:34.506403+0000","last_peered":"2023-10-08T07:05:34.506403+0000","last_clean":"2023-10-08T07:05:34.506403+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:05:34.506403+0000","last_undegraded":"2023-10-08T07:05:34.506403+0000","last_fullsized":"2023-10-08T07:05:34.506403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359840+0000","last_change":"2023-10-08T07:05:33.326621+0000","last_active":"2023-10-08T07:05:34.359840+0000","last_peered":"2023-10-08T07:05:34.359840+0000","last_clean":"2023-10-08T07:05:34.359840+0000","last_became_active":"2023-10-08T07:05:33.326272+0000","last_became_peered":"2023-10-08T07:05:33.326272+0000","last_unstale":"2023-10-08T07:05:34.359840+0000","last_undegraded":"2023-10-08T07:05:34.359840+0000","last_fullsized":"2023-10-08T07:05:34.359840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:31.752188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.359963+0000","last_change":"2023-10-08T07:05:32.323175+0000","last_active":"2023-10-08T07:05:34.359963+0000","last_peered":"2023-10-08T07:05:34.359963+0000","last_clean":"2023-10-08T07:05:34.359963+0000","last_became_active":"2023-10-08T07:05:32.322814+0000","last_became_peered":"2023-10-08T07:05:32.322814+0000","last_unstale":"2023-10-08T07:05:34.359963+0000","last_undegraded":"2023-10-08T07:05:34.359963+0000","last_fullsized":"2023-10-08T07:05:34.359963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360537+0000","last_change":"2023-10-08T07:05:33.318398+0000","last_active":"2023-10-08T07:05:34.360537+0000","last_peered":"2023-10-08T07:05:34.360537+0000","last_clean":"2023-10-08T07:05:34.360537+0000","last_became_active":"2023-10-08T07:05:33.317478+0000","last_became_peered":"2023-10-08T07:05:33.317478+0000","last_unstale":"2023-10-08T07:05:34.360537+0000","last_undegraded":"2023-10-08T07:05:34.360537+0000","last_fullsized":"2023-10-08T07:05:34.360537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320059+0000","last_change":"2023-10-08T07:05:32.320603+0000","last_active":"2023-10-08T07:05:34.320059+0000","last_peered":"2023-10-08T07:05:34.320059+0000","last_clean":"2023-10-08T07:05:34.320059+0000","last_became_active":"2023-10-08T07:05:32.320262+0000","last_became_peered":"2023-10-08T07:05:32.320262+0000","last_unstale":"2023-10-08T07:05:34.320059+0000","last_undegraded":"2023-10-08T07:05:34.320059+0000","last_fullsized":"2023-10-08T07:05:34.320059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:09.249029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319954+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:05:34.319954+0000","last_peered":"2023-10-08T07:05:34.319954+0000","last_clean":"2023-10-08T07:05:34.319954+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:05:34.319954+0000","last_undegraded":"2023-10-08T07:05:34.319954+0000","last_fullsized":"2023-10-08T07:05:34.319954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360795+0000","last_change":"2023-10-08T07:05:32.323143+0000","last_active":"2023-10-08T07:05:34.360795+0000","last_peered":"2023-10-08T07:05:34.360795+0000","last_clean":"2023-10-08T07:05:34.360795+0000","last_became_active":"2023-10-08T07:05:32.322789+0000","last_became_peered":"2023-10-08T07:05:32.322789+0000","last_unstale":"2023-10-08T07:05:34.360795+0000","last_undegraded":"2023-10-08T07:05:34.360795+0000","last_fullsized":"2023-10-08T07:05:34.360795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:03.978136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319826+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:05:34.319826+0000","last_peered":"2023-10-08T07:05:34.319826+0000","last_clean":"2023-10-08T07:05:34.319826+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:05:34.319826+0000","last_undegraded":"2023-10-08T07:05:34.319826+0000","last_fullsized":"2023-10-08T07:05:34.319826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319964+0000","last_change":"2023-10-08T07:05:32.319462+0000","last_active":"2023-10-08T07:05:34.319964+0000","last_peered":"2023-10-08T07:05:34.319964+0000","last_clean":"2023-10-08T07:05:34.319964+0000","last_became_active":"2023-10-08T07:05:32.318951+0000","last_became_peered":"2023-10-08T07:05:32.318951+0000","last_unstale":"2023-10-08T07:05:34.319964+0000","last_undegraded":"2023-10-08T07:05:34.319964+0000","last_fullsized":"2023-10-08T07:05:34.319964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360006+0000","last_change":"2023-10-08T07:05:33.319869+0000","last_active":"2023-10-08T07:05:34.360006+0000","last_peered":"2023-10-08T07:05:34.360006+0000","last_clean":"2023-10-08T07:05:34.360006+0000","last_became_active":"2023-10-08T07:05:33.318241+0000","last_became_peered":"2023-10-08T07:05:33.318241+0000","last_unstale":"2023-10-08T07:05:34.360006+0000","last_undegraded":"2023-10-08T07:05:34.360006+0000","last_fullsized":"2023-10-08T07:05:34.360006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320049+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:05:34.320049+0000","last_peered":"2023-10-08T07:05:34.320049+0000","last_clean":"2023-10-08T07:05:34.320049+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:05:34.320049+0000","last_undegraded":"2023-10-08T07:05:34.320049+0000","last_fullsized":"2023-10-08T07:05:34.320049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.320180+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:05:34.320180+0000","last_peered":"2023-10-08T07:05:34.320180+0000","last_clean":"2023-10-08T07:05:34.320180+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:05:34.320180+0000","last_undegraded":"2023-10-08T07:05:34.320180+0000","last_fullsized":"2023-10-08T07:05:34.320180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319653+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:05:34.319653+0000","last_peered":"2023-10-08T07:05:34.319653+0000","last_clean":"2023-10-08T07:05:34.319653+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:05:34.319653+0000","last_undegraded":"2023-10-08T07:05:34.319653+0000","last_fullsized":"2023-10-08T07:05:34.319653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319038+0000","last_change":"2023-10-08T07:05:33.322006+0000","last_active":"2023-10-08T07:05:34.319038+0000","last_peered":"2023-10-08T07:05:34.319038+0000","last_clean":"2023-10-08T07:05:34.319038+0000","last_became_active":"2023-10-08T07:05:33.321639+0000","last_became_peered":"2023-10-08T07:05:33.321639+0000","last_unstale":"2023-10-08T07:05:34.319038+0000","last_undegraded":"2023-10-08T07:05:34.319038+0000","last_fullsized":"2023-10-08T07:05:34.319038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360201+0000","last_change":"2023-10-08T07:05:33.329906+0000","last_active":"2023-10-08T07:05:34.360201+0000","last_peered":"2023-10-08T07:05:34.360201+0000","last_clean":"2023-10-08T07:05:34.360201+0000","last_became_active":"2023-10-08T07:05:33.329615+0000","last_became_peered":"2023-10-08T07:05:33.329615+0000","last_unstale":"2023-10-08T07:05:34.360201+0000","last_undegraded":"2023-10-08T07:05:34.360201+0000","last_fullsized":"2023-10-08T07:05:34.360201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.319571+0000","last_change":"2023-10-08T07:05:33.316573+0000","last_active":"2023-10-08T07:05:34.319571+0000","last_peered":"2023-10-08T07:05:34.319571+0000","last_clean":"2023-10-08T07:05:34.319571+0000","last_became_active":"2023-10-08T07:05:33.316193+0000","last_became_peered":"2023-10-08T07:05:33.316193+0000","last_unstale":"2023-10-08T07:05:34.319571+0000","last_undegraded":"2023-10-08T07:05:34.319571+0000","last_fullsized":"2023-10-08T07:05:34.319571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-08T07:05:34.360585+0000","last_change":"2023-10-08T07:05:33.320077+0000","last_active":"2023-10-08T07:05:34.360585+0000","last_peered":"2023-10-08T07:05:34.360585+0000","last_clean":"2023-10-08T07:05:34.360585+0000","last_became_active":"2023-10-08T07:05:33.319392+0000","last_became_peered":"2023-10-08T07:05:33.319392+0000","last_unstale":"2023-10-08T07:05:34.360585+0000","last_undegraded":"2023-10-08T07:05:34.360585+0000","last_fullsized":"2023-10-08T07:05:34.360585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":650475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":782336,"data_stored":649859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:05:53.770 INFO:tasks.thrashosds.thrasher:Setting 4.2d to [0, 2, 1] 2023-10-08T07:05:53.770 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.2d', '0', '2', '1'] 2023-10-08T07:05:53.771 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.2d 0 2 1 2023-10-08T07:05:53.771 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:53.771 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:53.773 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-10-08T07:05:53.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:53.776 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-10-08T07:05:53.778 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:05:53.800 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:53.799+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:53.862 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-10-08T07:05:53.862 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T07:05:53.862 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T07:05:53.862 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T07:05:53.863 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T07:05:53.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:53.863 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-08T07:05:53.863 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-08T07:05:53.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T07:05:53.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T07:05:53.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T07:05:53.864 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-08T07:05:53.901 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:53.900+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:53.906 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:53.906 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:53.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:05:54.002 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:54.002+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2023-10-08T07:05:54.056 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:54.056 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:54.066 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:05:54.110 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:54.109+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:54.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:54.118 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-08T07:05:54.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:54.136 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2023-10-08T07:05:54.148 INFO:teuthology.orchestra.run.smithi017.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2023-10-08T07:05:54.151 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-08T07:05:54.151 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2023-10-08T07:05:54.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:54.165 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-08T07:05:54.165 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-08T07:05:54.165 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T07:05:54.165 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T07:05:54.165 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-08T07:05:54.193 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:54.193 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:54.203 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:05:54.205 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:54.204+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:54.260 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T07:05:54.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:54.261 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-08T07:05:54.261 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-08T07:05:54.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T07:05:54.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T07:05:54.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T07:05:54.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T07:05:54.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T07:05:54.262 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-08T07:05:54.309 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:54.304+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:54.380 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:05:54.406 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:54.406+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:54.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:54.470 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-08T07:05:54.470 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-08T07:05:54.470 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-10-08T07:05:54.470 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T07:05:54.470 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-08T07:05:54.507 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:54.507+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:54.527 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:54.527 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:54.538 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:05:54.570 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-08T07:05:54.570 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T07:05:54.570 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T07:05:54.587 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T07:05:54.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T07:05:54.588 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T07:05:54.608 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:54.607+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:54.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2023-10-08T07:05:54.669 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:54.670 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:54.680 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:05:54.709 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:54.709+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:54.712 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T07:05:54.771 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2023-10-08T07:05:54.771 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2023-10-08T07:05:54.771 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2023-10-08T07:05:54.771 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2023-10-08T07:05:54.771 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2023-10-08T07:05:54.772 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2023-10-08T07:05:54.772 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2023-10-08T07:05:54.772 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2023-10-08T07:05:54.772 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/systemd 2023-10-08T07:05:54.772 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2023-10-08T07:05:54.772 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2023-10-08T07:05:54.772 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/blkio 2023-10-08T07:05:54.772 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/devices 2023-10-08T07:05:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/perf_event 2023-10-08T07:05:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/rdma 2023-10-08T07:05:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/freezer 2023-10-08T07:05:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/pids 2023-10-08T07:05:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/memory 2023-10-08T07:05:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T07:05:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T07:05:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpuset 2023-10-08T07:05:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T07:05:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2023-10-08T07:05:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2023-10-08T07:05:54.773 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2023-10-08T07:05:54.774 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2023-10-08T07:05:54.774 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2023-10-08T07:05:54.774 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2023-10-08T07:05:54.774 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T07:05:54.774 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2023-10-08T07:05:54.774 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2023-10-08T07:05:54.774 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2023-10-08T07:05:54.774 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2023-10-08T07:05:54.774 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2023-10-08T07:05:54.774 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2023-10-08T07:05:54.775 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T07:05:54.775 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T07:05:54.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:54.775 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2023-10-08T07:05:54.811 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:54.810+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:54.812 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:54.812 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:54.823 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:05:54.828 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T07:05:54.828 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-08T07:05:54.871 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2023-10-08T07:05:54.898 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T07:05:54.912 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:54.911+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:54.955 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2023-10-08T07:05:54.955 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2023-10-08T07:05:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2023-10-08T07:05:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2023-10-08T07:05:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2023-10-08T07:05:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2023-10-08T07:05:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2023-10-08T07:05:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2023-10-08T07:05:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/systemd 2023-10-08T07:05:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2023-10-08T07:05:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2023-10-08T07:05:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/blkio 2023-10-08T07:05:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/devices 2023-10-08T07:05:54.956 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/perf_event 2023-10-08T07:05:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/rdma 2023-10-08T07:05:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/freezer 2023-10-08T07:05:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/pids 2023-10-08T07:05:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/memory 2023-10-08T07:05:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T07:05:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T07:05:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpuset 2023-10-08T07:05:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T07:05:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2023-10-08T07:05:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2023-10-08T07:05:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2023-10-08T07:05:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2023-10-08T07:05:54.958 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2023-10-08T07:05:54.958 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2023-10-08T07:05:54.958 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T07:05:54.958 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2023-10-08T07:05:54.958 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2023-10-08T07:05:54.958 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2023-10-08T07:05:54.958 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2023-10-08T07:05:54.958 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2023-10-08T07:05:54.958 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2023-10-08T07:05:54.958 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T07:05:54.958 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T07:05:54.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:54.959 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2023-10-08T07:05:54.962 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:54.962 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:54.964 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2023-10-08T07:05:54.963+0000 7f06855ba5c0 -1 init, newargv = 0x5580a4123c20 newargc=15 2023-10-08T07:05:54.964 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[101284]: starting ceph client 2023-10-08T07:05:54.968 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[101284]: starting fuse 2023-10-08T07:05:54.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:05:54.982 INFO:teuthology.orchestra.run.smithi017.stdout:47 2023-10-08T07:05:54.982 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-10-08T07:05:54.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2023-10-08T07:05:54.983 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2023-10-08T07:05:54.983 DEBUG:teuthology.orchestra.run.smithi017:> import re 2023-10-08T07:05:54.983 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-10-08T07:05:54.983 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2023-10-08T07:05:54.983 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-08T07:05:54.984 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2023-10-08T07:05:54.984 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T07:05:54.984 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2023-10-08T07:05:54.984 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T07:05:54.984 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-08T07:05:54.984 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2023-10-08T07:05:54.984 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2023-10-08T07:05:54.985 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2023-10-08T07:05:54.985 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2023-10-08T07:05:54.985 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-08T07:05:54.985 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2023-10-08T07:05:54.985 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T07:05:54.985 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T07:05:54.986 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T07:05:54.986 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2023-10-08T07:05:54.986 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2023-10-08T07:05:54.986 DEBUG:teuthology.orchestra.run.smithi017:> return f 2023-10-08T07:05:54.986 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T07:05:54.987 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-08T07:05:54.987 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2023-10-08T07:05:54.987 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-10-08T07:05:55.013 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:55.012+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:55.109 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.101284.asok 2023-10-08T07:05:55.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-08T07:05:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-08T07:05:55.114 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:55.113+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:55.117 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.101284.asok 2023-10-08T07:05:55.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:55.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.101284.asok status 2023-10-08T07:05:55.139 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:55.139 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:55.149 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:05:55.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:05:55.215 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:55.214+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:55.275 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:55.275 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:55.281 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-08T07:05:55.282 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2023-10-08T07:05:55.282 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "9725b08fd801c82987c737f7e6d354878f036ee8", 2023-10-08T07:05:55.282 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 18.0.0-6609-g9725b08f (9725b08fd801c82987c737f7e6d354878f036ee8) reef (dev)", 2023-10-08T07:05:55.282 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2023-10-08T07:05:55.282 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2023-10-08T07:05:55.282 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-08T07:05:55.282 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "101284", 2023-10-08T07:05:55.282 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2023-10-08T07:05:55.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:55.282 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2023-10-08T07:05:55.282 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2023-10-08T07:05:55.283 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4556, 2023-10-08T07:05:55.283 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2023-10-08T07:05:55.283 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2023-10-08T07:05:55.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2023-10-08T07:05:55.283 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 4556 2023-10-08T07:05:55.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:55.283 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2023-10-08T07:05:55.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:55.283 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2023-10-08T07:05:55.283 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2314322374 2023-10-08T07:05:55.283 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:05:55.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:55.284 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2023-10-08T07:05:55.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:05:55.284 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2023-10-08T07:05:55.284 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2314322374 2023-10-08T07:05:55.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:05:55.284 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.4556 192.168.0.1:0/2314322374", 2023-10-08T07:05:55.284 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/2314322374", 2023-10-08T07:05:55.284 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2023-10-08T07:05:55.284 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 6, 2023-10-08T07:05:55.284 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 20, 2023-10-08T07:05:55.284 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2023-10-08T07:05:55.284 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2023-10-08T07:05:55.285 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2023-10-08T07:05:55.285 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-08T07:05:55.286 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:05:55.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:55.293 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2023-10-08T07:05:55.293 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-08T07:05:55.310 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2023-10-08T07:05:55.310 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-08T07:05:55.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:05:55.310 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T07:05:55.317 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:55.316+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:55.357 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:05:55.378 INFO:teuthology.run_tasks:Running task workunit... 2023-10-08T07:05:55.390 INFO:tasks.workunit:Pulling workunits from ref 9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T07:05:55.391 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-08T07:05:55.391 INFO:tasks.workunit:timeout=3h 2023-10-08T07:05:55.391 INFO:tasks.workunit:cleanup=True 2023-10-08T07:05:55.391 DEBUG:teuthology.orchestra.run.smithi017:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-08T07:05:55.392 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:05:55.398 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:05:55.400 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:05:55.400 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T07:05:55.400 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:05:55.416 INFO:teuthology.orchestra.run.smithi017.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-08T07:05:55.416 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-10-08T07:05:55.416 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 2fh/47d Inode: 1 Links: 2 2023-10-08T07:05:55.416 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T07:05:55.416 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:fusefs_t:s0 2023-10-08T07:05:55.416 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-10-08T07:05:55.416 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-10-08 07:05:33.311701538 +0000 2023-10-08T07:05:55.416 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-10-08 07:05:55.376453726 +0000 2023-10-08T07:05:55.416 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2023-10-08T07:05:55.417 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-08T07:05:55.417 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-08T07:05:55.418 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:55.417+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:55.420 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:05:55.420 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:05:55.421 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:05:55.421 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:05:55.432 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:05:55.488 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T07:05:55.519 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:55.518+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:55.546 INFO:tasks.workunit.client.0.smithi017.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-08T07:05:55.558 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:05:55.558 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:05:55.558 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:05:55.558 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:05:55.558 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:05:55.568 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:05:55.621 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:55.620+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:55.696 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:05:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:05:55.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:05:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:05:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:05:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.377940498000001, 2023-10-08T07:05:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:05:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:55.697 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:05:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:05:55.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:05:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:05:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:05:55.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:05:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:05:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:05:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:05:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:05:55.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:05:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:05:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:05:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:05:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:05:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:05:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:05:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:05:55.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:05:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:05:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:05:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:05:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:05:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:05:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:05:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.377866714, 2023-10-08T07:05:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:05:55.705 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.706 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:05:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:05:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:05:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:05:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:05:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:05:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:05:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:05:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:05:55.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:05:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:05:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:05:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:05:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:05:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:05:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:05:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:05:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:05:55.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:05:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:05:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:05:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:05:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:05:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:05:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:05:55.714 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.377803537999998, 2023-10-08T07:05:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:05:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:05:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:05:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:05:55.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:05:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:05:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:05:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:05:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:05:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:05:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:05:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:05:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:05:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:05:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:05:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:05:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:05:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:05:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:05:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:55.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:05:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:05:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:05:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:05:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:05:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:05:55.721 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:05:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.377769191999999, 2023-10-08T07:05:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:05:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:55.722 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:05:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:05:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:05:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:05:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:05:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:05:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:05:55.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:05:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:05:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:05:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:05:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:05:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:05:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:05:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:05:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:05:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:05:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:05:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:55.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:05:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:05:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:05:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:05:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:05:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:05:55.728 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:05:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.377278966999999, 2023-10-08T07:05:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:05:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:05:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:05:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:05:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:05:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:05:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:05:55.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:05:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:05:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:05:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:05:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:05:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:05:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:05:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:05:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:05:55.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:05:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:05:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:05:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:05:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:05:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:05:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:05:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:05:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:05:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.736 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:55.736 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:05:55.736 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.377238389999999, 2023-10-08T07:05:55.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:05:55.736 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.736 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:55.736 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:05:55.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:05:55.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:05:55.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:05:55.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:05:55.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:05:55.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:05:55.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:05:55.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:05:55.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:05:55.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:05:55.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:05:55.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:05:55.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:05:55.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:55.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:05:55.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:05:55.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:55.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:05:55.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:05:55.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:55.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:05:55.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:05:55.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:55.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:05:55.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:05:55.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:05:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:05:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:05:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.377200820999999, 2023-10-08T07:05:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:05:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.743 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:55.743 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:05:55.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:05:55.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:05:55.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:05:55.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:05:55.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:05:55.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:05:55.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:05:55.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:05:55.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:05:55.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:05:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:05:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:05:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:05:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:05:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:05:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.747 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.747 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:55.747 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:05:55.747 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.377133381, 2023-10-08T07:05:55.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:05:55.747 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.747 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:55.747 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:05:55.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:05:55.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:05:55.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:05:55.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:05:55.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:05:55.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:05:55.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:05:55.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:05:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:05:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:05:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:05:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:05:55.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:05:55.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:05:55.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:05:55.751 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.751 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.751 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.752 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:55.752 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:05:55.752 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.377103738999999, 2023-10-08T07:05:55.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:05:55.752 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.752 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:55.752 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:05:55.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:05:55.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:05:55.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:05:55.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:05:55.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:05:55.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:05:55.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:05:55.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:05:55.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:05:55.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:05:55.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:05:55.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:05:55.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:05:55.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:05:55.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:05:55.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.756 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.756 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:05:55.756 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:05:55.757 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.371363177999999, 2023-10-08T07:05:55.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:05:55.757 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.757 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:05:55.757 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:05:55.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:05:55.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:05:55.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:05:55.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:05:55.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:05:55.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:05:55.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:05:55.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:05:55.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:05:55.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:05:55.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:05:55.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:05:55.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:05:55.760 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.760 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:16 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:05:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323497+0000", 2023-10-08T07:05:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.370965706, 2023-10-08T07:05:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019838899999999999, 2023-10-08T07:05:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323497+0000", 2023-10-08T07:05:55.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323497+0000", 2023-10-08T07:05:55.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323497+0000", 2023-10-08T07:05:55.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4999999999999999e-07 2023-10-08T07:05:55.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323499+0000", 2023-10-08T07:05:55.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2220000000000001e-06 2023-10-08T07:05:55.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323503+0000", 2023-10-08T07:05:55.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.721e-06 2023-10-08T07:05:55.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323513+0000", 2023-10-08T07:05:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9189999999999994e-06 2023-10-08T07:05:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323557+0000", 2023-10-08T07:05:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4199999999999997e-05 2023-10-08T07:05:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323565+0000", 2023-10-08T07:05:55.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7980000000000006e-06 2023-10-08T07:05:55.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323695+0000", 2023-10-08T07:05:55.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013037899999999999 2023-10-08T07:05:55.765 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.765 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.765 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.370913838, 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:05:55.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:05:55.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:05:55.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:05:55.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:05:55.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:05:55.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:05:55.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:05:55.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:05:55.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:05:55.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:05:55.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:05:55.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:05:55.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:05:55.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:05:55.770 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.770 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.770 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.770 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:05:55.770 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:05:55.770 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.370117948000001, 2023-10-08T07:05:55.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:05:55.771 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.771 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:55.771 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:05:55.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:05:55.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:05:55.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:05:55.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:05:55.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:05:55.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:05:55.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:05:55.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:05:55.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:05:55.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:05:55.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:05:55.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:05:55.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:05:55.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:55.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:05:55.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:05:55.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:05:55.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:05:55.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.775 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.776 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:05:55.776 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:05:55.776 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.370002596999999, 2023-10-08T07:05:55.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:05:55.776 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.776 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:55.776 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:05:55.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:05:55.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:05:55.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:05:55.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:05:55.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:05:55.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:05:55.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:05:55.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:05:55.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:05:55.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:05:55.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:05:55.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:05:55.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:05:55.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:55.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:05:55.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:05:55.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:05:55.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:05:55.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.781 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.782 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:05:55.782 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:05:55.782 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.364888031, 2023-10-08T07:05:55.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:05:55.782 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.782 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:55.782 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:05:55.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:05:55.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:05:55.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:05:55.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:05:55.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:05:55.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:05:55.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:05:55.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:05:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:05:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:05:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:05:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:05:55.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:05:55.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:55.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:05:55.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:05:55.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:05:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:05:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:05:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:05:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.364777039, 2023-10-08T07:05:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:05:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.787 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:55.788 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:05:55.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:05:55.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:05:55.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:05:55.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:05:55.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:05:55.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:05:55.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.364352598, 2023-10-08T07:05:55.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:05:55.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:05:55.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:05:55.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:05:55.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:05:55.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:05:55.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:05:55.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:05:55.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:05:55.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:05:55.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:05:55.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:05:55.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:05:55.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:05:55.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:05:55.796 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.797 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.797 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.797 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:05:55.797 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:05:55.797 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.364205462000001, 2023-10-08T07:05:55.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:05:55.797 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.797 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:05:55.797 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:05:55.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:05:55.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:05:55.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:05:55.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:05:55.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:05:55.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:05:55.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:05:55.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:05:55.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:05:55.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:05:55.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:05:55.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:05:55.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:05:55.801 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.801 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.801 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.802 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:05:55.802 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:05:55.802 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.292907193000001, 2023-10-08T07:05:55.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:05:55.802 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.802 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:55.802 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:05:55.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:05:55.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:05:55.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:05:55.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:05:55.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:05:55.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:05:55.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:05:55.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:05:55.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:05:55.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:05:55.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:05:55.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:05:55.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:05:55.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:55.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:05:55.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:05:55.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:55.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:05:55.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:05:55.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:55.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:05:55.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:05:55.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:55.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:05:55.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:05:55.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:05:55.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:05:55.808 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.808 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.808 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.808 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:05:55.808 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:05:55.808 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.291113609, 2023-10-08T07:05:55.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:05:55.809 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:55.809 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:55.809 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:55.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:55.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:05:55.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:55.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:05:55.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:55.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:55.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:05:55.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:05:55.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:55.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:05:55.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:05:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:05:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:05:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:05:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:05:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:55.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:05:55.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:05:55.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:55.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:05:55.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:05:55.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:55.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:55.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:55.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:05:55.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:05:55.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.813 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:55.813 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:55.813 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:05:55.815 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:05:55.815 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:55.813+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:55.915 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:55.914+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:55.962 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:05:55.962 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:05:55.962 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:05:55.962 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:05:55.973 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:05:56.016 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:56.015+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:56.023 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T07:05:56.117 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:56.116+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:56.146 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:05:56.146 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:05:56.146 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:05:56.146 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:05:56.146 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:05:56.156 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:05:56.217 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:56.216+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:56.290 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:05:56.290 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:05:56.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:05:56.290 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:05:56.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.291 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:05:56.291 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:05:56.291 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 33.516102695000001, 2023-10-08T07:05:56.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:05:56.291 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.291 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.291 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:05:56.291 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:05:56.291 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:05:56.292 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:05:56.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.292 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:05:56.292 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:05:56.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.293 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:05:56.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:05:56.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.293 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:05:56.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:05:56.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:05:56.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:05:56.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:05:56.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:05:56.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:05:56.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:05:56.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:05:56.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:05:56.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:05:56.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:05:56.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:05:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:05:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:05:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:05:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.298 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:05:56.298 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:05:56.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.298 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.298 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:05:56.298 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:05:56.298 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.298 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.298 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.299 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:05:56.299 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:05:56.299 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 33.516081149000001, 2023-10-08T07:05:56.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:05:56.299 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.299 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.299 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:05:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:05:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:05:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:05:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:05:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:05:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:05:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:05:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:05:56.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:05:56.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:05:56.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:05:56.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.303 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:05:56.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:05:56.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.303 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:05:56.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:05:56.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:05:56.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:05:56.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:05:56.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:05:56.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:05:56.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:05:56.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:05:56.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:05:56.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:05:56.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:05:56.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:05:56.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:05:56.307 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.307 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.307 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.307 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:05:56.307 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:05:56.307 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 33.516014554999998, 2023-10-08T07:05:56.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:05:56.307 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.308 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.308 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:05:56.308 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:05:56.308 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:05:56.308 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:05:56.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.308 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:05:56.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:05:56.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.310 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:05:56.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:05:56.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.310 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:05:56.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:05:56.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.311 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:05:56.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:05:56.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.311 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:05:56.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:05:56.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:05:56.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:05:56.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:05:56.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:05:56.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:05:56.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:05:56.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:05:56.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:05:56.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.314 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:05:56.314 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:05:56.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.314 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:05:56.314 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:05:56.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.315 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:05:56.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:05:56.315 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.315 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.315 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.315 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:05:56.316 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:05:56.316 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 33.515995658999998, 2023-10-08T07:05:56.316 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:05:56.316 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.316 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.316 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:05:56.316 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:05:56.316 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:05:56.316 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:05:56.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.317 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.317 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.317 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.317 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:05:56.317 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.317 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.317 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.317 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:05:56.317 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.318 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:05:56.318 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:05:56.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.318 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:05:56.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:05:56.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.319 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:05:56.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:05:56.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.319 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:05:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:05:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:05:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:05:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:05:56.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:05:56.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:05:56.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:05:56.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:05:56.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:05:56.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:05:56.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:05:56.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:05:56.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:05:56.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:05:56.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:05:56.323 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.323 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.324 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.324 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:05:56.324 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:05:56.324 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 33.515982649999998, 2023-10-08T07:05:56.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:05:56.324 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.324 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.324 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:05:56.325 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:05:56.325 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:05:56.325 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:05:56.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.325 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:05:56.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:05:56.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:05:56.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:05:56.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.327 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:05:56.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:05:56.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.327 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:05:56.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:05:56.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.328 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:05:56.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:05:56.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.328 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:05:56.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:05:56.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:05:56.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:05:56.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:05:56.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:05:56.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:05:56.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:05:56.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:05:56.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:05:56.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:05:56.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:05:56.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:05:56.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:05:56.332 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.333 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.333 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.333 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:05:56.334 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:05:56.334 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 33.515930597999997, 2023-10-08T07:05:56.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:05:56.334 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.334 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.334 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:05:56.334 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:05:56.334 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:05:56.334 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:05:56.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.335 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:05:56.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:05:56.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:05:56.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:05:56.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:05:56.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:05:56.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.337 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.337 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:05:56.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:05:56.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:05:56.338 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:05:56.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:05:56.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:05:56.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:05:56.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:05:56.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.341 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:05:56.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:05:56.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.341 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:05:56.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:05:56.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.342 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.342 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:05:56.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:05:56.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:05:56.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:05:56.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:05:56.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:05:56.344 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.344 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.344 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.344 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.345 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:05:56.345 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.970726770999999, 2023-10-08T07:05:56.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:05:56.345 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.345 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.345 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:05:56.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.347 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:05:56.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.347 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.347 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:05:56.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:05:56.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.347 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.347 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:05:56.348 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:05:56.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.348 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.348 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:05:56.348 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:05:56.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.348 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.348 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:05:56.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:05:56.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:05:56.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:05:56.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:05:56.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:05:56.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:05:56.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:05:56.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:05:56.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:05:56.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:05:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:05:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:05:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:05:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:05:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:05:56.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:05:56.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:05:56.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:05:56.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:05:56.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:05:56.353 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.353 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.353 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.353 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.353 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:05:56.353 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.970610293, 2023-10-08T07:05:56.354 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:05:56.354 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.354 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.354 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.354 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.354 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:05:56.354 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.354 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.355 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:05:56.355 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:05:56.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:05:56.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:05:56.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:05:56.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:05:56.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:05:56.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.359 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.359 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:05:56.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:05:56.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.360 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:05:56.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:05:56.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:05:56.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:05:56.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:05:56.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:05:56.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:05:56.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:05:56.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:05:56.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:05:56.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:05:56.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.363 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.364 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:05:56.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:05:56.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.364 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.364 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:05:56.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:05:56.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:05:56.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:05:56.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:05:56.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:05:56.366 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.367 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.367 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.367 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.367 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:05:56.368 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.970559966, 2023-10-08T07:05:56.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:05:56.368 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.368 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.368 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.369 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.369 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:05:56.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.369 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:05:56.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:05:56.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:05:56.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:05:56.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:05:56.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.372 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:05:56.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:05:56.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:05:56.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:05:56.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:05:56.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:05:56.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:05:56.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:05:56.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:05:56.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:05:56.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:05:56.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:05:56.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:05:56.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:05:56.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:05:56.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.377 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:05:56.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:05:56.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.378 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:05:56.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:05:56.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:05:56.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:05:56.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:05:56.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:05:56.380 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.380 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.380 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.380 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.381 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:05:56.381 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.970234121000001, 2023-10-08T07:05:56.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:05:56.381 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.381 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.381 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:05:56.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:05:56.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:05:56.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:05:56.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:05:56.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:05:56.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.384 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:05:56.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:05:56.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.384 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:05:56.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:05:56.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:05:56.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:05:56.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.386 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:05:56.386 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:05:56.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:05:56.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.387 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:05:56.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:05:56.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:05:56.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:05:56.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:05:56.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:05:56.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:05:56.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:05:56.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:05:56.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:05:56.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:05:56.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:05:56.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.392 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:05:56.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:05:56.392 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.392 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.392 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.393 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.393 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:05:56.393 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.970181596, 2023-10-08T07:05:56.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:05:56.393 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.394 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.394 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:05:56.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:05:56.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:05:56.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:05:56.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:05:56.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:05:56.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:05:56.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:05:56.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:05:56.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:05:56.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:05:56.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:05:56.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:05:56.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:05:56.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.400 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.400 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:05:56.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:05:56.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:05:56.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:05:56.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:05:56.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:05:56.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:05:56.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:05:56.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:05:56.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:05:56.403 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.404 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.404 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.404 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.404 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:05:56.404 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.970013621, 2023-10-08T07:05:56.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:05:56.405 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.405 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.405 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:05:56.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:05:56.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:05:56.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:05:56.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:05:56.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:05:56.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:05:56.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:05:56.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:05:56.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:05:56.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:05:56.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:05:56.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:05:56.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:05:56.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:05:56.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:05:56.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:05:56.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:05:56.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:05:56.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:05:56.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:05:56.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:05:56.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:05:56.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:05:56.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:05:56.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:05:56.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:05:56.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:05:56.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:05:56.417 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.417 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.418 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.418 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.418 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:05:56.418 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.969869323000001, 2023-10-08T07:05:56.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:05:56.419 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.419 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.419 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:05:56.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:05:56.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:05:56.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:05:56.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:05:56.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:05:56.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:05:56.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:05:56.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:05:56.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:05:56.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:05:56.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:05:56.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:05:56.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:05:56.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:05:56.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:05:56.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:05:56.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:05:56.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:05:56.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:05:56.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:05:56.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:05:56.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:05:56.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:05:56.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:05:56.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:05:56.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:05:56.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:05:56.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:05:56.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:05:56.431 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.431 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.431 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.432 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.432 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:05:56.432 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.969189811, 2023-10-08T07:05:56.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:05:56.432 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.432 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.432 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:05:56.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:05:56.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:05:56.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:05:56.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:05:56.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:05:56.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:05:56.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:05:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:05:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:05:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:05:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:05:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:05:56.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:05:56.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:05:56.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:05:56.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:05:56.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:05:56.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:05:56.438 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.438 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.438 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.438 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.438 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:05:56.438 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.969136541000001, 2023-10-08T07:05:56.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:05:56.439 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.439 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.439 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:05:56.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:05:56.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:05:56.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:05:56.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:05:56.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:05:56.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:05:56.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:05:56.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:05:56.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:05:56.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:05:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:05:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:05:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:05:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:05:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:05:56.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:05:56.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:05:56.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:05:56.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:05:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:05:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:05:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:05:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:05:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:05:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.969100695000002, 2023-10-08T07:05:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:05:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:05:56.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:05:56.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:05:56.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:05:56.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:05:56.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:05:56.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:05:56.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:05:56.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:05:56.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:05:56.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:05:56.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:05:56.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:05:56.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:05:56.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:05:56.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:05:56.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:05:56.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:05:56.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:05:56.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:05:56.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:05:56.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:05:56.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:05:56.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:05:56.451 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.451 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.451 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.451 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.451 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:05:56.451 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.968960163999999, 2023-10-08T07:05:56.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:05:56.451 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.452 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.452 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:05:56.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:05:56.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:05:56.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:05:56.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:05:56.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:05:56.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:05:56.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:05:56.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:05:56.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:05:56.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:05:56.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:05:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:05:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:05:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:05:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:05:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:05:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:05:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:05:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:05:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:05:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:05:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:05:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:05:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:05:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:05:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:05:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:05:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:05:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:05:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:05:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.968667840999998, 2023-10-08T07:05:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:05:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:05:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:05:56.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:05:56.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:05:56.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:05:56.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:05:56.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:05:56.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.462 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:05:56.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:05:56.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.462 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:05:56.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:05:56.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:05:56.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:05:56.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:05:56.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:05:56.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.464 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.465 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:05:56.465 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.968554199, 2023-10-08T07:05:56.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:05:56.465 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.465 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.465 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:05:56.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:05:56.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:05:56.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:05:56.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:05:56.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:05:56.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:05:56.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:05:56.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:05:56.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:05:56.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:05:56.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:05:56.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:05:56.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:05:56.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:56.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:05:56.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:05:56.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:05:56.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:05:56.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:05:56.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:05:56.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.470 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.471 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.471 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:05:56.471 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 22.967523974999999, 2023-10-08T07:05:56.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:05:56.471 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:05:56.471 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:05:56.471 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:05:56.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:05:56.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:05:56.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:05:56.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:05:56.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:05:56.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:05:56.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:05:56.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:05:56.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:05:56.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:05:56.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:05:56.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:05:56.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:05:56.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:05:56.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:05:56.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:05:56.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:05:56.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:05:56.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:05:56.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:05:56.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:05:56.475 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.475 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.475 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.475 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:05:56.475 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:05:56.475 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:05:56.477 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:05:56.477 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:56.475+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:56.578 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:56.577+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:56.614 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:05:56.615 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:05:56.615 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2023-10-08T07:05:56.615 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:05:56.625 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:05:56.679 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:56.678+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:56.751 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:05:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:05:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2023-10-08T07:05:56.751 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2023-10-08T07:05:56.751 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:05:56.761 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:05:56.780 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:56.780+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:56.881 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:56.880+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:56.888 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:05:56.888 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2023-10-08T07:05:56.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2023-10-08T07:05:56.889 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2023-10-08T07:05:56.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.889 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-10-08T07:05:56.889 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:05:56.889 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.571617109999998, 2023-10-08T07:05:56.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069404690000000003, 2023-10-08T07:05:56.889 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.889 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.889 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:05:56.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:05:56.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315211+0000", 2023-10-08T07:05:56.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:05:56.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315216+0000", 2023-10-08T07:05:56.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:05:56.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315229+0000", 2023-10-08T07:05:56.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.278e-05 2023-10-08T07:05:56.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315235+0000", 2023-10-08T07:05:56.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2023-10-08T07:05:56.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316390+0000", 2023-10-08T07:05:56.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011548179999999999 2023-10-08T07:05:56.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316410+0000", 2023-10-08T07:05:56.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0818999999999998e-05 2023-10-08T07:05:56.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322113+0000", 2023-10-08T07:05:56.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057026159999999998 2023-10-08T07:05:56.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322150+0000", 2023-10-08T07:05:56.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7401999999999999e-05 2023-10-08T07:05:56.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.894 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.894 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-10-08T07:05:56.894 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:05:56.894 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.114257340000002, 2023-10-08T07:05:56.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087059660000000007, 2023-10-08T07:05:56.894 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.894 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.894 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:05:56.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.895 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:05:56.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.895 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:05:56.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:05:56.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772604+0000", 2023-10-08T07:05:56.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.413e-05 2023-10-08T07:05:56.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772617+0000", 2023-10-08T07:05:56.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2595999999999999e-05 2023-10-08T07:05:56.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772624+0000", 2023-10-08T07:05:56.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2023-10-08T07:05:56.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772666+0000", 2023-10-08T07:05:56.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1925000000000003e-05 2023-10-08T07:05:56.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772685+0000", 2023-10-08T07:05:56.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9071000000000001e-05 2023-10-08T07:05:56.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781237+0000", 2023-10-08T07:05:56.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085519059999999997 2023-10-08T07:05:56.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781276+0000", 2023-10-08T07:05:56.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9161e-05 2023-10-08T07:05:56.899 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.899 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.899 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.899 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-10-08T07:05:56.899 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:05:56.899 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.113760685999999, 2023-10-08T07:05:56.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010997768, 2023-10-08T07:05:56.900 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.900 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.900 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:05:56.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:05:56.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773067+0000", 2023-10-08T07:05:56.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:05:56.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.901 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773071+0000", 2023-10-08T07:05:56.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3819999999999997e-06 2023-10-08T07:05:56.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773082+0000", 2023-10-08T07:05:56.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0407e-05 2023-10-08T07:05:56.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773087+0000", 2023-10-08T07:05:56.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:05:56.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775481+0000", 2023-10-08T07:05:56.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023941470000000001 2023-10-08T07:05:56.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775493+0000", 2023-10-08T07:05:56.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2126999999999999e-05 2023-10-08T07:05:56.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784021+0000", 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085280589999999993 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784064+0000", 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.295e-05 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:157 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'111, mlcod=11'105)", 2023-10-08T07:05:56.904 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:05:56.905 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.113340588, 2023-10-08T07:05:56.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010614554, 2023-10-08T07:05:56.905 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.905 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.905 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:05:56.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:05:56.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773487+0000", 2023-10-08T07:05:56.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:05:56.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773492+0000", 2023-10-08T07:05:56.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2249999999999999e-06 2023-10-08T07:05:56.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773503+0000", 2023-10-08T07:05:56.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0271e-05 2023-10-08T07:05:56.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773509+0000", 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5470000000000002e-06 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775801+0000", 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022918790000000001 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775822+0000", 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1486000000000001e-05 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784066+0000", 2023-10-08T07:05:56.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082432089999999996 2023-10-08T07:05:56.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784101+0000", 2023-10-08T07:05:56.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5383999999999999e-05 2023-10-08T07:05:56.909 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.909 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.909 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.910 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:158 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'112, mlcod=11'106)", 2023-10-08T07:05:56.910 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:05:56.910 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.112863490999999, 2023-10-08T07:05:56.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010172001999999999, 2023-10-08T07:05:56.910 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.910 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.910 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.82e-07 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773990+0000", 2023-10-08T07:05:56.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2023-10-08T07:05:56.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774001+0000", 2023-10-08T07:05:56.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0873000000000001e-05 2023-10-08T07:05:56.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774006+0000", 2023-10-08T07:05:56.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0900000000000004e-06 2023-10-08T07:05:56.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776145+0000", 2023-10-08T07:05:56.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021389759999999999 2023-10-08T07:05:56.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776165+0000", 2023-10-08T07:05:56.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9548e-05 2023-10-08T07:05:56.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784102+0000", 2023-10-08T07:05:56.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007937342 2023-10-08T07:05:56.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784136+0000", 2023-10-08T07:05:56.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3331000000000003e-05 2023-10-08T07:05:56.914 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.915 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.915 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.915 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:159 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'113, mlcod=11'106)", 2023-10-08T07:05:56.915 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:05:56.915 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.112330532999998, 2023-10-08T07:05:56.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096667119999999992, 2023-10-08T07:05:56.915 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.915 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.915 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:05:56.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:05:56.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774501+0000", 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1529999999999999e-06 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774511+0000", 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:05:56.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774533+0000", 2023-10-08T07:05:56.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2348999999999999e-05 2023-10-08T07:05:56.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776608+0000", 2023-10-08T07:05:56.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002074799 2023-10-08T07:05:56.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776627+0000", 2023-10-08T07:05:56.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8632999999999999e-05 2023-10-08T07:05:56.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784138+0000", 2023-10-08T07:05:56.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075110819999999997 2023-10-08T07:05:56.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784163+0000", 2023-10-08T07:05:56.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5425000000000001e-05 2023-10-08T07:05:56.920 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.920 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.920 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.920 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:160 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'114, mlcod=11'106)", 2023-10-08T07:05:56.920 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:05:56.920 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.111695351000002, 2023-10-08T07:05:56.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090478150000000007, 2023-10-08T07:05:56.920 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775133+0000", 2023-10-08T07:05:56.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2023-10-08T07:05:56.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775150+0000", 2023-10-08T07:05:56.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6206e-05 2023-10-08T07:05:56.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775173+0000", 2023-10-08T07:05:56.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.351e-05 2023-10-08T07:05:56.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775187+0000", 2023-10-08T07:05:56.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4396000000000001e-05 2023-10-08T07:05:56.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.923 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.923 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.923 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776909+0000", 2023-10-08T07:05:56.923 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017220429999999999 2023-10-08T07:05:56.923 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776929+0000", 2023-10-08T07:05:56.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9313e-05 2023-10-08T07:05:56.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.924 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.924 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.924 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784164+0000", 2023-10-08T07:05:56.924 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072352340000000001 2023-10-08T07:05:56.924 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.925 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.925 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:05:56.925 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526e-05 2023-10-08T07:05:56.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.925 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.925 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.925 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.925 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.925 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:161 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'115, mlcod=11'106)", 2023-10-08T07:05:56.925 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:05:56.925 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.111016462000002, 2023-10-08T07:05:56.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083874480000000005, 2023-10-08T07:05:56.926 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.926 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.926 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.926 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.926 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.926 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:05:56.926 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.926 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:05:56.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.927 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:05:56.927 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:05:56.927 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.927 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.927 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775837+0000", 2023-10-08T07:05:56.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6081e-05 2023-10-08T07:05:56.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775849+0000", 2023-10-08T07:05:56.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:05:56.928 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.928 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.928 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.928 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775854+0000", 2023-10-08T07:05:56.928 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1490000000000002e-06 2023-10-08T07:05:56.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777220+0000", 2023-10-08T07:05:56.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001365174 2023-10-08T07:05:56.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.929 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.929 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777232+0000", 2023-10-08T07:05:56.929 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2293000000000001e-05 2023-10-08T07:05:56.929 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.929 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:05:56.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069481450000000002 2023-10-08T07:05:56.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.930 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.930 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.930 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784198+0000", 2023-10-08T07:05:56.930 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2023-10-08T07:05:56.930 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.930 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.930 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.930 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.931 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:162 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'116, mlcod=11'106)", 2023-10-08T07:05:56.931 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:05:56.931 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.110392060000002, 2023-10-08T07:05:56.931 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077785969999999999, 2023-10-08T07:05:56.931 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.931 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.931 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.931 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:05:56.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:05:56.932 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.932 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.932 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.932 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.932 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776436+0000", 2023-10-08T07:05:56.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:05:56.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776440+0000", 2023-10-08T07:05:56.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2629999999999997e-06 2023-10-08T07:05:56.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.933 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.933 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.933 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776451+0000", 2023-10-08T07:05:56.933 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1385e-05 2023-10-08T07:05:56.933 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776456+0000", 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9919999999999998e-06 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777629+0000", 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001173297 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.934 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777650+0000", 2023-10-08T07:05:56.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0126e-05 2023-10-08T07:05:56.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784199+0000", 2023-10-08T07:05:56.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006548908 2023-10-08T07:05:56.935 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.935 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.935 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.935 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:05:56.935 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5071e-05 2023-10-08T07:05:56.935 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:163 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'117, mlcod=11'106)", 2023-10-08T07:05:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:05:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.109749653000002, 2023-10-08T07:05:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071515490000000001, 2023-10-08T07:05:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.936 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:05:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:05:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.937 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777078+0000", 2023-10-08T07:05:56.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4400000000000001e-07 2023-10-08T07:05:56.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777082+0000", 2023-10-08T07:05:56.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.732e-06 2023-10-08T07:05:56.938 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.938 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.938 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.938 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777095+0000", 2023-10-08T07:05:56.938 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3749e-05 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777100+0000", 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.634e-06 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777944+0000", 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00084377599999999997 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.939 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777957+0000", 2023-10-08T07:05:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.276e-05 2023-10-08T07:05:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:05:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006257617 2023-10-08T07:05:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784229+0000", 2023-10-08T07:05:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4837e-05 2023-10-08T07:05:56.941 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.941 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.941 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.941 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.941 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.941 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:164 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'118, mlcod=11'106)", 2023-10-08T07:05:56.941 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:05:56.941 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 34.109168314000001, 2023-10-08T07:05:56.941 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093104280000000008, 2023-10-08T07:05:56.941 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.941 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.941 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.942 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2e-07 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777713+0000", 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4079999999999997e-05 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777724+0000", 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0652999999999999e-05 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.943 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777729+0000", 2023-10-08T07:05:56.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2050000000000001e-06 2023-10-08T07:05:56.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778177+0000", 2023-10-08T07:05:56.944 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044763499999999999 2023-10-08T07:05:56.944 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.944 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.944 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.944 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778195+0000", 2023-10-08T07:05:56.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8125e-05 2023-10-08T07:05:56.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.945 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.945 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786935+0000", 2023-10-08T07:05:56.945 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087396049999999992 2023-10-08T07:05:56.945 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.945 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.946 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.946 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786969+0000", 2023-10-08T07:05:56.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4604999999999998e-05 2023-10-08T07:05:56.946 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.946 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.946 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.946 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.946 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.946 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.946 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:05:56.946 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.571279883999999, 2023-10-08T07:05:56.946 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013957681, 2023-10-08T07:05:56.947 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.947 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.947 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.947 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:05:56.947 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.947 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.947 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.947 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:05:56.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.948 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315552+0000", 2023-10-08T07:05:56.948 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.152e-06 2023-10-08T07:05:56.948 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.948 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.948 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315568+0000", 2023-10-08T07:05:56.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5301000000000001e-05 2023-10-08T07:05:56.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315583+0000", 2023-10-08T07:05:56.949 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5826000000000001e-05 2023-10-08T07:05:56.949 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.949 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.949 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.949 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315598+0000", 2023-10-08T07:05:56.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4953999999999999e-05 2023-10-08T07:05:56.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317200+0000", 2023-10-08T07:05:56.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016014950000000001 2023-10-08T07:05:56.950 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.950 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.950 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.950 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317351+0000", 2023-10-08T07:05:56.950 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015081400000000001 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317540+0000", 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000189557 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322281+0000", 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047409599999999998 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.951 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329404+0000", 2023-10-08T07:05:56.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071225460000000004 2023-10-08T07:05:56.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329459+0000", 2023-10-08T07:05:56.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5016999999999999e-05 2023-10-08T07:05:56.952 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.952 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.952 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.952 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329505+0000", 2023-10-08T07:05:56.952 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059000000000001e-05 2023-10-08T07:05:56.953 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.953 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.953 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.953 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.953 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.953 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.953 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:05:56.953 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.571196915000002, 2023-10-08T07:05:56.953 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015617259, 2023-10-08T07:05:56.953 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.953 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.953 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:05:56.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.954 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:05:56.954 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.954 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.954 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.954 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315631+0000", 2023-10-08T07:05:56.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2023-10-08T07:05:56.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315636+0000", 2023-10-08T07:05:56.955 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1019999999999996e-06 2023-10-08T07:05:56.955 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.955 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.955 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.955 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315646+0000", 2023-10-08T07:05:56.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0056e-05 2023-10-08T07:05:56.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315654+0000", 2023-10-08T07:05:56.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7810000000000005e-06 2023-10-08T07:05:56.956 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.956 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.956 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.956 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318626+0000", 2023-10-08T07:05:56.956 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00297183 2023-10-08T07:05:56.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319450+0000", 2023-10-08T07:05:56.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082440400000000004 2023-10-08T07:05:56.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.957 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:56.957 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319924+0000", 2023-10-08T07:05:56.957 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047403099999999997 2023-10-08T07:05:56.957 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.957 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:56.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322475+0000", 2023-10-08T07:05:56.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002550442 2023-10-08T07:05:56.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.958 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331142+0000", 2023-10-08T07:05:56.958 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086669030000000001 2023-10-08T07:05:56.958 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.958 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.958 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331217+0000", 2023-10-08T07:05:56.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5606999999999996e-05 2023-10-08T07:05:56.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.959 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.959 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331247+0000", 2023-10-08T07:05:56.959 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:05:56.959 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.959 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.959 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.959 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.959 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.960 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:15 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.960 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:05:56.960 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.570033475999999, 2023-10-08T07:05:56.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012716055, 2023-10-08T07:05:56.960 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.960 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.960 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.960 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.960 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.960 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:05:56.960 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.960 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:05:56.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.961 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:05:56.961 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8599999999999997e-07 2023-10-08T07:05:56.961 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.961 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.961 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316805+0000", 2023-10-08T07:05:56.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0475000000000001e-05 2023-10-08T07:05:56.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316817+0000", 2023-10-08T07:05:56.962 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.226e-05 2023-10-08T07:05:56.962 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.962 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.962 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.962 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316828+0000", 2023-10-08T07:05:56.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1090999999999999e-05 2023-10-08T07:05:56.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317025+0000", 2023-10-08T07:05:56.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019711500000000001 2023-10-08T07:05:56.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.963 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.963 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.963 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317244+0000", 2023-10-08T07:05:56.963 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021908999999999999 2023-10-08T07:05:56.963 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:56.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317436+0000", 2023-10-08T07:05:56.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019164900000000001 2023-10-08T07:05:56.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:56.964 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321493+0000", 2023-10-08T07:05:56.964 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040573190000000002 2023-10-08T07:05:56.964 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.964 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.964 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329275+0000", 2023-10-08T07:05:56.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077820950000000002 2023-10-08T07:05:56.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329457+0000", 2023-10-08T07:05:56.965 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018165600000000001 2023-10-08T07:05:56.965 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.965 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.965 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.965 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329510+0000", 2023-10-08T07:05:56.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2519000000000003e-05 2023-10-08T07:05:56.966 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.966 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.966 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.966 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.966 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.966 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:27 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.966 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:05:56.966 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.569972685, 2023-10-08T07:05:56.966 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015441417000000001, 2023-10-08T07:05:56.966 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.966 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.967 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:05:56.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.967 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.967 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.967 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:05:56.967 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.967 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316855+0000", 2023-10-08T07:05:56.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:05:56.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.968 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316861+0000", 2023-10-08T07:05:56.968 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6210000000000001e-06 2023-10-08T07:05:56.968 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.968 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.968 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316869+0000", 2023-10-08T07:05:56.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.225e-06 2023-10-08T07:05:56.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316878+0000", 2023-10-08T07:05:56.969 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8799999999999997e-06 2023-10-08T07:05:56.969 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.969 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.969 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.969 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319969+0000", 2023-10-08T07:05:56.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030906689999999999 2023-10-08T07:05:56.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320072+0000", 2023-10-08T07:05:56.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103458 2023-10-08T07:05:56.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.970 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.970 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:56.970 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320631+0000", 2023-10-08T07:05:56.970 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055936099999999997 2023-10-08T07:05:56.970 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:56.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322686+0000", 2023-10-08T07:05:56.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020545899999999998 2023-10-08T07:05:56.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.971 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332244+0000", 2023-10-08T07:05:56.971 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095578690000000001 2023-10-08T07:05:56.971 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.971 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.971 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332274+0000", 2023-10-08T07:05:56.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0527000000000001e-05 2023-10-08T07:05:56.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.972 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.972 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.972 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332296+0000", 2023-10-08T07:05:56.972 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1359999999999999e-05 2023-10-08T07:05:56.972 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.972 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.972 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.972 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.973 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.973 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:05:56.973 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.569936095999999, 2023-10-08T07:05:56.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014502582, 2023-10-08T07:05:56.973 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.973 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.973 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.973 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.973 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.973 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:05:56.973 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:05:56.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.974 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.974 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316892+0000", 2023-10-08T07:05:56.974 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:05:56.974 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.974 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316896+0000", 2023-10-08T07:05:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9140000000000001e-06 2023-10-08T07:05:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316904+0000", 2023-10-08T07:05:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1170000000000004e-06 2023-10-08T07:05:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.975 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316911+0000", 2023-10-08T07:05:56.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:05:56.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320938+0000", 2023-10-08T07:05:56.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040269959999999997 2023-10-08T07:05:56.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.976 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.976 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321023+0000", 2023-10-08T07:05:56.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5420000000000005e-05 2023-10-08T07:05:56.976 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:56.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321157+0000", 2023-10-08T07:05:56.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013383700000000001 2023-10-08T07:05:56.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.977 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:56.977 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322742+0000", 2023-10-08T07:05:56.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015851249999999999 2023-10-08T07:05:56.977 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.977 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331290+0000", 2023-10-08T07:05:56.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085483190000000004 2023-10-08T07:05:56.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331348+0000", 2023-10-08T07:05:56.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7630999999999998e-05 2023-10-08T07:05:56.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331394+0000", 2023-10-08T07:05:56.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5534999999999997e-05 2023-10-08T07:05:56.979 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.979 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.979 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.979 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.979 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:05:56.979 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.569907608000001, 2023-10-08T07:05:56.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015363402, 2023-10-08T07:05:56.979 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.979 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.980 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:05:56.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:05:56.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316920+0000", 2023-10-08T07:05:56.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2023-10-08T07:05:56.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316923+0000", 2023-10-08T07:05:56.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2169999999999999e-06 2023-10-08T07:05:56.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316930+0000", 2023-10-08T07:05:56.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:05:56.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316938+0000", 2023-10-08T07:05:56.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:05:56.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322217+0000", 2023-10-08T07:05:56.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052793680000000004 2023-10-08T07:05:56.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322295+0000", 2023-10-08T07:05:56.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7621999999999996e-05 2023-10-08T07:05:56.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:56.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322411+0000", 2023-10-08T07:05:56.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000116297 2023-10-08T07:05:56.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:56.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323187+0000", 2023-10-08T07:05:56.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077583700000000003 2023-10-08T07:05:56.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332224+0000", 2023-10-08T07:05:56.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090370980000000004 2023-10-08T07:05:56.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.984 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.984 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332261+0000", 2023-10-08T07:05:56.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6464999999999997e-05 2023-10-08T07:05:56.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.985 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.985 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332283+0000", 2023-10-08T07:05:56.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2124e-05 2023-10-08T07:05:56.985 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.985 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.985 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.985 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.985 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.986 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:05:56.986 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.568784424, 2023-10-08T07:05:56.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014463023, 2023-10-08T07:05:56.986 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.986 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:56.986 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.986 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:05:56.986 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:05:56.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318044+0000", 2023-10-08T07:05:56.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1000000000000001e-06 2023-10-08T07:05:56.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318057+0000", 2023-10-08T07:05:56.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2860000000000001e-05 2023-10-08T07:05:56.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318067+0000", 2023-10-08T07:05:56.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0638999999999999e-05 2023-10-08T07:05:56.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318090+0000", 2023-10-08T07:05:56.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2889000000000001e-05 2023-10-08T07:05:56.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320985+0000", 2023-10-08T07:05:56.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028951279999999999 2023-10-08T07:05:56.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321126+0000", 2023-10-08T07:05:56.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014045600000000001 2023-10-08T07:05:56.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:56.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321798+0000", 2023-10-08T07:05:56.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067266600000000004 2023-10-08T07:05:56.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:56.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323135+0000", 2023-10-08T07:05:56.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013368589999999999 2023-10-08T07:05:56.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:56.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332445+0000", 2023-10-08T07:05:56.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093094419999999994 2023-10-08T07:05:56.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:56.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332482+0000", 2023-10-08T07:05:56.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:05:56.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332506+0000", 2023-10-08T07:05:56.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3649e-05 2023-10-08T07:05:56.992 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.992 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.992 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.992 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.992 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:05:56.992 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.568715914999999, 2023-10-08T07:05:56.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011597616999999999, 2023-10-08T07:05:56.992 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.993 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:05:56.993 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:05:56.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:05:56.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318112+0000", 2023-10-08T07:05:56.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2299999999999999e-07 2023-10-08T07:05:56.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318117+0000", 2023-10-08T07:05:56.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1170000000000003e-06 2023-10-08T07:05:56.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:56.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318127+0000", 2023-10-08T07:05:56.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0129000000000001e-05 2023-10-08T07:05:56.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.995 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:56.995 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318136+0000", 2023-10-08T07:05:56.995 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3610000000000001e-06 2023-10-08T07:05:56.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:56.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:05:56.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101062 2023-10-08T07:05:56.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:56.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318422+0000", 2023-10-08T07:05:56.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018560500000000001 2023-10-08T07:05:56.996 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:56.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329709+0000", 2023-10-08T07:05:56.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01128642 2023-10-08T07:05:56.997 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.997 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:56.997 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:56.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.997 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:56.997 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:05:56.997 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 23.568676795000002, 2023-10-08T07:05:56.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088267940000000007, 2023-10-08T07:05:56.997 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:56.998 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:05:56.998 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:56.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:56.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:05:56.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:56.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:05:56.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:56.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:56.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318151+0000", 2023-10-08T07:05:56.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:05:56.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:56.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:56.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318154+0000", 2023-10-08T07:05:56.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9529999999999999e-06 2023-10-08T07:05:56.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:56.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:57.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:57.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318161+0000", 2023-10-08T07:05:57.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.126e-06 2023-10-08T07:05:57.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:57.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:57.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318167+0000", 2023-10-08T07:05:57.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2169999999999999e-06 2023-10-08T07:05:57.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:57.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:57.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:57.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319711+0000", 2023-10-08T07:05:57.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015438769999999999 2023-10-08T07:05:57.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:57.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:57.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:57.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319864+0000", 2023-10-08T07:05:57.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015264799999999999 2023-10-08T07:05:57.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:57.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:57.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:57.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.326977+0000", 2023-10-08T07:05:57.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071133890000000003 2023-10-08T07:05:57.002 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:57.002 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:57.002 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:57.002 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:57.002 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:57.002 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:05:57.003 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:57.002+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:57.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:05:57.013 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2023-10-08T07:05:57.104 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:57.103+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:57.144 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:05:57.145 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:05:57.145 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:05:57.145 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:05:57.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:05:57.205 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:57.204+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:57.283 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:05:57.283 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:05:57.283 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:05:57.283 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:05:57.283 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:05:57.293 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:05:57.338 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:57.337+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:57.406 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:57.405+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:57.412 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:05:57.426 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:05:57.426 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:05:57.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:05:57.427 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:05:57.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:05:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.104811100999999, 2023-10-08T07:05:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:05:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:05:57.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:05:57.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:05:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:05:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:05:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:05:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:05:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:05:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:05:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:05:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:05:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:05:57.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:05:57.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:05:57.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:57.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:05:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:05:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:05:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:05:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:05:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:05:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:05:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:05:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:05:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:05:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:05:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.104737317000001, 2023-10-08T07:05:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:05:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:05:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:05:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:05:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:05:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:05:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:05:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:05:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:05:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:05:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:05:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:05:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:05:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:05:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:05:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:05:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:05:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:05:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:05:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:05:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:05:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:05:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:05:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:05:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:05:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:05:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.104674141, 2023-10-08T07:05:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:05:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:05:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:05:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:05:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:05:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:05:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:05:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:05:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:05:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:05:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:05:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:05:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:05:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:05:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:05:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:05:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:05:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:05:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:05:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:05:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:05:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:05:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:05:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:05:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:05:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:05:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.104639795000001, 2023-10-08T07:05:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:05:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:05:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:05:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:05:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:05:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:05:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:05:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:05:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:05:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:05:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:05:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:05:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:05:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:05:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:05:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:05:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:05:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:05:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:05:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:05:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:05:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:05:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:05:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:05:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:05:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:05:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:05:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.104149570000001, 2023-10-08T07:05:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:05:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:05:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:05:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:05:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:05:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:05:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:05:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:05:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:05:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:05:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:05:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:05:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:05:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:05:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:05:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:05:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:05:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:05:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:05:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:05:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:05:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:05:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:05:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:05:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:05:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:05:57.476 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.104108993000001, 2023-10-08T07:05:57.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:05:57.476 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.476 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:57.476 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:05:57.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:05:57.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:05:57.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:05:57.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:05:57.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:05:57.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:05:57.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:05:57.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:05:57.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:05:57.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:05:57.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:05:57.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:05:57.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:05:57.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:57.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:05:57.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:05:57.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:57.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:05:57.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:05:57.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:57.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:05:57.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:05:57.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:57.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:05:57.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:05:57.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:05:57.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:05:57.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.483 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.484 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:57.484 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:05:57.484 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.104071424000001, 2023-10-08T07:05:57.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:05:57.484 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.484 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:57.484 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:05:57.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:05:57.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:05:57.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:05:57.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:05:57.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:05:57.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:05:57.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:05:57.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:05:57.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:05:57.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:05:57.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:05:57.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:05:57.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:05:57.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:05:57.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:05:57.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.491 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.492 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:57.492 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:05:57.492 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.104003983999998, 2023-10-08T07:05:57.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:05:57.492 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.492 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:57.492 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:05:57.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:05:57.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:05:57.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:05:57.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:05:57.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:05:57.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:05:57.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:05:57.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:05:57.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:05:57.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:05:57.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:05:57.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:05:57.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:05:57.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:05:57.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:05:57.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.497 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.498 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:57.498 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:05:57.498 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.103974342000001, 2023-10-08T07:05:57.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:05:57.498 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.498 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:57.499 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:05:57.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:05:57.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:05:57.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:05:57.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:05:57.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:05:57.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:05:57.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:05:57.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:05:57.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:05:57.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:05:57.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:05:57.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:05:57.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:05:57.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:05:57.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:05:57.504 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.504 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.504 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.505 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:05:57.505 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:05:57.505 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.098233781000001, 2023-10-08T07:05:57.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:05:57.505 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.505 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:05:57.505 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:05:57.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:05:57.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:05:57.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:05:57.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:05:57.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:05:57.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:05:57.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:05:57.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:05:57.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:05:57.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:05:57.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:05:57.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:05:57.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:05:57.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.510 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.510 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:16 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:05:57.510 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323497+0000", 2023-10-08T07:05:57.511 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.097836309000002, 2023-10-08T07:05:57.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019838899999999999, 2023-10-08T07:05:57.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:57.511 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323497+0000", 2023-10-08T07:05:57.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323497+0000", 2023-10-08T07:05:57.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323497+0000", 2023-10-08T07:05:57.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4999999999999999e-07 2023-10-08T07:05:57.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323499+0000", 2023-10-08T07:05:57.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2220000000000001e-06 2023-10-08T07:05:57.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323503+0000", 2023-10-08T07:05:57.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.721e-06 2023-10-08T07:05:57.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323513+0000", 2023-10-08T07:05:57.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9189999999999994e-06 2023-10-08T07:05:57.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323557+0000", 2023-10-08T07:05:57.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4199999999999997e-05 2023-10-08T07:05:57.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323565+0000", 2023-10-08T07:05:57.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7980000000000006e-06 2023-10-08T07:05:57.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323695+0000", 2023-10-08T07:05:57.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013037899999999999 2023-10-08T07:05:57.516 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.516 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.516 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.517 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:05:57.517 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:05:57.517 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.097784441000002, 2023-10-08T07:05:57.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:05:57.517 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.517 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:57.517 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:05:57.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:05:57.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:05:57.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:05:57.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:05:57.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:05:57.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:05:57.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:05:57.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:05:57.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:05:57.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:05:57.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:05:57.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:05:57.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:05:57.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:05:57.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:05:57.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.522 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.523 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:05:57.523 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:05:57.523 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.096988550999999, 2023-10-08T07:05:57.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:05:57.523 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.523 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:57.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:05:57.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:05:57.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:05:57.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:05:57.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:05:57.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:05:57.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:05:57.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:05:57.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:05:57.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:05:57.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:05:57.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:05:57.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:05:57.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:05:57.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:57.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:05:57.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:05:57.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:05:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:05:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:05:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:05:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.096873200000001, 2023-10-08T07:05:57.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:05:57.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:57.530 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:05:57.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:05:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:05:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:05:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:05:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:05:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:05:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:05:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:05:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:05:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:05:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:05:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:05:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:05:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:05:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:05:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:05:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:05:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:05:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:05:57.536 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.091758634000001, 2023-10-08T07:05:57.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:05:57.536 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.536 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:57.536 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:05:57.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:05:57.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:05:57.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:05:57.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:05:57.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:05:57.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:05:57.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:05:57.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:05:57.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:05:57.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:05:57.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:05:57.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:05:57.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:05:57.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:57.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:05:57.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:05:57.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:05:57.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:05:57.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.541 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.541 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:05:57.542 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:05:57.542 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.091647642000002, 2023-10-08T07:05:57.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:05:57.542 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.542 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:57.542 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:05:57.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:05:57.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:05:57.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:05:57.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:05:57.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:05:57.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:05:57.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:05:57.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:05:57.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:05:57.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:05:57.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:05:57.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:05:57.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:05:57.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:57.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:05:57.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:05:57.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:05:57.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:05:57.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.547 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.547 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:05:57.547 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:05:57.547 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.091223200999998, 2023-10-08T07:05:57.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:05:57.547 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.547 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:57.547 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:05:57.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:05:57.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:05:57.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:05:57.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:05:57.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:05:57.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:05:57.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:05:57.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:05:57.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:05:57.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:05:57.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:05:57.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:05:57.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:05:57.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:05:57.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:05:57.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.552 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.553 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:05:57.553 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:05:57.553 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.091076064999999, 2023-10-08T07:05:57.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:05:57.553 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.553 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:05:57.553 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:05:57.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:05:57.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:05:57.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:05:57.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:05:57.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:05:57.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:05:57.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:05:57.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:05:57.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:05:57.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:05:57.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:05:57.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:05:57.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:05:57.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.558 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.559 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:05:57.559 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:05:57.559 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.019777796, 2023-10-08T07:05:57.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:05:57.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:57.559 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:05:57.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:05:57.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:05:57.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:05:57.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:05:57.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:05:57.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:05:57.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:05:57.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:05:57.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:05:57.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:05:57.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:05:57.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:05:57.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:05:57.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:57.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:05:57.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:05:57.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:05:57.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:05:57.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:05:57.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:57.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:05:57.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:05:57.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:05:57.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:05:57.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:05:57.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:05:57.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:05:57.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.569 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.569 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:05:57.569 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:05:57.570 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.017984212000002, 2023-10-08T07:05:57.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:05:57.570 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:05:57.570 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:05:57.570 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:05:57.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:05:57.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:05:57.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:05:57.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:05:57.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:05:57.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:05:57.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:05:57.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:05:57.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:05:57.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:05:57.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:05:57.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:05:57.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:05:57.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:05:57.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:05:57.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:05:57.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:05:57.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:05:57.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:05:57.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:05:57.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:05:57.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:05:57.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:05:57.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:05:57.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:05:57.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:05:57.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:05:57.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:05:57.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.574 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:05:57.575 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:05:57.575 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:05:57.576 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:05:57.577 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:05:57.578 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:57.578+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:57.596 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:05:57.617 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:05:57.618 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:05:57.618 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T07:05:57.618 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:05:57.677 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:57.677+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:57.723 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:57.723 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:57.733 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:05:57.778 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:57.777+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:57.865 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:57.866 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:57.876 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:05:57.879 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:57.878+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:57.980 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:57.979+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:58.007 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:58.007 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:58.017 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:05:58.081 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:58.081+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:58.157 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:58.158 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:58.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:05:58.183 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:58.182+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:58.284 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:58.283+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:58.295 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:58.295 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:58.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:05:58.384 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:58.384+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:58.472 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:58.473 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:58.482 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:05:58.486 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:58.485+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:58.586 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:58.586+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:58.622 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:58.622 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:58.633 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:05:58.687 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:58.686+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:58.759 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:58.760 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:58.770 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:05:58.787 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:58.787+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:58.888 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:58.888+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:58.896 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:58.896 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:58.907 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:05:58.989 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:58.989+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:59.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T07:05:59.054 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:59.054 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:59.064 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:05:59.091 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:59.090+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:59.152 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T07:05:59.153 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T07:05:59.153 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-10-08T07:05:59.153 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-10-08T07:05:59.153 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-10-08T07:05:59.153 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-10-08T07:05:59.192 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:59.191+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:59.197 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:59.197 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:59.210 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:05:59.290 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:05:59.290 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-10-08T07:05:59.290 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:05:59.292 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:59.293+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:59.345 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:59.345 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:59.355 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:05:59.393 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:59.393+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:05:59.495 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:59.495+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:59.496 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:59.496 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:59.507 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:05:59.596 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:59.595+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:59.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:05:59.672 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:05:59.673 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:05:59.683 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:05:59.696 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:05:59.695+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:05:59.782 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:05:59.797 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:05:59.797+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:05:59.803 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:05:59.812 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:05:59.812 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2023-10-08T07:05:59.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2023-10-08T07:05:59.812 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2023-10-08T07:05:59.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.812 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-10-08T07:05:59.812 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:05:59.812 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.495218944999998, 2023-10-08T07:05:59.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069404690000000003, 2023-10-08T07:05:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:05:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:05:59.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315211+0000", 2023-10-08T07:05:59.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:05:59.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315216+0000", 2023-10-08T07:05:59.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:05:59.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315229+0000", 2023-10-08T07:05:59.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.278e-05 2023-10-08T07:05:59.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315235+0000", 2023-10-08T07:05:59.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2023-10-08T07:05:59.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316390+0000", 2023-10-08T07:05:59.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011548179999999999 2023-10-08T07:05:59.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316410+0000", 2023-10-08T07:05:59.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0818999999999998e-05 2023-10-08T07:05:59.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322113+0000", 2023-10-08T07:05:59.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057026159999999998 2023-10-08T07:05:59.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322150+0000", 2023-10-08T07:05:59.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7401999999999999e-05 2023-10-08T07:05:59.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.817 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.817 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.817 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-10-08T07:05:59.817 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:05:59.817 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.037859175000001, 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087059660000000007, 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:05:59.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772604+0000", 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.413e-05 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772617+0000", 2023-10-08T07:05:59.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2595999999999999e-05 2023-10-08T07:05:59.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772624+0000", 2023-10-08T07:05:59.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2023-10-08T07:05:59.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772666+0000", 2023-10-08T07:05:59.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1925000000000003e-05 2023-10-08T07:05:59.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772685+0000", 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9071000000000001e-05 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781237+0000", 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085519059999999997 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781276+0000", 2023-10-08T07:05:59.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9161e-05 2023-10-08T07:05:59.824 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.824 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.824 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.824 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-10-08T07:05:59.824 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:05:59.824 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.037362520999999, 2023-10-08T07:05:59.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010997768, 2023-10-08T07:05:59.824 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.824 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.824 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:05:59.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.825 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:05:59.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.825 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773067+0000", 2023-10-08T07:05:59.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:05:59.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773071+0000", 2023-10-08T07:05:59.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3819999999999997e-06 2023-10-08T07:05:59.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773082+0000", 2023-10-08T07:05:59.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0407e-05 2023-10-08T07:05:59.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773087+0000", 2023-10-08T07:05:59.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:05:59.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775481+0000", 2023-10-08T07:05:59.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023941470000000001 2023-10-08T07:05:59.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775493+0000", 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2126999999999999e-05 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784021+0000", 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085280589999999993 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784064+0000", 2023-10-08T07:05:59.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.295e-05 2023-10-08T07:05:59.829 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.829 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.829 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.829 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:157 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'111, mlcod=11'105)", 2023-10-08T07:05:59.829 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:05:59.829 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.036942422999999, 2023-10-08T07:05:59.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010614554, 2023-10-08T07:05:59.829 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.829 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.829 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:05:59.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:05:59.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773487+0000", 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773492+0000", 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2249999999999999e-06 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773503+0000", 2023-10-08T07:05:59.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0271e-05 2023-10-08T07:05:59.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773509+0000", 2023-10-08T07:05:59.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5470000000000002e-06 2023-10-08T07:05:59.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775801+0000", 2023-10-08T07:05:59.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022918790000000001 2023-10-08T07:05:59.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775822+0000", 2023-10-08T07:05:59.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1486000000000001e-05 2023-10-08T07:05:59.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784066+0000", 2023-10-08T07:05:59.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082432089999999996 2023-10-08T07:05:59.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784101+0000", 2023-10-08T07:05:59.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5383999999999999e-05 2023-10-08T07:05:59.834 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.834 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.834 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.834 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:158 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'112, mlcod=11'106)", 2023-10-08T07:05:59.834 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:05:59.834 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.036465325999998, 2023-10-08T07:05:59.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010172001999999999, 2023-10-08T07:05:59.834 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.834 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:05:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:05:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:05:59.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.82e-07 2023-10-08T07:05:59.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773990+0000", 2023-10-08T07:05:59.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2023-10-08T07:05:59.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774001+0000", 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0873000000000001e-05 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774006+0000", 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0900000000000004e-06 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776145+0000", 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021389759999999999 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776165+0000", 2023-10-08T07:05:59.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9548e-05 2023-10-08T07:05:59.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784102+0000", 2023-10-08T07:05:59.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007937342 2023-10-08T07:05:59.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784136+0000", 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3331000000000003e-05 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:159 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'113, mlcod=11'106)", 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.035932367999997, 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096667119999999992, 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.839 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.840 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:05:59.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:05:59.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:05:59.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:05:59.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774501+0000", 2023-10-08T07:05:59.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1529999999999999e-06 2023-10-08T07:05:59.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774511+0000", 2023-10-08T07:05:59.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:05:59.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774533+0000", 2023-10-08T07:05:59.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2348999999999999e-05 2023-10-08T07:05:59.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.842 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.842 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.842 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776608+0000", 2023-10-08T07:05:59.842 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002074799 2023-10-08T07:05:59.842 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776627+0000", 2023-10-08T07:05:59.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8632999999999999e-05 2023-10-08T07:05:59.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.843 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784138+0000", 2023-10-08T07:05:59.843 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075110819999999997 2023-10-08T07:05:59.843 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.843 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.843 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784163+0000", 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5425000000000001e-05 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:160 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'114, mlcod=11'106)", 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.035297186000001, 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090478150000000007, 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.844 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.845 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:05:59.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.845 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.845 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:05:59.845 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.845 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.845 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775133+0000", 2023-10-08T07:05:59.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2023-10-08T07:05:59.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775150+0000", 2023-10-08T07:05:59.846 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6206e-05 2023-10-08T07:05:59.846 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.846 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.846 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.846 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775173+0000", 2023-10-08T07:05:59.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.351e-05 2023-10-08T07:05:59.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775187+0000", 2023-10-08T07:05:59.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4396000000000001e-05 2023-10-08T07:05:59.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.847 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.847 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.847 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776909+0000", 2023-10-08T07:05:59.847 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017220429999999999 2023-10-08T07:05:59.847 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776929+0000", 2023-10-08T07:05:59.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9313e-05 2023-10-08T07:05:59.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.848 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784164+0000", 2023-10-08T07:05:59.848 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072352340000000001 2023-10-08T07:05:59.848 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.848 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.848 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526e-05 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:161 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'115, mlcod=11'106)", 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.034618297000002, 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083874480000000005, 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.849 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.850 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:05:59.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.850 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.850 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.850 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:05:59.850 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.850 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:05:59.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:05:59.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.851 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775837+0000", 2023-10-08T07:05:59.851 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6081e-05 2023-10-08T07:05:59.851 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.851 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.851 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775849+0000", 2023-10-08T07:05:59.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:05:59.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775854+0000", 2023-10-08T07:05:59.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1490000000000002e-06 2023-10-08T07:05:59.852 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.852 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.852 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.852 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777220+0000", 2023-10-08T07:05:59.852 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001365174 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777232+0000", 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2293000000000001e-05 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069481450000000002 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.853 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.854 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784198+0000", 2023-10-08T07:05:59.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2023-10-08T07:05:59.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.854 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.854 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.854 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.854 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.854 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:162 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'116, mlcod=11'106)", 2023-10-08T07:05:59.854 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:05:59.854 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.033993895000002, 2023-10-08T07:05:59.854 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077785969999999999, 2023-10-08T07:05:59.854 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.855 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776436+0000", 2023-10-08T07:05:59.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:05:59.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776440+0000", 2023-10-08T07:05:59.856 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2629999999999997e-06 2023-10-08T07:05:59.856 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.856 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.856 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.856 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776451+0000", 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1385e-05 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776456+0000", 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9919999999999998e-06 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777629+0000", 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001173297 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.857 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777650+0000", 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0126e-05 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784199+0000", 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006548908 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:05:59.858 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5071e-05 2023-10-08T07:05:59.859 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.859 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.859 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.859 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.859 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.859 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:163 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'117, mlcod=11'106)", 2023-10-08T07:05:59.859 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:05:59.859 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.033351488000001, 2023-10-08T07:05:59.859 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071515490000000001, 2023-10-08T07:05:59.859 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.859 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.859 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:05:59.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.860 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:05:59.860 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.860 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.860 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.860 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777078+0000", 2023-10-08T07:05:59.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4400000000000001e-07 2023-10-08T07:05:59.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777082+0000", 2023-10-08T07:05:59.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.732e-06 2023-10-08T07:05:59.861 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.861 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.861 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.861 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777095+0000", 2023-10-08T07:05:59.861 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3749e-05 2023-10-08T07:05:59.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777100+0000", 2023-10-08T07:05:59.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.634e-06 2023-10-08T07:05:59.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.862 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.862 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.862 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777944+0000", 2023-10-08T07:05:59.862 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00084377599999999997 2023-10-08T07:05:59.862 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777957+0000", 2023-10-08T07:05:59.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.276e-05 2023-10-08T07:05:59.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.863 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.863 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:05:59.863 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006257617 2023-10-08T07:05:59.863 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.863 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.864 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.864 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784229+0000", 2023-10-08T07:05:59.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4837e-05 2023-10-08T07:05:59.864 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.864 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.864 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.864 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.864 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.864 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:164 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'118, mlcod=11'106)", 2023-10-08T07:05:59.864 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:05:59.864 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 37.032770149000001, 2023-10-08T07:05:59.864 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093104280000000008, 2023-10-08T07:05:59.865 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.865 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.865 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:05:59.865 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.865 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.865 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.865 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.865 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:05:59.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:05:59.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2e-07 2023-10-08T07:05:59.866 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.866 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.866 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.866 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777713+0000", 2023-10-08T07:05:59.866 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4079999999999997e-05 2023-10-08T07:05:59.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777724+0000", 2023-10-08T07:05:59.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0652999999999999e-05 2023-10-08T07:05:59.867 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.867 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.867 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.867 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777729+0000", 2023-10-08T07:05:59.867 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2050000000000001e-06 2023-10-08T07:05:59.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778177+0000", 2023-10-08T07:05:59.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044763499999999999 2023-10-08T07:05:59.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.868 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.868 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778195+0000", 2023-10-08T07:05:59.868 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8125e-05 2023-10-08T07:05:59.868 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.868 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786935+0000", 2023-10-08T07:05:59.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087396049999999992 2023-10-08T07:05:59.869 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.869 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.869 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.869 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786969+0000", 2023-10-08T07:05:59.869 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4604999999999998e-05 2023-10-08T07:05:59.869 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.869 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.869 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.870 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.870 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:59.870 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:05:59.870 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.494881718999999, 2023-10-08T07:05:59.870 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013957681, 2023-10-08T07:05:59.870 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.870 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.870 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.870 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:05:59.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:05:59.871 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.871 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.871 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.871 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.871 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315552+0000", 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.152e-06 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315568+0000", 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5301000000000001e-05 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315583+0000", 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5826000000000001e-05 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.872 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315598+0000", 2023-10-08T07:05:59.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4953999999999999e-05 2023-10-08T07:05:59.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317200+0000", 2023-10-08T07:05:59.873 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016014950000000001 2023-10-08T07:05:59.873 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.873 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.873 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.873 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317351+0000", 2023-10-08T07:05:59.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015081400000000001 2023-10-08T07:05:59.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:59.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317540+0000", 2023-10-08T07:05:59.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000189557 2023-10-08T07:05:59.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.874 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.874 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:59.874 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322281+0000", 2023-10-08T07:05:59.874 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047409599999999998 2023-10-08T07:05:59.874 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:59.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329404+0000", 2023-10-08T07:05:59.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071225460000000004 2023-10-08T07:05:59.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.875 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329459+0000", 2023-10-08T07:05:59.875 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5016999999999999e-05 2023-10-08T07:05:59.875 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.875 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.875 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.876 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329505+0000", 2023-10-08T07:05:59.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059000000000001e-05 2023-10-08T07:05:59.876 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.876 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.876 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.876 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.876 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.876 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:59.876 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:05:59.876 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.494798750000001, 2023-10-08T07:05:59.876 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015617259, 2023-10-08T07:05:59.876 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.877 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.877 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:05:59.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.877 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.877 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.877 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:05:59.877 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.877 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315631+0000", 2023-10-08T07:05:59.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2023-10-08T07:05:59.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.878 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315636+0000", 2023-10-08T07:05:59.878 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1019999999999996e-06 2023-10-08T07:05:59.878 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.878 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.878 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315646+0000", 2023-10-08T07:05:59.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0056e-05 2023-10-08T07:05:59.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315654+0000", 2023-10-08T07:05:59.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7810000000000005e-06 2023-10-08T07:05:59.879 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.879 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.879 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.879 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318626+0000", 2023-10-08T07:05:59.879 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00297183 2023-10-08T07:05:59.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319450+0000", 2023-10-08T07:05:59.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082440400000000004 2023-10-08T07:05:59.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.880 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:59.880 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319924+0000", 2023-10-08T07:05:59.880 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047403099999999997 2023-10-08T07:05:59.880 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.880 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:59.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322475+0000", 2023-10-08T07:05:59.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002550442 2023-10-08T07:05:59.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:59.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331142+0000", 2023-10-08T07:05:59.881 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086669030000000001 2023-10-08T07:05:59.881 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.881 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.881 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.881 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331217+0000", 2023-10-08T07:05:59.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5606999999999996e-05 2023-10-08T07:05:59.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.882 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.882 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331247+0000", 2023-10-08T07:05:59.882 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:05:59.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.882 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.882 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.882 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.882 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.882 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:15 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:59.883 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:05:59.883 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.493635310999998, 2023-10-08T07:05:59.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012716055, 2023-10-08T07:05:59.883 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.883 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.883 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.883 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.883 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:05:59.883 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.883 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.883 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:05:59.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:05:59.884 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8599999999999997e-07 2023-10-08T07:05:59.884 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.884 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.884 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.884 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316805+0000", 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0475000000000001e-05 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316817+0000", 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.226e-05 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316828+0000", 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1090999999999999e-05 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.885 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317025+0000", 2023-10-08T07:05:59.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019711500000000001 2023-10-08T07:05:59.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317244+0000", 2023-10-08T07:05:59.886 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021908999999999999 2023-10-08T07:05:59.886 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.886 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.886 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:59.886 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317436+0000", 2023-10-08T07:05:59.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019164900000000001 2023-10-08T07:05:59.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:59.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321493+0000", 2023-10-08T07:05:59.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040573190000000002 2023-10-08T07:05:59.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.887 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.887 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:59.887 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329275+0000", 2023-10-08T07:05:59.887 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077820950000000002 2023-10-08T07:05:59.887 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329457+0000", 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018165600000000001 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329510+0000", 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2519000000000003e-05 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.888 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.889 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:27 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:59.889 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:05:59.889 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.493574519999999, 2023-10-08T07:05:59.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015441417000000001, 2023-10-08T07:05:59.889 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.889 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.889 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.889 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.889 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.889 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:05:59.889 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:05:59.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.890 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.890 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316855+0000", 2023-10-08T07:05:59.890 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:05:59.890 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.890 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316861+0000", 2023-10-08T07:05:59.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6210000000000001e-06 2023-10-08T07:05:59.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316869+0000", 2023-10-08T07:05:59.891 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.225e-06 2023-10-08T07:05:59.891 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.891 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.891 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.891 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316878+0000", 2023-10-08T07:05:59.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8799999999999997e-06 2023-10-08T07:05:59.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319969+0000", 2023-10-08T07:05:59.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030906689999999999 2023-10-08T07:05:59.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.892 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.892 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.892 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320072+0000", 2023-10-08T07:05:59.892 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103458 2023-10-08T07:05:59.892 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320631+0000", 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055936099999999997 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322686+0000", 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020545899999999998 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:59.893 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332244+0000", 2023-10-08T07:05:59.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095578690000000001 2023-10-08T07:05:59.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332274+0000", 2023-10-08T07:05:59.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0527000000000001e-05 2023-10-08T07:05:59.894 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.894 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.894 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.894 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332296+0000", 2023-10-08T07:05:59.894 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1359999999999999e-05 2023-10-08T07:05:59.894 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.895 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.895 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.895 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.895 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:59.895 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:05:59.895 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.493537930999999, 2023-10-08T07:05:59.895 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014502582, 2023-10-08T07:05:59.895 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.895 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.895 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.895 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:05:59.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:05:59.896 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.896 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.896 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.896 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.896 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316892+0000", 2023-10-08T07:05:59.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:05:59.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316896+0000", 2023-10-08T07:05:59.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9140000000000001e-06 2023-10-08T07:05:59.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.897 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.897 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.897 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316904+0000", 2023-10-08T07:05:59.897 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1170000000000004e-06 2023-10-08T07:05:59.897 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316911+0000", 2023-10-08T07:05:59.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:05:59.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.898 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320938+0000", 2023-10-08T07:05:59.898 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040269959999999997 2023-10-08T07:05:59.898 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.898 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.898 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321023+0000", 2023-10-08T07:05:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5420000000000005e-05 2023-10-08T07:05:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321157+0000", 2023-10-08T07:05:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013383700000000001 2023-10-08T07:05:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322742+0000", 2023-10-08T07:05:59.899 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015851249999999999 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331290+0000", 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085483190000000004 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331348+0000", 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7630999999999998e-05 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.900 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.901 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331394+0000", 2023-10-08T07:05:59.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5534999999999997e-05 2023-10-08T07:05:59.901 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.901 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.901 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.901 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.901 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.901 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:59.901 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:05:59.901 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.493509443000001, 2023-10-08T07:05:59.901 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015363402, 2023-10-08T07:05:59.902 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.902 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.902 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:05:59.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.902 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.902 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.902 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.902 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:05:59.902 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316920+0000", 2023-10-08T07:05:59.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2023-10-08T07:05:59.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.903 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.903 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316923+0000", 2023-10-08T07:05:59.903 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2169999999999999e-06 2023-10-08T07:05:59.903 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.903 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316930+0000", 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316938+0000", 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322217+0000", 2023-10-08T07:05:59.904 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052793680000000004 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322295+0000", 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7621999999999996e-05 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322411+0000", 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000116297 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.905 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:59.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323187+0000", 2023-10-08T07:05:59.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077583700000000003 2023-10-08T07:05:59.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:59.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332224+0000", 2023-10-08T07:05:59.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090370980000000004 2023-10-08T07:05:59.906 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.906 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.906 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.906 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332261+0000", 2023-10-08T07:05:59.906 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6464999999999997e-05 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332283+0000", 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2124e-05 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:05:59.907 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.492386259, 2023-10-08T07:05:59.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014463023, 2023-10-08T07:05:59.908 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.908 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:05:59.908 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:05:59.908 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.908 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.908 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.908 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.908 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318044+0000", 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1000000000000001e-06 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318057+0000", 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2860000000000001e-05 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.909 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318067+0000", 2023-10-08T07:05:59.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0638999999999999e-05 2023-10-08T07:05:59.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318090+0000", 2023-10-08T07:05:59.910 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2889000000000001e-05 2023-10-08T07:05:59.910 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.910 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.910 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.910 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320985+0000", 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028951279999999999 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321126+0000", 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014045600000000001 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321798+0000", 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067266600000000004 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.911 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:05:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323135+0000", 2023-10-08T07:05:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013368589999999999 2023-10-08T07:05:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:05:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332445+0000", 2023-10-08T07:05:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093094419999999994 2023-10-08T07:05:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:05:59.912 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332482+0000", 2023-10-08T07:05:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:05:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332506+0000", 2023-10-08T07:05:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3649e-05 2023-10-08T07:05:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.913 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:59.914 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:05:59.914 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.492317750000002, 2023-10-08T07:05:59.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011597616999999999, 2023-10-08T07:05:59.914 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.914 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:05:59.914 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.914 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.914 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.914 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:05:59.914 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.914 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:05:59.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.915 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318112+0000", 2023-10-08T07:05:59.915 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2299999999999999e-07 2023-10-08T07:05:59.915 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.915 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.915 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318117+0000", 2023-10-08T07:05:59.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1170000000000003e-06 2023-10-08T07:05:59.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318127+0000", 2023-10-08T07:05:59.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0129000000000001e-05 2023-10-08T07:05:59.916 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.916 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.916 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.916 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318136+0000", 2023-10-08T07:05:59.916 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3610000000000001e-06 2023-10-08T07:05:59.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:05:59.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101062 2023-10-08T07:05:59.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.917 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.917 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318422+0000", 2023-10-08T07:05:59.917 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018560500000000001 2023-10-08T07:05:59.917 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.917 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.918 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.918 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329709+0000", 2023-10-08T07:05:59.918 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01128642 2023-10-08T07:05:59.918 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.918 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.918 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.918 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.918 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.918 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:05:59.918 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:05:59.918 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 26.492278630000001, 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088267940000000007, 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:05:59.919 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:05:59.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:05:59.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318151+0000", 2023-10-08T07:05:59.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:05:59.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.920 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:05:59.920 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318154+0000", 2023-10-08T07:05:59.920 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9529999999999999e-06 2023-10-08T07:05:59.920 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.920 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:05:59.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318161+0000", 2023-10-08T07:05:59.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.126e-06 2023-10-08T07:05:59.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:05:59.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318167+0000", 2023-10-08T07:05:59.921 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2169999999999999e-06 2023-10-08T07:05:59.921 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.921 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.921 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:05:59.921 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319711+0000", 2023-10-08T07:05:59.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015438769999999999 2023-10-08T07:05:59.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:05:59.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319864+0000", 2023-10-08T07:05:59.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015264799999999999 2023-10-08T07:05:59.922 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:05:59.922 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:05:59.922 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:05:59.922 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.326977+0000", 2023-10-08T07:05:59.922 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071133890000000003 2023-10-08T07:05:59.922 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.923 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.923 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.923 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:05:59.923 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:05:59.923 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:05:59.924 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:05:59.925 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:05:59.926 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:05:59.926 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T07:05:59.926 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:05:59.926 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:05:59.923+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:00.017 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2023-10-08T07:06:00.026 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:00.026+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:00.066 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:00.066 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:00.066 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:00.076 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:00.127 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:00.127+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:00.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:00.258 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:00.257+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:00.329 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:00.328+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:00.344 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:00.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:00.344 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:00.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.344 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.344 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:00.344 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.025401292000002, 2023-10-08T07:06:00.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:00.344 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.344 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.344 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:00.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:00.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:00.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:00.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:00.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:00.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:00.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:00.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:00.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:00.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:00.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:00.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:00.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:00.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:00.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:00.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:00.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:00.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:00.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:00.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:00.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:00.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:00.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:00.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:00.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:00.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:00.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.353 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.353 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.025327508, 2023-10-08T07:06:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.354 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:00.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:00.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.361 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.025264331999999, 2023-10-08T07:06:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:00.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.025229985999999, 2023-10-08T07:06:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.368 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:00.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:00.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:00.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:00.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:00.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:00.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:00.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:00.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:00.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:00.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:00.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:00.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:00.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:00.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:00.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:00.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:00.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:00.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:00.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:00.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.375 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.375 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.375 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:00.376 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.024739760999999, 2023-10-08T07:06:00.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:00.376 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.376 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.376 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:00.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:00.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:00.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:00.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:00.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:00.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:00.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:00.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:00.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:00.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:00.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:00.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:00.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:00.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:00.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:00.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:00.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:00.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:00.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:00.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:00.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:00.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:00.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:00.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:00.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:00.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:00.386 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.386 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.386 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.387 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.387 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:00.387 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.024699183999999, 2023-10-08T07:06:00.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:00.388 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.388 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:00.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:00.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:00.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:00.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:00.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:00.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:00.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:00.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:00.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:00.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:00.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:00.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:00.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:00.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:00.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:00.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:00.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:00.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:00.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:00.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:00.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:00.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:00.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:00.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:00.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:00.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:00.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.396 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.396 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.396 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.396 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:00.396 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.024661614999999, 2023-10-08T07:06:00.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:00.396 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.397 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:00.397 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:00.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:00.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:00.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:00.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:00.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:00.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:00.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:00.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:00.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:00.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:00.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:00.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:00.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:00.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:00.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:00.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.401 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.402 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.402 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:00.402 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.024594175000001, 2023-10-08T07:06:00.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:00.402 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.402 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:00.402 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:00.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:00.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:00.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:00.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:00.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:00.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:00.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.406 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.407 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.407 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:00.407 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.024564532999999, 2023-10-08T07:06:00.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:00.407 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.407 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:00.407 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:00.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:00.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:00.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:00.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:00.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:00.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:00.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:00.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:00.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:00.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.412 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.412 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:00.412 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:00.412 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.018823972, 2023-10-08T07:06:00.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:00.413 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.413 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:00.413 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:00.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:00.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:00.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:00.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:00.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:00.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:00.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:00.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:00.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:00.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:00.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:00.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:00.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:00.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.419 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.420 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:00.420 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:00.420 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.018374632, 2023-10-08T07:06:00.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:00.421 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.421 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:00.421 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:00.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:00.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:00.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:00.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:00.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:00.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:00.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:00.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:00.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:00.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:00.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:00.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:00.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:00.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:00.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:00.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.425 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.426 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:00.426 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:00.426 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.017578742000001, 2023-10-08T07:06:00.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:00.426 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.426 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.426 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:00.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:00.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:00.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:00.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:00.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:00.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:00.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:00.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:00.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:00.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:00.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:00.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:00.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:00.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:00.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:00.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:00.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.431 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.017463391, 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:00.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:00.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:00.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:00.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:00.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:00.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:00.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.012348825, 2023-10-08T07:06:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:00.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:00.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.012237833, 2023-10-08T07:06:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.443 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:00.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.011813392000001, 2023-10-08T07:06:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:00.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.454 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.011666256000002, 2023-10-08T07:06:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:00.455 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:00.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:00.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:00.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:00.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:00.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.940367986999998, 2023-10-08T07:06:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:00.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:00.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.465 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.938574403000001, 2023-10-08T07:06:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:00.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 2.9399847330000002, 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:00.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:00.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:00.477 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:00.478 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:00.477+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:00.479 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:00.579 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:00.579+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:00.625 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:00.625 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:00.625 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:00.625 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:00.635 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:00.680 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:00.680+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:00.768 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:00.768 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:00.768 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:00.768 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:00.768 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:00.778 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:00.781 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:00.781+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:00.881 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:00.881+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:00.912 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:00.912 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:00.912 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:00.912 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:00.913 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.913 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:00.913 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:00.913 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 38.138490689999998, 2023-10-08T07:06:00.913 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:06:00.913 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.913 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.913 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:00.913 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:00.913 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:00.914 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:06:00.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.914 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.914 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.914 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.914 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:00.914 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.914 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.914 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.915 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:00.915 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.915 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.915 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:00.915 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:00.915 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:06:00.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.915 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.915 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:00.915 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:06:00.915 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:06:00.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.916 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:00.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:06:00.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:06:00.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.916 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:06:00.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:06:00.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:06:00.917 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:06:00.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:00.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:06:00.917 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:06:00.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.918 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:06:00.918 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:06:00.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.918 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.918 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:00.918 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:06:00.918 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:06:00.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.918 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.918 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.918 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:06:00.919 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:06:00.919 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.919 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.919 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:00.919 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:06:00.919 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:06:00.919 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.919 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.919 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:00.919 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:06:00.919 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:06:00.919 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.920 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:00.920 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.920 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.920 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:00.920 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:00.920 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 38.138469143999998, 2023-10-08T07:06:00.920 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:06:00.920 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.921 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.921 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:00.921 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:00.921 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:00.921 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:06:00.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.921 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.921 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.921 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:00.921 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.922 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.922 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:00.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.922 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.922 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:00.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:00.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:06:00.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:06:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:06:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:06:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:06:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:06:00.924 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:06:00.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:06:00.924 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:06:00.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:00.925 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:06:00.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:06:00.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.925 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.925 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.925 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:06:00.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:06:00.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.925 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.925 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:00.925 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:06:00.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:06:00.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.926 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.926 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.926 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:06:00.926 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:06:00.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.926 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.926 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:00.926 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:06:00.926 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:06:00.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.927 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:00.927 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:06:00.927 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:06:00.927 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.927 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:00.927 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.927 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:00.927 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:00.928 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 38.138402550000002, 2023-10-08T07:06:00.928 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:06:00.928 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.928 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.928 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:00.928 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:00.928 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:00.928 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:06:00.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.928 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.928 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.929 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:00.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.929 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.929 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:00.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.929 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:00.929 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:06:00.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:06:00.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.930 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.930 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:00.930 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:06:00.930 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:06:00.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.930 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.930 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:00.930 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:06:00.930 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:06:00.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:00.931 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:06:00.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:06:00.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.932 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.932 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:06:00.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:06:00.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.932 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:00.932 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:06:00.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:06:00.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:06:00.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:06:00.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:00.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:06:00.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:06:00.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.934 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:00.934 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:06:00.934 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:06:00.934 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.934 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:00.934 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.934 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.934 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:00.934 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:00.934 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 38.138383654000002, 2023-10-08T07:06:00.935 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:06:00.935 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.935 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.935 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:00.935 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:00.935 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:00.935 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:06:00.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.935 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.935 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.935 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.935 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:00.936 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.936 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.936 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.936 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:00.936 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.936 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.936 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:00.936 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:00.936 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:06:00.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.937 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.937 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:00.937 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:06:00.937 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:06:00.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.937 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.937 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:00.937 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:06:00.937 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:06:00.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.938 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.938 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.938 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:06:00.938 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:06:00.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.938 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.938 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.938 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:06:00.938 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:06:00.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.938 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.939 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:00.939 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:06:00.939 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:06:00.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.939 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.939 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.939 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:06:00.939 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:06:00.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.939 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.939 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:00.939 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.941 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:00.941 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:06:00.941 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:06:00.941 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.941 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:00.941 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.941 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.941 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:00.941 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:00.941 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 38.138370645000002, 2023-10-08T07:06:00.941 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:00.942 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.942 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.942 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:00.942 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:00.942 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:00.942 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:00.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.942 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.942 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.942 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.942 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:00.942 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.943 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.943 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.943 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:00.943 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.943 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.943 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:00.943 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:00.943 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:00.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.943 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.944 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:00.944 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:00.944 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:00.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.944 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.944 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:00.944 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:00.944 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:00.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.944 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.944 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.944 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.945 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:00.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:00.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.946 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:00.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:00.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:00.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.946 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:00.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:00.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.947 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:00.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:00.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:00.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.947 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:00.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:00.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:00.948 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.948 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:00.948 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.948 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.948 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:00.948 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:00.948 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 38.138318593000001, 2023-10-08T07:06:00.948 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:00.948 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.948 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.948 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:00.949 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:00.949 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:00.949 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:00.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.949 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.949 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:00.949 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.949 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.950 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:00.950 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.950 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.950 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:00.950 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:00.950 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:00.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.950 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.950 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:00.950 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.951 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:00.952 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:00.954 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:00.954 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:00.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.954 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:00.954 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:00.954 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:00.954 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.954 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:00.954 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.955 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.955 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:00.955 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.593114765999999, 2023-10-08T07:06:00.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:06:00.955 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.955 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.955 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.955 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.955 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.955 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:00.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.956 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.956 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:00.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.956 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:00.956 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:06:00.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:06:00.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:00.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:06:00.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:06:00.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:00.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:06:00.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:06:00.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.958 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:00.958 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:06:00.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.958 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:06:00.958 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:06:00.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:00.958 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:06:00.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:06:00.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.959 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.959 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.959 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:06:00.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:06:00.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.959 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.959 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:00.959 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:06:00.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:06:00.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.960 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.960 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:06:00.960 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:06:00.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.960 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.960 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:06:00.960 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:06:00.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:00.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:06:00.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:06:00.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:00.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:06:00.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:06:00.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:00.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:06:00.962 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:00.962 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.962 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:00.962 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.962 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.962 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:00.962 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.592998288, 2023-10-08T07:06:00.962 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:00.963 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.963 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.963 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:00.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:00.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.964 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:00.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:00.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:00.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.964 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:00.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:00.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:00.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:00.965 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:00.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:00.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.965 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:00.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:00.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.966 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.966 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.966 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:00.966 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:00.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.966 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.966 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:00.966 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:00.967 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:00.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.967 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.967 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.967 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:00.967 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:00.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.967 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.967 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:00.967 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:00.968 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:00.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.968 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.968 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:00.968 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:00.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.968 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.968 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:00.968 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:00.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.969 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.969 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:00.969 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:00.969 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:00.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.969 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.969 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:00.969 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:00.969 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:00.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.970 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.970 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:00.970 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:00.970 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:00.970 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.970 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:00.970 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.970 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.971 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.971 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:00.971 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.592947961, 2023-10-08T07:06:00.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:00.971 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.971 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.971 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:00.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.972 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:00.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.972 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:00.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:00.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:00.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:00.973 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:00.973 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:00.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:00.973 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:00.973 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:00.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.974 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.974 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:00.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:00.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.974 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.974 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.974 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:00.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:00.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.974 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.974 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:00.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:00.977 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.978 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:00.978 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.978 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.978 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:00.978 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.592622116000001, 2023-10-08T07:06:00.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:00.978 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.978 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.978 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:00.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:00.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:00.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:00.981 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:00.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.981 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.981 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.981 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:00.981 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:00.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.981 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.981 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.981 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:00.981 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:00.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:00.982 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:00.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:00.985 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.985 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:00.985 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.985 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.985 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:00.985 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.592569591, 2023-10-08T07:06:00.985 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:00.985 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.985 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.986 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:00.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:00.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:00.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:00.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:00.988 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:00.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:00.988 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:00.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:00.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:00.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.990 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.990 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:00.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:00.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.990 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:00.990 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:00.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:00.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.592401616, 2023-10-08T07:06:00.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:00.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:00.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:00.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:00.994 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:00.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:00.994 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:00.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:00.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:00.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:00.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:00.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:00.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:00.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:00.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.592257318000001, 2023-10-08T07:06:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.591577806, 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.591524536000001, 2023-10-08T07:06:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.591488689999998, 2023-10-08T07:06:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.591348158999999, 2023-10-08T07:06:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.591055835999999, 2023-10-08T07:06:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.590942194, 2023-10-08T07:06:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 27.589911969999999, 2023-10-08T07:06:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:01.053 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:01.055 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:01.055 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:01.055+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:01.156 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:01.155+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:01.194 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:01.194 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:01.194 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2023-10-08T07:06:01.194 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:01.204 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:01.257 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:01.256+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:01.330 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:01.330 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:01.330 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2023-10-08T07:06:01.330 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2023-10-08T07:06:01.330 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:01.340 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:01.381 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:01.381+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:01.459 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:01.458+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:01.509 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2023-10-08T07:06:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2023-10-08T07:06:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2023-10-08T07:06:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.509 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-10-08T07:06:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 39.192173945999997, 2023-10-08T07:06:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069404690000000003, 2023-10-08T07:06:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315211+0000", 2023-10-08T07:06:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:06:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315216+0000", 2023-10-08T07:06:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:06:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315229+0000", 2023-10-08T07:06:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.278e-05 2023-10-08T07:06:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315235+0000", 2023-10-08T07:06:01.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2023-10-08T07:06:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316390+0000", 2023-10-08T07:06:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011548179999999999 2023-10-08T07:06:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316410+0000", 2023-10-08T07:06:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0818999999999998e-05 2023-10-08T07:06:01.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322113+0000", 2023-10-08T07:06:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057026159999999998 2023-10-08T07:06:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322150+0000", 2023-10-08T07:06:01.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7401999999999999e-05 2023-10-08T07:06:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-10-08T07:06:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.734814176, 2023-10-08T07:06:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087059660000000007, 2023-10-08T07:06:01.516 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:06:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.518 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772604+0000", 2023-10-08T07:06:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.413e-05 2023-10-08T07:06:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772617+0000", 2023-10-08T07:06:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2595999999999999e-05 2023-10-08T07:06:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.519 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772624+0000", 2023-10-08T07:06:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2023-10-08T07:06:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772666+0000", 2023-10-08T07:06:01.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1925000000000003e-05 2023-10-08T07:06:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772685+0000", 2023-10-08T07:06:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9071000000000001e-05 2023-10-08T07:06:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781237+0000", 2023-10-08T07:06:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085519059999999997 2023-10-08T07:06:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781276+0000", 2023-10-08T07:06:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9161e-05 2023-10-08T07:06:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-10-08T07:06:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.734317521999998, 2023-10-08T07:06:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010997768, 2023-10-08T07:06:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:01.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773067+0000", 2023-10-08T07:06:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:06:01.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773071+0000", 2023-10-08T07:06:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3819999999999997e-06 2023-10-08T07:06:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773082+0000", 2023-10-08T07:06:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0407e-05 2023-10-08T07:06:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773087+0000", 2023-10-08T07:06:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:06:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775481+0000", 2023-10-08T07:06:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023941470000000001 2023-10-08T07:06:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775493+0000", 2023-10-08T07:06:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2126999999999999e-05 2023-10-08T07:06:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784021+0000", 2023-10-08T07:06:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085280589999999993 2023-10-08T07:06:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784064+0000", 2023-10-08T07:06:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.295e-05 2023-10-08T07:06:01.529 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:157 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'111, mlcod=11'105)", 2023-10-08T07:06:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.733897423999998, 2023-10-08T07:06:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010614554, 2023-10-08T07:06:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.530 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773487+0000", 2023-10-08T07:06:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:06:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.532 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773492+0000", 2023-10-08T07:06:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2249999999999999e-06 2023-10-08T07:06:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773503+0000", 2023-10-08T07:06:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0271e-05 2023-10-08T07:06:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773509+0000", 2023-10-08T07:06:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5470000000000002e-06 2023-10-08T07:06:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775801+0000", 2023-10-08T07:06:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022918790000000001 2023-10-08T07:06:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775822+0000", 2023-10-08T07:06:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1486000000000001e-05 2023-10-08T07:06:01.535 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784066+0000", 2023-10-08T07:06:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082432089999999996 2023-10-08T07:06:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.536 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784101+0000", 2023-10-08T07:06:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5383999999999999e-05 2023-10-08T07:06:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:158 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'112, mlcod=11'106)", 2023-10-08T07:06:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.733420326999997, 2023-10-08T07:06:01.537 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010172001999999999, 2023-10-08T07:06:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.82e-07 2023-10-08T07:06:01.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773990+0000", 2023-10-08T07:06:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2023-10-08T07:06:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774001+0000", 2023-10-08T07:06:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0873000000000001e-05 2023-10-08T07:06:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774006+0000", 2023-10-08T07:06:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0900000000000004e-06 2023-10-08T07:06:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776145+0000", 2023-10-08T07:06:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021389759999999999 2023-10-08T07:06:01.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776165+0000", 2023-10-08T07:06:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9548e-05 2023-10-08T07:06:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784102+0000", 2023-10-08T07:06:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007937342 2023-10-08T07:06:01.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784136+0000", 2023-10-08T07:06:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3331000000000003e-05 2023-10-08T07:06:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:159 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'113, mlcod=11'106)", 2023-10-08T07:06:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.732887368999997, 2023-10-08T07:06:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096667119999999992, 2023-10-08T07:06:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:06:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774501+0000", 2023-10-08T07:06:01.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1529999999999999e-06 2023-10-08T07:06:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774511+0000", 2023-10-08T07:06:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:06:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774533+0000", 2023-10-08T07:06:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2348999999999999e-05 2023-10-08T07:06:01.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776608+0000", 2023-10-08T07:06:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002074799 2023-10-08T07:06:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776627+0000", 2023-10-08T07:06:01.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8632999999999999e-05 2023-10-08T07:06:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784138+0000", 2023-10-08T07:06:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075110819999999997 2023-10-08T07:06:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784163+0000", 2023-10-08T07:06:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5425000000000001e-05 2023-10-08T07:06:01.549 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:160 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'114, mlcod=11'106)", 2023-10-08T07:06:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.732252187, 2023-10-08T07:06:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090478150000000007, 2023-10-08T07:06:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.550 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.551 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775133+0000", 2023-10-08T07:06:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2023-10-08T07:06:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775150+0000", 2023-10-08T07:06:01.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6206e-05 2023-10-08T07:06:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775173+0000", 2023-10-08T07:06:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.351e-05 2023-10-08T07:06:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775187+0000", 2023-10-08T07:06:01.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4396000000000001e-05 2023-10-08T07:06:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776909+0000", 2023-10-08T07:06:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017220429999999999 2023-10-08T07:06:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776929+0000", 2023-10-08T07:06:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9313e-05 2023-10-08T07:06:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784164+0000", 2023-10-08T07:06:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072352340000000001 2023-10-08T07:06:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526e-05 2023-10-08T07:06:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.556 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:161 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'115, mlcod=11'106)", 2023-10-08T07:06:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.731573298000001, 2023-10-08T07:06:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083874480000000005, 2023-10-08T07:06:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:06:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775837+0000", 2023-10-08T07:06:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6081e-05 2023-10-08T07:06:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775849+0000", 2023-10-08T07:06:01.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:06:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775854+0000", 2023-10-08T07:06:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1490000000000002e-06 2023-10-08T07:06:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.560 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777220+0000", 2023-10-08T07:06:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001365174 2023-10-08T07:06:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777232+0000", 2023-10-08T07:06:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2293000000000001e-05 2023-10-08T07:06:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:01.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069481450000000002 2023-10-08T07:06:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784198+0000", 2023-10-08T07:06:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2023-10-08T07:06:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:162 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'116, mlcod=11'106)", 2023-10-08T07:06:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.730948896000001, 2023-10-08T07:06:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077785969999999999, 2023-10-08T07:06:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776436+0000", 2023-10-08T07:06:01.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:06:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776440+0000", 2023-10-08T07:06:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2629999999999997e-06 2023-10-08T07:06:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776451+0000", 2023-10-08T07:06:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1385e-05 2023-10-08T07:06:01.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776456+0000", 2023-10-08T07:06:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9919999999999998e-06 2023-10-08T07:06:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777629+0000", 2023-10-08T07:06:01.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001173297 2023-10-08T07:06:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777650+0000", 2023-10-08T07:06:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0126e-05 2023-10-08T07:06:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.567 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784199+0000", 2023-10-08T07:06:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006548908 2023-10-08T07:06:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5071e-05 2023-10-08T07:06:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.568 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:163 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'117, mlcod=11'106)", 2023-10-08T07:06:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.730306489, 2023-10-08T07:06:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071515490000000001, 2023-10-08T07:06:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777078+0000", 2023-10-08T07:06:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4400000000000001e-07 2023-10-08T07:06:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777082+0000", 2023-10-08T07:06:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.732e-06 2023-10-08T07:06:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777095+0000", 2023-10-08T07:06:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3749e-05 2023-10-08T07:06:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777100+0000", 2023-10-08T07:06:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.634e-06 2023-10-08T07:06:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777944+0000", 2023-10-08T07:06:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00084377599999999997 2023-10-08T07:06:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777957+0000", 2023-10-08T07:06:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.276e-05 2023-10-08T07:06:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:01.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006257617 2023-10-08T07:06:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784229+0000", 2023-10-08T07:06:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4837e-05 2023-10-08T07:06:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:164 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'118, mlcod=11'106)", 2023-10-08T07:06:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 38.72972515, 2023-10-08T07:06:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093104280000000008, 2023-10-08T07:06:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.575 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2e-07 2023-10-08T07:06:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777713+0000", 2023-10-08T07:06:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4079999999999997e-05 2023-10-08T07:06:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777724+0000", 2023-10-08T07:06:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0652999999999999e-05 2023-10-08T07:06:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777729+0000", 2023-10-08T07:06:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2050000000000001e-06 2023-10-08T07:06:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778177+0000", 2023-10-08T07:06:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044763499999999999 2023-10-08T07:06:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778195+0000", 2023-10-08T07:06:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8125e-05 2023-10-08T07:06:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786935+0000", 2023-10-08T07:06:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087396049999999992 2023-10-08T07:06:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786969+0000", 2023-10-08T07:06:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4604999999999998e-05 2023-10-08T07:06:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.581 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.191836720000001, 2023-10-08T07:06:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013957681, 2023-10-08T07:06:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315552+0000", 2023-10-08T07:06:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.152e-06 2023-10-08T07:06:01.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315568+0000", 2023-10-08T07:06:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5301000000000001e-05 2023-10-08T07:06:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315583+0000", 2023-10-08T07:06:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5826000000000001e-05 2023-10-08T07:06:01.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315598+0000", 2023-10-08T07:06:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4953999999999999e-05 2023-10-08T07:06:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317200+0000", 2023-10-08T07:06:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016014950000000001 2023-10-08T07:06:01.585 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317351+0000", 2023-10-08T07:06:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015081400000000001 2023-10-08T07:06:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317540+0000", 2023-10-08T07:06:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000189557 2023-10-08T07:06:01.586 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322281+0000", 2023-10-08T07:06:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047409599999999998 2023-10-08T07:06:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329404+0000", 2023-10-08T07:06:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071225460000000004 2023-10-08T07:06:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329459+0000", 2023-10-08T07:06:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5016999999999999e-05 2023-10-08T07:06:01.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329505+0000", 2023-10-08T07:06:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059000000000001e-05 2023-10-08T07:06:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.589 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.191753751, 2023-10-08T07:06:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015617259, 2023-10-08T07:06:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.590 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315631+0000", 2023-10-08T07:06:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2023-10-08T07:06:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315636+0000", 2023-10-08T07:06:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1019999999999996e-06 2023-10-08T07:06:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315646+0000", 2023-10-08T07:06:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0056e-05 2023-10-08T07:06:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315654+0000", 2023-10-08T07:06:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7810000000000005e-06 2023-10-08T07:06:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318626+0000", 2023-10-08T07:06:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00297183 2023-10-08T07:06:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319450+0000", 2023-10-08T07:06:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082440400000000004 2023-10-08T07:06:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319924+0000", 2023-10-08T07:06:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047403099999999997 2023-10-08T07:06:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322475+0000", 2023-10-08T07:06:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002550442 2023-10-08T07:06:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331142+0000", 2023-10-08T07:06:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086669030000000001 2023-10-08T07:06:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331217+0000", 2023-10-08T07:06:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5606999999999996e-05 2023-10-08T07:06:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331247+0000", 2023-10-08T07:06:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:06:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:15 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.597 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.190590312000001, 2023-10-08T07:06:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012716055, 2023-10-08T07:06:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:01.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8599999999999997e-07 2023-10-08T07:06:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316805+0000", 2023-10-08T07:06:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0475000000000001e-05 2023-10-08T07:06:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316817+0000", 2023-10-08T07:06:01.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.226e-05 2023-10-08T07:06:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316828+0000", 2023-10-08T07:06:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1090999999999999e-05 2023-10-08T07:06:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317025+0000", 2023-10-08T07:06:01.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019711500000000001 2023-10-08T07:06:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317244+0000", 2023-10-08T07:06:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021908999999999999 2023-10-08T07:06:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317436+0000", 2023-10-08T07:06:01.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019164900000000001 2023-10-08T07:06:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321493+0000", 2023-10-08T07:06:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040573190000000002 2023-10-08T07:06:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329275+0000", 2023-10-08T07:06:01.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077820950000000002 2023-10-08T07:06:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329457+0000", 2023-10-08T07:06:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018165600000000001 2023-10-08T07:06:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329510+0000", 2023-10-08T07:06:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2519000000000003e-05 2023-10-08T07:06:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:27 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.190529520999998, 2023-10-08T07:06:01.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015441417000000001, 2023-10-08T07:06:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316855+0000", 2023-10-08T07:06:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316861+0000", 2023-10-08T07:06:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6210000000000001e-06 2023-10-08T07:06:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316869+0000", 2023-10-08T07:06:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.225e-06 2023-10-08T07:06:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316878+0000", 2023-10-08T07:06:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8799999999999997e-06 2023-10-08T07:06:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319969+0000", 2023-10-08T07:06:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030906689999999999 2023-10-08T07:06:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320072+0000", 2023-10-08T07:06:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103458 2023-10-08T07:06:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320631+0000", 2023-10-08T07:06:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055936099999999997 2023-10-08T07:06:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322686+0000", 2023-10-08T07:06:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020545899999999998 2023-10-08T07:06:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332244+0000", 2023-10-08T07:06:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095578690000000001 2023-10-08T07:06:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332274+0000", 2023-10-08T07:06:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0527000000000001e-05 2023-10-08T07:06:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332296+0000", 2023-10-08T07:06:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1359999999999999e-05 2023-10-08T07:06:01.612 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.190492932000002, 2023-10-08T07:06:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014502582, 2023-10-08T07:06:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.613 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316892+0000", 2023-10-08T07:06:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:06:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316896+0000", 2023-10-08T07:06:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9140000000000001e-06 2023-10-08T07:06:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316904+0000", 2023-10-08T07:06:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1170000000000004e-06 2023-10-08T07:06:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316911+0000", 2023-10-08T07:06:01.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:06:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320938+0000", 2023-10-08T07:06:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040269959999999997 2023-10-08T07:06:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321023+0000", 2023-10-08T07:06:01.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5420000000000005e-05 2023-10-08T07:06:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321157+0000", 2023-10-08T07:06:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013383700000000001 2023-10-08T07:06:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:01.618 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322742+0000", 2023-10-08T07:06:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015851249999999999 2023-10-08T07:06:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331290+0000", 2023-10-08T07:06:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085483190000000004 2023-10-08T07:06:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331348+0000", 2023-10-08T07:06:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7630999999999998e-05 2023-10-08T07:06:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331394+0000", 2023-10-08T07:06:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5534999999999997e-05 2023-10-08T07:06:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.620 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.190464444, 2023-10-08T07:06:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015363402, 2023-10-08T07:06:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316920+0000", 2023-10-08T07:06:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2023-10-08T07:06:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316923+0000", 2023-10-08T07:06:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2169999999999999e-06 2023-10-08T07:06:01.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316930+0000", 2023-10-08T07:06:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:06:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316938+0000", 2023-10-08T07:06:01.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:06:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322217+0000", 2023-10-08T07:06:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052793680000000004 2023-10-08T07:06:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.625 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322295+0000", 2023-10-08T07:06:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7621999999999996e-05 2023-10-08T07:06:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322411+0000", 2023-10-08T07:06:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000116297 2023-10-08T07:06:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323187+0000", 2023-10-08T07:06:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077583700000000003 2023-10-08T07:06:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332224+0000", 2023-10-08T07:06:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090370980000000004 2023-10-08T07:06:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332261+0000", 2023-10-08T07:06:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6464999999999997e-05 2023-10-08T07:06:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332283+0000", 2023-10-08T07:06:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2124e-05 2023-10-08T07:06:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.628 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.189341259999999, 2023-10-08T07:06:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014463023, 2023-10-08T07:06:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:01.629 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318044+0000", 2023-10-08T07:06:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1000000000000001e-06 2023-10-08T07:06:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318057+0000", 2023-10-08T07:06:01.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2860000000000001e-05 2023-10-08T07:06:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318067+0000", 2023-10-08T07:06:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0638999999999999e-05 2023-10-08T07:06:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318090+0000", 2023-10-08T07:06:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2889000000000001e-05 2023-10-08T07:06:01.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320985+0000", 2023-10-08T07:06:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028951279999999999 2023-10-08T07:06:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321126+0000", 2023-10-08T07:06:01.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014045600000000001 2023-10-08T07:06:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321798+0000", 2023-10-08T07:06:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067266600000000004 2023-10-08T07:06:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323135+0000", 2023-10-08T07:06:01.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013368589999999999 2023-10-08T07:06:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332445+0000", 2023-10-08T07:06:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093094419999999994 2023-10-08T07:06:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:01.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332482+0000", 2023-10-08T07:06:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332506+0000", 2023-10-08T07:06:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3649e-05 2023-10-08T07:06:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.189272751000001, 2023-10-08T07:06:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011597616999999999, 2023-10-08T07:06:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318112+0000", 2023-10-08T07:06:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2299999999999999e-07 2023-10-08T07:06:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318117+0000", 2023-10-08T07:06:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1170000000000003e-06 2023-10-08T07:06:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318127+0000", 2023-10-08T07:06:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0129000000000001e-05 2023-10-08T07:06:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318136+0000", 2023-10-08T07:06:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3610000000000001e-06 2023-10-08T07:06:01.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101062 2023-10-08T07:06:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318422+0000", 2023-10-08T07:06:01.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018560500000000001 2023-10-08T07:06:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329709+0000", 2023-10-08T07:06:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01128642 2023-10-08T07:06:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 28.189233631, 2023-10-08T07:06:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088267940000000007, 2023-10-08T07:06:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.643 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:01.644 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318151+0000", 2023-10-08T07:06:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:06:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318154+0000", 2023-10-08T07:06:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9529999999999999e-06 2023-10-08T07:06:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.645 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:01.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318161+0000", 2023-10-08T07:06:01.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.126e-06 2023-10-08T07:06:01.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.646 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:01.646 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318167+0000", 2023-10-08T07:06:01.646 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2169999999999999e-06 2023-10-08T07:06:01.646 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.646 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:01.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319711+0000", 2023-10-08T07:06:01.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015438769999999999 2023-10-08T07:06:01.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:01.647 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319864+0000", 2023-10-08T07:06:01.647 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015264799999999999 2023-10-08T07:06:01.647 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:01.647 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:01.647 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:01.648 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.326977+0000", 2023-10-08T07:06:01.648 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071133890000000003 2023-10-08T07:06:01.648 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.648 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.648 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.648 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:01.648 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:01.648 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:01.650 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:01.650 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:01.648+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:01.750 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:01.749+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:01.791 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:01.791 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:01.791 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:01.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:01.851 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:01.850+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:01.927 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:01.952 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:01.951+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:01.969 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:01.969 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:01.969 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:01.969 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:01.969 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:01.979 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:02.030 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T07:06:02.053 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:02.052+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:02.090 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:02.112 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:02.133 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:02.134 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:02.134 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T07:06:02.134 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:02.148 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:02.148 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:02.153 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:02.152+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:02.158 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:02.254 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:02.254+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:02.306 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:02.306 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:02.316 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:02.355 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:02.355+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:02.448 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:02.448 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:02.456 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:02.455+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:02.458 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:02.565 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:02.562+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:02.590 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:02.590 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:02.602 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:02.663 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:02.662+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:02.747 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:02.748 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:02.758 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:02.764 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:02.763+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:02.866 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:02.864+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:02.930 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:02.930 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:02.940 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:02.966 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:02.966+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:03.028 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2023-10-08T07:06:03.067 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:03.066+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:03.068 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:03.069 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:03.079 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:03.168 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:03.167+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:03.219 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:03.219 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:03.230 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:03.269 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:03.268+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:03.358 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:03.358 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:03.368 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:03.370 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:03.369+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:03.471 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:03.470+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:03.495 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:03.496 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:03.505 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:03.572 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:03.571+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:03.651 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:03.652 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:03.662 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:03.673 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:03.672+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:03.774 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:03.773+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:03.834 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:03.835 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:03.845 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:03.874 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:03.874+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:03.975 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:03.974+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:03.976 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:03.977 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:03.988 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:04.076 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:04.075+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:04.128 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:04.128 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:04.139 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:04.146 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:04.180 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:04.179+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:04.278 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:04.277+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:04.302 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T07:06:04.302 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T07:06:04.302 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2023-10-08T07:06:04.302 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-10-08T07:06:04.302 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-10-08T07:06:04.303 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2023-10-08T07:06:04.305 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:04.305 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:04.307 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:04.316 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:04.329 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:04.350 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:04.351 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T07:06:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:04.400 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:04.399+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:04.432 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:04.432 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-10-08T07:06:04.432 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:04.479 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:04.479+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:04.487 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2023-10-08T07:06:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2023-10-08T07:06:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2023-10-08T07:06:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-10-08T07:06:04.487 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 42.170093405999999, 2023-10-08T07:06:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069404690000000003, 2023-10-08T07:06:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315211+0000", 2023-10-08T07:06:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:06:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315216+0000", 2023-10-08T07:06:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:06:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315229+0000", 2023-10-08T07:06:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.278e-05 2023-10-08T07:06:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.491 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315235+0000", 2023-10-08T07:06:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2023-10-08T07:06:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316390+0000", 2023-10-08T07:06:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011548179999999999 2023-10-08T07:06:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316410+0000", 2023-10-08T07:06:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0818999999999998e-05 2023-10-08T07:06:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322113+0000", 2023-10-08T07:06:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057026159999999998 2023-10-08T07:06:04.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322150+0000", 2023-10-08T07:06:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7401999999999999e-05 2023-10-08T07:06:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.494 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-10-08T07:06:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:04.495 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.712733636000003, 2023-10-08T07:06:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087059660000000007, 2023-10-08T07:06:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.496 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:06:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772604+0000", 2023-10-08T07:06:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.413e-05 2023-10-08T07:06:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772617+0000", 2023-10-08T07:06:04.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2595999999999999e-05 2023-10-08T07:06:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772624+0000", 2023-10-08T07:06:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2023-10-08T07:06:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772666+0000", 2023-10-08T07:06:04.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1925000000000003e-05 2023-10-08T07:06:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772685+0000", 2023-10-08T07:06:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9071000000000001e-05 2023-10-08T07:06:04.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781237+0000", 2023-10-08T07:06:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085519059999999997 2023-10-08T07:06:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781276+0000", 2023-10-08T07:06:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9161e-05 2023-10-08T07:06:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.503 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-10-08T07:06:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.712236982, 2023-10-08T07:06:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010997768, 2023-10-08T07:06:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.504 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773067+0000", 2023-10-08T07:06:04.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:06:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773071+0000", 2023-10-08T07:06:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3819999999999997e-06 2023-10-08T07:06:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773082+0000", 2023-10-08T07:06:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0407e-05 2023-10-08T07:06:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773087+0000", 2023-10-08T07:06:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:06:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775481+0000", 2023-10-08T07:06:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023941470000000001 2023-10-08T07:06:04.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775493+0000", 2023-10-08T07:06:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2126999999999999e-05 2023-10-08T07:06:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784021+0000", 2023-10-08T07:06:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085280589999999993 2023-10-08T07:06:04.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784064+0000", 2023-10-08T07:06:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.295e-05 2023-10-08T07:06:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.510 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:157 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'111, mlcod=11'105)", 2023-10-08T07:06:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.711816884000001, 2023-10-08T07:06:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010614554, 2023-10-08T07:06:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.511 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773487+0000", 2023-10-08T07:06:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:06:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773492+0000", 2023-10-08T07:06:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2249999999999999e-06 2023-10-08T07:06:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773503+0000", 2023-10-08T07:06:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0271e-05 2023-10-08T07:06:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.514 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773509+0000", 2023-10-08T07:06:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5470000000000002e-06 2023-10-08T07:06:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775801+0000", 2023-10-08T07:06:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022918790000000001 2023-10-08T07:06:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.515 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775822+0000", 2023-10-08T07:06:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1486000000000001e-05 2023-10-08T07:06:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784066+0000", 2023-10-08T07:06:04.516 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082432089999999996 2023-10-08T07:06:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784101+0000", 2023-10-08T07:06:04.517 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5383999999999999e-05 2023-10-08T07:06:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.518 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:158 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'112, mlcod=11'106)", 2023-10-08T07:06:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.711339787, 2023-10-08T07:06:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010172001999999999, 2023-10-08T07:06:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.519 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.520 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.82e-07 2023-10-08T07:06:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.521 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773990+0000", 2023-10-08T07:06:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2023-10-08T07:06:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774001+0000", 2023-10-08T07:06:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0873000000000001e-05 2023-10-08T07:06:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.522 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774006+0000", 2023-10-08T07:06:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0900000000000004e-06 2023-10-08T07:06:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776145+0000", 2023-10-08T07:06:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021389759999999999 2023-10-08T07:06:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776165+0000", 2023-10-08T07:06:04.523 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9548e-05 2023-10-08T07:06:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784102+0000", 2023-10-08T07:06:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007937342 2023-10-08T07:06:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784136+0000", 2023-10-08T07:06:04.524 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3331000000000003e-05 2023-10-08T07:06:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:159 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'113, mlcod=11'106)", 2023-10-08T07:06:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:04.525 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.710806828999999, 2023-10-08T07:06:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096667119999999992, 2023-10-08T07:06:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:06:04.527 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774501+0000", 2023-10-08T07:06:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1529999999999999e-06 2023-10-08T07:06:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774511+0000", 2023-10-08T07:06:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:06:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.528 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774533+0000", 2023-10-08T07:06:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2348999999999999e-05 2023-10-08T07:06:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776608+0000", 2023-10-08T07:06:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002074799 2023-10-08T07:06:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.529 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776627+0000", 2023-10-08T07:06:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8632999999999999e-05 2023-10-08T07:06:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784138+0000", 2023-10-08T07:06:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075110819999999997 2023-10-08T07:06:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.530 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784163+0000", 2023-10-08T07:06:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5425000000000001e-05 2023-10-08T07:06:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:160 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'114, mlcod=11'106)", 2023-10-08T07:06:04.531 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.710171647000003, 2023-10-08T07:06:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090478150000000007, 2023-10-08T07:06:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.532 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.533 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775133+0000", 2023-10-08T07:06:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2023-10-08T07:06:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775150+0000", 2023-10-08T07:06:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6206e-05 2023-10-08T07:06:04.534 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.537 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775173+0000", 2023-10-08T07:06:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.351e-05 2023-10-08T07:06:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775187+0000", 2023-10-08T07:06:04.538 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4396000000000001e-05 2023-10-08T07:06:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776909+0000", 2023-10-08T07:06:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017220429999999999 2023-10-08T07:06:04.539 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776929+0000", 2023-10-08T07:06:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9313e-05 2023-10-08T07:06:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784164+0000", 2023-10-08T07:06:04.540 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072352340000000001 2023-10-08T07:06:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526e-05 2023-10-08T07:06:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.541 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:161 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'115, mlcod=11'106)", 2023-10-08T07:06:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.709492758000003, 2023-10-08T07:06:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083874480000000005, 2023-10-08T07:06:04.542 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:04.543 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.544 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:06:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775837+0000", 2023-10-08T07:06:04.545 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6081e-05 2023-10-08T07:06:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775849+0000", 2023-10-08T07:06:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:06:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.546 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775854+0000", 2023-10-08T07:06:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1490000000000002e-06 2023-10-08T07:06:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777220+0000", 2023-10-08T07:06:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001365174 2023-10-08T07:06:04.547 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777232+0000", 2023-10-08T07:06:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2293000000000001e-05 2023-10-08T07:06:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.548 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069481450000000002 2023-10-08T07:06:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.549 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784198+0000", 2023-10-08T07:06:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2023-10-08T07:06:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.550 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:162 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'116, mlcod=11'106)", 2023-10-08T07:06:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.708868355999996, 2023-10-08T07:06:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077785969999999999, 2023-10-08T07:06:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.551 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.552 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776436+0000", 2023-10-08T07:06:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:06:04.553 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776440+0000", 2023-10-08T07:06:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2629999999999997e-06 2023-10-08T07:06:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.554 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776451+0000", 2023-10-08T07:06:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1385e-05 2023-10-08T07:06:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.555 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776456+0000", 2023-10-08T07:06:04.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9919999999999998e-06 2023-10-08T07:06:04.556 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.556 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.556 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.556 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777629+0000", 2023-10-08T07:06:04.556 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001173297 2023-10-08T07:06:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777650+0000", 2023-10-08T07:06:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0126e-05 2023-10-08T07:06:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.557 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784199+0000", 2023-10-08T07:06:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006548908 2023-10-08T07:06:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.558 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5071e-05 2023-10-08T07:06:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.559 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:163 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'117, mlcod=11'106)", 2023-10-08T07:06:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.708225949000003, 2023-10-08T07:06:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071515490000000001, 2023-10-08T07:06:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.560 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.561 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777078+0000", 2023-10-08T07:06:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4400000000000001e-07 2023-10-08T07:06:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.562 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777082+0000", 2023-10-08T07:06:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.732e-06 2023-10-08T07:06:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777095+0000", 2023-10-08T07:06:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3749e-05 2023-10-08T07:06:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.563 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777100+0000", 2023-10-08T07:06:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.634e-06 2023-10-08T07:06:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777944+0000", 2023-10-08T07:06:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00084377599999999997 2023-10-08T07:06:04.564 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777957+0000", 2023-10-08T07:06:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.276e-05 2023-10-08T07:06:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.565 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006257617 2023-10-08T07:06:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.566 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784229+0000", 2023-10-08T07:06:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4837e-05 2023-10-08T07:06:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:164 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'118, mlcod=11'106)", 2023-10-08T07:06:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:04.567 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 41.707644610000003, 2023-10-08T07:06:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093104280000000008, 2023-10-08T07:06:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.568 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2e-07 2023-10-08T07:06:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.569 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777713+0000", 2023-10-08T07:06:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4079999999999997e-05 2023-10-08T07:06:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777724+0000", 2023-10-08T07:06:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0652999999999999e-05 2023-10-08T07:06:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.570 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777729+0000", 2023-10-08T07:06:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2050000000000001e-06 2023-10-08T07:06:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778177+0000", 2023-10-08T07:06:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044763499999999999 2023-10-08T07:06:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.571 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778195+0000", 2023-10-08T07:06:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8125e-05 2023-10-08T07:06:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.572 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786935+0000", 2023-10-08T07:06:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087396049999999992 2023-10-08T07:06:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786969+0000", 2023-10-08T07:06:04.573 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4604999999999998e-05 2023-10-08T07:06:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.574 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.16975618, 2023-10-08T07:06:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013957681, 2023-10-08T07:06:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.575 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.576 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.577 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315552+0000", 2023-10-08T07:06:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.152e-06 2023-10-08T07:06:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315568+0000", 2023-10-08T07:06:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5301000000000001e-05 2023-10-08T07:06:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.578 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315583+0000", 2023-10-08T07:06:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5826000000000001e-05 2023-10-08T07:06:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315598+0000", 2023-10-08T07:06:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4953999999999999e-05 2023-10-08T07:06:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.579 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317200+0000", 2023-10-08T07:06:04.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016014950000000001 2023-10-08T07:06:04.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317351+0000", 2023-10-08T07:06:04.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015081400000000001 2023-10-08T07:06:04.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.580 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.580 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:04.580 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317540+0000", 2023-10-08T07:06:04.580 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000189557 2023-10-08T07:06:04.580 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:04.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322281+0000", 2023-10-08T07:06:04.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047409599999999998 2023-10-08T07:06:04.581 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.581 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.581 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:04.581 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329404+0000", 2023-10-08T07:06:04.581 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071225460000000004 2023-10-08T07:06:04.582 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.582 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.582 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.582 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329459+0000", 2023-10-08T07:06:04.582 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5016999999999999e-05 2023-10-08T07:06:04.583 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.583 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.583 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.583 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329505+0000", 2023-10-08T07:06:04.583 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059000000000001e-05 2023-10-08T07:06:04.584 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.584 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.584 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.584 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.584 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.585 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:04.585 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:04.585 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.169673210999999, 2023-10-08T07:06:04.585 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015617259, 2023-10-08T07:06:04.585 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.586 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.586 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.586 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.586 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.587 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:04.587 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.587 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.587 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.588 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.588 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:04.588 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.588 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.588 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.589 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.589 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315631+0000", 2023-10-08T07:06:04.589 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2023-10-08T07:06:04.589 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.590 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.590 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.590 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315636+0000", 2023-10-08T07:06:04.590 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1019999999999996e-06 2023-10-08T07:06:04.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.591 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.591 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.591 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315646+0000", 2023-10-08T07:06:04.591 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0056e-05 2023-10-08T07:06:04.591 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.592 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.592 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.592 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315654+0000", 2023-10-08T07:06:04.592 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7810000000000005e-06 2023-10-08T07:06:04.592 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.593 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.593 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318626+0000", 2023-10-08T07:06:04.593 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00297183 2023-10-08T07:06:04.593 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.593 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319450+0000", 2023-10-08T07:06:04.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082440400000000004 2023-10-08T07:06:04.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.594 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:04.594 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319924+0000", 2023-10-08T07:06:04.594 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047403099999999997 2023-10-08T07:06:04.594 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.594 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:04.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322475+0000", 2023-10-08T07:06:04.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002550442 2023-10-08T07:06:04.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:04.595 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331142+0000", 2023-10-08T07:06:04.595 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086669030000000001 2023-10-08T07:06:04.595 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.595 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.595 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331217+0000", 2023-10-08T07:06:04.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5606999999999996e-05 2023-10-08T07:06:04.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.596 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.596 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.596 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331247+0000", 2023-10-08T07:06:04.596 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:06:04.596 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.596 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.596 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.596 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:15 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.168509772, 2023-10-08T07:06:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012716055, 2023-10-08T07:06:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:04.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.598 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.598 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:04.598 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8599999999999997e-07 2023-10-08T07:06:04.598 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.598 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316805+0000", 2023-10-08T07:06:04.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0475000000000001e-05 2023-10-08T07:06:04.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316817+0000", 2023-10-08T07:06:04.599 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.226e-05 2023-10-08T07:06:04.599 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.599 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.599 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.599 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316828+0000", 2023-10-08T07:06:04.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1090999999999999e-05 2023-10-08T07:06:04.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317025+0000", 2023-10-08T07:06:04.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019711500000000001 2023-10-08T07:06:04.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.600 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.600 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.600 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317244+0000", 2023-10-08T07:06:04.600 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021908999999999999 2023-10-08T07:06:04.600 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:04.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317436+0000", 2023-10-08T07:06:04.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019164900000000001 2023-10-08T07:06:04.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:04.601 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321493+0000", 2023-10-08T07:06:04.601 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040573190000000002 2023-10-08T07:06:04.601 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.601 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.601 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:04.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329275+0000", 2023-10-08T07:06:04.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077820950000000002 2023-10-08T07:06:04.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329457+0000", 2023-10-08T07:06:04.602 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018165600000000001 2023-10-08T07:06:04.602 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.602 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.602 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.602 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329510+0000", 2023-10-08T07:06:04.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2519000000000003e-05 2023-10-08T07:06:04.603 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.603 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.603 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.603 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.603 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.603 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:27 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:04.603 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:04.603 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.168448981000001, 2023-10-08T07:06:04.603 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015441417000000001, 2023-10-08T07:06:04.604 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.604 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.604 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.604 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:04.604 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.604 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.604 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.604 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:04.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.605 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316855+0000", 2023-10-08T07:06:04.605 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:04.605 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.605 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.605 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316861+0000", 2023-10-08T07:06:04.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6210000000000001e-06 2023-10-08T07:06:04.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.606 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316869+0000", 2023-10-08T07:06:04.606 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.225e-06 2023-10-08T07:06:04.606 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.606 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.606 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316878+0000", 2023-10-08T07:06:04.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8799999999999997e-06 2023-10-08T07:06:04.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319969+0000", 2023-10-08T07:06:04.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030906689999999999 2023-10-08T07:06:04.607 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.607 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.607 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.607 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320072+0000", 2023-10-08T07:06:04.607 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103458 2023-10-08T07:06:04.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:04.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320631+0000", 2023-10-08T07:06:04.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055936099999999997 2023-10-08T07:06:04.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.608 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:04.608 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322686+0000", 2023-10-08T07:06:04.608 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020545899999999998 2023-10-08T07:06:04.608 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.608 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:04.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332244+0000", 2023-10-08T07:06:04.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095578690000000001 2023-10-08T07:06:04.609 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.609 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.609 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.609 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332274+0000", 2023-10-08T07:06:04.609 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0527000000000001e-05 2023-10-08T07:06:04.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.610 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.610 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332296+0000", 2023-10-08T07:06:04.610 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1359999999999999e-05 2023-10-08T07:06:04.610 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.610 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.610 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.610 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.610 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.611 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:04.611 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:04.611 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.168412392, 2023-10-08T07:06:04.611 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014502582, 2023-10-08T07:06:04.611 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.611 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.611 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.611 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.611 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.611 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:04.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.612 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.612 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:04.612 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.612 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.612 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316892+0000", 2023-10-08T07:06:04.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:06:04.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.613 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.613 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316896+0000", 2023-10-08T07:06:04.613 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9140000000000001e-06 2023-10-08T07:06:04.613 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.613 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316904+0000", 2023-10-08T07:06:04.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1170000000000004e-06 2023-10-08T07:06:04.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.614 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.614 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316911+0000", 2023-10-08T07:06:04.614 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:06:04.614 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.614 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320938+0000", 2023-10-08T07:06:04.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040269959999999997 2023-10-08T07:06:04.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.615 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.615 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321023+0000", 2023-10-08T07:06:04.615 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5420000000000005e-05 2023-10-08T07:06:04.615 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.615 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:04.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321157+0000", 2023-10-08T07:06:04.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013383700000000001 2023-10-08T07:06:04.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:04.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322742+0000", 2023-10-08T07:06:04.616 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015851249999999999 2023-10-08T07:06:04.616 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.616 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.616 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:04.616 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331290+0000", 2023-10-08T07:06:04.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085483190000000004 2023-10-08T07:06:04.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331348+0000", 2023-10-08T07:06:04.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7630999999999998e-05 2023-10-08T07:06:04.617 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.617 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.617 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.617 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331394+0000", 2023-10-08T07:06:04.617 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5534999999999997e-05 2023-10-08T07:06:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.168383903999999, 2023-10-08T07:06:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015363402, 2023-10-08T07:06:04.618 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.619 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.619 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:04.619 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.619 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.619 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.619 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.619 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:04.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316920+0000", 2023-10-08T07:06:04.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2023-10-08T07:06:04.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.620 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.620 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.620 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316923+0000", 2023-10-08T07:06:04.620 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2169999999999999e-06 2023-10-08T07:06:04.620 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316930+0000", 2023-10-08T07:06:04.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:06:04.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.621 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.621 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316938+0000", 2023-10-08T07:06:04.621 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:06:04.621 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.621 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322217+0000", 2023-10-08T07:06:04.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052793680000000004 2023-10-08T07:06:04.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.622 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.622 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322295+0000", 2023-10-08T07:06:04.622 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7621999999999996e-05 2023-10-08T07:06:04.622 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.622 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:04.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322411+0000", 2023-10-08T07:06:04.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000116297 2023-10-08T07:06:04.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:04.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323187+0000", 2023-10-08T07:06:04.623 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077583700000000003 2023-10-08T07:06:04.623 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.623 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.623 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:04.623 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332224+0000", 2023-10-08T07:06:04.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090370980000000004 2023-10-08T07:06:04.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332261+0000", 2023-10-08T07:06:04.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6464999999999997e-05 2023-10-08T07:06:04.624 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.624 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.624 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.624 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332283+0000", 2023-10-08T07:06:04.624 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2124e-05 2023-10-08T07:06:04.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.625 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.625 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.625 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.625 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.625 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:04.625 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:04.625 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.167260720000002, 2023-10-08T07:06:04.625 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014463023, 2023-10-08T07:06:04.626 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.626 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:04.626 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:04.626 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.626 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.626 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.626 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.626 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:04.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318044+0000", 2023-10-08T07:06:04.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1000000000000001e-06 2023-10-08T07:06:04.627 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.627 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.627 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.627 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318057+0000", 2023-10-08T07:06:04.627 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2860000000000001e-05 2023-10-08T07:06:04.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318067+0000", 2023-10-08T07:06:04.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0638999999999999e-05 2023-10-08T07:06:04.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.628 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.628 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318090+0000", 2023-10-08T07:06:04.628 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2889000000000001e-05 2023-10-08T07:06:04.628 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.628 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320985+0000", 2023-10-08T07:06:04.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028951279999999999 2023-10-08T07:06:04.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.629 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.629 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321126+0000", 2023-10-08T07:06:04.629 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014045600000000001 2023-10-08T07:06:04.629 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.629 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:04.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321798+0000", 2023-10-08T07:06:04.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067266600000000004 2023-10-08T07:06:04.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.630 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:04.630 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323135+0000", 2023-10-08T07:06:04.630 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013368589999999999 2023-10-08T07:06:04.630 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.630 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:04.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332445+0000", 2023-10-08T07:06:04.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093094419999999994 2023-10-08T07:06:04.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.631 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:04.631 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332482+0000", 2023-10-08T07:06:04.631 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:04.631 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.631 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.632 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.632 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332506+0000", 2023-10-08T07:06:04.632 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3649e-05 2023-10-08T07:06:04.632 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.632 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.632 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.632 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.632 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.632 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:04.632 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:04.632 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.167192211, 2023-10-08T07:06:04.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011597616999999999, 2023-10-08T07:06:04.633 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.633 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:04.633 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.633 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:04.633 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.633 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.633 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.633 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:04.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318112+0000", 2023-10-08T07:06:04.634 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2299999999999999e-07 2023-10-08T07:06:04.634 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.634 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.634 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.634 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318117+0000", 2023-10-08T07:06:04.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1170000000000003e-06 2023-10-08T07:06:04.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318127+0000", 2023-10-08T07:06:04.635 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0129000000000001e-05 2023-10-08T07:06:04.635 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.635 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.635 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.635 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318136+0000", 2023-10-08T07:06:04.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3610000000000001e-06 2023-10-08T07:06:04.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:04.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101062 2023-10-08T07:06:04.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.636 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.636 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.636 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318422+0000", 2023-10-08T07:06:04.636 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018560500000000001 2023-10-08T07:06:04.636 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.637 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.637 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329709+0000", 2023-10-08T07:06:04.637 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01128642 2023-10-08T07:06:04.637 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.637 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.637 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.637 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.637 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.637 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:04.638 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:04.638 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 31.167153090999999, 2023-10-08T07:06:04.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088267940000000007, 2023-10-08T07:06:04.638 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:04.638 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:04.638 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:04.638 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.638 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:04.638 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:04.638 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.638 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:04.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:04.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:04.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.639 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:04.639 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318151+0000", 2023-10-08T07:06:04.639 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:06:04.639 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.639 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:04.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318154+0000", 2023-10-08T07:06:04.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9529999999999999e-06 2023-10-08T07:06:04.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:04.640 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318161+0000", 2023-10-08T07:06:04.640 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.126e-06 2023-10-08T07:06:04.640 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.640 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.640 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:04.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318167+0000", 2023-10-08T07:06:04.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2169999999999999e-06 2023-10-08T07:06:04.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:04.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319711+0000", 2023-10-08T07:06:04.641 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015438769999999999 2023-10-08T07:06:04.641 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.641 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.641 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:04.641 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319864+0000", 2023-10-08T07:06:04.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015264799999999999 2023-10-08T07:06:04.642 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:04.642 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:04.642 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:04.642 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.326977+0000", 2023-10-08T07:06:04.642 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071133890000000003 2023-10-08T07:06:04.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.642 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.642 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:04.642 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:04.643 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:04.644 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:04.645 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:04.643+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:04.747 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:04.746+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:04.784 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:04.784 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:04.784 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:04.784 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:04.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:04.848 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:04.847+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:04.949 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:04.948+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:04.961 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:04.961 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:04.961 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:04.972 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:05.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T07:06:05.051 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:05.050+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:05.100 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:05.101 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:05.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:05.101 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:05.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.101 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.102 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:05.102 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.782114151000002, 2023-10-08T07:06:05.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:05.102 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.102 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.102 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:05.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:05.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:05.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:05.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:05.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:05.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:05.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:05.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:05.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:05.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:05.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:05.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:05.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:05.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:05.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:05.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:05.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:05.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:05.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:05.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:05.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:05.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:05.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:05.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:05.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:05.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:05.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.113 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.114 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.114 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:05.114 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.782040367, 2023-10-08T07:06:05.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:05.114 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.114 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.114 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:05.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:05.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:05.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:05.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:05.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:05.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:05.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:05.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:05.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:05.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:05.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:05.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:05.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:05.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:05.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:05.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:05.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:05.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.781977190999999, 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:05.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:05.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:05.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:05.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:05.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:05.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:05.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:05.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:05.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:05.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:05.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:05.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:05.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:05.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:05.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:05.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:05.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:05.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:05.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:05.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:05.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.126 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.126 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.126 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:05.126 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.781942845, 2023-10-08T07:06:05.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:05.126 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.126 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:05.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:05.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:05.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:05.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:05.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:05.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:05.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:05.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:05.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:05.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:05.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:05.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:05.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:05.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:05.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:05.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:05.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:05.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:05.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:05.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:05.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:05.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.78145262, 2023-10-08T07:06:05.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:05.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.133 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:05.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:05.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:05.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:05.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:05.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:05.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:05.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:05.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:05.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:05.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:05.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:05.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:05.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:05.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.138 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.138 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.138 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:05.139 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.781412043, 2023-10-08T07:06:05.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:05.139 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.139 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.139 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:05.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:05.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:05.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:05.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:05.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:05.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:05.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:05.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:05.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:05.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:05.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:05.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:05.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:05.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:05.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:05.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:05.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:05.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:05.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:05.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:05.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:05.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:05.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:05.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:05.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:05.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:05.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.144 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.781374474, 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:05.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:05.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:05.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:05.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:05.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:05.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:05.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:05.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:05.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:05.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:05.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:05.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:05.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:05.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:05.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:05.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.149 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.149 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.149 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:05.150 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.781307034000001, 2023-10-08T07:06:05.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:05.150 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.150 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:05.150 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:05.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:05.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:05.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:05.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:05.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:05.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:05.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:05.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.156 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.156 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:05.156 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.781277392, 2023-10-08T07:06:05.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:05.156 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.156 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:05.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:05.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:05.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:05.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:05.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:05.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:05.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:05.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:05.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:05.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.160 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.161 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:05.161 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:05.161 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.775536831, 2023-10-08T07:06:05.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:05.161 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.161 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:05.161 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:05.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:05.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:05.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:05.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:05.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:05.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:05.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:05.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:05.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:05.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:05.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:05.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.775087491000001, 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:05.165 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:05.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:05.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:05.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:05.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:05.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:05.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:05.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:05.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:05.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:05.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.169 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.170 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:05.170 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:05.170 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.774291601000002, 2023-10-08T07:06:05.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:05.170 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.170 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.170 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:05.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:05.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:05.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:05.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:05.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.77417625, 2023-10-08T07:06:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:05.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:05.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:05.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:05.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:05.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:05.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:05.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:05.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:05.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:05.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:05.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.179 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.769061684, 2023-10-08T07:06:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:05.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:05.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:05.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:05.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:05.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:05.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:05.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:05.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:05.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:05.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:05.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:05.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:05.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:05.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:05.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:05.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:05.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:05.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.185 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.185 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:05.185 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:05.185 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.768950692000001, 2023-10-08T07:06:05.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:05.186 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.186 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.186 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:05.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:05.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:05.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:05.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:05.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:05.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:05.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:05.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:05.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:05.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:05.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:05.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:05.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:05.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:05.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:05.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:05.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:05.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:05.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.190 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:05.191 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:05.191 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.768526251000001, 2023-10-08T07:06:05.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:05.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:05.191 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:05.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:05.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:05.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:05.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:05.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:05.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:05.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:05.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:05.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:05.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.195 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.195 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:05.195 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:05.195 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.768379114999998, 2023-10-08T07:06:05.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:05.195 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.196 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:05.196 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:05.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:05.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:05.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:05.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:05.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:05.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:05.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:05.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:05.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:05.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:05.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:05.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:05.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:05.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.199 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:05.200 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:05.200 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.697080845999999, 2023-10-08T07:06:05.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:05.200 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.200 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:05.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:05.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:05.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:05.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:05.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:05.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:05.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:05.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:05.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:05.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:05.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:05.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:05.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:05.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:05.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:05.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:05.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:05.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:05.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:05.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:05.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:05.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:05.205 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.205 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.205 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.206 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:05.206 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:05.206 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.695287262000001, 2023-10-08T07:06:05.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:05.206 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.206 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:05.206 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:05.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:05.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:05.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:05.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:05.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:05.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:05.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:05.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:05.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:05.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:05.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:05.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:05.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:05.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:05.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:05.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.210 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.211 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:05.211 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:05.211 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.6966975919999996, 2023-10-08T07:06:05.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:05.211 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:05.211 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.211 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:05.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:05.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:05.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:05.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:05.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:05.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:05.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:05.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:05.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:05.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:05.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:05.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:05.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:05.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:05.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:05.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:05.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:05.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:05.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:05.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:05.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:05.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:05.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.216 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:05.217 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:05.217 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:05.218 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:05.219 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:05.217+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:05.319 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:05.318+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:05.365 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:05.365 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:05.366 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:05.366 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:05.376 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:05.420 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:05.420+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:05.508 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:05.509 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:05.509 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:05.509 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:05.509 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:05.519 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:05.520 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:05.520+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:05.621 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:05.620+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:05.653 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:05.653 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:05.654 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:05.654 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:05.654 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.654 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:05.654 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:05.654 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.879344422999999, 2023-10-08T07:06:05.654 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:06:05.654 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.654 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.654 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:05.655 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:05.655 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:05.655 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:06:05.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.655 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.655 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.655 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.655 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:05.655 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.655 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.655 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.656 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:05.656 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.656 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.656 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.656 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:05.656 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:06:05.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.656 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.656 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.656 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:06:05.657 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:06:05.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.657 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.657 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.657 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:06:05.657 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:06:05.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.657 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.657 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.657 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:06:05.657 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:06:05.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.658 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.658 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.658 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:06:05.658 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:06:05.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.658 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.658 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.658 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:06:05.658 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:06:05.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.658 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.659 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.659 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:06:05.659 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:06:05.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.659 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.659 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.660 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:06:05.660 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:06:05.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.660 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.660 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.660 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:06:05.661 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:06:05.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.661 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.661 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.661 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:06:05.661 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:06:05.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.662 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.662 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.662 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:06:05.662 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:06:05.663 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.663 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.663 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.663 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.663 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:05.664 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:05.664 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.879322877, 2023-10-08T07:06:05.664 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:06:05.664 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.664 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.664 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:05.665 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:05.665 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:05.665 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:06:05.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.665 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.666 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.666 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.666 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:05.666 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.667 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.667 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.667 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:05.667 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.667 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.668 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.668 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:05.668 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:06:05.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.668 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.669 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:06:05.669 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:06:05.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.669 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.670 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:06:05.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:06:05.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.670 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.671 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:06:05.671 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:06:05.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.671 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.672 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:06:05.672 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:06:05.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.672 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.673 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:06:05.673 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:06:05.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.673 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.673 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.674 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:06:05.674 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:06:05.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.674 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.675 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:06:05.675 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:06:05.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.675 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.675 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.676 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:06:05.676 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:06:05.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.676 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.676 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.677 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:06:05.677 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:06:05.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.677 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.677 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.677 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:06:05.678 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:06:05.678 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.678 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.678 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.679 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:05.679 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:05.679 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.879256282999997, 2023-10-08T07:06:05.679 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:06:05.679 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.680 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.680 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:05.680 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:05.680 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:05.680 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:06:05.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.681 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.681 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.681 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:05.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.682 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.682 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.682 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:05.682 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.683 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.683 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:06:05.683 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:06:05.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.684 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.684 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:06:05.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:06:05.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:06:05.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:06:05.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:06:05.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:06:05.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.687 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:06:05.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:06:05.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:06:05.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:06:05.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.689 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.689 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:06:05.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:06:05.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:06:05.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:06:05.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:06:05.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:06:05.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:06:05.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:06:05.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:06:05.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:06:05.694 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.694 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.694 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.695 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:05.695 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:05.695 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.879237387000003, 2023-10-08T07:06:05.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:06:05.696 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.696 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.696 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:05.696 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:05.696 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:05.697 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:06:05.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.697 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:05.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.698 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.698 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:05.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:05.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:06:05.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:06:05.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:06:05.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:06:05.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:06:05.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:06:05.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:06:05.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.703 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.703 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:06:05.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:06:05.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:06:05.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:06:05.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:06:05.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:06:05.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:06:05.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:06:05.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.707 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.707 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:06:05.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:06:05.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.707 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.707 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:06:05.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:06:05.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:06:05.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:06:05.709 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.709 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.709 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.710 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:05.710 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:05.710 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.879224378000004, 2023-10-08T07:06:05.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:05.711 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.711 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.711 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:05.711 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:05.711 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:05.712 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:05.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.712 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:05.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:05.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:05.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:05.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:05.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:05.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:05.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:05.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:05.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:05.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:05.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:05.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:05.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:05.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:05.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:05.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:05.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:05.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:05.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:05.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.723 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.723 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:05.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:05.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:05.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:05.724 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.724 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.725 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.725 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:05.725 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:05.725 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.879172326000003, 2023-10-08T07:06:05.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:05.726 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.726 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.726 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:05.726 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:05.727 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:05.727 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:05.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.727 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:05.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:05.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:05.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:05.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:05.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:05.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:05.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:05.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:05.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:05.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:05.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:05.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:05.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:05.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:05.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:05.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:05.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:05.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:05.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:05.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:05.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:05.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:05.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:05.737 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.737 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.737 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.738 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.738 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:05.738 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.333968499000001, 2023-10-08T07:06:05.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:06:05.738 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.739 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.739 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:05.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:05.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:06:05.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:06:05.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:06:05.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:06:05.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:06:05.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:06:05.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:05.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:06:05.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:06:05.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:06:05.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:05.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:06:05.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:06:05.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:06:05.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:06:05.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:06:05.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:06:05.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:06:05.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:06:05.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:06:05.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:06:05.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:06:05.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:06:05.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:06:05.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:06:05.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:06:05.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:05.747 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.747 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.747 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.747 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.748 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:05.748 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.333852020999998, 2023-10-08T07:06:05.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:05.748 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.748 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.748 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:05.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:05.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:05.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:05.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:05.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:05.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:05.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:05.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:05.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:05.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:05.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:05.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:05.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:05.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:05.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:05.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:05.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:05.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:05.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:05.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:05.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:05.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:05.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:05.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:05.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:05.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:05.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:05.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:05.755 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.755 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.755 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.756 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.756 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:05.756 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.333801694000002, 2023-10-08T07:06:05.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:05.756 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.756 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.756 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:05.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:05.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:05.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:05.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:05.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:05.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:05.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:05.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:05.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:05.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:05.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:05.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:05.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:05.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:05.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:05.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:05.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:05.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:05.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:05.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:05.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:05.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:05.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:05.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:05.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:05.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:05.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:05.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:05.763 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.763 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.763 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.763 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.763 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:05.764 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.333475849000003, 2023-10-08T07:06:05.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:05.764 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.764 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.764 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:05.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:05.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:05.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:05.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:05.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:05.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:05.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:05.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:05.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:05.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:05.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:05.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:05.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:05.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:05.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:05.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:05.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:05.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:05.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:05.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:05.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:05.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:05.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:05.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:05.770 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.770 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.770 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.771 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.771 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:05.771 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.333423324000002, 2023-10-08T07:06:05.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:05.771 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.771 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.771 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:05.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:05.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.333255348999998, 2023-10-08T07:06:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:05.780 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:05.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:05.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:05.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:05.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:05.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:05.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:05.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:05.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:05.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:05.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:05.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:05.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.790 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.333111051000003, 2023-10-08T07:06:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.791 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:05.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:05.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:05.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:05.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:05.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:05.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:05.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:05.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:05.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:05.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:05.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:05.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:05.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:05.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:05.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:05.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:05.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:05.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:05.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:05.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:05.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:05.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:05.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:05.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:05.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:05.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:05.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:05.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.799 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.800 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.800 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:05.800 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.332431538999998, 2023-10-08T07:06:05.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:05.801 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.801 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.801 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:05.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:05.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:05.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:05.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:05.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:05.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:05.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:05.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:05.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:05.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:05.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:05.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:05.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:05.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:05.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:05.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.332378269000003, 2023-10-08T07:06:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.808 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.808 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:05.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:05.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:05.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:05.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:05.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:05.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:05.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:05.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:05.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:05.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:05.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:05.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:05.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:05.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:05.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:05.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:05.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:05.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:05.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:05.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:05.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:05.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:05.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:05.814 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.814 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.815 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.815 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.815 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:05.815 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.332342423, 2023-10-08T07:06:05.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:05.815 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.815 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.816 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:05.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:05.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:05.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:05.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:05.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:05.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:05.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:05.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:05.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:05.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:05.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:05.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:05.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:05.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:05.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:05.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:05.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:05.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:05.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:05.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:05.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:05.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:05.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:05.822 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:05.824 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.332201892, 2023-10-08T07:06:05.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:05.824 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.824 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.824 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.828 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:05.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:05.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.828 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.828 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:05.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:05.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:05.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:05.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:05.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:05.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:05.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:05.833 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.833 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.833 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.833 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.833 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.331909568999997, 2023-10-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.835 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.835 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:05.835 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.835 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.835 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:05.835 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:05.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:05.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:05.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:05.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:05.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:05.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:05.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:05.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:05.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:05.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:05.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:05.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.331795927000002, 2023-10-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:05.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:05.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:05.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:05.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:05.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:05.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:05.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:05.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:05.847 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:05.847 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:05.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:05.847 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:05.847 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:05.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.848 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:05.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:05.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:05.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.848 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:05.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:05.848 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.849 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.849 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.849 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:05.849 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:05.849 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 32.330765702999997, 2023-10-08T07:06:05.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:05.849 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:05.849 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:05.850 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:05.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:05.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:05.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:05.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:05.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:05.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:05.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:05.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:05.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:05.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:05.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:05.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:05.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:05.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:05.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:05.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:05.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:05.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:05.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:05.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:05.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:05.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:05.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:05.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:05.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:05.854 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:05.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:05.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:05.854 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.855 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.855 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.855 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:05.855 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:05.855 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:05.857 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:05.857 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:05.856+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:05.957 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:05.956+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:05.996 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:05.996 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:05.996 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2023-10-08T07:06:05.997 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:06.006 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:06.032 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2023-10-08T07:06:06.058 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:06.057+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:06.133 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:06.133 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:06.133 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2023-10-08T07:06:06.133 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2023-10-08T07:06:06.133 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:06.143 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:06.159 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:06.158+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:06.260 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:06.259+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:06.272 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:06.272 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2023-10-08T07:06:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2023-10-08T07:06:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2023-10-08T07:06:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-10-08T07:06:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:06.273 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.955035592000002, 2023-10-08T07:06:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069404690000000003, 2023-10-08T07:06:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315211+0000", 2023-10-08T07:06:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:06:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315216+0000", 2023-10-08T07:06:06.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:06:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315229+0000", 2023-10-08T07:06:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.278e-05 2023-10-08T07:06:06.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315235+0000", 2023-10-08T07:06:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2023-10-08T07:06:06.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316390+0000", 2023-10-08T07:06:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011548179999999999 2023-10-08T07:06:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316410+0000", 2023-10-08T07:06:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0818999999999998e-05 2023-10-08T07:06:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322113+0000", 2023-10-08T07:06:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057026159999999998 2023-10-08T07:06:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.282 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322150+0000", 2023-10-08T07:06:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7401999999999999e-05 2023-10-08T07:06:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.283 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-10-08T07:06:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.497675821999998, 2023-10-08T07:06:06.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087059660000000007, 2023-10-08T07:06:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:06:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772604+0000", 2023-10-08T07:06:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.413e-05 2023-10-08T07:06:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772617+0000", 2023-10-08T07:06:06.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2595999999999999e-05 2023-10-08T07:06:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772624+0000", 2023-10-08T07:06:06.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2023-10-08T07:06:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772666+0000", 2023-10-08T07:06:06.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1925000000000003e-05 2023-10-08T07:06:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772685+0000", 2023-10-08T07:06:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9071000000000001e-05 2023-10-08T07:06:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781237+0000", 2023-10-08T07:06:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085519059999999997 2023-10-08T07:06:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781276+0000", 2023-10-08T07:06:06.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9161e-05 2023-10-08T07:06:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-10-08T07:06:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:06.294 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.497179168000002, 2023-10-08T07:06:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010997768, 2023-10-08T07:06:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:06.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773067+0000", 2023-10-08T07:06:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:06:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773071+0000", 2023-10-08T07:06:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3819999999999997e-06 2023-10-08T07:06:06.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773082+0000", 2023-10-08T07:06:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0407e-05 2023-10-08T07:06:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773087+0000", 2023-10-08T07:06:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:06:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775481+0000", 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023941470000000001 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775493+0000", 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2126999999999999e-05 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784021+0000", 2023-10-08T07:06:06.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085280589999999993 2023-10-08T07:06:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784064+0000", 2023-10-08T07:06:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.295e-05 2023-10-08T07:06:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.300 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:157 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'111, mlcod=11'105)", 2023-10-08T07:06:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.496759070000003, 2023-10-08T07:06:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010614554, 2023-10-08T07:06:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773487+0000", 2023-10-08T07:06:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:06:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773492+0000", 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2249999999999999e-06 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773503+0000", 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0271e-05 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773509+0000", 2023-10-08T07:06:06.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5470000000000002e-06 2023-10-08T07:06:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775801+0000", 2023-10-08T07:06:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022918790000000001 2023-10-08T07:06:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775822+0000", 2023-10-08T07:06:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1486000000000001e-05 2023-10-08T07:06:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784066+0000", 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082432089999999996 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784101+0000", 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5383999999999999e-05 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:158 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'112, mlcod=11'106)", 2023-10-08T07:06:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.496281973000002, 2023-10-08T07:06:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010172001999999999, 2023-10-08T07:06:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:06.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.82e-07 2023-10-08T07:06:06.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773990+0000", 2023-10-08T07:06:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2023-10-08T07:06:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774001+0000", 2023-10-08T07:06:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0873000000000001e-05 2023-10-08T07:06:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774006+0000", 2023-10-08T07:06:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0900000000000004e-06 2023-10-08T07:06:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776145+0000", 2023-10-08T07:06:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021389759999999999 2023-10-08T07:06:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776165+0000", 2023-10-08T07:06:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9548e-05 2023-10-08T07:06:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784102+0000", 2023-10-08T07:06:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007937342 2023-10-08T07:06:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784136+0000", 2023-10-08T07:06:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3331000000000003e-05 2023-10-08T07:06:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:159 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'113, mlcod=11'106)", 2023-10-08T07:06:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.495749015000001, 2023-10-08T07:06:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096667119999999992, 2023-10-08T07:06:06.311 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774501+0000", 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1529999999999999e-06 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774511+0000", 2023-10-08T07:06:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:06:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774533+0000", 2023-10-08T07:06:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2348999999999999e-05 2023-10-08T07:06:06.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776608+0000", 2023-10-08T07:06:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002074799 2023-10-08T07:06:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776627+0000", 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8632999999999999e-05 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784138+0000", 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075110819999999997 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784163+0000", 2023-10-08T07:06:06.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5425000000000001e-05 2023-10-08T07:06:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:160 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'114, mlcod=11'106)", 2023-10-08T07:06:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.495113832999998, 2023-10-08T07:06:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090478150000000007, 2023-10-08T07:06:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.317 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775133+0000", 2023-10-08T07:06:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2023-10-08T07:06:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775150+0000", 2023-10-08T07:06:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6206e-05 2023-10-08T07:06:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775173+0000", 2023-10-08T07:06:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.351e-05 2023-10-08T07:06:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775187+0000", 2023-10-08T07:06:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4396000000000001e-05 2023-10-08T07:06:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776909+0000", 2023-10-08T07:06:06.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017220429999999999 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776929+0000", 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9313e-05 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784164+0000", 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072352340000000001 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526e-05 2023-10-08T07:06:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:161 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'115, mlcod=11'106)", 2023-10-08T07:06:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.494434943999998, 2023-10-08T07:06:06.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083874480000000005, 2023-10-08T07:06:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:06.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:06:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775837+0000", 2023-10-08T07:06:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6081e-05 2023-10-08T07:06:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775849+0000", 2023-10-08T07:06:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:06:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775854+0000", 2023-10-08T07:06:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1490000000000002e-06 2023-10-08T07:06:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777220+0000", 2023-10-08T07:06:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001365174 2023-10-08T07:06:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777232+0000", 2023-10-08T07:06:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2293000000000001e-05 2023-10-08T07:06:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069481450000000002 2023-10-08T07:06:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784198+0000", 2023-10-08T07:06:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2023-10-08T07:06:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:162 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'116, mlcod=11'106)", 2023-10-08T07:06:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.493810541999999, 2023-10-08T07:06:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077785969999999999, 2023-10-08T07:06:06.328 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:06.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776436+0000", 2023-10-08T07:06:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:06:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776440+0000", 2023-10-08T07:06:06.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2629999999999997e-06 2023-10-08T07:06:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776451+0000", 2023-10-08T07:06:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1385e-05 2023-10-08T07:06:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776456+0000", 2023-10-08T07:06:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9919999999999998e-06 2023-10-08T07:06:06.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777629+0000", 2023-10-08T07:06:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001173297 2023-10-08T07:06:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777650+0000", 2023-10-08T07:06:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0126e-05 2023-10-08T07:06:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784199+0000", 2023-10-08T07:06:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006548908 2023-10-08T07:06:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5071e-05 2023-10-08T07:06:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:163 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'117, mlcod=11'106)", 2023-10-08T07:06:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.493168134999998, 2023-10-08T07:06:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071515490000000001, 2023-10-08T07:06:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777078+0000", 2023-10-08T07:06:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4400000000000001e-07 2023-10-08T07:06:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777082+0000", 2023-10-08T07:06:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.732e-06 2023-10-08T07:06:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777095+0000", 2023-10-08T07:06:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3749e-05 2023-10-08T07:06:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777100+0000", 2023-10-08T07:06:06.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.634e-06 2023-10-08T07:06:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777944+0000", 2023-10-08T07:06:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00084377599999999997 2023-10-08T07:06:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777957+0000", 2023-10-08T07:06:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.276e-05 2023-10-08T07:06:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006257617 2023-10-08T07:06:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784229+0000", 2023-10-08T07:06:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4837e-05 2023-10-08T07:06:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:164 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'118, mlcod=11'106)", 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 43.492586795999998, 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093104280000000008, 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2e-07 2023-10-08T07:06:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777713+0000", 2023-10-08T07:06:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4079999999999997e-05 2023-10-08T07:06:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777724+0000", 2023-10-08T07:06:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0652999999999999e-05 2023-10-08T07:06:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777729+0000", 2023-10-08T07:06:06.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2050000000000001e-06 2023-10-08T07:06:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778177+0000", 2023-10-08T07:06:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044763499999999999 2023-10-08T07:06:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778195+0000", 2023-10-08T07:06:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8125e-05 2023-10-08T07:06:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786935+0000", 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087396049999999992 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786969+0000", 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4604999999999998e-05 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.954698366000002, 2023-10-08T07:06:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013957681, 2023-10-08T07:06:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315552+0000", 2023-10-08T07:06:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.152e-06 2023-10-08T07:06:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315568+0000", 2023-10-08T07:06:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5301000000000001e-05 2023-10-08T07:06:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315583+0000", 2023-10-08T07:06:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5826000000000001e-05 2023-10-08T07:06:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315598+0000", 2023-10-08T07:06:06.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4953999999999999e-05 2023-10-08T07:06:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317200+0000", 2023-10-08T07:06:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016014950000000001 2023-10-08T07:06:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317351+0000", 2023-10-08T07:06:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015081400000000001 2023-10-08T07:06:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317540+0000", 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000189557 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322281+0000", 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047409599999999998 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329404+0000", 2023-10-08T07:06:06.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071225460000000004 2023-10-08T07:06:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329459+0000", 2023-10-08T07:06:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5016999999999999e-05 2023-10-08T07:06:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329505+0000", 2023-10-08T07:06:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059000000000001e-05 2023-10-08T07:06:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.349 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.954615396999998, 2023-10-08T07:06:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015617259, 2023-10-08T07:06:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315631+0000", 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2023-10-08T07:06:06.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315636+0000", 2023-10-08T07:06:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1019999999999996e-06 2023-10-08T07:06:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315646+0000", 2023-10-08T07:06:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0056e-05 2023-10-08T07:06:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315654+0000", 2023-10-08T07:06:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7810000000000005e-06 2023-10-08T07:06:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318626+0000", 2023-10-08T07:06:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00297183 2023-10-08T07:06:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319450+0000", 2023-10-08T07:06:06.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082440400000000004 2023-10-08T07:06:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319924+0000", 2023-10-08T07:06:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047403099999999997 2023-10-08T07:06:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322475+0000", 2023-10-08T07:06:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002550442 2023-10-08T07:06:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331142+0000", 2023-10-08T07:06:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086669030000000001 2023-10-08T07:06:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331217+0000", 2023-10-08T07:06:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5606999999999996e-05 2023-10-08T07:06:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331247+0000", 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:15 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.953451958000002, 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012716055, 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.356 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8599999999999997e-07 2023-10-08T07:06:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316805+0000", 2023-10-08T07:06:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0475000000000001e-05 2023-10-08T07:06:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316817+0000", 2023-10-08T07:06:06.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.226e-05 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316828+0000", 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1090999999999999e-05 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317025+0000", 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019711500000000001 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317244+0000", 2023-10-08T07:06:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021908999999999999 2023-10-08T07:06:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317436+0000", 2023-10-08T07:06:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019164900000000001 2023-10-08T07:06:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321493+0000", 2023-10-08T07:06:06.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040573190000000002 2023-10-08T07:06:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329275+0000", 2023-10-08T07:06:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077820950000000002 2023-10-08T07:06:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329457+0000", 2023-10-08T07:06:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018165600000000001 2023-10-08T07:06:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329510+0000", 2023-10-08T07:06:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2519000000000003e-05 2023-10-08T07:06:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:27 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.953391166999999, 2023-10-08T07:06:06.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015441417000000001, 2023-10-08T07:06:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:06.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316855+0000", 2023-10-08T07:06:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316861+0000", 2023-10-08T07:06:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6210000000000001e-06 2023-10-08T07:06:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316869+0000", 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.225e-06 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316878+0000", 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8799999999999997e-06 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319969+0000", 2023-10-08T07:06:06.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030906689999999999 2023-10-08T07:06:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320072+0000", 2023-10-08T07:06:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103458 2023-10-08T07:06:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320631+0000", 2023-10-08T07:06:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055936099999999997 2023-10-08T07:06:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322686+0000", 2023-10-08T07:06:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020545899999999998 2023-10-08T07:06:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332244+0000", 2023-10-08T07:06:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095578690000000001 2023-10-08T07:06:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332274+0000", 2023-10-08T07:06:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0527000000000001e-05 2023-10-08T07:06:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332296+0000", 2023-10-08T07:06:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1359999999999999e-05 2023-10-08T07:06:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.368 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.953354578000003, 2023-10-08T07:06:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014502582, 2023-10-08T07:06:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316892+0000", 2023-10-08T07:06:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:06:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316896+0000", 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9140000000000001e-06 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316904+0000", 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1170000000000004e-06 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316911+0000", 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:06:06.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320938+0000", 2023-10-08T07:06:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040269959999999997 2023-10-08T07:06:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321023+0000", 2023-10-08T07:06:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5420000000000005e-05 2023-10-08T07:06:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321157+0000", 2023-10-08T07:06:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013383700000000001 2023-10-08T07:06:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322742+0000", 2023-10-08T07:06:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015851249999999999 2023-10-08T07:06:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331290+0000", 2023-10-08T07:06:06.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085483190000000004 2023-10-08T07:06:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331348+0000", 2023-10-08T07:06:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7630999999999998e-05 2023-10-08T07:06:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331394+0000", 2023-10-08T07:06:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5534999999999997e-05 2023-10-08T07:06:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.374 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.953326089999997, 2023-10-08T07:06:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015363402, 2023-10-08T07:06:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316920+0000", 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2023-10-08T07:06:06.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316923+0000", 2023-10-08T07:06:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2169999999999999e-06 2023-10-08T07:06:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316930+0000", 2023-10-08T07:06:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:06:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316938+0000", 2023-10-08T07:06:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:06:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322217+0000", 2023-10-08T07:06:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052793680000000004 2023-10-08T07:06:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322295+0000", 2023-10-08T07:06:06.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7621999999999996e-05 2023-10-08T07:06:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322411+0000", 2023-10-08T07:06:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000116297 2023-10-08T07:06:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323187+0000", 2023-10-08T07:06:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077583700000000003 2023-10-08T07:06:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332224+0000", 2023-10-08T07:06:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090370980000000004 2023-10-08T07:06:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332261+0000", 2023-10-08T07:06:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6464999999999997e-05 2023-10-08T07:06:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332283+0000", 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2124e-05 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.952202905999997, 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014463023, 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.381 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318044+0000", 2023-10-08T07:06:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1000000000000001e-06 2023-10-08T07:06:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318057+0000", 2023-10-08T07:06:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2860000000000001e-05 2023-10-08T07:06:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318067+0000", 2023-10-08T07:06:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0638999999999999e-05 2023-10-08T07:06:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318090+0000", 2023-10-08T07:06:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2889000000000001e-05 2023-10-08T07:06:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320985+0000", 2023-10-08T07:06:06.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028951279999999999 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321126+0000", 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014045600000000001 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321798+0000", 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067266600000000004 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323135+0000", 2023-10-08T07:06:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013368589999999999 2023-10-08T07:06:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332445+0000", 2023-10-08T07:06:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093094419999999994 2023-10-08T07:06:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332482+0000", 2023-10-08T07:06:06.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332506+0000", 2023-10-08T07:06:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3649e-05 2023-10-08T07:06:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.387 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.952134397000002, 2023-10-08T07:06:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011597616999999999, 2023-10-08T07:06:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318112+0000", 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2299999999999999e-07 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318117+0000", 2023-10-08T07:06:06.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1170000000000003e-06 2023-10-08T07:06:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318127+0000", 2023-10-08T07:06:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0129000000000001e-05 2023-10-08T07:06:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318136+0000", 2023-10-08T07:06:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3610000000000001e-06 2023-10-08T07:06:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101062 2023-10-08T07:06:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318422+0000", 2023-10-08T07:06:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018560500000000001 2023-10-08T07:06:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329709+0000", 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01128642 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 32.952095276999998, 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088267940000000007, 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:06.392 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:06.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318151+0000", 2023-10-08T07:06:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:06:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318154+0000", 2023-10-08T07:06:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9529999999999999e-06 2023-10-08T07:06:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318161+0000", 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.126e-06 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318167+0000", 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2169999999999999e-06 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319711+0000", 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015438769999999999 2023-10-08T07:06:06.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319864+0000", 2023-10-08T07:06:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015264799999999999 2023-10-08T07:06:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.326977+0000", 2023-10-08T07:06:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071133890000000003 2023-10-08T07:06:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:06.397 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:06.397 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:06.397 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:06.399 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:06.399 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:06.397+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:06.499 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:06.498+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:06.539 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:06.539 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:06.540 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:06.540 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:06.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:06.600 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:06.599+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:06.604 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:06.604 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T07:06:06.604 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:06.700 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:06.699+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:06.717 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:06.727 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:06.801 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:06.800+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:06.894 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:06.894 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:06.902 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:06.901+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:06.904 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:07.002 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:07.002+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:07.050 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:07.050 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:07.061 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:07.105 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:07.104+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:07.193 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:07.193 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:07.203 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:07.205 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:07.204+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:07.306 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:07.305+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:07.377 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:07.377 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:07.387 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:07.429 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:07.428+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:07.508 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:07.507+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:07.527 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:07.527 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:07.537 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:07.610 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:07.609+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:07.664 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:07.664 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:07.674 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:07.716 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:07.715+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:07.815 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:07.815+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:07.842 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:07.842 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:07.852 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:07.916 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:07.915+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:07.987 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:07.987 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:07.997 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:08.018 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:08.017+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:08.046 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T07:06:08.119 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:08.118+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:08.165 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:08.166 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:08.175 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:08.222 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:08.221+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:08.323 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:08.322+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:08.343 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:08.343 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:08.353 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:08.424 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:08.423+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:08.500 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:08.500 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:08.510 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:08.525 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:08.524+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:08.617 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:08.626 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:08.625+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:08.642 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:08.642 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:08.652 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:08.727 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:08.726+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:08.776 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:08.787 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:08.787 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:08.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:08.787 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:08.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.788 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:08.788 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:08.788 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 46.013073126000002, 2023-10-08T07:06:08.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:06:08.788 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.788 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.788 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:08.788 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:08.789 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:08.789 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:06:08.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.789 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:08.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:08.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:08.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:06:08.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:06:08.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:06:08.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:06:08.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:06:08.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:06:08.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:06:08.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:06:08.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:06:08.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:06:08.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:06:08.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:06:08.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:06:08.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:06:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:06:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:06:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:06:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:06:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:06:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:06:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:06:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.796 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.796 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:08.796 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:08.796 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 46.013051580000003, 2023-10-08T07:06:08.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:06:08.796 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.796 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.796 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:08.796 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:06:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:08.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:08.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:06:08.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:06:08.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:06:08.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:06:08.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:06:08.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:06:08.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:06:08.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:06:08.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:06:08.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:06:08.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:06:08.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:06:08.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:06:08.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:06:08.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:06:08.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:06:08.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:06:08.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:06:08.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:06:08.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:06:08.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:06:08.803 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.803 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.803 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.803 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:08.803 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:08.803 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 46.012984985999999, 2023-10-08T07:06:08.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:06:08.803 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.803 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.804 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:08.804 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:08.804 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:08.804 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:06:08.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.804 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:08.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:08.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:06:08.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:06:08.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:06:08.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:06:08.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:06:08.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:06:08.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:06:08.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:06:08.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:06:08.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:06:08.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:06:08.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:06:08.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:06:08.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:06:08.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:06:08.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:06:08.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:06:08.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:06:08.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:06:08.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:06:08.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:06:08.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:06:08.811 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.811 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.811 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.811 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:08.811 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:08.812 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 46.012966089999999, 2023-10-08T07:06:08.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:06:08.812 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.812 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.812 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:08.812 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:08.812 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:08.812 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:06:08.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.812 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:08.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:06:08.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:06:08.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:06:08.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:06:08.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:06:08.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:06:08.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:06:08.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:06:08.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:06:08.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:06:08.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:06:08.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:06:08.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:06:08.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:06:08.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:06:08.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:06:08.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:06:08.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:06:08.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:06:08.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:06:08.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:06:08.818 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.818 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.818 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.819 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:08.819 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:08.819 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 46.012953080999999, 2023-10-08T07:06:08.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:08.819 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.819 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.819 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:08.819 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:08.819 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:08.819 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:08.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.820 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:08.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:08.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:08.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:08.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:08.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:08.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:08.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:08.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:08.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:08.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:08.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:08.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:08.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:08.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:08.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:08.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:08.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:08.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:08.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:08.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:08.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:08.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:08.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:08.825 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.825 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.825 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.826 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.826 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:08.826 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:08.826 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 46.012901028999998, 2023-10-08T07:06:08.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:08.826 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.826 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.826 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:08.826 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:08.826 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:08.826 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:08.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.827 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:08.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:08.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.828 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.828 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:08.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:08.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.828 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.828 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:08.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:08.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:08.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:08.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:08.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:08.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:08.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:08.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:08.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:08.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:08.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:08.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:08.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:08.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:08.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:08.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:08.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:08.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:08.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:08.832 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.832 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.832 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.833 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.833 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:08.833 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.467697201999997, 2023-10-08T07:06:08.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:06:08.833 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.833 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.833 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.833 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:08.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:08.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:06:08.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:06:08.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.835 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.835 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:06:08.835 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:06:08.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.835 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.835 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:06:08.835 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:06:08.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.835 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:08.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:06:08.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:06:08.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:06:08.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:08.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:06:08.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:06:08.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:06:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:06:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:06:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:06:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:06:08.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:06:08.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:06:08.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:06:08.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:06:08.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:06:08.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.841 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.841 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:06:08.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:06:08.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.841 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.841 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:06:08.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:08.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.841 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.842 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.842 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.842 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.842 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:08.842 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.467580724000001, 2023-10-08T07:06:08.842 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:08.842 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.842 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.842 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:08.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:08.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:08.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:08.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:08.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:08.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:08.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:08.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:08.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:08.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:08.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:08.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:08.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:08.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:08.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:08.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:08.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.847 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:08.847 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:08.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.847 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:08.847 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:08.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:08.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:08.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.848 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:08.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:08.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.848 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:08.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:08.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:08.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:08.849 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.849 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.849 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.849 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.849 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:08.850 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.467530396999997, 2023-10-08T07:06:08.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:08.850 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.850 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.850 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:08.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:08.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:08.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:08.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:08.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:08.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:08.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:08.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:08.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:08.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:08.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:08.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:08.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:08.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:08.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.854 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:08.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:08.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.854 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:08.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:08.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:08.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:08.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:08.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:08.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:08.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:08.856 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.857 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.857 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.857 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.857 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.857 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:08.857 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.467204551999998, 2023-10-08T07:06:08.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:08.857 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.857 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.857 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.858 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.858 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:08.858 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.858 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.858 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:08.858 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:08.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:08.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:08.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:08.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:08.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:08.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:08.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:08.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:08.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:08.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.861 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:08.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:08.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:08.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.861 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:08.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:08.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.862 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.862 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:08.862 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:08.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.862 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.862 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:08.862 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:08.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:08.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:08.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:08.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:08.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:08.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:08.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.864 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.864 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:08.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:08.864 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.864 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.864 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.865 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.865 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:08.865 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.467152026999997, 2023-10-08T07:06:08.865 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:08.865 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.865 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.865 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.865 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.865 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.865 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:08.865 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.866 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.866 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:08.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.866 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.866 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:08.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:08.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:08.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:08.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:08.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:08.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:08.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:08.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.868 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.868 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.868 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:08.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:08.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.868 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.868 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.868 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:08.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:08.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.869 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.869 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.869 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:08.869 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:08.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.869 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.869 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.869 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:08.869 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:08.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.869 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.870 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.870 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:08.870 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:08.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.870 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.870 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.870 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:08.870 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:08.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.870 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.870 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.871 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:08.871 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:08.871 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.871 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.871 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.871 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.871 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.871 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.871 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:08.871 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.466984052000001, 2023-10-08T07:06:08.871 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:08.872 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.872 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.872 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.872 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.872 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.872 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:08.872 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.872 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.872 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.873 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:08.873 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.873 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.873 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.873 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:08.873 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:08.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.873 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.873 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.873 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:08.874 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:08.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.874 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.874 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.874 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:08.874 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:08.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.874 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.874 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.874 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:08.874 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:08.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.875 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.875 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.875 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:08.875 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:08.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.875 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.875 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:08.875 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:08.875 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:08.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.876 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.876 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.876 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:08.876 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:08.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.876 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.876 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.876 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:08.876 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:08.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.876 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.876 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:08.877 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:08.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.877 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.877 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:08.877 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:08.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.877 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.877 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:08.878 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:08.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.878 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.878 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:08.878 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:08.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.878 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.878 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:08.878 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:08.878 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.879 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.879 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.879 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.879 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.879 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:08.879 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.466839753999999, 2023-10-08T07:06:08.879 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:08.879 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.879 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.879 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.880 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.880 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.880 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:08.880 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.880 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.880 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.880 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:08.880 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.880 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.881 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.881 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:08.881 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:08.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.881 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.881 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.881 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:08.881 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:08.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.881 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.881 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.881 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:08.882 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:08.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.882 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.882 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.882 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:08.882 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:08.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.882 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.882 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.882 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:08.882 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:08.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.883 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.883 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:08.883 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:08.883 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:08.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.883 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.883 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.883 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:08.883 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:08.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.883 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.883 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.884 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:08.884 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:08.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.884 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.884 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:08.884 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:08.884 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:08.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.884 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.884 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.884 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:08.884 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:08.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.885 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.885 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.885 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:08.885 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:08.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.885 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.885 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.885 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:08.885 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:08.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.886 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.886 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.886 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:08.886 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:08.886 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.886 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.886 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.887 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.887 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.887 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:08.887 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.466160242000001, 2023-10-08T07:06:08.887 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:08.887 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.887 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.887 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.887 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.887 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.887 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:08.887 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.888 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.888 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.888 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:08.888 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.888 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.888 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.888 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:08.888 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:08.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.889 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.889 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.889 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:08.889 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:08.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.889 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.889 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.889 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:08.889 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:08.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.889 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.890 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.890 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:08.890 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:08.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.890 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.890 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.890 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:08.890 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:08.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.890 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.890 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.890 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:08.891 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:08.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.891 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.891 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.891 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:08.891 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:08.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.891 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.891 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.891 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:08.891 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:08.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.892 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.892 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.892 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:08.892 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:08.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.892 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.892 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.892 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:08.892 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:08.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.892 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.893 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.893 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:08.893 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:08.893 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.893 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.893 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.893 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.893 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.893 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:08.893 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.466106971999999, 2023-10-08T07:06:08.893 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:08.894 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.894 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.894 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.894 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.894 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.894 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:08.894 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.894 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.894 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.894 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:08.895 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.895 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.895 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.895 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:08.895 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:08.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.895 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.895 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.895 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:08.895 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:08.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.896 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.896 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.896 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:08.896 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:08.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.896 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.896 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.896 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:08.896 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:08.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.897 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.897 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.897 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:08.897 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:08.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.897 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.897 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.897 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:08.897 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:08.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.897 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.897 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.898 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:08.898 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:08.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.898 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.898 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.898 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:08.898 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:08.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.898 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.898 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.898 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:08.898 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:08.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.899 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.899 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.899 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:08.899 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:08.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.899 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.899 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.899 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:08.899 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:08.899 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.900 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.900 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.900 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.900 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.900 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:08.900 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.466071126000003, 2023-10-08T07:06:08.900 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:08.900 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.900 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.900 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.901 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.901 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:08.901 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.901 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.901 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:08.901 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.902 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.902 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:08.902 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:08.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.902 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.902 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.902 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:08.902 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:08.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.902 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.902 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.903 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:08.903 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:08.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.903 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.903 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.903 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:08.903 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:08.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.903 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.904 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.904 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:08.904 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:08.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.904 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.904 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.904 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:08.904 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:08.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.904 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.904 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:08.905 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:08.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.905 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:08.905 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:08.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.905 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:08.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:08.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.906 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.906 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.906 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:08.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:08.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.906 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.906 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.906 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:08.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.465930595000003, 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.907 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.908 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.908 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:08.908 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.908 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.908 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.908 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:08.908 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.908 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.908 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.909 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:08.909 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:08.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.909 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.909 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.909 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:08.909 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:08.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.909 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.909 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.909 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:08.910 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:08.910 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.910 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.910 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.910 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:08.910 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:08.910 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.910 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.910 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.910 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:08.910 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:08.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.911 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.911 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:08.911 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:08.911 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:08.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.911 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.911 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.911 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:08.911 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:08.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.912 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.912 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:08.912 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:08.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.912 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:08.912 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:08.912 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:08.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.913 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:08.913 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:08.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.913 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.913 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:08.913 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:08.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.913 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.913 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:08.914 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:08.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.914 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.914 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.914 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:08.914 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:08.914 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.914 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.914 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.914 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.915 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.915 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:08.915 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.465638272, 2023-10-08T07:06:08.915 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:08.915 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.915 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.915 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.915 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.915 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.915 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:08.915 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:08.917 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:08.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:08.917 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:08.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:08.918 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:08.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.918 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.918 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.918 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:08.918 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:08.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.918 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.918 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.920 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:08.920 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:08.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.920 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.920 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.920 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:08.920 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:08.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.921 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.921 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:08.921 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:08.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.921 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.921 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:08.921 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:08.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.922 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:08.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:08.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.922 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.922 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:08.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:08.922 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.922 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.922 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.923 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.923 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:08.923 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.465524629999997, 2023-10-08T07:06:08.923 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:08.923 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.923 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:08.923 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:08.924 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:08.924 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:08.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:08.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.925 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.925 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.925 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:08.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:08.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.925 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.925 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.925 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:08.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:08.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.926 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.926 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.926 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:08.926 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:08.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.926 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.926 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.926 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:08.926 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:08.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.926 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.927 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.927 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:08.927 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:08.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.927 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:08.927 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:08.927 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:08.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.927 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:08.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:08.928 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:08.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.928 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:08.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:08.928 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:08.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.928 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:08.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.929 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 35.464494406, 2023-10-08T07:06:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.931 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:08.931 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:08.931 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:08.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.931 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.931 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:08.931 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:08.931 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:08.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.931 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.931 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:08.931 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:08.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:08.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.932 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:08.932 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:08.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:08.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.932 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:08.932 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:08.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:08.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:08.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:08.934 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:08.934 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.934 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.934 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.934 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:08.934 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:08.934 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:08.935 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:08.936 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:08.937 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:08.937 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:08.937 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T07:06:08.937 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:08.938 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:08.935+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:09.036 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:09.036+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:09.044 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2023-10-08T07:06:09.076 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:09.076 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:09.076 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2023-10-08T07:06:09.076 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:09.087 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:09.137 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:09.136+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:09.213 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2023-10-08T07:06:09.214 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2023-10-08T07:06:09.214 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:09.224 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:09.238 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:09.237+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:09.339 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:09.338+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:09.392 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:09.392 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2023-10-08T07:06:09.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2023-10-08T07:06:09.393 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2023-10-08T07:06:09.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.393 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-10-08T07:06:09.393 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:09.393 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 47.075717070000003, 2023-10-08T07:06:09.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069404690000000003, 2023-10-08T07:06:09.393 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.393 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.393 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:09.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:09.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315211+0000", 2023-10-08T07:06:09.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:06:09.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315216+0000", 2023-10-08T07:06:09.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:06:09.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.396 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.396 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315229+0000", 2023-10-08T07:06:09.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.278e-05 2023-10-08T07:06:09.396 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.397 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315235+0000", 2023-10-08T07:06:09.397 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2023-10-08T07:06:09.397 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.397 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.397 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316390+0000", 2023-10-08T07:06:09.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011548179999999999 2023-10-08T07:06:09.398 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.398 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.398 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.398 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316410+0000", 2023-10-08T07:06:09.398 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0818999999999998e-05 2023-10-08T07:06:09.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.399 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322113+0000", 2023-10-08T07:06:09.399 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057026159999999998 2023-10-08T07:06:09.399 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.399 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.399 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.400 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322150+0000", 2023-10-08T07:06:09.400 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7401999999999999e-05 2023-10-08T07:06:09.400 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.400 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.400 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.400 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.400 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.400 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-10-08T07:06:09.400 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:09.400 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.6183573, 2023-10-08T07:06:09.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087059660000000007, 2023-10-08T07:06:09.401 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.401 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.401 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.401 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.401 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:09.401 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.401 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.401 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:09.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.402 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.402 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.402 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.402 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:09.402 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:06:09.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.403 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.403 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772604+0000", 2023-10-08T07:06:09.403 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.413e-05 2023-10-08T07:06:09.403 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.403 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772617+0000", 2023-10-08T07:06:09.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2595999999999999e-05 2023-10-08T07:06:09.404 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.404 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.404 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.404 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772624+0000", 2023-10-08T07:06:09.404 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2023-10-08T07:06:09.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772666+0000", 2023-10-08T07:06:09.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1925000000000003e-05 2023-10-08T07:06:09.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.405 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.405 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772685+0000", 2023-10-08T07:06:09.405 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9071000000000001e-05 2023-10-08T07:06:09.405 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.405 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781237+0000", 2023-10-08T07:06:09.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085519059999999997 2023-10-08T07:06:09.406 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.406 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.406 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.406 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781276+0000", 2023-10-08T07:06:09.406 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9161e-05 2023-10-08T07:06:09.406 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.406 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.406 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.407 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.407 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-10-08T07:06:09.407 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:09.407 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.617860645999997, 2023-10-08T07:06:09.407 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010997768, 2023-10-08T07:06:09.407 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.407 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.407 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.407 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.407 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:09.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:09.408 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.408 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.408 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.408 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.408 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773067+0000", 2023-10-08T07:06:09.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:06:09.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773071+0000", 2023-10-08T07:06:09.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3819999999999997e-06 2023-10-08T07:06:09.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.409 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.409 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.409 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773082+0000", 2023-10-08T07:06:09.409 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0407e-05 2023-10-08T07:06:09.409 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773087+0000", 2023-10-08T07:06:09.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:06:09.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.410 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.410 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775481+0000", 2023-10-08T07:06:09.410 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023941470000000001 2023-10-08T07:06:09.410 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.410 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775493+0000", 2023-10-08T07:06:09.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2126999999999999e-05 2023-10-08T07:06:09.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.411 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.411 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.411 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784021+0000", 2023-10-08T07:06:09.411 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085280589999999993 2023-10-08T07:06:09.411 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.412 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.412 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784064+0000", 2023-10-08T07:06:09.412 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.295e-05 2023-10-08T07:06:09.412 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.412 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.412 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.412 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.412 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.412 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:157 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'111, mlcod=11'105)", 2023-10-08T07:06:09.412 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:09.413 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.617440547999998, 2023-10-08T07:06:09.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010614554, 2023-10-08T07:06:09.413 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.413 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.413 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.413 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.413 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:09.413 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.413 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.413 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:09.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.414 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773487+0000", 2023-10-08T07:06:09.414 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:06:09.414 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.414 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.414 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773492+0000", 2023-10-08T07:06:09.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2249999999999999e-06 2023-10-08T07:06:09.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773503+0000", 2023-10-08T07:06:09.415 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0271e-05 2023-10-08T07:06:09.415 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.415 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.415 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.415 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773509+0000", 2023-10-08T07:06:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5470000000000002e-06 2023-10-08T07:06:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775801+0000", 2023-10-08T07:06:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022918790000000001 2023-10-08T07:06:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.416 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775822+0000", 2023-10-08T07:06:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1486000000000001e-05 2023-10-08T07:06:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784066+0000", 2023-10-08T07:06:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082432089999999996 2023-10-08T07:06:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.417 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784101+0000", 2023-10-08T07:06:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5383999999999999e-05 2023-10-08T07:06:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.418 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:158 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'112, mlcod=11'106)", 2023-10-08T07:06:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.616963450999997, 2023-10-08T07:06:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010172001999999999, 2023-10-08T07:06:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.419 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.420 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.82e-07 2023-10-08T07:06:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773990+0000", 2023-10-08T07:06:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2023-10-08T07:06:09.421 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774001+0000", 2023-10-08T07:06:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0873000000000001e-05 2023-10-08T07:06:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774006+0000", 2023-10-08T07:06:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0900000000000004e-06 2023-10-08T07:06:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.422 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776145+0000", 2023-10-08T07:06:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021389759999999999 2023-10-08T07:06:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776165+0000", 2023-10-08T07:06:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9548e-05 2023-10-08T07:06:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.423 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784102+0000", 2023-10-08T07:06:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007937342 2023-10-08T07:06:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784136+0000", 2023-10-08T07:06:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3331000000000003e-05 2023-10-08T07:06:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.424 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:159 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'113, mlcod=11'106)", 2023-10-08T07:06:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.616430493000003, 2023-10-08T07:06:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096667119999999992, 2023-10-08T07:06:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.425 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:09.426 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:06:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774501+0000", 2023-10-08T07:06:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1529999999999999e-06 2023-10-08T07:06:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774511+0000", 2023-10-08T07:06:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:06:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.427 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774533+0000", 2023-10-08T07:06:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2348999999999999e-05 2023-10-08T07:06:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776608+0000", 2023-10-08T07:06:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002074799 2023-10-08T07:06:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.428 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776627+0000", 2023-10-08T07:06:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8632999999999999e-05 2023-10-08T07:06:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784138+0000", 2023-10-08T07:06:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075110819999999997 2023-10-08T07:06:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.429 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784163+0000", 2023-10-08T07:06:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5425000000000001e-05 2023-10-08T07:06:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.430 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:160 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'114, mlcod=11'106)", 2023-10-08T07:06:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.615795310999999, 2023-10-08T07:06:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090478150000000007, 2023-10-08T07:06:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.431 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775133+0000", 2023-10-08T07:06:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2023-10-08T07:06:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.432 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775150+0000", 2023-10-08T07:06:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6206e-05 2023-10-08T07:06:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775173+0000", 2023-10-08T07:06:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.351e-05 2023-10-08T07:06:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.433 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775187+0000", 2023-10-08T07:06:09.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4396000000000001e-05 2023-10-08T07:06:09.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776909+0000", 2023-10-08T07:06:09.434 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017220429999999999 2023-10-08T07:06:09.434 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.434 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.434 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.434 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776929+0000", 2023-10-08T07:06:09.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9313e-05 2023-10-08T07:06:09.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784164+0000", 2023-10-08T07:06:09.435 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072352340000000001 2023-10-08T07:06:09.435 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.435 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.435 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.435 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:09.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526e-05 2023-10-08T07:06:09.436 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.436 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.436 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.436 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.436 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.436 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:161 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'115, mlcod=11'106)", 2023-10-08T07:06:09.436 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:09.436 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.615116422, 2023-10-08T07:06:09.436 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083874480000000005, 2023-10-08T07:06:09.436 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.437 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.437 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:09.437 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.437 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.437 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.437 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.437 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:09.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:09.438 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:06:09.438 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.438 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.438 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.438 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775837+0000", 2023-10-08T07:06:09.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6081e-05 2023-10-08T07:06:09.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775849+0000", 2023-10-08T07:06:09.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:06:09.439 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.439 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.439 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.439 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775854+0000", 2023-10-08T07:06:09.439 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1490000000000002e-06 2023-10-08T07:06:09.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777220+0000", 2023-10-08T07:06:09.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001365174 2023-10-08T07:06:09.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.440 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.440 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.440 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777232+0000", 2023-10-08T07:06:09.440 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2293000000000001e-05 2023-10-08T07:06:09.440 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:09.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069481450000000002 2023-10-08T07:06:09.441 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.441 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.441 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.441 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784198+0000", 2023-10-08T07:06:09.441 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2023-10-08T07:06:09.441 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.441 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.441 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.442 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.442 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:162 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'116, mlcod=11'106)", 2023-10-08T07:06:09.442 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:09.442 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.61449202, 2023-10-08T07:06:09.442 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077785969999999999, 2023-10-08T07:06:09.442 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.442 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.442 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.442 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:09.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:09.443 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.443 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.443 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.443 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.443 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776436+0000", 2023-10-08T07:06:09.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:06:09.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776440+0000", 2023-10-08T07:06:09.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2629999999999997e-06 2023-10-08T07:06:09.444 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.444 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.444 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.444 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776451+0000", 2023-10-08T07:06:09.444 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1385e-05 2023-10-08T07:06:09.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776456+0000", 2023-10-08T07:06:09.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9919999999999998e-06 2023-10-08T07:06:09.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.445 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.445 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.445 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777629+0000", 2023-10-08T07:06:09.445 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001173297 2023-10-08T07:06:09.445 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777650+0000", 2023-10-08T07:06:09.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0126e-05 2023-10-08T07:06:09.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.446 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784199+0000", 2023-10-08T07:06:09.446 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006548908 2023-10-08T07:06:09.446 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.446 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.446 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5071e-05 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:163 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'117, mlcod=11'106)", 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.613849612999999, 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071515490000000001, 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.447 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.448 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777078+0000", 2023-10-08T07:06:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4400000000000001e-07 2023-10-08T07:06:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777082+0000", 2023-10-08T07:06:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.732e-06 2023-10-08T07:06:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777095+0000", 2023-10-08T07:06:09.449 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3749e-05 2023-10-08T07:06:09.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777100+0000", 2023-10-08T07:06:09.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.634e-06 2023-10-08T07:06:09.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.450 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.450 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.450 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777944+0000", 2023-10-08T07:06:09.450 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00084377599999999997 2023-10-08T07:06:09.450 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777957+0000", 2023-10-08T07:06:09.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.276e-05 2023-10-08T07:06:09.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.451 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.451 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:09.451 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006257617 2023-10-08T07:06:09.451 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.451 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784229+0000", 2023-10-08T07:06:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4837e-05 2023-10-08T07:06:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:164 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'118, mlcod=11'106)", 2023-10-08T07:06:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 46.613268273999999, 2023-10-08T07:06:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093104280000000008, 2023-10-08T07:06:09.453 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.453 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.453 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:09.453 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.453 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.453 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.453 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.453 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:09.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:09.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2e-07 2023-10-08T07:06:09.454 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.454 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.454 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.454 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777713+0000", 2023-10-08T07:06:09.454 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4079999999999997e-05 2023-10-08T07:06:09.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777724+0000", 2023-10-08T07:06:09.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0652999999999999e-05 2023-10-08T07:06:09.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.455 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.455 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.455 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777729+0000", 2023-10-08T07:06:09.455 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2050000000000001e-06 2023-10-08T07:06:09.455 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778177+0000", 2023-10-08T07:06:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044763499999999999 2023-10-08T07:06:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778195+0000", 2023-10-08T07:06:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8125e-05 2023-10-08T07:06:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.456 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786935+0000", 2023-10-08T07:06:09.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087396049999999992 2023-10-08T07:06:09.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.457 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.457 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786969+0000", 2023-10-08T07:06:09.457 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4604999999999998e-05 2023-10-08T07:06:09.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.457 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.457 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.457 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.457 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.075379843999997, 2023-10-08T07:06:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013957681, 2023-10-08T07:06:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315552+0000", 2023-10-08T07:06:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.152e-06 2023-10-08T07:06:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315568+0000", 2023-10-08T07:06:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5301000000000001e-05 2023-10-08T07:06:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315583+0000", 2023-10-08T07:06:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5826000000000001e-05 2023-10-08T07:06:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315598+0000", 2023-10-08T07:06:09.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4953999999999999e-05 2023-10-08T07:06:09.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317200+0000", 2023-10-08T07:06:09.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016014950000000001 2023-10-08T07:06:09.461 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.461 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.461 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.461 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317351+0000", 2023-10-08T07:06:09.461 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015081400000000001 2023-10-08T07:06:09.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:09.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317540+0000", 2023-10-08T07:06:09.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000189557 2023-10-08T07:06:09.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.462 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.462 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:09.462 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322281+0000", 2023-10-08T07:06:09.462 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047409599999999998 2023-10-08T07:06:09.462 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:09.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329404+0000", 2023-10-08T07:06:09.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071225460000000004 2023-10-08T07:06:09.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.463 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329459+0000", 2023-10-08T07:06:09.463 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5016999999999999e-05 2023-10-08T07:06:09.463 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.463 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.463 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.464 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329505+0000", 2023-10-08T07:06:09.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059000000000001e-05 2023-10-08T07:06:09.464 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.464 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.464 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.464 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.464 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.464 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:09.464 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:09.464 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.075296874999999, 2023-10-08T07:06:09.464 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015617259, 2023-10-08T07:06:09.464 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.465 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315631+0000", 2023-10-08T07:06:09.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2023-10-08T07:06:09.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.466 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.466 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315636+0000", 2023-10-08T07:06:09.466 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1019999999999996e-06 2023-10-08T07:06:09.466 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.466 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315646+0000", 2023-10-08T07:06:09.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0056e-05 2023-10-08T07:06:09.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315654+0000", 2023-10-08T07:06:09.467 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7810000000000005e-06 2023-10-08T07:06:09.467 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.467 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.467 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.467 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318626+0000", 2023-10-08T07:06:09.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00297183 2023-10-08T07:06:09.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319450+0000", 2023-10-08T07:06:09.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082440400000000004 2023-10-08T07:06:09.468 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.468 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.468 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:09.468 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319924+0000", 2023-10-08T07:06:09.468 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047403099999999997 2023-10-08T07:06:09.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:09.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322475+0000", 2023-10-08T07:06:09.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002550442 2023-10-08T07:06:09.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.469 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:09.469 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331142+0000", 2023-10-08T07:06:09.469 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086669030000000001 2023-10-08T07:06:09.469 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.469 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331217+0000", 2023-10-08T07:06:09.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5606999999999996e-05 2023-10-08T07:06:09.470 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.470 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.470 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.470 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331247+0000", 2023-10-08T07:06:09.470 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:06:09.470 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.470 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.470 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.471 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.471 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:15 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:09.471 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:09.471 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.074133435999997, 2023-10-08T07:06:09.471 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012716055, 2023-10-08T07:06:09.471 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.471 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.471 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.471 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.471 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:09.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:09.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.472 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.472 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.472 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.472 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:09.472 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8599999999999997e-07 2023-10-08T07:06:09.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316805+0000", 2023-10-08T07:06:09.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0475000000000001e-05 2023-10-08T07:06:09.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.473 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.473 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.473 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316817+0000", 2023-10-08T07:06:09.473 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.226e-05 2023-10-08T07:06:09.473 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316828+0000", 2023-10-08T07:06:09.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1090999999999999e-05 2023-10-08T07:06:09.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.474 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.474 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317025+0000", 2023-10-08T07:06:09.474 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019711500000000001 2023-10-08T07:06:09.474 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.474 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317244+0000", 2023-10-08T07:06:09.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021908999999999999 2023-10-08T07:06:09.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:09.475 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317436+0000", 2023-10-08T07:06:09.475 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019164900000000001 2023-10-08T07:06:09.475 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.475 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.475 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:09.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321493+0000", 2023-10-08T07:06:09.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040573190000000002 2023-10-08T07:06:09.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:09.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329275+0000", 2023-10-08T07:06:09.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077820950000000002 2023-10-08T07:06:09.476 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.476 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.476 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.476 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329457+0000", 2023-10-08T07:06:09.476 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018165600000000001 2023-10-08T07:06:09.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.477 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.477 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329510+0000", 2023-10-08T07:06:09.477 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2519000000000003e-05 2023-10-08T07:06:09.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.477 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.477 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.477 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.477 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.477 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:27 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:09.477 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:09.478 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.074072645000001, 2023-10-08T07:06:09.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015441417000000001, 2023-10-08T07:06:09.478 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.478 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.478 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.478 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.478 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:09.478 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.478 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.478 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:09.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.479 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.479 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316855+0000", 2023-10-08T07:06:09.479 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:09.479 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.479 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316861+0000", 2023-10-08T07:06:09.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6210000000000001e-06 2023-10-08T07:06:09.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316869+0000", 2023-10-08T07:06:09.480 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.225e-06 2023-10-08T07:06:09.480 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.480 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.480 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.480 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316878+0000", 2023-10-08T07:06:09.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8799999999999997e-06 2023-10-08T07:06:09.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319969+0000", 2023-10-08T07:06:09.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030906689999999999 2023-10-08T07:06:09.481 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.481 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.481 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.481 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320072+0000", 2023-10-08T07:06:09.481 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103458 2023-10-08T07:06:09.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:09.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320631+0000", 2023-10-08T07:06:09.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055936099999999997 2023-10-08T07:06:09.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.482 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.482 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:09.482 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322686+0000", 2023-10-08T07:06:09.482 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020545899999999998 2023-10-08T07:06:09.482 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:09.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332244+0000", 2023-10-08T07:06:09.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095578690000000001 2023-10-08T07:06:09.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.483 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.483 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332274+0000", 2023-10-08T07:06:09.483 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0527000000000001e-05 2023-10-08T07:06:09.483 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.483 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.484 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.484 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332296+0000", 2023-10-08T07:06:09.484 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1359999999999999e-05 2023-10-08T07:06:09.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.484 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.484 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.484 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.484 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.484 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:09.484 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:09.484 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.074036055999997, 2023-10-08T07:06:09.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014502582, 2023-10-08T07:06:09.485 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.485 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.485 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.485 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:09.485 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.485 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.485 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.485 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:09.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316892+0000", 2023-10-08T07:06:09.486 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:06:09.486 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.486 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.486 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.486 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316896+0000", 2023-10-08T07:06:09.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9140000000000001e-06 2023-10-08T07:06:09.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316904+0000", 2023-10-08T07:06:09.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1170000000000004e-06 2023-10-08T07:06:09.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.487 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.487 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.487 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316911+0000", 2023-10-08T07:06:09.487 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:06:09.487 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320938+0000", 2023-10-08T07:06:09.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040269959999999997 2023-10-08T07:06:09.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.488 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.488 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.488 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321023+0000", 2023-10-08T07:06:09.488 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5420000000000005e-05 2023-10-08T07:06:09.488 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:09.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321157+0000", 2023-10-08T07:06:09.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013383700000000001 2023-10-08T07:06:09.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:09.489 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322742+0000", 2023-10-08T07:06:09.489 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015851249999999999 2023-10-08T07:06:09.489 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.489 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.489 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:09.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331290+0000", 2023-10-08T07:06:09.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085483190000000004 2023-10-08T07:06:09.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331348+0000", 2023-10-08T07:06:09.490 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7630999999999998e-05 2023-10-08T07:06:09.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.490 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.490 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.490 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331394+0000", 2023-10-08T07:06:09.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5534999999999997e-05 2023-10-08T07:06:09.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.491 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.491 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.491 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.491 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:09.491 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:09.491 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.074007567999999, 2023-10-08T07:06:09.491 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015363402, 2023-10-08T07:06:09.491 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.491 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.492 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:09.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.492 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.492 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:09.492 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.492 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316920+0000", 2023-10-08T07:06:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2023-10-08T07:06:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316923+0000", 2023-10-08T07:06:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2169999999999999e-06 2023-10-08T07:06:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.493 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316930+0000", 2023-10-08T07:06:09.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:06:09.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316938+0000", 2023-10-08T07:06:09.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:06:09.494 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.494 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.494 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.494 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322217+0000", 2023-10-08T07:06:09.494 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052793680000000004 2023-10-08T07:06:09.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322295+0000", 2023-10-08T07:06:09.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7621999999999996e-05 2023-10-08T07:06:09.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.495 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:09.495 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322411+0000", 2023-10-08T07:06:09.495 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000116297 2023-10-08T07:06:09.495 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.495 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:09.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323187+0000", 2023-10-08T07:06:09.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077583700000000003 2023-10-08T07:06:09.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:09.496 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332224+0000", 2023-10-08T07:06:09.496 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090370980000000004 2023-10-08T07:06:09.496 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.496 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.496 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332261+0000", 2023-10-08T07:06:09.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6464999999999997e-05 2023-10-08T07:06:09.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.497 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.497 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.497 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332283+0000", 2023-10-08T07:06:09.497 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2124e-05 2023-10-08T07:06:09.497 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.497 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.497 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.497 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.498 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:09.498 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:09.498 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.072884383999998, 2023-10-08T07:06:09.498 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014463023, 2023-10-08T07:06:09.498 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.498 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.498 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.498 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.498 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.498 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:09.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:09.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.499 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.499 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.499 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318044+0000", 2023-10-08T07:06:09.499 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1000000000000001e-06 2023-10-08T07:06:09.499 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318057+0000", 2023-10-08T07:06:09.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2860000000000001e-05 2023-10-08T07:06:09.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.500 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.500 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318067+0000", 2023-10-08T07:06:09.500 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0638999999999999e-05 2023-10-08T07:06:09.500 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.500 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318090+0000", 2023-10-08T07:06:09.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2889000000000001e-05 2023-10-08T07:06:09.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.501 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320985+0000", 2023-10-08T07:06:09.501 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028951279999999999 2023-10-08T07:06:09.501 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.501 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.501 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321126+0000", 2023-10-08T07:06:09.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014045600000000001 2023-10-08T07:06:09.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:09.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321798+0000", 2023-10-08T07:06:09.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067266600000000004 2023-10-08T07:06:09.502 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.502 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.502 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:09.502 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323135+0000", 2023-10-08T07:06:09.502 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013368589999999999 2023-10-08T07:06:09.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:09.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332445+0000", 2023-10-08T07:06:09.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093094419999999994 2023-10-08T07:06:09.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.503 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.503 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:09.503 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332482+0000", 2023-10-08T07:06:09.503 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:09.503 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.504 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.504 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332506+0000", 2023-10-08T07:06:09.504 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3649e-05 2023-10-08T07:06:09.504 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.504 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.504 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.504 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.504 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.504 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:09.504 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:09.504 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.072815875000003, 2023-10-08T07:06:09.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011597616999999999, 2023-10-08T07:06:09.505 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.505 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:09.505 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:09.505 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.505 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.505 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.505 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.505 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:09.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318112+0000", 2023-10-08T07:06:09.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2299999999999999e-07 2023-10-08T07:06:09.506 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.506 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.506 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.506 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318117+0000", 2023-10-08T07:06:09.506 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1170000000000003e-06 2023-10-08T07:06:09.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318127+0000", 2023-10-08T07:06:09.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0129000000000001e-05 2023-10-08T07:06:09.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.507 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.507 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.507 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318136+0000", 2023-10-08T07:06:09.507 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3610000000000001e-06 2023-10-08T07:06:09.507 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:09.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101062 2023-10-08T07:06:09.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.508 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318422+0000", 2023-10-08T07:06:09.508 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018560500000000001 2023-10-08T07:06:09.508 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.508 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.508 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.509 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329709+0000", 2023-10-08T07:06:09.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01128642 2023-10-08T07:06:09.509 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.509 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.509 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.509 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.509 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.509 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:09.509 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:09.509 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 36.072776755, 2023-10-08T07:06:09.509 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088267940000000007, 2023-10-08T07:06:09.509 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:09.510 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:09.510 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:09.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:09.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:09.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.510 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.510 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:09.510 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:09.510 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:09.510 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:09.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318151+0000", 2023-10-08T07:06:09.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:06:09.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.511 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:09.511 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318154+0000", 2023-10-08T07:06:09.511 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9529999999999999e-06 2023-10-08T07:06:09.511 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.511 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318161+0000", 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.126e-06 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318167+0000", 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2169999999999999e-06 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319711+0000", 2023-10-08T07:06:09.512 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015438769999999999 2023-10-08T07:06:09.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:09.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319864+0000", 2023-10-08T07:06:09.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015264799999999999 2023-10-08T07:06:09.513 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:09.513 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:09.513 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:09.513 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.326977+0000", 2023-10-08T07:06:09.513 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071133890000000003 2023-10-08T07:06:09.513 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.513 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.514 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.514 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:09.514 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:09.514 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:09.514 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T07:06:09.514 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T07:06:09.515 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2023-10-08T07:06:09.515 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-10-08T07:06:09.515 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-10-08T07:06:09.515 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2023-10-08T07:06:09.516 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:09.514+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:09.517 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:09.616 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:09.615+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:09.665 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-10-08T07:06:09.665 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:09.666 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:09.666 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:09.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:09.724 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:09.724+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:09.818 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:09.818+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:09.850 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:09.851 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:09.851 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:09.851 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:09.851 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:09.861 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:09.921 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:09.920+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:09.989 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:09.989 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:09.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:09.989 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:09.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.989 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:09.989 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:09.989 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.670688757000001, 2023-10-08T07:06:09.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:09.990 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:09.990 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:09.990 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:09.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:09.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:09.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:09.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:09.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:09.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:09.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:09.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:09.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:09.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:09.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:09.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:09.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:09.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:09.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:09.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:09.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:09.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:09.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:09.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:09.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:09.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:09.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:09.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:09.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:09.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:09.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:09.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:09.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:09.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:09.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:09.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:09.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:09.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:09.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:09.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:09.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:09.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:09.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:09.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:09.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:09.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:09.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:09.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:09.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:09.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:09.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:09.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:10.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:10.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:10.001 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.001 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.001 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.002 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.002 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:10.002 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.670614972999999, 2023-10-08T07:06:10.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:10.002 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.002 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.003 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:10.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:10.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:10.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:10.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:10.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:10.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:10.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:10.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:10.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:10.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:10.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:10.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:10.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:10.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:10.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:10.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:10.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:10.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:10.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:10.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:10.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:10.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:10.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:10.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:10.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:10.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:10.017 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.018 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.018 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.018 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.019 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:10.019 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.670551797000002, 2023-10-08T07:06:10.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:10.019 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.019 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.020 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:10.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:10.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:10.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:10.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:10.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:10.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:10.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:10.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:10.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:10.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:10.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:10.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:10.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:10.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:10.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:10.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:10.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:10.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:10.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:10.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:10.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:10.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:10.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:10.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:10.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:10.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.032 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.033 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.033 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:10.033 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.670517451000002, 2023-10-08T07:06:10.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:10.034 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.034 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.034 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:10.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:10.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:10.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:10.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:10.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:10.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:10.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:10.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:10.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:10.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:10.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:10.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:10.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:10.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.670027226000002, 2023-10-08T07:06:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.669986649000002, 2023-10-08T07:06:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.669949080000002, 2023-10-08T07:06:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.66988164, 2023-10-08T07:06:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.669851997999999, 2023-10-08T07:06:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.664111437000003, 2023-10-08T07:06:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.663662097, 2023-10-08T07:06:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.662866207, 2023-10-08T07:06:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.662750856000002, 2023-10-08T07:06:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.657636289999999, 2023-10-08T07:06:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.657525298000003, 2023-10-08T07:06:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.657100857000003, 2023-10-08T07:06:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.656953721000001, 2023-10-08T07:06:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.585655451999997, 2023-10-08T07:06:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.583861868, 2023-10-08T07:06:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.585272198, 2023-10-08T07:06:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:10.148 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:10.150 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:10.150 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:10.149+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:10.251 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:10.250+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:10.296 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:10.297 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:10.297 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:10.297 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:10.307 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:10.352 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:10.351+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:10.452 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:10.451+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:10.479 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:10.480 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:10.480 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:10.480 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:10.480 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:10.490 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:10.553 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:10.553+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:10.654 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:10.653+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:10.665 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:10.665 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:10.665 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:10.665 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:10.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.665 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:10.665 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:10.665 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.891302439999997, 2023-10-08T07:06:10.666 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:06:10.666 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.666 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.666 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:10.666 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:10.666 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:10.666 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:06:10.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.667 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.667 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.667 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.667 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:10.667 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.668 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.668 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.668 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:10.668 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.668 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.668 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.668 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:10.668 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:06:10.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.669 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:06:10.669 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:06:10.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.669 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:06:10.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:06:10.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.670 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.670 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:06:10.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:06:10.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.670 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.670 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:06:10.671 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:06:10.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.671 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.671 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:06:10.671 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:06:10.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.672 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.672 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:06:10.672 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:06:10.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.673 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.673 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.673 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:06:10.673 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:06:10.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.674 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.674 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:06:10.674 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:06:10.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.675 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.677 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:06:10.677 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:06:10.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.677 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.678 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.678 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:06:10.678 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:06:10.678 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.678 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.679 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.679 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:10.679 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:10.679 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.891280893999998, 2023-10-08T07:06:10.679 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:06:10.680 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.680 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.680 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:10.680 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:10.680 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:10.681 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:06:10.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.681 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.681 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.681 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:10.682 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.684 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.684 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:10.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:10.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:06:10.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:06:10.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:06:10.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:06:10.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:06:10.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:06:10.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:06:10.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:06:10.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:06:10.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.687 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:06:10.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:06:10.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.687 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:06:10.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:06:10.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:06:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:06:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:06:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:06:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:06:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:06:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:06:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:06:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:10.693 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:10.693 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.891214300000001, 2023-10-08T07:06:10.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:06:10.693 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.693 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.693 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:10.693 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:10.693 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:10.693 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:06:10.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.693 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:10.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:10.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:06:10.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:06:10.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:06:10.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:06:10.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:06:10.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:06:10.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:06:10.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:06:10.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:06:10.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:06:10.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:06:10.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:06:10.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:06:10.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:06:10.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:06:10.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:06:10.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.698 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.698 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:06:10.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:06:10.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.698 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.698 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:06:10.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:06:10.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:06:10.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:06:10.699 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.699 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.699 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.699 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:10.699 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:10.700 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.891195404000001, 2023-10-08T07:06:10.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:06:10.700 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.700 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.700 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:10.700 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:10.700 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:10.700 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:06:10.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.700 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:10.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:10.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:10.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:06:10.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:06:10.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:06:10.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:06:10.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:06:10.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.703 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.703 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:06:10.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:06:10.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.703 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.703 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:06:10.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:06:10.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:06:10.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:06:10.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:06:10.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:06:10.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:06:10.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:06:10.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:06:10.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:06:10.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:06:10.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:06:10.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:06:10.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:06:10.706 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.706 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.706 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.707 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:10.707 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:10.707 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.891182395000001, 2023-10-08T07:06:10.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:10.707 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.707 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.707 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:10.707 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:10.707 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:10.707 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:10.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.707 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:10.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:10.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:10.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:10.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:10.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:10.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:10.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:10.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:10.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:10.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:10.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:10.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:10.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:10.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:10.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:10.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:10.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:10.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:10.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:10.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:10.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:10.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:10.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:10.713 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.713 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.713 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.713 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:10.713 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:10.714 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.891130343, 2023-10-08T07:06:10.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:10.714 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.714 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.714 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:10.714 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:10.714 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:10.714 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:10.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.714 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:10.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:10.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:10.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:10.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:10.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:10.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:10.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:10.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:10.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:10.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:10.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:10.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:10.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:10.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:10.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:10.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:10.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:10.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:10.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:10.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:10.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:10.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:10.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:10.720 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.720 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.720 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.721 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.721 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:10.721 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.345926515999999, 2023-10-08T07:06:10.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:06:10.721 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.721 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.721 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:10.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:10.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:06:10.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:06:10.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:06:10.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:06:10.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:06:10.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:06:10.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:10.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:06:10.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:06:10.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:06:10.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:10.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:06:10.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:06:10.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:06:10.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:06:10.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:06:10.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:06:10.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:06:10.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:06:10.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:06:10.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:06:10.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:06:10.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:06:10.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:06:10.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:06:10.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:06:10.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:10.734 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.734 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.735 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.735 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.735 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:10.735 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.345810038000003, 2023-10-08T07:06:10.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:10.735 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.735 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.735 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:10.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:10.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:10.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:10.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:10.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:10.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:10.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:10.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:10.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:10.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:10.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:10.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:10.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:10.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:10.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:10.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:10.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:10.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:10.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:10.742 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.743 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.743 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.743 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.743 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:10.743 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.345759710999999, 2023-10-08T07:06:10.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:10.743 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.743 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.743 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:10.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:10.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:10.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:10.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:10.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:10.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:10.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:10.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:10.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:10.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:10.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:10.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:10.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:10.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:10.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:10.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:10.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:10.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:10.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:10.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:10.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:10.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:10.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:10.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:10.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:10.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:10.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:10.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:10.750 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.750 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.750 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.751 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.751 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:10.751 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.345433866, 2023-10-08T07:06:10.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:10.751 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.751 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.751 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:10.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:10.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:10.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:10.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:10.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:10.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:10.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:10.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:10.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:10.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:10.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:10.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:10.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:10.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:10.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:10.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:10.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:10.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:10.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:10.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:10.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:10.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:10.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:10.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:10.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:10.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:10.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:10.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:10.758 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.758 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.758 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.758 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.758 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:10.758 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.345381341, 2023-10-08T07:06:10.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:10.758 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.758 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.759 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:10.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:10.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:10.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:10.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:10.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:10.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:10.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:10.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:10.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:10.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:10.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:10.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:10.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:10.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:10.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:10.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:10.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:10.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:10.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:10.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:10.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:10.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:10.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:10.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.764 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.765 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.765 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:10.765 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.345213366000003, 2023-10-08T07:06:10.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:10.765 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.765 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.765 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:10.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:10.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:10.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:10.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:10.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:10.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:10.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:10.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:10.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:10.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:10.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:10.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:10.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:10.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:10.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:10.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:10.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:10.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:10.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:10.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:10.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:10.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:10.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:10.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:10.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:10.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:10.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:10.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:10.772 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.772 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.772 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.772 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.772 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:10.772 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.345069068000001, 2023-10-08T07:06:10.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:10.773 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.773 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.773 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:10.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:10.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:10.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:10.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:10.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:10.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:10.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:10.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:10.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:10.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:10.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:10.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:10.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:10.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:10.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:10.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:10.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:10.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:10.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:10.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:10.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:10.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:10.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:10.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:10.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:10.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:10.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:10.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:10.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:10.779 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.779 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.779 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.780 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.780 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:10.780 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.344389556000003, 2023-10-08T07:06:10.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:10.780 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.780 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.780 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:10.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:10.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:10.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:10.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:10.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:10.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:10.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:10.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:10.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:10.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:10.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:10.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:10.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:10.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:10.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:10.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:10.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:10.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:10.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:10.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:10.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:10.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:10.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:10.786 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.786 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.786 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.787 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.787 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:10.787 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.344336286000001, 2023-10-08T07:06:10.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:10.787 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.787 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.787 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:10.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:10.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:10.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:10.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:10.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:10.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:10.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:10.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:10.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:10.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:10.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:10.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:10.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:10.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:10.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:10.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:10.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:10.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:10.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:10.793 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.793 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.793 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.793 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.793 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:10.794 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.344300439999998, 2023-10-08T07:06:10.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:10.794 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.794 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.794 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:10.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:10.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:10.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:10.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:10.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:10.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:10.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:10.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:10.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:10.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:10.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:10.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:10.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:10.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:10.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:10.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:10.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:10.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:10.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:10.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:10.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:10.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:10.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:10.800 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.800 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.800 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.800 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.800 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:10.800 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.344159908999998, 2023-10-08T07:06:10.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:10.800 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.800 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.801 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:10.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:10.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:10.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:10.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:10.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:10.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:10.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:10.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:10.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:10.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:10.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:10.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:10.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:10.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:10.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:10.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:10.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:10.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:10.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:10.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:10.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:10.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:10.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:10.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:10.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:10.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:10.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:10.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:10.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:10.807 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.807 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.807 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.808 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.808 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:10.808 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.343867586000002, 2023-10-08T07:06:10.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:10.808 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.808 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.808 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:10.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:10.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:10.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:10.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:10.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:10.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:10.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:10.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:10.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:10.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:10.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:10.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:10.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:10.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:10.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:10.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:10.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:10.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:10.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:10.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:10.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:10.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:10.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:10.814 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.814 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.814 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.815 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.815 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:10.815 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.343753943999999, 2023-10-08T07:06:10.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:10.815 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.815 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:10.815 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:10.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:10.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:10.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:10.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:10.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:10.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:10.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:10.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:10.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:10.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:10.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:10.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:10.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:10.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:10.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:10.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:10.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:10.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:10.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:10.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:10.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:10.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:10.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:10.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:10.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:10.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:10.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:10.821 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.821 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.821 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.821 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:10.821 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:10.821 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 37.342723720000002, 2023-10-08T07:06:10.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:10.821 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:10.821 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:10.822 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:10.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:10.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:10.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:10.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:10.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:10.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:10.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:10.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:10.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:10.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:10.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:10.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:10.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:10.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:10.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:10.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:10.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:10.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:10.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:10.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:10.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:10.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:10.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:10.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:10.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:10.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:10.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:10.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:10.826 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.826 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.826 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.826 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:10.826 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:10.826 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:10.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:10.828 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:10.827+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:10.929 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:10.929+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:10.938 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:10.967 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:10.967 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:10.967 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2023-10-08T07:06:10.967 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:10.977 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:11.030 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:11.030+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:11.056 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T07:06:11.103 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:11.104 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:11.104 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2023-10-08T07:06:11.104 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2023-10-08T07:06:11.104 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:11.114 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:11.157 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:11.158 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:11.157+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:11.177 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:11.205 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:11.207 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:11.207 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T07:06:11.207 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:11.233 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:11.231+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:11.240 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:11.240 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:11.252 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:11.333 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:11.333+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:11.391 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:11.391 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:11.402 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:11.444 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:11.444+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:11.534 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:11.533+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:11.569 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:11.570 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:11.579 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:11.635 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:11.635+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:11.706 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:11.706 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:11.717 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:11.736 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:11.735+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:11.837 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:11.835+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:11.863 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:11.863 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:11.874 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:11.958 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:11.957+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:12.038 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:12.037+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:12.046 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:12.046 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:12.054 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2023-10-08T07:06:12.057 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:12.141 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:12.140+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:12.229 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:12.229 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:12.240 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:12.240 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:12.239+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:12.340 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:12.340+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:12.379 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:12.379 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:12.389 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:12.441 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:12.441+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:12.516 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:12.516 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:12.526 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:12.543 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:12.542+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:12.644 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:12.643+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:12.653 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:12.653 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:12.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:12.745 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:12.744+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:12.803 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:12.804 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:12.814 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:12.846 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:12.846+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:12.941 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:12.941 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:12.949 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:12.948+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:12.951 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:13.049 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:13.049+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:13.118 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:13.118 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:13.129 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:13.173 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:13.172+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:13.221 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:13.251 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:13.250+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:13.275 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:13.275 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:13.285 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:13.371 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:13.370+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:13.453 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:13.452+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:13.455 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:13.459 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:13.459 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:13.460 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:13.460 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:13.460 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:13.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:13.492 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:13.528 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T07:06:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:13.554 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:13.553+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:13.644 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:13.644 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:13.644 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:13.644 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:13.644 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.645 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:13.645 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:13.645 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.870542225999998, 2023-10-08T07:06:13.645 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:06:13.645 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.645 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.645 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:13.645 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:13.645 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:13.645 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:06:13.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.646 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.646 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.646 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.646 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:13.646 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.646 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.646 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.646 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:13.646 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.647 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.647 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.647 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:13.647 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:06:13.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.647 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.647 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.647 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:06:13.647 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:06:13.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.647 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.647 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.648 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:06:13.648 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:06:13.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.648 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.649 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.649 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:06:13.649 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:06:13.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.649 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.649 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.649 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:06:13.649 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:06:13.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.650 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.650 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.650 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:06:13.650 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:06:13.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.650 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.650 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.650 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:06:13.650 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:06:13.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:06:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:06:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:06:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:06:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.652 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:06:13.652 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:06:13.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.652 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.652 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.652 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:06:13.652 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:06:13.652 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.652 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.652 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.653 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.653 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:13.653 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:13.653 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.870520679999998, 2023-10-08T07:06:13.653 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:06:13.653 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.653 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.653 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:13.654 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:13.654 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:13.654 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:06:13.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.654 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.654 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.654 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.654 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:13.654 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.654 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.654 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.655 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:13.655 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.655 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.655 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.655 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:13.655 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:06:13.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.655 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.655 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.655 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:06:13.656 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:06:13.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.656 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.656 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.656 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:06:13.656 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:06:13.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.656 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.656 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.656 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:06:13.656 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:06:13.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.657 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.657 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.657 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:06:13.657 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:06:13.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.657 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.657 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.657 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:06:13.657 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:06:13.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.657 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.657 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.658 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:06:13.658 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:06:13.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.658 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.658 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.658 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:06:13.658 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:06:13.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.658 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.658 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.658 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:06:13.658 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:06:13.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.659 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.659 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.659 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:06:13.659 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:06:13.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.659 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.659 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.659 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:06:13.659 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:06:13.659 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.870454086000002, 2023-10-08T07:06:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:06:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:13.660 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:13.661 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:13.661 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:06:13.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.662 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.662 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.662 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.662 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:13.662 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.662 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.663 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.663 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:13.663 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.663 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.663 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.663 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:06:13.663 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:06:13.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.663 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.663 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:06:13.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.665 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.665 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:06:13.665 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:06:13.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.665 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.665 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:06:13.665 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:06:13.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.665 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.666 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:06:13.666 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:06:13.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.666 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.666 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.666 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:06:13.666 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:06:13.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.666 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.666 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.667 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:06:13.667 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:06:13.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.667 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.667 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.667 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:06:13.667 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:06:13.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.667 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.667 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.667 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.870435190000002, 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.668 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:13.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.670 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.670 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:13.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:06:13.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.670 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.670 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:06:13.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:06:13.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.671 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.671 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:06:13.671 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:06:13.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.671 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.671 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:06:13.671 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:06:13.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.671 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:06:13.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.673 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.673 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.673 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:06:13.674 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:06:13.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.674 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.674 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:06:13.674 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:06:13.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.674 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.675 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:06:13.675 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:06:13.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.675 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.675 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.675 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:06:13.675 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:06:13.676 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.676 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.676 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.676 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.676 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:13.676 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:13.676 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.870422181000002, 2023-10-08T07:06:13.676 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:13.676 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.676 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.676 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:13.677 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:13.677 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:13.677 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:13.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.677 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.677 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.677 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.677 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:13.677 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.678 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.678 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.678 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:13.678 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.678 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.678 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.678 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:13.678 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:13.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.679 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.679 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:13.679 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:13.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.679 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.679 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:13.679 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:13.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.680 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.680 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.680 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:13.680 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:13.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.680 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.680 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.680 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:13.680 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:13.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.680 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.680 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:13.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:13.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.681 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.681 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:13.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:13.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.681 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.681 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:13.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:13.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.682 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.682 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.682 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:13.682 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:13.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.682 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.682 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.682 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:13.682 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:13.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.682 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.683 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.683 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:13.683 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:13.683 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.683 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.683 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.684 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:13.684 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:13.684 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.870370129000001, 2023-10-08T07:06:13.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:13.684 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.684 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.684 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:13.684 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:13.684 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:13.684 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:13.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.684 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:13.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:13.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:13.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:13.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:13.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:13.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:13.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:13.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:13.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:13.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:13.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:13.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.689 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:13.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:13.690 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.690 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.690 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.690 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.690 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:13.690 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.325166302, 2023-10-08T07:06:13.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:06:13.690 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:06:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:06:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:06:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:06:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:06:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:06:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:06:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:06:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:06:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:06:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:06:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:06:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:06:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:06:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:06:13.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:06:13.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:06:13.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:06:13.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:06:13.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:13.697 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.697 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.697 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.697 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.697 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:13.697 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.325049823999997, 2023-10-08T07:06:13.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:13.698 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.698 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.698 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:13.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:13.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:13.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:13.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:13.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:13.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:13.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:13.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:13.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:13.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:13.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:13.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.703 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:13.703 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:13.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:13.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:13.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:13.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:13.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:13.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:13.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:13.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:13.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:13.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:13.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:13.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:13.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:13.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:13.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:13.707 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.707 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.707 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.707 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.707 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.707 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:13.707 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.324999497, 2023-10-08T07:06:13.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:13.708 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.708 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.708 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:13.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:13.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:13.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:13.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:13.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:13.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:13.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:13.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:13.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:13.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:13.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:13.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:13.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:13.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:13.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:13.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:13.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:13.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:13.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:13.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:13.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:13.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:13.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:13.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:13.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:13.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:13.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:13.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:13.714 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.714 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.714 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.715 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.715 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:13.715 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.324673652000001, 2023-10-08T07:06:13.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:13.715 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.715 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.715 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:13.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:13.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:13.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:13.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:13.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:13.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:13.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:13.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:13.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:13.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:13.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:13.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:13.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:13.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.324621127, 2023-10-08T07:06:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.722 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:13.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.728 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.324453151999997, 2023-10-08T07:06:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:13.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:13.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:13.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:13.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:13.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:13.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:13.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:13.736 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.736 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.736 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.736 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.736 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:13.736 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.324308854000002, 2023-10-08T07:06:13.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:13.736 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.737 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.737 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:13.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:13.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:13.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:13.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:13.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:13.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:13.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:13.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:13.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:13.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:13.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:13.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:13.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:13.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:13.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:13.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:13.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:13.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:13.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:13.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:13.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:13.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:13.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:13.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:13.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:13.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:13.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:13.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:13.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:13.743 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.743 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.743 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.744 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.744 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:13.744 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.323629341999997, 2023-10-08T07:06:13.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:13.744 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.744 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.744 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:13.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:13.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:13.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:13.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:13.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:13.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:13.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:13.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:13.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:13.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:13.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:13.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:13.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:13.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:13.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:13.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:13.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:13.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.323576072000002, 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:13.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:13.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:13.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:13.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:13.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:13.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:13.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:13.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:13.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:13.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:13.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:13.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:13.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:13.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:13.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:13.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:13.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:13.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:13.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:13.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:13.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:13.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:13.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:13.760 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.760 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.760 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.760 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.760 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:13.760 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.323540225999999, 2023-10-08T07:06:13.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:13.761 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.761 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.761 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:13.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:13.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:13.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:13.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:13.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:13.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:13.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:13.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:13.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:13.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:13.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:13.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:13.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:13.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:13.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:13.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:13.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:13.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:13.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:13.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:13.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:13.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:13.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:13.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.767 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.767 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.767 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:13.767 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.323399694999999, 2023-10-08T07:06:13.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:13.767 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.767 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.767 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:13.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:13.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:13.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:13.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:13.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:13.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:13.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:13.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:13.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:13.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:13.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:13.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:13.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:13.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:13.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:13.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:13.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:13.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:13.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:13.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:13.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:13.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:13.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:13.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:13.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:13.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:13.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:13.774 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.774 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.774 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.774 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.774 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:13.775 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.323107372000003, 2023-10-08T07:06:13.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:13.775 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.775 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.775 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:13.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:13.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:13.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:13.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:13.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:13.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:13.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:13.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:13.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:13.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:13.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:13.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:13.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:13.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:13.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:13.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:13.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:13.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:13.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:13.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:13.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:13.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:13.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:13.781 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.781 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.781 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.781 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.781 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:13.781 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.32299373, 2023-10-08T07:06:13.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:13.781 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.781 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:13.782 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:13.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:13.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:13.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:13.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:13.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:13.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:13.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:13.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:13.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:13.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:13.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:13.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:13.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:13.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:13.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:13.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:13.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:13.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:13.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:13.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:13.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:13.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:13.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:13.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:13.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:13.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:13.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:13.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.787 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.787 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:13.788 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:13.788 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 40.321963506000003, 2023-10-08T07:06:13.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:13.788 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:13.788 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:13.788 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:13.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:13.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:13.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:13.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:13.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:13.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:13.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:13.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:13.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:13.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:13.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:13.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:13.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:13.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:13.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:13.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:13.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:13.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:13.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:13.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:13.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:13.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:13.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:13.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:13.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:13.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:13.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:13.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:13.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.792 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:13.792 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:13.792 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:13.794 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:13.794 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:13.793+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:13.895 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:13.894+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:13.933 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:13.933 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:13.933 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2023-10-08T07:06:13.934 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:13.944 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:13.995 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:13.995+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:14.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T07:06:14.071 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:14.071 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:14.071 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2023-10-08T07:06:14.071 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2023-10-08T07:06:14.071 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:14.081 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:14.096 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:14.096+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:14.197 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:14.197+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:14.210 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2023-10-08T07:06:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2023-10-08T07:06:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2023-10-08T07:06:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.210 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-10-08T07:06:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.893212284999997, 2023-10-08T07:06:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069404690000000003, 2023-10-08T07:06:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:14.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315211+0000", 2023-10-08T07:06:14.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:06:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315216+0000", 2023-10-08T07:06:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:06:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315229+0000", 2023-10-08T07:06:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.278e-05 2023-10-08T07:06:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315235+0000", 2023-10-08T07:06:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2023-10-08T07:06:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316390+0000", 2023-10-08T07:06:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011548179999999999 2023-10-08T07:06:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316410+0000", 2023-10-08T07:06:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0818999999999998e-05 2023-10-08T07:06:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322113+0000", 2023-10-08T07:06:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057026159999999998 2023-10-08T07:06:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322150+0000", 2023-10-08T07:06:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7401999999999999e-05 2023-10-08T07:06:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-10-08T07:06:14.217 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.435852515000001, 2023-10-08T07:06:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087059660000000007, 2023-10-08T07:06:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:06:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772604+0000", 2023-10-08T07:06:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.413e-05 2023-10-08T07:06:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772617+0000", 2023-10-08T07:06:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2595999999999999e-05 2023-10-08T07:06:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772624+0000", 2023-10-08T07:06:14.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2023-10-08T07:06:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772666+0000", 2023-10-08T07:06:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1925000000000003e-05 2023-10-08T07:06:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772685+0000", 2023-10-08T07:06:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9071000000000001e-05 2023-10-08T07:06:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781237+0000", 2023-10-08T07:06:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085519059999999997 2023-10-08T07:06:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781276+0000", 2023-10-08T07:06:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9161e-05 2023-10-08T07:06:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.222 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-10-08T07:06:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.435355860999998, 2023-10-08T07:06:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010997768, 2023-10-08T07:06:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773067+0000", 2023-10-08T07:06:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:06:14.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773071+0000", 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3819999999999997e-06 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773082+0000", 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0407e-05 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773087+0000", 2023-10-08T07:06:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:06:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775481+0000", 2023-10-08T07:06:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023941470000000001 2023-10-08T07:06:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775493+0000", 2023-10-08T07:06:14.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2126999999999999e-05 2023-10-08T07:06:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784021+0000", 2023-10-08T07:06:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085280589999999993 2023-10-08T07:06:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784064+0000", 2023-10-08T07:06:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.295e-05 2023-10-08T07:06:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:157 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'111, mlcod=11'105)", 2023-10-08T07:06:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.434935762999999, 2023-10-08T07:06:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010614554, 2023-10-08T07:06:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.229 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:14.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773487+0000", 2023-10-08T07:06:14.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:06:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773492+0000", 2023-10-08T07:06:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2249999999999999e-06 2023-10-08T07:06:14.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773503+0000", 2023-10-08T07:06:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0271e-05 2023-10-08T07:06:14.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773509+0000", 2023-10-08T07:06:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5470000000000002e-06 2023-10-08T07:06:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775801+0000", 2023-10-08T07:06:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022918790000000001 2023-10-08T07:06:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775822+0000", 2023-10-08T07:06:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1486000000000001e-05 2023-10-08T07:06:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784066+0000", 2023-10-08T07:06:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082432089999999996 2023-10-08T07:06:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784101+0000", 2023-10-08T07:06:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5383999999999999e-05 2023-10-08T07:06:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:158 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'112, mlcod=11'106)", 2023-10-08T07:06:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.434458665999998, 2023-10-08T07:06:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010172001999999999, 2023-10-08T07:06:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.240 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:14.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.82e-07 2023-10-08T07:06:14.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773990+0000", 2023-10-08T07:06:14.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2023-10-08T07:06:14.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774001+0000", 2023-10-08T07:06:14.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0873000000000001e-05 2023-10-08T07:06:14.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774006+0000", 2023-10-08T07:06:14.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0900000000000004e-06 2023-10-08T07:06:14.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776145+0000", 2023-10-08T07:06:14.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021389759999999999 2023-10-08T07:06:14.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776165+0000", 2023-10-08T07:06:14.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9548e-05 2023-10-08T07:06:14.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.247 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.247 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784102+0000", 2023-10-08T07:06:14.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007937342 2023-10-08T07:06:14.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784136+0000", 2023-10-08T07:06:14.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3331000000000003e-05 2023-10-08T07:06:14.249 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.249 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.249 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.249 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:159 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'113, mlcod=11'106)", 2023-10-08T07:06:14.250 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:14.250 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.433925707999997, 2023-10-08T07:06:14.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096667119999999992, 2023-10-08T07:06:14.250 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.250 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.251 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:14.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:14.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:14.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:06:14.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774501+0000", 2023-10-08T07:06:14.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1529999999999999e-06 2023-10-08T07:06:14.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774511+0000", 2023-10-08T07:06:14.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:06:14.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774533+0000", 2023-10-08T07:06:14.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2348999999999999e-05 2023-10-08T07:06:14.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776608+0000", 2023-10-08T07:06:14.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002074799 2023-10-08T07:06:14.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776627+0000", 2023-10-08T07:06:14.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8632999999999999e-05 2023-10-08T07:06:14.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784138+0000", 2023-10-08T07:06:14.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075110819999999997 2023-10-08T07:06:14.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784163+0000", 2023-10-08T07:06:14.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5425000000000001e-05 2023-10-08T07:06:14.258 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.258 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.258 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.259 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:160 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'114, mlcod=11'106)", 2023-10-08T07:06:14.259 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:14.259 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.433290526, 2023-10-08T07:06:14.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090478150000000007, 2023-10-08T07:06:14.260 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.260 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.260 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:14.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:14.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775133+0000", 2023-10-08T07:06:14.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2023-10-08T07:06:14.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775150+0000", 2023-10-08T07:06:14.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6206e-05 2023-10-08T07:06:14.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775173+0000", 2023-10-08T07:06:14.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.351e-05 2023-10-08T07:06:14.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775187+0000", 2023-10-08T07:06:14.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4396000000000001e-05 2023-10-08T07:06:14.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776909+0000", 2023-10-08T07:06:14.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017220429999999999 2023-10-08T07:06:14.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776929+0000", 2023-10-08T07:06:14.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9313e-05 2023-10-08T07:06:14.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784164+0000", 2023-10-08T07:06:14.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072352340000000001 2023-10-08T07:06:14.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.264 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.264 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:14.264 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526e-05 2023-10-08T07:06:14.264 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.264 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.264 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.264 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.264 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.265 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:161 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'115, mlcod=11'106)", 2023-10-08T07:06:14.265 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:14.265 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.432611637000001, 2023-10-08T07:06:14.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083874480000000005, 2023-10-08T07:06:14.265 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.265 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.265 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.265 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.265 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.265 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:14.265 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:14.266 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.266 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.266 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.266 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.266 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:14.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:06:14.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775837+0000", 2023-10-08T07:06:14.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6081e-05 2023-10-08T07:06:14.267 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.267 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.267 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.267 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775849+0000", 2023-10-08T07:06:14.267 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:06:14.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775854+0000", 2023-10-08T07:06:14.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1490000000000002e-06 2023-10-08T07:06:14.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.268 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.268 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777220+0000", 2023-10-08T07:06:14.268 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001365174 2023-10-08T07:06:14.268 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.268 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777232+0000", 2023-10-08T07:06:14.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2293000000000001e-05 2023-10-08T07:06:14.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:14.269 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069481450000000002 2023-10-08T07:06:14.269 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.269 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.269 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.269 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784198+0000", 2023-10-08T07:06:14.270 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2023-10-08T07:06:14.270 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.270 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.270 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.270 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.270 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.271 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:162 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'116, mlcod=11'106)", 2023-10-08T07:06:14.271 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:14.271 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.431987235000001, 2023-10-08T07:06:14.271 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077785969999999999, 2023-10-08T07:06:14.271 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.271 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.271 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.271 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.271 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.271 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:14.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:14.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.272 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.272 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.272 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776436+0000", 2023-10-08T07:06:14.272 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:06:14.272 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776440+0000", 2023-10-08T07:06:14.273 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2629999999999997e-06 2023-10-08T07:06:14.273 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.273 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.273 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.273 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776451+0000", 2023-10-08T07:06:14.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1385e-05 2023-10-08T07:06:14.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.274 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.274 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776456+0000", 2023-10-08T07:06:14.274 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9919999999999998e-06 2023-10-08T07:06:14.274 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.274 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777629+0000", 2023-10-08T07:06:14.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001173297 2023-10-08T07:06:14.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777650+0000", 2023-10-08T07:06:14.275 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0126e-05 2023-10-08T07:06:14.275 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.275 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.275 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.275 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784199+0000", 2023-10-08T07:06:14.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006548908 2023-10-08T07:06:14.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.276 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.276 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:14.276 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5071e-05 2023-10-08T07:06:14.276 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.276 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.276 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.276 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.276 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.276 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:163 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'117, mlcod=11'106)", 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.431344828, 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071515490000000001, 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.277 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:14.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777078+0000", 2023-10-08T07:06:14.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4400000000000001e-07 2023-10-08T07:06:14.278 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.278 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.278 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.278 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777082+0000", 2023-10-08T07:06:14.278 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.732e-06 2023-10-08T07:06:14.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777095+0000", 2023-10-08T07:06:14.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3749e-05 2023-10-08T07:06:14.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.279 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.279 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.279 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777100+0000", 2023-10-08T07:06:14.279 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.634e-06 2023-10-08T07:06:14.279 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777944+0000", 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00084377599999999997 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777957+0000", 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.276e-05 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.280 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:14.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006257617 2023-10-08T07:06:14.281 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.281 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.281 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.281 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784229+0000", 2023-10-08T07:06:14.281 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4837e-05 2023-10-08T07:06:14.281 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.282 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.282 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.282 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.282 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.282 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:164 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'118, mlcod=11'106)", 2023-10-08T07:06:14.282 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:14.283 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 51.430763489, 2023-10-08T07:06:14.283 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093104280000000008, 2023-10-08T07:06:14.283 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.283 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.283 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.283 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.283 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:14.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.284 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.284 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.284 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:14.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.284 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.285 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:14.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2e-07 2023-10-08T07:06:14.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777713+0000", 2023-10-08T07:06:14.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4079999999999997e-05 2023-10-08T07:06:14.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777724+0000", 2023-10-08T07:06:14.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0652999999999999e-05 2023-10-08T07:06:14.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777729+0000", 2023-10-08T07:06:14.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2050000000000001e-06 2023-10-08T07:06:14.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778177+0000", 2023-10-08T07:06:14.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044763499999999999 2023-10-08T07:06:14.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778195+0000", 2023-10-08T07:06:14.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8125e-05 2023-10-08T07:06:14.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786935+0000", 2023-10-08T07:06:14.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087396049999999992 2023-10-08T07:06:14.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.290 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786969+0000", 2023-10-08T07:06:14.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4604999999999998e-05 2023-10-08T07:06:14.291 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.291 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.291 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.292 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.292 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:14.292 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 40.892875058999998, 2023-10-08T07:06:14.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013957681, 2023-10-08T07:06:14.292 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.292 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.293 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:14.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:14.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315552+0000", 2023-10-08T07:06:14.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.152e-06 2023-10-08T07:06:14.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315568+0000", 2023-10-08T07:06:14.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5301000000000001e-05 2023-10-08T07:06:14.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315583+0000", 2023-10-08T07:06:14.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5826000000000001e-05 2023-10-08T07:06:14.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315598+0000", 2023-10-08T07:06:14.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4953999999999999e-05 2023-10-08T07:06:14.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317200+0000", 2023-10-08T07:06:14.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016014950000000001 2023-10-08T07:06:14.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317351+0000", 2023-10-08T07:06:14.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015081400000000001 2023-10-08T07:06:14.296 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317540+0000", 2023-10-08T07:06:14.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000189557 2023-10-08T07:06:14.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:14.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322281+0000", 2023-10-08T07:06:14.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047409599999999998 2023-10-08T07:06:14.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329404+0000", 2023-10-08T07:06:14.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071225460000000004 2023-10-08T07:06:14.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329459+0000", 2023-10-08T07:06:14.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5016999999999999e-05 2023-10-08T07:06:14.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329505+0000", 2023-10-08T07:06:14.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059000000000001e-05 2023-10-08T07:06:14.298 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.299 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.299 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.299 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.299 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:14.299 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 40.89279209, 2023-10-08T07:06:14.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015617259, 2023-10-08T07:06:14.299 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.300 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.300 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:14.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:14.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315631+0000", 2023-10-08T07:06:14.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2023-10-08T07:06:14.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315636+0000", 2023-10-08T07:06:14.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1019999999999996e-06 2023-10-08T07:06:14.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315646+0000", 2023-10-08T07:06:14.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0056e-05 2023-10-08T07:06:14.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315654+0000", 2023-10-08T07:06:14.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7810000000000005e-06 2023-10-08T07:06:14.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318626+0000", 2023-10-08T07:06:14.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00297183 2023-10-08T07:06:14.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319450+0000", 2023-10-08T07:06:14.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082440400000000004 2023-10-08T07:06:14.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319924+0000", 2023-10-08T07:06:14.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047403099999999997 2023-10-08T07:06:14.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:14.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322475+0000", 2023-10-08T07:06:14.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002550442 2023-10-08T07:06:14.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.307 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.307 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.307 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331142+0000", 2023-10-08T07:06:14.307 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086669030000000001 2023-10-08T07:06:14.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.308 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.308 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331217+0000", 2023-10-08T07:06:14.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5606999999999996e-05 2023-10-08T07:06:14.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331247+0000", 2023-10-08T07:06:14.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:06:14.309 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.309 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.309 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.310 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:15 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.310 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:14.310 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 40.891628650999998, 2023-10-08T07:06:14.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012716055, 2023-10-08T07:06:14.310 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.310 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.311 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:14.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:14.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:14.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8599999999999997e-07 2023-10-08T07:06:14.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316805+0000", 2023-10-08T07:06:14.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0475000000000001e-05 2023-10-08T07:06:14.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316817+0000", 2023-10-08T07:06:14.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.226e-05 2023-10-08T07:06:14.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316828+0000", 2023-10-08T07:06:14.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1090999999999999e-05 2023-10-08T07:06:14.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317025+0000", 2023-10-08T07:06:14.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019711500000000001 2023-10-08T07:06:14.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317244+0000", 2023-10-08T07:06:14.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021908999999999999 2023-10-08T07:06:14.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.314 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.314 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317436+0000", 2023-10-08T07:06:14.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019164900000000001 2023-10-08T07:06:14.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:14.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321493+0000", 2023-10-08T07:06:14.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040573190000000002 2023-10-08T07:06:14.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329275+0000", 2023-10-08T07:06:14.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077820950000000002 2023-10-08T07:06:14.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329457+0000", 2023-10-08T07:06:14.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018165600000000001 2023-10-08T07:06:14.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329510+0000", 2023-10-08T07:06:14.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2519000000000003e-05 2023-10-08T07:06:14.316 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.316 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.316 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.316 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:27 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.317 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:14.317 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 40.891567860000002, 2023-10-08T07:06:14.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015441417000000001, 2023-10-08T07:06:14.317 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.317 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.317 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:14.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:14.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316855+0000", 2023-10-08T07:06:14.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:14.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316861+0000", 2023-10-08T07:06:14.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6210000000000001e-06 2023-10-08T07:06:14.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316869+0000", 2023-10-08T07:06:14.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.225e-06 2023-10-08T07:06:14.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.319 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.319 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316878+0000", 2023-10-08T07:06:14.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8799999999999997e-06 2023-10-08T07:06:14.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319969+0000", 2023-10-08T07:06:14.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030906689999999999 2023-10-08T07:06:14.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320072+0000", 2023-10-08T07:06:14.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103458 2023-10-08T07:06:14.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320631+0000", 2023-10-08T07:06:14.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055936099999999997 2023-10-08T07:06:14.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:14.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322686+0000", 2023-10-08T07:06:14.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020545899999999998 2023-10-08T07:06:14.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332244+0000", 2023-10-08T07:06:14.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095578690000000001 2023-10-08T07:06:14.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332274+0000", 2023-10-08T07:06:14.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0527000000000001e-05 2023-10-08T07:06:14.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332296+0000", 2023-10-08T07:06:14.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1359999999999999e-05 2023-10-08T07:06:14.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.323 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.323 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.323 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:14.323 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 40.891531270999998, 2023-10-08T07:06:14.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014502582, 2023-10-08T07:06:14.323 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.323 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.324 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:14.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.324 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.324 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:14.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316892+0000", 2023-10-08T07:06:14.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:06:14.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316896+0000", 2023-10-08T07:06:14.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9140000000000001e-06 2023-10-08T07:06:14.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316904+0000", 2023-10-08T07:06:14.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1170000000000004e-06 2023-10-08T07:06:14.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316911+0000", 2023-10-08T07:06:14.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:06:14.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320938+0000", 2023-10-08T07:06:14.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040269959999999997 2023-10-08T07:06:14.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321023+0000", 2023-10-08T07:06:14.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5420000000000005e-05 2023-10-08T07:06:14.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321157+0000", 2023-10-08T07:06:14.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013383700000000001 2023-10-08T07:06:14.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:14.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322742+0000", 2023-10-08T07:06:14.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015851249999999999 2023-10-08T07:06:14.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331290+0000", 2023-10-08T07:06:14.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085483190000000004 2023-10-08T07:06:14.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331348+0000", 2023-10-08T07:06:14.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7630999999999998e-05 2023-10-08T07:06:14.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.329 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.329 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331394+0000", 2023-10-08T07:06:14.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5534999999999997e-05 2023-10-08T07:06:14.329 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.329 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.329 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.330 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.330 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:14.330 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 40.891502783, 2023-10-08T07:06:14.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015363402, 2023-10-08T07:06:14.330 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.330 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.330 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:14.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:14.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316920+0000", 2023-10-08T07:06:14.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2023-10-08T07:06:14.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316923+0000", 2023-10-08T07:06:14.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2169999999999999e-06 2023-10-08T07:06:14.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316930+0000", 2023-10-08T07:06:14.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:06:14.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316938+0000", 2023-10-08T07:06:14.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:06:14.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322217+0000", 2023-10-08T07:06:14.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052793680000000004 2023-10-08T07:06:14.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322295+0000", 2023-10-08T07:06:14.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7621999999999996e-05 2023-10-08T07:06:14.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322411+0000", 2023-10-08T07:06:14.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000116297 2023-10-08T07:06:14.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.334 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:14.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323187+0000", 2023-10-08T07:06:14.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077583700000000003 2023-10-08T07:06:14.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332224+0000", 2023-10-08T07:06:14.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090370980000000004 2023-10-08T07:06:14.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332261+0000", 2023-10-08T07:06:14.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6464999999999997e-05 2023-10-08T07:06:14.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332283+0000", 2023-10-08T07:06:14.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2124e-05 2023-10-08T07:06:14.336 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.336 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.336 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.336 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.336 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:14.336 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 40.890379598999999, 2023-10-08T07:06:14.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014463023, 2023-10-08T07:06:14.336 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.337 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.337 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:14.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:14.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318044+0000", 2023-10-08T07:06:14.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1000000000000001e-06 2023-10-08T07:06:14.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318057+0000", 2023-10-08T07:06:14.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2860000000000001e-05 2023-10-08T07:06:14.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318067+0000", 2023-10-08T07:06:14.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0638999999999999e-05 2023-10-08T07:06:14.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318090+0000", 2023-10-08T07:06:14.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2889000000000001e-05 2023-10-08T07:06:14.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320985+0000", 2023-10-08T07:06:14.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028951279999999999 2023-10-08T07:06:14.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321126+0000", 2023-10-08T07:06:14.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014045600000000001 2023-10-08T07:06:14.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321798+0000", 2023-10-08T07:06:14.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067266600000000004 2023-10-08T07:06:14.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:14.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323135+0000", 2023-10-08T07:06:14.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013368589999999999 2023-10-08T07:06:14.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332445+0000", 2023-10-08T07:06:14.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093094419999999994 2023-10-08T07:06:14.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:14.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332482+0000", 2023-10-08T07:06:14.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:14.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332506+0000", 2023-10-08T07:06:14.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3649e-05 2023-10-08T07:06:14.343 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.343 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.343 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.343 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.344 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:14.344 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 40.890311089999997, 2023-10-08T07:06:14.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011597616999999999, 2023-10-08T07:06:14.344 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.344 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:14.344 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.344 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:14.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:14.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318112+0000", 2023-10-08T07:06:14.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2299999999999999e-07 2023-10-08T07:06:14.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318117+0000", 2023-10-08T07:06:14.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1170000000000003e-06 2023-10-08T07:06:14.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318127+0000", 2023-10-08T07:06:14.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0129000000000001e-05 2023-10-08T07:06:14.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318136+0000", 2023-10-08T07:06:14.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3610000000000001e-06 2023-10-08T07:06:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101062 2023-10-08T07:06:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318422+0000", 2023-10-08T07:06:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018560500000000001 2023-10-08T07:06:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329709+0000", 2023-10-08T07:06:14.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01128642 2023-10-08T07:06:14.348 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.348 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.348 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.348 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.348 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:14.348 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 40.890271970000001, 2023-10-08T07:06:14.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088267940000000007, 2023-10-08T07:06:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:14.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:14.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:14.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318151+0000", 2023-10-08T07:06:14.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:06:14.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:14.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318154+0000", 2023-10-08T07:06:14.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9529999999999999e-06 2023-10-08T07:06:14.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:14.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318161+0000", 2023-10-08T07:06:14.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.126e-06 2023-10-08T07:06:14.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318167+0000", 2023-10-08T07:06:14.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2169999999999999e-06 2023-10-08T07:06:14.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:14.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319711+0000", 2023-10-08T07:06:14.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015438769999999999 2023-10-08T07:06:14.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:14.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319864+0000", 2023-10-08T07:06:14.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015264799999999999 2023-10-08T07:06:14.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:14.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:14.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:14.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.326977+0000", 2023-10-08T07:06:14.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071133890000000003 2023-10-08T07:06:14.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.353 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.353 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:14.353 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:14.353 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:14.355 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:14.355 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:14.353+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:14.455 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:14.455+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:14.494 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:14.494 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:14.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:14.556 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:14.555+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:14.656 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:14.656+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:14.672 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:14.672 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:14.672 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:14.673 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:14.673 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:14.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:14.683 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T07:06:14.683 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T07:06:14.683 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2023-10-08T07:06:14.683 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-10-08T07:06:14.683 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-10-08T07:06:14.683 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2023-10-08T07:06:14.757 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:14.757+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:14.812 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:14.812 INFO:teuthology.orchestra.run.smithi086.stdout: "success": "" 2023-10-08T07:06:14.812 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:14.852 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:14.852 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:14.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:14.852 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:14.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.852 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.853 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:14.853 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.533996059000003, 2023-10-08T07:06:14.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:14.853 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.853 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.853 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:14.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:14.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:14.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:14.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:14.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:14.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:14.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:14.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:14.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:14.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:14.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:14.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:14.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:14.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:14.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:14.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:14.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:14.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:14.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:14.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:14.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:14.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:14.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:14.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:14.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:14.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.859 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.859 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.860 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:14.860 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.533922275000002, 2023-10-08T07:06:14.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:14.860 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.860 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.860 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:14.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:14.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:14.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:14.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:14.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:14.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:14.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:14.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:14.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:14.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:14.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:14.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:14.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:14.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:14.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:14.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:14.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:14.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:14.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:14.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:14.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:14.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:14.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:14.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.533859098999997, 2023-10-08T07:06:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.866 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.867 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:14.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:14.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:14.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:14.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:14.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:14.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:14.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:14.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:14.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:14.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:14.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:14.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:14.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:14.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:14.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:14.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:14.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:14.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:14.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:14.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.873 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.873 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.873 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:14.873 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.533824752999998, 2023-10-08T07:06:14.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:14.874 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.874 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.874 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:14.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:14.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:14.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:14.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:14.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:14.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:14.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:14.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:14.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:14.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:14.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:14.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:14.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:14.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:14.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:14.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:14.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:14.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:14.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:14.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:14.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:14.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:14.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:14.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:14.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:14.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:14.880 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.881 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.881 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.881 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.881 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:14.881 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.533334527999997, 2023-10-08T07:06:14.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:14.881 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.881 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.881 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:14.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:14.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:14.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:14.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:14.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:14.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:14.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:14.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:14.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:14.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:14.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:14.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:14.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:14.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:14.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:14.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:14.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:14.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:14.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:14.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:14.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:14.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:14.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:14.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:14.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:14.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.887 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.889 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.889 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:14.889 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.533293950999997, 2023-10-08T07:06:14.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:14.889 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.889 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.889 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:14.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:14.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:14.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:14.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:14.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:14.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:14.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:14.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:14.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:14.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:14.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:14.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:14.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:14.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:14.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:14.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:14.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:14.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:14.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:14.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:14.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:14.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:14.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:14.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:14.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:14.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.895 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.895 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.895 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:14.896 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.533256381999998, 2023-10-08T07:06:14.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:14.896 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.896 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:14.896 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:14.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:14.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:14.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:14.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:14.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:14.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:14.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:14.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:14.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:14.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:14.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:14.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:14.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:14.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:14.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:14.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.901 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.901 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.901 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:14.901 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.533188942000002, 2023-10-08T07:06:14.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:14.901 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.901 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:14.902 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:14.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:14.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:14.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:14.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:14.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:14.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:14.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:14.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:14.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:14.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:14.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:14.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:14.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:14.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:14.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:14.905 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.905 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.906 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:14.906 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:14.906 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.533159300000001, 2023-10-08T07:06:14.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:14.906 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.906 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:14.906 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:14.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:14.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:14.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:14.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:14.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:14.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:14.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:14.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:14.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:14.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:14.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:14.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.911 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.912 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:14.912 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:14.912 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.527418738999998, 2023-10-08T07:06:14.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:14.912 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.912 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:14.912 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:14.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:14.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:14.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:14.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:14.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:14.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:14.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:14.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.526969399000002, 2023-10-08T07:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.916 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:14.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:14.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:14.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:14.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:14.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:14.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:14.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:14.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:14.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:14.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:14.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:14.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:14.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:14.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:14.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.921 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.922 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:14.922 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:14.922 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.526173509000003, 2023-10-08T07:06:14.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:14.922 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.922 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.922 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:14.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:14.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:14.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:14.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:14.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:14.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:14.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:14.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:14.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:14.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:14.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:14.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:14.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:14.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:14.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:14.927 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.927 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.927 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.928 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:14.928 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:14.928 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.526058157999998, 2023-10-08T07:06:14.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:14.928 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.928 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.928 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:14.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:14.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:14.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:14.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:14.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:14.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:14.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:14.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:14.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:14.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:14.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:14.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:14.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:14.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:14.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:14.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:14.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:14.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:14.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.932 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.520943592000002, 2023-10-08T07:06:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:14.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:14.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:14.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:14.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:14.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:14.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:14.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:14.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:14.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:14.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:14.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:14.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:14.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:14.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:14.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:14.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:14.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:14.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:14.938 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.938 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.938 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.938 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:14.938 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:14.938 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.520832599999999, 2023-10-08T07:06:14.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:14.938 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.938 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:14.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:14.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:14.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:14.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:14.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:14.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:14.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:14.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:14.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:14.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:14.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:14.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:14.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:14.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:14.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:14.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:14.943 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.943 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.943 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.943 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:14.943 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:14.943 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.520408158999999, 2023-10-08T07:06:14.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:14.943 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:14.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:14.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:14.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:14.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:14.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:14.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:14.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:14.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:14.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:14.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:14.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:14.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:14.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:14.948 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.948 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.948 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.948 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:14.948 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:14.948 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.520261023000003, 2023-10-08T07:06:14.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:14.948 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.948 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:14.948 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:14.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:14.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:14.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:14.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:14.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:14.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:14.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:14.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.448962754, 2023-10-08T07:06:14.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:14.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:14.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:14.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:14.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:14.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:14.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:14.958 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.958 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.958 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.959 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:14.959 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:14.959 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.447169170000002, 2023-10-08T07:06:14.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:14.959 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.959 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:14.959 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:14.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:14.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:14.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:14.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:14.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:14.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:14.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:14.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:14.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:14.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:14.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:14.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:14.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.963 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.963 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:14.963 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:14.963 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.448579500000001, 2023-10-08T07:06:14.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:14.964 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:14.964 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:14.964 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:14.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:14.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:14.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:14.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:14.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:14.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:14.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:14.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:14.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:14.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:14.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:14.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:14.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:14.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:14.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:14.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:14.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:14.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:14.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:14.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:14.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:14.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:14.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:14.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:14.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:14.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:14.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:14.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:14.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:14.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:14.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:14.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:14.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:14.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:14.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.969 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:14.969 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:14.970 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:14.971 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:14.972 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:14.970+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2023-10-08T07:06:15.071 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:15.071+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:15.117 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:15.118 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:15.118 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:15.118 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:15.128 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:15.172 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:15.171+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:15.260 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:15.261 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:15.261 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:15.261 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:15.261 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:15.271 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:15.272 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:15.272+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:15.373 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:15.373+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:15.405 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:15.406 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:15.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:15.406 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:15.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.406 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:15.406 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:15.406 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 52.631904652999999, 2023-10-08T07:06:15.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:06:15.406 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.406 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.406 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:15.407 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:15.407 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:15.407 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:06:15.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.407 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:15.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:15.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:15.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:06:15.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:06:15.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:06:15.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:06:15.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:06:15.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:06:15.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:06:15.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:06:15.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:06:15.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:06:15.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:06:15.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:06:15.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:06:15.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:06:15.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:06:15.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:06:15.412 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.412 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.412 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.413 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:15.413 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:15.413 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 52.631883107, 2023-10-08T07:06:15.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:06:15.413 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.413 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.413 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:15.413 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:15.413 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:15.413 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:06:15.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.414 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:15.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:15.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:15.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:06:15.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:06:15.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:06:15.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:06:15.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:06:15.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:06:15.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:06:15.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:06:15.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:06:15.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:06:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:06:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:06:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:06:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:06:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:06:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:06:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:06:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.419 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:15.420 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:15.420 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 52.631816512999997, 2023-10-08T07:06:15.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:06:15.420 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.420 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.420 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:15.420 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:15.420 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:15.420 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:06:15.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.420 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:15.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:15.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:06:15.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:06:15.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:06:15.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:06:15.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:06:15.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:06:15.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:06:15.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:06:15.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:06:15.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:06:15.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:06:15.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:06:15.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:06:15.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:06:15.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:06:15.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:06:15.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:06:15.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:06:15.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:06:15.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:06:15.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:06:15.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:06:15.426 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.426 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.426 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.427 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:15.427 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:15.427 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 52.631797616999997, 2023-10-08T07:06:15.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:06:15.427 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.427 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.427 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:15.427 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:15.428 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:15.428 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:06:15.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.428 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:15.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:15.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:15.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:06:15.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:06:15.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:06:15.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:06:15.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:06:15.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:06:15.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:06:15.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:06:15.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:06:15.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:06:15.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:06:15.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:06:15.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:06:15.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:06:15.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:06:15.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:06:15.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:06:15.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:06:15.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:06:15.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:06:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:06:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 52.631784607999997, 2023-10-08T07:06:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:15.435 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.435 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.435 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:15.435 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:15.435 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:15.435 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:15.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.435 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:15.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:15.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:15.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:15.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:15.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:15.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:15.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:15.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:15.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:15.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:15.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:15.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:15.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:15.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:15.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:15.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:15.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:15.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:15.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:15.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:15.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:15.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:15.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:15.441 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.441 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.441 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.441 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:15.442 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:15.442 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 52.631732556000003, 2023-10-08T07:06:15.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:15.442 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.442 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.442 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:15.442 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:15.442 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:15.442 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:15.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.442 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:15.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:15.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:15.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:15.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:15.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:15.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:15.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:15.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:15.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:15.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:15.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:15.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:15.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:15.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:15.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:15.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:15.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:15.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:15.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:15.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:15.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:15.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:15.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:15.448 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.448 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.448 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.449 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.449 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:15.449 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.086528729000001, 2023-10-08T07:06:15.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:06:15.449 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.449 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.449 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:15.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:15.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:06:15.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:06:15.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:06:15.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:06:15.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:06:15.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:06:15.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:15.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:06:15.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:06:15.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:06:15.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:15.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:06:15.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:06:15.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:06:15.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:06:15.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:06:15.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:06:15.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:06:15.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:06:15.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:06:15.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:06:15.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:06:15.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:06:15.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:06:15.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:06:15.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:06:15.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:15.457 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.458 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.458 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.458 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.458 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:15.458 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.086412250999999, 2023-10-08T07:06:15.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:15.458 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.458 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.458 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:15.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:15.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:15.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:15.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:15.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:15.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:15.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:15.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:15.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:15.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:15.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:15.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.462 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:15.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:15.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:15.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:15.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:15.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:15.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:15.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:15.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:15.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:15.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:15.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:15.465 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.465 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.465 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.466 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.466 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:15.466 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.086361924000002, 2023-10-08T07:06:15.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:15.466 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.466 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.466 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:15.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:15.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:15.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:15.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:15.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:15.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:15.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:15.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:15.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:15.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:15.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:15.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:15.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:15.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:15.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:15.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:15.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:15.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:15.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:15.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:15.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:15.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:15.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:15.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:15.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:15.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:15.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:15.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:15.472 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.473 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.473 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.473 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.473 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:15.473 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.086036079000003, 2023-10-08T07:06:15.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:15.473 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.473 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.474 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:15.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:15.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:15.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:15.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:15.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:15.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:15.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:15.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:15.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:15.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:15.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:15.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:15.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:15.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:15.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:15.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:15.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:15.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:15.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:15.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:15.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:15.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:15.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:15.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:15.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:15.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:15.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:15.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:15.480 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.480 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.480 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.481 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.481 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:15.481 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.085983554000002, 2023-10-08T07:06:15.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:15.481 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.481 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.481 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:15.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:15.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:15.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:15.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.483 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:15.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:15.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.483 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:15.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:15.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:15.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:15.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:15.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:15.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:15.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:15.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:15.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:15.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:15.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:15.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:15.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:15.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:15.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:15.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:15.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:15.488 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.488 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.488 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.489 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.489 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:15.489 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.085815578999998, 2023-10-08T07:06:15.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:15.489 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.489 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.489 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:15.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:15.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:15.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:15.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:15.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:15.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:15.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:15.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:15.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:15.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:15.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:15.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:15.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:15.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:15.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:15.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:15.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:15.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:15.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:15.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:15.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:15.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:15.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:15.496 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.496 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.496 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.496 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.496 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:15.496 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.085671281000003, 2023-10-08T07:06:15.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:15.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:15.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:15.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:15.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:15.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:15.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:15.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:15.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:15.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:15.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:15.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:15.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:15.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:15.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:15.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:15.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:15.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:15.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:15.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:15.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:15.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:15.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:15.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:15.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:15.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:15.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.503 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.503 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:15.503 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:15.503 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.503 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.503 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.503 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.503 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:15.504 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.084991768999998, 2023-10-08T07:06:15.504 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:15.504 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.504 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.504 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.504 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.504 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:15.504 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.504 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:15.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:15.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:15.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:15.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:15.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:15.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:15.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:15.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:15.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:15.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:15.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:15.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:15.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:15.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:15.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:15.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:15.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:15.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:15.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:15.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:15.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:15.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:15.509 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.509 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.510 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.510 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.510 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:15.510 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.084938499000003, 2023-10-08T07:06:15.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:15.510 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.510 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.510 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.511 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:15.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.511 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.511 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.511 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:15.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.511 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.511 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.511 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:15.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:15.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:15.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:15.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:15.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:15.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:15.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:15.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:15.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:15.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:15.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:15.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:15.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:15.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:15.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:15.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.084902653, 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.516 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:15.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:15.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:15.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:15.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:15.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:15.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:15.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:15.522 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.522 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.522 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.522 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.084762122000001, 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:15.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:15.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:15.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:15.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.526 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.526 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:15.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:15.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.526 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:15.526 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:15.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:15.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.526 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:15.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:15.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:15.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:15.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:15.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:15.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:15.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:15.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:15.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:15.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:15.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:15.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:15.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:15.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:15.529 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.529 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.529 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.530 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.530 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:15.530 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.084469798999997, 2023-10-08T07:06:15.530 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:15.530 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.530 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.530 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.530 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.530 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:15.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.531 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.531 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.531 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:15.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.531 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.531 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.531 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:15.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:15.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:15.532 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:15.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:15.532 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:15.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.533 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:15.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:15.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.533 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.533 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.533 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:15.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:15.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.533 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.533 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.533 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:15.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:15.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.534 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.534 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.534 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:15.534 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:15.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.534 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.534 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.534 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:15.534 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:15.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.534 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:15.535 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:15.536 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.536 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.536 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.536 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.536 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:15.536 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.084356157000002, 2023-10-08T07:06:15.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:15.536 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.536 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:15.536 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.537 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:15.537 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.537 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:15.537 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.537 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.538 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:15.538 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:15.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.538 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.538 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.538 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:15.538 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:15.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.538 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.538 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.538 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.539 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:15.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:15.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:15.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:15.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:15.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:15.541 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:15.541 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:15.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.541 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.541 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:15.541 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:15.541 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:15.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.541 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.541 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:15.541 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:15.541 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:15.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.542 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.542 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:15.542 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:15.542 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.542 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.542 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.542 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:15.542 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:15.543 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 42.083325932999998, 2023-10-08T07:06:15.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:15.543 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:15.543 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:15.543 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:15.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.543 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:15.543 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:15.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.543 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:15.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:15.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:15.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:15.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:15.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:15.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:15.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:15.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:15.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.545 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.545 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:15.545 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:15.545 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:15.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.545 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.545 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:15.545 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:15.545 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:15.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.545 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.546 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:15.546 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:15.546 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:15.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.546 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.546 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:15.546 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:15.546 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:15.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:15.546 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:15.546 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:15.547 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:15.547 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:15.547 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.547 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.547 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.547 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:15.547 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:15.547 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:15.548 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:15.549 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:15.548+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:15.549 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:15.649 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:15.649+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:15.684 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:15.684 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:15.685 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2023-10-08T07:06:15.685 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:15.694 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:15.750 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:15.750+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:15.821 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:15.821 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:15.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:15.855 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:15.855 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T07:06:15.856 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:15.872 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:15.871+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:15.953 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:15.953+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:15.997 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:15.997 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:16.007 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:16.054 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:16.054+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:16.147 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:16.148 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:16.156 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:16.155+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:16.157 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:16.257 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:16.257+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:16.327 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:16.328 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:16.337 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:16.358 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:16.357+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:16.459 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:16.459+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:16.504 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:16.504 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:16.515 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:16.560 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:16.560+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:16.661 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:16.661 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:16.661 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:16.661+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:16.672 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:16.762 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:16.761+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:16.805 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:16.805 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:16.815 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:16.863 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:16.863+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:16.964 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:16.963+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:16.988 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:16.988 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:16.999 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:17.065 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:17.064+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:17.079 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T07:06:17.139 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:17.139 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:17.149 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:17.190 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:17.189+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:17.267 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:17.267+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:17.315 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:17.316 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:17.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:17.368 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:17.368+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:17.453 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:17.453 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:17.461 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:17.505 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:17.505+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:17.570 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:17.569+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:17.594 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:17.595 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:17.604 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:17.688 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:17.688+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:17.770 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:17.771 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:17.772 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:17.771+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:17.780 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:17.872 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:17.873 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:17.873+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:17.948 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:17.948 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:17.958 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:18.003 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:18.002+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:18.065 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2023-10-08T07:06:18.075 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:18.074+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:18.106 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:18.106 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:18.110 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:18.116 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:18.146 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:18.183 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T07:06:18.185 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:18.201 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:18.200+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:18.277 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:18.276+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:18.290 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:18.290 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:18.290 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:18.290 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:18.290 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:18.300 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:18.378 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:18.377+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:18.474 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:18.474 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:18.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:18.475 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:18.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.475 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:18.477 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:18.477 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 55.700504983000002, 2023-10-08T07:06:18.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:06:18.477 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.478 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.478 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:18.478 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:18.478 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:18.478 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:06:18.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.478 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:18.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:18.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:18.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:06:18.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:06:18.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:06:18.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:06:18.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:06:18.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:06:18.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:06:18.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:06:18.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:06:18.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:06:18.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:06:18.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.483 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:06:18.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:06:18.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:06:18.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:06:18.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:06:18.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:06:18.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:06:18.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:06:18.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:06:18.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:06:18.485 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.486 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.486 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.486 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:18.486 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:18.486 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 55.700483437000003, 2023-10-08T07:06:18.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:06:18.486 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.486 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.487 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:18.487 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:18.487 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:18.487 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:06:18.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.487 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.487 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:18.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:18.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:18.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:06:18.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:06:18.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:06:18.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:06:18.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:06:18.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:06:18.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:06:18.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:06:18.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:06:18.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:06:18.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:06:18.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:06:18.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:06:18.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:06:18.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:06:18.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:06:18.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:06:18.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:06:18.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:06:18.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:06:18.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:06:18.494 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.494 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.494 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.494 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:18.495 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:18.495 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 55.700416842999999, 2023-10-08T07:06:18.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:06:18.495 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.495 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.495 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:18.495 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:18.495 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:18.495 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:06:18.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.496 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:18.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:18.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:06:18.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:06:18.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:06:18.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:06:18.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:06:18.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:06:18.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:06:18.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:06:18.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:06:18.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:06:18.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:06:18.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:06:18.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:06:18.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:06:18.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:06:18.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:06:18.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:06:18.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:06:18.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:06:18.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:06:18.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:06:18.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:06:18.503 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.503 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.503 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.503 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:18.503 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:18.503 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 55.700397946999999, 2023-10-08T07:06:18.503 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:06:18.504 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.504 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.504 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:18.504 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:18.504 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:18.504 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:06:18.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.504 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:18.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:18.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:18.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:06:18.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:06:18.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:06:18.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:06:18.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:06:18.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:06:18.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:06:18.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:06:18.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:06:18.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:06:18.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:06:18.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:06:18.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:06:18.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:06:18.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:06:18.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.510 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:06:18.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:06:18.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.511 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:06:18.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:06:18.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.511 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.511 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.511 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:06:18.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:06:18.511 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.511 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.512 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.512 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:18.512 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:18.512 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 55.700384937999999, 2023-10-08T07:06:18.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:18.512 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.512 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.512 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:18.513 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:18.513 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:18.513 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:18.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.513 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:18.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:18.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:18.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:18.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:18.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:18.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.516 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:18.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:18.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.516 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.516 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:18.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:18.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.517 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:18.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:18.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.517 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:18.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:18.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:18.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:18.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:18.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:18.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:18.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:18.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:18.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:18.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:18.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:18.520 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.521 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.521 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.521 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:18.521 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:18.521 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 55.700332885999998, 2023-10-08T07:06:18.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:18.521 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.521 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.522 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:18.522 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:18.522 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:18.522 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:18.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.522 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:18.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:18.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:18.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:18.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:18.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:18.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:18.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:18.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:18.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:18.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:18.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:18.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.526 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.526 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:18.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:18.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:18.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:18.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:18.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:18.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:18.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:18.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:18.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:18.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:18.530 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:18.530 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.530 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.530 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.530 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.531 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:18.531 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.155129058999997, 2023-10-08T07:06:18.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:06:18.531 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.531 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.531 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.531 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.531 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:18.532 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:18.532 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:06:18.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:06:18.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.533 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.533 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.533 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:06:18.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:06:18.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.533 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.533 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.533 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:06:18.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:06:18.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.534 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.534 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.534 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:18.534 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:06:18.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.534 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.534 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.534 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:06:18.534 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:06:18.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:18.535 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:06:18.535 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:06:18.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.535 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:06:18.535 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:06:18.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.536 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:06:18.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:06:18.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.536 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:06:18.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:06:18.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.536 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:06:18.537 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:06:18.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.537 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:06:18.537 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:06:18.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.537 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:06:18.537 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:06:18.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.538 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.538 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.538 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:06:18.538 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:18.538 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.538 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.538 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.538 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.539 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.539 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:18.539 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.155012581000001, 2023-10-08T07:06:18.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:18.539 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.539 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.539 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.539 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.539 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.539 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:18.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:18.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:18.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:18.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.541 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:18.541 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:18.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.541 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.541 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.541 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:18.541 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:18.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.541 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.541 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.541 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:18.542 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:18.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.542 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.542 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:18.542 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:18.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.542 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:18.542 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:18.542 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:18.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.543 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.543 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:18.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:18.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.543 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.543 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:18.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:18.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:18.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:18.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:18.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:18.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.545 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:18.545 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:18.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.545 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.545 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.545 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:18.545 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:18.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.545 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.545 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.545 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:18.546 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:18.546 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.546 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.546 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.546 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.546 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.546 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:18.546 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.154962253999997, 2023-10-08T07:06:18.546 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:18.546 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.547 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.547 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.547 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.547 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:18.547 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.547 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.547 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:18.547 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.548 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:18.548 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:18.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.548 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:18.549 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:18.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.549 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.549 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:18.549 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:18.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.549 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.549 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:18.550 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:18.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.550 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.550 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.550 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:18.550 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:18.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.550 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.550 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:18.551 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:18.551 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:18.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.551 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.551 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.551 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:18.551 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:18.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.551 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.552 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.552 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:18.552 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:18.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.552 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.552 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.552 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:18.552 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:18.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.553 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.553 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:18.553 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:18.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.553 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.553 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:18.553 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:18.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.554 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.554 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:18.554 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:18.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.554 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.554 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:18.554 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:18.554 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.555 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.555 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.555 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.555 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.555 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:18.555 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.154636408999998, 2023-10-08T07:06:18.555 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:18.555 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.555 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.555 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.556 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.556 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.556 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:18.556 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.556 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.556 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.556 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:18.556 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.558 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:18.558 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:18.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.558 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.558 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.558 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:18.558 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:18.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.558 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.558 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.559 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:18.559 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:18.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.559 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.559 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:18.559 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:18.559 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:18.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.559 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.559 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.559 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:18.559 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:18.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.560 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.560 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.560 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:18.560 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:18.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.560 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.560 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.560 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:18.560 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:18.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.562 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.562 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.562 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:18.563 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:18.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.563 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.563 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.563 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:18.563 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:18.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.564 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.564 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.564 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:18.564 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:18.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.564 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.564 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.564 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:18.564 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:18.564 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.564 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.154583883999997, 2023-10-08T07:06:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.565 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.566 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:18.566 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.566 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.566 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.566 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:18.566 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.566 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.566 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.566 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:18.567 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:18.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.567 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.567 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.567 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:18.567 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:18.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.567 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.567 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.567 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:18.567 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:18.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.568 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.568 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.568 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:18.568 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:18.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.568 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.568 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.568 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:18.568 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:18.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.568 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.568 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.569 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:18.569 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:18.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.569 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.569 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.569 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:18.569 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:18.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.569 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.569 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.569 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.570 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.571 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.571 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:18.571 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:18.571 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.571 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.571 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.571 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.571 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.571 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:18.571 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.154415909000001, 2023-10-08T07:06:18.572 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:18.572 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.572 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.572 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.572 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.572 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.572 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:18.572 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.572 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.572 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.572 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.572 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.573 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.574 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.574 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:18.574 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:18.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.574 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.574 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.574 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:18.574 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:18.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.574 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.574 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.575 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:18.575 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:18.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.575 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.575 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:18.575 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:18.575 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:18.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.575 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.575 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.575 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:18.575 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.576 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.577 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:18.577 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:18.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.577 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.577 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.577 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:18.577 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:18.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.577 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.577 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.577 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:18.577 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:18.578 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.578 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.578 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.578 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:18.578 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:18.578 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.578 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.578 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.578 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.578 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.578 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.578 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:18.579 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.154271610999999, 2023-10-08T07:06:18.579 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:18.579 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.579 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.579 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.579 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.579 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.579 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:18.579 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.579 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.579 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:18.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.581 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.581 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.581 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:18.581 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:18.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.581 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.581 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.581 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:18.581 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:18.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.581 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.581 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.582 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:18.582 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:18.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.582 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.582 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:18.582 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:18.582 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:18.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.583 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.583 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.583 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:18.583 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:18.583 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.583 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.583 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.583 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:18.583 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.584 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.585 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:18.585 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:18.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.585 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.585 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.585 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:18.585 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:18.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.585 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.585 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.585 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:18.585 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:18.586 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.586 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.586 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.586 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.586 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.586 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:18.586 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.153592099000001, 2023-10-08T07:06:18.586 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:18.586 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.586 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.586 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.587 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.587 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.587 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:18.587 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.587 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.587 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.587 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:18.587 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.588 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.588 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.588 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:18.588 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:18.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.588 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.588 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.588 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:18.588 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:18.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.588 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.588 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.589 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:18.589 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:18.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.589 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.589 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.589 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:18.589 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:18.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.589 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.589 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.589 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:18.590 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:18.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.590 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.590 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.590 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:18.590 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:18.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.590 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.590 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.590 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:18.590 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:18.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.591 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.591 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.591 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:18.591 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:18.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.591 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.591 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.591 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:18.591 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:18.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.592 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.592 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.592 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:18.592 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:18.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.592 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.592 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.592 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:18.592 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:18.592 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.592 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.593 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.593 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.593 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.593 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.593 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:18.593 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.153538828999999, 2023-10-08T07:06:18.593 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:18.593 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.593 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.593 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.593 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.593 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.594 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:18.594 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.594 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.594 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.594 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:18.594 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.594 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.594 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.594 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:18.594 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:18.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.595 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.595 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.595 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:18.595 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:18.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.595 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.595 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.595 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:18.595 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:18.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.596 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.596 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.596 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:18.596 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:18.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.596 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.596 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.596 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:18.596 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:18.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.596 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.596 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:18.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.598 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.598 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.598 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:18.598 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:18.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.598 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.598 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.598 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:18.598 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:18.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.598 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.599 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.599 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:18.599 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:18.599 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.599 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.599 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.599 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.599 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.599 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:18.599 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.153502983000003, 2023-10-08T07:06:18.599 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:18.600 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.600 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.600 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.600 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.600 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.600 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:18.600 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.600 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.600 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.600 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:18.601 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.601 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.601 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:18.601 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:18.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.601 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.601 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:18.601 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:18.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.602 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.602 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:18.602 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:18.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.602 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.602 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:18.602 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:18.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.602 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.603 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:18.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:18.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.603 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.603 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.603 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:18.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:18.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.603 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.603 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.603 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:18.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:18.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.604 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.604 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:18.604 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:18.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.604 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.604 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:18.604 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:18.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.605 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.605 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.605 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:18.605 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:18.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.605 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.605 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.605 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:18.605 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:18.605 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.605 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.605 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.153362452000003, 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:18.606 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.607 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.607 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:18.607 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.607 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.607 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:18.607 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:18.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.608 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.608 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:18.608 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:18.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.608 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.608 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.608 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:18.608 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.610 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:18.610 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:18.610 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:18.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.610 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.610 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.610 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:18.610 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:18.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.610 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.610 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.610 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:18.611 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:18.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.611 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.611 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:18.611 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:18.611 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:18.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.611 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.611 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.611 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:18.611 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:18.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.612 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.612 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.612 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:18.612 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:18.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.612 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.612 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.612 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:18.612 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:18.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.153070129, 2023-10-08T07:06:18.613 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:18.614 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.614 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.614 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.614 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.614 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.614 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:18.614 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.614 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.614 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.614 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:18.614 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.615 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.615 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.615 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:18.615 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:18.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.615 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.615 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.615 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:18.615 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:18.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.615 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.618 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:18.618 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:18.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.618 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:18.618 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:18.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.618 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.619 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:18.619 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:18.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.619 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.619 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.619 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:18.619 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:18.619 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.619 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.619 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.620 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.620 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.620 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:18.620 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.152956486999997, 2023-10-08T07:06:18.620 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:18.620 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.620 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:18.620 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.620 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.620 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.620 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:18.620 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.621 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.621 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:18.621 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.621 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.621 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:18.621 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:18.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.622 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.622 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:18.622 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:18.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.622 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.622 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.622 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:18.622 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:18.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.622 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.622 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.622 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:18.623 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:18.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.623 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.623 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.623 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:18.623 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:18.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.623 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.623 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.623 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:18.623 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:18.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.624 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.624 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:18.624 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:18.624 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:18.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.624 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.624 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:18.624 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:18.624 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:18.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.624 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:18.625 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:18.626 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.626 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.626 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.626 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.626 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:18.626 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:18.626 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 45.151926263, 2023-10-08T07:06:18.626 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:18.626 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:18.626 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:18.626 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:18.627 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.627 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:18.627 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:18.627 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.627 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.627 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:18.627 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:18.627 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:18.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.627 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.627 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:18.628 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:18.628 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:18.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.628 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.628 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:18.628 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:18.628 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:18.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.628 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.628 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:18.628 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:18.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:18.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.629 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:18.629 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:18.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:18.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.629 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:18.629 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:18.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:18.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.630 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.630 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:18.630 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:18.630 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:18.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:18.630 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:18.630 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:18.630 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:18.630 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:18.631 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.631 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.631 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.631 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:18.631 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:18.631 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:18.632 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:18.633 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:18.631+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:18.733 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:18.732+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:18.772 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:18.772 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:18.772 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2023-10-08T07:06:18.772 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:18.782 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:18.867 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:18.866+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:18.935 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:18.935+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:18.949 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:18.949 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2023-10-08T07:06:18.950 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2023-10-08T07:06:18.950 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:18.959 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:19.044 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:19.043+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:19.127 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:19.127 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2023-10-08T07:06:19.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2023-10-08T07:06:19.128 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2023-10-08T07:06:19.128 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.128 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-10-08T07:06:19.128 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:19.128 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.810456274000003, 2023-10-08T07:06:19.128 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069404690000000003, 2023-10-08T07:06:19.128 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.129 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.129 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.129 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.129 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:19.129 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.129 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.129 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:19.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.130 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.130 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.130 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.130 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315211+0000", 2023-10-08T07:06:19.130 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:06:19.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315216+0000", 2023-10-08T07:06:19.131 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:06:19.131 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.131 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.131 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.131 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315229+0000", 2023-10-08T07:06:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.278e-05 2023-10-08T07:06:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315235+0000", 2023-10-08T07:06:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2023-10-08T07:06:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316390+0000", 2023-10-08T07:06:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011548179999999999 2023-10-08T07:06:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316410+0000", 2023-10-08T07:06:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0818999999999998e-05 2023-10-08T07:06:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322113+0000", 2023-10-08T07:06:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057026159999999998 2023-10-08T07:06:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322150+0000", 2023-10-08T07:06:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7401999999999999e-05 2023-10-08T07:06:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-10-08T07:06:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.353096504, 2023-10-08T07:06:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087059660000000007, 2023-10-08T07:06:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:06:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772604+0000", 2023-10-08T07:06:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.413e-05 2023-10-08T07:06:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772617+0000", 2023-10-08T07:06:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2595999999999999e-05 2023-10-08T07:06:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772624+0000", 2023-10-08T07:06:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2023-10-08T07:06:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772666+0000", 2023-10-08T07:06:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1925000000000003e-05 2023-10-08T07:06:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772685+0000", 2023-10-08T07:06:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9071000000000001e-05 2023-10-08T07:06:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781237+0000", 2023-10-08T07:06:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085519059999999997 2023-10-08T07:06:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781276+0000", 2023-10-08T07:06:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9161e-05 2023-10-08T07:06:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-10-08T07:06:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.352599849999997, 2023-10-08T07:06:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010997768, 2023-10-08T07:06:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:19.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.146 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:19.146 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.146 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.146 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.146 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773067+0000", 2023-10-08T07:06:19.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:06:19.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773071+0000", 2023-10-08T07:06:19.147 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3819999999999997e-06 2023-10-08T07:06:19.147 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.147 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.147 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.147 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773082+0000", 2023-10-08T07:06:19.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0407e-05 2023-10-08T07:06:19.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773087+0000", 2023-10-08T07:06:19.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:06:19.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.148 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.148 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.148 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775481+0000", 2023-10-08T07:06:19.148 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023941470000000001 2023-10-08T07:06:19.148 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775493+0000", 2023-10-08T07:06:19.149 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2126999999999999e-05 2023-10-08T07:06:19.149 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.149 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.149 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.149 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784021+0000", 2023-10-08T07:06:19.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085280589999999993 2023-10-08T07:06:19.150 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.150 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.150 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.150 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784064+0000", 2023-10-08T07:06:19.150 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.295e-05 2023-10-08T07:06:19.150 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.150 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.150 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.151 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.151 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:157 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'111, mlcod=11'105)", 2023-10-08T07:06:19.151 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:19.151 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.352179751999998, 2023-10-08T07:06:19.151 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010614554, 2023-10-08T07:06:19.151 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.151 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.151 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.151 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.151 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:19.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:19.152 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.152 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.152 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.152 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.152 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773487+0000", 2023-10-08T07:06:19.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:06:19.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773492+0000", 2023-10-08T07:06:19.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2249999999999999e-06 2023-10-08T07:06:19.153 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.153 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.153 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.153 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773503+0000", 2023-10-08T07:06:19.153 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0271e-05 2023-10-08T07:06:19.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773509+0000", 2023-10-08T07:06:19.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5470000000000002e-06 2023-10-08T07:06:19.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.154 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.154 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.154 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775801+0000", 2023-10-08T07:06:19.154 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022918790000000001 2023-10-08T07:06:19.154 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775822+0000", 2023-10-08T07:06:19.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1486000000000001e-05 2023-10-08T07:06:19.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.155 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784066+0000", 2023-10-08T07:06:19.155 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082432089999999996 2023-10-08T07:06:19.155 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.155 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.155 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.156 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784101+0000", 2023-10-08T07:06:19.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5383999999999999e-05 2023-10-08T07:06:19.156 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.156 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.156 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.156 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.156 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.156 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:158 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'112, mlcod=11'106)", 2023-10-08T07:06:19.156 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:19.156 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.351702654999997, 2023-10-08T07:06:19.156 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010172001999999999, 2023-10-08T07:06:19.157 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.157 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.157 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.157 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:19.157 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.157 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.157 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.157 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:19.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.158 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:19.158 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.82e-07 2023-10-08T07:06:19.158 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.158 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.158 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773990+0000", 2023-10-08T07:06:19.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2023-10-08T07:06:19.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774001+0000", 2023-10-08T07:06:19.159 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0873000000000001e-05 2023-10-08T07:06:19.159 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.159 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.159 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.159 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774006+0000", 2023-10-08T07:06:19.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0900000000000004e-06 2023-10-08T07:06:19.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776145+0000", 2023-10-08T07:06:19.160 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021389759999999999 2023-10-08T07:06:19.160 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.160 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.160 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.160 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776165+0000", 2023-10-08T07:06:19.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9548e-05 2023-10-08T07:06:19.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784102+0000", 2023-10-08T07:06:19.161 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007937342 2023-10-08T07:06:19.161 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.161 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.161 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.161 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784136+0000", 2023-10-08T07:06:19.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3331000000000003e-05 2023-10-08T07:06:19.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.162 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.162 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.162 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.162 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.162 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:159 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'113, mlcod=11'106)", 2023-10-08T07:06:19.162 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:19.162 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.351169697000003, 2023-10-08T07:06:19.162 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096667119999999992, 2023-10-08T07:06:19.162 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.163 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.163 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:19.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.163 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.163 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.163 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.163 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:19.163 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:19.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:06:19.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.164 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.164 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774501+0000", 2023-10-08T07:06:19.164 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1529999999999999e-06 2023-10-08T07:06:19.164 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.164 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774511+0000", 2023-10-08T07:06:19.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:06:19.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774533+0000", 2023-10-08T07:06:19.165 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2348999999999999e-05 2023-10-08T07:06:19.165 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.165 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.165 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.165 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776608+0000", 2023-10-08T07:06:19.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002074799 2023-10-08T07:06:19.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776627+0000", 2023-10-08T07:06:19.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8632999999999999e-05 2023-10-08T07:06:19.166 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.166 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.166 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.166 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784138+0000", 2023-10-08T07:06:19.166 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075110819999999997 2023-10-08T07:06:19.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.167 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.167 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784163+0000", 2023-10-08T07:06:19.167 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5425000000000001e-05 2023-10-08T07:06:19.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.167 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.167 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.167 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.167 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.167 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:160 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'114, mlcod=11'106)", 2023-10-08T07:06:19.168 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:19.168 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.350534515, 2023-10-08T07:06:19.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090478150000000007, 2023-10-08T07:06:19.168 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.168 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.168 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.168 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.168 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.168 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:19.168 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.168 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:19.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.169 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.169 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.169 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775133+0000", 2023-10-08T07:06:19.169 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2023-10-08T07:06:19.169 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775150+0000", 2023-10-08T07:06:19.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6206e-05 2023-10-08T07:06:19.170 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.170 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.170 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.170 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775173+0000", 2023-10-08T07:06:19.170 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.351e-05 2023-10-08T07:06:19.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775187+0000", 2023-10-08T07:06:19.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4396000000000001e-05 2023-10-08T07:06:19.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.171 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.171 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.171 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776909+0000", 2023-10-08T07:06:19.171 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017220429999999999 2023-10-08T07:06:19.171 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776929+0000", 2023-10-08T07:06:19.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9313e-05 2023-10-08T07:06:19.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.172 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.172 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784164+0000", 2023-10-08T07:06:19.172 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072352340000000001 2023-10-08T07:06:19.172 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.172 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.173 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.173 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:19.173 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526e-05 2023-10-08T07:06:19.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.173 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.173 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.173 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.173 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.173 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:161 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'115, mlcod=11'106)", 2023-10-08T07:06:19.173 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:19.173 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.349855626, 2023-10-08T07:06:19.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083874480000000005, 2023-10-08T07:06:19.174 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.174 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.174 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.174 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:19.174 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.174 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.174 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.174 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:19.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:19.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:06:19.175 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.175 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.175 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.175 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775837+0000", 2023-10-08T07:06:19.175 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6081e-05 2023-10-08T07:06:19.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775849+0000", 2023-10-08T07:06:19.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:06:19.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.176 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.176 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775854+0000", 2023-10-08T07:06:19.176 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1490000000000002e-06 2023-10-08T07:06:19.176 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.176 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777220+0000", 2023-10-08T07:06:19.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001365174 2023-10-08T07:06:19.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.177 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777232+0000", 2023-10-08T07:06:19.177 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2293000000000001e-05 2023-10-08T07:06:19.177 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.177 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.177 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:19.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069481450000000002 2023-10-08T07:06:19.178 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.178 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.178 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.178 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784198+0000", 2023-10-08T07:06:19.178 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2023-10-08T07:06:19.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.178 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.178 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.179 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.179 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:162 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'116, mlcod=11'106)", 2023-10-08T07:06:19.179 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:19.179 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.349231224, 2023-10-08T07:06:19.179 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077785969999999999, 2023-10-08T07:06:19.179 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.179 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.179 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.179 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.179 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:19.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.180 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.180 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:19.180 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.180 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.180 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776436+0000", 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776440+0000", 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2629999999999997e-06 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776451+0000", 2023-10-08T07:06:19.181 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1385e-05 2023-10-08T07:06:19.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776456+0000", 2023-10-08T07:06:19.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9919999999999998e-06 2023-10-08T07:06:19.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.182 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.182 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.182 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777629+0000", 2023-10-08T07:06:19.182 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001173297 2023-10-08T07:06:19.182 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777650+0000", 2023-10-08T07:06:19.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0126e-05 2023-10-08T07:06:19.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.183 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784199+0000", 2023-10-08T07:06:19.183 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006548908 2023-10-08T07:06:19.183 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.183 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.183 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.184 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:19.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5071e-05 2023-10-08T07:06:19.184 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.184 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.184 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.184 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.184 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.184 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:163 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'117, mlcod=11'106)", 2023-10-08T07:06:19.184 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:19.184 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.348588817, 2023-10-08T07:06:19.184 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071515490000000001, 2023-10-08T07:06:19.184 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.185 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.185 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:19.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.185 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.185 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.185 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.185 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:19.185 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777078+0000", 2023-10-08T07:06:19.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4400000000000001e-07 2023-10-08T07:06:19.186 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.186 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.186 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.186 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777082+0000", 2023-10-08T07:06:19.186 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.732e-06 2023-10-08T07:06:19.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.187 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.187 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777095+0000", 2023-10-08T07:06:19.187 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3749e-05 2023-10-08T07:06:19.187 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.187 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777100+0000", 2023-10-08T07:06:19.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.634e-06 2023-10-08T07:06:19.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777944+0000", 2023-10-08T07:06:19.188 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00084377599999999997 2023-10-08T07:06:19.188 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.188 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.188 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.188 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777957+0000", 2023-10-08T07:06:19.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.276e-05 2023-10-08T07:06:19.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:19.189 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006257617 2023-10-08T07:06:19.189 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.189 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.189 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.189 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784229+0000", 2023-10-08T07:06:19.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4837e-05 2023-10-08T07:06:19.190 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.190 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.190 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.190 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.190 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.190 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:164 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'118, mlcod=11'106)", 2023-10-08T07:06:19.190 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:19.190 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 56.348007478, 2023-10-08T07:06:19.190 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093104280000000008, 2023-10-08T07:06:19.190 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.190 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.191 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:19.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.191 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.191 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:19.191 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.191 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.191 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:19.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2e-07 2023-10-08T07:06:19.192 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.192 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.192 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.192 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777713+0000", 2023-10-08T07:06:19.192 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4079999999999997e-05 2023-10-08T07:06:19.194 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.194 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.194 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.194 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777724+0000", 2023-10-08T07:06:19.195 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0652999999999999e-05 2023-10-08T07:06:19.195 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.195 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.195 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.195 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777729+0000", 2023-10-08T07:06:19.196 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2050000000000001e-06 2023-10-08T07:06:19.196 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.196 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.196 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.197 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778177+0000", 2023-10-08T07:06:19.197 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044763499999999999 2023-10-08T07:06:19.197 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.197 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.197 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.198 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778195+0000", 2023-10-08T07:06:19.198 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8125e-05 2023-10-08T07:06:19.198 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.198 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786935+0000", 2023-10-08T07:06:19.199 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087396049999999992 2023-10-08T07:06:19.199 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.199 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.199 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.199 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786969+0000", 2023-10-08T07:06:19.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4604999999999998e-05 2023-10-08T07:06:19.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.200 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.200 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.200 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.200 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.200 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.200 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:19.200 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.810119047999997, 2023-10-08T07:06:19.200 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013957681, 2023-10-08T07:06:19.201 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.201 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.201 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:19.201 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.201 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.201 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.201 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.201 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:19.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.202 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.202 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.202 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.202 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315552+0000", 2023-10-08T07:06:19.202 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.152e-06 2023-10-08T07:06:19.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.203 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.203 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.203 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315568+0000", 2023-10-08T07:06:19.203 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5301000000000001e-05 2023-10-08T07:06:19.203 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.204 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315583+0000", 2023-10-08T07:06:19.204 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5826000000000001e-05 2023-10-08T07:06:19.204 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.204 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.204 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315598+0000", 2023-10-08T07:06:19.205 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4953999999999999e-05 2023-10-08T07:06:19.205 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.205 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.205 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.205 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317200+0000", 2023-10-08T07:06:19.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016014950000000001 2023-10-08T07:06:19.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.206 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.206 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317351+0000", 2023-10-08T07:06:19.206 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015081400000000001 2023-10-08T07:06:19.206 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.206 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317540+0000", 2023-10-08T07:06:19.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000189557 2023-10-08T07:06:19.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.207 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.207 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:19.207 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322281+0000", 2023-10-08T07:06:19.207 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047409599999999998 2023-10-08T07:06:19.207 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329404+0000", 2023-10-08T07:06:19.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071225460000000004 2023-10-08T07:06:19.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.208 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329459+0000", 2023-10-08T07:06:19.208 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5016999999999999e-05 2023-10-08T07:06:19.208 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.208 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.208 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.209 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329505+0000", 2023-10-08T07:06:19.209 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059000000000001e-05 2023-10-08T07:06:19.209 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.209 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.210 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.210 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.210 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.210 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:19.210 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.810036079, 2023-10-08T07:06:19.210 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015617259, 2023-10-08T07:06:19.210 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.210 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.210 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.210 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.211 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.211 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:19.211 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.212 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.212 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.212 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:19.212 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.212 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.213 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315631+0000", 2023-10-08T07:06:19.213 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2023-10-08T07:06:19.213 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.213 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.213 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315636+0000", 2023-10-08T07:06:19.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1019999999999996e-06 2023-10-08T07:06:19.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315646+0000", 2023-10-08T07:06:19.214 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0056e-05 2023-10-08T07:06:19.214 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.214 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.214 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.214 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315654+0000", 2023-10-08T07:06:19.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7810000000000005e-06 2023-10-08T07:06:19.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318626+0000", 2023-10-08T07:06:19.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00297183 2023-10-08T07:06:19.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.215 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.215 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.215 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319450+0000", 2023-10-08T07:06:19.215 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082440400000000004 2023-10-08T07:06:19.215 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319924+0000", 2023-10-08T07:06:19.216 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047403099999999997 2023-10-08T07:06:19.216 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.216 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.216 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:19.216 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322475+0000", 2023-10-08T07:06:19.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002550442 2023-10-08T07:06:19.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331142+0000", 2023-10-08T07:06:19.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086669030000000001 2023-10-08T07:06:19.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.217 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.217 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.217 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331217+0000", 2023-10-08T07:06:19.217 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5606999999999996e-05 2023-10-08T07:06:19.217 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.218 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.218 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331247+0000", 2023-10-08T07:06:19.218 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:06:19.218 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.218 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.218 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.218 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.218 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.218 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:15 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.218 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:19.218 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.808872639999997, 2023-10-08T07:06:19.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012716055, 2023-10-08T07:06:19.219 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.219 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.219 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:19.219 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.219 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.219 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.219 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.219 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8599999999999997e-07 2023-10-08T07:06:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316805+0000", 2023-10-08T07:06:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0475000000000001e-05 2023-10-08T07:06:19.220 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316817+0000", 2023-10-08T07:06:19.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.226e-05 2023-10-08T07:06:19.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.221 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316828+0000", 2023-10-08T07:06:19.221 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1090999999999999e-05 2023-10-08T07:06:19.221 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.221 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.221 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317025+0000", 2023-10-08T07:06:19.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019711500000000001 2023-10-08T07:06:19.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317244+0000", 2023-10-08T07:06:19.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021908999999999999 2023-10-08T07:06:19.222 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.222 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.222 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.222 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317436+0000", 2023-10-08T07:06:19.222 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019164900000000001 2023-10-08T07:06:19.223 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.223 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.223 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:19.223 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321493+0000", 2023-10-08T07:06:19.223 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040573190000000002 2023-10-08T07:06:19.224 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.224 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.224 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329275+0000", 2023-10-08T07:06:19.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077820950000000002 2023-10-08T07:06:19.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329457+0000", 2023-10-08T07:06:19.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018165600000000001 2023-10-08T07:06:19.225 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.225 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.225 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.225 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329510+0000", 2023-10-08T07:06:19.225 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2519000000000003e-05 2023-10-08T07:06:19.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.226 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.226 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.226 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.226 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.226 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:27 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.226 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:19.226 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.808811849000001, 2023-10-08T07:06:19.226 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015441417000000001, 2023-10-08T07:06:19.226 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.226 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.227 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316855+0000", 2023-10-08T07:06:19.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:19.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316861+0000", 2023-10-08T07:06:19.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6210000000000001e-06 2023-10-08T07:06:19.228 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.228 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.228 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.228 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316869+0000", 2023-10-08T07:06:19.228 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.225e-06 2023-10-08T07:06:19.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316878+0000", 2023-10-08T07:06:19.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8799999999999997e-06 2023-10-08T07:06:19.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.229 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.229 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319969+0000", 2023-10-08T07:06:19.229 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030906689999999999 2023-10-08T07:06:19.229 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.229 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320072+0000", 2023-10-08T07:06:19.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103458 2023-10-08T07:06:19.230 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.230 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.230 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.230 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320631+0000", 2023-10-08T07:06:19.230 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055936099999999997 2023-10-08T07:06:19.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:19.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322686+0000", 2023-10-08T07:06:19.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020545899999999998 2023-10-08T07:06:19.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.231 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.231 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.231 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332244+0000", 2023-10-08T07:06:19.231 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095578690000000001 2023-10-08T07:06:19.231 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332274+0000", 2023-10-08T07:06:19.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0527000000000001e-05 2023-10-08T07:06:19.232 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.232 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.232 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.232 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332296+0000", 2023-10-08T07:06:19.232 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1359999999999999e-05 2023-10-08T07:06:19.232 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.233 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.233 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.233 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.233 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.233 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:19.233 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.808775259999997, 2023-10-08T07:06:19.233 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014502582, 2023-10-08T07:06:19.233 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.233 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.233 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.233 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.234 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:19.234 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.234 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.234 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.234 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:19.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316892+0000", 2023-10-08T07:06:19.235 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:06:19.235 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.235 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.235 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.235 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316896+0000", 2023-10-08T07:06:19.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9140000000000001e-06 2023-10-08T07:06:19.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316904+0000", 2023-10-08T07:06:19.236 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1170000000000004e-06 2023-10-08T07:06:19.236 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.236 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.236 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.236 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316911+0000", 2023-10-08T07:06:19.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:06:19.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320938+0000", 2023-10-08T07:06:19.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040269959999999997 2023-10-08T07:06:19.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.237 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.237 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.237 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321023+0000", 2023-10-08T07:06:19.237 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5420000000000005e-05 2023-10-08T07:06:19.237 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321157+0000", 2023-10-08T07:06:19.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013383700000000001 2023-10-08T07:06:19.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:19.238 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322742+0000", 2023-10-08T07:06:19.238 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015851249999999999 2023-10-08T07:06:19.238 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.238 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.238 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331290+0000", 2023-10-08T07:06:19.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085483190000000004 2023-10-08T07:06:19.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331348+0000", 2023-10-08T07:06:19.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7630999999999998e-05 2023-10-08T07:06:19.239 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.239 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.239 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.239 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331394+0000", 2023-10-08T07:06:19.239 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5534999999999997e-05 2023-10-08T07:06:19.240 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.240 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.240 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.240 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.240 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.240 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.240 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:19.240 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.808746771999999, 2023-10-08T07:06:19.240 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015363402, 2023-10-08T07:06:19.240 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.240 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.240 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:19.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.241 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:19.241 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.241 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.241 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.241 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316920+0000", 2023-10-08T07:06:19.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2023-10-08T07:06:19.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316923+0000", 2023-10-08T07:06:19.242 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2169999999999999e-06 2023-10-08T07:06:19.242 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.242 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.242 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.242 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316930+0000", 2023-10-08T07:06:19.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:06:19.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316938+0000", 2023-10-08T07:06:19.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:06:19.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.243 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.243 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.243 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322217+0000", 2023-10-08T07:06:19.243 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052793680000000004 2023-10-08T07:06:19.243 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322295+0000", 2023-10-08T07:06:19.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7621999999999996e-05 2023-10-08T07:06:19.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.244 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322411+0000", 2023-10-08T07:06:19.244 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000116297 2023-10-08T07:06:19.244 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.244 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.244 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:19.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323187+0000", 2023-10-08T07:06:19.245 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077583700000000003 2023-10-08T07:06:19.245 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.245 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.245 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.245 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332224+0000", 2023-10-08T07:06:19.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090370980000000004 2023-10-08T07:06:19.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332261+0000", 2023-10-08T07:06:19.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6464999999999997e-05 2023-10-08T07:06:19.246 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.246 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.246 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.246 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332283+0000", 2023-10-08T07:06:19.246 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2124e-05 2023-10-08T07:06:19.246 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.247 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.247 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.247 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.247 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.247 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.247 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:19.247 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.807623587999998, 2023-10-08T07:06:19.247 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014463023, 2023-10-08T07:06:19.247 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.247 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.247 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.248 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318044+0000", 2023-10-08T07:06:19.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1000000000000001e-06 2023-10-08T07:06:19.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318057+0000", 2023-10-08T07:06:19.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2860000000000001e-05 2023-10-08T07:06:19.249 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.249 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.249 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.249 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318067+0000", 2023-10-08T07:06:19.249 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0638999999999999e-05 2023-10-08T07:06:19.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318090+0000", 2023-10-08T07:06:19.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2889000000000001e-05 2023-10-08T07:06:19.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.250 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.250 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.250 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320985+0000", 2023-10-08T07:06:19.250 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028951279999999999 2023-10-08T07:06:19.250 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321126+0000", 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014045600000000001 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321798+0000", 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067266600000000004 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:19.251 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323135+0000", 2023-10-08T07:06:19.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013368589999999999 2023-10-08T07:06:19.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332445+0000", 2023-10-08T07:06:19.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093094419999999994 2023-10-08T07:06:19.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.252 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.252 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:19.252 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332482+0000", 2023-10-08T07:06:19.252 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:19.252 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.253 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.253 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332506+0000", 2023-10-08T07:06:19.253 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3649e-05 2023-10-08T07:06:19.253 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.253 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.253 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.253 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.253 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.253 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.253 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:19.253 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.807555078999997, 2023-10-08T07:06:19.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011597616999999999, 2023-10-08T07:06:19.254 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.254 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:19.254 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.254 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:19.254 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.254 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.254 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.254 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.255 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:19.255 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.255 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.255 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.255 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.256 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318112+0000", 2023-10-08T07:06:19.256 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2299999999999999e-07 2023-10-08T07:06:19.256 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.256 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.256 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318117+0000", 2023-10-08T07:06:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1170000000000003e-06 2023-10-08T07:06:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318127+0000", 2023-10-08T07:06:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0129000000000001e-05 2023-10-08T07:06:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318136+0000", 2023-10-08T07:06:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3610000000000001e-06 2023-10-08T07:06:19.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:19.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101062 2023-10-08T07:06:19.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.258 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.258 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.258 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318422+0000", 2023-10-08T07:06:19.258 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018560500000000001 2023-10-08T07:06:19.258 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329709+0000", 2023-10-08T07:06:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01128642 2023-10-08T07:06:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:19.259 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 45.807515959, 2023-10-08T07:06:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088267940000000007, 2023-10-08T07:06:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:19.260 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:19.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:19.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:19.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318151+0000", 2023-10-08T07:06:19.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:06:19.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.261 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.261 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:19.261 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318154+0000", 2023-10-08T07:06:19.261 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9529999999999999e-06 2023-10-08T07:06:19.261 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:19.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318161+0000", 2023-10-08T07:06:19.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.126e-06 2023-10-08T07:06:19.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.262 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318167+0000", 2023-10-08T07:06:19.262 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2169999999999999e-06 2023-10-08T07:06:19.262 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.262 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.262 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:19.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319711+0000", 2023-10-08T07:06:19.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015438769999999999 2023-10-08T07:06:19.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:19.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319864+0000", 2023-10-08T07:06:19.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015264799999999999 2023-10-08T07:06:19.263 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:19.263 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:19.263 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:19.263 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.326977+0000", 2023-10-08T07:06:19.263 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071133890000000003 2023-10-08T07:06:19.264 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.264 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.264 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.264 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:19.264 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:19.264 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:19.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:19.266 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:19.265+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:19.366 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:19.366+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:19.405 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:19.406 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:19.406 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:19.406 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:19.415 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:19.467 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:19.466+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:19.542 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:19.543 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:19.552 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:19.568 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:19.567+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:19.669 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:19.669+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:19.681 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:19.681 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:19.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:19.681 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:19.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.681 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.681 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:19.681 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.362689215000003, 2023-10-08T07:06:19.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:19.682 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.682 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.682 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:19.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:19.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:19.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:19.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:19.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:19.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:19.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:19.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:19.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:19.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:19.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:19.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:19.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:19.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:19.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:19.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:19.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:19.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:19.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:19.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:19.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:19.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:19.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:19.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:19.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:19.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.688 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.688 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.688 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:19.688 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.362615431000002, 2023-10-08T07:06:19.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:19.688 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.689 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.689 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:19.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:19.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:19.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:19.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:19.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:19.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:19.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:19.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:19.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:19.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:19.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:19.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:19.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:19.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:19.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:19.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:19.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:19.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:19.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:19.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:19.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:19.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:19.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:19.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:19.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:19.700 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.701 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.701 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.701 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:19.702 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.362552254999997, 2023-10-08T07:06:19.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:19.702 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.702 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.702 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:19.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:19.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:19.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:19.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:19.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:19.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:19.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:19.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:19.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:19.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:19.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:19.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:19.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:19.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:19.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:19.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.710 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.710 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.710 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:19.710 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.362517908999997, 2023-10-08T07:06:19.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:19.710 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.711 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.711 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:19.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:19.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:19.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:19.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:19.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:19.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:19.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:19.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:19.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:19.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:19.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:19.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:19.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:19.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:19.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:19.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:19.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:19.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:19.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:19.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:19.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:19.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:19.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:19.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:19.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:19.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:19.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.718 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.718 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.719 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:19.719 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.362027683999997, 2023-10-08T07:06:19.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:19.719 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.719 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.719 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:19.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:19.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:19.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:19.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:19.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:19.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:19.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:19.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:19.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:19.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:19.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:19.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:19.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:19.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:19.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:19.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:19.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:19.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:19.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:19.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:19.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:19.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:19.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:19.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:19.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:19.728 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.728 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.728 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.729 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.729 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:19.729 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.361987106999997, 2023-10-08T07:06:19.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:19.729 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.729 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.729 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:19.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:19.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:19.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:19.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:19.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:19.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:19.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:19.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:19.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:19.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:19.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:19.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:19.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:19.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:19.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:19.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:19.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:19.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:19.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:19.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:19.736 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.737 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.737 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.737 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:19.737 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.361949537999998, 2023-10-08T07:06:19.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:19.737 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.737 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:19.737 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:19.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:19.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:19.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:19.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:19.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:19.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:19.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:19.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:19.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:19.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:19.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:19.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.361882098000002, 2023-10-08T07:06:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:19.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:19.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:19.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:19.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:19.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:19.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:19.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:19.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:19.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:19.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:19.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:19.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:19.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:19.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:19.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.747 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.748 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:19.748 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:19.748 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.361852456000001, 2023-10-08T07:06:19.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:19.748 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.748 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:19.748 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:19.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:19.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:19.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:19.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:19.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:19.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:19.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:19.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:19.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:19.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:19.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:19.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:19.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:19.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:19.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:19.754 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.754 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.754 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.754 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:19.755 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:19.755 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.356111894999998, 2023-10-08T07:06:19.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:19.755 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.755 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:19.755 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:19.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:19.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:19.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:19.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:19.758 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.758 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.758 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.759 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:19.759 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:19.759 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.355662555000002, 2023-10-08T07:06:19.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:19.759 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.759 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:19.759 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:19.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:19.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:19.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:19.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:19.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:19.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:19.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:19.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:19.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:19.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:19.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:19.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:19.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:19.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:19.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:19.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.763 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.763 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:19.763 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.354866665000003, 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:19.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:19.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:19.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:19.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:19.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:19.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:19.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:19.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:19.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:19.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:19.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:19.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:19.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:19.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:19.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:19.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.354751313999998, 2023-10-08T07:06:19.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:19.771 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.771 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.771 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:19.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:19.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:19.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:19.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:19.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:19.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:19.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:19.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:19.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:19.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:19.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:19.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:19.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:19.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:19.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:19.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:19.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:19.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:19.779 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.779 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.780 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.780 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:19.780 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:19.780 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.349636748000002, 2023-10-08T07:06:19.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:19.781 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.781 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.781 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:19.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:19.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:19.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:19.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:19.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:19.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:19.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:19.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:19.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:19.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:19.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:19.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:19.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:19.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:19.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:19.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:19.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:19.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:19.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.787 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.787 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:19.787 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:19.787 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.349525755999998, 2023-10-08T07:06:19.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:19.788 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.788 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.788 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:19.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:19.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:19.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:19.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:19.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:19.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:19.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:19.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:19.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:19.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:19.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:19.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:19.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:19.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:19.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:19.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:19.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:19.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:19.794 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.794 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.794 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.795 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:19.795 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:19.795 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.349101314999999, 2023-10-08T07:06:19.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:19.795 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.796 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:19.796 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:19.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:19.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:19.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:19.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:19.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:19.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:19.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:19.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:19.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:19.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:19.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:19.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 46.348954179000003, 2023-10-08T07:06:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:19.804 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:19.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:19.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.811 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.27765591, 2023-10-08T07:06:19.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:19.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.821 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 42.275862326000002, 2023-10-08T07:06:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:19.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.277272656000001, 2023-10-08T07:06:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:19.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:19.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:19.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:19.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:19.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:19.834 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:19.834 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:19.835 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T07:06:19.835 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T07:06:19.835 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-10-08T07:06:19.836 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-10-08T07:06:19.836 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-10-08T07:06:19.836 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-10-08T07:06:19.837 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:19.835+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:19.838 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:19.937 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:19.937+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:19.991 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:19.991 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "" 2023-10-08T07:06:19.991 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:19.992 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:19.993 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:19.993 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:19.993 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:20.004 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:20.038 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:20.038+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:20.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T07:06:20.139 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:20.138+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:20.177 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:20.177 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:20.178 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:20.178 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:20.178 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:20.188 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:20.200 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:20.240 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:20.240+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:20.341 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:20.341+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:20.363 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:20.363 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:20.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:20.363 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:20.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.364 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:20.364 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:20.364 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 57.589544408000002, 2023-10-08T07:06:20.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:06:20.364 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.364 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.364 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:20.364 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:20.364 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:20.364 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:06:20.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.365 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:20.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:20.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:20.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:06:20.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:06:20.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:06:20.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:06:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:06:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:06:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:06:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.367 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:06:20.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:06:20.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:06:20.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:06:20.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:06:20.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:06:20.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.369 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.369 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:06:20.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:06:20.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.369 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.369 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:06:20.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:06:20.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:06:20.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:06:20.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:06:20.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:06:20.370 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.370 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.371 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.371 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:20.371 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:20.371 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 57.589522862000003, 2023-10-08T07:06:20.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:06:20.371 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.371 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.371 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:20.371 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:20.371 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:06:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:20.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:06:20.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:06:20.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:06:20.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:06:20.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:06:20.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:06:20.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:06:20.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:06:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:06:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:06:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:06:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:06:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:06:20.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:06:20.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:06:20.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:06:20.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:06:20.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.377 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:06:20.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:06:20.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.377 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:06:20.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:06:20.377 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 57.589456267999999, 2023-10-08T07:06:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:06:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:06:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.380 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:20.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.380 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:06:20.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:06:20.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:06:20.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:06:20.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.381 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:06:20.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:06:20.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.381 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:06:20.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:06:20.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:06:20.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:06:20.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:06:20.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:06:20.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:06:20.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:06:20.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:06:20.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:06:20.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:06:20.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:06:20.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.384 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:06:20.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:06:20.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.384 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:06:20.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:06:20.385 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.385 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.385 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.385 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:20.385 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:20.385 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 57.589437371999999, 2023-10-08T07:06:20.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:06:20.385 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.385 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.386 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:20.386 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:20.386 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:20.386 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:06:20.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.386 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.386 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.386 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:20.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:06:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:06:20.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:06:20.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:06:20.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:06:20.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:06:20.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:06:20.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:06:20.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:06:20.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:06:20.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:06:20.391 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.392 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.392 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.392 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:20.392 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:20.392 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 57.589424362999999, 2023-10-08T07:06:20.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:20.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:20.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:20.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:20.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:20.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:20.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:20.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:20.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:20.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:20.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:20.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:20.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:20.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:20.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:20.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:20.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:20.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:20.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:20.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:20.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:20.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:20.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:20.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:20.399 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.399 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.399 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.399 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:20.399 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:20.400 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 57.589372310999998, 2023-10-08T07:06:20.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:20.400 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.400 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.400 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:20.400 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:20.400 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:20.400 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:20.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.400 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.400 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:20.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:20.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:20.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:20.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:20.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:20.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:20.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:20.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.044168483999997, 2023-10-08T07:06:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:06:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:06:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:06:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:06:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:06:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:06:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:06:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:06:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:06:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:06:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:06:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:06:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:06:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:06:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:06:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:06:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:06:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:06:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:06:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:06:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:06:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:06:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:06:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:06:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:06:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.044052006000001, 2023-10-08T07:06:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.044001678999997, 2023-10-08T07:06:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.043675833999998, 2023-10-08T07:06:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.043623308999997, 2023-10-08T07:06:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.043455334000001, 2023-10-08T07:06:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.043311035999999, 2023-10-08T07:06:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:20.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:20.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:20.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:20.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:20.458 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.459 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.459 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.459 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.459 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:20.459 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.042631524000001, 2023-10-08T07:06:20.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:20.459 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.459 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.042578253999999, 2023-10-08T07:06:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.042542408000003, 2023-10-08T07:06:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.042401877000003, 2023-10-08T07:06:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.042109554, 2023-10-08T07:06:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.041995911999997, 2023-10-08T07:06:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 47.040965688, 2023-10-08T07:06:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:20.522 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:20.527 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:20.527 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:20.527 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:20.528 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:20.528 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:20.522+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:20.529 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:20.529 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T07:06:20.529 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:20.623 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:20.623+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:20.668 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:20.668 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:20.678 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:20.724 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:20.724+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:20.803 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:20.803 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:20.813 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:20.857 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:20.856+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:20.925 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:20.925+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:20.939 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:20.939 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:20.950 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:21.026 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:21.026+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2023-10-08T07:06:21.091 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:21.091 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:21.101 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:21.127 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:21.126+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:21.227 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:21.227+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:21.268 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:21.269 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:21.279 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:21.328 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:21.328+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:21.406 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:21.407 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:21.417 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:21.430 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:21.429+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:21.531 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:21.531+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:21.564 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:21.564 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:21.574 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:21.631 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:21.631+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:21.708 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:21.708 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:21.718 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:21.762 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:21.761+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:21.833 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:21.832+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:21.850 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:21.850 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:21.860 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:21.934 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:21.933+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:21.995 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:21.995 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:22.005 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:22.035 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:22.033+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:22.131 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:22.131 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:22.135 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:22.134+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:22.141 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:22.236 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:22.235+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:22.308 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:22.308 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:22.318 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:22.363 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:22.363+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:22.437 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:22.437+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:22.452 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:22.452 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:22.462 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:22.530 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:22.548 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:22.548+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:22.630 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:22.630 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:22.639 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:22.638+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:22.640 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:22.684 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:22.704 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:22.726 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:22.727 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:22.727 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T07:06:22.727 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:22.739 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:22.739+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:22.810 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:22.810 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:22.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:22.810 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:22.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.810 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:22.811 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:22.811 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.491916033000003, 2023-10-08T07:06:22.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:22.811 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.811 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:22.811 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:22.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:22.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:22.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:22.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:22.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:22.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:22.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:22.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:22.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:22.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:22.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:22.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:22.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:22.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:22.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:22.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:22.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:22.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:22.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:22.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:22.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:22.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:22.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:22.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:22.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:22.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:22.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:22.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.817 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.818 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:22.818 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:22.818 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.491842249000001, 2023-10-08T07:06:22.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:22.818 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.818 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:22.818 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:22.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:22.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:22.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:22.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:22.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:22.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:22.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:22.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:22.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:22.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:22.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:22.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:22.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:22.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:22.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:22.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:22.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:22.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:22.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:22.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:22.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:22.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:22.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:22.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:22.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:22.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:22.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:22.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.824 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.825 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:22.825 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:22.825 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.491779073000004, 2023-10-08T07:06:22.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:22.825 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.825 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:22.825 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:22.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:22.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:22.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:22.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:22.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:22.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:22.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:22.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:22.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:22.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:22.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:22.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:22.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:22.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:22.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:22.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:22.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:22.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:22.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:22.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:22.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:22.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:22.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:22.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:22.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:22.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:22.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:22.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.831 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.831 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:22.832 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:22.832 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.491744726999997, 2023-10-08T07:06:22.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:22.832 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.832 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:22.832 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:22.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:22.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:22.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:22.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:22.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:22.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:22.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:22.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:22.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:22.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:22.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:22.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:22.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:22.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:22.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:22.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:22.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:22.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:22.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:22.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:22.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:22.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:22.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:22.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:22.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:22.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:22.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:22.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.838 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.839 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:22.839 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:22.839 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.491254501999997, 2023-10-08T07:06:22.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:22.839 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.839 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:22.839 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:22.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:22.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:22.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:22.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:22.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:22.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:22.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:22.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:22.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:22.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:22.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:22.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:22.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:22.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:22.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:22.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:22.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:22.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:22.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:22.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:22.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:22.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:22.845 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.845 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.845 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.845 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:22.845 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:22.845 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.491213924999997, 2023-10-08T07:06:22.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:22.846 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.846 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:22.846 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:22.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:22.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:22.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:22.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:22.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:22.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:22.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:22.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:22.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:22.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:22.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:22.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:22.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:22.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:22.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:22.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:22.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:22.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.851 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.852 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:22.852 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:22.852 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.491176355999997, 2023-10-08T07:06:22.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:22.852 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.852 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:22.852 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:22.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:22.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:22.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:22.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:22.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:22.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:22.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:22.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:22.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:22.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:22.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:22.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:22.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:22.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:22.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:22.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.856 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.856 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.491108916000002, 2023-10-08T07:06:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:22.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:22.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:22.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:22.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:22.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:22.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:22.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:22.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:22.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:22.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:22.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:22.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:22.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:22.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:22.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.861 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.861 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:22.861 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:22.862 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.491079274000001, 2023-10-08T07:06:22.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:22.862 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.862 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:22.862 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:22.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:22.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:22.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:22.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:22.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:22.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:22.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:22.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:22.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:22.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:22.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:22.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:22.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:22.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:22.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:22.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.866 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.867 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:22.867 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:22.867 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.485338712999997, 2023-10-08T07:06:22.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:22.867 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.867 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:22.867 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:22.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:22.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:22.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:22.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:22.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:22.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:22.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:22.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:22.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:22.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:22.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:22.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:22.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:22.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.871 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.872 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:22.872 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:22.872 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.484889373000001, 2023-10-08T07:06:22.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:22.872 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.872 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:22.872 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:22.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:22.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:22.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:22.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:22.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:22.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:22.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:22.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:22.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:22.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:22.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:22.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:22.876 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.876 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.876 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.877 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:22.877 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:22.877 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.484093483000002, 2023-10-08T07:06:22.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:22.877 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.877 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:22.877 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:22.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:22.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:22.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:22.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:22.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:22.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:22.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:22.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:22.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:22.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:22.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:22.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:22.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:22.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:22.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:22.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:22.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:22.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:22.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.882 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.882 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:22.882 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:22.882 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.483978131999997, 2023-10-08T07:06:22.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:22.883 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.883 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:22.883 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:22.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:22.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:22.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:22.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:22.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:22.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:22.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:22.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:22.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:22.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:22.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:22.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:22.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:22.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:22.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:22.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:22.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:22.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:22.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.887 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.888 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:22.888 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:22.888 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.478863566000001, 2023-10-08T07:06:22.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:22.888 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.888 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:22.888 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:22.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:22.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:22.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:22.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:22.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:22.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:22.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:22.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:22.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:22.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:22.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:22.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:22.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:22.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:22.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:22.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:22.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:22.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:22.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.893 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.894 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:22.894 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:22.894 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.478752573999998, 2023-10-08T07:06:22.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:22.894 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.894 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:22.894 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:22.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:22.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:22.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:22.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:22.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:22.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:22.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:22.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:22.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:22.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:22.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:22.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:22.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:22.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:22.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:22.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:22.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:22.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:22.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.899 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.899 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:22.899 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:22.899 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.478328132999998, 2023-10-08T07:06:22.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:22.900 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.900 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:22.900 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:22.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:22.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:22.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:22.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:22.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:22.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:22.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:22.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:22.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:22.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:22.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:22.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:22.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:22.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:22.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:22.904 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.904 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.904 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.905 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:22.905 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:22.905 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.478180997000003, 2023-10-08T07:06:22.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:22.905 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.905 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:22.905 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:22.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:22.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:22.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:22.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:22.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:22.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:22.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:22.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:22.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:22.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:22.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:22.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:22.909 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.406882727999999, 2023-10-08T07:06:22.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:22.910 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.910 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:22.910 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:22.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:22.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:22.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:22.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:22.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:22.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:22.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:22.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:22.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:22.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:22.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:22.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:22.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:22.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:22.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:22.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:22.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:22.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:22.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:22.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:22.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:22.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:22.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:22.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:22.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:22.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:22.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:22.915 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.915 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.916 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.916 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:22.916 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:22.916 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.405089144000002, 2023-10-08T07:06:22.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:22.916 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.916 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:22.916 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:22.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:22.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:22.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:22.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:22.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:22.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:22.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:22.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:22.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:22.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:22.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:22.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:22.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:22.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:22.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:22.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.920 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.921 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:22.921 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:22.921 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.406499474, 2023-10-08T07:06:22.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:22.921 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:22.921 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:22.921 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:22.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:22.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:22.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:22.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:22.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:22.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:22.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:22.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:22.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:22.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:22.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:22.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:22.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:22.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:22.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:22.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:22.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:22.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:22.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:22.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:22.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:22.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:22.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:22.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:22.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:22.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:22.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:22.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:22.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:22.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:22.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:22.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:22.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:22.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:22.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:22.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:22.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:22.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:22.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:22.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:22.928 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.928 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.928 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.928 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:22.928 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:22.928 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:22.930 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:22.930 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:22.929+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:23.031 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:23.030+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:23.076 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:23.077 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:23.077 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:23.086 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T07:06:23.087 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:23.131 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:23.131+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:23.232 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:23.231+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:23.260 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:23.260 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:23.261 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:23.261 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:23.261 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:23.271 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:23.332 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:23.332+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:23.405 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 60.631118096000002, 2023-10-08T07:06:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:06:23.405 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:06:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:06:23.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:06:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:06:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:06:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:06:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:06:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:06:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:06:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:06:23.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:06:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:06:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:06:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:06:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:06:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:06:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:06:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:06:23.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:06:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:06:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:06:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:06:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.412 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 60.631096550000002, 2023-10-08T07:06:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:06:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:23.413 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:06:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:06:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:06:23.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:06:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:06:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:06:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:06:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:06:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:06:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:06:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:06:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:06:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:06:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:06:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:06:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:06:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:06:23.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:06:23.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:06:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:06:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:06:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:06:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.422 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 60.631029955999999, 2023-10-08T07:06:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:06:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:23.423 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:06:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:06:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:06:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:06:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:06:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:06:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:06:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:06:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:06:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:06:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:06:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:06:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:06:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:06:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:06:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:06:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:06:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:06:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:06:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:06:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:06:23.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:06:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:06:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.430 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 60.631011059999999, 2023-10-08T07:06:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:06:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:06:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.431 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:06:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:06:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:06:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:06:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:06:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:06:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:06:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:06:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:06:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:06:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:06:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:06:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:06:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:06:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:06:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:06:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:06:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:06:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:06:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:06:23.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:06:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 60.630998050999999, 2023-10-08T07:06:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:23.438 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:23.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:23.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:23.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.445 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 60.630945998999998, 2023-10-08T07:06:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.446 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:23.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:23.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:23.453 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.085742172000003, 2023-10-08T07:06:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:06:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:06:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:06:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:06:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:06:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:06:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:06:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:06:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:06:23.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:06:23.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:23.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:06:23.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:06:23.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:06:23.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:06:23.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:06:23.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:06:23.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:06:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:06:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:06:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:06:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:06:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:06:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:06:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:06:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:06:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:23.462 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.085625694000001, 2023-10-08T07:06:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.470 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.085575366999997, 2023-10-08T07:06:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:23.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:23.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:23.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.085249521999998, 2023-10-08T07:06:23.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:23.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.085196996999997, 2023-10-08T07:06:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:23.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:23.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.494 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.085029022000001, 2023-10-08T07:06:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:23.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:23.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:23.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:23.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:23.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.084884723999998, 2023-10-08T07:06:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.502 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.504 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:23.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:23.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:23.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.084205212000001, 2023-10-08T07:06:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:23.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.511 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.084151941999998, 2023-10-08T07:06:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:23.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:23.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.084116096000002, 2023-10-08T07:06:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:23.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:23.529 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.083975565000003, 2023-10-08T07:06:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.531 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:23.532 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:23.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:23.534 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:23.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.537 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.083683241999999, 2023-10-08T07:06:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.538 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.539 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.541 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.542 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.543 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:23.544 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.083569599999997, 2023-10-08T07:06:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:23.545 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.546 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.547 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:23.548 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:23.550 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.551 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 50.082539376, 2023-10-08T07:06:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:23.552 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:23.553 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.555 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.556 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.557 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:23.558 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:23.559 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:23.560 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:23.559+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:23.660 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:23.660+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:23.698 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:23.699 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2023-10-08T07:06:23.699 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:23.709 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:23.761 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:23.760+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:23.835 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:23.836 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:23.836 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2023-10-08T07:06:23.836 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2023-10-08T07:06:23.836 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:23.846 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:23.890 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:23.889+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:23.963 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:23.963+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:23.975 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:23.976 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2023-10-08T07:06:23.976 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2023-10-08T07:06:23.976 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2023-10-08T07:06:23.976 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.977 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-10-08T07:06:23.977 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:23.977 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.658236358000003, 2023-10-08T07:06:23.977 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069404690000000003, 2023-10-08T07:06:23.977 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:23.977 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.978 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:23.978 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.978 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:23.978 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:23.978 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:23.978 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:23.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:23.979 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:23.979 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.979 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.979 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:23.979 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315211+0000", 2023-10-08T07:06:23.980 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:06:23.980 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.980 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.980 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:23.980 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315216+0000", 2023-10-08T07:06:23.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:06:23.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:23.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315229+0000", 2023-10-08T07:06:23.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.278e-05 2023-10-08T07:06:23.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.981 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.981 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.981 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315235+0000", 2023-10-08T07:06:23.981 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2023-10-08T07:06:23.981 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:23.982 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316390+0000", 2023-10-08T07:06:23.982 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011548179999999999 2023-10-08T07:06:23.982 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.982 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.982 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:23.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316410+0000", 2023-10-08T07:06:23.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0818999999999998e-05 2023-10-08T07:06:23.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:23.983 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322113+0000", 2023-10-08T07:06:23.983 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057026159999999998 2023-10-08T07:06:23.983 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.983 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.983 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:23.984 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322150+0000", 2023-10-08T07:06:23.984 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7401999999999999e-05 2023-10-08T07:06:23.984 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:23.984 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:23.984 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:23.984 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.985 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.985 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-10-08T07:06:23.985 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:23.985 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.200876588, 2023-10-08T07:06:23.985 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087059660000000007, 2023-10-08T07:06:23.986 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:23.986 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.986 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:23.986 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.986 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:23.987 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:23.987 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:23.987 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.987 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.987 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:23.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:23.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:23.988 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.988 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.988 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:23.988 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:23.988 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:06:23.989 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.989 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.989 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:23.989 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772604+0000", 2023-10-08T07:06:23.989 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.413e-05 2023-10-08T07:06:23.990 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.990 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.990 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:23.990 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772617+0000", 2023-10-08T07:06:23.990 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2595999999999999e-05 2023-10-08T07:06:23.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.991 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.991 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:23.991 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772624+0000", 2023-10-08T07:06:23.991 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2023-10-08T07:06:23.991 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:23.992 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772666+0000", 2023-10-08T07:06:23.992 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1925000000000003e-05 2023-10-08T07:06:23.992 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.992 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.992 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:23.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772685+0000", 2023-10-08T07:06:23.993 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9071000000000001e-05 2023-10-08T07:06:23.993 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.993 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.993 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:23.993 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781237+0000", 2023-10-08T07:06:23.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085519059999999997 2023-10-08T07:06:23.994 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.994 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.994 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:23.994 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781276+0000", 2023-10-08T07:06:23.994 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9161e-05 2023-10-08T07:06:23.995 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:23.995 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:23.995 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:23.995 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.995 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.995 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-10-08T07:06:23.995 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:23.995 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.200379933999997, 2023-10-08T07:06:23.996 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010997768, 2023-10-08T07:06:23.996 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:23.996 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:23.996 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:23.996 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.996 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:23.996 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:23.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:23.997 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.997 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.997 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:23.997 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:23.997 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:23.998 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.998 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.998 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:23.998 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773067+0000", 2023-10-08T07:06:23.998 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:06:23.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:23.999 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:23.999 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:23.999 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773071+0000", 2023-10-08T07:06:23.999 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3819999999999997e-06 2023-10-08T07:06:23.999 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773082+0000", 2023-10-08T07:06:24.000 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0407e-05 2023-10-08T07:06:24.000 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.000 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.000 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.000 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773087+0000", 2023-10-08T07:06:24.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:06:24.001 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.001 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.001 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.001 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775481+0000", 2023-10-08T07:06:24.001 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023941470000000001 2023-10-08T07:06:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775493+0000", 2023-10-08T07:06:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2126999999999999e-05 2023-10-08T07:06:24.003 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.003 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.003 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.003 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784021+0000", 2023-10-08T07:06:24.003 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085280589999999993 2023-10-08T07:06:24.004 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.004 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.004 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.004 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784064+0000", 2023-10-08T07:06:24.004 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.295e-05 2023-10-08T07:06:24.004 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.005 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.005 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.005 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.005 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.005 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:157 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'111, mlcod=11'105)", 2023-10-08T07:06:24.005 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:24.005 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.199959835999998, 2023-10-08T07:06:24.006 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010614554, 2023-10-08T07:06:24.006 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.006 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.006 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.006 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.007 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:24.007 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.007 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.007 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.007 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:24.008 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.008 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.008 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.008 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.008 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773487+0000", 2023-10-08T07:06:24.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:06:24.009 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.009 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.009 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.009 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773492+0000", 2023-10-08T07:06:24.009 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2249999999999999e-06 2023-10-08T07:06:24.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.010 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.010 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.010 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773503+0000", 2023-10-08T07:06:24.010 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0271e-05 2023-10-08T07:06:24.010 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.011 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.011 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773509+0000", 2023-10-08T07:06:24.011 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5470000000000002e-06 2023-10-08T07:06:24.011 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.011 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775801+0000", 2023-10-08T07:06:24.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022918790000000001 2023-10-08T07:06:24.012 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.012 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.012 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.012 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775822+0000", 2023-10-08T07:06:24.012 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1486000000000001e-05 2023-10-08T07:06:24.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.013 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.013 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784066+0000", 2023-10-08T07:06:24.013 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082432089999999996 2023-10-08T07:06:24.013 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.013 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.014 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.014 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784101+0000", 2023-10-08T07:06:24.014 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5383999999999999e-05 2023-10-08T07:06:24.014 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.014 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.014 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.015 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.015 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.015 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:158 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'112, mlcod=11'106)", 2023-10-08T07:06:24.015 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:24.015 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.199482738999997, 2023-10-08T07:06:24.015 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010172001999999999, 2023-10-08T07:06:24.016 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.016 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.016 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.016 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.016 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.016 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:24.016 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.016 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:24.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.017 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.017 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.017 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:24.017 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.82e-07 2023-10-08T07:06:24.017 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773990+0000", 2023-10-08T07:06:24.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2023-10-08T07:06:24.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.018 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.018 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.018 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774001+0000", 2023-10-08T07:06:24.018 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0873000000000001e-05 2023-10-08T07:06:24.018 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774006+0000", 2023-10-08T07:06:24.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0900000000000004e-06 2023-10-08T07:06:24.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.019 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.019 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.019 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776145+0000", 2023-10-08T07:06:24.019 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021389759999999999 2023-10-08T07:06:24.019 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776165+0000", 2023-10-08T07:06:24.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9548e-05 2023-10-08T07:06:24.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.020 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784102+0000", 2023-10-08T07:06:24.020 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007937342 2023-10-08T07:06:24.020 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.020 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.020 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.021 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784136+0000", 2023-10-08T07:06:24.021 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3331000000000003e-05 2023-10-08T07:06:24.021 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.021 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.021 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.021 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.021 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.021 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:159 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'113, mlcod=11'106)", 2023-10-08T07:06:24.021 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.198949781000003, 2023-10-08T07:06:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096667119999999992, 2023-10-08T07:06:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:24.022 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:24.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.023 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.023 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:24.023 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:06:24.023 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.023 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774501+0000", 2023-10-08T07:06:24.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1529999999999999e-06 2023-10-08T07:06:24.024 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.024 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.024 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.024 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774511+0000", 2023-10-08T07:06:24.024 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:06:24.025 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.025 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.025 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.025 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774533+0000", 2023-10-08T07:06:24.025 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2348999999999999e-05 2023-10-08T07:06:24.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.026 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.026 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776608+0000", 2023-10-08T07:06:24.026 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002074799 2023-10-08T07:06:24.026 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.026 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776627+0000", 2023-10-08T07:06:24.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8632999999999999e-05 2023-10-08T07:06:24.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.027 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784138+0000", 2023-10-08T07:06:24.027 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075110819999999997 2023-10-08T07:06:24.027 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.027 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.027 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.028 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784163+0000", 2023-10-08T07:06:24.028 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5425000000000001e-05 2023-10-08T07:06:24.028 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.028 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.028 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.028 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.028 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.028 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:160 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'114, mlcod=11'106)", 2023-10-08T07:06:24.028 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:24.028 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.198314599, 2023-10-08T07:06:24.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090478150000000007, 2023-10-08T07:06:24.029 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.029 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.029 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:24.029 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.029 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.029 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.029 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.029 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:24.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.030 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775133+0000", 2023-10-08T07:06:24.030 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2023-10-08T07:06:24.030 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.030 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.030 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775150+0000", 2023-10-08T07:06:24.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6206e-05 2023-10-08T07:06:24.031 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.031 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.031 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.031 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775173+0000", 2023-10-08T07:06:24.031 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.351e-05 2023-10-08T07:06:24.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775187+0000", 2023-10-08T07:06:24.032 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4396000000000001e-05 2023-10-08T07:06:24.032 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.032 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.032 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.032 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776909+0000", 2023-10-08T07:06:24.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017220429999999999 2023-10-08T07:06:24.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776929+0000", 2023-10-08T07:06:24.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9313e-05 2023-10-08T07:06:24.033 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.033 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.033 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.033 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784164+0000", 2023-10-08T07:06:24.033 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072352340000000001 2023-10-08T07:06:24.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.034 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.034 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.034 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:24.034 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526e-05 2023-10-08T07:06:24.034 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.034 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.034 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.034 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.035 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:161 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'115, mlcod=11'106)", 2023-10-08T07:06:24.035 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:24.035 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.19763571, 2023-10-08T07:06:24.035 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083874480000000005, 2023-10-08T07:06:24.035 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.035 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.035 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.035 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.035 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:24.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.036 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:24.036 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.036 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.036 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.036 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:24.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:06:24.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775837+0000", 2023-10-08T07:06:24.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6081e-05 2023-10-08T07:06:24.037 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.037 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.037 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.037 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775849+0000", 2023-10-08T07:06:24.037 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:06:24.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775854+0000", 2023-10-08T07:06:24.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1490000000000002e-06 2023-10-08T07:06:24.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.038 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.038 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777220+0000", 2023-10-08T07:06:24.038 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001365174 2023-10-08T07:06:24.038 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.038 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777232+0000", 2023-10-08T07:06:24.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2293000000000001e-05 2023-10-08T07:06:24.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:24.039 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069481450000000002 2023-10-08T07:06:24.039 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.039 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.039 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.039 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784198+0000", 2023-10-08T07:06:24.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2023-10-08T07:06:24.040 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.040 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.040 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.040 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.040 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.040 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:162 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'116, mlcod=11'106)", 2023-10-08T07:06:24.040 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:24.040 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.197011308, 2023-10-08T07:06:24.040 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077785969999999999, 2023-10-08T07:06:24.040 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.040 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.041 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:24.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.041 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.041 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.041 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:24.041 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.041 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776436+0000", 2023-10-08T07:06:24.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:06:24.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.042 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776440+0000", 2023-10-08T07:06:24.042 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2629999999999997e-06 2023-10-08T07:06:24.042 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.042 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.042 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776451+0000", 2023-10-08T07:06:24.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1385e-05 2023-10-08T07:06:24.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776456+0000", 2023-10-08T07:06:24.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9919999999999998e-06 2023-10-08T07:06:24.043 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.043 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.043 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.043 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777629+0000", 2023-10-08T07:06:24.043 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001173297 2023-10-08T07:06:24.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777650+0000", 2023-10-08T07:06:24.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0126e-05 2023-10-08T07:06:24.044 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.044 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.044 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.044 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784199+0000", 2023-10-08T07:06:24.044 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006548908 2023-10-08T07:06:24.045 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.045 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.045 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.045 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:24.045 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5071e-05 2023-10-08T07:06:24.045 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.046 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.046 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.046 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.046 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.046 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:163 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'117, mlcod=11'106)", 2023-10-08T07:06:24.046 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:24.046 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.196368901, 2023-10-08T07:06:24.046 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071515490000000001, 2023-10-08T07:06:24.046 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.046 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.047 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:24.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.047 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.047 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.047 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:24.047 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.047 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777078+0000", 2023-10-08T07:06:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4400000000000001e-07 2023-10-08T07:06:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777082+0000", 2023-10-08T07:06:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.732e-06 2023-10-08T07:06:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.048 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777095+0000", 2023-10-08T07:06:24.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3749e-05 2023-10-08T07:06:24.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777100+0000", 2023-10-08T07:06:24.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.634e-06 2023-10-08T07:06:24.049 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.049 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.049 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.049 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777944+0000", 2023-10-08T07:06:24.049 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00084377599999999997 2023-10-08T07:06:24.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777957+0000", 2023-10-08T07:06:24.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.276e-05 2023-10-08T07:06:24.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.050 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.050 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:24.050 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006257617 2023-10-08T07:06:24.050 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.050 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.051 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.051 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784229+0000", 2023-10-08T07:06:24.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4837e-05 2023-10-08T07:06:24.051 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.051 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.051 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.051 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.051 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.051 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:164 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'118, mlcod=11'106)", 2023-10-08T07:06:24.051 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:24.051 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 61.195787562, 2023-10-08T07:06:24.051 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093104280000000008, 2023-10-08T07:06:24.052 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.052 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.052 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:24.052 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.052 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.052 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.052 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.052 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2e-07 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777713+0000", 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4079999999999997e-05 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.053 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777724+0000", 2023-10-08T07:06:24.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0652999999999999e-05 2023-10-08T07:06:24.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.054 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.054 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.054 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777729+0000", 2023-10-08T07:06:24.054 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2050000000000001e-06 2023-10-08T07:06:24.054 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778177+0000", 2023-10-08T07:06:24.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044763499999999999 2023-10-08T07:06:24.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.055 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778195+0000", 2023-10-08T07:06:24.055 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8125e-05 2023-10-08T07:06:24.055 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.055 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.055 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786935+0000", 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087396049999999992 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786969+0000", 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4604999999999998e-05 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.056 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.057 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:24.057 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.657899131999997, 2023-10-08T07:06:24.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013957681, 2023-10-08T07:06:24.057 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.057 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.057 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.057 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.057 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.057 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:24.057 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.057 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:24.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.058 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.058 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315552+0000", 2023-10-08T07:06:24.058 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.152e-06 2023-10-08T07:06:24.058 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.058 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315568+0000", 2023-10-08T07:06:24.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5301000000000001e-05 2023-10-08T07:06:24.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.059 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315583+0000", 2023-10-08T07:06:24.059 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5826000000000001e-05 2023-10-08T07:06:24.059 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.059 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.059 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315598+0000", 2023-10-08T07:06:24.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4953999999999999e-05 2023-10-08T07:06:24.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317200+0000", 2023-10-08T07:06:24.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016014950000000001 2023-10-08T07:06:24.060 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.060 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.060 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.060 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317351+0000", 2023-10-08T07:06:24.060 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015081400000000001 2023-10-08T07:06:24.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317540+0000", 2023-10-08T07:06:24.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000189557 2023-10-08T07:06:24.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.061 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:24.061 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322281+0000", 2023-10-08T07:06:24.061 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047409599999999998 2023-10-08T07:06:24.061 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.061 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329404+0000", 2023-10-08T07:06:24.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071225460000000004 2023-10-08T07:06:24.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329459+0000", 2023-10-08T07:06:24.062 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5016999999999999e-05 2023-10-08T07:06:24.062 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.062 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.062 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.062 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329505+0000", 2023-10-08T07:06:24.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059000000000001e-05 2023-10-08T07:06:24.063 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.063 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.063 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.063 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.063 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.063 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.063 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:24.063 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.657816163, 2023-10-08T07:06:24.063 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015617259, 2023-10-08T07:06:24.063 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.064 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315631+0000", 2023-10-08T07:06:24.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2023-10-08T07:06:24.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.065 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.065 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315636+0000", 2023-10-08T07:06:24.065 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1019999999999996e-06 2023-10-08T07:06:24.065 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.065 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315646+0000", 2023-10-08T07:06:24.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0056e-05 2023-10-08T07:06:24.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315654+0000", 2023-10-08T07:06:24.066 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7810000000000005e-06 2023-10-08T07:06:24.066 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.066 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.066 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.066 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318626+0000", 2023-10-08T07:06:24.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00297183 2023-10-08T07:06:24.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319450+0000", 2023-10-08T07:06:24.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082440400000000004 2023-10-08T07:06:24.067 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.067 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.067 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.067 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319924+0000", 2023-10-08T07:06:24.067 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047403099999999997 2023-10-08T07:06:24.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:24.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322475+0000", 2023-10-08T07:06:24.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002550442 2023-10-08T07:06:24.068 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.068 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.068 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.068 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331142+0000", 2023-10-08T07:06:24.068 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086669030000000001 2023-10-08T07:06:24.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331217+0000", 2023-10-08T07:06:24.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5606999999999996e-05 2023-10-08T07:06:24.069 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.069 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.069 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.069 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331247+0000", 2023-10-08T07:06:24.069 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:06:24.070 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.070 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.070 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.070 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.070 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.070 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:15 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.070 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:24.070 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.656652723999997, 2023-10-08T07:06:24.070 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012716055, 2023-10-08T07:06:24.070 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.070 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.071 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:24.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.071 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.071 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:24.071 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.071 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.071 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:24.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8599999999999997e-07 2023-10-08T07:06:24.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.072 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316805+0000", 2023-10-08T07:06:24.072 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0475000000000001e-05 2023-10-08T07:06:24.072 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.072 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.072 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316817+0000", 2023-10-08T07:06:24.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.226e-05 2023-10-08T07:06:24.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316828+0000", 2023-10-08T07:06:24.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1090999999999999e-05 2023-10-08T07:06:24.073 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.073 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.073 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.073 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317025+0000", 2023-10-08T07:06:24.073 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019711500000000001 2023-10-08T07:06:24.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317244+0000", 2023-10-08T07:06:24.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021908999999999999 2023-10-08T07:06:24.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.074 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.074 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.074 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317436+0000", 2023-10-08T07:06:24.074 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019164900000000001 2023-10-08T07:06:24.074 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:24.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321493+0000", 2023-10-08T07:06:24.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040573190000000002 2023-10-08T07:06:24.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.075 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329275+0000", 2023-10-08T07:06:24.075 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077820950000000002 2023-10-08T07:06:24.075 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.075 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.075 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329457+0000", 2023-10-08T07:06:24.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018165600000000001 2023-10-08T07:06:24.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.076 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.076 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.076 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329510+0000", 2023-10-08T07:06:24.076 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2519000000000003e-05 2023-10-08T07:06:24.076 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.076 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.076 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.076 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.077 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:27 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.077 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:24.077 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.656591933000001, 2023-10-08T07:06:24.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015441417000000001, 2023-10-08T07:06:24.077 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.077 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.077 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.077 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.077 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.077 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:24.077 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:24.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.078 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.078 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.078 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316855+0000", 2023-10-08T07:06:24.078 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:24.078 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316861+0000", 2023-10-08T07:06:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6210000000000001e-06 2023-10-08T07:06:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316869+0000", 2023-10-08T07:06:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.225e-06 2023-10-08T07:06:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316878+0000", 2023-10-08T07:06:24.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8799999999999997e-06 2023-10-08T07:06:24.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319969+0000", 2023-10-08T07:06:24.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030906689999999999 2023-10-08T07:06:24.080 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.080 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.080 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.080 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320072+0000", 2023-10-08T07:06:24.080 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103458 2023-10-08T07:06:24.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320631+0000", 2023-10-08T07:06:24.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055936099999999997 2023-10-08T07:06:24.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.081 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:24.081 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322686+0000", 2023-10-08T07:06:24.081 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020545899999999998 2023-10-08T07:06:24.081 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.081 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332244+0000", 2023-10-08T07:06:24.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095578690000000001 2023-10-08T07:06:24.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.082 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332274+0000", 2023-10-08T07:06:24.082 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0527000000000001e-05 2023-10-08T07:06:24.082 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.082 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.082 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.083 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332296+0000", 2023-10-08T07:06:24.083 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1359999999999999e-05 2023-10-08T07:06:24.083 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.083 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.083 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.083 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.083 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.083 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.083 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:24.083 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.656555343999997, 2023-10-08T07:06:24.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014502582, 2023-10-08T07:06:24.084 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.084 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.084 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.084 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:24.084 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.084 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.084 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.084 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:24.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316892+0000", 2023-10-08T07:06:24.085 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:06:24.085 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.085 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.085 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.085 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316896+0000", 2023-10-08T07:06:24.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9140000000000001e-06 2023-10-08T07:06:24.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316904+0000", 2023-10-08T07:06:24.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1170000000000004e-06 2023-10-08T07:06:24.086 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.086 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.086 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.086 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316911+0000", 2023-10-08T07:06:24.086 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:06:24.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320938+0000", 2023-10-08T07:06:24.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040269959999999997 2023-10-08T07:06:24.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.087 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.087 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321023+0000", 2023-10-08T07:06:24.087 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5420000000000005e-05 2023-10-08T07:06:24.087 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.087 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321157+0000", 2023-10-08T07:06:24.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013383700000000001 2023-10-08T07:06:24.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:24.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322742+0000", 2023-10-08T07:06:24.088 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015851249999999999 2023-10-08T07:06:24.088 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.088 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.088 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.088 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331290+0000", 2023-10-08T07:06:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085483190000000004 2023-10-08T07:06:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331348+0000", 2023-10-08T07:06:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7630999999999998e-05 2023-10-08T07:06:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331394+0000", 2023-10-08T07:06:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5534999999999997e-05 2023-10-08T07:06:24.089 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.090 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.090 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.090 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.090 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.090 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:24.090 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.656526855999999, 2023-10-08T07:06:24.090 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015363402, 2023-10-08T07:06:24.090 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.090 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.090 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.090 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:24.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:24.091 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.091 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.091 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.091 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.091 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316920+0000", 2023-10-08T07:06:24.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2023-10-08T07:06:24.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316923+0000", 2023-10-08T07:06:24.092 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2169999999999999e-06 2023-10-08T07:06:24.092 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.092 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.092 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.092 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316930+0000", 2023-10-08T07:06:24.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:06:24.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316938+0000", 2023-10-08T07:06:24.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:06:24.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.093 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.093 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.093 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322217+0000", 2023-10-08T07:06:24.093 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052793680000000004 2023-10-08T07:06:24.093 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322295+0000", 2023-10-08T07:06:24.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7621999999999996e-05 2023-10-08T07:06:24.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.094 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.094 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322411+0000", 2023-10-08T07:06:24.094 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000116297 2023-10-08T07:06:24.094 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.094 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323187+0000", 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077583700000000003 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332224+0000", 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090370980000000004 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332261+0000", 2023-10-08T07:06:24.095 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6464999999999997e-05 2023-10-08T07:06:24.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.096 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.096 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332283+0000", 2023-10-08T07:06:24.096 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2124e-05 2023-10-08T07:06:24.096 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.096 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.096 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.096 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.096 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.096 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.097 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:24.097 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.655403671999998, 2023-10-08T07:06:24.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014463023, 2023-10-08T07:06:24.097 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.097 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.097 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.097 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.097 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:24.097 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.097 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.097 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:24.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.098 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318044+0000", 2023-10-08T07:06:24.098 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1000000000000001e-06 2023-10-08T07:06:24.098 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.098 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.098 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318057+0000", 2023-10-08T07:06:24.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2860000000000001e-05 2023-10-08T07:06:24.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318067+0000", 2023-10-08T07:06:24.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0638999999999999e-05 2023-10-08T07:06:24.099 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.099 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.099 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.099 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318090+0000", 2023-10-08T07:06:24.099 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2889000000000001e-05 2023-10-08T07:06:24.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320985+0000", 2023-10-08T07:06:24.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028951279999999999 2023-10-08T07:06:24.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.100 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.100 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321126+0000", 2023-10-08T07:06:24.100 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014045600000000001 2023-10-08T07:06:24.100 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.100 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321798+0000", 2023-10-08T07:06:24.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067266600000000004 2023-10-08T07:06:24.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:24.101 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323135+0000", 2023-10-08T07:06:24.101 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013368589999999999 2023-10-08T07:06:24.101 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.101 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.101 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332445+0000", 2023-10-08T07:06:24.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093094419999999994 2023-10-08T07:06:24.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:24.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332482+0000", 2023-10-08T07:06:24.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:24.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.102 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.102 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.102 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332506+0000", 2023-10-08T07:06:24.102 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3649e-05 2023-10-08T07:06:24.103 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.103 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.103 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.103 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.103 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.103 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:24.103 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.655335162999997, 2023-10-08T07:06:24.103 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011597616999999999, 2023-10-08T07:06:24.103 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.103 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:24.103 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:24.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.104 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:24.104 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.104 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.104 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318112+0000", 2023-10-08T07:06:24.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2299999999999999e-07 2023-10-08T07:06:24.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318117+0000", 2023-10-08T07:06:24.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1170000000000003e-06 2023-10-08T07:06:24.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.105 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.105 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.105 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318127+0000", 2023-10-08T07:06:24.105 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0129000000000001e-05 2023-10-08T07:06:24.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318136+0000", 2023-10-08T07:06:24.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3610000000000001e-06 2023-10-08T07:06:24.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.106 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.106 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:24.106 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101062 2023-10-08T07:06:24.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.106 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318422+0000", 2023-10-08T07:06:24.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018560500000000001 2023-10-08T07:06:24.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.107 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.107 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.107 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329709+0000", 2023-10-08T07:06:24.107 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01128642 2023-10-08T07:06:24.107 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.107 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.107 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.107 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.108 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.108 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:24.108 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 50.655296043, 2023-10-08T07:06:24.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088267940000000007, 2023-10-08T07:06:24.108 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:24.108 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:24.108 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:24.108 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.108 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:24.108 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:24.108 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:24.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:24.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:24.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.109 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:24.109 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318151+0000", 2023-10-08T07:06:24.109 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:06:24.109 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.109 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:24.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318154+0000", 2023-10-08T07:06:24.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9529999999999999e-06 2023-10-08T07:06:24.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:24.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318161+0000", 2023-10-08T07:06:24.110 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.126e-06 2023-10-08T07:06:24.110 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.110 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.110 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.110 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318167+0000", 2023-10-08T07:06:24.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2169999999999999e-06 2023-10-08T07:06:24.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:24.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319711+0000", 2023-10-08T07:06:24.111 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015438769999999999 2023-10-08T07:06:24.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.111 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.111 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:24.111 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319864+0000", 2023-10-08T07:06:24.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015264799999999999 2023-10-08T07:06:24.112 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:24.112 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:24.112 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:24.112 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.326977+0000", 2023-10-08T07:06:24.112 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071133890000000003 2023-10-08T07:06:24.112 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.112 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.112 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.112 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:24.112 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:24.113 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:24.114 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:24.114+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:24.115 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2023-10-08T07:06:24.115 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:24.215 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:24.214+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:24.254 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:24.255 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:24.255 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:24.255 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:24.266 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:24.317 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:24.316+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:24.394 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:24.394 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:24.404 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:24.417 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:24.417+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:24.518 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:24.517+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:24.574 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:24.574 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.255346474, 2023-10-08T07:06:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:24.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.583 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.255272689999998, 2023-10-08T07:06:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.584 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:24.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:24.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:24.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.592 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.255209514000001, 2023-10-08T07:06:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:24.593 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:24.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:24.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:24.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:24.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:24.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:24.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:24.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:24.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:24.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:24.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:24.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:24.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.605 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.606 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.606 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:24.607 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.255175168000001, 2023-10-08T07:06:24.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:24.607 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.607 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:24.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:24.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:24.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:24.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:24.614 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.254684943000001, 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:24.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:24.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:24.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.254644366000001, 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:24.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:24.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.254606797000001, 2023-10-08T07:06:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:24.627 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.631 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.254539356999999, 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:24.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.636 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.254509714999998, 2023-10-08T07:06:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:24.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.641 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.248769154000001, 2023-10-08T07:06:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:24.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.248319813999998, 2023-10-08T07:06:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:24.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:24.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.650 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.650 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:24.650 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:24.650 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.247523923999999, 2023-10-08T07:06:24.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:24.650 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.650 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.651 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:24.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:24.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:24.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:24.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:24.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:24.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:24.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:24.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:24.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:24.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:24.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:24.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:24.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.247408573000001, 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.655 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:24.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:24.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:24.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:24.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:24.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:24.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:24.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:24.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:24.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:24.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:24.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:24.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:24.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:24.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:24.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:24.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:24.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.242294006999998, 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.660 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:24.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:24.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:24.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:24.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:24.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:24.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:24.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:24.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:24.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:24.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:24.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.242183015000002, 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:24.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:24.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:24.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:24.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:24.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:24.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.669 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.241758574000002, 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:24.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:24.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:24.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:24.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:24.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:24.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:24.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:24.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:24.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:24.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:24.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:24.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.674 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.674 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:24.674 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:24.674 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.241611438, 2023-10-08T07:06:24.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:24.675 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.675 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:24.675 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:24.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:24.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:24.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:24.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:24.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:24.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:24.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:24.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:24.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:24.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.678 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.678 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:24.679 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:24.679 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.170313169000003, 2023-10-08T07:06:24.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:24.679 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.679 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.679 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:24.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:24.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:24.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:24.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:24.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:24.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:24.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:24.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:24.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:24.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:24.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:24.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:24.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:24.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:24.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:24.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:24.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:24.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.684 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.685 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:24.685 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:24.685 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.168519584999999, 2023-10-08T07:06:24.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:24.685 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.685 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:24.685 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:24.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:24.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:24.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:24.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:24.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:24.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:24.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:24.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:24.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:24.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:24.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:24.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:24.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:24.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:24.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:24.689 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.689 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.689 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.169929915000001, 2023-10-08T07:06:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:24.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:24.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:24.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:24.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:24.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:24.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:24.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:24.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:24.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:24.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:24.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:24.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:24.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:24.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:24.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:24.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:24.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:24.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:24.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:24.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:24.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:24.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:24.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:24.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:24.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:24.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:24.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:24.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:24.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:24.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:24.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:24.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:24.696 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:24.698 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:24.698 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:24.697+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:24.743 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:24.799 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:24.798+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:24.844 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:24.844 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:24.844 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:24.845 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:24.855 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:24.899 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:24.899+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:24.975 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:24.990 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:24.990 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:25.000 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:25.001 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:24.999+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:25.003 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T07:06:25.003 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T07:06:25.003 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-10-08T07:06:25.004 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-10-08T07:06:25.004 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-10-08T07:06:25.004 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-10-08T07:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:25.028 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:25.028 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T07:06:25.028 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:25.101 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:25.101+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:25.174 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:25.174 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "" 2023-10-08T07:06:25.175 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:25.176 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:25.176 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:25.187 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:25.202 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:25.201+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:25.303 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:25.303+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:25.326 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:25.327 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:25.337 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:25.403 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:25.402+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:25.464 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:25.464 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:25.474 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:25.506 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:25.506+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:25.607 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:25.607+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:25.640 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:25.641 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:25.650 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:25.708 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:25.708+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:25.791 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:25.791 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:25.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:25.810 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:25.809+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:25.911 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:25.910+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:25.929 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:25.929 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:25.939 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:26.012 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:26.012+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:26.066 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:26.066 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:26.075 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:26.116 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T07:06:26.119 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:26.118+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:26.214 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:26.213+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:26.221 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:26.222 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:26.232 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:26.316 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:26.316+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:26.405 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:26.405 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:26.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:26.417 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:26.416+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:26.518 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:26.517+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:26.547 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:26.548 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:26.558 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:26.619 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:26.619+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:26.697 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:26.698 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:26.707 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:26.752 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:26.751+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:26.822 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:26.821+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:26.834 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:26.834 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:26.845 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:26.925 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:26.923+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:27.011 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:27.011 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:27.022 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:27.023 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:27.023+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:27.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:27.104 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2023-10-08T07:06:27.125 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:27.124+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:27.163 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:27.163 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:27.173 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:27.226 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:27.226+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:27.277 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:27.312 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:27.327 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:27.327+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:27.342 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:27.342 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:27.348 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:27.350 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:27.350 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T07:06:27.350 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:27.352 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:27.428 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:27.427+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:27.520 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:27.520 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.202448050000001, 2023-10-08T07:06:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:27.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.529 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.529 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:27.529 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:27.529 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.202374266, 2023-10-08T07:06:27.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:27.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:27.530 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:27.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:27.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:27.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:27.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:27.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:27.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:27.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:27.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:27.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:27.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:27.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:27.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:27.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:27.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:27.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:27.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:27.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:27.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:27.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:27.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:27.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:27.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:27.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:27.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:27.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:27.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:27.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:27.538 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.538 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.538 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.539 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:27.539 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:27.539 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.202311090000002, 2023-10-08T07:06:27.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:27.539 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.539 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:27.540 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:27.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:27.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:27.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:27.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:27.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:27.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:27.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:27.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:27.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:27.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:27.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:27.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:27.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:27.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:27.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:27.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:27.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:27.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:27.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:27.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:27.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:27.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:27.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:27.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:27.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:27.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:27.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:27.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.547 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.547 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:27.547 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:27.547 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.202276744000002, 2023-10-08T07:06:27.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:27.547 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.547 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:27.548 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:27.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:27.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:27.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:27.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:27.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:27.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:27.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:27.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:27.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:27.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:27.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:27.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:27.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:27.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:27.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:27.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:27.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:27.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.554 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.555 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:27.555 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:27.555 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.201786519000002, 2023-10-08T07:06:27.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:27.555 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.555 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:27.555 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:27.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:27.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:27.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:27.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:27.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:27.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:27.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:27.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:27.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:27.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:27.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:27.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:27.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:27.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:27.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:27.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:27.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:27.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:27.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:27.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:27.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:27.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:27.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.563 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:27.563 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:27.563 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.201745942000002, 2023-10-08T07:06:27.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:27.563 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.563 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:27.563 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:27.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:27.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:27.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:27.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:27.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:27.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:27.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:27.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:27.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:27.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:27.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:27.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:27.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:27.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:27.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:27.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:27.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:27.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:27.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:27.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:27.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:27.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:27.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:27.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:27.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:27.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:27.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:27.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.572 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.573 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:27.573 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:27.573 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.201708373000002, 2023-10-08T07:06:27.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:27.573 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.573 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:27.574 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:27.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:27.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:27.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:27.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:27.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:27.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:27.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:27.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:27.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:27.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:27.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:27.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:27.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:27.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:27.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:27.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.580 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.580 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:27.580 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:27.580 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.201640933, 2023-10-08T07:06:27.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:27.581 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.581 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:27.581 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:27.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:27.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:27.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:27.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:27.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:27.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:27.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:27.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:27.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:27.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:27.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:27.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:27.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:27.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:27.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:27.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.586 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.586 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:27.586 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:27.586 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.201611290999999, 2023-10-08T07:06:27.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:27.587 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.587 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:27.587 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:27.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:27.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:27.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:27.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:27.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:27.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:27.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:27.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:27.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:27.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:27.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:27.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:27.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:27.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:27.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:27.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.591 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.591 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:27.591 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:27.591 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.195870730000003, 2023-10-08T07:06:27.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:27.592 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.592 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:27.592 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:27.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:27.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:27.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:27.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:27.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:27.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:27.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:27.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:27.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:27.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:27.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:27.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:27.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:27.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.597 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.598 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:27.598 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:27.598 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.19542139, 2023-10-08T07:06:27.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:27.598 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.598 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:27.599 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:27.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:27.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:27.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:27.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:27.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:27.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.604 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.605 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:27.605 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:27.605 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.194625500000001, 2023-10-08T07:06:27.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:27.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.606 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:27.606 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:27.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:27.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:27.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:27.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:27.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:27.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:27.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:27.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:27.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:27.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:27.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:27.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:27.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:27.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:27.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:27.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:27.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:27.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:27.610 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.610 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.611 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:27.611 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:27.611 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.194510149000003, 2023-10-08T07:06:27.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:27.611 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.611 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:27.611 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:27.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:27.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:27.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:27.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:27.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:27.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:27.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:27.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:27.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:27.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:27.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:27.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:27.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:27.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:27.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:27.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:27.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:27.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:27.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.619 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.619 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.619 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:27.619 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:27.620 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.189395583, 2023-10-08T07:06:27.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:27.620 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.620 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:27.620 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:27.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:27.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:27.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:27.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:27.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:27.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:27.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:27.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:27.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:27.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:27.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:27.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:27.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:27.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:27.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:27.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.625 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:27.626 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.189284591000003, 2023-10-08T07:06:27.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:27.627 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.627 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:27.627 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:27.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:27.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:27.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:27.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:27.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:27.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:27.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:27.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:27.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:27.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:27.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:27.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:27.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:27.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:27.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:27.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:27.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:27.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:27.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.632 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.632 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:27.632 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:27.632 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.188860149999996, 2023-10-08T07:06:27.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:27.633 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.633 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:27.633 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:27.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:27.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:27.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:27.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:27.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:27.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:27.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:27.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:27.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:27.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:27.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:27.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:27.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:27.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:27.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:27.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.638 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.638 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:27.638 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:27.638 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.188713014000001, 2023-10-08T07:06:27.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:27.638 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.639 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:27.639 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:27.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:27.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:27.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:27.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:27.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:27.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:27.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:27.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:27.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:27.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:27.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:27.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:27.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:27.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.645 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.645 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:27.645 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:27.646 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.117414744999998, 2023-10-08T07:06:27.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:27.646 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.646 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:27.646 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:27.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:27.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:27.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:27.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:27.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:27.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:27.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:27.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:27.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:27.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:27.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:27.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:27.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:27.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:27.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:27.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:27.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:27.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:27.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:27.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:27.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:27.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:27.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:27.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:27.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:27.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:27.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:27.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.652 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.652 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:27.652 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:27.653 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.115621161, 2023-10-08T07:06:27.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:27.653 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.653 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:27.653 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:27.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:27.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:27.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:27.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:27.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:27.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:27.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:27.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:27.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:27.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:27.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:27.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:27.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:27.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:27.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:27.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.657 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.658 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:27.658 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:27.658 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.117031490999999, 2023-10-08T07:06:27.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:27.658 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:27.658 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:27.658 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:27.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:27.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:27.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:27.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:27.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:27.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:27.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:27.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:27.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:27.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:27.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:27.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:27.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:27.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:27.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:27.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:27.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:27.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:27.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:27.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:27.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:27.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:27.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:27.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:27.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:27.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:27.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:27.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:27.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:27.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:27.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:27.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:27.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:27.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:27.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:27.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:27.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:27.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:27.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:27.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:27.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.665 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:27.665 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:27.665 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:27.667 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:27.667 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:27.665+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:27.768 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:27.768+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:27.813 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:27.813 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:27.813 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:27.814 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:27.825 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:27.869 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:27.868+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:27.957 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:27.957 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:27.957 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:27.958 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:27.958 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:27.968 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:27.970 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:27.969+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:28.072 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:28.071+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:28.145 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:28.145 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:28.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:28.146 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:28.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.146 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:28.146 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:28.146 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 65.370393738999994, 2023-10-08T07:06:28.146 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:06:28.146 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.146 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.146 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:28.147 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:28.147 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:28.147 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:06:28.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.147 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:28.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:28.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:28.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:06:28.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.149 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.149 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:06:28.149 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:06:28.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.149 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.149 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:06:28.149 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:06:28.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.150 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.150 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.150 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:06:28.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:06:28.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.150 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.150 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.150 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:06:28.151 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:06:28.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.151 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.151 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:06:28.151 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:06:28.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.151 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.151 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:06:28.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:06:28.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:06:28.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:06:28.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:06:28.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:06:28.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.153 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.153 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:06:28.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:06:28.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.153 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.154 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:06:28.154 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:06:28.154 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.154 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.154 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.154 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:28.154 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:28.154 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 65.370372192999994, 2023-10-08T07:06:28.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:06:28.155 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.155 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.155 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:28.155 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:28.155 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:28.155 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:06:28.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.155 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.156 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.156 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:28.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.156 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.156 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:28.157 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.157 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.157 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:28.157 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:06:28.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.157 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.158 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:06:28.158 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:06:28.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.158 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.158 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:06:28.158 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:06:28.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:06:28.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:06:28.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:06:28.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:06:28.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:06:28.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:06:28.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:06:28.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:06:28.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.161 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.161 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:06:28.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:06:28.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.161 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.161 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:06:28.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:06:28.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.162 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:06:28.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:06:28.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.162 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:06:28.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:06:28.162 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.162 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.163 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.163 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.163 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:28.163 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:28.163 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 65.370305599000005, 2023-10-08T07:06:28.163 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:06:28.163 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.163 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:28.164 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:28.164 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:28.164 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:06:28.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.164 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.164 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:28.164 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:28.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:06:28.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:06:28.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.166 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.166 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.166 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:06:28.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:06:28.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.166 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.166 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.166 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:06:28.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:06:28.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.167 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:06:28.167 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:06:28.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.167 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:06:28.167 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:06:28.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:06:28.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:06:28.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:06:28.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:06:28.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:06:28.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:06:28.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:06:28.170 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:06:28.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.170 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.170 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.170 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:06:28.170 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:06:28.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.170 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.170 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.170 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:06:28.171 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:06:28.171 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.171 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.171 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.171 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:28.171 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:28.171 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 65.370286703000005, 2023-10-08T07:06:28.171 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:06:28.172 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.172 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.172 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:28.172 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:28.172 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:28.172 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:06:28.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.172 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.172 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:28.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:28.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:28.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:06:28.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:06:28.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:06:28.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:06:28.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:06:28.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:06:28.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:06:28.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:06:28.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:06:28.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:06:28.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:06:28.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.177 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.177 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:06:28.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:06:28.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.177 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.177 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:06:28.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:06:28.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:06:28.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:06:28.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:06:28.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:06:28.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:06:28.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:06:28.179 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.179 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.179 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.179 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:28.179 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:28.180 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 65.370273694000005, 2023-10-08T07:06:28.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:28.180 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.180 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.180 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:28.180 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:28.180 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:28.180 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:28.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.180 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:28.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:28.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:28.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:28.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:28.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:28.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:28.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:28.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:28.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:28.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.184 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.184 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:28.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:28.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.184 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.184 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:28.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:28.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:28.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:28.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:28.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:28.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:28.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:28.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:28.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:28.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:28.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:28.187 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.187 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.187 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.188 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:28.188 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:28.188 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 65.370221642000004, 2023-10-08T07:06:28.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:28.188 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.188 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.188 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:28.188 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:28.188 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:28.188 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:28.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.189 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:28.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:28.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:28.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:28.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.191 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:28.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:28.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.191 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.191 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:28.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:28.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.191 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.192 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:28.192 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:28.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.192 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.192 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.192 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:28.192 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:28.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.192 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.192 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.193 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:28.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:28.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.193 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.193 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.193 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:28.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:28.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.193 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.193 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:28.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:28.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:28.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:28.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:28.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:28.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:28.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:28.195 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.195 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.195 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.196 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.196 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:28.196 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.825017815000002, 2023-10-08T07:06:28.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:06:28.196 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.196 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.196 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.197 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.197 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:28.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.197 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.197 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:28.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:06:28.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:06:28.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:06:28.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:06:28.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:06:28.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:06:28.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:28.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:06:28.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:06:28.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:06:28.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:28.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:06:28.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:06:28.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.201 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.201 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:06:28.201 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:06:28.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.201 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.201 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:06:28.201 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:06:28.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.202 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.202 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:06:28.202 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:06:28.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.202 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.202 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:06:28.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:06:28.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:06:28.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:06:28.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:06:28.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:06:28.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:06:28.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:28.204 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.204 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.205 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.205 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.205 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:28.205 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.824901337, 2023-10-08T07:06:28.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:28.205 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.205 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.205 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:28.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:28.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.207 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:28.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:28.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.207 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:28.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:28.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:28.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:28.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:28.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:28.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:28.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:28.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:28.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:28.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:28.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:28.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:28.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:28.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:28.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:28.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:28.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:28.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:28.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:28.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:28.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:28.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:28.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:28.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:28.213 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.213 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.214 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.214 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.214 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:28.214 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.824851010000003, 2023-10-08T07:06:28.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:28.214 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.214 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.215 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.215 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:28.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.215 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:28.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.216 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.216 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:28.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:28.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.216 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.216 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.217 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:28.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:28.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.217 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.217 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:28.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:28.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:28.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:28.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:28.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:28.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:28.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:28.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:28.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:28.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:28.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.220 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.220 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:28.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:28.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.220 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:28.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:28.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:28.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:28.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:28.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:28.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:28.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:28.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:28.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:28.223 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.223 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.223 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.223 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.224 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:28.224 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.824525164999997, 2023-10-08T07:06:28.224 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:28.224 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.224 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.224 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.224 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.224 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:28.225 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.225 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.225 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.225 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:28.225 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.225 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.225 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.226 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:28.226 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:28.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.226 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.226 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:28.226 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:28.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.227 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:28.227 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:28.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.227 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:28.227 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:28.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.228 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.228 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:28.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:28.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.228 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:28.228 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:28.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:28.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.229 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.229 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:28.229 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:28.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.229 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.229 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:28.229 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:28.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.230 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:28.230 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:28.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.230 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:28.230 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:28.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.231 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.231 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:28.231 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:28.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.231 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.231 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.231 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:28.231 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:28.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.232 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.232 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.232 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:28.232 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:28.232 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.232 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.232 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.232 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.232 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.233 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:28.233 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.824472640000003, 2023-10-08T07:06:28.233 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:28.233 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.233 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.233 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.233 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.233 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:28.233 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.234 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.234 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:28.234 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.234 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.234 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:28.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:28.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:28.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:28.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:28.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:28.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:28.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:28.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:28.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:28.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:28.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:28.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:28.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:28.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.238 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:28.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:28.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.239 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:28.239 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:28.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.239 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.239 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.239 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:28.239 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:28.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.239 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.240 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.240 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:28.240 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:28.240 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.240 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.240 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.240 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.240 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.241 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:28.241 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.824304665, 2023-10-08T07:06:28.241 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:28.241 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.241 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.241 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:28.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:28.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.243 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:28.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:28.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.243 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.243 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.243 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:28.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:28.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.243 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.243 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.244 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:28.244 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:28.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.244 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:28.244 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:28.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:28.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:28.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:28.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:28.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:28.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:28.246 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:28.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.246 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.246 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:28.246 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:28.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.246 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.246 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:28.246 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:28.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.247 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.247 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.247 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:28.247 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:28.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.247 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.247 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.247 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:28.247 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:28.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.248 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:28.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:28.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.248 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:28.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:28.249 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.249 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.249 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.249 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.249 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:28.249 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.824160366999998, 2023-10-08T07:06:28.249 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:28.249 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.250 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.250 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.250 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.250 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.250 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:28.250 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.250 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.250 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.250 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:28.251 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.251 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.251 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.251 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:28.251 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:28.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.251 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.251 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:28.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:28.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:28.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:28.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:28.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:28.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:28.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:28.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:28.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:28.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:28.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.254 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:28.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:28.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.254 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:28.255 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:28.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.255 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.255 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:28.255 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:28.255 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:28.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.255 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.255 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.255 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:28.255 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:28.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:28.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:28.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:28.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.258 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.258 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:28.258 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.823480855, 2023-10-08T07:06:28.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:28.258 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.258 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.258 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.258 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.259 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:28.259 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.259 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.259 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:28.259 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.260 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:28.260 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:28.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.260 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:28.260 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:28.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.261 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.261 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.261 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:28.261 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:28.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.261 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.261 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.261 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:28.261 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:28.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.262 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.262 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.262 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:28.262 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:28.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.262 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.262 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.262 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:28.262 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:28.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.263 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:28.263 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:28.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.263 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:28.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:28.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.264 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.264 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:28.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:28.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.264 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.264 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:28.265 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:28.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.265 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:28.265 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:28.265 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.265 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.265 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.266 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.266 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:28.266 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.823427584999997, 2023-10-08T07:06:28.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:28.266 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.266 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.266 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:28.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:28.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:28.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:28.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:28.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:28.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.269 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.269 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:28.269 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:28.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.269 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.269 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:28.269 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:28.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.270 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:28.270 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:28.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.270 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:28.270 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:28.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:28.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:28.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:28.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:28.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:28.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:28.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:28.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:28.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.273 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:28.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:28.273 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.273 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.273 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.273 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.274 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:28.274 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.823391739000002, 2023-10-08T07:06:28.274 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:28.274 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.274 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.274 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.274 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.274 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:28.274 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.275 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.275 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.275 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:28.275 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.275 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.275 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.275 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:28.275 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:28.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.276 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:28.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:28.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.276 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:28.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:28.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:28.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:28.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:28.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:28.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:28.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:28.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:28.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:28.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:28.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:28.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:28.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:28.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.280 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:28.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:28.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.280 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:28.281 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:28.281 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.281 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.281 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.281 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.281 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.281 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:28.281 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.823251208000002, 2023-10-08T07:06:28.281 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:28.282 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.282 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.282 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:28.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.283 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:28.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.283 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:28.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:28.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.284 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:28.284 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:28.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.284 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.284 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:28.284 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:28.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.284 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.285 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:28.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:28.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.285 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:28.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:28.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:28.286 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:28.286 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:28.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.286 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.286 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:28.286 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:28.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.287 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.287 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.287 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:28.287 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:28.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.287 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.287 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:28.287 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:28.287 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:28.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.288 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:28.288 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:28.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.288 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:28.288 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:28.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.289 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.289 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:28.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:28.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.289 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.289 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:28.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:28.290 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.290 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.290 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.290 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.290 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:28.290 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.822958884999998, 2023-10-08T07:06:28.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:28.291 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.291 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.291 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.291 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.291 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:28.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.291 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:28.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:28.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.293 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:28.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:28.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.293 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:28.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:28.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:28.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:28.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.297 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.298 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.298 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.298 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:28.298 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.822845243000003, 2023-10-08T07:06:28.298 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:28.298 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.298 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.299 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:28.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:28.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:28.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:28.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:28.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:28.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:28.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:28.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:28.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:28.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:28.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:28.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:28.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:28.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.303 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:28.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:28.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:28.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:28.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:28.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:28.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:28.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:28.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:28.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:28.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:28.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:28.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:28.305 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.306 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.306 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.306 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.306 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:28.306 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 54.821815018999999, 2023-10-08T07:06:28.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:28.306 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:28.307 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:28.307 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:28.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:28.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:28.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:28.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:28.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:28.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:28.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:28.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:28.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:28.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:28.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:28.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:28.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:28.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:28.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:28.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:28.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:28.310 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:28.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:28.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:28.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:28.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:28.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:28.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:28.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:28.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:28.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:28.313 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.313 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.314 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.314 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:28.314 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:28.314 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:28.315 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:28.315+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:28.316 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:28.416 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:28.416+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:28.455 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:28.455 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:28.455 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2023-10-08T07:06:28.455 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:28.465 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:28.518 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:28.517+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:28.591 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:28.591 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:28.591 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2023-10-08T07:06:28.592 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2023-10-08T07:06:28.592 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:28.601 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:28.646 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:28.645+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:28.722 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:28.721+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:28.729 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:28.729 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2023-10-08T07:06:28.729 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2023-10-08T07:06:28.729 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2023-10-08T07:06:28.729 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.729 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-10-08T07:06:28.729 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:28.730 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 66.412350113000002, 2023-10-08T07:06:28.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069404690000000003, 2023-10-08T07:06:28.730 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.730 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.730 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.730 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:28.730 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.730 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.730 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.730 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:28.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315211+0000", 2023-10-08T07:06:28.731 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:06:28.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.731 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.731 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.731 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315216+0000", 2023-10-08T07:06:28.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:06:28.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315229+0000", 2023-10-08T07:06:28.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.278e-05 2023-10-08T07:06:28.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.732 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.732 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.732 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315235+0000", 2023-10-08T07:06:28.732 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2023-10-08T07:06:28.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316390+0000", 2023-10-08T07:06:28.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011548179999999999 2023-10-08T07:06:28.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.733 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316410+0000", 2023-10-08T07:06:28.733 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0818999999999998e-05 2023-10-08T07:06:28.733 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.733 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.733 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322113+0000", 2023-10-08T07:06:28.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057026159999999998 2023-10-08T07:06:28.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.734 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.734 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322150+0000", 2023-10-08T07:06:28.734 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7401999999999999e-05 2023-10-08T07:06:28.734 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.734 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.734 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.734 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.734 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.735 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-10-08T07:06:28.735 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:28.735 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.954990343000006, 2023-10-08T07:06:28.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087059660000000007, 2023-10-08T07:06:28.735 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.735 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.735 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.735 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.735 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.735 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:28.735 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.735 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:28.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.736 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:28.736 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:06:28.736 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.736 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.736 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772604+0000", 2023-10-08T07:06:28.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.413e-05 2023-10-08T07:06:28.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772617+0000", 2023-10-08T07:06:28.737 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2595999999999999e-05 2023-10-08T07:06:28.737 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.737 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.737 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.737 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772624+0000", 2023-10-08T07:06:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2023-10-08T07:06:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772666+0000", 2023-10-08T07:06:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1925000000000003e-05 2023-10-08T07:06:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772685+0000", 2023-10-08T07:06:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9071000000000001e-05 2023-10-08T07:06:28.738 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781237+0000", 2023-10-08T07:06:28.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085519059999999997 2023-10-08T07:06:28.739 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.739 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.739 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.739 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781276+0000", 2023-10-08T07:06:28.739 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9161e-05 2023-10-08T07:06:28.739 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.739 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.739 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.740 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.740 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-10-08T07:06:28.740 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:28.740 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.954493689000003, 2023-10-08T07:06:28.740 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010997768, 2023-10-08T07:06:28.740 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.740 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.740 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.740 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.740 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.740 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:28.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:28.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.741 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.741 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.741 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773067+0000", 2023-10-08T07:06:28.741 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:06:28.741 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773071+0000", 2023-10-08T07:06:28.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3819999999999997e-06 2023-10-08T07:06:28.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.742 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773082+0000", 2023-10-08T07:06:28.742 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0407e-05 2023-10-08T07:06:28.742 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.742 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.742 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773087+0000", 2023-10-08T07:06:28.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:06:28.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775481+0000", 2023-10-08T07:06:28.743 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023941470000000001 2023-10-08T07:06:28.743 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.743 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.743 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.743 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775493+0000", 2023-10-08T07:06:28.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2126999999999999e-05 2023-10-08T07:06:28.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784021+0000", 2023-10-08T07:06:28.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085280589999999993 2023-10-08T07:06:28.744 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.744 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.744 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.744 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784064+0000", 2023-10-08T07:06:28.744 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.295e-05 2023-10-08T07:06:28.744 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.745 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.745 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.745 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.745 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:157 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'111, mlcod=11'105)", 2023-10-08T07:06:28.745 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:28.745 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.954073590999997, 2023-10-08T07:06:28.745 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010614554, 2023-10-08T07:06:28.745 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.745 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.745 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.745 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:28.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:28.746 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.746 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.746 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.746 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.746 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773487+0000", 2023-10-08T07:06:28.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:06:28.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773492+0000", 2023-10-08T07:06:28.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2249999999999999e-06 2023-10-08T07:06:28.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.747 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.747 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.747 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773503+0000", 2023-10-08T07:06:28.747 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0271e-05 2023-10-08T07:06:28.747 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773509+0000", 2023-10-08T07:06:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5470000000000002e-06 2023-10-08T07:06:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775801+0000", 2023-10-08T07:06:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022918790000000001 2023-10-08T07:06:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.748 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775822+0000", 2023-10-08T07:06:28.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1486000000000001e-05 2023-10-08T07:06:28.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784066+0000", 2023-10-08T07:06:28.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082432089999999996 2023-10-08T07:06:28.749 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.749 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.749 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.749 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784101+0000", 2023-10-08T07:06:28.749 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5383999999999999e-05 2023-10-08T07:06:28.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.750 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.750 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.750 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.750 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.750 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:158 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'112, mlcod=11'106)", 2023-10-08T07:06:28.750 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:28.750 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.953596493999996, 2023-10-08T07:06:28.750 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010172001999999999, 2023-10-08T07:06:28.750 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.750 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.751 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.82e-07 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773990+0000", 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774001+0000", 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0873000000000001e-05 2023-10-08T07:06:28.752 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774006+0000", 2023-10-08T07:06:28.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0900000000000004e-06 2023-10-08T07:06:28.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.753 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.753 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776145+0000", 2023-10-08T07:06:28.753 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021389759999999999 2023-10-08T07:06:28.753 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.753 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776165+0000", 2023-10-08T07:06:28.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9548e-05 2023-10-08T07:06:28.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784102+0000", 2023-10-08T07:06:28.754 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007937342 2023-10-08T07:06:28.754 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.754 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.754 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.754 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784136+0000", 2023-10-08T07:06:28.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3331000000000003e-05 2023-10-08T07:06:28.755 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.755 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.755 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.755 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.755 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.755 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:159 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'113, mlcod=11'106)", 2023-10-08T07:06:28.755 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:28.755 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.953063536000002, 2023-10-08T07:06:28.755 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096667119999999992, 2023-10-08T07:06:28.755 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.755 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.756 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:28.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.756 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.756 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.756 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:28.756 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.756 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774501+0000", 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1529999999999999e-06 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.757 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774511+0000", 2023-10-08T07:06:28.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:06:28.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774533+0000", 2023-10-08T07:06:28.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2348999999999999e-05 2023-10-08T07:06:28.758 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.758 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.758 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.758 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776608+0000", 2023-10-08T07:06:28.758 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002074799 2023-10-08T07:06:28.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776627+0000", 2023-10-08T07:06:28.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8632999999999999e-05 2023-10-08T07:06:28.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.759 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.759 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784138+0000", 2023-10-08T07:06:28.759 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075110819999999997 2023-10-08T07:06:28.759 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.759 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.760 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.760 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784163+0000", 2023-10-08T07:06:28.760 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5425000000000001e-05 2023-10-08T07:06:28.760 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.760 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.760 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.760 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.760 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.760 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:160 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'114, mlcod=11'106)", 2023-10-08T07:06:28.760 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:28.760 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.952428354000006, 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090478150000000007, 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:28.761 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775133+0000", 2023-10-08T07:06:28.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2023-10-08T07:06:28.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.762 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.762 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.762 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775150+0000", 2023-10-08T07:06:28.762 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6206e-05 2023-10-08T07:06:28.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775173+0000", 2023-10-08T07:06:28.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.351e-05 2023-10-08T07:06:28.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.763 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775187+0000", 2023-10-08T07:06:28.763 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4396000000000001e-05 2023-10-08T07:06:28.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.763 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.763 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776909+0000", 2023-10-08T07:06:28.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017220429999999999 2023-10-08T07:06:28.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776929+0000", 2023-10-08T07:06:28.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9313e-05 2023-10-08T07:06:28.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.764 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.764 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.764 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784164+0000", 2023-10-08T07:06:28.764 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072352340000000001 2023-10-08T07:06:28.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.765 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.765 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:28.765 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526e-05 2023-10-08T07:06:28.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.765 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.765 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.765 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.765 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:161 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'115, mlcod=11'106)", 2023-10-08T07:06:28.766 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:28.766 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.951749465000006, 2023-10-08T07:06:28.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083874480000000005, 2023-10-08T07:06:28.766 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.766 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.766 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.766 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.766 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:28.766 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.766 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:28.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:28.767 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:06:28.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.767 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.767 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.767 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775837+0000", 2023-10-08T07:06:28.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6081e-05 2023-10-08T07:06:28.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775849+0000", 2023-10-08T07:06:28.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:06:28.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.768 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.768 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.768 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775854+0000", 2023-10-08T07:06:28.768 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1490000000000002e-06 2023-10-08T07:06:28.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777220+0000", 2023-10-08T07:06:28.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001365174 2023-10-08T07:06:28.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.769 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777232+0000", 2023-10-08T07:06:28.769 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2293000000000001e-05 2023-10-08T07:06:28.769 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.769 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.769 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:28.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069481450000000002 2023-10-08T07:06:28.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.770 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.770 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784198+0000", 2023-10-08T07:06:28.770 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2023-10-08T07:06:28.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.770 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.770 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.770 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.770 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.771 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:162 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'116, mlcod=11'106)", 2023-10-08T07:06:28.771 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:28.771 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.951125063000006, 2023-10-08T07:06:28.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077785969999999999, 2023-10-08T07:06:28.771 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.771 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.771 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.771 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.771 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.771 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:28.771 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.771 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:28.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.772 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776436+0000", 2023-10-08T07:06:28.772 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:06:28.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.772 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.772 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776440+0000", 2023-10-08T07:06:28.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2629999999999997e-06 2023-10-08T07:06:28.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776451+0000", 2023-10-08T07:06:28.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1385e-05 2023-10-08T07:06:28.773 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.773 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.773 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.773 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776456+0000", 2023-10-08T07:06:28.773 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9919999999999998e-06 2023-10-08T07:06:28.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777629+0000", 2023-10-08T07:06:28.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001173297 2023-10-08T07:06:28.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.774 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.774 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777650+0000", 2023-10-08T07:06:28.774 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0126e-05 2023-10-08T07:06:28.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.774 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784199+0000", 2023-10-08T07:06:28.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006548908 2023-10-08T07:06:28.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.775 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.775 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.775 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:28.775 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5071e-05 2023-10-08T07:06:28.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.775 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.775 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.775 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.776 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:163 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'117, mlcod=11'106)", 2023-10-08T07:06:28.776 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:28.776 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.950482656000005, 2023-10-08T07:06:28.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071515490000000001, 2023-10-08T07:06:28.776 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.776 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.776 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.776 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.776 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.776 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:28.776 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:28.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.777 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.777 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777078+0000", 2023-10-08T07:06:28.777 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4400000000000001e-07 2023-10-08T07:06:28.777 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.777 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777082+0000", 2023-10-08T07:06:28.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.732e-06 2023-10-08T07:06:28.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.778 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.778 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777095+0000", 2023-10-08T07:06:28.778 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3749e-05 2023-10-08T07:06:28.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.778 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777100+0000", 2023-10-08T07:06:28.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.634e-06 2023-10-08T07:06:28.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777944+0000", 2023-10-08T07:06:28.779 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00084377599999999997 2023-10-08T07:06:28.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.779 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.779 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.779 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777957+0000", 2023-10-08T07:06:28.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.276e-05 2023-10-08T07:06:28.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:28.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006257617 2023-10-08T07:06:28.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.780 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.780 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.780 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784229+0000", 2023-10-08T07:06:28.780 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4837e-05 2023-10-08T07:06:28.780 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.781 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.781 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.781 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:164 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'118, mlcod=11'106)", 2023-10-08T07:06:28.781 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:28.781 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 65.949901316999998, 2023-10-08T07:06:28.781 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093104280000000008, 2023-10-08T07:06:28.781 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.781 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.781 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.781 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:28.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:28.782 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.782 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.782 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.782 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:28.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2e-07 2023-10-08T07:06:28.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777713+0000", 2023-10-08T07:06:28.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4079999999999997e-05 2023-10-08T07:06:28.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.783 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.783 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.783 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777724+0000", 2023-10-08T07:06:28.783 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0652999999999999e-05 2023-10-08T07:06:28.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777729+0000", 2023-10-08T07:06:28.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2050000000000001e-06 2023-10-08T07:06:28.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.784 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778177+0000", 2023-10-08T07:06:28.784 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044763499999999999 2023-10-08T07:06:28.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.784 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.784 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778195+0000", 2023-10-08T07:06:28.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8125e-05 2023-10-08T07:06:28.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786935+0000", 2023-10-08T07:06:28.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087396049999999992 2023-10-08T07:06:28.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.785 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.785 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.785 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786969+0000", 2023-10-08T07:06:28.785 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4604999999999998e-05 2023-10-08T07:06:28.786 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.786 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.786 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.786 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.786 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.786 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:28.786 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.412012887000003, 2023-10-08T07:06:28.786 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013957681, 2023-10-08T07:06:28.786 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.786 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.786 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:28.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.787 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.787 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:28.787 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.787 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315552+0000", 2023-10-08T07:06:28.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.152e-06 2023-10-08T07:06:28.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315568+0000", 2023-10-08T07:06:28.788 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5301000000000001e-05 2023-10-08T07:06:28.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.788 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.788 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.788 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315583+0000", 2023-10-08T07:06:28.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5826000000000001e-05 2023-10-08T07:06:28.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315598+0000", 2023-10-08T07:06:28.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4953999999999999e-05 2023-10-08T07:06:28.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.789 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.789 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.789 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317200+0000", 2023-10-08T07:06:28.789 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016014950000000001 2023-10-08T07:06:28.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317351+0000", 2023-10-08T07:06:28.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015081400000000001 2023-10-08T07:06:28.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.790 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:28.790 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317540+0000", 2023-10-08T07:06:28.790 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000189557 2023-10-08T07:06:28.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.790 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322281+0000", 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047409599999999998 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329404+0000", 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071225460000000004 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329459+0000", 2023-10-08T07:06:28.791 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5016999999999999e-05 2023-10-08T07:06:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329505+0000", 2023-10-08T07:06:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059000000000001e-05 2023-10-08T07:06:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.792 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:28.793 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.411929917999998, 2023-10-08T07:06:28.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015617259, 2023-10-08T07:06:28.793 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.793 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.793 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.793 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:28.793 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.793 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.793 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.793 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:28.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.794 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.794 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315631+0000", 2023-10-08T07:06:28.794 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2023-10-08T07:06:28.794 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.794 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315636+0000", 2023-10-08T07:06:28.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1019999999999996e-06 2023-10-08T07:06:28.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.795 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315646+0000", 2023-10-08T07:06:28.795 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0056e-05 2023-10-08T07:06:28.795 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.795 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.795 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315654+0000", 2023-10-08T07:06:28.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7810000000000005e-06 2023-10-08T07:06:28.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318626+0000", 2023-10-08T07:06:28.796 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00297183 2023-10-08T07:06:28.796 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.796 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.796 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.796 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319450+0000", 2023-10-08T07:06:28.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082440400000000004 2023-10-08T07:06:28.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:28.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319924+0000", 2023-10-08T07:06:28.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047403099999999997 2023-10-08T07:06:28.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.797 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.797 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:28.797 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322475+0000", 2023-10-08T07:06:28.797 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002550442 2023-10-08T07:06:28.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331142+0000", 2023-10-08T07:06:28.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086669030000000001 2023-10-08T07:06:28.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.798 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331217+0000", 2023-10-08T07:06:28.798 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5606999999999996e-05 2023-10-08T07:06:28.798 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.798 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.798 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331247+0000", 2023-10-08T07:06:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:06:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:15 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.410766479000003, 2023-10-08T07:06:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012716055, 2023-10-08T07:06:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8599999999999997e-07 2023-10-08T07:06:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316805+0000", 2023-10-08T07:06:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0475000000000001e-05 2023-10-08T07:06:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316817+0000", 2023-10-08T07:06:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.226e-05 2023-10-08T07:06:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316828+0000", 2023-10-08T07:06:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1090999999999999e-05 2023-10-08T07:06:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317025+0000", 2023-10-08T07:06:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019711500000000001 2023-10-08T07:06:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317244+0000", 2023-10-08T07:06:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021908999999999999 2023-10-08T07:06:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317436+0000", 2023-10-08T07:06:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019164900000000001 2023-10-08T07:06:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321493+0000", 2023-10-08T07:06:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040573190000000002 2023-10-08T07:06:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329275+0000", 2023-10-08T07:06:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077820950000000002 2023-10-08T07:06:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329457+0000", 2023-10-08T07:06:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018165600000000001 2023-10-08T07:06:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329510+0000", 2023-10-08T07:06:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2519000000000003e-05 2023-10-08T07:06:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:27 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.410705688, 2023-10-08T07:06:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015441417000000001, 2023-10-08T07:06:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316855+0000", 2023-10-08T07:06:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316861+0000", 2023-10-08T07:06:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6210000000000001e-06 2023-10-08T07:06:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316869+0000", 2023-10-08T07:06:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.225e-06 2023-10-08T07:06:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316878+0000", 2023-10-08T07:06:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8799999999999997e-06 2023-10-08T07:06:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319969+0000", 2023-10-08T07:06:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030906689999999999 2023-10-08T07:06:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320072+0000", 2023-10-08T07:06:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103458 2023-10-08T07:06:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320631+0000", 2023-10-08T07:06:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055936099999999997 2023-10-08T07:06:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322686+0000", 2023-10-08T07:06:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020545899999999998 2023-10-08T07:06:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332244+0000", 2023-10-08T07:06:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095578690000000001 2023-10-08T07:06:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332274+0000", 2023-10-08T07:06:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0527000000000001e-05 2023-10-08T07:06:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332296+0000", 2023-10-08T07:06:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1359999999999999e-05 2023-10-08T07:06:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.410669099000003, 2023-10-08T07:06:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014502582, 2023-10-08T07:06:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316892+0000", 2023-10-08T07:06:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:06:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316896+0000", 2023-10-08T07:06:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9140000000000001e-06 2023-10-08T07:06:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316904+0000", 2023-10-08T07:06:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1170000000000004e-06 2023-10-08T07:06:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316911+0000", 2023-10-08T07:06:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:06:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320938+0000", 2023-10-08T07:06:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040269959999999997 2023-10-08T07:06:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321023+0000", 2023-10-08T07:06:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5420000000000005e-05 2023-10-08T07:06:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321157+0000", 2023-10-08T07:06:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013383700000000001 2023-10-08T07:06:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322742+0000", 2023-10-08T07:06:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015851249999999999 2023-10-08T07:06:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331290+0000", 2023-10-08T07:06:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085483190000000004 2023-10-08T07:06:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331348+0000", 2023-10-08T07:06:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7630999999999998e-05 2023-10-08T07:06:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331394+0000", 2023-10-08T07:06:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5534999999999997e-05 2023-10-08T07:06:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.410640610999998, 2023-10-08T07:06:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015363402, 2023-10-08T07:06:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316920+0000", 2023-10-08T07:06:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2023-10-08T07:06:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316923+0000", 2023-10-08T07:06:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2169999999999999e-06 2023-10-08T07:06:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316930+0000", 2023-10-08T07:06:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:06:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316938+0000", 2023-10-08T07:06:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:06:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322217+0000", 2023-10-08T07:06:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052793680000000004 2023-10-08T07:06:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322295+0000", 2023-10-08T07:06:28.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7621999999999996e-05 2023-10-08T07:06:28.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:28.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322411+0000", 2023-10-08T07:06:28.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000116297 2023-10-08T07:06:28.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.823 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.823 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:28.823 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323187+0000", 2023-10-08T07:06:28.823 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077583700000000003 2023-10-08T07:06:28.823 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332224+0000", 2023-10-08T07:06:28.824 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090370980000000004 2023-10-08T07:06:28.824 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.824 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.824 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.824 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332261+0000", 2023-10-08T07:06:28.825 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6464999999999997e-05 2023-10-08T07:06:28.825 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.825 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.826 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.826 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332283+0000", 2023-10-08T07:06:28.826 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2124e-05 2023-10-08T07:06:28.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.826 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.826 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.826 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.826 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.826 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.826 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:28.826 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.409517426999997, 2023-10-08T07:06:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014463023, 2023-10-08T07:06:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.827 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:28.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318044+0000", 2023-10-08T07:06:28.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1000000000000001e-06 2023-10-08T07:06:28.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.828 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.828 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.828 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318057+0000", 2023-10-08T07:06:28.828 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2860000000000001e-05 2023-10-08T07:06:28.828 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318067+0000", 2023-10-08T07:06:28.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0638999999999999e-05 2023-10-08T07:06:28.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.829 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318090+0000", 2023-10-08T07:06:28.829 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2889000000000001e-05 2023-10-08T07:06:28.829 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.829 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.829 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320985+0000", 2023-10-08T07:06:28.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028951279999999999 2023-10-08T07:06:28.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321126+0000", 2023-10-08T07:06:28.830 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014045600000000001 2023-10-08T07:06:28.830 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.830 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.830 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:28.830 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321798+0000", 2023-10-08T07:06:28.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067266600000000004 2023-10-08T07:06:28.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:28.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323135+0000", 2023-10-08T07:06:28.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013368589999999999 2023-10-08T07:06:28.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.831 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.831 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:28.831 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332445+0000", 2023-10-08T07:06:28.831 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093094419999999994 2023-10-08T07:06:28.831 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:28.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332482+0000", 2023-10-08T07:06:28.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:28.832 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.832 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.832 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.832 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332506+0000", 2023-10-08T07:06:28.832 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3649e-05 2023-10-08T07:06:28.832 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.832 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.832 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.409448918000002, 2023-10-08T07:06:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011597616999999999, 2023-10-08T07:06:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.833 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:28.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:28.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.834 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.834 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.834 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318112+0000", 2023-10-08T07:06:28.834 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2299999999999999e-07 2023-10-08T07:06:28.834 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318117+0000", 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1170000000000003e-06 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318127+0000", 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0129000000000001e-05 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.835 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318136+0000", 2023-10-08T07:06:28.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3610000000000001e-06 2023-10-08T07:06:28.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:28.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101062 2023-10-08T07:06:28.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.836 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.836 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.836 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318422+0000", 2023-10-08T07:06:28.836 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018560500000000001 2023-10-08T07:06:28.836 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.837 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.837 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329709+0000", 2023-10-08T07:06:28.837 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01128642 2023-10-08T07:06:28.837 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.837 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.837 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.837 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.837 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.837 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:28.837 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 55.409409797999999, 2023-10-08T07:06:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088267940000000007, 2023-10-08T07:06:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.838 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:28.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:28.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:28.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:28.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318151+0000", 2023-10-08T07:06:28.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:06:28.839 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.839 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.839 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:28.839 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318154+0000", 2023-10-08T07:06:28.839 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9529999999999999e-06 2023-10-08T07:06:28.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:28.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318161+0000", 2023-10-08T07:06:28.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.126e-06 2023-10-08T07:06:28.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.840 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:28.840 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318167+0000", 2023-10-08T07:06:28.840 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2169999999999999e-06 2023-10-08T07:06:28.840 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.840 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319711+0000", 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015438769999999999 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319864+0000", 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015264799999999999 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.326977+0000", 2023-10-08T07:06:28.841 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071133890000000003 2023-10-08T07:06:28.842 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.842 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.842 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.842 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:28.842 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:28.842 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:28.843 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:28.844 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:28.843+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:28.946 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:28.945+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:28.983 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:28.983 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:28.983 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:28.984 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:28.993 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:29.082 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:29.081+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:29.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T07:06:29.147 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:29.146+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:29.160 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:29.160 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:29.160 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:29.160 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:29.160 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:29.170 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:29.248 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:29.248+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:29.340 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:29.340 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:29.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:29.340 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:29.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.341 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:29.341 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:29.341 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.021652602000003, 2023-10-08T07:06:29.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:29.341 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.341 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:29.341 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:29.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:29.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:29.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:29.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:29.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:29.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:29.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:29.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:29.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:29.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:29.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:29.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:29.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:29.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:29.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:29.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:29.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:29.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:29.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:29.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:29.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:29.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:29.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:29.347 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.348 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.348 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:29.348 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:29.348 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.021578818000002, 2023-10-08T07:06:29.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:29.348 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.348 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:29.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:29.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:29.354 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.021515641999997, 2023-10-08T07:06:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:29.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:29.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:29.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:29.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:29.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:29.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:29.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.361 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.361 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:29.362 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:29.362 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.021481295999997, 2023-10-08T07:06:29.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:29.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:29.362 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:29.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:29.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:29.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:29.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:29.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:29.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:29.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:29.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:29.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:29.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:29.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:29.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:29.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:29.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:29.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:29.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:29.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:29.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:29.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:29.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:29.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:29.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:29.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:29.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:29.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:29.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:29.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:29.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.368 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.368 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:29.368 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:29.368 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.020991070999997, 2023-10-08T07:06:29.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:29.368 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.368 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:29.369 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:29.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:29.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:29.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:29.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:29.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:29.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:29.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:29.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:29.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:29.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:29.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:29.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:29.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:29.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:29.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:29.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:29.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:29.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:29.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:29.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:29.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:29.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:29.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:29.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:29.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:29.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:29.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:29.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.374 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.375 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:29.375 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:29.375 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.020950493999997, 2023-10-08T07:06:29.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:29.375 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.375 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:29.375 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:29.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:29.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:29.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:29.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:29.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:29.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:29.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:29.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:29.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:29.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:29.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:29.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:29.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:29.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:29.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:29.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:29.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:29.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:29.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:29.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:29.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:29.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:29.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:29.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:29.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:29.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:29.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:29.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.382 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.382 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:29.382 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:29.382 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.020912924999998, 2023-10-08T07:06:29.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:29.382 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.383 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:29.383 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:29.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:29.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:29.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:29.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:29.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:29.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:29.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:29.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:29.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:29.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:29.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:29.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:29.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:29.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:29.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:29.386 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.387 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.387 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:29.387 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:29.387 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.020845485000002, 2023-10-08T07:06:29.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:29.387 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.387 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:29.387 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:29.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:29.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:29.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:29.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:29.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:29.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:29.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:29.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:29.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:29.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:29.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:29.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:29.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:29.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:29.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:29.391 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.391 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.391 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.392 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:29.392 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:29.392 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.020815843000001, 2023-10-08T07:06:29.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:29.392 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.392 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:29.392 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:29.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:29.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:29.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:29.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:29.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:29.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:29.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:29.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:29.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:29.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:29.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:29.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:29.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:29.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:29.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:29.396 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.396 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.397 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:29.397 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:29.397 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.015075281999998, 2023-10-08T07:06:29.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:29.397 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.397 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:29.397 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:29.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:29.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:29.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:29.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:29.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:29.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:29.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:29.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:29.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:29.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.401 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.401 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:29.401 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:29.401 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.014625942000002, 2023-10-08T07:06:29.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:29.401 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.402 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:29.402 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:29.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:29.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:29.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:29.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:29.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:29.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:29.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:29.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:29.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:29.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:29.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:29.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:29.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:29.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:29.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:29.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.406 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.406 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:29.406 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:29.406 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.013830052000003, 2023-10-08T07:06:29.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:29.406 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.406 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:29.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:29.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:29.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:29.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:29.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:29.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:29.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:29.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:29.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:29.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:29.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:29.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:29.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:29.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:29.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:29.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:29.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.411 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.411 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:29.411 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:29.411 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.013714700999998, 2023-10-08T07:06:29.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:29.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:29.412 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:29.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:29.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:29.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:29.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:29.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:29.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:29.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:29.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:29.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:29.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:29.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:29.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:29.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:29.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:29.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:29.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:29.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:29.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:29.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.416 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.416 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:29.417 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:29.417 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.008600135000002, 2023-10-08T07:06:29.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:29.417 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.417 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:29.417 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:29.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:29.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:29.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:29.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:29.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:29.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:29.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:29.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:29.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:29.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:29.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:29.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:29.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:29.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:29.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:29.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:29.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:29.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:29.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.422 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.422 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:29.422 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:29.422 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.008489142999998, 2023-10-08T07:06:29.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:29.422 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.423 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:29.423 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:29.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:29.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:29.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:29.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:29.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:29.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:29.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:29.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:29.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:29.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:29.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:29.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:29.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:29.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:29.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:29.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:29.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:29.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:29.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.427 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.427 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:29.428 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:29.428 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.008064701999999, 2023-10-08T07:06:29.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:29.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:29.428 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:29.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:29.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:29.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:29.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:29.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:29.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:29.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:29.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:29.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:29.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:29.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:29.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:29.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:29.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:29.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:29.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.432 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.432 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:29.432 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:29.432 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.007917566000003, 2023-10-08T07:06:29.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:29.433 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.433 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:29.433 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:29.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:29.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:29.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:29.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:29.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:29.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:29.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:29.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:29.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:29.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:29.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:29.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:29.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:29.437 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.437 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.437 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.437 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:29.437 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:29.437 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.936619297, 2023-10-08T07:06:29.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:29.438 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.438 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:29.438 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:29.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:29.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:29.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:29.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:29.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:29.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:29.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:29.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:29.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:29.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:29.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:29.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:29.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:29.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:29.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:29.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:29.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:29.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:29.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:29.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:29.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:29.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:29.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.444 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:29.444 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:29.444 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.934825713000002, 2023-10-08T07:06:29.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:29.444 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.444 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:29.444 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:29.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:29.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:29.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:29.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:29.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:29.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:29.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:29.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:29.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:29.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:29.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:29.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:29.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:29.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:29.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:29.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.448 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.448 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:29.449 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:29.449 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.936236043000001, 2023-10-08T07:06:29.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:29.449 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:29.449 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:29.449 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:29.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:29.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:29.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:29.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:29.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:29.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:29.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:29.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:29.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:29.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:29.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:29.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:29.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:29.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:29.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:29.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:29.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:29.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:29.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:29.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:29.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:29.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:29.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:29.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:29.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:29.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:29.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:29.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:29.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:29.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:29.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:29.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:29.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:29.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:29.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:29.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:29.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:29.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:29.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:29.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:29.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.455 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:29.455 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:29.455 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:29.455 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:29.457 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:29.455+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:29.457 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:29.557 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:29.556+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:29.604 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:29.604 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:29.604 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:29.604 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:29.614 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:29.658 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:29.657+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T07:06:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:29.746 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:29.747 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:29.757 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:29.798 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:29.798+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:29.860 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:29.859+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:29.929 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:29.930 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:29.939 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:29.960 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:29.959+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:30.062 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:30.061+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:30.078 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:30.079 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:30.089 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:30.102 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2023-10-08T07:06:30.163 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:30.162+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:30.187 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-10-08T07:06:30.188 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2023-10-08T07:06:30.215 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:30.215 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:30.225 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:30.269 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:30.268+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:30.352 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:30.352 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:30.362 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:30.404 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:30.403+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:30.464 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:30.464+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:30.497 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:30.497 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:30.507 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:30.566 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:30.566+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:30.635 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:30.635 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:30.645 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:30.666 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:30.666+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:30.768 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:30.767+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:30.774 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:30.774 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:30.782 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:30.869 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:30.868+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:30.929 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:30.929 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:30.939 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:30.970 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:30.969+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:31.071 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:31.070+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:31.072 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:31.072 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:31.082 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:31.104 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.0 to 1 (10000) 2023-10-08T07:06:31.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2023-10-08T07:06:31.172 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:31.171+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:31.214 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:31.214 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:31.226 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:31.273 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:31.272+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:31.357 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:31.357 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:31.367 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:31.374 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:31.374+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:31.475 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:31.475+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:31.533 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:31.533 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:31.543 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:31.577 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:31.577+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:31.668 INFO:teuthology.orchestra.run.smithi086.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:31.669 INFO:teuthology.orchestra.run.smithi086.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:31.679 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:31.680 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:31.678+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:31.719 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:31.780 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:31.779+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:31.813 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:31.813 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:31.823 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:31.881 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:31.880+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:31.946 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:31.966 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:31.982 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:31.982+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:31.986 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T07:06:31.988 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:31.990 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:31.990 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:32.002 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:32.083 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:32.082+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.1 to 1 (10000) 2023-10-08T07:06:32.118 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T07:06:32.122 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2023-10-08T07:06:32.132 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.813776933, 2023-10-08T07:06:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.813703148999998, 2023-10-08T07:06:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.813639973000001, 2023-10-08T07:06:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.813605627000001, 2023-10-08T07:06:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.813115402000001, 2023-10-08T07:06:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.813074825000001, 2023-10-08T07:06:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.813037256000001, 2023-10-08T07:06:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.812969815999999, 2023-10-08T07:06:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.812940173999998, 2023-10-08T07:06:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.807199613000002, 2023-10-08T07:06:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.806750272999999, 2023-10-08T07:06:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.805954383, 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.805839032000002, 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.800724465999998, 2023-10-08T07:06:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:32.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:32.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:32.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.224 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.224 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:32.224 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.800613474000002, 2023-10-08T07:06:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.800189033000002, 2023-10-08T07:06:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.800041897, 2023-10-08T07:06:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.728743627999997, 2023-10-08T07:06:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.726950043999999, 2023-10-08T07:06:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.728360373999998, 2023-10-08T07:06:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:32.255 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:32.257 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:32.255+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:32.257 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:32.357 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:32.356+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:32.404 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:32.404 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:32.404 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:32.404 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:32.415 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:32.458 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:32.458+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:32.547 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:32.547 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:32.547 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:32.547 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:32.547 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:32.558 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:32.559 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:32.559+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:32.661 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:32.661+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:32.733 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:32.733 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:32.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:32.734 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:32.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.734 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:32.734 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:32.734 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.958922774000001, 2023-10-08T07:06:32.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:06:32.734 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.734 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.734 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:32.734 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:32.734 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:32.734 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:06:32.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.735 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:32.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:32.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:06:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:06:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:06:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:06:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:06:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:06:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:06:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:06:32.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:06:32.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:06:32.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:06:32.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:06:32.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:06:32.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:06:32.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:06:32.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:06:32.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:06:32.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.741 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:32.741 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:32.741 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.958901228000002, 2023-10-08T07:06:32.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:06:32.741 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.741 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.741 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:32.741 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:32.741 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:32.741 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:06:32.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.742 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:32.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:32.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:32.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:06:32.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:06:32.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:06:32.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:06:32.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:06:32.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:06:32.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:06:32.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:06:32.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:06:32.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:06:32.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:06:32.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:06:32.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:06:32.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:06:32.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:06:32.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:06:32.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:06:32.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:06:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:06:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:06:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:06:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.747 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:32.748 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:32.748 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.958834633999999, 2023-10-08T07:06:32.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:06:32.748 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.748 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.748 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:32.748 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:32.748 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:32.748 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:06:32.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.748 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:32.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:32.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:06:32.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:06:32.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:06:32.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:06:32.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:06:32.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:06:32.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:06:32.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:06:32.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:06:32.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:06:32.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:06:32.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:06:32.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:06:32.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:06:32.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:06:32.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:06:32.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:06:32.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:06:32.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:06:32.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:06:32.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:06:32.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:06:32.754 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.754 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.754 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.754 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:32.754 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:32.755 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.958815737999998, 2023-10-08T07:06:32.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:06:32.755 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.755 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.755 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:32.755 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:32.755 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:32.755 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:06:32.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.755 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:32.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:32.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:32.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:06:32.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:06:32.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:06:32.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:06:32.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:06:32.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:06:32.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:06:32.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:06:32.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:06:32.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:06:32.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:06:32.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:06:32.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:06:32.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:06:32.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:06:32.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:06:32.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:06:32.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:06:32.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:06:32.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:06:32.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:06:32.761 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.761 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.761 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.762 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:32.762 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:32.762 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.958802728999999, 2023-10-08T07:06:32.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:32.762 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.762 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.762 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:32.762 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:32.762 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:32.763 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:32.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.763 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:32.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:32.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:32.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:32.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:32.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:32.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:32.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:32.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:32.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:32.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:32.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:32.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:32.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:32.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:32.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:32.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:32.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:32.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:32.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:32.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:32.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:32.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:32.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:32.768 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.769 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.769 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.769 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:32.769 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:32.769 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.958750676999998, 2023-10-08T07:06:32.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:32.769 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.769 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.769 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:32.770 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:32.770 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:32.770 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:32.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.770 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:32.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:32.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:32.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:32.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:32.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:32.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:32.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:32.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:32.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:32.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:32.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:32.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:32.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:32.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:32.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:32.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:32.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:32.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:32.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:32.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:32.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:32.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:32.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:32.775 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.775 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.776 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.776 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.776 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:32.776 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.413546850000003, 2023-10-08T07:06:32.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:06:32.776 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.776 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.776 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:32.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:32.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:06:32.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:06:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:06:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:06:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:06:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:06:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:32.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:06:32.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:06:32.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:06:32.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:32.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:06:32.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:06:32.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:06:32.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:06:32.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:06:32.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:06:32.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:06:32.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:06:32.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:06:32.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:06:32.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:06:32.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:06:32.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:06:32.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:06:32.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:06:32.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:32.783 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.783 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.783 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.783 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.783 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:32.783 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.413430372000001, 2023-10-08T07:06:32.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:32.783 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.783 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:32.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:32.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:32.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:32.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:32.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:32.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:32.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:32.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:32.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:32.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:32.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:32.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:32.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:32.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:32.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:32.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:32.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:32.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:32.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:32.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:32.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:32.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:32.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:32.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:32.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:32.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:32.790 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.790 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.790 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.790 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.790 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:32.790 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.413380044999997, 2023-10-08T07:06:32.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:32.791 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.791 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.791 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:32.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:32.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:32.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:32.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:32.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:32.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:32.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:32.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:32.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:32.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:32.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:32.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:32.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:32.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:32.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:32.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:32.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:32.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:32.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.413054199999998, 2023-10-08T07:06:32.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:32.798 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.798 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.798 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:32.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:32.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:32.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:32.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:32.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:32.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:32.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:32.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:32.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:32.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:32.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:32.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:32.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:32.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:32.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:32.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:32.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:32.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:32.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:32.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:32.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:32.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:32.804 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.804 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.804 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.804 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.804 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:32.805 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.413001674999997, 2023-10-08T07:06:32.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:32.805 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.805 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.805 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:32.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:32.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:32.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:32.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:32.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:32.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:32.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:32.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:32.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:32.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:32.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:32.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:32.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:32.810 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.810 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.810 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.811 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.811 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:32.811 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.4128337, 2023-10-08T07:06:32.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:32.811 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.811 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.811 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:32.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:32.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:32.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:32.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:32.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:32.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:32.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:32.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:32.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:32.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:32.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:32.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:32.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:32.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:32.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:32.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:32.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:32.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:32.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:32.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:32.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:32.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:32.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:32.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:32.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:32.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:32.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:32.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:32.817 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.817 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.817 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.818 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.818 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:32.818 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.412689401999998, 2023-10-08T07:06:32.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:32.818 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.818 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.818 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:32.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:32.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:32.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:32.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:32.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:32.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:32.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:32.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:32.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:32.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:32.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:32.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:32.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:32.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:32.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:32.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:32.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:32.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:32.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:32.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:32.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:32.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:32.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:32.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.41200989, 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.825 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.826 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.826 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.826 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:32.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.826 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.826 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.826 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:32.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.826 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.826 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:32.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:32.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:32.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:32.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:32.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:32.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.828 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.828 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:32.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:32.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.828 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:32.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:32.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:32.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:32.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:32.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:32.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:32.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:32.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:32.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:32.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:32.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:32.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:32.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:32.831 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.831 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.832 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.832 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.832 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:32.832 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.411956619999998, 2023-10-08T07:06:32.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:32.832 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.832 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.832 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:32.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.833 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:32.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.833 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:32.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:32.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:32.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:32.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:32.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:32.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.835 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.835 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:32.835 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:32.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.835 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.835 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:32.835 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:32.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.835 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.835 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:32.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:32.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:32.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:32.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:32.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:32.838 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.838 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.838 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.838 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.838 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:32.838 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.411920774000002, 2023-10-08T07:06:32.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:32.838 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:32.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:32.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:32.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:32.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:32.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:32.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.841 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.841 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:32.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:32.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.841 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.841 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:32.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:32.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:32.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:32.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:32.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:32.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:32.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:32.844 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.411780243000003, 2023-10-08T07:06:32.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:32.845 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.845 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.845 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:32.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:32.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:32.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:32.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:32.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:32.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:32.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.848 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:32.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:32.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:32.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.848 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:32.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:32.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:32.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:32.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:32.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:32.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:32.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:32.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:32.851 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.851 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.851 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.851 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.852 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:32.852 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.411487919999999, 2023-10-08T07:06:32.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:32.852 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.852 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.852 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:32.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:32.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:32.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:32.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:32.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:32.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.854 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:32.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:32.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.854 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:32.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:32.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:32.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:32.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:32.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:32.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:32.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:32.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.857 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.857 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.857 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:32.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:32.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.857 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.857 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.857 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:32.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:32.857 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.857 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.857 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.858 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.858 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:32.858 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.411374277999997, 2023-10-08T07:06:32.858 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:32.858 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.858 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:32.858 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.858 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.858 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:32.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:32.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:32.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:32.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:32.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:32.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.861 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:32.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:32.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.861 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:32.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:32.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.862 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:32.862 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:32.862 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:32.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.862 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:32.862 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:32.862 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:32.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.862 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:32.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:32.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:32.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:32.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:32.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:32.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:32.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 59.410344053999999, 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:32.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.865 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:32.865 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:32.865 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.865 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.865 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:32.865 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:32.865 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:32.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.865 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.865 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:32.865 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:32.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:32.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.866 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:32.866 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:32.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:32.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.866 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:32.866 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:32.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:32.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:32.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:32.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:32.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:32.868 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:32.868 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:32.868 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:32.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:32.868 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.868 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.868 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.868 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:32.868 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:32.868 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:32.870 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:06:32.870 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:32.870+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:32.971 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:32.971+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:33.009 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:33.010 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:33.010 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2023-10-08T07:06:33.010 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:33.020 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-10-08T07:06:33.072 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:33.071+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.2 to 1 (10000) 2023-10-08T07:06:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2023-10-08T07:06:33.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2023-10-08T07:06:33.131 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:06:33.147 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:33.147 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:06:33.147 INFO:teuthology.orchestra.run.smithi086.stdout: "complaint_time": 30, 2023-10-08T07:06:33.147 INFO:teuthology.orchestra.run.smithi086.stdout: "num_blocked_ops": 0 2023-10-08T07:06:33.147 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:33.157 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-10-08T07:06:33.173 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:33.172+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:33.274 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:33.274+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:33.284 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:06:33.284 INFO:teuthology.orchestra.run.smithi086.stdout: "size": 20, 2023-10-08T07:06:33.284 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 600, 2023-10-08T07:06:33.284 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [ 2023-10-08T07:06:33.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.285 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:33 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'19, mlcod=11'14)", 2023-10-08T07:06:33.285 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:33.285 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 70.967628726000001, 2023-10-08T07:06:33.285 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069404690000000003, 2023-10-08T07:06:33.285 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.285 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.285 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.285 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.285 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:33.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315210+0000", 2023-10-08T07:06:33.286 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.286 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.286 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.286 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315211+0000", 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315216+0000", 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315229+0000", 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.278e-05 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.287 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.315235+0000", 2023-10-08T07:06:33.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.964e-06 2023-10-08T07:06:33.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.288 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.288 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316390+0000", 2023-10-08T07:06:33.288 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0011548179999999999 2023-10-08T07:06:33.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.288 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.316410+0000", 2023-10-08T07:06:33.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0818999999999998e-05 2023-10-08T07:06:33.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.289 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322113+0000", 2023-10-08T07:06:33.289 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0057026159999999998 2023-10-08T07:06:33.289 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.289 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.289 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.290 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.322150+0000", 2023-10-08T07:06:33.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7401999999999999e-05 2023-10-08T07:06:33.290 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.290 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.290 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.290 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.290 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-10-08T07:06:33.290 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:33.290 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 70.510268956000004, 2023-10-08T07:06:33.290 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087059660000000007, 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772570+0000", 2023-10-08T07:06:33.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:06:33.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.292 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772604+0000", 2023-10-08T07:06:33.292 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.413e-05 2023-10-08T07:06:33.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.292 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.292 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772617+0000", 2023-10-08T07:06:33.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2595999999999999e-05 2023-10-08T07:06:33.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.293 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772624+0000", 2023-10-08T07:06:33.293 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5939999999999999e-06 2023-10-08T07:06:33.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.293 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.293 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772666+0000", 2023-10-08T07:06:33.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1925000000000003e-05 2023-10-08T07:06:33.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.294 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.772685+0000", 2023-10-08T07:06:33.294 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9071000000000001e-05 2023-10-08T07:06:33.294 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.294 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.294 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781237+0000", 2023-10-08T07:06:33.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085519059999999997 2023-10-08T07:06:33.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.295 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.295 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.781276+0000", 2023-10-08T07:06:33.295 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9161e-05 2023-10-08T07:06:33.295 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.295 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.295 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.295 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.295 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.296 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-10-08T07:06:33.296 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:33.296 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 70.509772302000002, 2023-10-08T07:06:33.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010997768, 2023-10-08T07:06:33.296 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.296 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.296 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.296 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.296 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.296 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:33.296 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773066+0000", 2023-10-08T07:06:33.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.297 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.297 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773067+0000", 2023-10-08T07:06:33.297 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:06:33.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.297 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.298 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.298 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773071+0000", 2023-10-08T07:06:33.298 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.3819999999999997e-06 2023-10-08T07:06:33.298 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.298 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773082+0000", 2023-10-08T07:06:33.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0407e-05 2023-10-08T07:06:33.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.299 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.299 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.299 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773087+0000", 2023-10-08T07:06:33.299 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:06:33.299 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775481+0000", 2023-10-08T07:06:33.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0023941470000000001 2023-10-08T07:06:33.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.300 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775493+0000", 2023-10-08T07:06:33.300 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2126999999999999e-05 2023-10-08T07:06:33.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.300 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.300 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784021+0000", 2023-10-08T07:06:33.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085280589999999993 2023-10-08T07:06:33.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.301 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.301 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.301 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784064+0000", 2023-10-08T07:06:33.301 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.295e-05 2023-10-08T07:06:33.301 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.301 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.301 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.301 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.302 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:157 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'111, mlcod=11'105)", 2023-10-08T07:06:33.302 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:33.302 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 70.509352203999995, 2023-10-08T07:06:33.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010614554, 2023-10-08T07:06:33.302 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.302 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.302 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.302 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.302 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.302 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:33.302 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773486+0000", 2023-10-08T07:06:33.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.303 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.303 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773487+0000", 2023-10-08T07:06:33.303 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:06:33.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.303 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773492+0000", 2023-10-08T07:06:33.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2249999999999999e-06 2023-10-08T07:06:33.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773503+0000", 2023-10-08T07:06:33.304 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0271e-05 2023-10-08T07:06:33.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.304 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.304 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.304 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773509+0000", 2023-10-08T07:06:33.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.5470000000000002e-06 2023-10-08T07:06:33.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775801+0000", 2023-10-08T07:06:33.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0022918790000000001 2023-10-08T07:06:33.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.305 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.305 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.305 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775822+0000", 2023-10-08T07:06:33.305 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1486000000000001e-05 2023-10-08T07:06:33.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784066+0000", 2023-10-08T07:06:33.306 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0082432089999999996 2023-10-08T07:06:33.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.306 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.306 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.306 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784101+0000", 2023-10-08T07:06:33.308 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.5383999999999999e-05 2023-10-08T07:06:33.308 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.308 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.308 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.308 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.308 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:158 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'112, mlcod=11'106)", 2023-10-08T07:06:33.309 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:33.309 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 70.508875106999994, 2023-10-08T07:06:33.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.010172001999999999, 2023-10-08T07:06:33.309 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.309 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.309 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.309 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.309 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:33.309 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.309 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:33.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.310 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773964+0000", 2023-10-08T07:06:33.310 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.82e-07 2023-10-08T07:06:33.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.310 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.310 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.773990+0000", 2023-10-08T07:06:33.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6259999999999999e-05 2023-10-08T07:06:33.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774001+0000", 2023-10-08T07:06:33.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0873000000000001e-05 2023-10-08T07:06:33.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.311 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.311 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.311 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774006+0000", 2023-10-08T07:06:33.311 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.0900000000000004e-06 2023-10-08T07:06:33.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776145+0000", 2023-10-08T07:06:33.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0021389759999999999 2023-10-08T07:06:33.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.312 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.312 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776165+0000", 2023-10-08T07:06:33.312 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9548e-05 2023-10-08T07:06:33.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.312 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784102+0000", 2023-10-08T07:06:33.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.007937342 2023-10-08T07:06:33.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.313 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.313 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.313 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784136+0000", 2023-10-08T07:06:33.313 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.3331000000000003e-05 2023-10-08T07:06:33.313 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.314 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.314 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.314 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:159 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'113, mlcod=11'106)", 2023-10-08T07:06:33.314 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:33.314 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 70.508342149000001, 2023-10-08T07:06:33.314 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0096667119999999992, 2023-10-08T07:06:33.314 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.314 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.314 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.314 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:33.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:33.315 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.315 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.315 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.315 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774497+0000", 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774501+0000", 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.1529999999999999e-06 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774511+0000", 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.316 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.774533+0000", 2023-10-08T07:06:33.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2348999999999999e-05 2023-10-08T07:06:33.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776608+0000", 2023-10-08T07:06:33.317 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002074799 2023-10-08T07:06:33.317 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.317 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.317 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.317 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776627+0000", 2023-10-08T07:06:33.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8632999999999999e-05 2023-10-08T07:06:33.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784138+0000", 2023-10-08T07:06:33.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0075110819999999997 2023-10-08T07:06:33.318 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.318 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.318 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.318 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784163+0000", 2023-10-08T07:06:33.318 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.5425000000000001e-05 2023-10-08T07:06:33.318 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.319 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.319 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.319 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.319 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:160 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'114, mlcod=11'106)", 2023-10-08T07:06:33.319 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:33.319 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 70.507706967000004, 2023-10-08T07:06:33.319 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090478150000000007, 2023-10-08T07:06:33.319 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.319 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.319 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.319 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:33.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775132+0000", 2023-10-08T07:06:33.320 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.320 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.320 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.320 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775133+0000", 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.587e-06 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775150+0000", 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.6206e-05 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775173+0000", 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.351e-05 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.321 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775187+0000", 2023-10-08T07:06:33.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4396000000000001e-05 2023-10-08T07:06:33.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776909+0000", 2023-10-08T07:06:33.322 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0017220429999999999 2023-10-08T07:06:33.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.322 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.322 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.322 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776929+0000", 2023-10-08T07:06:33.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.9313e-05 2023-10-08T07:06:33.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784164+0000", 2023-10-08T07:06:33.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0072352340000000001 2023-10-08T07:06:33.323 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.323 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.323 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.323 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:33.323 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5526e-05 2023-10-08T07:06:33.323 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.324 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.324 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.324 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.324 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:161 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'115, mlcod=11'106)", 2023-10-08T07:06:33.324 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:33.324 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 70.507028078000005, 2023-10-08T07:06:33.324 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0083874480000000005, 2023-10-08T07:06:33.324 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.324 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.324 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.324 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775811+0000", 2023-10-08T07:06:33.325 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:06:33.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775837+0000", 2023-10-08T07:06:33.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.6081e-05 2023-10-08T07:06:33.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.326 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.326 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.326 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775849+0000", 2023-10-08T07:06:33.326 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:06:33.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.775854+0000", 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1490000000000002e-06 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777220+0000", 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001365174 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.327 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777232+0000", 2023-10-08T07:06:33.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2293000000000001e-05 2023-10-08T07:06:33.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784180+0000", 2023-10-08T07:06:33.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0069481450000000002 2023-10-08T07:06:33.328 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.328 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.328 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.328 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784198+0000", 2023-10-08T07:06:33.328 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.7997000000000001e-05 2023-10-08T07:06:33.328 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.329 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.329 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.329 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:162 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'116, mlcod=11'106)", 2023-10-08T07:06:33.329 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:33.329 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 70.506403676000005, 2023-10-08T07:06:33.329 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077785969999999999, 2023-10-08T07:06:33.329 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.329 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.329 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.329 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:33.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776435+0000", 2023-10-08T07:06:33.330 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.330 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.330 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.330 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.330 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776436+0000", 2023-10-08T07:06:33.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:06:33.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776440+0000", 2023-10-08T07:06:33.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.2629999999999997e-06 2023-10-08T07:06:33.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.331 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.331 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.331 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776451+0000", 2023-10-08T07:06:33.331 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1385e-05 2023-10-08T07:06:33.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.776456+0000", 2023-10-08T07:06:33.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.9919999999999998e-06 2023-10-08T07:06:33.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.332 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.332 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.332 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777629+0000", 2023-10-08T07:06:33.332 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.001173297 2023-10-08T07:06:33.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777650+0000", 2023-10-08T07:06:33.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.0126e-05 2023-10-08T07:06:33.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.333 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784199+0000", 2023-10-08T07:06:33.333 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006548908 2023-10-08T07:06:33.333 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.333 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.333 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.334 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:33.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5071e-05 2023-10-08T07:06:33.334 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.334 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.334 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.334 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.334 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:163 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'117, mlcod=11'106)", 2023-10-08T07:06:33.334 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:33.334 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 70.505761269000004, 2023-10-08T07:06:33.334 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071515490000000001, 2023-10-08T07:06:33.334 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777077+0000", 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.335 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777078+0000", 2023-10-08T07:06:33.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.4400000000000001e-07 2023-10-08T07:06:33.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777082+0000", 2023-10-08T07:06:33.336 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.732e-06 2023-10-08T07:06:33.336 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.336 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.336 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.336 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777095+0000", 2023-10-08T07:06:33.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.3749e-05 2023-10-08T07:06:33.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777100+0000", 2023-10-08T07:06:33.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.634e-06 2023-10-08T07:06:33.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.337 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.337 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.337 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777944+0000", 2023-10-08T07:06:33.337 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00084377599999999997 2023-10-08T07:06:33.337 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777957+0000", 2023-10-08T07:06:33.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.276e-05 2023-10-08T07:06:33.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.338 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.338 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784214+0000", 2023-10-08T07:06:33.338 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.006257617 2023-10-08T07:06:33.338 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.338 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.784229+0000", 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4837e-05 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_repop(client.4141.0:164 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'118, mlcod=11'106)", 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 70.505179929999997, 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093104280000000008, 2023-10-08T07:06:33.339 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.340 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.340 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:33.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.340 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.340 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.340 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:33.340 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.340 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777659+0000", 2023-10-08T07:06:33.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2e-07 2023-10-08T07:06:33.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.341 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777713+0000", 2023-10-08T07:06:33.341 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.4079999999999997e-05 2023-10-08T07:06:33.341 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.341 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.341 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777724+0000", 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0652999999999999e-05 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.777729+0000", 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2050000000000001e-06 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778177+0000", 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00044763499999999999 2023-10-08T07:06:33.342 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.778195+0000", 2023-10-08T07:06:33.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.8125e-05 2023-10-08T07:06:33.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.343 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786935+0000", 2023-10-08T07:06:33.343 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0087396049999999992 2023-10-08T07:06:33.343 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.343 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.343 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.344 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:22.786969+0000", 2023-10-08T07:06:33.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.4604999999999998e-05 2023-10-08T07:06:33.344 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.344 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.344 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.344 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.344 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.344 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.344 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:33.344 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.967291500000002, 2023-10-08T07:06:33.344 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.013957681, 2023-10-08T07:06:33.344 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315547+0000", 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.345 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315552+0000", 2023-10-08T07:06:33.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.152e-06 2023-10-08T07:06:33.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315568+0000", 2023-10-08T07:06:33.346 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5301000000000001e-05 2023-10-08T07:06:33.346 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.346 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.346 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.346 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315583+0000", 2023-10-08T07:06:33.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.5826000000000001e-05 2023-10-08T07:06:33.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315598+0000", 2023-10-08T07:06:33.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.4953999999999999e-05 2023-10-08T07:06:33.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.347 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.347 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.347 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317200+0000", 2023-10-08T07:06:33.347 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0016014950000000001 2023-10-08T07:06:33.347 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317351+0000", 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015081400000000001 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317540+0000", 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000189557 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:33.348 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322281+0000", 2023-10-08T07:06:33.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0047409599999999998 2023-10-08T07:06:33.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329404+0000", 2023-10-08T07:06:33.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071225460000000004 2023-10-08T07:06:33.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.349 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.349 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.349 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329459+0000", 2023-10-08T07:06:33.349 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.5016999999999999e-05 2023-10-08T07:06:33.349 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.350 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.350 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329505+0000", 2023-10-08T07:06:33.350 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.6059000000000001e-05 2023-10-08T07:06:33.350 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.350 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.350 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.350 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.350 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.350 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.350 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:33.350 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.967208530999997, 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015617259, 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315630+0000", 2023-10-08T07:06:33.351 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315631+0000", 2023-10-08T07:06:33.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3099999999999996e-07 2023-10-08T07:06:33.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.352 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.352 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315636+0000", 2023-10-08T07:06:33.352 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1019999999999996e-06 2023-10-08T07:06:33.352 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.352 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315646+0000", 2023-10-08T07:06:33.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0056e-05 2023-10-08T07:06:33.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.315654+0000", 2023-10-08T07:06:33.353 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7810000000000005e-06 2023-10-08T07:06:33.353 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.353 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.353 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.353 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318626+0000", 2023-10-08T07:06:33.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00297183 2023-10-08T07:06:33.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319450+0000", 2023-10-08T07:06:33.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00082440400000000004 2023-10-08T07:06:33.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.354 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.354 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.354 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319924+0000", 2023-10-08T07:06:33.354 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00047403099999999997 2023-10-08T07:06:33.354 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:33.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322475+0000", 2023-10-08T07:06:33.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.002550442 2023-10-08T07:06:33.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.355 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331142+0000", 2023-10-08T07:06:33.355 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0086669030000000001 2023-10-08T07:06:33.355 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.355 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.355 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331217+0000", 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.5606999999999996e-05 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331247+0000", 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.356 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:15 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.966045092000002, 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.012716055, 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.357 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:33.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316794+0000", 2023-10-08T07:06:33.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.8599999999999997e-07 2023-10-08T07:06:33.358 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.358 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.358 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.358 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316805+0000", 2023-10-08T07:06:33.358 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0475000000000001e-05 2023-10-08T07:06:33.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316817+0000", 2023-10-08T07:06:33.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.226e-05 2023-10-08T07:06:33.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.359 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.359 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316828+0000", 2023-10-08T07:06:33.359 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1090999999999999e-05 2023-10-08T07:06:33.359 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.359 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317025+0000", 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019711500000000001 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317244+0000", 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00021908999999999999 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.317436+0000", 2023-10-08T07:06:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00019164900000000001 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321493+0000", 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040573190000000002 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329275+0000", 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0077820950000000002 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329457+0000", 2023-10-08T07:06:33.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018165600000000001 2023-10-08T07:06:33.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.362 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.362 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329510+0000", 2023-10-08T07:06:33.362 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.2519000000000003e-05 2023-10-08T07:06:33.362 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.362 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.362 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.362 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.362 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.363 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:27 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.363 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:33.363 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.965984300999999, 2023-10-08T07:06:33.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015441417000000001, 2023-10-08T07:06:33.363 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.363 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.363 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.363 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.363 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.363 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:33.363 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.363 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316854+0000", 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316855+0000", 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.364 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316861+0000", 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.6210000000000001e-06 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316869+0000", 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.225e-06 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316878+0000", 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.8799999999999997e-06 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.365 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319969+0000", 2023-10-08T07:06:33.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0030906689999999999 2023-10-08T07:06:33.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320072+0000", 2023-10-08T07:06:33.366 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000103458 2023-10-08T07:06:33.366 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.366 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.366 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.366 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320631+0000", 2023-10-08T07:06:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00055936099999999997 2023-10-08T07:06:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322686+0000", 2023-10-08T07:06:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0020545899999999998 2023-10-08T07:06:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332244+0000", 2023-10-08T07:06:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0095578690000000001 2023-10-08T07:06:33.367 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332274+0000", 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.0527000000000001e-05 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332296+0000", 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.1359999999999999e-05 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.368 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.965947712000002, 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014502582, 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.369 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316891+0000", 2023-10-08T07:06:33.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.370 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316892+0000", 2023-10-08T07:06:33.370 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:06:33.370 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.370 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.370 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316896+0000", 2023-10-08T07:06:33.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.9140000000000001e-06 2023-10-08T07:06:33.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316904+0000", 2023-10-08T07:06:33.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.1170000000000004e-06 2023-10-08T07:06:33.371 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.371 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.371 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.371 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316911+0000", 2023-10-08T07:06:33.371 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320938+0000", 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0040269959999999997 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321023+0000", 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.5420000000000005e-05 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.372 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321157+0000", 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00013383700000000001 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322742+0000", 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015851249999999999 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331290+0000", 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0085483190000000004 2023-10-08T07:06:33.373 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331348+0000", 2023-10-08T07:06:33.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.7630999999999998e-05 2023-10-08T07:06:33.374 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.374 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.374 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.374 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.331394+0000", 2023-10-08T07:06:33.374 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 4.5534999999999997e-05 2023-10-08T07:06:33.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.374 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.374 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:33 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.965919223999997, 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.015363402, 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:33.375 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316919+0000", 2023-10-08T07:06:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316920+0000", 2023-10-08T07:06:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.75e-07 2023-10-08T07:06:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.376 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316923+0000", 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.2169999999999999e-06 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316930+0000", 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.316938+0000", 2023-10-08T07:06:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:06:33.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322217+0000", 2023-10-08T07:06:33.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0052793680000000004 2023-10-08T07:06:33.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.378 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.378 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322295+0000", 2023-10-08T07:06:33.378 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.7621999999999996e-05 2023-10-08T07:06:33.378 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.378 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.322411+0000", 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000116297 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323187+0000", 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00077583700000000003 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332224+0000", 2023-10-08T07:06:33.379 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0090370980000000004 2023-10-08T07:06:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332261+0000", 2023-10-08T07:06:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.6464999999999997e-05 2023-10-08T07:06:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332283+0000", 2023-10-08T07:06:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2124e-05 2023-10-08T07:06:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.380 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.964796040000003, 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.014463023, 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.381 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318043+0000", 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318044+0000", 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.1000000000000001e-06 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.382 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318057+0000", 2023-10-08T07:06:33.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.2860000000000001e-05 2023-10-08T07:06:33.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.383 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318067+0000", 2023-10-08T07:06:33.383 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0638999999999999e-05 2023-10-08T07:06:33.383 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.383 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.383 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318090+0000", 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.2889000000000001e-05 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.320985+0000", 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0028951279999999999 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321126+0000", 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00014045600000000001 2023-10-08T07:06:33.384 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.321798+0000", 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00067266600000000004 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "op_commit", 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.323135+0000", 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0013368589999999999 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.385 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332445+0000", 2023-10-08T07:06:33.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0093094419999999994 2023-10-08T07:06:33.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "commit_sent", 2023-10-08T07:06:33.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332482+0000", 2023-10-08T07:06:33.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:33.386 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.386 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.386 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.386 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.332506+0000", 2023-10-08T07:06:33.386 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.3649e-05 2023-10-08T07:06:33.386 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:26 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.964727531000001, 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.011597616999999999, 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.387 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318111+0000", 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318112+0000", 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 9.2299999999999999e-07 2023-10-08T07:06:33.388 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318117+0000", 2023-10-08T07:06:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.1170000000000003e-06 2023-10-08T07:06:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318127+0000", 2023-10-08T07:06:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 1.0129000000000001e-05 2023-10-08T07:06:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.389 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318136+0000", 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 8.3610000000000001e-06 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.000101062 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318422+0000", 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00018560500000000001 2023-10-08T07:06:33.390 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.391 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.391 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.329709+0000", 2023-10-08T07:06:33.391 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.01128642 2023-10-08T07:06:33.391 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.391 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.391 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.391 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.391 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.391 INFO:teuthology.orchestra.run.smithi086.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.391 INFO:teuthology.orchestra.run.smithi086.stdout: "initiated_at": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:33.391 INFO:teuthology.orchestra.run.smithi086.stdout: "age": 59.964688410999997, 2023-10-08T07:06:33.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0088267940000000007, 2023-10-08T07:06:33.392 INFO:teuthology.orchestra.run.smithi086.stdout: "type_data": { 2023-10-08T07:06:33.392 INFO:teuthology.orchestra.run.smithi086.stdout: "flag_point": "started", 2023-10-08T07:06:33.392 INFO:teuthology.orchestra.run.smithi086.stdout: "events": [ 2023-10-08T07:06:33.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "initiated", 2023-10-08T07:06:33.392 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:33.392 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.392 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.392 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.392 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "header_read", 2023-10-08T07:06:33.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318150+0000", 2023-10-08T07:06:33.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0 2023-10-08T07:06:33.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "throttled", 2023-10-08T07:06:33.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318151+0000", 2023-10-08T07:06:33.393 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:06:33.393 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.393 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.393 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "all_read", 2023-10-08T07:06:33.393 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318154+0000", 2023-10-08T07:06:33.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 2.9529999999999999e-06 2023-10-08T07:06:33.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "dispatched", 2023-10-08T07:06:33.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318161+0000", 2023-10-08T07:06:33.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 7.126e-06 2023-10-08T07:06:33.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.394 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.394 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.394 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.318167+0000", 2023-10-08T07:06:33.394 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 6.2169999999999999e-06 2023-10-08T07:06:33.394 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "reached_pg", 2023-10-08T07:06:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319711+0000", 2023-10-08T07:06:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0015438769999999999 2023-10-08T07:06:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "started", 2023-10-08T07:06:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.319864+0000", 2023-10-08T07:06:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.00015264799999999999 2023-10-08T07:06:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2023-10-08T07:06:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: { 2023-10-08T07:06:33.395 INFO:teuthology.orchestra.run.smithi086.stdout: "event": "done", 2023-10-08T07:06:33.396 INFO:teuthology.orchestra.run.smithi086.stdout: "time": "2023-10-08T07:05:33.326977+0000", 2023-10-08T07:06:33.396 INFO:teuthology.orchestra.run.smithi086.stdout: "duration": 0.0071133890000000003 2023-10-08T07:06:33.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.396 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.396 INFO:teuthology.orchestra.run.smithi086.stdout: } 2023-10-08T07:06:33.396 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2023-10-08T07:06:33.396 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:06:33.398 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:33.398 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:33.396+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:33.498 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:33.498+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:33.538 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:33.538 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:33.539 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:33.539 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:33.549 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:06:33.551 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:06:33.552 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:33.566 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-10-08T07:06:33.106832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91380,"kb_used_data":2000,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024140,"statfs":{"total":289910292480,"available":289816719360,"internally_reserved":0,"allocated":2048000,"data_stored":1520161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":91483475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.593200"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082540+0000","last_change":"2023-10-08T07:05:33.319747+0000","last_active":"2023-10-08T07:06:24.082540+0000","last_peered":"2023-10-08T07:06:24.082540+0000","last_clean":"2023-10-08T07:06:24.082540+0000","last_became_active":"2023-10-08T07:05:33.318115+0000","last_became_peered":"2023-10-08T07:05:33.318115+0000","last_unstale":"2023-10-08T07:06:24.082540+0000","last_undegraded":"2023-10-08T07:06:24.082540+0000","last_fullsized":"2023-10-08T07:06:24.082540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082173+0000","last_change":"2023-10-08T07:05:33.322480+0000","last_active":"2023-10-08T07:06:24.082173+0000","last_peered":"2023-10-08T07:06:24.082173+0000","last_clean":"2023-10-08T07:06:24.082173+0000","last_became_active":"2023-10-08T07:05:33.322153+0000","last_became_peered":"2023-10-08T07:05:33.322153+0000","last_unstale":"2023-10-08T07:06:24.082173+0000","last_undegraded":"2023-10-08T07:06:24.082173+0000","last_fullsized":"2023-10-08T07:06:24.082173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377041+0000","last_change":"2023-10-08T07:05:33.325067+0000","last_active":"2023-10-08T07:06:24.377041+0000","last_peered":"2023-10-08T07:06:24.377041+0000","last_clean":"2023-10-08T07:06:24.377041+0000","last_became_active":"2023-10-08T07:05:33.323439+0000","last_became_peered":"2023-10-08T07:05:33.323439+0000","last_unstale":"2023-10-08T07:06:24.377041+0000","last_undegraded":"2023-10-08T07:06:24.377041+0000","last_fullsized":"2023-10-08T07:06:24.377041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:18.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376804+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:06:24.376804+0000","last_peered":"2023-10-08T07:06:24.376804+0000","last_clean":"2023-10-08T07:06:24.376804+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:06:24.376804+0000","last_undegraded":"2023-10-08T07:06:24.376804+0000","last_fullsized":"2023-10-08T07:06:24.376804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082022+0000","last_change":"2023-10-08T07:05:33.321314+0000","last_active":"2023-10-08T07:06:24.082022+0000","last_peered":"2023-10-08T07:06:24.082022+0000","last_clean":"2023-10-08T07:06:24.082022+0000","last_became_active":"2023-10-08T07:05:33.320841+0000","last_became_peered":"2023-10-08T07:05:33.320841+0000","last_unstale":"2023-10-08T07:06:24.082022+0000","last_undegraded":"2023-10-08T07:06:24.082022+0000","last_fullsized":"2023-10-08T07:06:24.082022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376102+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:06:24.376102+0000","last_peered":"2023-10-08T07:06:24.376102+0000","last_clean":"2023-10-08T07:06:24.376102+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:06:24.376102+0000","last_undegraded":"2023-10-08T07:06:24.376102+0000","last_fullsized":"2023-10-08T07:06:24.376102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376036+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:06:24.376036+0000","last_peered":"2023-10-08T07:06:24.376036+0000","last_clean":"2023-10-08T07:06:24.376036+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:06:24.376036+0000","last_undegraded":"2023-10-08T07:06:24.376036+0000","last_fullsized":"2023-10-08T07:06:24.376036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.375940+0000","last_change":"2023-10-08T07:05:33.327740+0000","last_active":"2023-10-08T07:06:24.375940+0000","last_peered":"2023-10-08T07:06:24.375940+0000","last_clean":"2023-10-08T07:06:24.375940+0000","last_became_active":"2023-10-08T07:05:33.325912+0000","last_became_peered":"2023-10-08T07:05:33.325912+0000","last_unstale":"2023-10-08T07:06:24.375940+0000","last_undegraded":"2023-10-08T07:06:24.375940+0000","last_fullsized":"2023-10-08T07:06:24.375940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079533+0000","last_change":"2023-10-08T07:05:33.322628+0000","last_active":"2023-10-08T07:06:24.079533+0000","last_peered":"2023-10-08T07:06:24.079533+0000","last_clean":"2023-10-08T07:06:24.079533+0000","last_became_active":"2023-10-08T07:05:33.321816+0000","last_became_peered":"2023-10-08T07:05:33.321816+0000","last_unstale":"2023-10-08T07:06:24.079533+0000","last_undegraded":"2023-10-08T07:06:24.079533+0000","last_fullsized":"2023-10-08T07:06:24.079533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082334+0000","last_change":"2023-10-08T07:05:33.322098+0000","last_active":"2023-10-08T07:06:24.082334+0000","last_peered":"2023-10-08T07:06:24.082334+0000","last_clean":"2023-10-08T07:06:24.082334+0000","last_became_active":"2023-10-08T07:05:33.321208+0000","last_became_peered":"2023-10-08T07:05:33.321208+0000","last_unstale":"2023-10-08T07:06:24.082334+0000","last_undegraded":"2023-10-08T07:06:24.082334+0000","last_fullsized":"2023-10-08T07:06:24.082334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376847+0000","last_change":"2023-10-08T07:05:33.328140+0000","last_active":"2023-10-08T07:06:24.376847+0000","last_peered":"2023-10-08T07:06:24.376847+0000","last_clean":"2023-10-08T07:06:24.376847+0000","last_became_active":"2023-10-08T07:05:33.327595+0000","last_became_peered":"2023-10-08T07:05:33.327595+0000","last_unstale":"2023-10-08T07:06:24.376847+0000","last_undegraded":"2023-10-08T07:06:24.376847+0000","last_fullsized":"2023-10-08T07:06:24.376847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082010+0000","last_change":"2023-10-08T07:05:33.329834+0000","last_active":"2023-10-08T07:06:24.082010+0000","last_peered":"2023-10-08T07:06:24.082010+0000","last_clean":"2023-10-08T07:06:24.082010+0000","last_became_active":"2023-10-08T07:05:33.329357+0000","last_became_peered":"2023-10-08T07:05:33.329357+0000","last_unstale":"2023-10-08T07:06:24.082010+0000","last_undegraded":"2023-10-08T07:06:24.082010+0000","last_fullsized":"2023-10-08T07:06:24.082010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081937+0000","last_change":"2023-10-08T07:05:33.319643+0000","last_active":"2023-10-08T07:06:24.081937+0000","last_peered":"2023-10-08T07:06:24.081937+0000","last_clean":"2023-10-08T07:06:24.081937+0000","last_became_active":"2023-10-08T07:05:33.318659+0000","last_became_peered":"2023-10-08T07:05:33.318659+0000","last_unstale":"2023-10-08T07:06:24.081937+0000","last_undegraded":"2023-10-08T07:06:24.081937+0000","last_fullsized":"2023-10-08T07:06:24.081937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376660+0000","last_change":"2023-10-08T07:05:33.318491+0000","last_active":"2023-10-08T07:06:24.376660+0000","last_peered":"2023-10-08T07:06:24.376660+0000","last_clean":"2023-10-08T07:06:24.376660+0000","last_became_active":"2023-10-08T07:05:33.317703+0000","last_became_peered":"2023-10-08T07:05:33.317703+0000","last_unstale":"2023-10-08T07:06:24.376660+0000","last_undegraded":"2023-10-08T07:06:24.376660+0000","last_fullsized":"2023-10-08T07:06:24.376660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376189+0000","last_change":"2023-10-08T07:05:33.319294+0000","last_active":"2023-10-08T07:06:24.376189+0000","last_peered":"2023-10-08T07:06:24.376189+0000","last_clean":"2023-10-08T07:06:24.376189+0000","last_became_active":"2023-10-08T07:05:33.318364+0000","last_became_peered":"2023-10-08T07:05:33.318364+0000","last_unstale":"2023-10-08T07:06:24.376189+0000","last_undegraded":"2023-10-08T07:06:24.376189+0000","last_fullsized":"2023-10-08T07:06:24.376189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.375959+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:06:24.375959+0000","last_peered":"2023-10-08T07:06:24.375959+0000","last_clean":"2023-10-08T07:06:24.375959+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:06:24.375959+0000","last_undegraded":"2023-10-08T07:06:24.375959+0000","last_fullsized":"2023-10-08T07:06:24.375959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079575+0000","last_change":"2023-10-08T07:05:33.317287+0000","last_active":"2023-10-08T07:06:24.079575+0000","last_peered":"2023-10-08T07:06:24.079575+0000","last_clean":"2023-10-08T07:06:24.079575+0000","last_became_active":"2023-10-08T07:05:33.316483+0000","last_became_peered":"2023-10-08T07:05:33.316483+0000","last_unstale":"2023-10-08T07:06:24.079575+0000","last_undegraded":"2023-10-08T07:06:24.079575+0000","last_fullsized":"2023-10-08T07:06:24.079575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082413+0000","last_change":"2023-10-08T07:05:33.321088+0000","last_active":"2023-10-08T07:06:24.082413+0000","last_peered":"2023-10-08T07:06:24.082413+0000","last_clean":"2023-10-08T07:06:24.082413+0000","last_became_active":"2023-10-08T07:05:33.319541+0000","last_became_peered":"2023-10-08T07:05:33.319541+0000","last_unstale":"2023-10-08T07:06:24.082413+0000","last_undegraded":"2023-10-08T07:06:24.082413+0000","last_fullsized":"2023-10-08T07:06:24.082413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079347+0000","last_change":"2023-10-08T07:05:33.322110+0000","last_active":"2023-10-08T07:06:24.079347+0000","last_peered":"2023-10-08T07:06:24.079347+0000","last_clean":"2023-10-08T07:06:24.079347+0000","last_became_active":"2023-10-08T07:05:33.321780+0000","last_became_peered":"2023-10-08T07:05:33.321780+0000","last_unstale":"2023-10-08T07:06:24.079347+0000","last_undegraded":"2023-10-08T07:06:24.079347+0000","last_fullsized":"2023-10-08T07:06:24.079347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376690+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:06:24.376690+0000","last_peered":"2023-10-08T07:06:24.376690+0000","last_clean":"2023-10-08T07:06:24.376690+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:06:24.376690+0000","last_undegraded":"2023-10-08T07:06:24.376690+0000","last_fullsized":"2023-10-08T07:06:24.376690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376555+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:06:24.376555+0000","last_peered":"2023-10-08T07:06:24.376555+0000","last_clean":"2023-10-08T07:06:24.376555+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:06:24.376555+0000","last_undegraded":"2023-10-08T07:06:24.376555+0000","last_fullsized":"2023-10-08T07:06:24.376555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081862+0000","last_change":"2023-10-08T07:05:33.326970+0000","last_active":"2023-10-08T07:06:24.081862+0000","last_peered":"2023-10-08T07:06:24.081862+0000","last_clean":"2023-10-08T07:06:24.081862+0000","last_became_active":"2023-10-08T07:05:33.326650+0000","last_became_peered":"2023-10-08T07:05:33.326650+0000","last_unstale":"2023-10-08T07:06:24.081862+0000","last_undegraded":"2023-10-08T07:06:24.081862+0000","last_fullsized":"2023-10-08T07:06:24.081862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078821+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:06:24.078821+0000","last_peered":"2023-10-08T07:06:24.078821+0000","last_clean":"2023-10-08T07:06:24.078821+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:06:24.078821+0000","last_undegraded":"2023-10-08T07:06:24.078821+0000","last_fullsized":"2023-10-08T07:06:24.078821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081835+0000","last_change":"2023-10-08T07:05:33.319759+0000","last_active":"2023-10-08T07:06:24.081835+0000","last_peered":"2023-10-08T07:06:24.081835+0000","last_clean":"2023-10-08T07:06:24.081835+0000","last_became_active":"2023-10-08T07:05:33.318507+0000","last_became_peered":"2023-10-08T07:05:33.318507+0000","last_unstale":"2023-10-08T07:06:24.081835+0000","last_undegraded":"2023-10-08T07:06:24.081835+0000","last_fullsized":"2023-10-08T07:06:24.081835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082527+0000","last_change":"2023-10-08T07:05:33.317560+0000","last_active":"2023-10-08T07:06:24.082527+0000","last_peered":"2023-10-08T07:06:24.082527+0000","last_clean":"2023-10-08T07:06:24.082527+0000","last_became_active":"2023-10-08T07:05:33.316906+0000","last_became_peered":"2023-10-08T07:05:33.316906+0000","last_unstale":"2023-10-08T07:06:24.082527+0000","last_undegraded":"2023-10-08T07:06:24.082527+0000","last_fullsized":"2023-10-08T07:06:24.082527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079709+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:06:24.079709+0000","last_peered":"2023-10-08T07:06:24.079709+0000","last_clean":"2023-10-08T07:06:24.079709+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:06:24.079709+0000","last_undegraded":"2023-10-08T07:06:24.079709+0000","last_fullsized":"2023-10-08T07:06:24.079709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376924+0000","last_change":"2023-10-08T07:05:33.326267+0000","last_active":"2023-10-08T07:06:24.376924+0000","last_peered":"2023-10-08T07:06:24.376924+0000","last_clean":"2023-10-08T07:06:24.376924+0000","last_became_active":"2023-10-08T07:05:33.324579+0000","last_became_peered":"2023-10-08T07:05:33.324579+0000","last_unstale":"2023-10-08T07:06:24.376924+0000","last_undegraded":"2023-10-08T07:06:24.376924+0000","last_fullsized":"2023-10-08T07:06:24.376924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081845+0000","last_change":"2023-10-08T07:05:32.320295+0000","last_active":"2023-10-08T07:06:24.081845+0000","last_peered":"2023-10-08T07:06:24.081845+0000","last_clean":"2023-10-08T07:06:24.081845+0000","last_became_active":"2023-10-08T07:05:32.320044+0000","last_became_peered":"2023-10-08T07:05:32.320044+0000","last_unstale":"2023-10-08T07:06:24.081845+0000","last_undegraded":"2023-10-08T07:06:24.081845+0000","last_fullsized":"2023-10-08T07:06:24.081845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:44.690611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082418+0000","last_change":"2023-10-08T07:05:33.329921+0000","last_active":"2023-10-08T07:06:24.082418+0000","last_peered":"2023-10-08T07:06:24.082418+0000","last_clean":"2023-10-08T07:06:24.082418+0000","last_became_active":"2023-10-08T07:05:33.329346+0000","last_became_peered":"2023-10-08T07:05:33.329346+0000","last_unstale":"2023-10-08T07:06:24.082418+0000","last_undegraded":"2023-10-08T07:06:24.082418+0000","last_fullsized":"2023-10-08T07:06:24.082418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078850+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:06:24.078850+0000","last_peered":"2023-10-08T07:06:24.078850+0000","last_clean":"2023-10-08T07:06:24.078850+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:06:24.078850+0000","last_undegraded":"2023-10-08T07:06:24.078850+0000","last_fullsized":"2023-10-08T07:06:24.078850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079499+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:06:24.079499+0000","last_peered":"2023-10-08T07:06:24.079499+0000","last_clean":"2023-10-08T07:06:24.079499+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:06:24.079499+0000","last_undegraded":"2023-10-08T07:06:24.079499+0000","last_fullsized":"2023-10-08T07:06:24.079499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078809+0000","last_change":"2023-10-08T07:05:32.315935+0000","last_active":"2023-10-08T07:06:24.078809+0000","last_peered":"2023-10-08T07:06:24.078809+0000","last_clean":"2023-10-08T07:06:24.078809+0000","last_became_active":"2023-10-08T07:05:32.315661+0000","last_became_peered":"2023-10-08T07:05:32.315661+0000","last_unstale":"2023-10-08T07:06:24.078809+0000","last_undegraded":"2023-10-08T07:06:24.078809+0000","last_fullsized":"2023-10-08T07:06:24.078809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:01:05.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082498+0000","last_change":"2023-10-08T07:05:33.330068+0000","last_active":"2023-10-08T07:06:24.082498+0000","last_peered":"2023-10-08T07:06:24.082498+0000","last_clean":"2023-10-08T07:06:24.082498+0000","last_became_active":"2023-10-08T07:05:33.329169+0000","last_became_peered":"2023-10-08T07:05:33.329169+0000","last_unstale":"2023-10-08T07:06:24.082498+0000","last_undegraded":"2023-10-08T07:06:24.082498+0000","last_fullsized":"2023-10-08T07:06:24.082498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079709+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:06:24.079709+0000","last_peered":"2023-10-08T07:06:24.079709+0000","last_clean":"2023-10-08T07:06:24.079709+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:06:24.079709+0000","last_undegraded":"2023-10-08T07:06:24.079709+0000","last_fullsized":"2023-10-08T07:06:24.079709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078654+0000","last_change":"2023-10-08T07:05:33.316496+0000","last_active":"2023-10-08T07:06:24.078654+0000","last_peered":"2023-10-08T07:06:24.078654+0000","last_clean":"2023-10-08T07:06:24.078654+0000","last_became_active":"2023-10-08T07:05:33.316084+0000","last_became_peered":"2023-10-08T07:05:33.316084+0000","last_unstale":"2023-10-08T07:06:24.078654+0000","last_undegraded":"2023-10-08T07:06:24.078654+0000","last_fullsized":"2023-10-08T07:06:24.078654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377077+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:06:24.377077+0000","last_peered":"2023-10-08T07:06:24.377077+0000","last_clean":"2023-10-08T07:06:24.377077+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:06:24.377077+0000","last_undegraded":"2023-10-08T07:06:24.377077+0000","last_fullsized":"2023-10-08T07:06:24.377077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078957+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:06:24.078957+0000","last_peered":"2023-10-08T07:06:24.078957+0000","last_clean":"2023-10-08T07:06:24.078957+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:06:24.078957+0000","last_undegraded":"2023-10-08T07:06:24.078957+0000","last_fullsized":"2023-10-08T07:06:24.078957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082226+0000","last_change":"2023-10-08T07:05:32.323201+0000","last_active":"2023-10-08T07:06:24.082226+0000","last_peered":"2023-10-08T07:06:24.082226+0000","last_clean":"2023-10-08T07:06:24.082226+0000","last_became_active":"2023-10-08T07:05:32.322864+0000","last_became_peered":"2023-10-08T07:05:32.322864+0000","last_unstale":"2023-10-08T07:06:24.082226+0000","last_undegraded":"2023-10-08T07:06:24.082226+0000","last_fullsized":"2023-10-08T07:06:24.082226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:40.093124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078889+0000","last_change":"2023-10-08T07:05:33.317114+0000","last_active":"2023-10-08T07:06:24.078889+0000","last_peered":"2023-10-08T07:06:24.078889+0000","last_clean":"2023-10-08T07:06:24.078889+0000","last_became_active":"2023-10-08T07:05:33.316390+0000","last_became_peered":"2023-10-08T07:05:33.316390+0000","last_unstale":"2023-10-08T07:06:24.078889+0000","last_undegraded":"2023-10-08T07:06:24.078889+0000","last_fullsized":"2023-10-08T07:06:24.078889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"22'10","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376686+0000","last_change":"2023-10-08T07:05:32.319510+0000","last_active":"2023-10-08T07:06:24.376686+0000","last_peered":"2023-10-08T07:06:24.376686+0000","last_clean":"2023-10-08T07:06:24.376686+0000","last_became_active":"2023-10-08T07:05:32.319209+0000","last_became_peered":"2023-10-08T07:05:32.319209+0000","last_unstale":"2023-10-08T07:06:24.376686+0000","last_undegraded":"2023-10-08T07:06:24.376686+0000","last_fullsized":"2023-10-08T07:06:24.376686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:28.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376958+0000","last_change":"2023-10-08T07:05:33.317137+0000","last_active":"2023-10-08T07:06:24.376958+0000","last_peered":"2023-10-08T07:06:24.376958+0000","last_clean":"2023-10-08T07:06:24.376958+0000","last_became_active":"2023-10-08T07:05:33.316562+0000","last_became_peered":"2023-10-08T07:05:33.316562+0000","last_unstale":"2023-10-08T07:06:24.376958+0000","last_undegraded":"2023-10-08T07:06:24.376958+0000","last_fullsized":"2023-10-08T07:06:24.376958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:41.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376893+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:06:24.376893+0000","last_peered":"2023-10-08T07:06:24.376893+0000","last_clean":"2023-10-08T07:06:24.376893+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:06:24.376893+0000","last_undegraded":"2023-10-08T07:06:24.376893+0000","last_fullsized":"2023-10-08T07:06:24.376893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082114+0000","last_change":"2023-10-08T07:05:33.322201+0000","last_active":"2023-10-08T07:06:24.082114+0000","last_peered":"2023-10-08T07:06:24.082114+0000","last_clean":"2023-10-08T07:06:24.082114+0000","last_became_active":"2023-10-08T07:05:33.321826+0000","last_became_peered":"2023-10-08T07:05:33.321826+0000","last_unstale":"2023-10-08T07:06:24.082114+0000","last_undegraded":"2023-10-08T07:06:24.082114+0000","last_fullsized":"2023-10-08T07:06:24.082114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079020+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:06:24.079020+0000","last_peered":"2023-10-08T07:06:24.079020+0000","last_clean":"2023-10-08T07:06:24.079020+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:06:24.079020+0000","last_undegraded":"2023-10-08T07:06:24.079020+0000","last_fullsized":"2023-10-08T07:06:24.079020+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082388+0000","last_change":"2023-10-08T07:05:33.317545+0000","last_active":"2023-10-08T07:06:24.082388+0000","last_peered":"2023-10-08T07:06:24.082388+0000","last_clean":"2023-10-08T07:06:24.082388+0000","last_became_active":"2023-10-08T07:05:33.317134+0000","last_became_peered":"2023-10-08T07:05:33.317134+0000","last_unstale":"2023-10-08T07:06:24.082388+0000","last_undegraded":"2023-10-08T07:06:24.082388+0000","last_fullsized":"2023-10-08T07:06:24.082388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081781+0000","last_change":"2023-10-08T07:05:32.323406+0000","last_active":"2023-10-08T07:06:24.081781+0000","last_peered":"2023-10-08T07:06:24.081781+0000","last_clean":"2023-10-08T07:06:24.081781+0000","last_became_active":"2023-10-08T07:05:32.323040+0000","last_became_peered":"2023-10-08T07:05:32.323040+0000","last_unstale":"2023-10-08T07:06:24.081781+0000","last_undegraded":"2023-10-08T07:06:24.081781+0000","last_fullsized":"2023-10-08T07:06:24.081781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079610+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:06:24.079610+0000","last_peered":"2023-10-08T07:06:24.079610+0000","last_clean":"2023-10-08T07:06:24.079610+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:06:24.079610+0000","last_undegraded":"2023-10-08T07:06:24.079610+0000","last_fullsized":"2023-10-08T07:06:24.079610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376256+0000","last_change":"2023-10-08T07:05:32.319220+0000","last_active":"2023-10-08T07:06:24.376256+0000","last_peered":"2023-10-08T07:06:24.376256+0000","last_clean":"2023-10-08T07:06:24.376256+0000","last_became_active":"2023-10-08T07:05:32.318838+0000","last_became_peered":"2023-10-08T07:05:32.318838+0000","last_unstale":"2023-10-08T07:06:24.376256+0000","last_undegraded":"2023-10-08T07:06:24.376256+0000","last_fullsized":"2023-10-08T07:06:24.376256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:32:59.940325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079772+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:06:24.079772+0000","last_peered":"2023-10-08T07:06:24.079772+0000","last_clean":"2023-10-08T07:06:24.079772+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:06:24.079772+0000","last_undegraded":"2023-10-08T07:06:24.079772+0000","last_fullsized":"2023-10-08T07:06:24.079772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377179+0000","last_change":"2023-10-08T07:05:32.319446+0000","last_active":"2023-10-08T07:06:24.377179+0000","last_peered":"2023-10-08T07:06:24.377179+0000","last_clean":"2023-10-08T07:06:24.377179+0000","last_became_active":"2023-10-08T07:05:32.319019+0000","last_became_peered":"2023-10-08T07:05:32.319019+0000","last_unstale":"2023-10-08T07:06:24.377179+0000","last_undegraded":"2023-10-08T07:06:24.377179+0000","last_fullsized":"2023-10-08T07:06:24.377179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:56.843162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081595+0000","last_change":"2023-10-08T07:05:33.330217+0000","last_active":"2023-10-08T07:06:24.081595+0000","last_peered":"2023-10-08T07:06:24.081595+0000","last_clean":"2023-10-08T07:06:24.081595+0000","last_became_active":"2023-10-08T07:05:33.329639+0000","last_became_peered":"2023-10-08T07:05:33.329639+0000","last_unstale":"2023-10-08T07:06:24.081595+0000","last_undegraded":"2023-10-08T07:06:24.081595+0000","last_fullsized":"2023-10-08T07:06:24.081595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:21.715645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082228+0000","last_change":"2023-10-08T07:05:32.323481+0000","last_active":"2023-10-08T07:06:24.082228+0000","last_peered":"2023-10-08T07:06:24.082228+0000","last_clean":"2023-10-08T07:06:24.082228+0000","last_became_active":"2023-10-08T07:05:32.323243+0000","last_became_peered":"2023-10-08T07:05:32.323243+0000","last_unstale":"2023-10-08T07:06:24.082228+0000","last_undegraded":"2023-10-08T07:06:24.082228+0000","last_fullsized":"2023-10-08T07:06:24.082228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081970+0000","last_change":"2023-10-08T07:05:33.318539+0000","last_active":"2023-10-08T07:06:24.081970+0000","last_peered":"2023-10-08T07:06:24.081970+0000","last_clean":"2023-10-08T07:06:24.081970+0000","last_became_active":"2023-10-08T07:05:33.317371+0000","last_became_peered":"2023-10-08T07:05:33.317371+0000","last_unstale":"2023-10-08T07:06:24.081970+0000","last_undegraded":"2023-10-08T07:06:24.081970+0000","last_fullsized":"2023-10-08T07:06:24.081970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:00.945202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376961+0000","last_change":"2023-10-08T07:05:32.321744+0000","last_active":"2023-10-08T07:06:24.376961+0000","last_peered":"2023-10-08T07:06:24.376961+0000","last_clean":"2023-10-08T07:06:24.376961+0000","last_became_active":"2023-10-08T07:05:32.321482+0000","last_became_peered":"2023-10-08T07:05:32.321482+0000","last_unstale":"2023-10-08T07:06:24.376961+0000","last_undegraded":"2023-10-08T07:06:24.376961+0000","last_fullsized":"2023-10-08T07:06:24.376961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:13.789778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376485+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:06:24.376485+0000","last_peered":"2023-10-08T07:06:24.376485+0000","last_clean":"2023-10-08T07:06:24.376485+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:06:24.376485+0000","last_undegraded":"2023-10-08T07:06:24.376485+0000","last_fullsized":"2023-10-08T07:06:24.376485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376417+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:06:24.376417+0000","last_peered":"2023-10-08T07:06:24.376417+0000","last_clean":"2023-10-08T07:06:24.376417+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:06:24.376417+0000","last_undegraded":"2023-10-08T07:06:24.376417+0000","last_fullsized":"2023-10-08T07:06:24.376417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079105+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:06:24.079105+0000","last_peered":"2023-10-08T07:06:24.079105+0000","last_clean":"2023-10-08T07:06:24.079105+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:06:24.079105+0000","last_undegraded":"2023-10-08T07:06:24.079105+0000","last_fullsized":"2023-10-08T07:06:24.079105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078981+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:06:24.078981+0000","last_peered":"2023-10-08T07:06:24.078981+0000","last_clean":"2023-10-08T07:06:24.078981+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:06:24.078981+0000","last_undegraded":"2023-10-08T07:06:24.078981+0000","last_fullsized":"2023-10-08T07:06:24.078981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376433+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:06:24.376433+0000","last_peered":"2023-10-08T07:06:24.376433+0000","last_clean":"2023-10-08T07:06:24.376433+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:06:24.376433+0000","last_undegraded":"2023-10-08T07:06:24.376433+0000","last_fullsized":"2023-10-08T07:06:24.376433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376214+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:06:24.376214+0000","last_peered":"2023-10-08T07:06:24.376214+0000","last_clean":"2023-10-08T07:06:24.376214+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:06:24.376214+0000","last_undegraded":"2023-10-08T07:06:24.376214+0000","last_fullsized":"2023-10-08T07:06:24.376214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377188+0000","last_change":"2023-10-08T07:05:33.319933+0000","last_active":"2023-10-08T07:06:24.377188+0000","last_peered":"2023-10-08T07:06:24.377188+0000","last_clean":"2023-10-08T07:06:24.377188+0000","last_became_active":"2023-10-08T07:05:33.317937+0000","last_became_peered":"2023-10-08T07:05:33.317937+0000","last_unstale":"2023-10-08T07:06:24.377188+0000","last_undegraded":"2023-10-08T07:06:24.377188+0000","last_fullsized":"2023-10-08T07:06:24.377188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:57:42.074994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081680+0000","last_change":"2023-10-08T07:05:32.323415+0000","last_active":"2023-10-08T07:06:24.081680+0000","last_peered":"2023-10-08T07:06:24.081680+0000","last_clean":"2023-10-08T07:06:24.081680+0000","last_became_active":"2023-10-08T07:05:32.322910+0000","last_became_peered":"2023-10-08T07:05:32.322910+0000","last_unstale":"2023-10-08T07:06:24.081680+0000","last_undegraded":"2023-10-08T07:06:24.081680+0000","last_fullsized":"2023-10-08T07:06:24.081680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377180+0000","last_change":"2023-10-08T07:05:33.325994+0000","last_active":"2023-10-08T07:06:24.377180+0000","last_peered":"2023-10-08T07:06:24.377180+0000","last_clean":"2023-10-08T07:06:24.377180+0000","last_became_active":"2023-10-08T07:05:33.324865+0000","last_became_peered":"2023-10-08T07:05:33.324865+0000","last_unstale":"2023-10-08T07:06:24.377180+0000","last_undegraded":"2023-10-08T07:06:24.377180+0000","last_fullsized":"2023-10-08T07:06:24.377180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:14.142601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081686+0000","last_change":"2023-10-08T07:05:32.320359+0000","last_active":"2023-10-08T07:06:24.081686+0000","last_peered":"2023-10-08T07:06:24.081686+0000","last_clean":"2023-10-08T07:06:24.081686+0000","last_became_active":"2023-10-08T07:05:32.320137+0000","last_became_peered":"2023-10-08T07:05:32.320137+0000","last_unstale":"2023-10-08T07:06:24.081686+0000","last_undegraded":"2023-10-08T07:06:24.081686+0000","last_fullsized":"2023-10-08T07:06:24.081686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:32.366341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079639+0000","last_change":"2023-10-08T07:05:33.322861+0000","last_active":"2023-10-08T07:06:24.079639+0000","last_peered":"2023-10-08T07:06:24.079639+0000","last_clean":"2023-10-08T07:06:24.079639+0000","last_became_active":"2023-10-08T07:05:33.322450+0000","last_became_peered":"2023-10-08T07:05:33.322450+0000","last_unstale":"2023-10-08T07:06:24.079639+0000","last_undegraded":"2023-10-08T07:06:24.079639+0000","last_fullsized":"2023-10-08T07:06:24.079639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079244+0000","last_change":"2023-10-08T07:05:27.295597+0000","last_active":"2023-10-08T07:06:24.079244+0000","last_peered":"2023-10-08T07:06:24.079244+0000","last_clean":"2023-10-08T07:06:24.079244+0000","last_became_active":"2023-10-08T07:05:27.295265+0000","last_became_peered":"2023-10-08T07:05:27.295265+0000","last_unstale":"2023-10-08T07:06:24.079244+0000","last_undegraded":"2023-10-08T07:06:24.079244+0000","last_fullsized":"2023-10-08T07:06:24.079244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:50.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377085+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:06:24.377085+0000","last_peered":"2023-10-08T07:06:24.377085+0000","last_clean":"2023-10-08T07:06:24.377085+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:06:24.377085+0000","last_undegraded":"2023-10-08T07:06:24.377085+0000","last_fullsized":"2023-10-08T07:06:24.377085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081938+0000","last_change":"2023-10-08T07:05:33.326797+0000","last_active":"2023-10-08T07:06:24.081938+0000","last_peered":"2023-10-08T07:06:24.081938+0000","last_clean":"2023-10-08T07:06:24.081938+0000","last_became_active":"2023-10-08T07:05:33.326518+0000","last_became_peered":"2023-10-08T07:05:33.326518+0000","last_unstale":"2023-10-08T07:06:24.081938+0000","last_undegraded":"2023-10-08T07:06:24.081938+0000","last_fullsized":"2023-10-08T07:06:24.081938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376623+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:06:24.376623+0000","last_peered":"2023-10-08T07:06:24.376623+0000","last_clean":"2023-10-08T07:06:24.376623+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:06:24.376623+0000","last_undegraded":"2023-10-08T07:06:24.376623+0000","last_fullsized":"2023-10-08T07:06:24.376623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376707+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:06:24.376707+0000","last_peered":"2023-10-08T07:06:24.376707+0000","last_clean":"2023-10-08T07:06:24.376707+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:06:24.376707+0000","last_undegraded":"2023-10-08T07:06:24.376707+0000","last_fullsized":"2023-10-08T07:06:24.376707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079168+0000","last_change":"2023-10-08T07:05:33.322164+0000","last_active":"2023-10-08T07:06:24.079168+0000","last_peered":"2023-10-08T07:06:24.079168+0000","last_clean":"2023-10-08T07:06:24.079168+0000","last_became_active":"2023-10-08T07:05:33.321757+0000","last_became_peered":"2023-10-08T07:05:33.321757+0000","last_unstale":"2023-10-08T07:06:24.079168+0000","last_undegraded":"2023-10-08T07:06:24.079168+0000","last_fullsized":"2023-10-08T07:06:24.079168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078737+0000","last_change":"2023-10-08T07:05:27.295991+0000","last_active":"2023-10-08T07:06:24.078737+0000","last_peered":"2023-10-08T07:06:24.078737+0000","last_clean":"2023-10-08T07:06:24.078737+0000","last_became_active":"2023-10-08T07:05:27.295727+0000","last_became_peered":"2023-10-08T07:05:27.295727+0000","last_unstale":"2023-10-08T07:06:24.078737+0000","last_undegraded":"2023-10-08T07:06:24.078737+0000","last_fullsized":"2023-10-08T07:06:24.078737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:54.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081687+0000","last_change":"2023-10-08T07:05:32.323161+0000","last_active":"2023-10-08T07:06:24.081687+0000","last_peered":"2023-10-08T07:06:24.081687+0000","last_clean":"2023-10-08T07:06:24.081687+0000","last_became_active":"2023-10-08T07:05:32.322832+0000","last_became_peered":"2023-10-08T07:05:32.322832+0000","last_unstale":"2023-10-08T07:06:24.081687+0000","last_undegraded":"2023-10-08T07:06:24.081687+0000","last_fullsized":"2023-10-08T07:06:24.081687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079741+0000","last_change":"2023-10-08T07:05:33.323204+0000","last_active":"2023-10-08T07:06:24.079741+0000","last_peered":"2023-10-08T07:06:24.079741+0000","last_clean":"2023-10-08T07:06:24.079741+0000","last_became_active":"2023-10-08T07:05:33.322899+0000","last_became_peered":"2023-10-08T07:05:33.322899+0000","last_unstale":"2023-10-08T07:06:24.079741+0000","last_undegraded":"2023-10-08T07:06:24.079741+0000","last_fullsized":"2023-10-08T07:06:24.079741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376818+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:06:24.376818+0000","last_peered":"2023-10-08T07:06:24.376818+0000","last_clean":"2023-10-08T07:06:24.376818+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:06:24.376818+0000","last_undegraded":"2023-10-08T07:06:24.376818+0000","last_fullsized":"2023-10-08T07:06:24.376818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376084+0000","last_change":"2023-10-08T07:05:22.277737+0000","last_active":"2023-10-08T07:06:24.376084+0000","last_peered":"2023-10-08T07:06:24.376084+0000","last_clean":"2023-10-08T07:06:24.376084+0000","last_became_active":"2023-10-08T07:05:22.277417+0000","last_became_peered":"2023-10-08T07:05:22.277417+0000","last_unstale":"2023-10-08T07:06:24.376084+0000","last_undegraded":"2023-10-08T07:06:24.376084+0000","last_fullsized":"2023-10-08T07:06:24.376084+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:10.186804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078849+0000","last_change":"2023-10-08T07:05:32.316756+0000","last_active":"2023-10-08T07:06:24.078849+0000","last_peered":"2023-10-08T07:06:24.078849+0000","last_clean":"2023-10-08T07:06:24.078849+0000","last_became_active":"2023-10-08T07:05:32.316340+0000","last_became_peered":"2023-10-08T07:05:32.316340+0000","last_unstale":"2023-10-08T07:06:24.078849+0000","last_undegraded":"2023-10-08T07:06:24.078849+0000","last_fullsized":"2023-10-08T07:06:24.078849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:46:34.838960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377169+0000","last_change":"2023-10-08T07:05:33.318964+0000","last_active":"2023-10-08T07:06:24.377169+0000","last_peered":"2023-10-08T07:06:24.377169+0000","last_clean":"2023-10-08T07:06:24.377169+0000","last_became_active":"2023-10-08T07:05:33.317866+0000","last_became_peered":"2023-10-08T07:05:33.317866+0000","last_unstale":"2023-10-08T07:06:24.377169+0000","last_undegraded":"2023-10-08T07:06:24.377169+0000","last_fullsized":"2023-10-08T07:06:24.377169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:47.306558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376085+0000","last_change":"2023-10-08T07:05:27.295425+0000","last_active":"2023-10-08T07:06:24.376085+0000","last_peered":"2023-10-08T07:06:24.376085+0000","last_clean":"2023-10-08T07:06:24.376085+0000","last_became_active":"2023-10-08T07:05:27.295157+0000","last_became_peered":"2023-10-08T07:05:27.295157+0000","last_unstale":"2023-10-08T07:06:24.376085+0000","last_undegraded":"2023-10-08T07:06:24.376085+0000","last_fullsized":"2023-10-08T07:06:24.376085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:06.192882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078622+0000","last_change":"2023-10-08T07:05:32.317723+0000","last_active":"2023-10-08T07:06:24.078622+0000","last_peered":"2023-10-08T07:06:24.078622+0000","last_clean":"2023-10-08T07:06:24.078622+0000","last_became_active":"2023-10-08T07:05:32.317444+0000","last_became_peered":"2023-10-08T07:05:32.317444+0000","last_unstale":"2023-10-08T07:06:24.078622+0000","last_undegraded":"2023-10-08T07:06:24.078622+0000","last_fullsized":"2023-10-08T07:06:24.078622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:29.242830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082387+0000","last_change":"2023-10-08T07:05:33.321497+0000","last_active":"2023-10-08T07:06:24.082387+0000","last_peered":"2023-10-08T07:06:24.082387+0000","last_clean":"2023-10-08T07:06:24.082387+0000","last_became_active":"2023-10-08T07:05:33.319658+0000","last_became_peered":"2023-10-08T07:05:33.319658+0000","last_unstale":"2023-10-08T07:06:24.082387+0000","last_undegraded":"2023-10-08T07:06:24.082387+0000","last_fullsized":"2023-10-08T07:06:24.082387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082304+0000","last_change":"2023-10-08T07:05:27.298597+0000","last_active":"2023-10-08T07:06:24.082304+0000","last_peered":"2023-10-08T07:06:24.082304+0000","last_clean":"2023-10-08T07:06:24.082304+0000","last_became_active":"2023-10-08T07:05:27.298355+0000","last_became_peered":"2023-10-08T07:05:27.298355+0000","last_unstale":"2023-10-08T07:06:24.082304+0000","last_undegraded":"2023-10-08T07:06:24.082304+0000","last_fullsized":"2023-10-08T07:06:24.082304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:06.241475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079072+0000","last_change":"2023-10-08T07:05:32.319605+0000","last_active":"2023-10-08T07:06:24.079072+0000","last_peered":"2023-10-08T07:06:24.079072+0000","last_clean":"2023-10-08T07:06:24.079072+0000","last_became_active":"2023-10-08T07:05:32.319244+0000","last_became_peered":"2023-10-08T07:05:32.319244+0000","last_unstale":"2023-10-08T07:06:24.079072+0000","last_undegraded":"2023-10-08T07:06:24.079072+0000","last_fullsized":"2023-10-08T07:06:24.079072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:25.991992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082115+0000","last_change":"2023-10-08T07:05:33.327112+0000","last_active":"2023-10-08T07:06:24.082115+0000","last_peered":"2023-10-08T07:06:24.082115+0000","last_clean":"2023-10-08T07:06:24.082115+0000","last_became_active":"2023-10-08T07:05:33.326816+0000","last_became_peered":"2023-10-08T07:05:33.326816+0000","last_unstale":"2023-10-08T07:06:24.082115+0000","last_undegraded":"2023-10-08T07:06:24.082115+0000","last_fullsized":"2023-10-08T07:06:24.082115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079606+0000","last_change":"2023-10-08T07:05:32.319875+0000","last_active":"2023-10-08T07:06:24.079606+0000","last_peered":"2023-10-08T07:06:24.079606+0000","last_clean":"2023-10-08T07:06:24.079606+0000","last_became_active":"2023-10-08T07:05:32.319385+0000","last_became_peered":"2023-10-08T07:05:32.319385+0000","last_unstale":"2023-10-08T07:06:24.079606+0000","last_undegraded":"2023-10-08T07:06:24.079606+0000","last_fullsized":"2023-10-08T07:06:24.079606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079608+0000","last_change":"2023-10-08T07:05:27.295537+0000","last_active":"2023-10-08T07:06:24.079608+0000","last_peered":"2023-10-08T07:06:24.079608+0000","last_clean":"2023-10-08T07:06:24.079608+0000","last_became_active":"2023-10-08T07:05:27.295234+0000","last_became_peered":"2023-10-08T07:05:27.295234+0000","last_unstale":"2023-10-08T07:06:24.079608+0000","last_undegraded":"2023-10-08T07:06:24.079608+0000","last_fullsized":"2023-10-08T07:06:24.079608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:22.951187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078527+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:06:24.078527+0000","last_peered":"2023-10-08T07:06:24.078527+0000","last_clean":"2023-10-08T07:06:24.078527+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:06:24.078527+0000","last_undegraded":"2023-10-08T07:06:24.078527+0000","last_fullsized":"2023-10-08T07:06:24.078527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377152+0000","last_change":"2023-10-08T07:05:27.295945+0000","last_active":"2023-10-08T07:06:24.377152+0000","last_peered":"2023-10-08T07:06:24.377152+0000","last_clean":"2023-10-08T07:06:24.377152+0000","last_became_active":"2023-10-08T07:05:27.295726+0000","last_became_peered":"2023-10-08T07:05:27.295726+0000","last_unstale":"2023-10-08T07:06:24.377152+0000","last_undegraded":"2023-10-08T07:06:24.377152+0000","last_fullsized":"2023-10-08T07:06:24.377152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:55.040889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"22'3","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079438+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:06:24.079438+0000","last_peered":"2023-10-08T07:06:24.079438+0000","last_clean":"2023-10-08T07:06:24.079438+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:06:24.079438+0000","last_undegraded":"2023-10-08T07:06:24.079438+0000","last_fullsized":"2023-10-08T07:06:24.079438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081795+0000","last_change":"2023-10-08T07:05:33.326621+0000","last_active":"2023-10-08T07:06:24.081795+0000","last_peered":"2023-10-08T07:06:24.081795+0000","last_clean":"2023-10-08T07:06:24.081795+0000","last_became_active":"2023-10-08T07:05:33.326272+0000","last_became_peered":"2023-10-08T07:05:33.326272+0000","last_unstale":"2023-10-08T07:06:24.081795+0000","last_undegraded":"2023-10-08T07:06:24.081795+0000","last_fullsized":"2023-10-08T07:06:24.081795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:31.752188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082052+0000","last_change":"2023-10-08T07:05:32.323175+0000","last_active":"2023-10-08T07:06:24.082052+0000","last_peered":"2023-10-08T07:06:24.082052+0000","last_clean":"2023-10-08T07:06:24.082052+0000","last_became_active":"2023-10-08T07:05:32.322814+0000","last_became_peered":"2023-10-08T07:05:32.322814+0000","last_unstale":"2023-10-08T07:06:24.082052+0000","last_undegraded":"2023-10-08T07:06:24.082052+0000","last_fullsized":"2023-10-08T07:06:24.082052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082207+0000","last_change":"2023-10-08T07:05:33.318398+0000","last_active":"2023-10-08T07:06:24.082207+0000","last_peered":"2023-10-08T07:06:24.082207+0000","last_clean":"2023-10-08T07:06:24.082207+0000","last_became_active":"2023-10-08T07:05:33.317478+0000","last_became_peered":"2023-10-08T07:05:33.317478+0000","last_unstale":"2023-10-08T07:06:24.082207+0000","last_undegraded":"2023-10-08T07:06:24.082207+0000","last_fullsized":"2023-10-08T07:06:24.082207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376571+0000","last_change":"2023-10-08T07:05:32.320603+0000","last_active":"2023-10-08T07:06:24.376571+0000","last_peered":"2023-10-08T07:06:24.376571+0000","last_clean":"2023-10-08T07:06:24.376571+0000","last_became_active":"2023-10-08T07:05:32.320262+0000","last_became_peered":"2023-10-08T07:05:32.320262+0000","last_unstale":"2023-10-08T07:06:24.376571+0000","last_undegraded":"2023-10-08T07:06:24.376571+0000","last_fullsized":"2023-10-08T07:06:24.376571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:09.249029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376560+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:06:24.376560+0000","last_peered":"2023-10-08T07:06:24.376560+0000","last_clean":"2023-10-08T07:06:24.376560+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:06:24.376560+0000","last_undegraded":"2023-10-08T07:06:24.376560+0000","last_fullsized":"2023-10-08T07:06:24.376560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082343+0000","last_change":"2023-10-08T07:05:32.323143+0000","last_active":"2023-10-08T07:06:24.082343+0000","last_peered":"2023-10-08T07:06:24.082343+0000","last_clean":"2023-10-08T07:06:24.082343+0000","last_became_active":"2023-10-08T07:05:32.322789+0000","last_became_peered":"2023-10-08T07:05:32.322789+0000","last_unstale":"2023-10-08T07:06:24.082343+0000","last_undegraded":"2023-10-08T07:06:24.082343+0000","last_fullsized":"2023-10-08T07:06:24.082343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:03.978136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376442+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:06:24.376442+0000","last_peered":"2023-10-08T07:06:24.376442+0000","last_clean":"2023-10-08T07:06:24.376442+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:06:24.376442+0000","last_undegraded":"2023-10-08T07:06:24.376442+0000","last_fullsized":"2023-10-08T07:06:24.376442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079711+0000","last_change":"2023-10-08T07:05:32.319462+0000","last_active":"2023-10-08T07:06:24.079711+0000","last_peered":"2023-10-08T07:06:24.079711+0000","last_clean":"2023-10-08T07:06:24.079711+0000","last_became_active":"2023-10-08T07:05:32.318951+0000","last_became_peered":"2023-10-08T07:05:32.318951+0000","last_unstale":"2023-10-08T07:06:24.079711+0000","last_undegraded":"2023-10-08T07:06:24.079711+0000","last_fullsized":"2023-10-08T07:06:24.079711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081896+0000","last_change":"2023-10-08T07:05:33.319869+0000","last_active":"2023-10-08T07:06:24.081896+0000","last_peered":"2023-10-08T07:06:24.081896+0000","last_clean":"2023-10-08T07:06:24.081896+0000","last_became_active":"2023-10-08T07:05:33.318241+0000","last_became_peered":"2023-10-08T07:05:33.318241+0000","last_unstale":"2023-10-08T07:06:24.081896+0000","last_undegraded":"2023-10-08T07:06:24.081896+0000","last_fullsized":"2023-10-08T07:06:24.081896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079679+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:06:24.079679+0000","last_peered":"2023-10-08T07:06:24.079679+0000","last_clean":"2023-10-08T07:06:24.079679+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:06:24.079679+0000","last_undegraded":"2023-10-08T07:06:24.079679+0000","last_fullsized":"2023-10-08T07:06:24.079679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376365+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:06:24.376365+0000","last_peered":"2023-10-08T07:06:24.376365+0000","last_clean":"2023-10-08T07:06:24.376365+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:06:24.376365+0000","last_undegraded":"2023-10-08T07:06:24.376365+0000","last_fullsized":"2023-10-08T07:06:24.376365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376241+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:06:24.376241+0000","last_peered":"2023-10-08T07:06:24.376241+0000","last_clean":"2023-10-08T07:06:24.376241+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:06:24.376241+0000","last_undegraded":"2023-10-08T07:06:24.376241+0000","last_fullsized":"2023-10-08T07:06:24.376241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078689+0000","last_change":"2023-10-08T07:05:33.322006+0000","last_active":"2023-10-08T07:06:24.078689+0000","last_peered":"2023-10-08T07:06:24.078689+0000","last_clean":"2023-10-08T07:06:24.078689+0000","last_became_active":"2023-10-08T07:05:33.321639+0000","last_became_peered":"2023-10-08T07:05:33.321639+0000","last_unstale":"2023-10-08T07:06:24.078689+0000","last_undegraded":"2023-10-08T07:06:24.078689+0000","last_fullsized":"2023-10-08T07:06:24.078689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081998+0000","last_change":"2023-10-08T07:05:33.329906+0000","last_active":"2023-10-08T07:06:24.081998+0000","last_peered":"2023-10-08T07:06:24.081998+0000","last_clean":"2023-10-08T07:06:24.081998+0000","last_became_active":"2023-10-08T07:05:33.329615+0000","last_became_peered":"2023-10-08T07:05:33.329615+0000","last_unstale":"2023-10-08T07:06:24.081998+0000","last_undegraded":"2023-10-08T07:06:24.081998+0000","last_fullsized":"2023-10-08T07:06:24.081998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079230+0000","last_change":"2023-10-08T07:05:33.316573+0000","last_active":"2023-10-08T07:06:24.079230+0000","last_peered":"2023-10-08T07:06:24.079230+0000","last_clean":"2023-10-08T07:06:24.079230+0000","last_became_active":"2023-10-08T07:05:33.316193+0000","last_became_peered":"2023-10-08T07:05:33.316193+0000","last_unstale":"2023-10-08T07:06:24.079230+0000","last_undegraded":"2023-10-08T07:06:24.079230+0000","last_fullsized":"2023-10-08T07:06:24.079230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082214+0000","last_change":"2023-10-08T07:05:33.320077+0000","last_active":"2023-10-08T07:06:24.082214+0000","last_peered":"2023-10-08T07:06:24.082214+0000","last_clean":"2023-10-08T07:06:24.082214+0000","last_became_active":"2023-10-08T07:05:33.319392+0000","last_became_peered":"2023-10-08T07:05:33.319392+0000","last_unstale":"2023-10-08T07:06:24.082214+0000","last_undegraded":"2023-10-08T07:06:24.082214+0000","last_fullsized":"2023-10-08T07:06:24.082214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738384,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":108857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.433},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.40400000000000003}]},{"osd":1,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.45400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":705960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.46800000000000003}]},{"osd":2,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.37},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.38900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738385,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":884736,"data_stored":705344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.495},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.44}]},{"osd":2,"last update":"Sun Oct 8 07:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:06:33.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:06:33.600 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:33.599+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:33.679 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:33.680 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:33.680 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:33.680 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:33.680 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:33.689 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:33.701 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:33.701+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:33.801 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:33.800+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:33.818 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:33.818 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:33.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:33.819 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:33.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.819 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.819 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:33.819 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.500348244000001, 2023-10-08T07:06:33.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:33.819 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.819 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.819 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:33.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:33.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:33.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:33.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:33.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:33.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:33.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:33.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:33.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:33.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:33.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:33.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:33.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:33.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:33.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:33.825 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.825 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.825 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.825 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.826 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:33.826 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.50027446, 2023-10-08T07:06:33.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:33.826 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.826 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.826 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:33.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:33.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:33.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:33.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:33.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:33.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:33.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:33.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:33.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:33.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:33.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:33.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:33.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:33.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:33.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:33.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:33.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:33.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:33.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:33.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:33.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:33.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:33.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:33.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:33.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:33.833 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.833 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.834 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.834 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:33.834 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.500211284000002, 2023-10-08T07:06:33.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:33.834 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.837 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.837 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:33.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:33.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:33.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:33.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:33.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:33.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:33.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:33.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:33.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:33.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:33.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:33.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:33.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:33.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:33.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:33.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:33.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:33.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:33.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:33.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:33.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:33.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:33.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:33.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:33.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:33.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:33.842 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.843 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.843 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.843 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:33.843 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.500176938000003, 2023-10-08T07:06:33.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:33.843 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.843 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.843 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:33.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:33.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:33.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:33.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:33.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:33.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:33.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:33.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:33.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:33.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:33.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:33.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:33.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:33.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:33.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:33.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:33.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:33.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:33.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:33.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:33.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:33.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:33.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:33.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:33.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:33.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:33.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.849 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.849 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.849 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:33.850 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.499686713000003, 2023-10-08T07:06:33.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:33.850 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.850 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.850 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:33.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:33.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:33.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:33.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:33.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:33.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:33.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:33.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:33.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:33.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:33.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:33.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:33.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:33.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:33.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:33.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:33.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.856 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.856 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.856 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:33.857 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.499646136000003, 2023-10-08T07:06:33.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:33.857 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.857 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.857 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:33.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:33.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:33.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:33.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:33.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:33.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:33.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:33.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:33.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:33.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:33.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:33.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:33.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:33.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:33.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:33.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:33.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:33.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:33.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:33.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:33.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:33.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:33.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:33.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:33.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:33.864 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.864 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.864 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.865 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.865 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:33.865 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.499608567000003, 2023-10-08T07:06:33.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:33.865 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.865 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:33.865 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:33.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:33.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:33.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:33.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:33.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:33.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:33.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:33.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:33.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:33.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:33.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:33.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:33.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:33.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:33.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:33.869 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.869 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.869 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.869 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.870 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:33.870 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.499541127000001, 2023-10-08T07:06:33.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:33.870 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.870 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:33.870 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:33.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:33.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:33.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:33.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:33.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:33.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:33.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:33.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:33.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:33.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:33.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:33.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:33.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:33.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:33.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:33.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.874 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.874 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:33.874 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:33.874 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.499511484999999, 2023-10-08T07:06:33.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:33.875 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.875 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:33.875 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:33.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:33.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:33.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:33.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:33.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:33.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:33.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:33.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:33.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:33.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:33.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:33.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:33.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:33.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:33.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:33.879 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.879 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.879 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.879 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:33.879 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:33.879 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.493770924000003, 2023-10-08T07:06:33.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:33.879 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.880 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:33.880 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:33.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:33.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:33.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:33.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:33.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:33.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:33.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:33.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:33.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:33.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:33.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:33.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:33.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:33.883 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.883 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.883 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.884 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:33.884 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:33.884 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.493321584, 2023-10-08T07:06:33.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:33.884 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.884 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:33.884 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:33.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:33.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:33.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:33.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:33.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:33.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:33.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:33.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:33.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:33.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:33.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.888 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.888 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:33.888 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:33.888 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.492525694000001, 2023-10-08T07:06:33.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:33.889 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.889 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.889 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:33.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:33.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:33.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:33.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:33.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:33.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:33.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:33.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:33.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:33.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:33.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:33.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:33.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:33.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.893 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:33.894 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:33.894 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.492410343000003, 2023-10-08T07:06:33.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:33.894 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.894 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.894 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:33.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:33.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:33.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:33.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:33.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:33.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:33.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:33.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:33.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:33.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:33.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:33.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:33.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:33.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:33.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:33.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:33.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:33.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:33.898 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.898 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.898 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.487295777, 2023-10-08T07:06:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:33.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:33.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:33.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:33.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:33.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:33.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:33.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:33.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:33.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:33.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:33.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:33.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:33.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:33.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:33.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.904 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.904 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.904 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:33.904 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:33.904 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.487184784999997, 2023-10-08T07:06:33.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:33.905 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.905 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.905 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:33.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:33.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:33.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:33.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:33.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:33.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:33.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:33.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:33.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:33.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:33.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:33.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:33.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:33.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.909 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.909 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:33.910 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:33.910 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.486760343999997, 2023-10-08T07:06:33.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:33.910 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.910 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:33.910 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:33.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:33.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:33.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:33.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:33.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:33.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:33.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:33.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:33.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:33.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:33.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:33.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:33.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:33.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:33.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:33.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.914 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.914 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:33.914 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:33.914 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.486613208000001, 2023-10-08T07:06:33.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:33.914 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.915 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:33.915 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:33.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:33.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:33.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:33.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:33.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:33.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:33.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:33.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:33.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:33.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:33.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:33.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:33.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:33.918 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.918 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.918 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.918 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:33.918 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:33.919 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.415314938999998, 2023-10-08T07:06:33.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:33.919 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.919 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.919 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:33.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:33.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:33.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:33.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:33.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:33.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:33.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:33.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:33.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:33.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:33.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:33.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:33.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:33.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:33.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:33.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:33.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:33.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:33.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:33.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:33.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:33.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:33.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:33.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:33.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:33.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.925 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.925 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:33.925 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:33.925 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.413521355, 2023-10-08T07:06:33.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:33.925 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.925 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:33.926 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:33.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:33.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:33.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:33.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:33.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:33.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:33.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:33.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:33.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:33.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:33.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:33.929 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.930 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.930 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:33.930 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:33.930 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.414931684999999, 2023-10-08T07:06:33.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:33.930 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:33.930 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:33.930 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:33.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:33.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:33.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:33.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:33.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:33.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:33.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:33.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:33.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:33.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:33.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:33.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:33.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:33.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:33.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:33.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:33.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:33.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:33.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:33.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:33.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:33.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:33.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:33.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:33.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:33.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:33.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:33.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:33.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:33.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:33.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:33.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:33.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:33.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:33.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:33.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:33.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:33.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:33.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:33.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:33.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.936 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:33.936 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:33.936 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:33.938 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:33.938 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:06:33.937+0000 7f897d34f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 97611) UID: 0 2023-10-08T07:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:06:33.998 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:06:33.999 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:34.011 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-10-08T07:06:33.106832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91380,"kb_used_data":2000,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024140,"statfs":{"total":289910292480,"available":289816719360,"internally_reserved":0,"allocated":2048000,"data_stored":1520161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":91483475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.593200"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082540+0000","last_change":"2023-10-08T07:05:33.319747+0000","last_active":"2023-10-08T07:06:24.082540+0000","last_peered":"2023-10-08T07:06:24.082540+0000","last_clean":"2023-10-08T07:06:24.082540+0000","last_became_active":"2023-10-08T07:05:33.318115+0000","last_became_peered":"2023-10-08T07:05:33.318115+0000","last_unstale":"2023-10-08T07:06:24.082540+0000","last_undegraded":"2023-10-08T07:06:24.082540+0000","last_fullsized":"2023-10-08T07:06:24.082540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082173+0000","last_change":"2023-10-08T07:05:33.322480+0000","last_active":"2023-10-08T07:06:24.082173+0000","last_peered":"2023-10-08T07:06:24.082173+0000","last_clean":"2023-10-08T07:06:24.082173+0000","last_became_active":"2023-10-08T07:05:33.322153+0000","last_became_peered":"2023-10-08T07:05:33.322153+0000","last_unstale":"2023-10-08T07:06:24.082173+0000","last_undegraded":"2023-10-08T07:06:24.082173+0000","last_fullsized":"2023-10-08T07:06:24.082173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377041+0000","last_change":"2023-10-08T07:05:33.325067+0000","last_active":"2023-10-08T07:06:24.377041+0000","last_peered":"2023-10-08T07:06:24.377041+0000","last_clean":"2023-10-08T07:06:24.377041+0000","last_became_active":"2023-10-08T07:05:33.323439+0000","last_became_peered":"2023-10-08T07:05:33.323439+0000","last_unstale":"2023-10-08T07:06:24.377041+0000","last_undegraded":"2023-10-08T07:06:24.377041+0000","last_fullsized":"2023-10-08T07:06:24.377041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:18.052602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376804+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:06:24.376804+0000","last_peered":"2023-10-08T07:06:24.376804+0000","last_clean":"2023-10-08T07:06:24.376804+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:06:24.376804+0000","last_undegraded":"2023-10-08T07:06:24.376804+0000","last_fullsized":"2023-10-08T07:06:24.376804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082022+0000","last_change":"2023-10-08T07:05:33.321314+0000","last_active":"2023-10-08T07:06:24.082022+0000","last_peered":"2023-10-08T07:06:24.082022+0000","last_clean":"2023-10-08T07:06:24.082022+0000","last_became_active":"2023-10-08T07:05:33.320841+0000","last_became_peered":"2023-10-08T07:05:33.320841+0000","last_unstale":"2023-10-08T07:06:24.082022+0000","last_undegraded":"2023-10-08T07:06:24.082022+0000","last_fullsized":"2023-10-08T07:06:24.082022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376102+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:06:24.376102+0000","last_peered":"2023-10-08T07:06:24.376102+0000","last_clean":"2023-10-08T07:06:24.376102+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:06:24.376102+0000","last_undegraded":"2023-10-08T07:06:24.376102+0000","last_fullsized":"2023-10-08T07:06:24.376102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376036+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:06:24.376036+0000","last_peered":"2023-10-08T07:06:24.376036+0000","last_clean":"2023-10-08T07:06:24.376036+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:06:24.376036+0000","last_undegraded":"2023-10-08T07:06:24.376036+0000","last_fullsized":"2023-10-08T07:06:24.376036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.375940+0000","last_change":"2023-10-08T07:05:33.327740+0000","last_active":"2023-10-08T07:06:24.375940+0000","last_peered":"2023-10-08T07:06:24.375940+0000","last_clean":"2023-10-08T07:06:24.375940+0000","last_became_active":"2023-10-08T07:05:33.325912+0000","last_became_peered":"2023-10-08T07:05:33.325912+0000","last_unstale":"2023-10-08T07:06:24.375940+0000","last_undegraded":"2023-10-08T07:06:24.375940+0000","last_fullsized":"2023-10-08T07:06:24.375940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079533+0000","last_change":"2023-10-08T07:05:33.322628+0000","last_active":"2023-10-08T07:06:24.079533+0000","last_peered":"2023-10-08T07:06:24.079533+0000","last_clean":"2023-10-08T07:06:24.079533+0000","last_became_active":"2023-10-08T07:05:33.321816+0000","last_became_peered":"2023-10-08T07:05:33.321816+0000","last_unstale":"2023-10-08T07:06:24.079533+0000","last_undegraded":"2023-10-08T07:06:24.079533+0000","last_fullsized":"2023-10-08T07:06:24.079533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082334+0000","last_change":"2023-10-08T07:05:33.322098+0000","last_active":"2023-10-08T07:06:24.082334+0000","last_peered":"2023-10-08T07:06:24.082334+0000","last_clean":"2023-10-08T07:06:24.082334+0000","last_became_active":"2023-10-08T07:05:33.321208+0000","last_became_peered":"2023-10-08T07:05:33.321208+0000","last_unstale":"2023-10-08T07:06:24.082334+0000","last_undegraded":"2023-10-08T07:06:24.082334+0000","last_fullsized":"2023-10-08T07:06:24.082334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376847+0000","last_change":"2023-10-08T07:05:33.328140+0000","last_active":"2023-10-08T07:06:24.376847+0000","last_peered":"2023-10-08T07:06:24.376847+0000","last_clean":"2023-10-08T07:06:24.376847+0000","last_became_active":"2023-10-08T07:05:33.327595+0000","last_became_peered":"2023-10-08T07:05:33.327595+0000","last_unstale":"2023-10-08T07:06:24.376847+0000","last_undegraded":"2023-10-08T07:06:24.376847+0000","last_fullsized":"2023-10-08T07:06:24.376847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082010+0000","last_change":"2023-10-08T07:05:33.329834+0000","last_active":"2023-10-08T07:06:24.082010+0000","last_peered":"2023-10-08T07:06:24.082010+0000","last_clean":"2023-10-08T07:06:24.082010+0000","last_became_active":"2023-10-08T07:05:33.329357+0000","last_became_peered":"2023-10-08T07:05:33.329357+0000","last_unstale":"2023-10-08T07:06:24.082010+0000","last_undegraded":"2023-10-08T07:06:24.082010+0000","last_fullsized":"2023-10-08T07:06:24.082010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081937+0000","last_change":"2023-10-08T07:05:33.319643+0000","last_active":"2023-10-08T07:06:24.081937+0000","last_peered":"2023-10-08T07:06:24.081937+0000","last_clean":"2023-10-08T07:06:24.081937+0000","last_became_active":"2023-10-08T07:05:33.318659+0000","last_became_peered":"2023-10-08T07:05:33.318659+0000","last_unstale":"2023-10-08T07:06:24.081937+0000","last_undegraded":"2023-10-08T07:06:24.081937+0000","last_fullsized":"2023-10-08T07:06:24.081937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376660+0000","last_change":"2023-10-08T07:05:33.318491+0000","last_active":"2023-10-08T07:06:24.376660+0000","last_peered":"2023-10-08T07:06:24.376660+0000","last_clean":"2023-10-08T07:06:24.376660+0000","last_became_active":"2023-10-08T07:05:33.317703+0000","last_became_peered":"2023-10-08T07:05:33.317703+0000","last_unstale":"2023-10-08T07:06:24.376660+0000","last_undegraded":"2023-10-08T07:06:24.376660+0000","last_fullsized":"2023-10-08T07:06:24.376660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376189+0000","last_change":"2023-10-08T07:05:33.319294+0000","last_active":"2023-10-08T07:06:24.376189+0000","last_peered":"2023-10-08T07:06:24.376189+0000","last_clean":"2023-10-08T07:06:24.376189+0000","last_became_active":"2023-10-08T07:05:33.318364+0000","last_became_peered":"2023-10-08T07:05:33.318364+0000","last_unstale":"2023-10-08T07:06:24.376189+0000","last_undegraded":"2023-10-08T07:06:24.376189+0000","last_fullsized":"2023-10-08T07:06:24.376189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.375959+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:06:24.375959+0000","last_peered":"2023-10-08T07:06:24.375959+0000","last_clean":"2023-10-08T07:06:24.375959+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:06:24.375959+0000","last_undegraded":"2023-10-08T07:06:24.375959+0000","last_fullsized":"2023-10-08T07:06:24.375959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079575+0000","last_change":"2023-10-08T07:05:33.317287+0000","last_active":"2023-10-08T07:06:24.079575+0000","last_peered":"2023-10-08T07:06:24.079575+0000","last_clean":"2023-10-08T07:06:24.079575+0000","last_became_active":"2023-10-08T07:05:33.316483+0000","last_became_peered":"2023-10-08T07:05:33.316483+0000","last_unstale":"2023-10-08T07:06:24.079575+0000","last_undegraded":"2023-10-08T07:06:24.079575+0000","last_fullsized":"2023-10-08T07:06:24.079575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082413+0000","last_change":"2023-10-08T07:05:33.321088+0000","last_active":"2023-10-08T07:06:24.082413+0000","last_peered":"2023-10-08T07:06:24.082413+0000","last_clean":"2023-10-08T07:06:24.082413+0000","last_became_active":"2023-10-08T07:05:33.319541+0000","last_became_peered":"2023-10-08T07:05:33.319541+0000","last_unstale":"2023-10-08T07:06:24.082413+0000","last_undegraded":"2023-10-08T07:06:24.082413+0000","last_fullsized":"2023-10-08T07:06:24.082413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079347+0000","last_change":"2023-10-08T07:05:33.322110+0000","last_active":"2023-10-08T07:06:24.079347+0000","last_peered":"2023-10-08T07:06:24.079347+0000","last_clean":"2023-10-08T07:06:24.079347+0000","last_became_active":"2023-10-08T07:05:33.321780+0000","last_became_peered":"2023-10-08T07:05:33.321780+0000","last_unstale":"2023-10-08T07:06:24.079347+0000","last_undegraded":"2023-10-08T07:06:24.079347+0000","last_fullsized":"2023-10-08T07:06:24.079347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:57.848039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376690+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:06:24.376690+0000","last_peered":"2023-10-08T07:06:24.376690+0000","last_clean":"2023-10-08T07:06:24.376690+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:06:24.376690+0000","last_undegraded":"2023-10-08T07:06:24.376690+0000","last_fullsized":"2023-10-08T07:06:24.376690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376555+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:06:24.376555+0000","last_peered":"2023-10-08T07:06:24.376555+0000","last_clean":"2023-10-08T07:06:24.376555+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:06:24.376555+0000","last_undegraded":"2023-10-08T07:06:24.376555+0000","last_fullsized":"2023-10-08T07:06:24.376555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081862+0000","last_change":"2023-10-08T07:05:33.326970+0000","last_active":"2023-10-08T07:06:24.081862+0000","last_peered":"2023-10-08T07:06:24.081862+0000","last_clean":"2023-10-08T07:06:24.081862+0000","last_became_active":"2023-10-08T07:05:33.326650+0000","last_became_peered":"2023-10-08T07:05:33.326650+0000","last_unstale":"2023-10-08T07:06:24.081862+0000","last_undegraded":"2023-10-08T07:06:24.081862+0000","last_fullsized":"2023-10-08T07:06:24.081862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078821+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:06:24.078821+0000","last_peered":"2023-10-08T07:06:24.078821+0000","last_clean":"2023-10-08T07:06:24.078821+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:06:24.078821+0000","last_undegraded":"2023-10-08T07:06:24.078821+0000","last_fullsized":"2023-10-08T07:06:24.078821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081835+0000","last_change":"2023-10-08T07:05:33.319759+0000","last_active":"2023-10-08T07:06:24.081835+0000","last_peered":"2023-10-08T07:06:24.081835+0000","last_clean":"2023-10-08T07:06:24.081835+0000","last_became_active":"2023-10-08T07:05:33.318507+0000","last_became_peered":"2023-10-08T07:05:33.318507+0000","last_unstale":"2023-10-08T07:06:24.081835+0000","last_undegraded":"2023-10-08T07:06:24.081835+0000","last_fullsized":"2023-10-08T07:06:24.081835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082527+0000","last_change":"2023-10-08T07:05:33.317560+0000","last_active":"2023-10-08T07:06:24.082527+0000","last_peered":"2023-10-08T07:06:24.082527+0000","last_clean":"2023-10-08T07:06:24.082527+0000","last_became_active":"2023-10-08T07:05:33.316906+0000","last_became_peered":"2023-10-08T07:05:33.316906+0000","last_unstale":"2023-10-08T07:06:24.082527+0000","last_undegraded":"2023-10-08T07:06:24.082527+0000","last_fullsized":"2023-10-08T07:06:24.082527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:45:33.280975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079709+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:06:24.079709+0000","last_peered":"2023-10-08T07:06:24.079709+0000","last_clean":"2023-10-08T07:06:24.079709+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:06:24.079709+0000","last_undegraded":"2023-10-08T07:06:24.079709+0000","last_fullsized":"2023-10-08T07:06:24.079709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376924+0000","last_change":"2023-10-08T07:05:33.326267+0000","last_active":"2023-10-08T07:06:24.376924+0000","last_peered":"2023-10-08T07:06:24.376924+0000","last_clean":"2023-10-08T07:06:24.376924+0000","last_became_active":"2023-10-08T07:05:33.324579+0000","last_became_peered":"2023-10-08T07:05:33.324579+0000","last_unstale":"2023-10-08T07:06:24.376924+0000","last_undegraded":"2023-10-08T07:06:24.376924+0000","last_fullsized":"2023-10-08T07:06:24.376924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:09.406423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081845+0000","last_change":"2023-10-08T07:05:32.320295+0000","last_active":"2023-10-08T07:06:24.081845+0000","last_peered":"2023-10-08T07:06:24.081845+0000","last_clean":"2023-10-08T07:06:24.081845+0000","last_became_active":"2023-10-08T07:05:32.320044+0000","last_became_peered":"2023-10-08T07:05:32.320044+0000","last_unstale":"2023-10-08T07:06:24.081845+0000","last_undegraded":"2023-10-08T07:06:24.081845+0000","last_fullsized":"2023-10-08T07:06:24.081845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:44.690611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082418+0000","last_change":"2023-10-08T07:05:33.329921+0000","last_active":"2023-10-08T07:06:24.082418+0000","last_peered":"2023-10-08T07:06:24.082418+0000","last_clean":"2023-10-08T07:06:24.082418+0000","last_became_active":"2023-10-08T07:05:33.329346+0000","last_became_peered":"2023-10-08T07:05:33.329346+0000","last_unstale":"2023-10-08T07:06:24.082418+0000","last_undegraded":"2023-10-08T07:06:24.082418+0000","last_fullsized":"2023-10-08T07:06:24.082418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078850+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:06:24.078850+0000","last_peered":"2023-10-08T07:06:24.078850+0000","last_clean":"2023-10-08T07:06:24.078850+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:06:24.078850+0000","last_undegraded":"2023-10-08T07:06:24.078850+0000","last_fullsized":"2023-10-08T07:06:24.078850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079499+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:06:24.079499+0000","last_peered":"2023-10-08T07:06:24.079499+0000","last_clean":"2023-10-08T07:06:24.079499+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:06:24.079499+0000","last_undegraded":"2023-10-08T07:06:24.079499+0000","last_fullsized":"2023-10-08T07:06:24.079499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078809+0000","last_change":"2023-10-08T07:05:32.315935+0000","last_active":"2023-10-08T07:06:24.078809+0000","last_peered":"2023-10-08T07:06:24.078809+0000","last_clean":"2023-10-08T07:06:24.078809+0000","last_became_active":"2023-10-08T07:05:32.315661+0000","last_became_peered":"2023-10-08T07:05:32.315661+0000","last_unstale":"2023-10-08T07:06:24.078809+0000","last_undegraded":"2023-10-08T07:06:24.078809+0000","last_fullsized":"2023-10-08T07:06:24.078809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:01:05.952228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082498+0000","last_change":"2023-10-08T07:05:33.330068+0000","last_active":"2023-10-08T07:06:24.082498+0000","last_peered":"2023-10-08T07:06:24.082498+0000","last_clean":"2023-10-08T07:06:24.082498+0000","last_became_active":"2023-10-08T07:05:33.329169+0000","last_became_peered":"2023-10-08T07:05:33.329169+0000","last_unstale":"2023-10-08T07:06:24.082498+0000","last_undegraded":"2023-10-08T07:06:24.082498+0000","last_fullsized":"2023-10-08T07:06:24.082498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079709+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:06:24.079709+0000","last_peered":"2023-10-08T07:06:24.079709+0000","last_clean":"2023-10-08T07:06:24.079709+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:06:24.079709+0000","last_undegraded":"2023-10-08T07:06:24.079709+0000","last_fullsized":"2023-10-08T07:06:24.079709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078654+0000","last_change":"2023-10-08T07:05:33.316496+0000","last_active":"2023-10-08T07:06:24.078654+0000","last_peered":"2023-10-08T07:06:24.078654+0000","last_clean":"2023-10-08T07:06:24.078654+0000","last_became_active":"2023-10-08T07:05:33.316084+0000","last_became_peered":"2023-10-08T07:05:33.316084+0000","last_unstale":"2023-10-08T07:06:24.078654+0000","last_undegraded":"2023-10-08T07:06:24.078654+0000","last_fullsized":"2023-10-08T07:06:24.078654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:29.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377077+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:06:24.377077+0000","last_peered":"2023-10-08T07:06:24.377077+0000","last_clean":"2023-10-08T07:06:24.377077+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:06:24.377077+0000","last_undegraded":"2023-10-08T07:06:24.377077+0000","last_fullsized":"2023-10-08T07:06:24.377077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078957+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:06:24.078957+0000","last_peered":"2023-10-08T07:06:24.078957+0000","last_clean":"2023-10-08T07:06:24.078957+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:06:24.078957+0000","last_undegraded":"2023-10-08T07:06:24.078957+0000","last_fullsized":"2023-10-08T07:06:24.078957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082226+0000","last_change":"2023-10-08T07:05:32.323201+0000","last_active":"2023-10-08T07:06:24.082226+0000","last_peered":"2023-10-08T07:06:24.082226+0000","last_clean":"2023-10-08T07:06:24.082226+0000","last_became_active":"2023-10-08T07:05:32.322864+0000","last_became_peered":"2023-10-08T07:05:32.322864+0000","last_unstale":"2023-10-08T07:06:24.082226+0000","last_undegraded":"2023-10-08T07:06:24.082226+0000","last_fullsized":"2023-10-08T07:06:24.082226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:40.093124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078889+0000","last_change":"2023-10-08T07:05:33.317114+0000","last_active":"2023-10-08T07:06:24.078889+0000","last_peered":"2023-10-08T07:06:24.078889+0000","last_clean":"2023-10-08T07:06:24.078889+0000","last_became_active":"2023-10-08T07:05:33.316390+0000","last_became_peered":"2023-10-08T07:05:33.316390+0000","last_unstale":"2023-10-08T07:06:24.078889+0000","last_undegraded":"2023-10-08T07:06:24.078889+0000","last_fullsized":"2023-10-08T07:06:24.078889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"22'10","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376686+0000","last_change":"2023-10-08T07:05:32.319510+0000","last_active":"2023-10-08T07:06:24.376686+0000","last_peered":"2023-10-08T07:06:24.376686+0000","last_clean":"2023-10-08T07:06:24.376686+0000","last_became_active":"2023-10-08T07:05:32.319209+0000","last_became_peered":"2023-10-08T07:05:32.319209+0000","last_unstale":"2023-10-08T07:06:24.376686+0000","last_undegraded":"2023-10-08T07:06:24.376686+0000","last_fullsized":"2023-10-08T07:06:24.376686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:28.695887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376958+0000","last_change":"2023-10-08T07:05:33.317137+0000","last_active":"2023-10-08T07:06:24.376958+0000","last_peered":"2023-10-08T07:06:24.376958+0000","last_clean":"2023-10-08T07:06:24.376958+0000","last_became_active":"2023-10-08T07:05:33.316562+0000","last_became_peered":"2023-10-08T07:05:33.316562+0000","last_unstale":"2023-10-08T07:06:24.376958+0000","last_undegraded":"2023-10-08T07:06:24.376958+0000","last_fullsized":"2023-10-08T07:06:24.376958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:41.200463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376893+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:06:24.376893+0000","last_peered":"2023-10-08T07:06:24.376893+0000","last_clean":"2023-10-08T07:06:24.376893+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:06:24.376893+0000","last_undegraded":"2023-10-08T07:06:24.376893+0000","last_fullsized":"2023-10-08T07:06:24.376893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082114+0000","last_change":"2023-10-08T07:05:33.322201+0000","last_active":"2023-10-08T07:06:24.082114+0000","last_peered":"2023-10-08T07:06:24.082114+0000","last_clean":"2023-10-08T07:06:24.082114+0000","last_became_active":"2023-10-08T07:05:33.321826+0000","last_became_peered":"2023-10-08T07:05:33.321826+0000","last_unstale":"2023-10-08T07:06:24.082114+0000","last_undegraded":"2023-10-08T07:06:24.082114+0000","last_fullsized":"2023-10-08T07:06:24.082114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079020+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:06:24.079020+0000","last_peered":"2023-10-08T07:06:24.079020+0000","last_clean":"2023-10-08T07:06:24.079020+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:06:24.079020+0000","last_undegraded":"2023-10-08T07:06:24.079020+0000","last_fullsized":"2023-10-08T07:06:24.079020+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082388+0000","last_change":"2023-10-08T07:05:33.317545+0000","last_active":"2023-10-08T07:06:24.082388+0000","last_peered":"2023-10-08T07:06:24.082388+0000","last_clean":"2023-10-08T07:06:24.082388+0000","last_became_active":"2023-10-08T07:05:33.317134+0000","last_became_peered":"2023-10-08T07:05:33.317134+0000","last_unstale":"2023-10-08T07:06:24.082388+0000","last_undegraded":"2023-10-08T07:06:24.082388+0000","last_fullsized":"2023-10-08T07:06:24.082388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081781+0000","last_change":"2023-10-08T07:05:32.323406+0000","last_active":"2023-10-08T07:06:24.081781+0000","last_peered":"2023-10-08T07:06:24.081781+0000","last_clean":"2023-10-08T07:06:24.081781+0000","last_became_active":"2023-10-08T07:05:32.323040+0000","last_became_peered":"2023-10-08T07:05:32.323040+0000","last_unstale":"2023-10-08T07:06:24.081781+0000","last_undegraded":"2023-10-08T07:06:24.081781+0000","last_fullsized":"2023-10-08T07:06:24.081781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079610+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:06:24.079610+0000","last_peered":"2023-10-08T07:06:24.079610+0000","last_clean":"2023-10-08T07:06:24.079610+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:06:24.079610+0000","last_undegraded":"2023-10-08T07:06:24.079610+0000","last_fullsized":"2023-10-08T07:06:24.079610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376256+0000","last_change":"2023-10-08T07:05:32.319220+0000","last_active":"2023-10-08T07:06:24.376256+0000","last_peered":"2023-10-08T07:06:24.376256+0000","last_clean":"2023-10-08T07:06:24.376256+0000","last_became_active":"2023-10-08T07:05:32.318838+0000","last_became_peered":"2023-10-08T07:05:32.318838+0000","last_unstale":"2023-10-08T07:06:24.376256+0000","last_undegraded":"2023-10-08T07:06:24.376256+0000","last_fullsized":"2023-10-08T07:06:24.376256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:32:59.940325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079772+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:06:24.079772+0000","last_peered":"2023-10-08T07:06:24.079772+0000","last_clean":"2023-10-08T07:06:24.079772+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:06:24.079772+0000","last_undegraded":"2023-10-08T07:06:24.079772+0000","last_fullsized":"2023-10-08T07:06:24.079772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377179+0000","last_change":"2023-10-08T07:05:32.319446+0000","last_active":"2023-10-08T07:06:24.377179+0000","last_peered":"2023-10-08T07:06:24.377179+0000","last_clean":"2023-10-08T07:06:24.377179+0000","last_became_active":"2023-10-08T07:05:32.319019+0000","last_became_peered":"2023-10-08T07:05:32.319019+0000","last_unstale":"2023-10-08T07:06:24.377179+0000","last_undegraded":"2023-10-08T07:06:24.377179+0000","last_fullsized":"2023-10-08T07:06:24.377179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:56.843162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081595+0000","last_change":"2023-10-08T07:05:33.330217+0000","last_active":"2023-10-08T07:06:24.081595+0000","last_peered":"2023-10-08T07:06:24.081595+0000","last_clean":"2023-10-08T07:06:24.081595+0000","last_became_active":"2023-10-08T07:05:33.329639+0000","last_became_peered":"2023-10-08T07:05:33.329639+0000","last_unstale":"2023-10-08T07:06:24.081595+0000","last_undegraded":"2023-10-08T07:06:24.081595+0000","last_fullsized":"2023-10-08T07:06:24.081595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:21.715645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082228+0000","last_change":"2023-10-08T07:05:32.323481+0000","last_active":"2023-10-08T07:06:24.082228+0000","last_peered":"2023-10-08T07:06:24.082228+0000","last_clean":"2023-10-08T07:06:24.082228+0000","last_became_active":"2023-10-08T07:05:32.323243+0000","last_became_peered":"2023-10-08T07:05:32.323243+0000","last_unstale":"2023-10-08T07:06:24.082228+0000","last_undegraded":"2023-10-08T07:06:24.082228+0000","last_fullsized":"2023-10-08T07:06:24.082228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081970+0000","last_change":"2023-10-08T07:05:33.318539+0000","last_active":"2023-10-08T07:06:24.081970+0000","last_peered":"2023-10-08T07:06:24.081970+0000","last_clean":"2023-10-08T07:06:24.081970+0000","last_became_active":"2023-10-08T07:05:33.317371+0000","last_became_peered":"2023-10-08T07:05:33.317371+0000","last_unstale":"2023-10-08T07:06:24.081970+0000","last_undegraded":"2023-10-08T07:06:24.081970+0000","last_fullsized":"2023-10-08T07:06:24.081970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:00.945202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376961+0000","last_change":"2023-10-08T07:05:32.321744+0000","last_active":"2023-10-08T07:06:24.376961+0000","last_peered":"2023-10-08T07:06:24.376961+0000","last_clean":"2023-10-08T07:06:24.376961+0000","last_became_active":"2023-10-08T07:05:32.321482+0000","last_became_peered":"2023-10-08T07:05:32.321482+0000","last_unstale":"2023-10-08T07:06:24.376961+0000","last_undegraded":"2023-10-08T07:06:24.376961+0000","last_fullsized":"2023-10-08T07:06:24.376961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:13.789778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376485+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:06:24.376485+0000","last_peered":"2023-10-08T07:06:24.376485+0000","last_clean":"2023-10-08T07:06:24.376485+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:06:24.376485+0000","last_undegraded":"2023-10-08T07:06:24.376485+0000","last_fullsized":"2023-10-08T07:06:24.376485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376417+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:06:24.376417+0000","last_peered":"2023-10-08T07:06:24.376417+0000","last_clean":"2023-10-08T07:06:24.376417+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:06:24.376417+0000","last_undegraded":"2023-10-08T07:06:24.376417+0000","last_fullsized":"2023-10-08T07:06:24.376417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079105+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:06:24.079105+0000","last_peered":"2023-10-08T07:06:24.079105+0000","last_clean":"2023-10-08T07:06:24.079105+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:06:24.079105+0000","last_undegraded":"2023-10-08T07:06:24.079105+0000","last_fullsized":"2023-10-08T07:06:24.079105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078981+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:06:24.078981+0000","last_peered":"2023-10-08T07:06:24.078981+0000","last_clean":"2023-10-08T07:06:24.078981+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:06:24.078981+0000","last_undegraded":"2023-10-08T07:06:24.078981+0000","last_fullsized":"2023-10-08T07:06:24.078981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376433+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:06:24.376433+0000","last_peered":"2023-10-08T07:06:24.376433+0000","last_clean":"2023-10-08T07:06:24.376433+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:06:24.376433+0000","last_undegraded":"2023-10-08T07:06:24.376433+0000","last_fullsized":"2023-10-08T07:06:24.376433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376214+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:06:24.376214+0000","last_peered":"2023-10-08T07:06:24.376214+0000","last_clean":"2023-10-08T07:06:24.376214+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:06:24.376214+0000","last_undegraded":"2023-10-08T07:06:24.376214+0000","last_fullsized":"2023-10-08T07:06:24.376214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377188+0000","last_change":"2023-10-08T07:05:33.319933+0000","last_active":"2023-10-08T07:06:24.377188+0000","last_peered":"2023-10-08T07:06:24.377188+0000","last_clean":"2023-10-08T07:06:24.377188+0000","last_became_active":"2023-10-08T07:05:33.317937+0000","last_became_peered":"2023-10-08T07:05:33.317937+0000","last_unstale":"2023-10-08T07:06:24.377188+0000","last_undegraded":"2023-10-08T07:06:24.377188+0000","last_fullsized":"2023-10-08T07:06:24.377188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:57:42.074994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081680+0000","last_change":"2023-10-08T07:05:32.323415+0000","last_active":"2023-10-08T07:06:24.081680+0000","last_peered":"2023-10-08T07:06:24.081680+0000","last_clean":"2023-10-08T07:06:24.081680+0000","last_became_active":"2023-10-08T07:05:32.322910+0000","last_became_peered":"2023-10-08T07:05:32.322910+0000","last_unstale":"2023-10-08T07:06:24.081680+0000","last_undegraded":"2023-10-08T07:06:24.081680+0000","last_fullsized":"2023-10-08T07:06:24.081680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377180+0000","last_change":"2023-10-08T07:05:33.325994+0000","last_active":"2023-10-08T07:06:24.377180+0000","last_peered":"2023-10-08T07:06:24.377180+0000","last_clean":"2023-10-08T07:06:24.377180+0000","last_became_active":"2023-10-08T07:05:33.324865+0000","last_became_peered":"2023-10-08T07:05:33.324865+0000","last_unstale":"2023-10-08T07:06:24.377180+0000","last_undegraded":"2023-10-08T07:06:24.377180+0000","last_fullsized":"2023-10-08T07:06:24.377180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:14.142601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081686+0000","last_change":"2023-10-08T07:05:32.320359+0000","last_active":"2023-10-08T07:06:24.081686+0000","last_peered":"2023-10-08T07:06:24.081686+0000","last_clean":"2023-10-08T07:06:24.081686+0000","last_became_active":"2023-10-08T07:05:32.320137+0000","last_became_peered":"2023-10-08T07:05:32.320137+0000","last_unstale":"2023-10-08T07:06:24.081686+0000","last_undegraded":"2023-10-08T07:06:24.081686+0000","last_fullsized":"2023-10-08T07:06:24.081686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:32.366341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079639+0000","last_change":"2023-10-08T07:05:33.322861+0000","last_active":"2023-10-08T07:06:24.079639+0000","last_peered":"2023-10-08T07:06:24.079639+0000","last_clean":"2023-10-08T07:06:24.079639+0000","last_became_active":"2023-10-08T07:05:33.322450+0000","last_became_peered":"2023-10-08T07:05:33.322450+0000","last_unstale":"2023-10-08T07:06:24.079639+0000","last_undegraded":"2023-10-08T07:06:24.079639+0000","last_fullsized":"2023-10-08T07:06:24.079639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079244+0000","last_change":"2023-10-08T07:05:27.295597+0000","last_active":"2023-10-08T07:06:24.079244+0000","last_peered":"2023-10-08T07:06:24.079244+0000","last_clean":"2023-10-08T07:06:24.079244+0000","last_became_active":"2023-10-08T07:05:27.295265+0000","last_became_peered":"2023-10-08T07:05:27.295265+0000","last_unstale":"2023-10-08T07:06:24.079244+0000","last_undegraded":"2023-10-08T07:06:24.079244+0000","last_fullsized":"2023-10-08T07:06:24.079244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:33:50.652757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377085+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:06:24.377085+0000","last_peered":"2023-10-08T07:06:24.377085+0000","last_clean":"2023-10-08T07:06:24.377085+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:06:24.377085+0000","last_undegraded":"2023-10-08T07:06:24.377085+0000","last_fullsized":"2023-10-08T07:06:24.377085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081938+0000","last_change":"2023-10-08T07:05:33.326797+0000","last_active":"2023-10-08T07:06:24.081938+0000","last_peered":"2023-10-08T07:06:24.081938+0000","last_clean":"2023-10-08T07:06:24.081938+0000","last_became_active":"2023-10-08T07:05:33.326518+0000","last_became_peered":"2023-10-08T07:05:33.326518+0000","last_unstale":"2023-10-08T07:06:24.081938+0000","last_undegraded":"2023-10-08T07:06:24.081938+0000","last_fullsized":"2023-10-08T07:06:24.081938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376623+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:06:24.376623+0000","last_peered":"2023-10-08T07:06:24.376623+0000","last_clean":"2023-10-08T07:06:24.376623+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:06:24.376623+0000","last_undegraded":"2023-10-08T07:06:24.376623+0000","last_fullsized":"2023-10-08T07:06:24.376623+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376707+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:06:24.376707+0000","last_peered":"2023-10-08T07:06:24.376707+0000","last_clean":"2023-10-08T07:06:24.376707+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:06:24.376707+0000","last_undegraded":"2023-10-08T07:06:24.376707+0000","last_fullsized":"2023-10-08T07:06:24.376707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079168+0000","last_change":"2023-10-08T07:05:33.322164+0000","last_active":"2023-10-08T07:06:24.079168+0000","last_peered":"2023-10-08T07:06:24.079168+0000","last_clean":"2023-10-08T07:06:24.079168+0000","last_became_active":"2023-10-08T07:05:33.321757+0000","last_became_peered":"2023-10-08T07:05:33.321757+0000","last_unstale":"2023-10-08T07:06:24.079168+0000","last_undegraded":"2023-10-08T07:06:24.079168+0000","last_fullsized":"2023-10-08T07:06:24.079168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078737+0000","last_change":"2023-10-08T07:05:27.295991+0000","last_active":"2023-10-08T07:06:24.078737+0000","last_peered":"2023-10-08T07:06:24.078737+0000","last_clean":"2023-10-08T07:06:24.078737+0000","last_became_active":"2023-10-08T07:05:27.295727+0000","last_became_peered":"2023-10-08T07:05:27.295727+0000","last_unstale":"2023-10-08T07:06:24.078737+0000","last_undegraded":"2023-10-08T07:06:24.078737+0000","last_fullsized":"2023-10-08T07:06:24.078737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:54.804133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081687+0000","last_change":"2023-10-08T07:05:32.323161+0000","last_active":"2023-10-08T07:06:24.081687+0000","last_peered":"2023-10-08T07:06:24.081687+0000","last_clean":"2023-10-08T07:06:24.081687+0000","last_became_active":"2023-10-08T07:05:32.322832+0000","last_became_peered":"2023-10-08T07:05:32.322832+0000","last_unstale":"2023-10-08T07:06:24.081687+0000","last_undegraded":"2023-10-08T07:06:24.081687+0000","last_fullsized":"2023-10-08T07:06:24.081687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079741+0000","last_change":"2023-10-08T07:05:33.323204+0000","last_active":"2023-10-08T07:06:24.079741+0000","last_peered":"2023-10-08T07:06:24.079741+0000","last_clean":"2023-10-08T07:06:24.079741+0000","last_became_active":"2023-10-08T07:05:33.322899+0000","last_became_peered":"2023-10-08T07:05:33.322899+0000","last_unstale":"2023-10-08T07:06:24.079741+0000","last_undegraded":"2023-10-08T07:06:24.079741+0000","last_fullsized":"2023-10-08T07:06:24.079741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376818+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:06:24.376818+0000","last_peered":"2023-10-08T07:06:24.376818+0000","last_clean":"2023-10-08T07:06:24.376818+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:06:24.376818+0000","last_undegraded":"2023-10-08T07:06:24.376818+0000","last_fullsized":"2023-10-08T07:06:24.376818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376084+0000","last_change":"2023-10-08T07:05:22.277737+0000","last_active":"2023-10-08T07:06:24.376084+0000","last_peered":"2023-10-08T07:06:24.376084+0000","last_clean":"2023-10-08T07:06:24.376084+0000","last_became_active":"2023-10-08T07:05:22.277417+0000","last_became_peered":"2023-10-08T07:05:22.277417+0000","last_unstale":"2023-10-08T07:06:24.376084+0000","last_undegraded":"2023-10-08T07:06:24.376084+0000","last_fullsized":"2023-10-08T07:06:24.376084+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:10.186804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078849+0000","last_change":"2023-10-08T07:05:32.316756+0000","last_active":"2023-10-08T07:06:24.078849+0000","last_peered":"2023-10-08T07:06:24.078849+0000","last_clean":"2023-10-08T07:06:24.078849+0000","last_became_active":"2023-10-08T07:05:32.316340+0000","last_became_peered":"2023-10-08T07:05:32.316340+0000","last_unstale":"2023-10-08T07:06:24.078849+0000","last_undegraded":"2023-10-08T07:06:24.078849+0000","last_fullsized":"2023-10-08T07:06:24.078849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:46:34.838960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377169+0000","last_change":"2023-10-08T07:05:33.318964+0000","last_active":"2023-10-08T07:06:24.377169+0000","last_peered":"2023-10-08T07:06:24.377169+0000","last_clean":"2023-10-08T07:06:24.377169+0000","last_became_active":"2023-10-08T07:05:33.317866+0000","last_became_peered":"2023-10-08T07:05:33.317866+0000","last_unstale":"2023-10-08T07:06:24.377169+0000","last_undegraded":"2023-10-08T07:06:24.377169+0000","last_fullsized":"2023-10-08T07:06:24.377169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:59:47.306558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376085+0000","last_change":"2023-10-08T07:05:27.295425+0000","last_active":"2023-10-08T07:06:24.376085+0000","last_peered":"2023-10-08T07:06:24.376085+0000","last_clean":"2023-10-08T07:06:24.376085+0000","last_became_active":"2023-10-08T07:05:27.295157+0000","last_became_peered":"2023-10-08T07:05:27.295157+0000","last_unstale":"2023-10-08T07:06:24.376085+0000","last_undegraded":"2023-10-08T07:06:24.376085+0000","last_fullsized":"2023-10-08T07:06:24.376085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:06.192882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078622+0000","last_change":"2023-10-08T07:05:32.317723+0000","last_active":"2023-10-08T07:06:24.078622+0000","last_peered":"2023-10-08T07:06:24.078622+0000","last_clean":"2023-10-08T07:06:24.078622+0000","last_became_active":"2023-10-08T07:05:32.317444+0000","last_became_peered":"2023-10-08T07:05:32.317444+0000","last_unstale":"2023-10-08T07:06:24.078622+0000","last_undegraded":"2023-10-08T07:06:24.078622+0000","last_fullsized":"2023-10-08T07:06:24.078622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:29.242830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082387+0000","last_change":"2023-10-08T07:05:33.321497+0000","last_active":"2023-10-08T07:06:24.082387+0000","last_peered":"2023-10-08T07:06:24.082387+0000","last_clean":"2023-10-08T07:06:24.082387+0000","last_became_active":"2023-10-08T07:05:33.319658+0000","last_became_peered":"2023-10-08T07:05:33.319658+0000","last_unstale":"2023-10-08T07:06:24.082387+0000","last_undegraded":"2023-10-08T07:06:24.082387+0000","last_fullsized":"2023-10-08T07:06:24.082387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082304+0000","last_change":"2023-10-08T07:05:27.298597+0000","last_active":"2023-10-08T07:06:24.082304+0000","last_peered":"2023-10-08T07:06:24.082304+0000","last_clean":"2023-10-08T07:06:24.082304+0000","last_became_active":"2023-10-08T07:05:27.298355+0000","last_became_peered":"2023-10-08T07:05:27.298355+0000","last_unstale":"2023-10-08T07:06:24.082304+0000","last_undegraded":"2023-10-08T07:06:24.082304+0000","last_fullsized":"2023-10-08T07:06:24.082304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:06.241475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079072+0000","last_change":"2023-10-08T07:05:32.319605+0000","last_active":"2023-10-08T07:06:24.079072+0000","last_peered":"2023-10-08T07:06:24.079072+0000","last_clean":"2023-10-08T07:06:24.079072+0000","last_became_active":"2023-10-08T07:05:32.319244+0000","last_became_peered":"2023-10-08T07:05:32.319244+0000","last_unstale":"2023-10-08T07:06:24.079072+0000","last_undegraded":"2023-10-08T07:06:24.079072+0000","last_fullsized":"2023-10-08T07:06:24.079072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:11:25.991992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082115+0000","last_change":"2023-10-08T07:05:33.327112+0000","last_active":"2023-10-08T07:06:24.082115+0000","last_peered":"2023-10-08T07:06:24.082115+0000","last_clean":"2023-10-08T07:06:24.082115+0000","last_became_active":"2023-10-08T07:05:33.326816+0000","last_became_peered":"2023-10-08T07:05:33.326816+0000","last_unstale":"2023-10-08T07:06:24.082115+0000","last_undegraded":"2023-10-08T07:06:24.082115+0000","last_fullsized":"2023-10-08T07:06:24.082115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079606+0000","last_change":"2023-10-08T07:05:32.319875+0000","last_active":"2023-10-08T07:06:24.079606+0000","last_peered":"2023-10-08T07:06:24.079606+0000","last_clean":"2023-10-08T07:06:24.079606+0000","last_became_active":"2023-10-08T07:05:32.319385+0000","last_became_peered":"2023-10-08T07:05:32.319385+0000","last_unstale":"2023-10-08T07:06:24.079606+0000","last_undegraded":"2023-10-08T07:06:24.079606+0000","last_fullsized":"2023-10-08T07:06:24.079606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:11:39.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079608+0000","last_change":"2023-10-08T07:05:27.295537+0000","last_active":"2023-10-08T07:06:24.079608+0000","last_peered":"2023-10-08T07:06:24.079608+0000","last_clean":"2023-10-08T07:06:24.079608+0000","last_became_active":"2023-10-08T07:05:27.295234+0000","last_became_peered":"2023-10-08T07:05:27.295234+0000","last_unstale":"2023-10-08T07:06:24.079608+0000","last_undegraded":"2023-10-08T07:06:24.079608+0000","last_fullsized":"2023-10-08T07:06:24.079608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:22.951187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078527+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:06:24.078527+0000","last_peered":"2023-10-08T07:06:24.078527+0000","last_clean":"2023-10-08T07:06:24.078527+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:06:24.078527+0000","last_undegraded":"2023-10-08T07:06:24.078527+0000","last_fullsized":"2023-10-08T07:06:24.078527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.377152+0000","last_change":"2023-10-08T07:05:27.295945+0000","last_active":"2023-10-08T07:06:24.377152+0000","last_peered":"2023-10-08T07:06:24.377152+0000","last_clean":"2023-10-08T07:06:24.377152+0000","last_became_active":"2023-10-08T07:05:27.295726+0000","last_became_peered":"2023-10-08T07:05:27.295726+0000","last_unstale":"2023-10-08T07:06:24.377152+0000","last_undegraded":"2023-10-08T07:06:24.377152+0000","last_fullsized":"2023-10-08T07:06:24.377152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:55.040889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"22'3","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079438+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:06:24.079438+0000","last_peered":"2023-10-08T07:06:24.079438+0000","last_clean":"2023-10-08T07:06:24.079438+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:06:24.079438+0000","last_undegraded":"2023-10-08T07:06:24.079438+0000","last_fullsized":"2023-10-08T07:06:24.079438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081795+0000","last_change":"2023-10-08T07:05:33.326621+0000","last_active":"2023-10-08T07:06:24.081795+0000","last_peered":"2023-10-08T07:06:24.081795+0000","last_clean":"2023-10-08T07:06:24.081795+0000","last_became_active":"2023-10-08T07:05:33.326272+0000","last_became_peered":"2023-10-08T07:05:33.326272+0000","last_unstale":"2023-10-08T07:06:24.081795+0000","last_undegraded":"2023-10-08T07:06:24.081795+0000","last_fullsized":"2023-10-08T07:06:24.081795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:31.752188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082052+0000","last_change":"2023-10-08T07:05:32.323175+0000","last_active":"2023-10-08T07:06:24.082052+0000","last_peered":"2023-10-08T07:06:24.082052+0000","last_clean":"2023-10-08T07:06:24.082052+0000","last_became_active":"2023-10-08T07:05:32.322814+0000","last_became_peered":"2023-10-08T07:05:32.322814+0000","last_unstale":"2023-10-08T07:06:24.082052+0000","last_undegraded":"2023-10-08T07:06:24.082052+0000","last_fullsized":"2023-10-08T07:06:24.082052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082207+0000","last_change":"2023-10-08T07:05:33.318398+0000","last_active":"2023-10-08T07:06:24.082207+0000","last_peered":"2023-10-08T07:06:24.082207+0000","last_clean":"2023-10-08T07:06:24.082207+0000","last_became_active":"2023-10-08T07:05:33.317478+0000","last_became_peered":"2023-10-08T07:05:33.317478+0000","last_unstale":"2023-10-08T07:06:24.082207+0000","last_undegraded":"2023-10-08T07:06:24.082207+0000","last_fullsized":"2023-10-08T07:06:24.082207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376571+0000","last_change":"2023-10-08T07:05:32.320603+0000","last_active":"2023-10-08T07:06:24.376571+0000","last_peered":"2023-10-08T07:06:24.376571+0000","last_clean":"2023-10-08T07:06:24.376571+0000","last_became_active":"2023-10-08T07:05:32.320262+0000","last_became_peered":"2023-10-08T07:05:32.320262+0000","last_unstale":"2023-10-08T07:06:24.376571+0000","last_undegraded":"2023-10-08T07:06:24.376571+0000","last_fullsized":"2023-10-08T07:06:24.376571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:09.249029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376560+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:06:24.376560+0000","last_peered":"2023-10-08T07:06:24.376560+0000","last_clean":"2023-10-08T07:06:24.376560+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:06:24.376560+0000","last_undegraded":"2023-10-08T07:06:24.376560+0000","last_fullsized":"2023-10-08T07:06:24.376560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082343+0000","last_change":"2023-10-08T07:05:32.323143+0000","last_active":"2023-10-08T07:06:24.082343+0000","last_peered":"2023-10-08T07:06:24.082343+0000","last_clean":"2023-10-08T07:06:24.082343+0000","last_became_active":"2023-10-08T07:05:32.322789+0000","last_became_peered":"2023-10-08T07:05:32.322789+0000","last_unstale":"2023-10-08T07:06:24.082343+0000","last_undegraded":"2023-10-08T07:06:24.082343+0000","last_fullsized":"2023-10-08T07:06:24.082343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:43:03.978136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376442+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:06:24.376442+0000","last_peered":"2023-10-08T07:06:24.376442+0000","last_clean":"2023-10-08T07:06:24.376442+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:06:24.376442+0000","last_undegraded":"2023-10-08T07:06:24.376442+0000","last_fullsized":"2023-10-08T07:06:24.376442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079711+0000","last_change":"2023-10-08T07:05:32.319462+0000","last_active":"2023-10-08T07:06:24.079711+0000","last_peered":"2023-10-08T07:06:24.079711+0000","last_clean":"2023-10-08T07:06:24.079711+0000","last_became_active":"2023-10-08T07:05:32.318951+0000","last_became_peered":"2023-10-08T07:05:32.318951+0000","last_unstale":"2023-10-08T07:06:24.079711+0000","last_undegraded":"2023-10-08T07:06:24.079711+0000","last_fullsized":"2023-10-08T07:06:24.079711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:39.471999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081896+0000","last_change":"2023-10-08T07:05:33.319869+0000","last_active":"2023-10-08T07:06:24.081896+0000","last_peered":"2023-10-08T07:06:24.081896+0000","last_clean":"2023-10-08T07:06:24.081896+0000","last_became_active":"2023-10-08T07:05:33.318241+0000","last_became_peered":"2023-10-08T07:05:33.318241+0000","last_unstale":"2023-10-08T07:06:24.081896+0000","last_undegraded":"2023-10-08T07:06:24.081896+0000","last_fullsized":"2023-10-08T07:06:24.081896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079679+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:06:24.079679+0000","last_peered":"2023-10-08T07:06:24.079679+0000","last_clean":"2023-10-08T07:06:24.079679+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:06:24.079679+0000","last_undegraded":"2023-10-08T07:06:24.079679+0000","last_fullsized":"2023-10-08T07:06:24.079679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376365+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:06:24.376365+0000","last_peered":"2023-10-08T07:06:24.376365+0000","last_clean":"2023-10-08T07:06:24.376365+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:06:24.376365+0000","last_undegraded":"2023-10-08T07:06:24.376365+0000","last_fullsized":"2023-10-08T07:06:24.376365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.376241+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:06:24.376241+0000","last_peered":"2023-10-08T07:06:24.376241+0000","last_clean":"2023-10-08T07:06:24.376241+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:06:24.376241+0000","last_undegraded":"2023-10-08T07:06:24.376241+0000","last_fullsized":"2023-10-08T07:06:24.376241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.078689+0000","last_change":"2023-10-08T07:05:33.322006+0000","last_active":"2023-10-08T07:06:24.078689+0000","last_peered":"2023-10-08T07:06:24.078689+0000","last_clean":"2023-10-08T07:06:24.078689+0000","last_became_active":"2023-10-08T07:05:33.321639+0000","last_became_peered":"2023-10-08T07:05:33.321639+0000","last_unstale":"2023-10-08T07:06:24.078689+0000","last_undegraded":"2023-10-08T07:06:24.078689+0000","last_fullsized":"2023-10-08T07:06:24.078689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:14.794656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.081998+0000","last_change":"2023-10-08T07:05:33.329906+0000","last_active":"2023-10-08T07:06:24.081998+0000","last_peered":"2023-10-08T07:06:24.081998+0000","last_clean":"2023-10-08T07:06:24.081998+0000","last_became_active":"2023-10-08T07:05:33.329615+0000","last_became_peered":"2023-10-08T07:05:33.329615+0000","last_unstale":"2023-10-08T07:06:24.081998+0000","last_undegraded":"2023-10-08T07:06:24.081998+0000","last_fullsized":"2023-10-08T07:06:24.081998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.079230+0000","last_change":"2023-10-08T07:05:33.316573+0000","last_active":"2023-10-08T07:06:24.079230+0000","last_peered":"2023-10-08T07:06:24.079230+0000","last_clean":"2023-10-08T07:06:24.079230+0000","last_became_active":"2023-10-08T07:05:33.316193+0000","last_became_peered":"2023-10-08T07:05:33.316193+0000","last_unstale":"2023-10-08T07:06:24.079230+0000","last_undegraded":"2023-10-08T07:06:24.079230+0000","last_fullsized":"2023-10-08T07:06:24.079230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-08T07:06:24.082214+0000","last_change":"2023-10-08T07:05:33.320077+0000","last_active":"2023-10-08T07:06:24.082214+0000","last_peered":"2023-10-08T07:06:24.082214+0000","last_clean":"2023-10-08T07:06:24.082214+0000","last_became_active":"2023-10-08T07:05:33.319392+0000","last_became_peered":"2023-10-08T07:05:33.319392+0000","last_unstale":"2023-10-08T07:06:24.082214+0000","last_undegraded":"2023-10-08T07:06:24.082214+0000","last_fullsized":"2023-10-08T07:06:24.082214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738384,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":108857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.433},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.40400000000000003}]},{"osd":1,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.45400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":705960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.46800000000000003}]},{"osd":2,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.37},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.38900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738385,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":884736,"data_stored":705344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.495},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.44}]},{"osd":2,"last update":"Sun Oct 8 07:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:06:34.019 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2023-10-08T07:06:34.019 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T07:06:34.020 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2023-10-08T07:06:34.020 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi086.front.sepia.ceph.com 2023-10-08T07:06:34.020 INFO:teuthology.orchestra.console.smithi086:Power off 2023-10-08T07:06:34.020 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T07:06:34.039 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:34.037+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:34.046 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-10-08T07:06:34.046 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:06:34.072 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-10-08T07:06:34.085 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:34.085 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:34.085 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:34.085 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:34.095 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:34.140 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:34.139+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:34.182 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:34.202 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:34.227 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:34.227 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:34.236 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:34.237 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-10-08T07:06:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:34.241 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:34.239+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:34.341 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:34.340+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:34.370 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:34.370 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:34.380 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:34.442 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:34.441+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:34.511 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:34.511 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:34.521 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:34.544 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:34.543+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:34.644 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:34.644+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:34.688 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:34.688 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:34.698 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:34.744 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:34.743+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:34.825 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:34.825 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:34.835 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:34.879 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:34.879+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:34.946 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:34.946+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:34.970 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:34.970 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:34.981 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:35.065 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:35.065+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:35.133 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T07:06:35.149 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:35.148+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:35.153 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:35.163 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:35.250 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:35.249+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:35.337 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:35.337 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:35.346 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:35.390 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:35.389+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:35.453 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:35.451+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:35.477 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:35.477 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:35.487 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:35.571 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:35.570+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:35.653 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:35.653 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:35.657 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:35.657+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:35.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:35.759 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:35.759+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:35.830 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:35.830 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:35.840 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:35.884 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:35.884+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:35.961 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:35.960+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:35.978 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:35.978 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:35.988 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:36.074 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:36.074+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:36.122 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2023-10-08T07:06:36.161 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:36.161 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:36.162 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:36.162+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:36.172 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:36.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:36.263 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:36.262+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:36.344 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:36.345 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:36.355 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:36.399 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:36.398+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:36.411 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:36.431 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2023-10-08T07:06:36.452 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-10-08T07:06:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:36.464 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:36.463+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:36.485 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:36.485 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:36.485 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:36.485 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:36.496 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:36.565 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:36.565+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:36.664 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:36.664 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:36.664 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:36.664 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:36.664 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:36.665 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:36.664+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:36.674 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:36.767 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:36.767+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:36.844 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:36.844 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:36.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:36.844 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:36.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.844 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:36.844 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:36.844 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.525582348999997, 2023-10-08T07:06:36.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:36.845 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.845 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:36.845 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:36.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:36.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:36.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:36.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:36.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:36.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:36.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:36.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:36.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:36.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:36.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:36.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:36.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:36.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:36.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:36.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:36.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:36.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:36.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:36.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:36.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:36.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:36.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:36.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:36.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:36.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:36.851 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.525508565000003, 2023-10-08T07:06:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:36.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:36.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.525445388999998, 2023-10-08T07:06:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:36.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:36.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:36.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:36.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:36.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:36.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:36.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:36.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:36.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:36.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:36.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:36.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:36.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:36.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:36.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:36.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:36.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:36.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:36.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:36.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:36.864 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.864 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.864 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.864 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:36.864 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:36.864 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.525411042999998, 2023-10-08T07:06:36.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:36.864 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.864 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:36.864 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:36.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:36.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:36.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:36.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:36.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:36.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:36.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:36.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:36.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:36.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:36.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:36.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:36.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:36.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:36.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:36.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:36.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:36.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:36.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:36.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:36.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:36.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:36.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:36.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:36.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:36.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:36.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:36.870 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.870 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.870 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.871 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:36.871 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:36.871 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.524920817999998, 2023-10-08T07:06:36.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:36.871 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.871 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:36.871 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:36.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:36.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:36.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:36.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:36.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:36.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:36.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:36.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:36.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:36.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:36.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:36.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:36.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:36.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:36.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:36.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:36.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:36.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:36.876 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.877 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.877 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.877 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:36.877 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:36.877 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.524880240999998, 2023-10-08T07:06:36.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:36.877 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.877 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:36.877 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:36.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:36.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:36.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:36.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:36.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:36.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:36.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:36.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:36.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:36.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:36.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:36.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:36.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:36.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:36.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:36.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:36.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:36.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:36.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:36.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:36.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:36.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:36.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:36.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:36.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:36.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:36.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:36.883 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.884 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.884 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.884 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:36.884 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:36.884 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.524842671999998, 2023-10-08T07:06:36.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:36.884 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.884 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:36.885 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:36.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:36.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:36.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:36.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:36.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:36.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:36.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:36.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:36.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:36.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:36.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:36.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:36.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:36.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:36.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:36.889 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.889 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.889 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.889 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:36.889 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:36.889 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.524775232000003, 2023-10-08T07:06:36.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:36.890 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.890 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:36.890 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:36.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:36.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:36.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:36.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:36.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:36.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:36.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:36.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:36.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:36.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:36.894 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.894 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.894 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.894 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:36.894 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:36.894 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.524745590000002, 2023-10-08T07:06:36.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:36.894 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.894 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:36.895 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:36.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:36.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:36.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:36.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:36.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:36.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:36.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:36.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:36.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:36.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:36.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:36.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:36.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:36.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:36.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:36.898 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.898 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.899 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:36.899 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:36.899 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.519005028999999, 2023-10-08T07:06:36.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:36.899 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.899 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:36.899 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:36.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:36.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:36.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:36.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:36.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:36.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:36.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:36.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.903 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.903 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:36.903 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:36.903 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.518555689000003, 2023-10-08T07:06:36.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:36.904 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.904 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:36.904 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:36.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:36.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:36.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:36.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:36.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:36.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:36.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:36.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:36.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:36.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:36.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:36.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:36.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:36.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:36.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:36.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.909 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.909 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:36.909 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:36.909 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.517759798999997, 2023-10-08T07:06:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:36.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:36.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:36.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:36.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:36.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:36.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:36.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:36.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:36.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:36.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:36.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:36.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:36.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:36.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:36.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:36.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:36.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:36.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.914 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.915 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.915 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:36.915 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:36.915 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.517644447999999, 2023-10-08T07:06:36.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:36.915 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.915 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:36.915 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:36.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:36.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:36.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:36.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:36.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:36.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:36.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:36.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:36.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:36.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:36.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:36.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:36.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:36.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:36.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:36.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:36.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:36.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:36.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.920 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.920 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:36.920 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:36.920 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.512529882000003, 2023-10-08T07:06:36.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:36.920 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.920 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:36.920 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:36.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:36.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:36.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:36.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:36.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:36.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:36.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:36.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:36.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:36.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:36.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:36.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:36.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:36.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:36.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:36.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:36.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.512418889999999, 2023-10-08T07:06:36.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:36.926 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.926 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:36.926 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:36.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:36.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:36.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:36.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:36.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:36.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:36.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:36.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:36.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:36.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:36.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:36.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:36.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:36.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:36.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:36.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:36.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:36.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:36.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.930 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.930 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:36.931 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:36.931 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.511994448999999, 2023-10-08T07:06:36.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:36.931 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.931 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:36.931 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:36.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:36.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:36.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:36.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:36.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:36.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:36.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:36.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:36.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:36.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:36.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:36.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:36.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:36.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:36.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:36.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.935 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.935 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:36.936 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:36.936 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.511847312999997, 2023-10-08T07:06:36.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:36.936 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.936 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:36.936 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:36.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:36.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:36.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:36.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:36.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:36.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:36.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:36.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:36.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:36.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:36.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:36.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:36.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:36.939 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.939 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.940 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.940 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:36.940 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:36.940 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.440549044000001, 2023-10-08T07:06:36.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:36.940 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.940 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:36.940 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:36.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:36.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:36.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:36.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:36.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:36.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:36.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:36.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:36.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:36.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:36.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.946 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.946 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:36.946 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:36.946 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.438755460000003, 2023-10-08T07:06:36.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:36.947 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.947 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:36.947 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:36.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:36.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:36.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:36.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:36.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:36.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:36.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:36.950 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.951 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.951 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.951 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:36.951 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:36.951 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.440165790000002, 2023-10-08T07:06:36.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:36.951 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:36.951 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:36.951 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:36.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:36.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:36.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:36.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:36.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:36.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:36.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:36.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:36.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:36.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:36.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:36.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:36.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:36.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:36.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:36.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:36.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:36.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:36.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:36.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:36.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:36.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:36.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:36.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:36.957 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.957 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.957 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.957 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:36.957 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:36.957 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:36.959 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:36.958+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:36.959 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:37.060 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:37.060+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:37.101 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:37.101 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:37.101 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:37.101 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:37.111 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:37.160 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:37.160+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:37.261 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:37.261+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:37.282 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:37.283 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:37.283 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:37.283 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:37.283 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:37.293 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:37.363 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:37.362+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:37.463 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:37.462+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:37.468 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:37.468 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:160 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 74.694700904000001, 2023-10-08T07:06:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013063739, 2023-10-08T07:06:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:37.469 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 160 2023-10-08T07:06:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771740+0000", 2023-10-08T07:06:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6100000000000002e-07 2023-10-08T07:06:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771743+0000", 2023-10-08T07:06:37.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1679999999999998e-06 2023-10-08T07:06:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771753+0000", 2023-10-08T07:06:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:06:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771756+0000", 2023-10-08T07:06:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1149999999999998e-06 2023-10-08T07:06:37.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774769+0000", 2023-10-08T07:06:37.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003012973 2023-10-08T07:06:37.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.774863+0000", 2023-10-08T07:06:37.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4209999999999994e-05 2023-10-08T07:06:37.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775007+0000", 2023-10-08T07:06:37.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014393899999999999 2023-10-08T07:06:37.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777284+0000", 2023-10-08T07:06:37.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022768670000000001 2023-10-08T07:06:37.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784709+0000", 2023-10-08T07:06:37.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074250719999999996 2023-10-08T07:06:37.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784766+0000", 2023-10-08T07:06:37.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7296000000000002e-05 2023-10-08T07:06:37.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784804+0000", 2023-10-08T07:06:37.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.79e-05 2023-10-08T07:06:37.475 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.475 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.476 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.476 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:37.476 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:37.476 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 74.694679358000002, 2023-10-08T07:06:37.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013112825999999999, 2023-10-08T07:06:37.476 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.476 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.476 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:37.477 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:37.477 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:37.477 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 161 2023-10-08T07:06:37.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.477 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:37.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:37.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771762+0000", 2023-10-08T07:06:37.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:06:37.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771809+0000", 2023-10-08T07:06:37.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7234000000000002e-05 2023-10-08T07:06:37.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771815+0000", 2023-10-08T07:06:37.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:06:37.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771819+0000", 2023-10-08T07:06:37.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6090000000000001e-06 2023-10-08T07:06:37.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775424+0000", 2023-10-08T07:06:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00360532 2023-10-08T07:06:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775510+0000", 2023-10-08T07:06:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5896000000000006e-05 2023-10-08T07:06:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.775656+0000", 2023-10-08T07:06:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014652799999999999 2023-10-08T07:06:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780879+0000", 2023-10-08T07:06:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052224480000000002 2023-10-08T07:06:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784829+0000", 2023-10-08T07:06:37.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039503730000000001 2023-10-08T07:06:37.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784856+0000", 2023-10-08T07:06:37.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:06:37.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784875+0000", 2023-10-08T07:06:37.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8719000000000002e-05 2023-10-08T07:06:37.482 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.483 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.483 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.483 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:37.483 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:37.483 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 74.694612763999999, 2023-10-08T07:06:37.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013189355999999999, 2023-10-08T07:06:37.483 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.483 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:37.484 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:37.484 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:37.484 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162 2023-10-08T07:06:37.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.484 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:37.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771828+0000", 2023-10-08T07:06:37.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771829+0000", 2023-10-08T07:06:37.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:06:37.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771831+0000", 2023-10-08T07:06:37.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0700000000000001e-06 2023-10-08T07:06:37.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771839+0000", 2023-10-08T07:06:37.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4640000000000006e-06 2023-10-08T07:06:37.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771842+0000", 2023-10-08T07:06:37.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1439999999999999e-06 2023-10-08T07:06:37.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.487 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776073+0000", 2023-10-08T07:06:37.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004231009 2023-10-08T07:06:37.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.487 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776163+0000", 2023-10-08T07:06:37.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9603000000000003e-05 2023-10-08T07:06:37.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776313+0000", 2023-10-08T07:06:37.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149887 2023-10-08T07:06:37.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780889+0000", 2023-10-08T07:06:37.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045758170000000003 2023-10-08T07:06:37.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784924+0000", 2023-10-08T07:06:37.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040351509999999998 2023-10-08T07:06:37.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.784982+0000", 2023-10-08T07:06:37.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7917000000000001e-05 2023-10-08T07:06:37.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785018+0000", 2023-10-08T07:06:37.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6007999999999998e-05 2023-10-08T07:06:37.490 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.490 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.490 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.490 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:37.490 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:37.490 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 74.694593867999998, 2023-10-08T07:06:37.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013242967, 2023-10-08T07:06:37.490 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.490 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.491 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:37.491 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:37.491 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:37.491 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 163 2023-10-08T07:06:37.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.491 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:37.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771847+0000", 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.23e-07 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771849+0000", 2023-10-08T07:06:37.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.984e-06 2023-10-08T07:06:37.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771854+0000", 2023-10-08T07:06:37.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2649999999999998e-06 2023-10-08T07:06:37.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771856+0000", 2023-10-08T07:06:37.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.706e-06 2023-10-08T07:06:37.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776736+0000", 2023-10-08T07:06:37.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048795649999999998 2023-10-08T07:06:37.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776828+0000", 2023-10-08T07:06:37.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:06:37.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.776966+0000", 2023-10-08T07:06:37.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013825600000000001 2023-10-08T07:06:37.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781057+0000", 2023-10-08T07:06:37.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040906609999999998 2023-10-08T07:06:37.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785044+0000", 2023-10-08T07:06:37.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039864929999999998 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785071+0000", 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7798e-05 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.785090+0000", 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8777e-05 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.496 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.497 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:37.497 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:37.497 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 74.694580858999998, 2023-10-08T07:06:37.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:37.497 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.497 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.497 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:37.497 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:37.497 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:37.498 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:37.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.498 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:37.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:37.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:37.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:37.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:37.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:37.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:37.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:37.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:37.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:37.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:37.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:37.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:37.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:37.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:37.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:37.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.503 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.503 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:37.503 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:37.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.503 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.503 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:37.503 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:37.503 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 74.694528806999998, 2023-10-08T07:06:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:37.504 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:37.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:37.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:37.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:37.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:37.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:37.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:37.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:37.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:37.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:37.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:37.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:37.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:37.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:37.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:37.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:37.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:37.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.510 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:37.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:37.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.510 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:37.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:37.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.510 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:37.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:37.511 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.511 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.511 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.511 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.511 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.511 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:37.511 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.149324980000003, 2023-10-08T07:06:37.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013470380000000001, 2023-10-08T07:06:37.511 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.511 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.512 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:37.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317116+0000", 2023-10-08T07:06:37.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317118+0000", 2023-10-08T07:06:37.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0870000000000001e-06 2023-10-08T07:06:37.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317144+0000", 2023-10-08T07:06:37.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5865999999999999e-05 2023-10-08T07:06:37.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317170+0000", 2023-10-08T07:06:37.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5987e-05 2023-10-08T07:06:37.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:37.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1343000000000001e-05 2023-10-08T07:06:37.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317366+0000", 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016496800000000001 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317373+0000", 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9070000000000001e-06 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320146+0000", 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027723499999999998 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.516 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.516 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320264+0000", 2023-10-08T07:06:37.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011849399999999999 2023-10-08T07:06:37.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.516 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.516 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320389+0000", 2023-10-08T07:06:37.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012505799999999999 2023-10-08T07:06:37.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.516 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326417+0000", 2023-10-08T07:06:37.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060276569999999996 2023-10-08T07:06:37.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.517 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330490+0000", 2023-10-08T07:06:37.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040727869999999996 2023-10-08T07:06:37.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.517 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330533+0000", 2023-10-08T07:06:37.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3387000000000003e-05 2023-10-08T07:06:37.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330587+0000", 2023-10-08T07:06:37.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:37.518 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.518 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.518 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.518 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.519 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:37.519 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.149208501999993, 2023-10-08T07:06:37.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:37.519 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.519 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.519 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:37.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:37.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:37.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:37.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:37.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:37.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:37.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:37.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:37.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:37.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:37.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:37.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:37.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:37.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:37.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:37.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:37.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:37.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:37.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:37.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:37.525 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.149158174999997, 2023-10-08T07:06:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.530 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:37.530 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:37.530 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:37.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.530 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.530 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:37.530 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:37.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.530 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.530 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:37.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:37.533 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.533 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.533 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.533 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.533 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.533 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:37.533 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.148832330000005, 2023-10-08T07:06:37.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:37.533 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.534 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.534 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.534 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.534 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.534 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:37.534 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.534 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.534 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.534 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:37.534 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.535 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:37.535 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:37.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.535 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:37.535 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:37.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:37.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:37.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.536 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:37.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:37.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.536 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:37.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:37.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.537 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:37.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:37.537 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:37.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.537 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:37.538 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:37.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.538 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.538 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.538 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:37.538 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:37.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.538 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.538 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.539 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:37.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:37.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.539 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.539 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.539 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:37.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:37.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:37.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:37.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:37.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:37.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.541 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.541 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.541 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:37.541 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:37.541 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.541 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.541 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.542 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.542 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:37.542 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.148779805000004, 2023-10-08T07:06:37.542 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:37.542 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.542 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.542 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.543 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.543 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:37.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.543 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.543 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:37.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:37.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:37.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:37.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:37.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.545 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:37.545 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:37.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.545 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.545 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.545 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:37.545 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:37.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.545 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.545 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.545 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:37.545 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:37.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.546 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.546 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.546 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:37.546 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:37.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.546 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.546 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.546 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:37.546 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:37.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.547 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.547 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:37.547 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:37.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.547 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.547 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:37.547 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:37.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.547 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:37.548 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:37.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.548 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:37.548 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:37.548 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.548 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.548 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.549 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.549 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:37.549 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.148611829999993, 2023-10-08T07:06:37.549 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:37.549 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.549 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.549 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.549 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.549 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:37.549 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.550 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.550 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.550 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:37.550 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.550 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.550 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.550 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:37.550 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:37.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.551 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.551 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.551 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:37.551 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:37.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.551 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.551 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.551 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:37.551 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:37.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.552 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.552 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.552 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:37.552 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:37.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.552 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.552 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.552 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:37.552 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:37.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.553 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:37.553 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:37.553 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:37.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.553 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.553 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:37.553 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:37.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.553 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:37.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.555 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.555 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.555 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:37.555 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:37.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.555 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.555 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.555 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:37.555 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:37.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.557 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.557 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:37.557 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:37.557 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.557 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.557 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.557 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.557 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:37.558 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.148467531999998, 2023-10-08T07:06:37.558 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:37.558 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.558 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.558 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.558 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.558 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.558 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:37.558 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.559 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.559 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.559 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:37.559 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.559 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.559 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.559 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:37.559 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:37.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.560 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:37.561 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:37.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.561 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.561 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.561 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:37.561 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:37.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.561 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.561 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:37.561 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:37.561 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:37.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.562 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.562 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.562 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:37.562 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:37.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.562 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.562 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.562 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:37.562 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:37.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.563 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.563 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:37.563 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:37.563 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:37.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.563 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.563 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.563 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:37.563 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:37.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.563 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.563 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.564 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:37.564 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:37.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.564 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.564 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.564 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:37.564 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:37.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.564 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.564 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.564 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:37.565 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:37.565 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.565 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.565 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.565 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.565 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.565 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:37.565 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.147788019999993, 2023-10-08T07:06:37.565 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:37.565 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:37.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.568 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.568 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.568 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:37.568 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:37.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.568 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.568 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.568 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:37.568 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:37.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.570 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:37.570 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:37.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.570 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.570 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.570 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:37.570 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:37.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.570 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.570 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.570 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:37.571 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:37.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.571 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.571 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.571 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:37.571 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:37.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.571 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.571 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.571 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:37.571 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:37.571 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.572 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.572 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.572 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.572 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.572 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.572 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:37.572 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.147734749999998, 2023-10-08T07:06:37.572 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:37.572 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.572 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.572 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.573 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.573 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.573 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:37.573 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.573 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.573 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.573 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:37.573 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.574 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.574 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.574 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:37.574 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:37.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.574 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.574 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.574 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:37.574 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:37.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.574 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.575 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.575 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:37.575 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:37.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.575 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.575 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.575 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:37.575 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:37.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.575 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.575 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.575 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:37.576 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:37.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.576 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.576 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.576 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:37.576 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:37.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.576 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.576 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.576 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:37.576 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:37.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.577 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.577 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.577 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:37.577 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:37.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.577 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.577 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.577 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:37.577 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:37.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.577 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.577 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.578 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:37.578 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:37.578 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.578 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.578 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.578 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:37.578 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:37.578 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.578 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.578 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.578 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.578 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.579 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.579 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:37.579 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.147698903999995, 2023-10-08T07:06:37.579 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:37.579 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.579 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.579 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.579 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.579 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.579 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:37.579 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.580 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.580 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.580 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:37.580 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.580 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.580 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.580 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:37.580 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:37.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.581 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.581 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.581 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:37.581 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:37.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.581 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.581 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.581 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:37.581 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:37.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.581 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.581 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.582 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:37.582 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:37.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.582 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.582 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.582 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:37.582 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:37.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.582 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.582 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.582 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:37.582 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:37.583 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.583 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.583 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.583 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:37.583 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:37.583 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.583 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.583 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.583 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:37.583 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:37.583 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.583 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.584 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.584 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:37.584 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:37.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.584 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.584 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.584 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:37.584 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:37.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.584 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.585 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.585 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:37.585 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:37.585 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.585 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.585 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.585 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.585 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.585 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:37.585 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.147558372999995, 2023-10-08T07:06:37.586 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:37.586 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.586 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.586 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.586 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.586 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.586 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:37.586 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.586 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.586 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.586 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:37.587 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.587 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.587 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.587 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:37.587 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:37.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.587 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.587 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.587 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:37.587 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:37.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.588 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.588 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.588 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:37.588 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:37.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.588 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.588 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.588 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:37.588 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:37.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.588 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.589 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.589 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:37.589 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:37.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.589 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.589 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:37.589 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:37.589 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:37.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.589 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.590 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:37.591 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:37.591 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:37.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.591 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.591 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.591 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:37.591 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:37.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.591 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.591 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.592 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:37.592 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:37.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.592 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.592 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.592 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:37.592 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:37.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.592 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.592 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.592 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:37.593 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:37.593 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.593 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.593 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.593 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.593 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.593 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.593 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:37.593 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.147266049999999, 2023-10-08T07:06:37.593 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:37.594 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.594 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.594 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.594 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.594 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.594 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:37.594 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.594 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.594 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.594 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:37.594 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.595 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.595 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.595 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:37.595 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:37.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.595 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.595 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.595 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:37.595 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:37.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.595 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.596 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:37.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.599 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.600 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.600 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.600 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:37.600 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.147152407999997, 2023-10-08T07:06:37.600 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:37.600 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.600 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:37.600 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.600 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.600 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.600 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:37.601 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.601 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.601 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:37.601 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.601 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.601 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:37.601 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:37.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.602 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.602 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:37.602 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:37.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.602 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.602 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:37.602 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:37.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.603 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.603 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.603 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:37.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:37.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.603 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.603 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.603 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:37.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:37.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.603 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.603 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.604 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:37.604 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:37.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.604 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:37.604 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:37.604 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:37.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.604 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:37.604 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:37.604 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:37.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.605 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.605 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:37.605 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:37.605 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:37.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.605 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.605 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:37.605 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:37.605 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:37.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.605 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.606 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.606 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:37.606 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:37.606 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.606 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.606 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.606 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.606 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:37.606 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:37.606 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 64.146122184000006, 2023-10-08T07:06:37.606 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:37.607 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.608 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:37.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:37.610 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:37.611 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:37.611 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:37.612 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:37.611+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:37.613 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:37.713 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:37.712+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:37.746 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:37.746 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:37.756 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:37.840 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:37.839+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:37.914 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:37.914+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:37.923 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:37.923 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:37.934 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:38.016 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:38.016+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:38.075 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:06:38.089 INFO:tasks.workunit.client.0.smithi017.stderr:Note: switching to '9725b08fd801c82987c737f7e6d354878f036ee8'. 2023-10-08T07:06:38.089 INFO:tasks.workunit.client.0.smithi017.stderr: 2023-10-08T07:06:38.090 INFO:tasks.workunit.client.0.smithi017.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-08T07:06:38.090 INFO:tasks.workunit.client.0.smithi017.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-08T07:06:38.090 INFO:tasks.workunit.client.0.smithi017.stderr:state without impacting any branches by switching back to a branch. 2023-10-08T07:06:38.090 INFO:tasks.workunit.client.0.smithi017.stderr: 2023-10-08T07:06:38.090 INFO:tasks.workunit.client.0.smithi017.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-08T07:06:38.090 INFO:tasks.workunit.client.0.smithi017.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-08T07:06:38.090 INFO:tasks.workunit.client.0.smithi017.stderr: 2023-10-08T07:06:38.090 INFO:tasks.workunit.client.0.smithi017.stderr: git switch -c 2023-10-08T07:06:38.090 INFO:tasks.workunit.client.0.smithi017.stderr: 2023-10-08T07:06:38.090 INFO:tasks.workunit.client.0.smithi017.stderr:Or undo this operation with: 2023-10-08T07:06:38.090 INFO:tasks.workunit.client.0.smithi017.stderr: 2023-10-08T07:06:38.091 INFO:tasks.workunit.client.0.smithi017.stderr: git switch - 2023-10-08T07:06:38.091 INFO:tasks.workunit.client.0.smithi017.stderr: 2023-10-08T07:06:38.091 INFO:tasks.workunit.client.0.smithi017.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-08T07:06:38.091 INFO:tasks.workunit.client.0.smithi017.stderr: 2023-10-08T07:06:38.091 INFO:tasks.workunit.client.0.smithi017.stderr:HEAD is now at 9725b08fd80 Merge pull request #53417 from jrchyang/fix_mclock_scheduling_slow_main 2023-10-08T07:06:38.094 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-08T07:06:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.785076367000002, 2023-10-08T07:06:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.785002582999994, 2023-10-08T07:06:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.784939406999996, 2023-10-08T07:06:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.784905061000003, 2023-10-08T07:06:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.784414835999996, 2023-10-08T07:06:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.784374259000003, 2023-10-08T07:06:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.784336690000004, 2023-10-08T07:06:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.784269249999994, 2023-10-08T07:06:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.784239608000007, 2023-10-08T07:06:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.778499046999997, 2023-10-08T07:06:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.778049706999994, 2023-10-08T07:06:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:38.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:38.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:38.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.777253817000002, 2023-10-08T07:06:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.777138465999997, 2023-10-08T07:06:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.772023899999994, 2023-10-08T07:06:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.771912908000004, 2023-10-08T07:06:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e18/16 ondisk, result = 0)", 2023-10-08T07:06:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.771488466999998, 2023-10-08T07:06:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022427499999999999, 2023-10-08T07:06:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330110+0000", 2023-10-08T07:06:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330111+0000", 2023-10-08T07:06:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:06:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330114+0000", 2023-10-08T07:06:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:06:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330120+0000", 2023-10-08T07:06:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:06:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330126+0000", 2023-10-08T07:06:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330245+0000", 2023-10-08T07:06:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011861 2023-10-08T07:06:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330250+0000", 2023-10-08T07:06:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7890000000000002e-06 2023-10-08T07:06:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330334+0000", 2023-10-08T07:06:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4746000000000005e-05 2023-10-08T07:06:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing_reply(3.b epoch 18/16 rep_tid 5 lcod 18'2)", 2023-10-08T07:06:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.771341331000002, 2023-10-08T07:06:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000201676, 2023-10-08T07:06:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330257+0000", 2023-10-08T07:06:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330258+0000", 2023-10-08T07:06:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:06:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330263+0000", 2023-10-08T07:06:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:06:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330273+0000", 2023-10-08T07:06:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0233e-05 2023-10-08T07:06:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330281+0000", 2023-10-08T07:06:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999995e-06 2023-10-08T07:06:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330341+0000", 2023-10-08T07:06:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9709e-05 2023-10-08T07:06:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330459+0000", 2023-10-08T07:06:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011796200000000001 2023-10-08T07:06:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.700043061999999, 2023-10-08T07:06:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e19/16 ondisk, result = 0)", 2023-10-08T07:06:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.698249478000001, 2023-10-08T07:06:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199662, 2023-10-08T07:06:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403349+0000", 2023-10-08T07:06:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403350+0000", 2023-10-08T07:06:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:06:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403373+0000", 2023-10-08T07:06:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3408999999999999e-05 2023-10-08T07:06:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403386+0000", 2023-10-08T07:06:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2802999999999999e-05 2023-10-08T07:06:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403395+0000", 2023-10-08T07:06:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2089999999999994e-06 2023-10-08T07:06:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403449+0000", 2023-10-08T07:06:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3609999999999997e-05 2023-10-08T07:06:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403454+0000", 2023-10-08T07:06:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:06:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403549+0000", 2023-10-08T07:06:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4438999999999995e-05 2023-10-08T07:06:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.699659808, 2023-10-08T07:06:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:38.229 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:38.230 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T07:06:38.232 INFO:tasks.workunit.client.0.smithi017.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-08T07:06:38.232 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-08T07:06:38.232 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-08T07:06:38.233 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:38.230+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:38.233 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:38.234 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-10-08T07:06:38.331 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:38.331+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:38.377 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:38.377 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:38.377 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:38.377 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:38.387 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:38.433 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:38.432+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:38.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:38.519 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:38.519 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:38.519 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:38.519 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:38.519 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:38.529 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:38.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-08T07:06:38.579 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:38.579+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:38.617 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-08T07:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:38.635 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:38.635+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:06:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:38.642 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:06:38.643 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:06:38.662 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:38.662 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:38.672 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:38.676 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-08T07:06:38.714 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-08T07:06:38.715 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-08T07:06:38.716 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-08T07:06:38.736 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:38.735+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:38.753 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-08T07:06:38.756 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:06:38.756 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-08T07:06:38.802 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:38.802 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:38.814 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:38.815 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2023-10-08T07:06:38.816 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2023-10-08T07:06:38.816 DEBUG:teuthology.orchestra.run.smithi017:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9725b08fd801c82987c737f7e6d354878f036ee8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2023-10-08T07:06:38.855 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:38.854+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:38.879 INFO:tasks.workunit.client.0.smithi017.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2023-10-08T07:06:38.898 INFO:tasks.workunit.client.0.smithi017.stderr:--2023-10-08 07:06:38-- http://download.ceph.com/qa/fsync-tester.c 2023-10-08T07:06:38.899 INFO:tasks.workunit.client.0.smithi017.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-10-08T07:06:38.935 INFO:tasks.workunit.client.0.smithi017.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-10-08T07:06:38.937 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:38.937+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:38.971 INFO:tasks.workunit.client.0.smithi017.stderr:HTTP request sent, awaiting response... 200 OK 2023-10-08T07:06:38.971 INFO:tasks.workunit.client.0.smithi017.stderr:Length: 3024 (3.0K) [application/octet-stream] 2023-10-08T07:06:38.971 INFO:tasks.workunit.client.0.smithi017.stderr:Saving to: ‘fsync-tester.c’ 2023-10-08T07:06:38.981 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:38.981 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:38.991 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:39.038 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:39.037+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:39.119 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:39.119 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:39.130 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2023-10-08T07:06:39.135 INFO:tasks.workunit.client.0.smithi017.stderr: 2023-10-08T07:06:39.135 INFO:tasks.workunit.client.0.smithi017.stderr: 0K .. 100% 491M=0s 2023-10-08T07:06:39.135 INFO:tasks.workunit.client.0.smithi017.stderr: 2023-10-08T07:06:39.135 INFO:tasks.workunit.client.0.smithi017.stderr:2023-10-08 07:06:39 (491 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2023-10-08T07:06:39.135 INFO:tasks.workunit.client.0.smithi017.stderr: 2023-10-08T07:06:39.136 INFO:tasks.workunit.client.0.smithi017.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2023-10-08T07:06:39.174 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:39.174+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:39.205 INFO:tasks.workunit.client.0.smithi017.stderr:+ ./fsync-tester 2023-10-08T07:06:39.239 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:39.239+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:39.271 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:39.271 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:39.282 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:39.366 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:39.366+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:39.441 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:39.441+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:39.456 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:39.456 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:39.467 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:39.542 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:39.541+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:39.642 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:39.642 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:39.643 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:39.642+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:39.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:39.743 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:39.742+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:39.787 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:39.787 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:39.797 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:39.843 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:39.844+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:39.944 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:39.944+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:39.967 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:39.967 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:39.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:40.045 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:40.044+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:40.106 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:40.107 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:40.117 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:40.159 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:40.157+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:40.248 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:40.247+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:40.252 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:40.252 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:40.262 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:40.348 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:40.348+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:40.394 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:40.394 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:40.404 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:40.488 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:40.488+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:40.550 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:40.550+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:40.577 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:40.577 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:40.588 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:40.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:40.651 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:40.651+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:40.718 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:40.718 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:40.730 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:40.774 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:40.773+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:40.800 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:40.822 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:40.823 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:40.823 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:06:40.823 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:40.825 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:06:40.826 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:06:40.853 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:40.853+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:40.858 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:40.859 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:40.859 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:40.859 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:40.859 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:40.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:40.954 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:40.953+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:41.040 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:41.041 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:41.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:41.041 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:41.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.041 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.041 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:41.042 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.722304051999998, 2023-10-08T07:06:41.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:41.042 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.042 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.042 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:41.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:41.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:41.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:41.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:41.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:41.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:41.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:41.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:41.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:41.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:41.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:41.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:41.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:41.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:41.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:41.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:41.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:41.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:41.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:41.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:41.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:41.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:41.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:41.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.722230268000004, 2023-10-08T07:06:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:41.048 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.049 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.049 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:41.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:41.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:41.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:41.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:41.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:41.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:41.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:41.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:41.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:41.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:41.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:41.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.722167092000007, 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.056 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:41.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.062 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.063 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:41.063 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.722132746, 2023-10-08T07:06:41.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:41.063 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.063 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.063 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:41.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:41.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:41.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:41.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:41.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:41.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:41.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:41.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:41.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:41.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:41.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:41.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:41.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:41.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:41.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:41.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:41.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:41.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:41.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:41.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:41.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:41.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:41.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:41.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:41.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.069 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.069 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.069 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:41.069 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.721642521000007, 2023-10-08T07:06:41.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:41.069 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.069 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.069 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:41.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:41.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:41.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:41.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:41.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:41.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:41.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:41.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:41.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:41.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:41.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:41.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:41.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:41.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:41.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:41.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:41.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:41.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:41.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:41.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:41.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:41.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:41.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:41.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:41.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:41.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.079 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.079 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.080 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:41.080 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.721601944, 2023-10-08T07:06:41.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:41.080 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.080 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.080 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:41.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:41.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:41.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:41.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:41.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:41.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:41.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:41.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:41.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:41.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:41.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:41.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:41.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:41.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:41.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:41.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:41.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:41.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:41.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:41.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:41.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:41.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:41.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:41.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:41.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:41.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.090 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.090 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.090 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:41.091 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.721564375, 2023-10-08T07:06:41.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:41.091 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.091 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:41.091 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:41.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:41.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:41.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:41.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:41.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:41.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:41.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:41.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:41.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:41.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:41.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:41.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:41.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:41.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:41.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:41.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.095 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.095 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.096 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:41.096 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.721496935000005, 2023-10-08T07:06:41.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:41.096 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.096 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:41.096 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:41.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:41.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:41.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:41.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:41.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:41.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:41.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:41.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:41.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:41.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:41.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:41.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:41.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.101 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.101 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.102 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:41.102 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.721467293000003, 2023-10-08T07:06:41.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062804039999999998, 2023-10-08T07:06:41.102 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.102 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:41.102 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:41.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:41.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317359+0000", 2023-10-08T07:06:41.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:06:41.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317362+0000", 2023-10-08T07:06:41.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4779999999999998e-06 2023-10-08T07:06:41.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317368+0000", 2023-10-08T07:06:41.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9259999999999997e-06 2023-10-08T07:06:41.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317372+0000", 2023-10-08T07:06:41.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4059999999999998e-06 2023-10-08T07:06:41.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317435+0000", 2023-10-08T07:06:41.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3181000000000004e-05 2023-10-08T07:06:41.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317579+0000", 2023-10-08T07:06:41.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143805 2023-10-08T07:06:41.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323639+0000", 2023-10-08T07:06:41.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060602219999999997 2023-10-08T07:06:41.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.108 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.108 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-10-08T07:06:41.108 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:41.109 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.715726731999993, 2023-10-08T07:06:41.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003389109, 2023-10-08T07:06:41.109 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.109 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:41.109 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:41.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:41.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323100+0000", 2023-10-08T07:06:41.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:06:41.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323109+0000", 2023-10-08T07:06:41.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:06:41.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323123+0000", 2023-10-08T07:06:41.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4062e-05 2023-10-08T07:06:41.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323144+0000", 2023-10-08T07:06:41.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0673e-05 2023-10-08T07:06:41.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323215+0000", 2023-10-08T07:06:41.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0695e-05 2023-10-08T07:06:41.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.326489+0000", 2023-10-08T07:06:41.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032741939999999998 2023-10-08T07:06:41.114 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.114 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.114 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.114 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2023-10-08T07:06:41.114 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:41.114 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.715277392000004, 2023-10-08T07:06:41.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024422700000000002, 2023-10-08T07:06:41.115 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.115 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:41.115 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:41.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:41.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323549+0000", 2023-10-08T07:06:41.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2100000000000001e-07 2023-10-08T07:06:41.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323551+0000", 2023-10-08T07:06:41.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1720000000000001e-06 2023-10-08T07:06:41.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323558+0000", 2023-10-08T07:06:41.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2023-10-08T07:06:41.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323564+0000", 2023-10-08T07:06:41.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:06:41.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323714+0000", 2023-10-08T07:06:41.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150378 2023-10-08T07:06:41.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323720+0000", 2023-10-08T07:06:41.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:06:41.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323793+0000", 2023-10-08T07:06:41.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3566999999999995e-05 2023-10-08T07:06:41.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.119 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.120 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:41.120 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:41.120 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.714481501999998, 2023-10-08T07:06:41.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028944169999999998, 2023-10-08T07:06:41.120 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.120 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:41.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:41.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324345+0000", 2023-10-08T07:06:41.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:06:41.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324358+0000", 2023-10-08T07:06:41.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2680000000000001e-05 2023-10-08T07:06:41.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324363+0000", 2023-10-08T07:06:41.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5330000000000002e-06 2023-10-08T07:06:41.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324369+0000", 2023-10-08T07:06:41.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1369999999999999e-06 2023-10-08T07:06:41.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324424+0000", 2023-10-08T07:06:41.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4821999999999998e-05 2023-10-08T07:06:41.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324445+0000", 2023-10-08T07:06:41.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452e-05 2023-10-08T07:06:41.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327195+0000", 2023-10-08T07:06:41.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027503879999999999 2023-10-08T07:06:41.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327239+0000", 2023-10-08T07:06:41.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4172999999999999e-05 2023-10-08T07:06:41.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.127 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.128 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:41.128 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:41.128 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.714366150999993, 2023-10-08T07:06:41.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029520129999999999, 2023-10-08T07:06:41.128 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.128 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.129 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:41.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324460+0000", 2023-10-08T07:06:41.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324461+0000", 2023-10-08T07:06:41.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:06:41.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324471+0000", 2023-10-08T07:06:41.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.082e-05 2023-10-08T07:06:41.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324478+0000", 2023-10-08T07:06:41.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2023-10-08T07:06:41.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324485+0000", 2023-10-08T07:06:41.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:06:41.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324789+0000", 2023-10-08T07:06:41.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030359799999999998 2023-10-08T07:06:41.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.324807+0000", 2023-10-08T07:06:41.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.872e-05 2023-10-08T07:06:41.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327373+0000", 2023-10-08T07:06:41.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025653759999999999 2023-10-08T07:06:41.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.327412+0000", 2023-10-08T07:06:41.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9403000000000002e-05 2023-10-08T07:06:41.136 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.137 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.137 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-10-08T07:06:41.137 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:41.138 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.709251585000004, 2023-10-08T07:06:41.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086384799999999996, 2023-10-08T07:06:41.138 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.138 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.138 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:41.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:41.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329575+0000", 2023-10-08T07:06:41.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:06:41.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329580+0000", 2023-10-08T07:06:41.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9749999999999998e-06 2023-10-08T07:06:41.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329588+0000", 2023-10-08T07:06:41.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5619999999999998e-06 2023-10-08T07:06:41.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329596+0000", 2023-10-08T07:06:41.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2023-10-08T07:06:41.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329645+0000", 2023-10-08T07:06:41.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8392e-05 2023-10-08T07:06:41.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329665+0000", 2023-10-08T07:06:41.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:06:41.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330402+0000", 2023-10-08T07:06:41.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073670099999999998 2023-10-08T07:06:41.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330439+0000", 2023-10-08T07:06:41.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6659000000000003e-05 2023-10-08T07:06:41.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.145 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.146 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(mds.0.3:32 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-10-08T07:06:41.146 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:41.146 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.709140593000001, 2023-10-08T07:06:41.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032864750000000001, 2023-10-08T07:06:41.146 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.146 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329686+0000", 2023-10-08T07:06:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:06:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329690+0000", 2023-10-08T07:06:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9910000000000004e-06 2023-10-08T07:06:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329696+0000", 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6080000000000003e-06 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329702+0000", 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329901+0000", 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199192 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.329922+0000", 2023-10-08T07:06:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:06:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332929+0000", 2023-10-08T07:06:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030069609999999998 2023-10-08T07:06:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.332972+0000", 2023-10-08T07:06:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2879000000000001e-05 2023-10-08T07:06:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-10-08T07:06:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.637270747000002, 2023-10-08T07:06:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019856069999999999, 2023-10-08T07:06:41.152 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.152 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.152 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:41.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401556+0000", 2023-10-08T07:06:41.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401559+0000", 2023-10-08T07:06:41.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0139999999999999e-06 2023-10-08T07:06:41.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401571+0000", 2023-10-08T07:06:41.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2506e-05 2023-10-08T07:06:41.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401607+0000", 2023-10-08T07:06:41.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6335999999999999e-05 2023-10-08T07:06:41.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401625+0000", 2023-10-08T07:06:41.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7087000000000001e-05 2023-10-08T07:06:41.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401744+0000", 2023-10-08T07:06:41.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011963099999999999 2023-10-08T07:06:41.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.401922+0000", 2023-10-08T07:06:41.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017815499999999999 2023-10-08T07:06:41.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:41.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402022+0000", 2023-10-08T07:06:41.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9514999999999998e-05 2023-10-08T07:06:41.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:41.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.402788+0000", 2023-10-08T07:06:41.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076640400000000004 2023-10-08T07:06:41.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403458+0000", 2023-10-08T07:06:41.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066954000000000004 2023-10-08T07:06:41.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403496+0000", 2023-10-08T07:06:41.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8098e-05 2023-10-08T07:06:41.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:37.403541+0000", 2023-10-08T07:06:41.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5321000000000002e-05 2023-10-08T07:06:41.162 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.162 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.163 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-10-08T07:06:41.163 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:41.164 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.636887493000003, 2023-10-08T07:06:41.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00183942, 2023-10-08T07:06:41.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.164 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:41.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401939+0000", 2023-10-08T07:06:41.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401942+0000", 2023-10-08T07:06:41.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1410000000000001e-06 2023-10-08T07:06:41.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401956+0000", 2023-10-08T07:06:41.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3988999999999999e-05 2023-10-08T07:06:41.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.401985+0000", 2023-10-08T07:06:41.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8873e-05 2023-10-08T07:06:41.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402031+0000", 2023-10-08T07:06:41.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5813000000000003e-05 2023-10-08T07:06:41.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402107+0000", 2023-10-08T07:06:41.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6663999999999996e-05 2023-10-08T07:06:41.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402182+0000", 2023-10-08T07:06:41.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4319000000000005e-05 2023-10-08T07:06:41.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:41.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402283+0000", 2023-10-08T07:06:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100945 2023-10-08T07:06:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.402888+0000", 2023-10-08T07:06:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060541399999999997 2023-10-08T07:06:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403716+0000", 2023-10-08T07:06:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082755399999999998 2023-10-08T07:06:41.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403753+0000", 2023-10-08T07:06:41.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7051000000000002e-05 2023-10-08T07:06:41.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:57.403778+0000", 2023-10-08T07:06:41.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5656999999999998e-05 2023-10-08T07:06:41.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.170 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.171 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:24 4.20 e38/17 4:07572838:::10000000004.00000010:head v 38'2, mlcod=0'0)", 2023-10-08T07:06:41.171 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:40.821393+0000", 2023-10-08T07:06:41.171 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.217433713, 2023-10-08T07:06:41.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092808390000000008, 2023-10-08T07:06:41.171 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.171 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.171 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.821393+0000", 2023-10-08T07:06:41.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.821393+0000", 2023-10-08T07:06:41.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.821394+0000", 2023-10-08T07:06:41.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9199999999999999e-07 2023-10-08T07:06:41.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.825196+0000", 2023-10-08T07:06:41.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038026900000000001 2023-10-08T07:06:41.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.825209+0000", 2023-10-08T07:06:41.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2323999999999999e-05 2023-10-08T07:06:41.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.825219+0000", 2023-10-08T07:06:41.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0434e-05 2023-10-08T07:06:41.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.825277+0000", 2023-10-08T07:06:41.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8010999999999997e-05 2023-10-08T07:06:41.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.825309+0000", 2023-10-08T07:06:41.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1900999999999998e-05 2023-10-08T07:06:41.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.830602+0000", 2023-10-08T07:06:41.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052926969999999999 2023-10-08T07:06:41.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.830673+0000", 2023-10-08T07:06:41.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1790000000000002e-05 2023-10-08T07:06:41.176 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.177 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.177 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.177 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:25 4.c e38/17 4:31e28161:::10000000004.00000011:head v 38'1, mlcod=0'0)", 2023-10-08T07:06:41.177 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:40.915856+0000", 2023-10-08T07:06:41.177 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.122970783, 2023-10-08T07:06:41.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010431197, 2023-10-08T07:06:41.178 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.178 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.178 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.915856+0000", 2023-10-08T07:06:41.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.915856+0000", 2023-10-08T07:06:41.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.915858+0000", 2023-10-08T07:06:41.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0190000000000001e-06 2023-10-08T07:06:41.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919710+0000", 2023-10-08T07:06:41.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038523189999999999 2023-10-08T07:06:41.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919731+0000", 2023-10-08T07:06:41.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0849e-05 2023-10-08T07:06:41.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919744+0000", 2023-10-08T07:06:41.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3399e-05 2023-10-08T07:06:41.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919817+0000", 2023-10-08T07:06:41.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3258999999999998e-05 2023-10-08T07:06:41.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919838+0000", 2023-10-08T07:06:41.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0256999999999999e-05 2023-10-08T07:06:41.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.926222+0000", 2023-10-08T07:06:41.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063838560000000003 2023-10-08T07:06:41.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.926287+0000", 2023-10-08T07:06:41.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5239000000000003e-05 2023-10-08T07:06:41.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.185 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:26 4.c e38/17 4:3352c333:::10000000004.00000012:head v 38'2, mlcod=0'0)", 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.003888+0000", 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.034938607000000003, 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010663526, 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.003888+0000", 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:41.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.003888+0000", 2023-10-08T07:06:41.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:41.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:41.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.003890+0000", 2023-10-08T07:06:41.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0020000000000001e-06 2023-10-08T07:06:41.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:41.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.007840+0000", 2023-10-08T07:06:41.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039502490000000003 2023-10-08T07:06:41.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:41.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.007877+0000", 2023-10-08T07:06:41.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7462999999999997e-05 2023-10-08T07:06:41.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.007906+0000", 2023-10-08T07:06:41.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8507999999999999e-05 2023-10-08T07:06:41.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:41.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.007978+0000", 2023-10-08T07:06:41.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1923999999999998e-05 2023-10-08T07:06:41.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:41.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.008006+0000", 2023-10-08T07:06:41.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7674e-05 2023-10-08T07:06:41.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:41.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.014488+0000", 2023-10-08T07:06:41.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0064825999999999998 2023-10-08T07:06:41.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:41.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:41.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:41.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.014551+0000", 2023-10-08T07:06:41.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3106000000000002e-05 2023-10-08T07:06:41.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:41.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:41.191 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:41.191 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:41.075+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:41.191 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:41.192 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T07:06:41.193 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:41.192+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:41.294 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:41.294+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:41.329 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:41.329 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:41.339 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:41.394 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:41.393+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:41.496 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:41.494+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:41.511 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:41.511 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:41.511 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:41.511 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:41.512 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:41.522 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:41.596 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:41.596+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:41.658 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 78.882164153000005, 2023-10-08T07:06:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.663 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:41.663 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:41.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.663 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.663 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.663 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:41.663 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 78.882112101000004, 2023-10-08T07:06:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.336791796, 2023-10-08T07:06:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013623718, 2023-10-08T07:06:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317233+0000", 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317234+0000", 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3790000000000001e-06 2023-10-08T07:06:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317240+0000", 2023-10-08T07:06:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0990000000000004e-06 2023-10-08T07:06:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317253+0000", 2023-10-08T07:06:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:06:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000007e-06 2023-10-08T07:06:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317651+0000", 2023-10-08T07:06:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00038917200000000002 2023-10-08T07:06:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317656+0000", 2023-10-08T07:06:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-06 2023-10-08T07:06:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321457+0000", 2023-10-08T07:06:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038005600000000001 2023-10-08T07:06:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.321554+0000", 2023-10-08T07:06:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6832999999999999e-05 2023-10-08T07:06:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.322239+0000", 2023-10-08T07:06:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00068569300000000002 2023-10-08T07:06:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330656+0000", 2023-10-08T07:06:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084170019999999998 2023-10-08T07:06:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330728+0000", 2023-10-08T07:06:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1240000000000002e-05 2023-10-08T07:06:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330805+0000", 2023-10-08T07:06:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7063000000000004e-05 2023-10-08T07:06:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330856+0000", 2023-10-08T07:06:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1654999999999999e-05 2023-10-08T07:06:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.336741469000003, 2023-10-08T07:06:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.336415623999997, 2023-10-08T07:06:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.336363098999996, 2023-10-08T07:06:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:13 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.336195124, 2023-10-08T07:06:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013500936999999999, 2023-10-08T07:06:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:41.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317829+0000", 2023-10-08T07:06:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317830+0000", 2023-10-08T07:06:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:06:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317835+0000", 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0479999999999998e-06 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317849+0000", 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3981e-05 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317861+0000", 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418e-05 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318436+0000", 2023-10-08T07:06:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057457799999999996 2023-10-08T07:06:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318443+0000", 2023-10-08T07:06:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:06:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320273+0000", 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018293739999999999 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320456+0000", 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018320899999999999 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320611+0000", 2023-10-08T07:06:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155241 2023-10-08T07:06:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326452+0000", 2023-10-08T07:06:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058414119999999998 2023-10-08T07:06:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331229+0000", 2023-10-08T07:06:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047770369999999996 2023-10-08T07:06:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331288+0000", 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8029999999999998e-05 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331330+0000", 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2701000000000003e-05 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.336050826000005, 2023-10-08T07:06:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.335371314, 2023-10-08T07:06:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:41.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:41.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:41.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:41.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:41.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:41.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:41.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:41.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:41.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:41.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:41.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:41.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:41.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:41.736 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.737 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.737 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.737 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.737 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:41.737 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.335318044000005, 2023-10-08T07:06:41.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:41.737 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.737 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.737 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:41.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:41.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:41.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:41.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:41.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:41.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:41.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:41.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:41.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:41.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:41.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:41.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:41.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:41.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:41.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:41.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.744 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.744 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:41.744 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.335282198000002, 2023-10-08T07:06:41.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:41.744 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.744 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.744 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:41.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:41.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:41.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:41.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:41.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:41.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:41.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:41.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:41.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:41.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:41.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:41.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:41.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:41.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:41.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:41.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:41.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:41.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:41.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:41.749 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.749 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.750 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.750 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:32 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.750 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:41.750 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.335141667000002, 2023-10-08T07:06:41.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014290614, 2023-10-08T07:06:41.750 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.750 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.750 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:41.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318883+0000", 2023-10-08T07:06:41.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318884+0000", 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.78e-07 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318890+0000", 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.302e-06 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318905+0000", 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4609e-05 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318914+0000", 2023-10-08T07:06:41.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1260000000000004e-06 2023-10-08T07:06:41.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319116+0000", 2023-10-08T07:06:41.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020248799999999999 2023-10-08T07:06:41.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:41.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319119+0000", 2023-10-08T07:06:41.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1250000000000001e-06 2023-10-08T07:06:41.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329166+0000", 2023-10-08T07:06:41.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010047135 2023-10-08T07:06:41.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329259+0000", 2023-10-08T07:06:41.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2656000000000002e-05 2023-10-08T07:06:41.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:41.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329401+0000", 2023-10-08T07:06:41.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:06:41.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332717+0000", 2023-10-08T07:06:41.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033163820000000001 2023-10-08T07:06:41.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333102+0000", 2023-10-08T07:06:41.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000385022 2023-10-08T07:06:41.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333140+0000", 2023-10-08T07:06:41.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8092000000000001e-05 2023-10-08T07:06:41.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333173+0000", 2023-10-08T07:06:41.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3189999999999999e-05 2023-10-08T07:06:41.757 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.757 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.757 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.758 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.758 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:41.758 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.334849344000006, 2023-10-08T07:06:41.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:41.758 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.758 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.758 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:41.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:41.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:41.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:41.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:41.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:41.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:41.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:41.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:41.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:41.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:41.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:41.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:41.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:41.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:41.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:41.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:41.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:41.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:41.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:41.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:41.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:41.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:41.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:41.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.764 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.764 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.764 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:41.764 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.334735702000003, 2023-10-08T07:06:41.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:41.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:41.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:41.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:41.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:41.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:41.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:41.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:41.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:41.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:41.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:41.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:41.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:41.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:41.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:41.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:41.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:41.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:41.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:41.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:41.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:41.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:41.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:41.771 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.771 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.771 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.771 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:41.771 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:41.771 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 68.333705477999999, 2023-10-08T07:06:41.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:41.771 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.771 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:41.772 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:41.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:41.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:41.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:41.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:41.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:41.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:41.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:41.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:41.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:41.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:41.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:41.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:41.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:41.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:41.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:41.776 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.776 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.776 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.776 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:24 4.20 4:07572838:::10000000004.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:41.776 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.816540+0000", 2023-10-08T07:06:41.776 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.83748420899999998, 2023-10-08T07:06:41.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014454027, 2023-10-08T07:06:41.776 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.777 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.777 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:41.777 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:41.777 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:41.777 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 24 2023-10-08T07:06:41.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.777 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.816540+0000", 2023-10-08T07:06:41.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.816540+0000", 2023-10-08T07:06:41.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.816541+0000", 2023-10-08T07:06:41.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7400000000000002e-07 2023-10-08T07:06:41.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.820783+0000", 2023-10-08T07:06:41.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042420399999999999 2023-10-08T07:06:41.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.820798+0000", 2023-10-08T07:06:41.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5302999999999999e-05 2023-10-08T07:06:41.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.820808+0000", 2023-10-08T07:06:41.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2699999999999993e-06 2023-10-08T07:06:41.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.820888+0000", 2023-10-08T07:06:41.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0107999999999999e-05 2023-10-08T07:06:41.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.821062+0000", 2023-10-08T07:06:41.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017391999999999999 2023-10-08T07:06:41.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:41.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.821239+0000", 2023-10-08T07:06:41.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000177734 2023-10-08T07:06:41.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.827675+0000", 2023-10-08T07:06:41.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0064351649999999996 2023-10-08T07:06:41.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.830877+0000", 2023-10-08T07:06:41.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032024649999999998 2023-10-08T07:06:41.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.830945+0000", 2023-10-08T07:06:41.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7627999999999997e-05 2023-10-08T07:06:41.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.830994+0000", 2023-10-08T07:06:41.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.952e-05 2023-10-08T07:06:41.783 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.783 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.783 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.783 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:25 4.c 4:31e28161:::10000000004.00000011:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:41.783 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.911542+0000", 2023-10-08T07:06:41.783 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.74248195500000003, 2023-10-08T07:06:41.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015283365, 2023-10-08T07:06:41.784 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.784 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.784 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:41.784 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:41.784 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:41.784 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 25 2023-10-08T07:06:41.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.784 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.911542+0000", 2023-10-08T07:06:41.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.911542+0000", 2023-10-08T07:06:41.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.911544+0000", 2023-10-08T07:06:41.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1370000000000001e-06 2023-10-08T07:06:41.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915273+0000", 2023-10-08T07:06:41.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003729539 2023-10-08T07:06:41.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915287+0000", 2023-10-08T07:06:41.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4058e-05 2023-10-08T07:06:41.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915295+0000", 2023-10-08T07:06:41.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.79e-06 2023-10-08T07:06:41.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915361+0000", 2023-10-08T07:06:41.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6490999999999997e-05 2023-10-08T07:06:41.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915528+0000", 2023-10-08T07:06:41.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016655399999999999 2023-10-08T07:06:41.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:41.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915686+0000", 2023-10-08T07:06:41.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015756099999999999 2023-10-08T07:06:41.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.921741+0000", 2023-10-08T07:06:41.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060556569999999999 2023-10-08T07:06:41.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.926711+0000", 2023-10-08T07:06:41.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0049696719999999996 2023-10-08T07:06:41.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.926779+0000", 2023-10-08T07:06:41.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8079999999999999e-05 2023-10-08T07:06:41.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.926826+0000", 2023-10-08T07:06:41.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6826000000000002e-05 2023-10-08T07:06:41.790 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.790 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.790 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.790 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:26 4.c 4:3352c333:::10000000004.00000012:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:41.791 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:41.791 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.65461607200000005, 2023-10-08T07:06:41.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015456749000000001, 2023-10-08T07:06:41.791 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.791 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.792 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:41.793 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:41.793 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:41.793 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 26 2023-10-08T07:06:41.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.793 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:41.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:41.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999409+0000", 2023-10-08T07:06:41.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1570000000000001e-06 2023-10-08T07:06:41.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003237+0000", 2023-10-08T07:06:41.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003827619 2023-10-08T07:06:41.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003252+0000", 2023-10-08T07:06:41.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5068999999999999e-05 2023-10-08T07:06:41.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003259+0000", 2023-10-08T07:06:41.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1910000000000003e-06 2023-10-08T07:06:41.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003330+0000", 2023-10-08T07:06:41.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0469999999999994e-05 2023-10-08T07:06:41.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003504+0000", 2023-10-08T07:06:41.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017425700000000001 2023-10-08T07:06:41.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:41.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003675+0000", 2023-10-08T07:06:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000171137 2023-10-08T07:06:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.010247+0000", 2023-10-08T07:06:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065716569999999998 2023-10-08T07:06:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014747+0000", 2023-10-08T07:06:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045002740000000003 2023-10-08T07:06:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014820+0000", 2023-10-08T07:06:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3310000000000001e-05 2023-10-08T07:06:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014865+0000", 2023-10-08T07:06:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4607999999999997e-05 2023-10-08T07:06:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:28 4.30 4:0f322a22:::10000000004.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.48266004699999998, 2023-10-08T07:06:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015624149, 2023-10-08T07:06:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 28 2023-10-08T07:06:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171372+0000", 2023-10-08T07:06:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8220000000000007e-06 2023-10-08T07:06:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175253+0000", 2023-10-08T07:06:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038812529999999999 2023-10-08T07:06:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175268+0000", 2023-10-08T07:06:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4782e-05 2023-10-08T07:06:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175275+0000", 2023-10-08T07:06:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0899999999999999e-06 2023-10-08T07:06:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175345+0000", 2023-10-08T07:06:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9604000000000006e-05 2023-10-08T07:06:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175502+0000", 2023-10-08T07:06:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015699799999999999 2023-10-08T07:06:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175652+0000", 2023-10-08T07:06:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014977100000000001 2023-10-08T07:06:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.182743+0000", 2023-10-08T07:06:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070913800000000004 2023-10-08T07:06:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186876+0000", 2023-10-08T07:06:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041328670000000001 2023-10-08T07:06:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186941+0000", 2023-10-08T07:06:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5506999999999995e-05 2023-10-08T07:06:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186989+0000", 2023-10-08T07:06:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7074999999999999e-05 2023-10-08T07:06:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:30 4.20 4:05b3915c:::10000000004.00000016:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:41.810 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.365783+0000", 2023-10-08T07:06:41.810 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.28824132499999999, 2023-10-08T07:06:41.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015199433, 2023-10-08T07:06:41.810 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:41.810 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:41.810 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:41.810 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 30 2023-10-08T07:06:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.365783+0000", 2023-10-08T07:06:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.365783+0000", 2023-10-08T07:06:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.365785+0000", 2023-10-08T07:06:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9939999999999999e-06 2023-10-08T07:06:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.369461+0000", 2023-10-08T07:06:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0036757949999999999 2023-10-08T07:06:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.369480+0000", 2023-10-08T07:06:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9128999999999999e-05 2023-10-08T07:06:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.369491+0000", 2023-10-08T07:06:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.128e-05 2023-10-08T07:06:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.369575+0000", 2023-10-08T07:06:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4140000000000004e-05 2023-10-08T07:06:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.369755+0000", 2023-10-08T07:06:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0001794 2023-10-08T07:06:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.369929+0000", 2023-10-08T07:06:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017398500000000001 2023-10-08T07:06:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.376551+0000", 2023-10-08T07:06:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0066225169999999996 2023-10-08T07:06:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.380868+0000", 2023-10-08T07:06:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004316243 2023-10-08T07:06:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.380939+0000", 2023-10-08T07:06:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1904999999999997e-05 2023-10-08T07:06:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.380983+0000", 2023-10-08T07:06:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3044999999999999e-05 2023-10-08T07:06:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:41.817 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:41.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:41.820 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:41.819+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:41.920 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:41.920+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:41.950 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:41.951 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:41.961 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:42.020 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:42.020+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:42.090 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:42.090 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:42.101 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:42.132 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2023-10-08T07:06:42.145 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:42.144+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:42.222 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:42.221+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:42.234 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.916341438000003, 2023-10-08T07:06:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.916267653999995, 2023-10-08T07:06:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.916204477999997, 2023-10-08T07:06:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070250529999999999, 2023-10-08T07:06:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316659+0000", 2023-10-08T07:06:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316660+0000", 2023-10-08T07:06:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:06:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316665+0000", 2023-10-08T07:06:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:06:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316674+0000", 2023-10-08T07:06:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0939999999999997e-06 2023-10-08T07:06:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316682+0000", 2023-10-08T07:06:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1629999999999996e-06 2023-10-08T07:06:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317799+0000", 2023-10-08T07:06:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117236 2023-10-08T07:06:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318257+0000", 2023-10-08T07:06:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045824100000000002 2023-10-08T07:06:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318405+0000", 2023-10-08T07:06:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757400000000001 2023-10-08T07:06:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319746+0000", 2023-10-08T07:06:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001340752 2023-10-08T07:06:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323571+0000", 2023-10-08T07:06:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038254740000000001 2023-10-08T07:06:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323638+0000", 2023-10-08T07:06:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7305999999999996e-05 2023-10-08T07:06:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323684+0000", 2023-10-08T07:06:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5862999999999998e-05 2023-10-08T07:06:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.916170132000005, 2023-10-08T07:06:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070919700000000004, 2023-10-08T07:06:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316694+0000", 2023-10-08T07:06:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316701+0000", 2023-10-08T07:06:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0550000000000002e-06 2023-10-08T07:06:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316716+0000", 2023-10-08T07:06:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4499e-05 2023-10-08T07:06:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316723+0000", 2023-10-08T07:06:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8419999999999999e-06 2023-10-08T07:06:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318717+0000", 2023-10-08T07:06:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019944089999999999 2023-10-08T07:06:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318770+0000", 2023-10-08T07:06:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2704999999999998e-05 2023-10-08T07:06:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318859+0000", 2023-10-08T07:06:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9438000000000007e-05 2023-10-08T07:06:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319816+0000", 2023-10-08T07:06:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095712900000000003 2023-10-08T07:06:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323724+0000", 2023-10-08T07:06:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039073199999999997 2023-10-08T07:06:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323761+0000", 2023-10-08T07:06:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7775999999999999e-05 2023-10-08T07:06:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.323786+0000", 2023-10-08T07:06:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4244999999999999e-05 2023-10-08T07:06:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.915679906999998, 2023-10-08T07:06:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.915639330000005, 2023-10-08T07:06:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.915601761000005, 2023-10-08T07:06:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.915534320999996, 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:24 4.20 e38/17 4:07572838:::10000000004.00000010:head v 38'2, mlcod=0'0)", 2023-10-08T07:06:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:40.821393+0000", 2023-10-08T07:06:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.4114710989999999, 2023-10-08T07:06:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092808390000000008, 2023-10-08T07:06:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.821393+0000", 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.821393+0000", 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.821394+0000", 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9199999999999999e-07 2023-10-08T07:06:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.825196+0000", 2023-10-08T07:06:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038026900000000001 2023-10-08T07:06:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.825209+0000", 2023-10-08T07:06:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2323999999999999e-05 2023-10-08T07:06:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.825219+0000", 2023-10-08T07:06:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0434e-05 2023-10-08T07:06:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.825277+0000", 2023-10-08T07:06:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8010999999999997e-05 2023-10-08T07:06:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.825309+0000", 2023-10-08T07:06:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1900999999999998e-05 2023-10-08T07:06:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.830602+0000", 2023-10-08T07:06:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052926969999999999 2023-10-08T07:06:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.830673+0000", 2023-10-08T07:06:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1790000000000002e-05 2023-10-08T07:06:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:25 4.c e38/17 4:31e28161:::10000000004.00000011:head v 38'1, mlcod=0'0)", 2023-10-08T07:06:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:40.915856+0000", 2023-10-08T07:06:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.317008169, 2023-10-08T07:06:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010431197, 2023-10-08T07:06:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.915856+0000", 2023-10-08T07:06:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.915856+0000", 2023-10-08T07:06:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.915858+0000", 2023-10-08T07:06:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0190000000000001e-06 2023-10-08T07:06:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919710+0000", 2023-10-08T07:06:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038523189999999999 2023-10-08T07:06:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919731+0000", 2023-10-08T07:06:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0849e-05 2023-10-08T07:06:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919744+0000", 2023-10-08T07:06:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3399e-05 2023-10-08T07:06:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919817+0000", 2023-10-08T07:06:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3258999999999998e-05 2023-10-08T07:06:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919838+0000", 2023-10-08T07:06:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0256999999999999e-05 2023-10-08T07:06:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.926222+0000", 2023-10-08T07:06:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063838560000000003 2023-10-08T07:06:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.926287+0000", 2023-10-08T07:06:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5239000000000003e-05 2023-10-08T07:06:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:26 4.c e38/17 4:3352c333:::10000000004.00000012:head v 38'2, mlcod=0'0)", 2023-10-08T07:06:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.003888+0000", 2023-10-08T07:06:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2289759929999999, 2023-10-08T07:06:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010663526, 2023-10-08T07:06:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.003888+0000", 2023-10-08T07:06:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.003888+0000", 2023-10-08T07:06:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.003890+0000", 2023-10-08T07:06:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0020000000000001e-06 2023-10-08T07:06:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.007840+0000", 2023-10-08T07:06:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039502490000000003 2023-10-08T07:06:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.007877+0000", 2023-10-08T07:06:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7462999999999997e-05 2023-10-08T07:06:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.007906+0000", 2023-10-08T07:06:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8507999999999999e-05 2023-10-08T07:06:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.007978+0000", 2023-10-08T07:06:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1923999999999998e-05 2023-10-08T07:06:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.008006+0000", 2023-10-08T07:06:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7674e-05 2023-10-08T07:06:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.014488+0000", 2023-10-08T07:06:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0064825999999999998 2023-10-08T07:06:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.014551+0000", 2023-10-08T07:06:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3106000000000002e-05 2023-10-08T07:06:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:28 4.30 e38/17 4:0f322a22:::10000000004.00000014:head v 38'1, mlcod=0'0)", 2023-10-08T07:06:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.175927+0000", 2023-10-08T07:06:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0569362339999999, 2023-10-08T07:06:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010730696, 2023-10-08T07:06:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.175927+0000", 2023-10-08T07:06:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.175927+0000", 2023-10-08T07:06:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.175929+0000", 2023-10-08T07:06:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2899999999999999e-06 2023-10-08T07:06:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.180411+0000", 2023-10-08T07:06:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044823290000000002 2023-10-08T07:06:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.180428+0000", 2023-10-08T07:06:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6872e-05 2023-10-08T07:06:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.180437+0000", 2023-10-08T07:06:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9770000000000006e-06 2023-10-08T07:06:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.180519+0000", 2023-10-08T07:06:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2170999999999996e-05 2023-10-08T07:06:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.180538+0000", 2023-10-08T07:06:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9021e-05 2023-10-08T07:06:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.186616+0000", 2023-10-08T07:06:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060777540000000003 2023-10-08T07:06:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.186658+0000", 2023-10-08T07:06:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2281999999999999e-05 2023-10-08T07:06:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:29 4.10 4:0b5763e1:::10000000004.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.268620+0000", 2023-10-08T07:06:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.96424409700000002, 2023-10-08T07:06:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097273169999999992, 2023-10-08T07:06:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 29 2023-10-08T07:06:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.268620+0000", 2023-10-08T07:06:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.268620+0000", 2023-10-08T07:06:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.268622+0000", 2023-10-08T07:06:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6759999999999999e-06 2023-10-08T07:06:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.272543+0000", 2023-10-08T07:06:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039205860000000002 2023-10-08T07:06:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.272558+0000", 2023-10-08T07:06:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.52e-05 2023-10-08T07:06:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.272568+0000", 2023-10-08T07:06:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0336999999999999e-05 2023-10-08T07:06:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.272624+0000", 2023-10-08T07:06:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5986000000000002e-05 2023-10-08T07:06:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.272732+0000", 2023-10-08T07:06:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010753500000000001 2023-10-08T07:06:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.278262+0000", 2023-10-08T07:06:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055301919999999997 2023-10-08T07:06:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.278298+0000", 2023-10-08T07:06:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5602999999999998e-05 2023-10-08T07:06:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.278347+0000", 2023-10-08T07:06:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9202000000000001e-05 2023-10-08T07:06:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:30 4.20 e38/17 4:05b3915c:::10000000004.00000016:head v 38'3, mlcod=38'1)", 2023-10-08T07:06:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.370172+0000", 2023-10-08T07:06:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.86269183999999999, 2023-10-08T07:06:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010506537999999999, 2023-10-08T07:06:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.370172+0000", 2023-10-08T07:06:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.370172+0000", 2023-10-08T07:06:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.370173+0000", 2023-10-08T07:06:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2330000000000001e-06 2023-10-08T07:06:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.373977+0000", 2023-10-08T07:06:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038043270000000001 2023-10-08T07:06:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.373992+0000", 2023-10-08T07:06:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.418e-05 2023-10-08T07:06:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.374018+0000", 2023-10-08T07:06:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5933999999999999e-05 2023-10-08T07:06:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.374075+0000", 2023-10-08T07:06:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7404000000000001e-05 2023-10-08T07:06:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.374102+0000", 2023-10-08T07:06:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6911999999999999e-05 2023-10-08T07:06:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.380632+0000", 2023-10-08T07:06:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065303030000000003 2023-10-08T07:06:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.380678+0000", 2023-10-08T07:06:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6245000000000002e-05 2023-10-08T07:06:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:31 4.f 4:f2537947:::10000000004.00000017:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.457155+0000", 2023-10-08T07:06:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.77570843199999995, 2023-10-08T07:06:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010510228, 2023-10-08T07:06:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 31 2023-10-08T07:06:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.457155+0000", 2023-10-08T07:06:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.457155+0000", 2023-10-08T07:06:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.457157+0000", 2023-10-08T07:06:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.699e-06 2023-10-08T07:06:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.460913+0000", 2023-10-08T07:06:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037557200000000002 2023-10-08T07:06:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.460929+0000", 2023-10-08T07:06:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5866e-05 2023-10-08T07:06:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.460955+0000", 2023-10-08T07:06:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6166999999999999e-05 2023-10-08T07:06:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.461024+0000", 2023-10-08T07:06:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9071000000000003e-05 2023-10-08T07:06:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.461193+0000", 2023-10-08T07:06:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016890300000000001 2023-10-08T07:06:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.467483+0000", 2023-10-08T07:06:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062899180000000002 2023-10-08T07:06:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.467545+0000", 2023-10-08T07:06:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2866000000000004e-05 2023-10-08T07:06:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.467666+0000", 2023-10-08T07:06:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120018 2023-10-08T07:06:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:32 4.3b 4:df0e4bf8:::10000000004.00000018:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.550495+0000", 2023-10-08T07:06:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.68236884600000003, 2023-10-08T07:06:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011375560999999999, 2023-10-08T07:06:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 32 2023-10-08T07:06:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.550495+0000", 2023-10-08T07:06:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.550495+0000", 2023-10-08T07:06:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.550496+0000", 2023-10-08T07:06:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2470000000000001e-06 2023-10-08T07:06:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554190+0000", 2023-10-08T07:06:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036941529999999999 2023-10-08T07:06:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554206+0000", 2023-10-08T07:06:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6047999999999999e-05 2023-10-08T07:06:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554233+0000", 2023-10-08T07:06:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6591999999999999e-05 2023-10-08T07:06:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554300+0000", 2023-10-08T07:06:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7529999999999999e-05 2023-10-08T07:06:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554410+0000", 2023-10-08T07:06:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000109448 2023-10-08T07:06:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.561722+0000", 2023-10-08T07:06:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073119259999999998 2023-10-08T07:06:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.561786+0000", 2023-10-08T07:06:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3758999999999997e-05 2023-10-08T07:06:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.561870+0000", 2023-10-08T07:06:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4858000000000006e-05 2023-10-08T07:06:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:35 4.a e38/17 4:524fba76:::10000000004.0000001b:head v 38'1, mlcod=0'0)", 2023-10-08T07:06:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.827765+0000", 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.40509904600000002, 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011168861, 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.827765+0000", 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.827765+0000", 2023-10-08T07:06:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.827766+0000", 2023-10-08T07:06:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.336e-06 2023-10-08T07:06:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831833+0000", 2023-10-08T07:06:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040671120000000003 2023-10-08T07:06:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831860+0000", 2023-10-08T07:06:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6925999999999999e-05 2023-10-08T07:06:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831892+0000", 2023-10-08T07:06:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2360000000000002e-05 2023-10-08T07:06:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831968+0000", 2023-10-08T07:06:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5901000000000004e-05 2023-10-08T07:06:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831988+0000", 2023-10-08T07:06:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0182000000000001e-05 2023-10-08T07:06:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.838865+0000", 2023-10-08T07:06:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068763390000000004 2023-10-08T07:06:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.838934+0000", 2023-10-08T07:06:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8705e-05 2023-10-08T07:06:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36 4.37 4:efdd41ff:::10000000004.0000001c:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.912864+0000", 2023-10-08T07:06:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.31999960500000002, 2023-10-08T07:06:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010048952999999999, 2023-10-08T07:06:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36 2023-10-08T07:06:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.912864+0000", 2023-10-08T07:06:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.912864+0000", 2023-10-08T07:06:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.912867+0000", 2023-10-08T07:06:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0340000000000001e-06 2023-10-08T07:06:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.916673+0000", 2023-10-08T07:06:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038062009999999999 2023-10-08T07:06:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.916699+0000", 2023-10-08T07:06:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5633e-05 2023-10-08T07:06:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.916713+0000", 2023-10-08T07:06:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3986e-05 2023-10-08T07:06:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.916781+0000", 2023-10-08T07:06:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8431999999999998e-05 2023-10-08T07:06:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.916891+0000", 2023-10-08T07:06:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010963699999999999 2023-10-08T07:06:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.922754+0000", 2023-10-08T07:06:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058631990000000004 2023-10-08T07:06:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.922835+0000", 2023-10-08T07:06:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0279999999999997e-05 2023-10-08T07:06:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.922913+0000", 2023-10-08T07:06:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8551000000000001e-05 2023-10-08T07:06:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37 4.19 4:9a1dab10:::10000000004.0000001d:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:42.002369+0000", 2023-10-08T07:06:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.23049454599999999, 2023-10-08T07:06:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011046347999999999, 2023-10-08T07:06:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37 2023-10-08T07:06:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.002369+0000", 2023-10-08T07:06:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.002369+0000", 2023-10-08T07:06:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.002372+0000", 2023-10-08T07:06:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0580000000000002e-06 2023-10-08T07:06:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006140+0000", 2023-10-08T07:06:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037672869999999998 2023-10-08T07:06:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006164+0000", 2023-10-08T07:06:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4694000000000001e-05 2023-10-08T07:06:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006177+0000", 2023-10-08T07:06:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3209e-05 2023-10-08T07:06:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006296+0000", 2023-10-08T07:06:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000118573 2023-10-08T07:06:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006485+0000", 2023-10-08T07:06:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018935600000000001 2023-10-08T07:06:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.013276+0000", 2023-10-08T07:06:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067901940000000003 2023-10-08T07:06:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.013325+0000", 2023-10-08T07:06:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9042000000000002e-05 2023-10-08T07:06:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.013416+0000", 2023-10-08T07:06:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0934999999999996e-05 2023-10-08T07:06:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:38 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:42.092037+0000", 2023-10-08T07:06:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14082633899999999, 2023-10-08T07:06:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010770381000000001, 2023-10-08T07:06:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 38 2023-10-08T07:06:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.092037+0000", 2023-10-08T07:06:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.092037+0000", 2023-10-08T07:06:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.092040+0000", 2023-10-08T07:06:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2023-10-08T07:06:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.095868+0000", 2023-10-08T07:06:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038279939999999999 2023-10-08T07:06:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.095894+0000", 2023-10-08T07:06:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6137999999999999e-05 2023-10-08T07:06:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.095905+0000", 2023-10-08T07:06:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1357e-05 2023-10-08T07:06:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.095988+0000", 2023-10-08T07:06:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3170999999999994e-05 2023-10-08T07:06:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.096140+0000", 2023-10-08T07:06:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015196799999999999 2023-10-08T07:06:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.102660+0000", 2023-10-08T07:06:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065195599999999998 2023-10-08T07:06:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.102715+0000", 2023-10-08T07:06:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4889000000000003e-05 2023-10-08T07:06:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.102808+0000", 2023-10-08T07:06:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2875999999999996e-05 2023-10-08T07:06:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:42.372 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:42.373 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:06:42.386 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:42.384+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:42.387 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:42.487 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:42.486+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:42.487 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-10-08T07:06:42.527 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:42.528 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:42.528 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:06:42.528 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:42.543 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:42.587 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-10-08T07:06:42.588 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:42.587+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:42.676 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:42.677 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:42.677 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:42.677 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:42.678 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:42.687 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:42.688 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:42.688+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:42.791 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:42.791+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:42.822 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:42.823 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:42.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:42.823 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:42.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.823 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:42.823 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:42.823 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 80.048513818999993, 2023-10-08T07:06:42.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:42.823 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.823 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.824 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:42.824 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:42.824 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:42.824 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:42.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.824 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:42.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:42.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:42.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:42.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.826 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.826 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.826 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:42.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:42.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:42.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:42.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:42.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:42.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.828 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.828 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:42.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:42.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:42.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:42.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:42.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:42.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:42.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:42.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:42.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:42.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:42.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:42.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:42.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:42.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:42.832 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.832 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.832 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.832 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:42.832 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:42.833 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 80.048461767000006, 2023-10-08T07:06:42.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:42.833 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.833 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.833 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:42.833 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:42.833 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:42.833 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:42.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.833 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:42.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.835 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:42.835 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.835 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.835 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:42.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:42.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:42.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:42.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:42.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:42.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:42.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:42.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:42.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:42.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:42.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:42.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:42.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:42.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:42.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:42.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:42.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:42.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:42.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:42.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:42.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.841 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.841 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:42.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:42.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.841 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.847 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.847 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:42.848 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.503091135000005, 2023-10-08T07:06:42.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015053349000000001, 2023-10-08T07:06:42.848 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.848 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.848 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.848 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:42.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317283+0000", 2023-10-08T07:06:42.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317284+0000", 2023-10-08T07:06:42.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:06:42.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317288+0000", 2023-10-08T07:06:42.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:06:42.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317299+0000", 2023-10-08T07:06:42.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:06:42.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317309+0000", 2023-10-08T07:06:42.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4069999999999999e-06 2023-10-08T07:06:42.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317691+0000", 2023-10-08T07:06:42.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000382147 2023-10-08T07:06:42.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:42.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317696+0000", 2023-10-08T07:06:42.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:06:42.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.326648+0000", 2023-10-08T07:06:42.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089519890000000005 2023-10-08T07:06:42.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327602+0000", 2023-10-08T07:06:42.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095474100000000005 2023-10-08T07:06:42.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:42.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327797+0000", 2023-10-08T07:06:42.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019434500000000001 2023-10-08T07:06:42.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332024+0000", 2023-10-08T07:06:42.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042277579999999999 2023-10-08T07:06:42.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332249+0000", 2023-10-08T07:06:42.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022503700000000001 2023-10-08T07:06:42.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.854 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332299+0000", 2023-10-08T07:06:42.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9477000000000001e-05 2023-10-08T07:06:42.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332336+0000", 2023-10-08T07:06:42.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7335000000000001e-05 2023-10-08T07:06:42.855 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.855 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.856 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.856 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.856 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:42.856 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.502765289999999, 2023-10-08T07:06:42.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:42.857 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.857 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.857 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.857 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.857 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.857 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:42.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.858 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.858 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:42.858 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.858 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.858 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:42.858 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:42.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:42.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:42.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:42.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:42.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:42.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:42.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:42.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:42.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:42.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:42.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:42.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.861 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:42.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:42.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.861 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:42.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:42.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.862 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:42.862 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:42.862 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:42.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.862 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.862 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:42.862 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:42.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:42.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:42.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.864 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.864 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:42.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:42.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.864 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.864 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:42.865 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:42.865 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.865 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.865 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.865 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.865 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.865 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:42.865 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.502712764999998, 2023-10-08T07:06:42.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:42.866 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.866 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.866 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.866 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.866 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:42.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:42.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:42.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:42.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.868 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.868 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.868 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:42.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:42.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.868 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.869 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.869 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:42.869 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:42.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.869 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.869 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.869 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:42.870 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:42.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.870 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.870 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.870 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:42.870 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:42.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.870 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.871 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.871 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:42.871 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:42.871 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.871 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.871 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:42.871 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:42.871 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:42.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.872 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.872 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.872 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:42.872 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:42.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.873 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.873 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.873 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:42.873 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:42.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.873 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.873 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.873 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:42.874 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:42.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.874 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.874 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.874 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:42.874 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:42.874 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.875 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.875 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.875 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.875 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:14 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.875 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:42.875 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.502400492000007, 2023-10-08T07:06:42.875 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014448931, 2023-10-08T07:06:42.876 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.876 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.876 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.876 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.876 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.876 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:42.876 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.877 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.877 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:42.877 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.877 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.877 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317974+0000", 2023-10-08T07:06:42.878 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:06:42.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.879 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.881 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317992+0000", 2023-10-08T07:06:42.881 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7801000000000001e-05 2023-10-08T07:06:42.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.881 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.881 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.881 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318004+0000", 2023-10-08T07:06:42.882 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1345000000000001e-05 2023-10-08T07:06:42.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.882 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.882 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.882 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318014+0000", 2023-10-08T07:06:42.882 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:06:42.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.882 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.882 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.882 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318687+0000", 2023-10-08T07:06:42.882 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067350899999999998 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op must wait for map", 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318695+0000", 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4740000000000005e-06 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327753+0000", 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009057285 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.883 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.884 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.327892+0000", 2023-10-08T07:06:42.884 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013948300000000001 2023-10-08T07:06:42.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.884 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.884 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:42.884 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328053+0000", 2023-10-08T07:06:42.884 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160583 2023-10-08T07:06:42.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.884 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.884 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.884 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331265+0000", 2023-10-08T07:06:42.884 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003211663 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332294+0000", 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010292260000000001 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332355+0000", 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1418e-05 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.886 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332423+0000", 2023-10-08T07:06:42.886 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7360999999999994e-05 2023-10-08T07:06:42.886 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.886 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.886 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.886 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.886 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.886 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:42.886 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.501720980000002, 2023-10-08T07:06:42.886 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:42.887 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.887 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.887 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.887 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.887 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.887 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:42.887 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.887 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.887 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.887 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:42.888 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.888 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.888 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.888 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:42.888 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:42.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.888 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.888 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.888 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:42.888 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:42.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.889 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:42.890 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:42.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.890 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.890 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.890 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:42.890 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:42.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.890 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.890 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:42.890 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:42.890 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:42.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.891 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.891 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.891 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:42.892 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:42.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.893 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.893 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.893 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:42.893 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:42.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.893 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.893 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.893 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:42.893 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:42.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.894 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.894 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.894 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:42.894 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:42.894 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.894 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.894 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.894 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.894 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.895 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:42.895 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.501667710000007, 2023-10-08T07:06:42.895 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:42.895 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.895 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.895 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.896 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.897 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.897 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:42.897 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.897 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.897 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.897 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:42.897 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.897 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.898 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.898 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:42.898 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:42.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.898 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.899 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.899 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:42.899 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:42.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.899 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.899 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.899 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:42.899 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:42.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.900 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.900 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.900 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:42.900 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:42.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.901 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.901 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:42.901 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:42.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.901 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.901 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:42.901 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:42.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.902 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.902 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:42.902 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:42.902 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:42.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.902 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.902 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.902 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:42.902 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:42.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.903 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.903 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.903 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:42.903 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:42.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.903 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.903 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.903 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:42.903 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:42.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.903 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.904 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.904 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:42.904 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:42.904 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.904 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.904 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.904 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.904 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.904 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:42.904 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.501631864000004, 2023-10-08T07:06:42.904 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:42.905 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.905 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.905 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.905 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:42.905 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.905 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.906 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:42.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.906 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.906 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.906 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:42.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:42.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.906 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.906 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.907 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:42.907 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:42.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.907 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.907 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.907 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:42.907 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:42.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.908 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.908 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.908 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:42.908 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:42.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.908 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.908 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.908 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:42.908 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:42.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.908 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.909 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.909 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:42.909 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:42.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.909 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.909 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:42.909 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:42.909 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:42.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.909 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.909 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.909 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:42.910 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:42.910 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.910 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.910 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.910 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:42.910 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:42.910 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.910 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.910 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.910 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:42.910 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:42.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.911 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.911 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.911 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:42.911 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:42.911 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.911 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.911 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.911 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.911 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.911 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:42.912 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.501199009999993, 2023-10-08T07:06:42.912 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:42.912 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.912 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.912 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.912 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.912 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:42.912 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.913 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:42.913 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.913 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.913 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:42.913 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:42.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.913 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.914 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:42.914 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:42.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.914 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.914 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.914 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.915 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.916 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:42.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:42.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.916 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:42.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:42.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:42.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:42.917 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:42.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:42.917 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:42.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.918 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.918 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:42.918 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:42.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.918 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.918 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.918 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:42.918 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:42.918 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.918 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.918 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.919 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.919 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.919 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.919 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:42.919 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.501085368000005, 2023-10-08T07:06:42.919 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:42.919 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.919 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.919 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.919 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.919 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.919 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:42.920 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.920 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.920 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.920 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:42.920 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.920 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.920 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.920 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:42.920 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:42.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.921 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.921 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:42.921 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:42.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.921 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.921 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:42.921 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:42.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.921 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:42.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:42.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.923 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:42.923 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:42.923 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:42.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.923 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.923 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:42.923 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:42.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:42.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:42.925 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.925 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.925 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.925 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.925 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:23 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:42.925 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:42.925 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 69.500055144000001, 2023-10-08T07:06:42.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01448903, 2023-10-08T07:06:42.925 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320319+0000", 2023-10-08T07:06:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320320+0000", 2023-10-08T07:06:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:06:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320322+0000", 2023-10-08T07:06:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9079999999999999e-06 2023-10-08T07:06:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.927 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320330+0000", 2023-10-08T07:06:42.928 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-06 2023-10-08T07:06:42.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.928 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.320336+0000", 2023-10-08T07:06:42.928 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:06:42.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.928 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331517+0000", 2023-10-08T07:06:42.928 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011180809999999999 2023-10-08T07:06:42.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.929 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.929 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331634+0000", 2023-10-08T07:06:42.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117306 2023-10-08T07:06:42.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.929 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.929 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334808+0000", 2023-10-08T07:06:42.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031736170000000001 2023-10-08T07:06:42.929 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.930 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.930 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.930 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.930 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:24 4.20 4:07572838:::10000000004.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:42.930 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.816540+0000", 2023-10-08T07:06:42.930 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.0038338750000002, 2023-10-08T07:06:42.930 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014454027, 2023-10-08T07:06:42.930 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.930 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.930 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:42.931 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:42.931 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.931 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 24 2023-10-08T07:06:42.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.931 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.931 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.931 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.931 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.816540+0000", 2023-10-08T07:06:42.931 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.931 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.932 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.932 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.816540+0000", 2023-10-08T07:06:42.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.932 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.932 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.816541+0000", 2023-10-08T07:06:42.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7400000000000002e-07 2023-10-08T07:06:42.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.932 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.820783+0000", 2023-10-08T07:06:42.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042420399999999999 2023-10-08T07:06:42.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.820798+0000", 2023-10-08T07:06:42.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5302999999999999e-05 2023-10-08T07:06:42.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.820808+0000", 2023-10-08T07:06:42.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2699999999999993e-06 2023-10-08T07:06:42.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.934 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.934 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.934 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.820888+0000", 2023-10-08T07:06:42.934 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0107999999999999e-05 2023-10-08T07:06:42.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.934 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.934 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.934 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.821062+0000", 2023-10-08T07:06:42.934 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017391999999999999 2023-10-08T07:06:42.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.935 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.935 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:42.935 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.821239+0000", 2023-10-08T07:06:42.935 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000177734 2023-10-08T07:06:42.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.935 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.935 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.935 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.827675+0000", 2023-10-08T07:06:42.935 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0064351649999999996 2023-10-08T07:06:42.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.935 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.935 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.936 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.830877+0000", 2023-10-08T07:06:42.936 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032024649999999998 2023-10-08T07:06:42.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.936 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.936 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.936 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.830945+0000", 2023-10-08T07:06:42.936 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7627999999999997e-05 2023-10-08T07:06:42.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.936 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.936 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.937 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.830994+0000", 2023-10-08T07:06:42.937 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.952e-05 2023-10-08T07:06:42.937 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.937 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.937 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.937 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.937 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:25 4.c 4:31e28161:::10000000004.00000011:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:42.937 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.911542+0000", 2023-10-08T07:06:42.937 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.908831621, 2023-10-08T07:06:42.937 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015283365, 2023-10-08T07:06:42.938 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.938 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.938 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:42.938 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:42.938 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.938 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 25 2023-10-08T07:06:42.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.938 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.938 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.938 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.938 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.911542+0000", 2023-10-08T07:06:42.938 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.939 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.939 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.939 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.911542+0000", 2023-10-08T07:06:42.939 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.939 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.939 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.939 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.911544+0000", 2023-10-08T07:06:42.939 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1370000000000001e-06 2023-10-08T07:06:42.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.939 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.940 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.940 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915273+0000", 2023-10-08T07:06:42.940 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003729539 2023-10-08T07:06:42.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.940 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.940 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915287+0000", 2023-10-08T07:06:42.940 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4058e-05 2023-10-08T07:06:42.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.940 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.940 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915295+0000", 2023-10-08T07:06:42.941 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.79e-06 2023-10-08T07:06:42.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.941 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.941 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.941 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915361+0000", 2023-10-08T07:06:42.941 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6490999999999997e-05 2023-10-08T07:06:42.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.941 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.941 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.941 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915528+0000", 2023-10-08T07:06:42.941 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016655399999999999 2023-10-08T07:06:42.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.942 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.942 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:42.942 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915686+0000", 2023-10-08T07:06:42.942 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015756099999999999 2023-10-08T07:06:42.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.942 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.942 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.942 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.921741+0000", 2023-10-08T07:06:42.942 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060556569999999999 2023-10-08T07:06:42.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.942 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.942 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.943 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.926711+0000", 2023-10-08T07:06:42.943 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0049696719999999996 2023-10-08T07:06:42.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.943 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.943 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.943 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.926779+0000", 2023-10-08T07:06:42.943 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8079999999999999e-05 2023-10-08T07:06:42.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.943 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.943 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.943 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.926826+0000", 2023-10-08T07:06:42.943 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6826000000000002e-05 2023-10-08T07:06:42.944 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.944 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.944 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.944 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.944 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:26 4.c 4:3352c333:::10000000004.00000012:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:42.944 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:42.944 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.8209657379999999, 2023-10-08T07:06:42.944 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015456749000000001, 2023-10-08T07:06:42.944 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.944 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.944 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:42.945 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:42.945 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.945 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 26 2023-10-08T07:06:42.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.945 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.945 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.945 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.945 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:42.945 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.945 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.945 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:42.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.946 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999409+0000", 2023-10-08T07:06:42.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1570000000000001e-06 2023-10-08T07:06:42.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.946 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003237+0000", 2023-10-08T07:06:42.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003827619 2023-10-08T07:06:42.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.947 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003252+0000", 2023-10-08T07:06:42.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5068999999999999e-05 2023-10-08T07:06:42.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.947 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003259+0000", 2023-10-08T07:06:42.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1910000000000003e-06 2023-10-08T07:06:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003330+0000", 2023-10-08T07:06:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0469999999999994e-05 2023-10-08T07:06:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003504+0000", 2023-10-08T07:06:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017425700000000001 2023-10-08T07:06:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:42.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003675+0000", 2023-10-08T07:06:42.949 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000171137 2023-10-08T07:06:42.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.949 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.010247+0000", 2023-10-08T07:06:42.949 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065716569999999998 2023-10-08T07:06:42.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.949 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014747+0000", 2023-10-08T07:06:42.950 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045002740000000003 2023-10-08T07:06:42.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.950 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.950 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.950 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014820+0000", 2023-10-08T07:06:42.950 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3310000000000001e-05 2023-10-08T07:06:42.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.950 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.950 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.950 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014865+0000", 2023-10-08T07:06:42.950 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4607999999999997e-05 2023-10-08T07:06:42.951 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.951 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.951 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.951 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.951 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:28 4.30 4:0f322a22:::10000000004.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:42.951 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:42.951 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.6490097129999999, 2023-10-08T07:06:42.951 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015624149, 2023-10-08T07:06:42.951 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.951 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.951 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:42.952 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:42.952 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.952 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 28 2023-10-08T07:06:42.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.952 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.952 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.952 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.952 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:42.952 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.952 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.952 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:42.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171372+0000", 2023-10-08T07:06:42.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8220000000000007e-06 2023-10-08T07:06:42.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175253+0000", 2023-10-08T07:06:42.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038812529999999999 2023-10-08T07:06:42.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.954 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.954 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175268+0000", 2023-10-08T07:06:42.954 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4782e-05 2023-10-08T07:06:42.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.954 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.954 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175275+0000", 2023-10-08T07:06:42.954 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0899999999999999e-06 2023-10-08T07:06:42.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.955 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.955 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175345+0000", 2023-10-08T07:06:42.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9604000000000006e-05 2023-10-08T07:06:42.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.955 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.955 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.955 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175502+0000", 2023-10-08T07:06:42.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015699799999999999 2023-10-08T07:06:42.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.955 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.955 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:42.955 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175652+0000", 2023-10-08T07:06:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014977100000000001 2023-10-08T07:06:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.182743+0000", 2023-10-08T07:06:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070913800000000004 2023-10-08T07:06:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186876+0000", 2023-10-08T07:06:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041328670000000001 2023-10-08T07:06:42.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186941+0000", 2023-10-08T07:06:42.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5506999999999995e-05 2023-10-08T07:06:42.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186989+0000", 2023-10-08T07:06:42.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7074999999999999e-05 2023-10-08T07:06:42.957 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.957 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.957 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.958 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:30 4.20 4:05b3915c:::10000000004.00000016:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:42.958 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.365783+0000", 2023-10-08T07:06:42.958 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.4545909909999999, 2023-10-08T07:06:42.958 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015199433, 2023-10-08T07:06:42.958 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.958 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.958 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:42.958 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:42.958 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.959 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 30 2023-10-08T07:06:42.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.959 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.959 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.959 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.959 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.365783+0000", 2023-10-08T07:06:42.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.959 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.959 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.959 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.365783+0000", 2023-10-08T07:06:42.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.960 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.960 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.365785+0000", 2023-10-08T07:06:42.960 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9939999999999999e-06 2023-10-08T07:06:42.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.960 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.960 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.369461+0000", 2023-10-08T07:06:42.960 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0036757949999999999 2023-10-08T07:06:42.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.369480+0000", 2023-10-08T07:06:42.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9128999999999999e-05 2023-10-08T07:06:42.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.369491+0000", 2023-10-08T07:06:42.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.128e-05 2023-10-08T07:06:42.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.369575+0000", 2023-10-08T07:06:42.962 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4140000000000004e-05 2023-10-08T07:06:42.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.369755+0000", 2023-10-08T07:06:42.962 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0001794 2023-10-08T07:06:42.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:42.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.369929+0000", 2023-10-08T07:06:42.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017398500000000001 2023-10-08T07:06:42.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.376551+0000", 2023-10-08T07:06:42.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0066225169999999996 2023-10-08T07:06:42.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.380868+0000", 2023-10-08T07:06:42.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004316243 2023-10-08T07:06:42.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.964 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.380939+0000", 2023-10-08T07:06:42.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1904999999999997e-05 2023-10-08T07:06:42.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.964 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.380983+0000", 2023-10-08T07:06:42.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3044999999999999e-05 2023-10-08T07:06:42.964 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.965 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.965 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.965 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:35 4.a 4:524fba76:::10000000004.0000001b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:42.965 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:42.965 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.99720519100000005, 2023-10-08T07:06:42.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016047682000000001, 2023-10-08T07:06:42.965 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.966 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.966 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:42.966 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:42.966 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.966 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 35 2023-10-08T07:06:42.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.967 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.967 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.967 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.967 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:42.967 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.967 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.967 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.968 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:42.968 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.968 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.968 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823216+0000", 2023-10-08T07:06:42.968 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7559999999999999e-05 2023-10-08T07:06:42.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.969 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.969 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827333+0000", 2023-10-08T07:06:42.969 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041169290000000001 2023-10-08T07:06:42.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.970 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.970 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.970 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827352+0000", 2023-10-08T07:06:42.970 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9026e-05 2023-10-08T07:06:42.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.970 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.970 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.970 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827361+0000", 2023-10-08T07:06:42.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6999999999999997e-06 2023-10-08T07:06:42.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827414+0000", 2023-10-08T07:06:42.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3122999999999999e-05 2023-10-08T07:06:42.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827530+0000", 2023-10-08T07:06:42.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000115618 2023-10-08T07:06:42.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.972 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:42.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827626+0000", 2023-10-08T07:06:42.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5997999999999998e-05 2023-10-08T07:06:42.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.972 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.834016+0000", 2023-10-08T07:06:42.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.006390298 2023-10-08T07:06:42.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.973 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839139+0000", 2023-10-08T07:06:42.973 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0051226370000000002 2023-10-08T07:06:42.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.973 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839180+0000", 2023-10-08T07:06:42.973 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0905999999999998e-05 2023-10-08T07:06:42.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.974 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839217+0000", 2023-10-08T07:06:42.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6887000000000001e-05 2023-10-08T07:06:42.974 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.974 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.974 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.974 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.974 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:42 4.38 4:1e0977c7:::10000000004.00000022:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:42.974 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:42.974 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.346000215, 2023-10-08T07:06:42.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015514448, 2023-10-08T07:06:42.975 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.975 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.975 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:42.975 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:42.975 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.975 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 42 2023-10-08T07:06:42.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.975 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.975 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:42.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:42.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474376+0000", 2023-10-08T07:06:42.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1150000000000001e-06 2023-10-08T07:06:42.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478104+0000", 2023-10-08T07:06:42.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003728514 2023-10-08T07:06:42.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478129+0000", 2023-10-08T07:06:42.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4655999999999999e-05 2023-10-08T07:06:42.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478140+0000", 2023-10-08T07:06:42.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1012000000000001e-05 2023-10-08T07:06:42.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478221+0000", 2023-10-08T07:06:42.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1099000000000004e-05 2023-10-08T07:06:42.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478343+0000", 2023-10-08T07:06:42.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012129 2023-10-08T07:06:42.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:42.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478444+0000", 2023-10-08T07:06:42.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000101587 2023-10-08T07:06:42.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.980 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.485040+0000", 2023-10-08T07:06:42.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065962260000000002 2023-10-08T07:06:42.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.980 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.980 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489774+0000", 2023-10-08T07:06:42.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047335889999999999 2023-10-08T07:06:42.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.980 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.980 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489841+0000", 2023-10-08T07:06:42.981 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7232999999999998e-05 2023-10-08T07:06:42.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.981 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.981 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.981 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489888+0000", 2023-10-08T07:06:42.981 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7126999999999998e-05 2023-10-08T07:06:42.981 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.981 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.981 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.982 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.982 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:43 4.3a 4:5f183e4b:::10000000004.00000023:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:42.982 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:42.569916+0000", 2023-10-08T07:06:42.982 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.25045790400000001, 2023-10-08T07:06:42.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014941591000000001, 2023-10-08T07:06:42.983 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:42.983 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:42.983 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:42.983 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:42.983 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:42.983 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 43 2023-10-08T07:06:42.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.983 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:42.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.983 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:42.984 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.569916+0000", 2023-10-08T07:06:42.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.985 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:42.985 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.569916+0000", 2023-10-08T07:06:42.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:42.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:42.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.569919+0000", 2023-10-08T07:06:42.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.695e-06 2023-10-08T07:06:42.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:42.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.573729+0000", 2023-10-08T07:06:42.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038099660000000001 2023-10-08T07:06:42.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.987 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.987 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:42.987 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.573754+0000", 2023-10-08T07:06:42.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5598000000000001e-05 2023-10-08T07:06:42.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.987 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.987 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:42.987 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.573766+0000", 2023-10-08T07:06:42.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1649e-05 2023-10-08T07:06:42.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:42.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.573854+0000", 2023-10-08T07:06:42.988 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8368999999999994e-05 2023-10-08T07:06:42.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:42.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.574025+0000", 2023-10-08T07:06:42.988 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017024299999999999 2023-10-08T07:06:42.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:42.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.574204+0000", 2023-10-08T07:06:42.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000178989 2023-10-08T07:06:42.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:42.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.582757+0000", 2023-10-08T07:06:42.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0085537709999999999 2023-10-08T07:06:42.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:42.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.584745+0000", 2023-10-08T07:06:42.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0019876799999999999 2023-10-08T07:06:42.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.990 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:42.990 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.584811+0000", 2023-10-08T07:06:42.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5619999999999999e-05 2023-10-08T07:06:42.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:42.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:42.990 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:42.990 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.584858+0000", 2023-10-08T07:06:42.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7011000000000001e-05 2023-10-08T07:06:42.991 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.991 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.991 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.991 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:42.991 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:42.991 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:42.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:42.993 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:42.994 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:42.992+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:43.095 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:43.094+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:43.122 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:06:43.123 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:43.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:43.152 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:43.182 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:43.182 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:43.182 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:06:43.182 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:43.184 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:06:43.185 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:06:43.196 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:43.195+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:43.264 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:43.264 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:43.274 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:43.296 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:43.295+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:43.397 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:43.396+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:43.403 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:43.403 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:43.414 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:43.498 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:43.497+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:43.557 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:43.557 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:43.567 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:43.599 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:43.598+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:43.701 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:43.699+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:43.739 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:43.767 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:43.768 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:43.801 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:43.800+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:43.901 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:43.900+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:43.943 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:43.943 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:43.953 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:44.002 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:44.001+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:44.084 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:44.084 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:44.094 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:44.103 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:44.102+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:44.142 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T07:06:44.204 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:44.203+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:44.260 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:44.260 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:44.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:44.314 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:44.313+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:44.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2023-10-08T07:06:44.397 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:44.398 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:44.405 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:44.404+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:44.407 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:44.506 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:44.505+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:44.544 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:44.544 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:44.555 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:44.639 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:44.638+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:44.709 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:44.708+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:44.734 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:44.735 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:44.743 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:44.829 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:44.828+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:44.910 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:44.910+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:44.916 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:44.916 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:44.926 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:45.012 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:45.011+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:45.055 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:45.056 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:45.066 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:45.113 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:45.112+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:45.142 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2023-10-08T07:06:45.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:45.194 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:45.194 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:45.206 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:45.247 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:45.246+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:45.315 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:45.314+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:45.352 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:45.375 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:06:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:45.378 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:06:45.379 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:06:45.393 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:45.393 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:45.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:45.393 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:45.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.394 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:45.394 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:45.394 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 72.074024996999995, 2023-10-08T07:06:45.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:45.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.394 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.394 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:45.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:45.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:45.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:45.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:45.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:45.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:45.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:45.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:45.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:45.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:45.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:45.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:45.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:45.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:45.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:45.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:45.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:45.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:45.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:45.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:45.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:45.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:45.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:45.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:45.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:45.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:45.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.400 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.400 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:45.400 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:45.400 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 72.073951213000001, 2023-10-08T07:06:45.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:45.401 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.401 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.401 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:45.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:45.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:45.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:45.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:45.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:45.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:45.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:45.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:45.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:45.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:45.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:45.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:45.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:45.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:45.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:45.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:45.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:45.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:45.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:45.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:45.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:45.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:45.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:45.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:45.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:45.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:45.407 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.407 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.407 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.407 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:45.408 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:45.408 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 72.073363466000004, 2023-10-08T07:06:45.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:45.408 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.408 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.408 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:45.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:45.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:45.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:45.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:45.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:45.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:45.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:45.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:45.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:45.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:45.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:45.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:45.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:45.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:45.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:45.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:45.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:45.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:45.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:45.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:45.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:45.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:45.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:45.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:45.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:45.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:45.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.414 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.415 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:45.415 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:45.415 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 72.073322888999996, 2023-10-08T07:06:45.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:45.415 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.415 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.415 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:45.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:45.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:45.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:45.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:45.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:45.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:45.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:45.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:45.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:45.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:45.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:45.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:45.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:45.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:45.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:45.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:45.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:45.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:45.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:45.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:45.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:45.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:45.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:45.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:45.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:45.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:45.421 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.421 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.422 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:45.423 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:45.423 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 72.073285319999997, 2023-10-08T07:06:45.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:45.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.424 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:45.424 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:45.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:45.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:45.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:45.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:45.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:45.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:45.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:45.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:45.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:45.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:45.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 72.073217880000001, 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:45.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:45.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:45.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:45.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:45.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:45.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:45.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:45.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:45.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:45.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.432 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.432 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:25 4.c e38/17 4:31e28161:::10000000004.00000011:head v 38'1, mlcod=0'0)", 2023-10-08T07:06:45.432 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:40.915856+0000", 2023-10-08T07:06:45.432 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4746917279999998, 2023-10-08T07:06:45.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010431197, 2023-10-08T07:06:45.433 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.433 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.433 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.915856+0000", 2023-10-08T07:06:45.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.915856+0000", 2023-10-08T07:06:45.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.915858+0000", 2023-10-08T07:06:45.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0190000000000001e-06 2023-10-08T07:06:45.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919710+0000", 2023-10-08T07:06:45.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038523189999999999 2023-10-08T07:06:45.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919731+0000", 2023-10-08T07:06:45.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0849e-05 2023-10-08T07:06:45.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919744+0000", 2023-10-08T07:06:45.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3399e-05 2023-10-08T07:06:45.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919817+0000", 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3258999999999998e-05 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.919838+0000", 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0256999999999999e-05 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.926222+0000", 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063838560000000003 2023-10-08T07:06:45.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:40.926287+0000", 2023-10-08T07:06:45.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5239000000000003e-05 2023-10-08T07:06:45.437 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.437 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.437 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.437 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:26 4.c e38/17 4:3352c333:::10000000004.00000012:head v 38'2, mlcod=0'0)", 2023-10-08T07:06:45.437 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.003888+0000", 2023-10-08T07:06:45.437 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3866595520000002, 2023-10-08T07:06:45.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010663526, 2023-10-08T07:06:45.438 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.438 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.438 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.003888+0000", 2023-10-08T07:06:45.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.003888+0000", 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.003890+0000", 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0020000000000001e-06 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.007840+0000", 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039502490000000003 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.007877+0000", 2023-10-08T07:06:45.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7462999999999997e-05 2023-10-08T07:06:45.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.007906+0000", 2023-10-08T07:06:45.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8507999999999999e-05 2023-10-08T07:06:45.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.007978+0000", 2023-10-08T07:06:45.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1923999999999998e-05 2023-10-08T07:06:45.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.008006+0000", 2023-10-08T07:06:45.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7674e-05 2023-10-08T07:06:45.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.014488+0000", 2023-10-08T07:06:45.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0064825999999999998 2023-10-08T07:06:45.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.014551+0000", 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3106000000000002e-05 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:28 4.30 e38/17 4:0f322a22:::10000000004.00000014:head v 38'1, mlcod=0'0)", 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.175927+0000", 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.2146197929999998, 2023-10-08T07:06:45.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010730696, 2023-10-08T07:06:45.443 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.443 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.443 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.175927+0000", 2023-10-08T07:06:45.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.175927+0000", 2023-10-08T07:06:45.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.175929+0000", 2023-10-08T07:06:45.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2899999999999999e-06 2023-10-08T07:06:45.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.180411+0000", 2023-10-08T07:06:45.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044823290000000002 2023-10-08T07:06:45.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.180428+0000", 2023-10-08T07:06:45.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6872e-05 2023-10-08T07:06:45.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.180437+0000", 2023-10-08T07:06:45.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9770000000000006e-06 2023-10-08T07:06:45.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.180519+0000", 2023-10-08T07:06:45.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2170999999999996e-05 2023-10-08T07:06:45.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.180538+0000", 2023-10-08T07:06:45.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9021e-05 2023-10-08T07:06:45.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.186616+0000", 2023-10-08T07:06:45.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060777540000000003 2023-10-08T07:06:45.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.186658+0000", 2023-10-08T07:06:45.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2281999999999999e-05 2023-10-08T07:06:45.447 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.447 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.447 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.447 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:30 4.20 e38/17 4:05b3915c:::10000000004.00000016:head v 38'3, mlcod=38'1)", 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.370172+0000", 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.0203753989999997, 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010506537999999999, 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.370172+0000", 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.370172+0000", 2023-10-08T07:06:45.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.370173+0000", 2023-10-08T07:06:45.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2330000000000001e-06 2023-10-08T07:06:45.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.373977+0000", 2023-10-08T07:06:45.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038043270000000001 2023-10-08T07:06:45.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.373992+0000", 2023-10-08T07:06:45.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.418e-05 2023-10-08T07:06:45.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.374018+0000", 2023-10-08T07:06:45.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5933999999999999e-05 2023-10-08T07:06:45.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.374075+0000", 2023-10-08T07:06:45.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7404000000000001e-05 2023-10-08T07:06:45.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.374102+0000", 2023-10-08T07:06:45.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6911999999999999e-05 2023-10-08T07:06:45.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.380632+0000", 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065303030000000003 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.380678+0000", 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6245000000000002e-05 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.453 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:31 4.f 4:f2537947:::10000000004.00000017:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:45.453 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.457155+0000", 2023-10-08T07:06:45.453 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.9333919910000001, 2023-10-08T07:06:45.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010510228, 2023-10-08T07:06:45.453 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.453 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:45.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:45.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.453 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 31 2023-10-08T07:06:45.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.457155+0000", 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.457155+0000", 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.457157+0000", 2023-10-08T07:06:45.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.699e-06 2023-10-08T07:06:45.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.460913+0000", 2023-10-08T07:06:45.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037557200000000002 2023-10-08T07:06:45.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.460929+0000", 2023-10-08T07:06:45.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5866e-05 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.460955+0000", 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6166999999999999e-05 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.461024+0000", 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9071000000000003e-05 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.461193+0000", 2023-10-08T07:06:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016890300000000001 2023-10-08T07:06:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.467483+0000", 2023-10-08T07:06:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062899180000000002 2023-10-08T07:06:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.467545+0000", 2023-10-08T07:06:45.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2866000000000004e-05 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.467666+0000", 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120018 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:32 4.3b 4:df0e4bf8:::10000000004.00000018:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.550495+0000", 2023-10-08T07:06:45.458 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.8400524049999998, 2023-10-08T07:06:45.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011375560999999999, 2023-10-08T07:06:45.459 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.459 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:45.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:45.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.459 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 32 2023-10-08T07:06:45.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.459 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.550495+0000", 2023-10-08T07:06:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.550495+0000", 2023-10-08T07:06:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.550496+0000", 2023-10-08T07:06:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2470000000000001e-06 2023-10-08T07:06:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554190+0000", 2023-10-08T07:06:45.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036941529999999999 2023-10-08T07:06:45.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554206+0000", 2023-10-08T07:06:45.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6047999999999999e-05 2023-10-08T07:06:45.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554233+0000", 2023-10-08T07:06:45.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6591999999999999e-05 2023-10-08T07:06:45.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554300+0000", 2023-10-08T07:06:45.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7529999999999999e-05 2023-10-08T07:06:45.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554410+0000", 2023-10-08T07:06:45.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000109448 2023-10-08T07:06:45.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:45.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.561722+0000", 2023-10-08T07:06:45.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073119259999999998 2023-10-08T07:06:45.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.561786+0000", 2023-10-08T07:06:45.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3758999999999997e-05 2023-10-08T07:06:45.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.561870+0000", 2023-10-08T07:06:45.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4858000000000006e-05 2023-10-08T07:06:45.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.464 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.465 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:35 4.a e38/17 4:524fba76:::10000000004.0000001b:head v 38'1, mlcod=0'0)", 2023-10-08T07:06:45.465 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.827765+0000", 2023-10-08T07:06:45.465 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.5627826049999998, 2023-10-08T07:06:45.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011168861, 2023-10-08T07:06:45.465 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.465 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.465 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.827765+0000", 2023-10-08T07:06:45.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.827765+0000", 2023-10-08T07:06:45.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.827766+0000", 2023-10-08T07:06:45.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.336e-06 2023-10-08T07:06:45.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831833+0000", 2023-10-08T07:06:45.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040671120000000003 2023-10-08T07:06:45.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831860+0000", 2023-10-08T07:06:45.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6925999999999999e-05 2023-10-08T07:06:45.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831892+0000", 2023-10-08T07:06:45.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2360000000000002e-05 2023-10-08T07:06:45.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831968+0000", 2023-10-08T07:06:45.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5901000000000004e-05 2023-10-08T07:06:45.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831988+0000", 2023-10-08T07:06:45.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0182000000000001e-05 2023-10-08T07:06:45.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.838865+0000", 2023-10-08T07:06:45.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068763390000000004 2023-10-08T07:06:45.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.838934+0000", 2023-10-08T07:06:45.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8705e-05 2023-10-08T07:06:45.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.470 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.470 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37 4.19 4:9a1dab10:::10000000004.0000001d:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:45.470 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:42.002369+0000", 2023-10-08T07:06:45.470 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.3881781050000002, 2023-10-08T07:06:45.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011046347999999999, 2023-10-08T07:06:45.470 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.470 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:45.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:45.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.471 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37 2023-10-08T07:06:45.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.471 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.002369+0000", 2023-10-08T07:06:45.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.002369+0000", 2023-10-08T07:06:45.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.002372+0000", 2023-10-08T07:06:45.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0580000000000002e-06 2023-10-08T07:06:45.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006140+0000", 2023-10-08T07:06:45.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037672869999999998 2023-10-08T07:06:45.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006164+0000", 2023-10-08T07:06:45.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4694000000000001e-05 2023-10-08T07:06:45.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006177+0000", 2023-10-08T07:06:45.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3209e-05 2023-10-08T07:06:45.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006296+0000", 2023-10-08T07:06:45.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000118573 2023-10-08T07:06:45.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006485+0000", 2023-10-08T07:06:45.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018935600000000001 2023-10-08T07:06:45.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:45.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.013276+0000", 2023-10-08T07:06:45.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067901940000000003 2023-10-08T07:06:45.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.013325+0000", 2023-10-08T07:06:45.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9042000000000002e-05 2023-10-08T07:06:45.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.013416+0000", 2023-10-08T07:06:45.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0934999999999996e-05 2023-10-08T07:06:45.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.476 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.476 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:38 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:45.476 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:42.092037+0000", 2023-10-08T07:06:45.476 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.2985098979999998, 2023-10-08T07:06:45.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010770381000000001, 2023-10-08T07:06:45.477 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.477 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:45.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:45.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.477 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 38 2023-10-08T07:06:45.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.477 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.092037+0000", 2023-10-08T07:06:45.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.092037+0000", 2023-10-08T07:06:45.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.092040+0000", 2023-10-08T07:06:45.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2023-10-08T07:06:45.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.095868+0000", 2023-10-08T07:06:45.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038279939999999999 2023-10-08T07:06:45.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.095894+0000", 2023-10-08T07:06:45.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6137999999999999e-05 2023-10-08T07:06:45.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.095905+0000", 2023-10-08T07:06:45.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1357e-05 2023-10-08T07:06:45.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.095988+0000", 2023-10-08T07:06:45.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3170999999999994e-05 2023-10-08T07:06:45.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.096140+0000", 2023-10-08T07:06:45.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015196799999999999 2023-10-08T07:06:45.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:45.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.102660+0000", 2023-10-08T07:06:45.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065195599999999998 2023-10-08T07:06:45.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.102715+0000", 2023-10-08T07:06:45.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4889000000000003e-05 2023-10-08T07:06:45.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.102808+0000", 2023-10-08T07:06:45.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2875999999999996e-05 2023-10-08T07:06:45.482 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.483 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.483 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:39 4.15 4:a88808fa:::10000000004.0000001f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:45.483 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:42.188712+0000", 2023-10-08T07:06:45.483 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.2018351319999998, 2023-10-08T07:06:45.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011193211, 2023-10-08T07:06:45.483 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.483 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:45.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:45.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.484 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 39 2023-10-08T07:06:45.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.484 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.188712+0000", 2023-10-08T07:06:45.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.188712+0000", 2023-10-08T07:06:45.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.188714+0000", 2023-10-08T07:06:45.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1409999999999999e-06 2023-10-08T07:06:45.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.192438+0000", 2023-10-08T07:06:45.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037237770000000002 2023-10-08T07:06:45.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.192462+0000", 2023-10-08T07:06:45.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4037999999999999e-05 2023-10-08T07:06:45.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.192474+0000", 2023-10-08T07:06:45.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2391999999999999e-05 2023-10-08T07:06:45.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.192635+0000", 2023-10-08T07:06:45.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016093300000000001 2023-10-08T07:06:45.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.192827+0000", 2023-10-08T07:06:45.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019171600000000001 2023-10-08T07:06:45.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:45.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.199728+0000", 2023-10-08T07:06:45.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00690057 2023-10-08T07:06:45.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.199805+0000", 2023-10-08T07:06:45.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7433000000000002e-05 2023-10-08T07:06:45.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.199905+0000", 2023-10-08T07:06:45.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010021100000000001 2023-10-08T07:06:45.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.489 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.489 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:42 4.38 e39/17 4:1e0977c7:::10000000004.00000022:head v 39'1, mlcod=0'0)", 2023-10-08T07:06:45.489 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:42.478719+0000", 2023-10-08T07:06:45.490 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 2.9118284389999998, 2023-10-08T07:06:45.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010874154, 2023-10-08T07:06:45.490 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.490 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.490 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.478719+0000", 2023-10-08T07:06:45.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.478719+0000", 2023-10-08T07:06:45.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.478720+0000", 2023-10-08T07:06:45.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2023-10-08T07:06:45.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.482781+0000", 2023-10-08T07:06:45.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040602169999999996 2023-10-08T07:06:45.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.482795+0000", 2023-10-08T07:06:45.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3930999999999999e-05 2023-10-08T07:06:45.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.482803+0000", 2023-10-08T07:06:45.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2009999999999999e-06 2023-10-08T07:06:45.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.482882+0000", 2023-10-08T07:06:45.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9352999999999997e-05 2023-10-08T07:06:45.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.482900+0000", 2023-10-08T07:06:45.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7793999999999999e-05 2023-10-08T07:06:45.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.489554+0000", 2023-10-08T07:06:45.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066538999999999999 2023-10-08T07:06:45.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.489593+0000", 2023-10-08T07:06:45.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9227999999999998e-05 2023-10-08T07:06:45.494 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.494 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.495 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:46 4.3a e39/17 4:5d52ad5e:::10000000004.00000026:head v 39'2, mlcod=0'0)", 2023-10-08T07:06:45.495 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:42.844575+0000", 2023-10-08T07:06:45.495 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 2.5459722999999999, 2023-10-08T07:06:45.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010200577000000001, 2023-10-08T07:06:45.495 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.495 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.495 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.844575+0000", 2023-10-08T07:06:45.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.844575+0000", 2023-10-08T07:06:45.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.844576+0000", 2023-10-08T07:06:45.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.161e-06 2023-10-08T07:06:45.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.848314+0000", 2023-10-08T07:06:45.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037382869999999999 2023-10-08T07:06:45.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.848330+0000", 2023-10-08T07:06:45.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5498999999999998e-05 2023-10-08T07:06:45.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.848338+0000", 2023-10-08T07:06:45.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6879999999999999e-06 2023-10-08T07:06:45.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.848428+0000", 2023-10-08T07:06:45.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0181999999999998e-05 2023-10-08T07:06:45.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.848447+0000", 2023-10-08T07:06:45.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9627e-05 2023-10-08T07:06:45.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.854731+0000", 2023-10-08T07:06:45.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062836769999999997 2023-10-08T07:06:45.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.854776+0000", 2023-10-08T07:06:45.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4456000000000003e-05 2023-10-08T07:06:45.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.500 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.501 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:48 4.7 4:e13e8cdb:::10000000004.00000028:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:45.501 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:43.026119+0000", 2023-10-08T07:06:45.501 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 2.364427966, 2023-10-08T07:06:45.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015490617999999999, 2023-10-08T07:06:45.501 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.501 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:45.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:45.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.501 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 48 2023-10-08T07:06:45.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.502 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.026119+0000", 2023-10-08T07:06:45.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.026119+0000", 2023-10-08T07:06:45.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.026121+0000", 2023-10-08T07:06:45.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0389999999999999e-06 2023-10-08T07:06:45.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035074+0000", 2023-10-08T07:06:45.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089530200000000008 2023-10-08T07:06:45.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035104+0000", 2023-10-08T07:06:45.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9896999999999999e-05 2023-10-08T07:06:45.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035124+0000", 2023-10-08T07:06:45.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0188999999999999e-05 2023-10-08T07:06:45.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035225+0000", 2023-10-08T07:06:45.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100399 2023-10-08T07:06:45.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035360+0000", 2023-10-08T07:06:45.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013467199999999999 2023-10-08T07:06:45.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:45.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.041522+0000", 2023-10-08T07:06:45.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061625159999999998 2023-10-08T07:06:45.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.041561+0000", 2023-10-08T07:06:45.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9291e-05 2023-10-08T07:06:45.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.041610+0000", 2023-10-08T07:06:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8594999999999998e-05 2023-10-08T07:06:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:49 4.2b e39/17 4:d7a77d67:::10000000004.00000029:head v 39'1, mlcod=0'0)", 2023-10-08T07:06:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:43.122948+0000", 2023-10-08T07:06:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 2.2675989599999999, 2023-10-08T07:06:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010828376000000001, 2023-10-08T07:06:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:45.507 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:45.508 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:45.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:45.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.122948+0000", 2023-10-08T07:06:45.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:45.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.122948+0000", 2023-10-08T07:06:45.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:45.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:45.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.122950+0000", 2023-10-08T07:06:45.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.64e-06 2023-10-08T07:06:45.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:45.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.126842+0000", 2023-10-08T07:06:45.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038925000000000001 2023-10-08T07:06:45.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:45.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.126863+0000", 2023-10-08T07:06:45.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0287000000000001e-05 2023-10-08T07:06:45.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.126875+0000", 2023-10-08T07:06:45.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2398999999999999e-05 2023-10-08T07:06:45.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:45.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.126969+0000", 2023-10-08T07:06:45.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3527000000000001e-05 2023-10-08T07:06:45.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:45.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.126994+0000", 2023-10-08T07:06:45.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5663000000000001e-05 2023-10-08T07:06:45.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:45.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.133727+0000", 2023-10-08T07:06:45.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067330000000000003 2023-10-08T07:06:45.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:45.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:45.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:45.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.133777+0000", 2023-10-08T07:06:45.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9360000000000002e-05 2023-10-08T07:06:45.512 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.512 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.512 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.512 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:45.512 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:45.512 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:45.514 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:45.512+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:45.514 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:45.614 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:45.613+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:45.681 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:45.682 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:45.682 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.682 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1014 4.2a 4:5404a18c:::10000000004.00000025:head [write 1175552~4096 in=4096b,write 1318912~4096 in=4096b,write 1638400~12288 in=12288b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:45.682 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.679217+0000", 2023-10-08T07:06:45.682 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00092650000000000002, 2023-10-08T07:06:45.682 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00096061400000000004, 2023-10-08T07:06:45.682 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:45.682 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:45.682 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:45.683 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:45.683 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.683 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1014 2023-10-08T07:06:45.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.683 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:45.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.683 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:45.683 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679217+0000", 2023-10-08T07:06:45.683 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.684 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:45.684 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679217+0000", 2023-10-08T07:06:45.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.684 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:45.684 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679218+0000", 2023-10-08T07:06:45.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7400000000000003e-07 2023-10-08T07:06:45.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.684 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:45.684 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679247+0000", 2023-10-08T07:06:45.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9343999999999999e-05 2023-10-08T07:06:45.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:45.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679257+0000", 2023-10-08T07:06:45.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0369e-05 2023-10-08T07:06:45.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679264+0000", 2023-10-08T07:06:45.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4300000000000003e-06 2023-10-08T07:06:45.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:45.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679323+0000", 2023-10-08T07:06:45.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8882999999999998e-05 2023-10-08T07:06:45.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:45.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679418+0000", 2023-10-08T07:06:45.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5424e-05 2023-10-08T07:06:45.687 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.687 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:45.687 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.687 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:1013 4.b e40/17 4:d0c991e0:::10000000004.0000002d:head v 40'20, mlcod=40'17)", 2023-10-08T07:06:45.687 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.679301+0000", 2023-10-08T07:06:45.687 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.000842628, 2023-10-08T07:06:45.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00097365099999999997, 2023-10-08T07:06:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679301+0000", 2023-10-08T07:06:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:45.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679301+0000", 2023-10-08T07:06:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679301+0000", 2023-10-08T07:06:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9100000000000004e-07 2023-10-08T07:06:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679313+0000", 2023-10-08T07:06:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1233000000000001e-05 2023-10-08T07:06:45.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:45.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679319+0000", 2023-10-08T07:06:45.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4949999999999996e-06 2023-10-08T07:06:45.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679323+0000", 2023-10-08T07:06:45.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9149999999999998e-06 2023-10-08T07:06:45.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:45.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679363+0000", 2023-10-08T07:06:45.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9780000000000002e-05 2023-10-08T07:06:45.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:45.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.679375+0000", 2023-10-08T07:06:45.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2041999999999999e-05 2023-10-08T07:06:45.691 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.691 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:45.692 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.692 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:1016 4.29 e40/17 4:94216392:::10000000004.0000002b:head v 40'18, mlcod=40'16)", 2023-10-08T07:06:45.692 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.680181+0000", 2023-10-08T07:06:45.692 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9999623, 2023-10-08T07:06:45.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019206099999999999, 2023-10-08T07:06:45.692 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:45.692 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:45.692 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680181+0000", 2023-10-08T07:06:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680181+0000", 2023-10-08T07:06:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:45.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680182+0000", 2023-10-08T07:06:45.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6400000000000002e-07 2023-10-08T07:06:45.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:45.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680206+0000", 2023-10-08T07:06:45.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3995999999999999e-05 2023-10-08T07:06:45.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:45.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680215+0000", 2023-10-08T07:06:45.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7790000000000007e-06 2023-10-08T07:06:45.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680224+0000", 2023-10-08T07:06:45.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3909999999999998e-06 2023-10-08T07:06:45.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:45.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680266+0000", 2023-10-08T07:06:45.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2565000000000003e-05 2023-10-08T07:06:45.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:45.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680279+0000", 2023-10-08T07:06:45.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2863e-05 2023-10-08T07:06:45.696 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.696 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:45.696 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.696 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1017 4.2 4:43cef10a:::10000000004.00000030:head [write 20480~4096 in=4096b,write 135168~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:45.697 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.680243+0000", 2023-10-08T07:06:45.697 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9999008, 2023-10-08T07:06:45.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000212258, 2023-10-08T07:06:45.697 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:45.697 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:45.697 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:45.697 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:45.697 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.697 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1017 2023-10-08T07:06:45.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.697 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:45.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.698 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:45.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680243+0000", 2023-10-08T07:06:45.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.698 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.698 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:45.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680243+0000", 2023-10-08T07:06:45.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:45.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680244+0000", 2023-10-08T07:06:45.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9599999999999998e-07 2023-10-08T07:06:45.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:45.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680255+0000", 2023-10-08T07:06:45.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0954999999999999e-05 2023-10-08T07:06:45.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:45.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680265+0000", 2023-10-08T07:06:45.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0515e-05 2023-10-08T07:06:45.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680273+0000", 2023-10-08T07:06:45.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1100000000000003e-06 2023-10-08T07:06:45.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:45.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680320+0000", 2023-10-08T07:06:45.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7061999999999998e-05 2023-10-08T07:06:45.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:45.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680409+0000", 2023-10-08T07:06:45.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8419999999999997e-05 2023-10-08T07:06:45.701 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1018 4.1b 4.168dfe9b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.680434+0000", 2023-10-08T07:06:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9997091, 2023-10-08T07:06:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000105334, 2023-10-08T07:06:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:06:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1018 2023-10-08T07:06:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680434+0000", 2023-10-08T07:06:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680434+0000", 2023-10-08T07:06:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680435+0000", 2023-10-08T07:06:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8299999999999995e-07 2023-10-08T07:06:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680478+0000", 2023-10-08T07:06:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3087999999999998e-05 2023-10-08T07:06:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680489+0000", 2023-10-08T07:06:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0907000000000001e-05 2023-10-08T07:06:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680496+0000", 2023-10-08T07:06:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2110000000000001e-06 2023-10-08T07:06:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680550+0000", 2023-10-08T07:06:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3913999999999999e-05 2023-10-08T07:06:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1006 4.2c 4:352c144c:::10000000004.00000003:head [write 2625536~4096 in=4096b,write 2818048~4096 in=4096b,write 2826240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.677096+0000", 2023-10-08T07:06:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0030475699999999999, 2023-10-08T07:06:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0035281029999999999, 2023-10-08T07:06:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1006 2023-10-08T07:06:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677096+0000", 2023-10-08T07:06:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677096+0000", 2023-10-08T07:06:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:45.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677097+0000", 2023-10-08T07:06:45.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4300000000000002e-07 2023-10-08T07:06:45.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:45.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677110+0000", 2023-10-08T07:06:45.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3021e-05 2023-10-08T07:06:45.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:45.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677122+0000", 2023-10-08T07:06:45.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2366e-05 2023-10-08T07:06:45.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677130+0000", 2023-10-08T07:06:45.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9640000000000003e-06 2023-10-08T07:06:45.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:45.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677189+0000", 2023-10-08T07:06:45.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8477000000000003e-05 2023-10-08T07:06:45.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:45.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677276+0000", 2023-10-08T07:06:45.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6935999999999996e-05 2023-10-08T07:06:45.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:45.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677419+0000", 2023-10-08T07:06:45.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014333299999999999 2023-10-08T07:06:45.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:45.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680379+0000", 2023-10-08T07:06:45.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029603910000000002 2023-10-08T07:06:45.714 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.714 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:45.714 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.714 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1007 4.31 4:8de29a03:::10000000004.00000001:head [write 28672~4096 in=4096b,write 172032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:45.714 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.677380+0000", 2023-10-08T07:06:45.714 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0027639000000000001, 2023-10-08T07:06:45.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033439680000000001, 2023-10-08T07:06:45.715 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:45.715 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:45.715 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:45.715 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:45.715 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.715 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1007 2023-10-08T07:06:45.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.716 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:45.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:45.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677380+0000", 2023-10-08T07:06:45.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:45.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677380+0000", 2023-10-08T07:06:45.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:45.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677381+0000", 2023-10-08T07:06:45.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0300000000000001e-06 2023-10-08T07:06:45.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:45.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677391+0000", 2023-10-08T07:06:45.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.075e-05 2023-10-08T07:06:45.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:45.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677401+0000", 2023-10-08T07:06:45.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1770000000000004e-06 2023-10-08T07:06:45.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677407+0000", 2023-10-08T07:06:45.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.922e-06 2023-10-08T07:06:45.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:45.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677457+0000", 2023-10-08T07:06:45.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9144000000000002e-05 2023-10-08T07:06:45.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:45.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.677543+0000", 2023-10-08T07:06:45.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6632000000000007e-05 2023-10-08T07:06:45.719 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.719 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1010 4.1a 4:5a59f83a:::10000000004.00000002:head [write 2711552~4096 in=4096b,write 2748416~4096 in=4096b,write 2789376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.678172+0000", 2023-10-08T07:06:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0019713209999999998, 2023-10-08T07:06:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0026432970000000002, 2023-10-08T07:06:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.721 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1010 2023-10-08T07:06:45.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.721 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:45.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:45.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678172+0000", 2023-10-08T07:06:45.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.723 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:45.723 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678172+0000", 2023-10-08T07:06:45.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:45.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678173+0000", 2023-10-08T07:06:45.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0800000000000004e-07 2023-10-08T07:06:45.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:45.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678192+0000", 2023-10-08T07:06:45.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9375e-05 2023-10-08T07:06:45.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:45.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678202+0000", 2023-10-08T07:06:45.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0091999999999999e-05 2023-10-08T07:06:45.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678209+0000", 2023-10-08T07:06:45.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.63e-06 2023-10-08T07:06:45.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:45.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678254+0000", 2023-10-08T07:06:45.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4728000000000003e-05 2023-10-08T07:06:45.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:45.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678308+0000", 2023-10-08T07:06:45.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4598000000000001e-05 2023-10-08T07:06:45.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:45.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678401+0000", 2023-10-08T07:06:45.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2460000000000006e-05 2023-10-08T07:06:45.727 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.727 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:45.727 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.727 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1011 4.20 4:04004f2c:::10000000004.0000000d:head [write 430080~4096 in=4096b,write 495616~4096 in=4096b,write 815104~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:45.727 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.678447+0000", 2023-10-08T07:06:45.728 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0016961579999999999, 2023-10-08T07:06:45.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002477894, 2023-10-08T07:06:45.728 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:45.728 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:45.728 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:45.728 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:45.728 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:45.728 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1011 2023-10-08T07:06:45.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.728 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:45.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:45.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678447+0000", 2023-10-08T07:06:45.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:45.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678447+0000", 2023-10-08T07:06:45.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:45.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:45.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678448+0000", 2023-10-08T07:06:45.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0299999999999999e-07 2023-10-08T07:06:45.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:45.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678472+0000", 2023-10-08T07:06:45.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4127000000000001e-05 2023-10-08T07:06:45.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:45.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678483+0000", 2023-10-08T07:06:45.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0698e-05 2023-10-08T07:06:45.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:45.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678488+0000", 2023-10-08T07:06:45.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6370000000000004e-06 2023-10-08T07:06:45.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:45.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678544+0000", 2023-10-08T07:06:45.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5220000000000003e-05 2023-10-08T07:06:45.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:45.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678639+0000", 2023-10-08T07:06:45.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5297999999999995e-05 2023-10-08T07:06:45.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:45.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.678813+0000", 2023-10-08T07:06:45.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017372399999999999 2023-10-08T07:06:45.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:45.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:45.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:45.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.680885+0000", 2023-10-08T07:06:45.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020721540000000001 2023-10-08T07:06:45.733 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.733 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:45.734 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.734 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:45.734 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:06:45.734 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 9 2023-10-08T07:06:45.734 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:45.735 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:45.734+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:45.736 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:45.836 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:45.835+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:45.937 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:45.936+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:45.957 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:45.957 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:45.957 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:45.957 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:45.957 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:45.968 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:46.038 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:46.037+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:46.139 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:46.138+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:46.172 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:46.172 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:46.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:46.173 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:46.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.173 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:46.173 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:46.173 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 83.397937533999993, 2023-10-08T07:06:46.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:46.173 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.174 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.174 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.174 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:46.174 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:46.174 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:46.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.174 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:46.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:46.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:46.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:46.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.177 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.177 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:46.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:46.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:46.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:46.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:46.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:46.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:46.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:46.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:46.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:46.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:46.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:46.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:46.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:46.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:46.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:46.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:46.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:46.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:46.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:46.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:46.183 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.183 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.183 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.183 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:46.183 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:46.183 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 83.397885482000007, 2023-10-08T07:06:46.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:46.183 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:46.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:46.184 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:46.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.184 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.184 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.184 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:46.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:46.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:46.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:46.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:46.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:46.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:46.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:46.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:46.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:46.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:46.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:46.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:46.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:46.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:46.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:46.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:46.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:46.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:46.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:46.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:46.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:46.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:46.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.191 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.191 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:46.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:46.191 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.191 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.191 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.191 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.191 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:46.192 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 72.852189005, 2023-10-08T07:06:46.192 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:46.192 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.192 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.192 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.192 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.192 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.192 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:46.192 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.193 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.193 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.193 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:46.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.193 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.193 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.193 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:46.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:46.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:46.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:46.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:46.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:46.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:46.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:46.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:46.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:46.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.197 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:46.197 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:46.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:46.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.197 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.197 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:46.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:46.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:46.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:46.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:46.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:46.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:46.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:46.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:46.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:46.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:46.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:46.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:46.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:46.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:46.200 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.200 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.200 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.201 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.201 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:46.201 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 72.852136479999999, 2023-10-08T07:06:46.201 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:46.201 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.201 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.201 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.201 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.201 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:46.201 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.202 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.202 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:46.202 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.202 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.202 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:46.202 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:46.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:46.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:46.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:46.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:46.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:46.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:46.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:46.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:46.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:46.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:46.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.205 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:46.205 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:46.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:46.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.205 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.205 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:46.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:46.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:46.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:46.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:46.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:46.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.207 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:46.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:46.207 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.207 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.207 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.207 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.207 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:46.208 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 72.851144695000002, 2023-10-08T07:06:46.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:46.208 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.208 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.208 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:46.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:46.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:46.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:46.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:46.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:46.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:46.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:46.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:46.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:46.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:46.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:46.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:46.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:46.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:46.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:46.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:46.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:46.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:46.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:46.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:46.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:46.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:46.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:46.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 72.851091425000007, 2023-10-08T07:06:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:46.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:46.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:46.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:46.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:46.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:46.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.220 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.220 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:46.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:46.220 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.220 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.220 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.220 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.220 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:46.220 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 72.851055579000004, 2023-10-08T07:06:46.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:46.221 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.221 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.221 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:46.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:46.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:46.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:46.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:46.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:46.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:46.224 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:46.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.224 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.224 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:46.224 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:46.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.224 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:46.224 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:46.224 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:46.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.227 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:46.227 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 72.850622724999994, 2023-10-08T07:06:46.227 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:46.227 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.227 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.227 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.227 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:46.227 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.228 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.228 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:46.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.228 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.228 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:46.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:46.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.228 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.228 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:46.229 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:46.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.229 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.229 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:46.229 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:46.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.229 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.229 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:46.229 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:46.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.230 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:46.230 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:46.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.230 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:46.230 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:46.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.232 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.233 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.233 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.233 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:46.233 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 72.850509083000006, 2023-10-08T07:06:46.233 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:46.233 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.233 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.233 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.234 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.234 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:46.234 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.234 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.234 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:46.234 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:46.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:46.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:46.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:46.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:46.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:46.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:46.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:46.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:46.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:46.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:46.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:46.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:46.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.238 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:46.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:46.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.238 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:46.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:46.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.239 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.239 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.239 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:46.239 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:46.239 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.239 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.239 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.239 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.239 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:25 4.c 4:31e28161:::10000000004.00000011:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:46.239 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.911542+0000", 2023-10-08T07:06:46.239 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2582553360000004, 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015283365, 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 25 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.911542+0000", 2023-10-08T07:06:46.240 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.911542+0000", 2023-10-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.911544+0000", 2023-10-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1370000000000001e-06 2023-10-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915273+0000", 2023-10-08T07:06:46.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003729539 2023-10-08T07:06:46.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915287+0000", 2023-10-08T07:06:46.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4058e-05 2023-10-08T07:06:46.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915295+0000", 2023-10-08T07:06:46.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.79e-06 2023-10-08T07:06:46.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.243 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.243 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.243 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915361+0000", 2023-10-08T07:06:46.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6490999999999997e-05 2023-10-08T07:06:46.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.243 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.243 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.243 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915528+0000", 2023-10-08T07:06:46.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016655399999999999 2023-10-08T07:06:46.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:46.244 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915686+0000", 2023-10-08T07:06:46.244 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015756099999999999 2023-10-08T07:06:46.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.244 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.921741+0000", 2023-10-08T07:06:46.244 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060556569999999999 2023-10-08T07:06:46.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.926711+0000", 2023-10-08T07:06:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0049696719999999996 2023-10-08T07:06:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.926779+0000", 2023-10-08T07:06:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8079999999999999e-05 2023-10-08T07:06:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.926826+0000", 2023-10-08T07:06:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6826000000000002e-05 2023-10-08T07:06:46.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.246 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.246 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:26 4.c 4:3352c333:::10000000004.00000012:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:46.246 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:46.246 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.1703894530000003, 2023-10-08T07:06:46.246 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015456749000000001, 2023-10-08T07:06:46.246 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.246 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.246 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 26 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.247 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:46.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.248 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999409+0000", 2023-10-08T07:06:46.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1570000000000001e-06 2023-10-08T07:06:46.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.248 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003237+0000", 2023-10-08T07:06:46.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003827619 2023-10-08T07:06:46.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.249 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.249 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003252+0000", 2023-10-08T07:06:46.249 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5068999999999999e-05 2023-10-08T07:06:46.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.249 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.249 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003259+0000", 2023-10-08T07:06:46.249 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1910000000000003e-06 2023-10-08T07:06:46.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.250 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.250 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003330+0000", 2023-10-08T07:06:46.250 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0469999999999994e-05 2023-10-08T07:06:46.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.250 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.250 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.250 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003504+0000", 2023-10-08T07:06:46.250 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017425700000000001 2023-10-08T07:06:46.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.250 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.250 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:46.251 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003675+0000", 2023-10-08T07:06:46.251 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000171137 2023-10-08T07:06:46.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.251 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.251 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.251 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.010247+0000", 2023-10-08T07:06:46.251 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065716569999999998 2023-10-08T07:06:46.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.251 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.251 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014747+0000", 2023-10-08T07:06:46.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045002740000000003 2023-10-08T07:06:46.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014820+0000", 2023-10-08T07:06:46.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3310000000000001e-05 2023-10-08T07:06:46.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014865+0000", 2023-10-08T07:06:46.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4607999999999997e-05 2023-10-08T07:06:46.253 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.253 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.253 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.253 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:28 4.30 4:0f322a22:::10000000004.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:46.253 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:46.253 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.9984334280000002, 2023-10-08T07:06:46.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015624149, 2023-10-08T07:06:46.253 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.253 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.254 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.254 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:46.254 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.254 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 28 2023-10-08T07:06:46.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.254 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.254 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:46.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.255 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.255 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.255 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:46.255 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.255 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.255 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.255 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171372+0000", 2023-10-08T07:06:46.255 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8220000000000007e-06 2023-10-08T07:06:46.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175253+0000", 2023-10-08T07:06:46.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038812529999999999 2023-10-08T07:06:46.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175268+0000", 2023-10-08T07:06:46.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4782e-05 2023-10-08T07:06:46.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.257 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175275+0000", 2023-10-08T07:06:46.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0899999999999999e-06 2023-10-08T07:06:46.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.257 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175345+0000", 2023-10-08T07:06:46.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9604000000000006e-05 2023-10-08T07:06:46.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.257 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175502+0000", 2023-10-08T07:06:46.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015699799999999999 2023-10-08T07:06:46.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.258 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:46.258 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175652+0000", 2023-10-08T07:06:46.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014977100000000001 2023-10-08T07:06:46.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.258 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.258 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.182743+0000", 2023-10-08T07:06:46.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070913800000000004 2023-10-08T07:06:46.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186876+0000", 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041328670000000001 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186941+0000", 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5506999999999995e-05 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186989+0000", 2023-10-08T07:06:46.259 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7074999999999999e-05 2023-10-08T07:06:46.260 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.260 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.260 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.260 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:35 4.a 4:524fba76:::10000000004.0000001b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:46.260 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:46.260 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.3466289060000003, 2023-10-08T07:06:46.260 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016047682000000001, 2023-10-08T07:06:46.261 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.261 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.261 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.261 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:46.261 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.261 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 35 2023-10-08T07:06:46.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.261 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.261 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.261 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.261 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:46.261 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823216+0000", 2023-10-08T07:06:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7559999999999999e-05 2023-10-08T07:06:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827333+0000", 2023-10-08T07:06:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041169290000000001 2023-10-08T07:06:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827352+0000", 2023-10-08T07:06:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9026e-05 2023-10-08T07:06:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827361+0000", 2023-10-08T07:06:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6999999999999997e-06 2023-10-08T07:06:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827414+0000", 2023-10-08T07:06:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3122999999999999e-05 2023-10-08T07:06:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827530+0000", 2023-10-08T07:06:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000115618 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827626+0000", 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5997999999999998e-05 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.834016+0000", 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.006390298 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839139+0000", 2023-10-08T07:06:46.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0051226370000000002 2023-10-08T07:06:46.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839180+0000", 2023-10-08T07:06:46.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0905999999999998e-05 2023-10-08T07:06:46.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839217+0000", 2023-10-08T07:06:46.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6887000000000001e-05 2023-10-08T07:06:46.267 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.267 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.267 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.267 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:42 4.38 4:1e0977c7:::10000000004.00000022:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:46.267 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:46.267 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.69542393, 2023-10-08T07:06:46.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015514448, 2023-10-08T07:06:46.267 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.267 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.267 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 42 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474376+0000", 2023-10-08T07:06:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1150000000000001e-06 2023-10-08T07:06:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478104+0000", 2023-10-08T07:06:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003728514 2023-10-08T07:06:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478129+0000", 2023-10-08T07:06:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4655999999999999e-05 2023-10-08T07:06:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478140+0000", 2023-10-08T07:06:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1012000000000001e-05 2023-10-08T07:06:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478221+0000", 2023-10-08T07:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1099000000000004e-05 2023-10-08T07:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478343+0000", 2023-10-08T07:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012129 2023-10-08T07:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478444+0000", 2023-10-08T07:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000101587 2023-10-08T07:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.485040+0000", 2023-10-08T07:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065962260000000002 2023-10-08T07:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489774+0000", 2023-10-08T07:06:46.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047335889999999999 2023-10-08T07:06:46.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.273 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489841+0000", 2023-10-08T07:06:46.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7232999999999998e-05 2023-10-08T07:06:46.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.273 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489888+0000", 2023-10-08T07:06:46.274 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7126999999999998e-05 2023-10-08T07:06:46.274 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.274 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.274 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.274 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:49 4.2b 4:d7a77d67:::10000000004.00000029:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:46.274 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:43.118728+0000", 2023-10-08T07:06:46.274 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.051070084, 2023-10-08T07:06:46.274 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369198000000001, 2023-10-08T07:06:46.274 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.275 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.275 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.275 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:46.275 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.275 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 49 2023-10-08T07:06:46.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.275 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.275 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.275 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.275 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.118728+0000", 2023-10-08T07:06:46.275 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.118728+0000", 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.118730+0000", 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4530000000000001e-06 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122434+0000", 2023-10-08T07:06:46.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0037039220000000001 2023-10-08T07:06:46.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122452+0000", 2023-10-08T07:06:46.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7510999999999999e-05 2023-10-08T07:06:46.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122461+0000", 2023-10-08T07:06:46.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9760000000000001e-06 2023-10-08T07:06:46.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122521+0000", 2023-10-08T07:06:46.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0569999999999998e-05 2023-10-08T07:06:46.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122636+0000", 2023-10-08T07:06:46.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011464 2023-10-08T07:06:46.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122741+0000", 2023-10-08T07:06:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010555799999999999 2023-10-08T07:06:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.132341+0000", 2023-10-08T07:06:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0095995449999999993 2023-10-08T07:06:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.134008+0000", 2023-10-08T07:06:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001667015 2023-10-08T07:06:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.134049+0000", 2023-10-08T07:06:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1542000000000003e-05 2023-10-08T07:06:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.134097+0000", 2023-10-08T07:06:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7466000000000003e-05 2023-10-08T07:06:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.281 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.281 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.281 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.281 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1379 4.e 4:70352312:::10000000004.0000001a:head [write 3547136~4096,write 3588096~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.281 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:46.281 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.35031235199999999, 2023-10-08T07:06:46.281 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016369865000000001, 2023-10-08T07:06:46.281 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.281 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.281 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.281 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1379 2023-10-08T07:06:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:46.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.283 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819486+0000", 2023-10-08T07:06:46.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:06:46.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.283 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819560+0000", 2023-10-08T07:06:46.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4473000000000003e-05 2023-10-08T07:06:46.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.284 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.284 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819571+0000", 2023-10-08T07:06:46.284 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0769e-05 2023-10-08T07:06:46.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.284 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.284 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819576+0000", 2023-10-08T07:06:46.284 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5410000000000002e-06 2023-10-08T07:06:46.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.284 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.285 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.821667+0000", 2023-10-08T07:06:46.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020909069999999999 2023-10-08T07:06:46.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.285 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.821747+0000", 2023-10-08T07:06:46.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0260999999999996e-05 2023-10-08T07:06:46.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.285 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835701+0000", 2023-10-08T07:06:46.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013954148 2023-10-08T07:06:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835762+0000", 2023-10-08T07:06:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.084e-05 2023-10-08T07:06:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.286 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835855+0000", 2023-10-08T07:06:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3425999999999996e-05 2023-10-08T07:06:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2064 4.32 4:4efc9492:::10000000004.00000032:head [write 110592~4096,write 249856~4096,write 270336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:46.287 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.11196682600000001, 2023-10-08T07:06:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019126292, 2023-10-08T07:06:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2064 2023-10-08T07:06:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.289 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:46.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.289 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.289 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:46.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.290 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.290 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057832+0000", 2023-10-08T07:06:46.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3699999999999999e-07 2023-10-08T07:06:46.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.290 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.290 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057886+0000", 2023-10-08T07:06:46.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4531999999999999e-05 2023-10-08T07:06:46.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.291 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.291 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057901+0000", 2023-10-08T07:06:46.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4518999999999999e-05 2023-10-08T07:06:46.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.291 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.291 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057910+0000", 2023-10-08T07:06:46.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4579999999999999e-06 2023-10-08T07:06:46.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057963+0000", 2023-10-08T07:06:46.292 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3161000000000001e-05 2023-10-08T07:06:46.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.058023+0000", 2023-10-08T07:06:46.292 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0027e-05 2023-10-08T07:06:46.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076814+0000", 2023-10-08T07:06:46.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018790187 2023-10-08T07:06:46.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.293 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076879+0000", 2023-10-08T07:06:46.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4999999999999994e-05 2023-10-08T07:06:46.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.293 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076957+0000", 2023-10-08T07:06:46.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8571000000000004e-05 2023-10-08T07:06:46.294 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.294 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.294 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.294 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2068 4.1a 4:5a59f83a:::10000000004.00000002:head [write 1794048~4096,write 1806336~4096,write 1937408~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.294 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:46.294 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.110790416, 2023-10-08T07:06:46.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017795372, 2023-10-08T07:06:46.295 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.295 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.295 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.295 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:46.295 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.295 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2068 2023-10-08T07:06:46.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.295 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:46.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:46.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059008+0000", 2023-10-08T07:06:46.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1299999999999998e-07 2023-10-08T07:06:46.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.297 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059061+0000", 2023-10-08T07:06:46.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2905000000000003e-05 2023-10-08T07:06:46.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.297 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059077+0000", 2023-10-08T07:06:46.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6099e-05 2023-10-08T07:06:46.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.298 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.298 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059088+0000", 2023-10-08T07:06:46.298 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1056000000000001e-05 2023-10-08T07:06:46.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.298 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.298 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059146+0000", 2023-10-08T07:06:46.298 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7385e-05 2023-10-08T07:06:46.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.298 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059210+0000", 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4509000000000002e-05 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059307+0000", 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6273000000000005e-05 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.060916+0000", 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001609365 2023-10-08T07:06:46.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076698+0000", 2023-10-08T07:06:46.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015781951999999998 2023-10-08T07:06:46.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076762+0000", 2023-10-08T07:06:46.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3744999999999994e-05 2023-10-08T07:06:46.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076803+0000", 2023-10-08T07:06:46.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1170000000000001e-05 2023-10-08T07:06:46.301 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.301 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.301 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.301 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2087 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1101824~12288,write 1150976~4096,write 1171456~4096,write 1265664~4096,write 1376256~4096,write 1519616~4096,write 1691648~4096,write 1724416~4096,write 1753088~4096,write 1794048~4096,write 1908736~4096,write 1921024~4096,write 2011136~4096,write 2207744~4096,write 2285568~4096,write 2744320~8192,write 2760704~4096,write 2879488~4096,write 2891776~4096,write 3129344~4096,write 3145728~4096,write 3215360~4096,write 3330048~8192,write 3362816~4096,write 3387392~4096,write 3485696~4096,write 3620864~4096,write 4120576~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.301 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:46.301 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.105819967, 2023-10-08T07:06:46.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016557490000000001, 2023-10-08T07:06:46.302 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.302 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.302 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.302 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:46.302 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.302 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2087 2023-10-08T07:06:46.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.302 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:46.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.303 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:46.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.303 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:46.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:06:46.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064123+0000", 2023-10-08T07:06:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014467700000000001 2023-10-08T07:06:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064131+0000", 2023-10-08T07:06:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9230000000000002e-06 2023-10-08T07:06:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064139+0000", 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5560000000000002e-06 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.073553+0000", 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0094146679999999993 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.073655+0000", 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010128000000000001 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.074076+0000", 2023-10-08T07:06:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00042132399999999999 2023-10-08T07:06:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.077289+0000", 2023-10-08T07:06:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032133589999999998 2023-10-08T07:06:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080463+0000", 2023-10-08T07:06:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031740940000000001 2023-10-08T07:06:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080512+0000", 2023-10-08T07:06:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8343000000000001e-05 2023-10-08T07:06:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080535+0000", 2023-10-08T07:06:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3586000000000001e-05 2023-10-08T07:06:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.308 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.308 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.308 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2088 4.2a 4:5404a18c:::10000000004.00000025:head [write 774144~4096,write 811008~4096,write 884736~4096,write 909312~4096,write 958464~4096,write 1028096~4096,write 1191936~4096,write 1224704~4096,write 1261568~4096,write 1294336~4096,write 1331200~4096,write 1523712~4096,write 1540096~4096,write 1572864~4096,write 1667072~4096,write 1810432~4096,write 1818624~4096,write 1859584~4096,write 1892352~4096,write 1916928~4096,write 2084864~4096,write 2158592~4096,write 2494464~4096,write 2543616~4096,write 2703360~4096,write 2748416~8192,write 2777088~4096,write 3784704~4096,write 3911680~4096,write 4120576~4096,write 4145152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.308 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:46.308 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.10563586899999999, 2023-10-08T07:06:46.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017312658000000002, 2023-10-08T07:06:46.308 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:46.308 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.308 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:46.308 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2088 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:46.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:46.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:46.310 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064163+0000", 2023-10-08T07:06:46.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:46.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:46.310 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064375+0000", 2023-10-08T07:06:46.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00021216599999999999 2023-10-08T07:06:46.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.311 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:46.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064385+0000", 2023-10-08T07:06:46.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0525e-05 2023-10-08T07:06:46.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.311 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064395+0000", 2023-10-08T07:06:46.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1689999999999998e-06 2023-10-08T07:06:46.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.311 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:46.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076644+0000", 2023-10-08T07:06:46.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012248991000000001 2023-10-08T07:06:46.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:46.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076709+0000", 2023-10-08T07:06:46.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5708000000000002e-05 2023-10-08T07:06:46.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:46.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081362+0000", 2023-10-08T07:06:46.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0046527449999999998 2023-10-08T07:06:46.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:46.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081425+0000", 2023-10-08T07:06:46.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3250000000000006e-05 2023-10-08T07:06:46.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:46.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:46.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:46.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081475+0000", 2023-10-08T07:06:46.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9246999999999998e-05 2023-10-08T07:06:46.313 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.314 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.314 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.314 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:46.314 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:46.314 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:46.315 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:46.314+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:46.316 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:46.416 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:46.415+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:46.485 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:3220 4.29 4:94216392:::10000000004.0000002b:head [write 999424~4096 in=4096b,write 1134592~4096 in=4096b,write 1269760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:46.480654+0000", 2023-10-08T07:06:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0036096980000000002, 2023-10-08T07:06:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036314379999999999, 2023-10-08T07:06:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3220 2023-10-08T07:06:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.480654+0000", 2023-10-08T07:06:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.480654+0000", 2023-10-08T07:06:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.480655+0000", 2023-10-08T07:06:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6299999999999993e-07 2023-10-08T07:06:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.480686+0000", 2023-10-08T07:06:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1331999999999997e-05 2023-10-08T07:06:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.480696+0000", 2023-10-08T07:06:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5889999999999992e-06 2023-10-08T07:06:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.480701+0000", 2023-10-08T07:06:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.169e-06 2023-10-08T07:06:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.480742+0000", 2023-10-08T07:06:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1257000000000002e-05 2023-10-08T07:06:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.480820+0000", 2023-10-08T07:06:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7257999999999998e-05 2023-10-08T07:06:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.480904+0000", 2023-10-08T07:06:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4172999999999995e-05 2023-10-08T07:06:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482613+0000", 2023-10-08T07:06:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017089830000000001 2023-10-08T07:06:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:3222 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 3047424~4096 in=4096b,write 3321856~4096 in=4096b,write 3706880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:46.482471+0000", 2023-10-08T07:06:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001793153, 2023-10-08T07:06:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019351920000000001, 2023-10-08T07:06:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3222 2023-10-08T07:06:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482471+0000", 2023-10-08T07:06:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482471+0000", 2023-10-08T07:06:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482471+0000", 2023-10-08T07:06:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8700000000000005e-07 2023-10-08T07:06:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482481+0000", 2023-10-08T07:06:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2023-10-08T07:06:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482490+0000", 2023-10-08T07:06:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2023-10-08T07:06:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482495+0000", 2023-10-08T07:06:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1240000000000004e-06 2023-10-08T07:06:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482548+0000", 2023-10-08T07:06:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2256999999999998e-05 2023-10-08T07:06:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482638+0000", 2023-10-08T07:06:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0362e-05 2023-10-08T07:06:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:3223 4.10 4:08d50e0e:::10000000004.0000003f:head [write 1134592~4096 in=4096b,write 1679360~4096 in=4096b,write 1708032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:46.482989+0000", 2023-10-08T07:06:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001274872, 2023-10-08T07:06:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014736459999999999, 2023-10-08T07:06:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3223 2023-10-08T07:06:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482989+0000", 2023-10-08T07:06:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482989+0000", 2023-10-08T07:06:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482990+0000", 2023-10-08T07:06:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7299999999999995e-07 2023-10-08T07:06:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.482998+0000", 2023-10-08T07:06:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2509999999999994e-06 2023-10-08T07:06:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.483006+0000", 2023-10-08T07:06:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6759999999999996e-06 2023-10-08T07:06:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.483012+0000", 2023-10-08T07:06:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2023-10-08T07:06:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.483054+0000", 2023-10-08T07:06:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2182999999999999e-05 2023-10-08T07:06:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.483132+0000", 2023-10-08T07:06:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7164999999999997e-05 2023-10-08T07:06:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:3224 4.38 e40/17 4:1e0977c7:::10000000004.00000022:head v 40'60, mlcod=40'58)", 2023-10-08T07:06:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:46.483709+0000", 2023-10-08T07:06:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00055451800000000005, 2023-10-08T07:06:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00083074099999999997, 2023-10-08T07:06:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.483709+0000", 2023-10-08T07:06:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.483709+0000", 2023-10-08T07:06:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.483710+0000", 2023-10-08T07:06:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0900000000000001e-07 2023-10-08T07:06:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.483723+0000", 2023-10-08T07:06:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2659e-05 2023-10-08T07:06:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.483733+0000", 2023-10-08T07:06:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0582e-05 2023-10-08T07:06:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.483741+0000", 2023-10-08T07:06:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9130000000000003e-06 2023-10-08T07:06:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.483782+0000", 2023-10-08T07:06:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0615999999999999e-05 2023-10-08T07:06:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.483796+0000", 2023-10-08T07:06:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4517e-05 2023-10-08T07:06:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:3225 4.20 e40/17 4:04004f2c:::10000000004.0000000d:head v 40'166, mlcod=40'164)", 2023-10-08T07:06:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:46.484000+0000", 2023-10-08T07:06:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00026426599999999998, 2023-10-08T07:06:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060438099999999997, 2023-10-08T07:06:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484000+0000", 2023-10-08T07:06:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484000+0000", 2023-10-08T07:06:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484000+0000", 2023-10-08T07:06:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:06:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484014+0000", 2023-10-08T07:06:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3889e-05 2023-10-08T07:06:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484026+0000", 2023-10-08T07:06:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1918e-05 2023-10-08T07:06:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484031+0000", 2023-10-08T07:06:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4600000000000002e-06 2023-10-08T07:06:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484077+0000", 2023-10-08T07:06:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6010000000000002e-05 2023-10-08T07:06:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484098+0000", 2023-10-08T07:06:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0346000000000001e-05 2023-10-08T07:06:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:3226 4.7 4:e13e8cdb:::10000000004.00000028:head [write 1478656~4096 in=4096b,write 1540096~4096 in=4096b,write 1548288~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:46.484022+0000", 2023-10-08T07:06:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000241535, 2023-10-08T07:06:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00065625000000000004, 2023-10-08T07:06:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3226 2023-10-08T07:06:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484022+0000", 2023-10-08T07:06:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484022+0000", 2023-10-08T07:06:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484023+0000", 2023-10-08T07:06:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8700000000000005e-07 2023-10-08T07:06:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484038+0000", 2023-10-08T07:06:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4625e-05 2023-10-08T07:06:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484050+0000", 2023-10-08T07:06:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2449000000000001e-05 2023-10-08T07:06:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484058+0000", 2023-10-08T07:06:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5660000000000001e-06 2023-10-08T07:06:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484117+0000", 2023-10-08T07:06:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9821000000000002e-05 2023-10-08T07:06:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484193+0000", 2023-10-08T07:06:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5970999999999995e-05 2023-10-08T07:06:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:3227 4.20 e40/17)", 2023-10-08T07:06:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:46.484705+0000", 2023-10-08T07:06:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9995589, 2023-10-08T07:06:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8417000000000001e-05, 2023-10-08T07:06:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:06:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484705+0000", 2023-10-08T07:06:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484705+0000", 2023-10-08T07:06:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484705+0000", 2023-10-08T07:06:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2100000000000002e-07 2023-10-08T07:06:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484713+0000", 2023-10-08T07:06:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3629999999999994e-06 2023-10-08T07:06:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484720+0000", 2023-10-08T07:06:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.725e-06 2023-10-08T07:06:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.484725+0000", 2023-10-08T07:06:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6600000000000003e-06 2023-10-08T07:06:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:06:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 7 2023-10-08T07:06:46.518 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:46.520 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:46.520 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:46.518+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:46.621 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:46.620+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:46.692 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:46.692 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:46.692 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:46.692 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:46.692 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:46.706 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:46.721 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:46.720+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:46.822 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:46.821+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:46.884 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:46.884 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:46.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:46.884 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:46.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.884 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.884 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:46.884 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.565263770000001, 2023-10-08T07:06:46.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:46.885 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.885 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.885 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:46.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:46.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:46.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:46.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:46.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:46.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:46.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:46.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:46.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:46.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:46.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:46.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:46.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:46.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:46.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:46.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:46.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:46.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:46.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:46.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:46.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.890 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.565189986000007, 2023-10-08T07:06:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:46.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:46.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:46.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:46.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:46.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:46.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:46.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:46.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:46.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:46.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:46.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:46.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:46.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:46.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:46.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:46.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:46.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:46.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:46.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:46.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:46.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:46.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:46.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:46.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:46.897 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.897 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.897 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.897 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.897 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:46.897 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.564602238999996, 2023-10-08T07:06:46.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:46.898 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.898 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.898 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:46.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:46.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:46.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:46.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:46.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:46.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:46.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:46.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:46.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:46.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:46.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:46.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:46.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:46.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:46.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:46.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:46.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:46.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:46.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:46.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:46.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:46.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:46.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:46.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:46.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.903 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.904 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.904 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:46.904 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.564561662000003, 2023-10-08T07:06:46.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013001472, 2023-10-08T07:06:46.904 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.904 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.904 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:46.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317224+0000", 2023-10-08T07:06:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317225+0000", 2023-10-08T07:06:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317229+0000", 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.301e-06 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317237+0000", 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317245+0000", 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:06:46.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317314+0000", 2023-10-08T07:06:46.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9621000000000003e-05 2023-10-08T07:06:46.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317444+0000", 2023-10-08T07:06:46.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129918 2023-10-08T07:06:46.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:46.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317555+0000", 2023-10-08T07:06:46.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011093 2023-10-08T07:06:46.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319380+0000", 2023-10-08T07:06:46.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018253869999999999 2023-10-08T07:06:46.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330150+0000", 2023-10-08T07:06:46.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010769340000000001 2023-10-08T07:06:46.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330184+0000", 2023-10-08T07:06:46.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4054000000000003e-05 2023-10-08T07:06:46.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330226+0000", 2023-10-08T07:06:46.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2052999999999999e-05 2023-10-08T07:06:46.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.910 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.910 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.910 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.910 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:46.910 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.564524093000003, 2023-10-08T07:06:46.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013191112, 2023-10-08T07:06:46.910 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.910 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:46.910 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317262+0000", 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317263+0000", 2023-10-08T07:06:46.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:06:46.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317267+0000", 2023-10-08T07:06:46.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8630000000000001e-06 2023-10-08T07:06:46.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317275+0000", 2023-10-08T07:06:46.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4069999999999993e-06 2023-10-08T07:06:46.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317281+0000", 2023-10-08T07:06:46.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:06:46.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318237+0000", 2023-10-08T07:06:46.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095520800000000003 2023-10-08T07:06:46.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318370+0000", 2023-10-08T07:06:46.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013320000000000001 2023-10-08T07:06:46.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330453+0000", 2023-10-08T07:06:46.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01208323 2023-10-08T07:06:46.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.914 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.914 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:46.915 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:46.915 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 73.564456652999993, 2023-10-08T07:06:46.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:46.915 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.915 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:46.915 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:46.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:46.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:46.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:46.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:46.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:46.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:46.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:46.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:46.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:46.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:32 4.3b 4:df0e4bf8:::10000000004.00000018:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.550495+0000", 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.3312911779999999, 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011375560999999999, 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.919 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.920 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.920 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.920 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.920 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 32 2023-10-08T07:06:46.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.920 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.550495+0000", 2023-10-08T07:06:46.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.550495+0000", 2023-10-08T07:06:46.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.550496+0000", 2023-10-08T07:06:46.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2470000000000001e-06 2023-10-08T07:06:46.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554190+0000", 2023-10-08T07:06:46.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036941529999999999 2023-10-08T07:06:46.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554206+0000", 2023-10-08T07:06:46.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6047999999999999e-05 2023-10-08T07:06:46.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554233+0000", 2023-10-08T07:06:46.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6591999999999999e-05 2023-10-08T07:06:46.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554300+0000", 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7529999999999999e-05 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.554410+0000", 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000109448 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.561722+0000", 2023-10-08T07:06:46.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073119259999999998 2023-10-08T07:06:46.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.561786+0000", 2023-10-08T07:06:46.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3758999999999997e-05 2023-10-08T07:06:46.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.561870+0000", 2023-10-08T07:06:46.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4858000000000006e-05 2023-10-08T07:06:46.924 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:35 4.a e38/17 4:524fba76:::10000000004.0000001b:head v 38'1, mlcod=0'0)", 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:41.827765+0000", 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.0540213779999998, 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011168861, 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.827765+0000", 2023-10-08T07:06:46.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.827765+0000", 2023-10-08T07:06:46.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.827766+0000", 2023-10-08T07:06:46.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.336e-06 2023-10-08T07:06:46.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831833+0000", 2023-10-08T07:06:46.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040671120000000003 2023-10-08T07:06:46.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831860+0000", 2023-10-08T07:06:46.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6925999999999999e-05 2023-10-08T07:06:46.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831892+0000", 2023-10-08T07:06:46.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2360000000000002e-05 2023-10-08T07:06:46.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831968+0000", 2023-10-08T07:06:46.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5901000000000004e-05 2023-10-08T07:06:46.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.831988+0000", 2023-10-08T07:06:46.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0182000000000001e-05 2023-10-08T07:06:46.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.838865+0000", 2023-10-08T07:06:46.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068763390000000004 2023-10-08T07:06:46.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:41.838934+0000", 2023-10-08T07:06:46.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8705e-05 2023-10-08T07:06:46.929 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.930 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.930 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37 4.19 4:9a1dab10:::10000000004.0000001d:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:46.930 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:42.002369+0000", 2023-10-08T07:06:46.930 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8794168779999998, 2023-10-08T07:06:46.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011046347999999999, 2023-10-08T07:06:46.930 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.930 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.930 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.930 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.002369+0000", 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.002369+0000", 2023-10-08T07:06:46.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.002372+0000", 2023-10-08T07:06:46.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0580000000000002e-06 2023-10-08T07:06:46.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006140+0000", 2023-10-08T07:06:46.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037672869999999998 2023-10-08T07:06:46.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006164+0000", 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4694000000000001e-05 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006177+0000", 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3209e-05 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006296+0000", 2023-10-08T07:06:46.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000118573 2023-10-08T07:06:46.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.006485+0000", 2023-10-08T07:06:46.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018935600000000001 2023-10-08T07:06:46.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.013276+0000", 2023-10-08T07:06:46.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067901940000000003 2023-10-08T07:06:46.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.013325+0000", 2023-10-08T07:06:46.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9042000000000002e-05 2023-10-08T07:06:46.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.013416+0000", 2023-10-08T07:06:46.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0934999999999996e-05 2023-10-08T07:06:46.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.935 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.936 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:38 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:46.936 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:42.092037+0000", 2023-10-08T07:06:46.936 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.7897486709999999, 2023-10-08T07:06:46.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010770381000000001, 2023-10-08T07:06:46.936 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.936 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.937 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 38 2023-10-08T07:06:46.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.937 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.092037+0000", 2023-10-08T07:06:46.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.092037+0000", 2023-10-08T07:06:46.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.092040+0000", 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4279999999999999e-06 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.095868+0000", 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038279939999999999 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.095894+0000", 2023-10-08T07:06:46.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6137999999999999e-05 2023-10-08T07:06:46.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.095905+0000", 2023-10-08T07:06:46.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1357e-05 2023-10-08T07:06:46.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.095988+0000", 2023-10-08T07:06:46.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3170999999999994e-05 2023-10-08T07:06:46.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.096140+0000", 2023-10-08T07:06:46.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015196799999999999 2023-10-08T07:06:46.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.102660+0000", 2023-10-08T07:06:46.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065195599999999998 2023-10-08T07:06:46.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.102715+0000", 2023-10-08T07:06:46.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4889000000000003e-05 2023-10-08T07:06:46.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.102808+0000", 2023-10-08T07:06:46.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2875999999999996e-05 2023-10-08T07:06:46.941 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.941 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.941 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.942 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:39 4.15 4:a88808fa:::10000000004.0000001f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:46.942 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:42.188712+0000", 2023-10-08T07:06:46.942 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.6930739050000003, 2023-10-08T07:06:46.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011193211, 2023-10-08T07:06:46.942 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.942 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.942 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.942 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.942 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.942 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 39 2023-10-08T07:06:46.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.188712+0000", 2023-10-08T07:06:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.188712+0000", 2023-10-08T07:06:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.188714+0000", 2023-10-08T07:06:46.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1409999999999999e-06 2023-10-08T07:06:46.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.192438+0000", 2023-10-08T07:06:46.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037237770000000002 2023-10-08T07:06:46.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.192462+0000", 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4037999999999999e-05 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.192474+0000", 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2391999999999999e-05 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.192635+0000", 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016093300000000001 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.192827+0000", 2023-10-08T07:06:46.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019171600000000001 2023-10-08T07:06:46.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.199728+0000", 2023-10-08T07:06:46.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00690057 2023-10-08T07:06:46.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.199805+0000", 2023-10-08T07:06:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7433000000000002e-05 2023-10-08T07:06:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.199905+0000", 2023-10-08T07:06:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010021100000000001 2023-10-08T07:06:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.948 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:42 4.38 e39/17 4:1e0977c7:::10000000004.00000022:head v 39'1, mlcod=0'0)", 2023-10-08T07:06:46.948 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:42.478719+0000", 2023-10-08T07:06:46.948 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4030672119999998, 2023-10-08T07:06:46.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010874154, 2023-10-08T07:06:46.948 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.948 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.948 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.478719+0000", 2023-10-08T07:06:46.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.478719+0000", 2023-10-08T07:06:46.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.478720+0000", 2023-10-08T07:06:46.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.53e-06 2023-10-08T07:06:46.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.482781+0000", 2023-10-08T07:06:46.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040602169999999996 2023-10-08T07:06:46.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.482795+0000", 2023-10-08T07:06:46.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3930999999999999e-05 2023-10-08T07:06:46.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.482803+0000", 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2009999999999999e-06 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.482882+0000", 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9352999999999997e-05 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.482900+0000", 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7793999999999999e-05 2023-10-08T07:06:46.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.489554+0000", 2023-10-08T07:06:46.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066538999999999999 2023-10-08T07:06:46.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:42.489593+0000", 2023-10-08T07:06:46.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9227999999999998e-05 2023-10-08T07:06:46.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.952 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.953 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:48 4.7 4:e13e8cdb:::10000000004.00000028:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:46.953 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:43.026119+0000", 2023-10-08T07:06:46.953 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.8556667390000001, 2023-10-08T07:06:46.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015490617999999999, 2023-10-08T07:06:46.953 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.953 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.954 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 48 2023-10-08T07:06:46.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.954 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.026119+0000", 2023-10-08T07:06:46.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.026119+0000", 2023-10-08T07:06:46.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.026121+0000", 2023-10-08T07:06:46.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0389999999999999e-06 2023-10-08T07:06:46.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035074+0000", 2023-10-08T07:06:46.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089530200000000008 2023-10-08T07:06:46.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035104+0000", 2023-10-08T07:06:46.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9896999999999999e-05 2023-10-08T07:06:46.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035124+0000", 2023-10-08T07:06:46.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0188999999999999e-05 2023-10-08T07:06:46.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035225+0000", 2023-10-08T07:06:46.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100399 2023-10-08T07:06:46.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035360+0000", 2023-10-08T07:06:46.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013467199999999999 2023-10-08T07:06:46.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.041522+0000", 2023-10-08T07:06:46.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061625159999999998 2023-10-08T07:06:46.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.041561+0000", 2023-10-08T07:06:46.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9291e-05 2023-10-08T07:06:46.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.041610+0000", 2023-10-08T07:06:46.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8594999999999998e-05 2023-10-08T07:06:46.958 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.958 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.958 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:49 4.2b e39/17 4:d7a77d67:::10000000004.00000029:head v 39'1, mlcod=0'0)", 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:43.122948+0000", 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.758837733, 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010828376000000001, 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.122948+0000", 2023-10-08T07:06:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.122948+0000", 2023-10-08T07:06:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.122950+0000", 2023-10-08T07:06:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.64e-06 2023-10-08T07:06:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.126842+0000", 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038925000000000001 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.126863+0000", 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0287000000000001e-05 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.126875+0000", 2023-10-08T07:06:46.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2398999999999999e-05 2023-10-08T07:06:46.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.126969+0000", 2023-10-08T07:06:46.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3527000000000001e-05 2023-10-08T07:06:46.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.126994+0000", 2023-10-08T07:06:46.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5663000000000001e-05 2023-10-08T07:06:46.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.133727+0000", 2023-10-08T07:06:46.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067330000000000003 2023-10-08T07:06:46.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.133777+0000", 2023-10-08T07:06:46.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9360000000000002e-05 2023-10-08T07:06:46.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.963 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.964 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:533 4.b 4:d0c991e0:::10000000004.0000002d:head [write 1671168~4096,write 1761280~4096,write 1884160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.964 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:45.487461+0000", 2023-10-08T07:06:46.964 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.3943249049999999, 2023-10-08T07:06:46.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010969387000000001, 2023-10-08T07:06:46.964 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.964 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.964 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.964 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.964 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.964 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 533 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.487461+0000", 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.487461+0000", 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.487462+0000", 2023-10-08T07:06:46.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4499999999999996e-07 2023-10-08T07:06:46.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.487485+0000", 2023-10-08T07:06:46.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3213e-05 2023-10-08T07:06:46.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.487496+0000", 2023-10-08T07:06:46.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0555e-05 2023-10-08T07:06:46.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.487503+0000", 2023-10-08T07:06:46.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1509999999999998e-06 2023-10-08T07:06:46.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.487560+0000", 2023-10-08T07:06:46.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7237000000000001e-05 2023-10-08T07:06:46.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.487649+0000", 2023-10-08T07:06:46.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8727000000000006e-05 2023-10-08T07:06:46.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:46.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.487808+0000", 2023-10-08T07:06:46.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015883499999999999 2023-10-08T07:06:46.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.495613+0000", 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078048620000000001 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.498372+0000", 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027595889999999998 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.498409+0000", 2023-10-08T07:06:46.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6689000000000001e-05 2023-10-08T07:06:46.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.498431+0000", 2023-10-08T07:06:46.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1684000000000001e-05 2023-10-08T07:06:46.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.970 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.970 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:1252 4.c e40/17 4:3352c333:::10000000004.00000012:head v 40'36, mlcod=40'32)", 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:45.769667+0000", 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.112119165, 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011288769000000001, 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.769667+0000", 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.769667+0000", 2023-10-08T07:06:46.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.769668+0000", 2023-10-08T07:06:46.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2200000000000004e-07 2023-10-08T07:06:46.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.769678+0000", 2023-10-08T07:06:46.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0217000000000001e-05 2023-10-08T07:06:46.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.769688+0000", 2023-10-08T07:06:46.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0718e-05 2023-10-08T07:06:46.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.769694+0000", 2023-10-08T07:06:46.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2129999999999999e-06 2023-10-08T07:06:46.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.772108+0000", 2023-10-08T07:06:46.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002414757 2023-10-08T07:06:46.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.772124+0000", 2023-10-08T07:06:46.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5760000000000002e-05 2023-10-08T07:06:46.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.780912+0000", 2023-10-08T07:06:46.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008787642 2023-10-08T07:06:46.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.780956+0000", 2023-10-08T07:06:46.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.384e-05 2023-10-08T07:06:46.975 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.975 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.975 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.976 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:1391 4.16 4:69eefec8:::10000000004.0000003a:head [write 3039232~4096,write 3096576~4096,write 3104768~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.976 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:45.823106+0000", 2023-10-08T07:06:46.976 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.058680031, 2023-10-08T07:06:46.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013965452, 2023-10-08T07:06:46.976 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.976 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.976 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.976 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.976 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.976 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1391 2023-10-08T07:06:46.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.976 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823106+0000", 2023-10-08T07:06:46.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823106+0000", 2023-10-08T07:06:46.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823107+0000", 2023-10-08T07:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8800000000000002e-07 2023-10-08T07:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823134+0000", 2023-10-08T07:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6968999999999999e-05 2023-10-08T07:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823144+0000", 2023-10-08T07:06:46.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0213e-05 2023-10-08T07:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823149+0000", 2023-10-08T07:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4650000000000002e-06 2023-10-08T07:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823189+0000", 2023-10-08T07:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9279000000000001e-05 2023-10-08T07:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823249+0000", 2023-10-08T07:06:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0288999999999998e-05 2023-10-08T07:06:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823349+0000", 2023-10-08T07:06:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100084 2023-10-08T07:06:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.826473+0000", 2023-10-08T07:06:46.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031240389999999999 2023-10-08T07:06:46.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.836982+0000", 2023-10-08T07:06:46.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010508721 2023-10-08T07:06:46.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.837035+0000", 2023-10-08T07:06:46.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3310000000000003e-05 2023-10-08T07:06:46.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.837071+0000", 2023-10-08T07:06:46.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6294999999999997e-05 2023-10-08T07:06:46.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.982 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.982 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:1393 4.26 4:672c55ca:::10000000004.00000006:head [write 2113536~4096,write 2392064~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.982 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:45.823661+0000", 2023-10-08T07:06:46.983 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0581252379999999, 2023-10-08T07:06:46.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013366281000000001, 2023-10-08T07:06:46.983 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.983 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1393 2023-10-08T07:06:46.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.983 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823661+0000", 2023-10-08T07:06:46.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823661+0000", 2023-10-08T07:06:46.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823662+0000", 2023-10-08T07:06:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6700000000000003e-07 2023-10-08T07:06:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823672+0000", 2023-10-08T07:06:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2023-10-08T07:06:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823681+0000", 2023-10-08T07:06:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5320000000000006e-06 2023-10-08T07:06:46.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823689+0000", 2023-10-08T07:06:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7370000000000006e-06 2023-10-08T07:06:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823736+0000", 2023-10-08T07:06:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7346999999999999e-05 2023-10-08T07:06:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823818+0000", 2023-10-08T07:06:46.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1754000000000004e-05 2023-10-08T07:06:46.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:46.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823951+0000", 2023-10-08T07:06:46.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013372199999999999 2023-10-08T07:06:46.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.826494+0000", 2023-10-08T07:06:46.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025422690000000002 2023-10-08T07:06:46.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:46.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.836959+0000", 2023-10-08T07:06:46.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010465275 2023-10-08T07:06:46.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.836992+0000", 2023-10-08T07:06:46.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3322999999999999e-05 2023-10-08T07:06:46.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.837027+0000", 2023-10-08T07:06:46.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4897999999999997e-05 2023-10-08T07:06:46.990 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.990 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:3115 4.15 4:aaa619cf:::10000000004.00000004:head [write 4022272~4096,write 4030464~4096,write 4042752~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:46.445851+0000", 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43593463399999999, 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012129344, 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.991 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3115 2023-10-08T07:06:46.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.992 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.445851+0000", 2023-10-08T07:06:46.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.445851+0000", 2023-10-08T07:06:46.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.445852+0000", 2023-10-08T07:06:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2999999999999999e-07 2023-10-08T07:06:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.445867+0000", 2023-10-08T07:06:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4266e-05 2023-10-08T07:06:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.445877+0000", 2023-10-08T07:06:46.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0545e-05 2023-10-08T07:06:46.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:46.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.445885+0000", 2023-10-08T07:06:46.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.605e-06 2023-10-08T07:06:46.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:46.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.445930+0000", 2023-10-08T07:06:46.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4984000000000002e-05 2023-10-08T07:06:46.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:46.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.445985+0000", 2023-10-08T07:06:46.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5436000000000003e-05 2023-10-08T07:06:46.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:46.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.457816+0000", 2023-10-08T07:06:46.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011831217999999999 2023-10-08T07:06:46.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.457881+0000", 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4664000000000003e-05 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.457981+0000", 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9796000000000005e-05 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:3119 4.15 4:aa4cb2c5:::10000000004.0000003c:head [write 1294336~4096,write 1310720~4096,write 1331200~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:46.446876+0000", 2023-10-08T07:06:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43491049900000001, 2023-10-08T07:06:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011261933999999999, 2023-10-08T07:06:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 3119 2023-10-08T07:06:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.997 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:46.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:46.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.446876+0000", 2023-10-08T07:06:46.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:46.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.446876+0000", 2023-10-08T07:06:46.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:46.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:46.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.446876+0000", 2023-10-08T07:06:46.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9100000000000002e-07 2023-10-08T07:06:46.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:46.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.446895+0000", 2023-10-08T07:06:46.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8961e-05 2023-10-08T07:06:46.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:46.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:46.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:46.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.446910+0000", 2023-10-08T07:06:46.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5048999999999999e-05 2023-10-08T07:06:47.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:47.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:47.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:47.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.446930+0000", 2023-10-08T07:06:47.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.946e-05 2023-10-08T07:06:47.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:47.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:47.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:47.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.446980+0000", 2023-10-08T07:06:47.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9917000000000003e-05 2023-10-08T07:06:47.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:47.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.447039+0000", 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.872e-05 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.457993+0000", 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01095399 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.458053+0000", 2023-10-08T07:06:47.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0130000000000002e-05 2023-10-08T07:06:47.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:47.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:47.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:47.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:46.458137+0000", 2023-10-08T07:06:47.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4815999999999996e-05 2023-10-08T07:06:47.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:47.002 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:47.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:47.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:47.002 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:47.002 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:47.004 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:47.002+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:47.004 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:47.104 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:47.103+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:47.154 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T07:06:47.175 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:5089 4.e 4:7242a848:::10000000004.00000020:head [write 3796992~4096 in=4096b,write 3825664~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:47.172651+0000", 2023-10-08T07:06:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.001513529, 2023-10-08T07:06:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001550608, 2023-10-08T07:06:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 5089 2023-10-08T07:06:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.172651+0000", 2023-10-08T07:06:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.172651+0000", 2023-10-08T07:06:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.172652+0000", 2023-10-08T07:06:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2200000000000004e-07 2023-10-08T07:06:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.172659+0000", 2023-10-08T07:06:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5299999999999999e-06 2023-10-08T07:06:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.172667+0000", 2023-10-08T07:06:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.011e-06 2023-10-08T07:06:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.172672+0000", 2023-10-08T07:06:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5730000000000001e-06 2023-10-08T07:06:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.172723+0000", 2023-10-08T07:06:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0957e-05 2023-10-08T07:06:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.172827+0000", 2023-10-08T07:06:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010367800000000001 2023-10-08T07:06:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:5092 4.c 4:3352c333:::10000000004.00000012:head [write 2338816~4096 in=4096b,write 2445312~4096 in=4096b,write 2523136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:47.173445+0000", 2023-10-08T07:06:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00071957499999999997, 2023-10-08T07:06:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00086182399999999997, 2023-10-08T07:06:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 5092 2023-10-08T07:06:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173445+0000", 2023-10-08T07:06:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173445+0000", 2023-10-08T07:06:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173446+0000", 2023-10-08T07:06:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4499999999999997e-07 2023-10-08T07:06:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173455+0000", 2023-10-08T07:06:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2189999999999993e-06 2023-10-08T07:06:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173462+0000", 2023-10-08T07:06:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9970000000000001e-06 2023-10-08T07:06:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173466+0000", 2023-10-08T07:06:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9879999999999998e-06 2023-10-08T07:06:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173516+0000", 2023-10-08T07:06:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0161000000000003e-05 2023-10-08T07:06:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173570+0000", 2023-10-08T07:06:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4388999999999997e-05 2023-10-08T07:06:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173715+0000", 2023-10-08T07:06:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014471300000000001 2023-10-08T07:06:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:5091 4.0 e40/17 4:02bf98b6:::10000000004.0000000e:head v 40'79, mlcod=40'77)", 2023-10-08T07:06:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:47.173578+0000", 2023-10-08T07:06:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00058704199999999997, 2023-10-08T07:06:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000829063, 2023-10-08T07:06:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173578+0000", 2023-10-08T07:06:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173578+0000", 2023-10-08T07:06:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173578+0000", 2023-10-08T07:06:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9500000000000002e-07 2023-10-08T07:06:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173591+0000", 2023-10-08T07:06:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.256e-05 2023-10-08T07:06:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173602+0000", 2023-10-08T07:06:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0795000000000001e-05 2023-10-08T07:06:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173609+0000", 2023-10-08T07:06:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7419999999999997e-06 2023-10-08T07:06:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173677+0000", 2023-10-08T07:06:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7628999999999999e-05 2023-10-08T07:06:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173697+0000", 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0322999999999998e-05 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:5093 4.27 4:e7872a4f:::10000000004.00000037:head [write 1257472~4096 in=4096b,write 1265664~4096 in=4096b,write 1347584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:47.173735+0000", 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00042985199999999999, 2023-10-08T07:06:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075424300000000004, 2023-10-08T07:06:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 5093 2023-10-08T07:06:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173735+0000", 2023-10-08T07:06:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173735+0000", 2023-10-08T07:06:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173736+0000", 2023-10-08T07:06:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4200000000000004e-07 2023-10-08T07:06:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173749+0000", 2023-10-08T07:06:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3606e-05 2023-10-08T07:06:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173759+0000", 2023-10-08T07:06:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0045e-05 2023-10-08T07:06:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173767+0000", 2023-10-08T07:06:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8180000000000004e-06 2023-10-08T07:06:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173816+0000", 2023-10-08T07:06:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8288000000000003e-05 2023-10-08T07:06:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.173874+0000", 2023-10-08T07:06:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8116999999999999e-05 2023-10-08T07:06:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:5094 4.e 4:70352312:::10000000004.0000001a:head [write 3010560~4096 in=4096b,write 3215360~4096 in=4096b,write 3637248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:47.174240+0000", 2023-10-08T07:06:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9999247, 2023-10-08T07:06:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000348289, 2023-10-08T07:06:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 5094 2023-10-08T07:06:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.174240+0000", 2023-10-08T07:06:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.174240+0000", 2023-10-08T07:06:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.174241+0000", 2023-10-08T07:06:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6400000000000001e-07 2023-10-08T07:06:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.174256+0000", 2023-10-08T07:06:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4969e-05 2023-10-08T07:06:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.174267+0000", 2023-10-08T07:06:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0824e-05 2023-10-08T07:06:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.174274+0000", 2023-10-08T07:06:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.644e-06 2023-10-08T07:06:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.174335+0000", 2023-10-08T07:06:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0368999999999997e-05 2023-10-08T07:06:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.174442+0000", 2023-10-08T07:06:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000107432 2023-10-08T07:06:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:5075 4.5 4:a367a3e8:::10000000004.00000000:head [write 3260416~8192 in=8192b,write 3280896~4096 in=4096b,write 3780608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:47.167332+0000", 2023-10-08T07:06:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0068324670000000001, 2023-10-08T07:06:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0073481809999999996, 2023-10-08T07:06:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 5075 2023-10-08T07:06:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.167332+0000", 2023-10-08T07:06:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.167332+0000", 2023-10-08T07:06:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.167333+0000", 2023-10-08T07:06:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9400000000000005e-07 2023-10-08T07:06:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.167363+0000", 2023-10-08T07:06:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9692e-05 2023-10-08T07:06:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.167372+0000", 2023-10-08T07:06:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7599999999999997e-06 2023-10-08T07:06:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.167381+0000", 2023-10-08T07:06:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1039999999999996e-06 2023-10-08T07:06:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.167424+0000", 2023-10-08T07:06:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2766999999999999e-05 2023-10-08T07:06:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.167489+0000", 2023-10-08T07:06:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4675e-05 2023-10-08T07:06:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:5082 4.c 4:31e28161:::10000000004.00000011:head [write 3342336~4096 in=4096b,write 3657728~4096 in=4096b,write 3796992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:47.169740+0000", 2023-10-08T07:06:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0044251799999999999, 2023-10-08T07:06:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0050116529999999996, 2023-10-08T07:06:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 5082 2023-10-08T07:06:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.169740+0000", 2023-10-08T07:06:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.169740+0000", 2023-10-08T07:06:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.169740+0000", 2023-10-08T07:06:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7700000000000004e-07 2023-10-08T07:06:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.169750+0000", 2023-10-08T07:06:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8260000000000005e-06 2023-10-08T07:06:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.169761+0000", 2023-10-08T07:06:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1406000000000001e-05 2023-10-08T07:06:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.169769+0000", 2023-10-08T07:06:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3239999999999997e-06 2023-10-08T07:06:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.169820+0000", 2023-10-08T07:06:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0800000000000002e-05 2023-10-08T07:06:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.169918+0000", 2023-10-08T07:06:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8332000000000007e-05 2023-10-08T07:06:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.170113+0000", 2023-10-08T07:06:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019493599999999999 2023-10-08T07:06:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.172115+0000", 2023-10-08T07:06:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002002359 2023-10-08T07:06:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.174672+0000", 2023-10-08T07:06:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0025565620000000001 2023-10-08T07:06:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.174718+0000", 2023-10-08T07:06:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6644000000000003e-05 2023-10-08T07:06:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.174751+0000", 2023-10-08T07:06:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2787000000000003e-05 2023-10-08T07:06:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:5086 4.1f 4:f9156152:::10000000004.00000036:head [write 2760704~4096 in=4096b,write 3006464~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:47.171508+0000", 2023-10-08T07:06:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0026562970000000002, 2023-10-08T07:06:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033793019999999998, 2023-10-08T07:06:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 5086 2023-10-08T07:06:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.171508+0000", 2023-10-08T07:06:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.171508+0000", 2023-10-08T07:06:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.171509+0000", 2023-10-08T07:06:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4899999999999995e-07 2023-10-08T07:06:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.171520+0000", 2023-10-08T07:06:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0959e-05 2023-10-08T07:06:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.171531+0000", 2023-10-08T07:06:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0723000000000001e-05 2023-10-08T07:06:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.171536+0000", 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2970000000000003e-06 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.171585+0000", 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8644999999999999e-05 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:47.171646+0000", 2023-10-08T07:06:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1074000000000005e-05 2023-10-08T07:06:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:06:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 8 2023-10-08T07:06:47.221 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:47.222 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:47.223 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:47.221+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:47.323 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:47.322+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:47.380 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:47.424 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:47.423+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:47.431 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:47.431 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:47.431 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:47.431 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:47.431 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:47.446 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:47.525 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:47.524+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:47.565 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:47.588 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:47.588 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:47.588 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:06:47.588 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:47.591 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:06:47.592 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:06:47.606 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:47.606 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:47.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:47.663 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:47.662+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:47.688 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2023-10-08T07:06:47.689 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T07:06:47.689 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-10-08T07:06:47.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-10-08T07:06:47.726 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:47.725+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:47.787 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:47.787 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:47.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:47.843 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:47.842+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:47.927 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:47.926+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:48.009 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:48.010 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:48.024 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:48.028 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:48.027+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-08T07:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 40, 2023-10-08T07:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "bb50b5dc-93de-4177-9c34-354ea3b007d0", 2023-10-08T07:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "created": "2023-10-08T07:05:10.233885+0000", 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "modified": "2023-10-08T07:06:45.132429+0000", 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "last_up_change": "2023-10-08T07:06:38.117398+0000", 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "last_in_change": "2023-10-08T07:05:11.167705+0000", 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_num": 5806080, 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_set": [ 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "nodeep-scrub", 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "noscrub", 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "pglog_hardlimit", 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "purged_snapdirs", 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_deletes", 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "sortbitwise" 2023-10-08T07:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-08T07:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_version": 4, 2023-10-08T07:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "full_ratio": 0.94999998807907104, 2023-10-08T07:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-08T07:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-08T07:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_snapshot": "", 2023-10-08T07:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_max": 4, 2023-10-08T07:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd": 3, 2023-10-08T07:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "require_min_compat_client": "luminous", 2023-10-08T07:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "min_compat_client": "jewel", 2023-10-08T07:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "require_osd_release": "reef", 2023-10-08T07:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_crimson": false, 2023-10-08T07:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "pools": [ 2023-10-08T07:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 1, 2023-10-08T07:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": ".mgr", 2023-10-08T07:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-10-08T07:05:20.557481+0000", 2023-10-08T07:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-08T07:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-10-08T07:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-10-08T07:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-10-08T07:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-10-08T07:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-10-08T07:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-10-08T07:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-10-08T07:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T07:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T07:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-10-08T07:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-10-08T07:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 1, 2023-10-08T07:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 1, 2023-10-08T07:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 1, 2023-10-08T07:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 1, 2023-10-08T07:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 1, 2023-10-08T07:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-10-08T07:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-10-08T07:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-10-08T07:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-10-08T07:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-10-08T07:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-10-08T07:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-10-08T07:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "12", 2023-10-08T07:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-10-08T07:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T07:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T07:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-10-08T07:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-10-08T07:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-10-08T07:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-10-08T07:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-10-08T07:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-10-08T07:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-10-08T07:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-10-08T07:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-10-08T07:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-10-08T07:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-10-08T07:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-10-08T07:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-10-08T07:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-10-08T07:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-10-08T07:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T07:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T07:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T07:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-10-08T07:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-10-08T07:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-10-08T07:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-10-08T07:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-10-08T07:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-10-08T07:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-10-08T07:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-10-08T07:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-10-08T07:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-10-08T07:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T07:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-10-08T07:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-10-08T07:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-10-08T07:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-10-08T07:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-10-08T07:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-10-08T07:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_max": 32, 2023-10-08T07:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 1 2023-10-08T07:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-10-08T07:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": {} 2023-10-08T07:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-10-08T07:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 3.0299999713897705, 2023-10-08T07:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 3.0299999713897705, 2023-10-08T07:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.33000001311302185, 2023-10-08T07:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1, 2023-10-08T07:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1, 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 2, 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "rbd", 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-10-08T07:05:25.624853+0000", 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-10-08T07:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-10-08T07:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-10-08T07:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-10-08T07:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-10-08T07:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-10-08T07:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T07:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T07:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-10-08T07:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-10-08T07:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 8, 2023-10-08T07:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 8, 2023-10-08T07:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 8, 2023-10-08T07:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 8, 2023-10-08T07:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 8, 2023-10-08T07:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-10-08T07:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-10-08T07:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-10-08T07:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-10-08T07:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-10-08T07:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-10-08T07:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-10-08T07:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "15", 2023-10-08T07:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-10-08T07:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T07:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T07:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-10-08T07:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-10-08T07:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-10-08T07:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-10-08T07:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-10-08T07:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-10-08T07:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-10-08T07:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-10-08T07:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-10-08T07:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-10-08T07:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-10-08T07:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-10-08T07:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-10-08T07:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-10-08T07:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-10-08T07:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T07:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T07:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T07:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-10-08T07:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-10-08T07:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-10-08T07:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-10-08T07:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-10-08T07:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-10-08T07:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-10-08T07:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-10-08T07:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-10-08T07:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-10-08T07:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T07:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-10-08T07:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-10-08T07:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-10-08T07:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-10-08T07:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-10-08T07:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "options": {}, 2023-10-08T07:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-10-08T07:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd": {} 2023-10-08T07:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-10-08T07:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.4900000095367432, 2023-10-08T07:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.4900000095367432, 2023-10-08T07:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.67000001668930054, 2023-10-08T07:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1, 2023-10-08T07:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1, 2023-10-08T07:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-10-08T07:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-10-08T07:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-10-08T07:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 3, 2023-10-08T07:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_metadata", 2023-10-08T07:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-10-08T07:05:30.549393+0000", 2023-10-08T07:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-08T07:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-10-08T07:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-10-08T07:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-10-08T07:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-10-08T07:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-10-08T07:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-10-08T07:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-10-08T07:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T07:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T07:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-10-08T07:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-10-08T07:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 32, 2023-10-08T07:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 32, 2023-10-08T07:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 32, 2023-10-08T07:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 32, 2023-10-08T07:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 32, 2023-10-08T07:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-10-08T07:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-10-08T07:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-10-08T07:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-10-08T07:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-10-08T07:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-10-08T07:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-10-08T07:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "18", 2023-10-08T07:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-10-08T07:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T07:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T07:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-10-08T07:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-10-08T07:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-10-08T07:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-10-08T07:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-10-08T07:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-10-08T07:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-10-08T07:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-10-08T07:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-10-08T07:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-10-08T07:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-10-08T07:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-10-08T07:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-10-08T07:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-10-08T07:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-10-08T07:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T07:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T07:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T07:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-10-08T07:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-10-08T07:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-10-08T07:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-10-08T07:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-10-08T07:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-10-08T07:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-10-08T07:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-10-08T07:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-10-08T07:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-10-08T07:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T07:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-10-08T07:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-10-08T07:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-10-08T07:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-10-08T07:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-10-08T07:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-10-08T07:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_bias": 4, 2023-10-08T07:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 16, 2023-10-08T07:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_priority": 5 2023-10-08T07:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-10-08T07:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-10-08T07:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": "cephfs" 2023-10-08T07:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-10-08T07:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.690000057220459, 2023-10-08T07:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.690000057220459, 2023-10-08T07:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.67000001668930054, 2023-10-08T07:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.1299999952316284, 2023-10-08T07:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.1299999952316284, 2023-10-08T07:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-10-08T07:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-10-08T07:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-10-08T07:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 4, 2023-10-08T07:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": "cephfs_data", 2023-10-08T07:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "create_time": "2023-10-08T07:05:31.693934+0000", 2023-10-08T07:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-08T07:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "flags_names": "hashpspool", 2023-10-08T07:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type": 1, 2023-10-08T07:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 2, 2023-10-08T07:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": 1, 2023-10-08T07:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_rule": 0, 2023-10-08T07:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_count": 0, 2023-10-08T07:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_target": 0, 2023-10-08T07:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_barrier": 0, 2023-10-08T07:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-08T07:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "object_hash": 2, 2023-10-08T07:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscale_mode": "off", 2023-10-08T07:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": 64, 2023-10-08T07:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num": 64, 2023-10-08T07:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_placement_num_target": 64, 2023-10-08T07:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_target": 64, 2023-10-08T07:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_pending": 64, 2023-10-08T07:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "last_pg_merge_meta": { 2023-10-08T07:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "source_pgid": "0.0", 2023-10-08T07:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "ready_epoch": 0, 2023-10-08T07:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_started": 0, 2023-10-08T07:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "last_epoch_clean": 0, 2023-10-08T07:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "source_version": "0'0", 2023-10-08T07:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "target_version": "0'0" 2023-10-08T07:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "last_change": "19", 2023-10-08T07:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend": "0", 2023-10-08T07:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-08T07:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "last_force_op_resend_preluminous": "0", 2023-10-08T07:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "auid": 0, 2023-10-08T07:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_mode": "selfmanaged", 2023-10-08T07:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_seq": 0, 2023-10-08T07:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_epoch": 0, 2023-10-08T07:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_snaps": [], 2023-10-08T07:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps": "[]", 2023-10-08T07:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_bytes": 0, 2023-10-08T07:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "quota_max_objects": 0, 2023-10-08T07:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tiers": [], 2023-10-08T07:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tier_of": -1, 2023-10-08T07:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "read_tier": -1, 2023-10-08T07:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "write_tier": -1, 2023-10-08T07:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_mode": "none", 2023-10-08T07:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_bytes": 0, 2023-10-08T07:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_objects": 0, 2023-10-08T07:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-08T07:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-08T07:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-08T07:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_flush_age": 0, 2023-10-08T07:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "cache_min_evict_age": 0, 2023-10-08T07:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profile": "", 2023-10-08T07:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_params": { 2023-10-08T07:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "none" 2023-10-08T07:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_period": 0, 2023-10-08T07:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_count": 0, 2023-10-08T07:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "use_gmt_hitset": true, 2023-10-08T07:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "min_read_recency_for_promote": 0, 2023-10-08T07:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "min_write_recency_for_promote": 0, 2023-10-08T07:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_grade_decay_rate": 0, 2023-10-08T07:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "hit_set_search_last_n": 0, 2023-10-08T07:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "grade_table": [], 2023-10-08T07:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "stripe_width": 0, 2023-10-08T07:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "expected_num_objects": 0, 2023-10-08T07:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "fast_read": false, 2023-10-08T07:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "options": { 2023-10-08T07:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num_min": 64, 2023-10-08T07:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "target_size_ratio": 0.89999997615814209 2023-10-08T07:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "application_metadata": { 2023-10-08T07:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs": { 2023-10-08T07:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "data": "cephfs" 2023-10-08T07:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "read_balance": { 2023-10-08T07:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "score_acting": 1.5399999618530273, 2023-10-08T07:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "score_stable": 1.5399999618530273, 2023-10-08T07:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "optimal_score": 0.67000001668930054, 2023-10-08T07:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_acting": 1.0299999713897705, 2023-10-08T07:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "raw_score_stable": 1.0299999713897705, 2023-10-08T07:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity_weighted": 1, 2023-10-08T07:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity": 1, 2023-10-08T07:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "average_primary_affinity_weighted": 1 2023-10-08T07:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-08T07:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "osds": [ 2023-10-08T07:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-10-08T07:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "ba776b12-56dd-4565-ab87-300e9dcd9f20", 2023-10-08T07:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-10-08T07:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-10-08T07:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-10-08T07:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-10-08T07:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-10-08T07:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-10-08T07:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 8, 2023-10-08T07:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 37, 2023-10-08T07:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-10-08T07:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-10-08T07:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-10-08T07:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6800", 2023-10-08T07:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6801", 2023-10-08T07:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-10-08T07:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6802", 2023-10-08T07:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6803", 2023-10-08T07:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-10-08T07:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6806", 2023-10-08T07:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6807", 2023-10-08T07:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-10-08T07:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6804", 2023-10-08T07:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.33:6805", 2023-10-08T07:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1203223037 2023-10-08T07:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.33:6801/1203223037", 2023-10-08T07:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.33:6803/1203223037", 2023-10-08T07:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.33:6807/1203223037", 2023-10-08T07:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.33:6805/1203223037", 2023-10-08T07:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-10-08T07:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-10-08T07:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-10-08T07:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-10-08T07:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "69c35118-ff9d-4847-ba6c-37d3e9805dbe", 2023-10-08T07:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 0, 2023-10-08T07:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-10-08T07:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-10-08T07:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-10-08T07:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-10-08T07:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-10-08T07:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 8, 2023-10-08T07:06:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 17, 2023-10-08T07:06:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 37, 2023-10-08T07:06:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-10-08T07:06:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-10-08T07:06:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:06:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:06:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6800", 2023-10-08T07:06:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:06:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:06:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6801", 2023-10-08T07:06:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:06:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-10-08T07:06:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:06:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:06:48.139 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6802", 2023-10-08T07:06:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:06:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:06:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6803", 2023-10-08T07:06:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:06:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-10-08T07:06:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:06:48.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:06:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6806", 2023-10-08T07:06:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:06:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:06:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6807", 2023-10-08T07:06:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:06:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.141 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-10-08T07:06:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:06:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:06:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6804", 2023-10-08T07:06:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:06:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:06:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.86:6805", 2023-10-08T07:06:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1966312605 2023-10-08T07:06:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.143 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.143 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.86:6801/1966312605", 2023-10-08T07:06:48.143 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.86:6803/1966312605", 2023-10-08T07:06:48.143 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.86:6807/1966312605", 2023-10-08T07:06:48.143 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.86:6805/1966312605", 2023-10-08T07:06:48.143 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-10-08T07:06:48.143 INFO:teuthology.orchestra.run.smithi017.stdout: "exists" 2023-10-08T07:06:48.143 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.144 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-10-08T07:06:48.144 INFO:teuthology.orchestra.run.smithi017.stdout: "uuid": "98332c95-54f9-4263-a295-d2a753d9f200", 2023-10-08T07:06:48.144 INFO:teuthology.orchestra.run.smithi017.stdout: "up": 1, 2023-10-08T07:06:48.144 INFO:teuthology.orchestra.run.smithi017.stdout: "in": 1, 2023-10-08T07:06:48.144 INFO:teuthology.orchestra.run.smithi017.stdout: "weight": 1, 2023-10-08T07:06:48.144 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_affinity": 1, 2023-10-08T07:06:48.144 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_begin": 0, 2023-10-08T07:06:48.144 INFO:teuthology.orchestra.run.smithi017.stdout: "last_clean_end": 0, 2023-10-08T07:06:48.144 INFO:teuthology.orchestra.run.smithi017.stdout: "up_from": 8, 2023-10-08T07:06:48.144 INFO:teuthology.orchestra.run.smithi017.stdout: "up_thru": 37, 2023-10-08T07:06:48.144 INFO:teuthology.orchestra.run.smithi017.stdout: "down_at": 0, 2023-10-08T07:06:48.145 INFO:teuthology.orchestra.run.smithi017.stdout: "lost_at": 0, 2023-10-08T07:06:48.145 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrs": { 2023-10-08T07:06:48.145 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:06:48.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:06:48.145 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6800", 2023-10-08T07:06:48.145 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:06:48.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:06:48.145 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6801", 2023-10-08T07:06:48.145 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:06:48.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.146 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.146 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addrs": { 2023-10-08T07:06:48.146 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:06:48.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:06:48.146 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6802", 2023-10-08T07:06:48.146 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:06:48.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:06:48.147 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6803", 2023-10-08T07:06:48.147 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:06:48.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.147 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.147 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addrs": { 2023-10-08T07:06:48.147 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:06:48.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:06:48.147 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6806", 2023-10-08T07:06:48.148 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:06:48.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.148 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:06:48.148 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6807", 2023-10-08T07:06:48.148 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:06:48.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.148 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.148 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addrs": { 2023-10-08T07:06:48.149 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-08T07:06:48.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-08T07:06:48.149 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6804", 2023-10-08T07:06:48.149 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:06:48.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-08T07:06:48.149 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.144:6805", 2023-10-08T07:06:48.149 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3675215989 2023-10-08T07:06:48.149 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.149 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.150 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "172.21.15.144:6801/3675215989", 2023-10-08T07:06:48.150 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "172.21.15.144:6803/3675215989", 2023-10-08T07:06:48.150 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_back_addr": "172.21.15.144:6807/3675215989", 2023-10-08T07:06:48.150 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_front_addr": "172.21.15.144:6805/3675215989", 2023-10-08T07:06:48.150 INFO:teuthology.orchestra.run.smithi017.stdout: "state": [ 2023-10-08T07:06:48.150 INFO:teuthology.orchestra.run.smithi017.stdout: "exists", 2023-10-08T07:06:48.150 INFO:teuthology.orchestra.run.smithi017.stdout: "up" 2023-10-08T07:06:48.150 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-08T07:06:48.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.150 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-08T07:06:48.150 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_xinfo": [ 2023-10-08T07:06:48.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.151 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 0, 2023-10-08T07:06:48.151 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-10-08T07:06:48.151 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-10-08T07:06:48.151 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-10-08T07:06:48.151 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-10-08T07:06:48.151 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-10-08T07:06:48.151 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-10-08T07:05:16.224774+0000", 2023-10-08T07:06:48.151 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-10-08T07:06:48.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.151 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 1, 2023-10-08T07:06:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-10-08T07:06:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-10-08T07:06:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-10-08T07:06:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-10-08T07:06:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-10-08T07:06:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-10-08T07:05:16.302627+0000", 2023-10-08T07:06:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 36 2023-10-08T07:06:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-08T07:06:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": 2, 2023-10-08T07:06:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: "down_stamp": "0.000000", 2023-10-08T07:06:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_probability": 0, 2023-10-08T07:06:48.153 INFO:teuthology.orchestra.run.smithi017.stdout: "laggy_interval": 0, 2023-10-08T07:06:48.153 INFO:teuthology.orchestra.run.smithi017.stdout: "features": 4540138322906710015, 2023-10-08T07:06:48.153 INFO:teuthology.orchestra.run.smithi017.stdout: "old_weight": 0, 2023-10-08T07:06:48.153 INFO:teuthology.orchestra.run.smithi017.stdout: "last_purged_snaps_scrub": "2023-10-08T07:05:16.248056+0000", 2023-10-08T07:06:48.153 INFO:teuthology.orchestra.run.smithi017.stdout: "dead_epoch": 0 2023-10-08T07:06:48.153 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.153 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-08T07:06:48.153 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap": [], 2023-10-08T07:06:48.153 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_items": [], 2023-10-08T07:06:48.153 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_upmap_primaries": [], 2023-10-08T07:06:48.153 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_temp": [], 2023-10-08T07:06:48.154 INFO:teuthology.orchestra.run.smithi017.stdout: "primary_temp": [], 2023-10-08T07:06:48.154 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklist": {}, 2023-10-08T07:06:48.154 INFO:teuthology.orchestra.run.smithi017.stdout: "range_blocklist": {}, 2023-10-08T07:06:48.154 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_profiles": { 2023-10-08T07:06:48.154 INFO:teuthology.orchestra.run.smithi017.stdout: "default": { 2023-10-08T07:06:48.154 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-failure-domain": "osd", 2023-10-08T07:06:48.154 INFO:teuthology.orchestra.run.smithi017.stdout: "k": "2", 2023-10-08T07:06:48.154 INFO:teuthology.orchestra.run.smithi017.stdout: "m": "1", 2023-10-08T07:06:48.154 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin": "jerasure", 2023-10-08T07:06:48.154 INFO:teuthology.orchestra.run.smithi017.stdout: "technique": "reed_sol_van" 2023-10-08T07:06:48.154 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-08T07:06:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: "removed_snaps_queue": [], 2023-10-08T07:06:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: "new_removed_snaps": [], 2023-10-08T07:06:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: "new_purged_snaps": [], 2023-10-08T07:06:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_node_flags": {}, 2023-10-08T07:06:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: "device_class_flags": {}, 2023-10-08T07:06:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode": { 2023-10-08T07:06:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_enabled": false, 2023-10-08T07:06:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_bucket_count": 0, 2023-10-08T07:06:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: "degraded_stretch_mode": 0, 2023-10-08T07:06:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: "recovering_stretch_mode": 0, 2023-10-08T07:06:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: "stretch_mode_bucket": 0 2023-10-08T07:06:48.156 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-08T07:06:48.156 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-08T07:06:48.157 INFO:tasks.thrashosds.thrasher:j is {'epoch': 40, 'fsid': 'bb50b5dc-93de-4177-9c34-354ea3b007d0', 'created': '2023-10-08T07:05:10.233885+0000', 'modified': '2023-10-08T07:06:45.132429+0000', 'last_up_change': '2023-10-08T07:06:38.117398+0000', 'last_in_change': '2023-10-08T07:05:11.167705+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T07:05:20.557481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T07:05:25.624853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T07:05:30.549393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T07:05:31.693934+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'ba776b12-56dd-4565-ab87-300e9dcd9f20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 37, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6800', 'nonce': 1203223037}, {'type': 'v1', 'addr': '172.21.15.33:6801', 'nonce': 1203223037}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6802', 'nonce': 1203223037}, {'type': 'v1', 'addr': '172.21.15.33:6803', 'nonce': 1203223037}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6806', 'nonce': 1203223037}, {'type': 'v1', 'addr': '172.21.15.33:6807', 'nonce': 1203223037}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6804', 'nonce': 1203223037}, {'type': 'v1', 'addr': '172.21.15.33:6805', 'nonce': 1203223037}]}, 'public_addr': '172.21.15.33:6801/1203223037', 'cluster_addr': '172.21.15.33:6803/1203223037', 'heartbeat_back_addr': '172.21.15.33:6807/1203223037', 'heartbeat_front_addr': '172.21.15.33:6805/1203223037', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '69c35118-ff9d-4847-ba6c-37d3e9805dbe', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 37, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6800', 'nonce': 1966312605}, {'type': 'v1', 'addr': '172.21.15.86:6801', 'nonce': 1966312605}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6802', 'nonce': 1966312605}, {'type': 'v1', 'addr': '172.21.15.86:6803', 'nonce': 1966312605}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6806', 'nonce': 1966312605}, {'type': 'v1', 'addr': '172.21.15.86:6807', 'nonce': 1966312605}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6804', 'nonce': 1966312605}, {'type': 'v1', 'addr': '172.21.15.86:6805', 'nonce': 1966312605}]}, 'public_addr': '172.21.15.86:6801/1966312605', 'cluster_addr': '172.21.15.86:6803/1966312605', 'heartbeat_back_addr': '172.21.15.86:6807/1966312605', 'heartbeat_front_addr': '172.21.15.86:6805/1966312605', 'state': ['exists']}, {'osd': 2, 'uuid': '98332c95-54f9-4263-a295-d2a753d9f200', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 37, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 3675215989}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 3675215989}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 3675215989}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 3675215989}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 3675215989}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 3675215989}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 3675215989}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 3675215989}]}, 'public_addr': '172.21.15.144:6801/3675215989', 'cluster_addr': '172.21.15.144:6803/3675215989', 'heartbeat_back_addr': '172.21.15.144:6807/3675215989', 'heartbeat_front_addr': '172.21.15.144:6805/3675215989', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T07:05:16.224774+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T07:05:16.302627+0000', 'dead_epoch': 36}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-10-08T07:05:16.248056+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-10-08T07:06:48.159 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:06:48.159 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:48.156+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:48.200 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2023-10-08T07:06:48.228 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:48.228 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:48.241 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:48.286 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:48.284+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:48.358 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:48.357+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:48.408 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:48.409 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:48.421 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:48.460 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:48.459+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:48.560 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:48.559+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:48.572 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:06:48.574 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:06:48.584 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2023-10-08T07:06:48.517153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":235546828,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":54,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":336,"num_write_kb":232932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":143,"acting":143,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":398808,"kb_used_data":309428,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":282716712,"statfs":{"total":289910292480,"available":289501913088,"internally_reserved":0,"allocated":316854272,"data_stored":316245572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":91483475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":226508586,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":33,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":221203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.392172"},"pg_stats":[{"pgid":"4.3f","version":"39'1","reported_seq":10,"reported_epoch":39,"state":"active+undersized","last_fresh":"2023-10-08T07:06:42.127354+0000","last_change":"2023-10-08T07:06:39.131836+0000","last_active":"2023-10-08T07:06:42.127354+0000","last_peered":"2023-10-08T07:06:42.127354+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.131836+0000","last_became_peered":"2023-10-08T07:06:39.131836+0000","last_unstale":"2023-10-08T07:06:42.127354+0000","last_undegraded":"2023-10-08T07:06:42.127354+0000","last_fullsized":"2023-10-08T07:06:39.128043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:36:40.144910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.516334+0000","last_change":"2023-10-08T07:06:39.129992+0000","last_active":"2023-10-08T07:06:39.516334+0000","last_peered":"2023-10-08T07:06:39.516334+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.129992+0000","last_became_peered":"2023-10-08T07:06:39.129992+0000","last_unstale":"2023-10-08T07:06:39.516334+0000","last_undegraded":"2023-10-08T07:06:39.516334+0000","last_fullsized":"2023-10-08T07:06:39.126760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:07.029716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.135007+0000","last_change":"2023-10-08T07:06:39.134780+0000","last_active":"2023-10-08T07:06:39.135007+0000","last_peered":"2023-10-08T07:06:39.135007+0000","last_clean":"2023-10-08T07:06:36.374478+0000","last_became_active":"2023-10-08T07:06:39.134780+0000","last_became_peered":"2023-10-08T07:06:39.134780+0000","last_unstale":"2023-10-08T07:06:39.135007+0000","last_undegraded":"2023-10-08T07:06:39.135007+0000","last_fullsized":"2023-10-08T07:06:39.130665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:54.702102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.129425+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:06:39.129425+0000","last_peered":"2023-10-08T07:06:39.129425+0000","last_clean":"2023-10-08T07:06:39.129425+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:06:39.129425+0000","last_undegraded":"2023-10-08T07:06:39.129425+0000","last_fullsized":"2023-10-08T07:06:39.129425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"38'2","reported_seq":11,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:41.561788+0000","last_change":"2023-10-08T07:06:41.561788+0000","last_active":"2023-10-08T07:06:41.561788+0000","last_peered":"2023-10-08T07:06:41.561788+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.129662+0000","last_became_peered":"2023-10-08T07:06:39.129662+0000","last_unstale":"2023-10-08T07:06:41.561788+0000","last_undegraded":"2023-10-08T07:06:40.731769+0000","last_fullsized":"2023-10-08T07:06:39.126685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:20.330113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"39'3","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-08T07:06:42.855042+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:06:42.855042+0000","last_peered":"2023-10-08T07:06:42.855042+0000","last_clean":"2023-10-08T07:06:42.855042+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:06:42.855042+0000","last_undegraded":"2023-10-08T07:06:42.855042+0000","last_fullsized":"2023-10-08T07:06:42.855042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.127840+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:06:39.127840+0000","last_peered":"2023-10-08T07:06:39.127840+0000","last_clean":"2023-10-08T07:06:39.127840+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:06:39.127840+0000","last_undegraded":"2023-10-08T07:06:39.127840+0000","last_fullsized":"2023-10-08T07:06:39.127840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"39'1","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-08T07:06:42.126522+0000","last_change":"2023-10-08T07:05:33.327740+0000","last_active":"2023-10-08T07:06:42.126522+0000","last_peered":"2023-10-08T07:06:42.126522+0000","last_clean":"2023-10-08T07:06:42.126522+0000","last_became_active":"2023-10-08T07:05:33.325912+0000","last_became_peered":"2023-10-08T07:05:33.325912+0000","last_unstale":"2023-10-08T07:06:42.126522+0000","last_undegraded":"2023-10-08T07:06:42.126522+0000","last_fullsized":"2023-10-08T07:06:42.126522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:53.107064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"38'1","reported_seq":36,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:41.922837+0000","last_change":"2023-10-08T07:06:42.127336+0000","last_active":"2023-10-08T07:06:41.922837+0000","last_peered":"2023-10-08T07:06:41.922837+0000","last_clean":"2023-10-08T07:06:36.118964+0000","last_became_active":"2023-10-08T07:06:39.131696+0000","last_became_peered":"2023-10-08T07:06:39.131696+0000","last_unstale":"2023-10-08T07:06:41.922837+0000","last_undegraded":"2023-10-08T07:06:41.922837+0000","last_fullsized":"2023-10-08T07:06:39.128179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:51.493084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"39'1","reported_seq":10,"reported_epoch":39,"state":"active+undersized","last_fresh":"2023-10-08T07:06:42.126489+0000","last_change":"2023-10-08T07:06:39.130847+0000","last_active":"2023-10-08T07:06:42.126489+0000","last_peered":"2023-10-08T07:06:42.126489+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.130847+0000","last_became_peered":"2023-10-08T07:06:39.130847+0000","last_unstale":"2023-10-08T07:06:42.126489+0000","last_undegraded":"2023-10-08T07:06:42.126489+0000","last_fullsized":"2023-10-08T07:06:39.126971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:03:17.826581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.129222+0000","last_change":"2023-10-08T07:05:33.328140+0000","last_active":"2023-10-08T07:06:39.129222+0000","last_peered":"2023-10-08T07:06:39.129222+0000","last_clean":"2023-10-08T07:06:39.129222+0000","last_became_active":"2023-10-08T07:05:33.327595+0000","last_became_peered":"2023-10-08T07:05:33.327595+0000","last_unstale":"2023-10-08T07:06:39.129222+0000","last_undegraded":"2023-10-08T07:06:39.129222+0000","last_fullsized":"2023-10-08T07:06:39.129222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"39'1","reported_seq":10,"reported_epoch":39,"state":"active+undersized","last_fresh":"2023-10-08T07:06:42.128140+0000","last_change":"2023-10-08T07:06:39.132494+0000","last_active":"2023-10-08T07:06:42.128140+0000","last_peered":"2023-10-08T07:06:42.128140+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.132494+0000","last_became_peered":"2023-10-08T07:06:39.132494+0000","last_unstale":"2023-10-08T07:06:42.128140+0000","last_undegraded":"2023-10-08T07:06:42.128140+0000","last_fullsized":"2023-10-08T07:06:39.127323+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:06:30.746295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.516141+0000","last_change":"2023-10-08T07:06:39.130613+0000","last_active":"2023-10-08T07:06:39.516141+0000","last_peered":"2023-10-08T07:06:39.516141+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.130613+0000","last_became_peered":"2023-10-08T07:06:39.130613+0000","last_unstale":"2023-10-08T07:06:39.516141+0000","last_undegraded":"2023-10-08T07:06:39.516141+0000","last_fullsized":"2023-10-08T07:06:39.127001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:41:36.271624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"39'2","reported_seq":37,"reported_epoch":39,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:42.127654+0000","last_change":"2023-10-08T07:06:42.127654+0000","last_active":"2023-10-08T07:06:42.127654+0000","last_peered":"2023-10-08T07:06:42.127654+0000","last_clean":"2023-10-08T07:06:36.374068+0000","last_became_active":"2023-10-08T07:06:39.132546+0000","last_became_peered":"2023-10-08T07:06:39.132546+0000","last_unstale":"2023-10-08T07:06:42.127654+0000","last_undegraded":"2023-10-08T07:06:39.206027+0000","last_fullsized":"2023-10-08T07:06:39.128131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:17.212720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4220696,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"38'2","reported_seq":37,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:41.652997+0000","last_change":"2023-10-08T07:06:41.652997+0000","last_active":"2023-10-08T07:06:41.652997+0000","last_peered":"2023-10-08T07:06:41.652997+0000","last_clean":"2023-10-08T07:06:36.373821+0000","last_became_active":"2023-10-08T07:06:39.133780+0000","last_became_peered":"2023-10-08T07:06:39.133780+0000","last_unstale":"2023-10-08T07:06:41.652997+0000","last_undegraded":"2023-10-08T07:06:39.478905+0000","last_fullsized":"2023-10-08T07:06:39.128430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:24.850665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"38'1","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:41.186945+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:06:41.186945+0000","last_peered":"2023-10-08T07:06:41.186945+0000","last_clean":"2023-10-08T07:06:41.186945+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:06:41.186945+0000","last_undegraded":"2023-10-08T07:06:41.186945+0000","last_fullsized":"2023-10-08T07:06:41.186945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.132979+0000","last_change":"2023-10-08T07:06:39.132782+0000","last_active":"2023-10-08T07:06:39.132979+0000","last_peered":"2023-10-08T07:06:39.132979+0000","last_clean":"2023-10-08T07:06:36.119029+0000","last_became_active":"2023-10-08T07:06:39.132782+0000","last_became_peered":"2023-10-08T07:06:39.132782+0000","last_unstale":"2023-10-08T07:06:39.132979+0000","last_undegraded":"2023-10-08T07:06:39.132979+0000","last_fullsized":"2023-10-08T07:06:39.128491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:30:30.859248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.516404+0000","last_change":"2023-10-08T07:06:39.133005+0000","last_active":"2023-10-08T07:06:39.516404+0000","last_peered":"2023-10-08T07:06:39.516404+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.133005+0000","last_became_peered":"2023-10-08T07:06:39.133005+0000","last_unstale":"2023-10-08T07:06:39.516404+0000","last_undegraded":"2023-10-08T07:06:39.516404+0000","last_fullsized":"2023-10-08T07:06:39.127333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:15:59.670090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"38'1","reported_seq":36,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:42.102718+0000","last_change":"2023-10-08T07:06:42.127147+0000","last_active":"2023-10-08T07:06:42.102718+0000","last_peered":"2023-10-08T07:06:42.102718+0000","last_clean":"2023-10-08T07:06:36.118970+0000","last_became_active":"2023-10-08T07:06:39.132003+0000","last_became_peered":"2023-10-08T07:06:39.132003+0000","last_unstale":"2023-10-08T07:06:42.102718+0000","last_undegraded":"2023-10-08T07:06:42.102718+0000","last_fullsized":"2023-10-08T07:06:39.128103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:25:30.930093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"38'1","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.649521+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:06:39.649521+0000","last_peered":"2023-10-08T07:06:39.649521+0000","last_clean":"2023-10-08T07:06:39.649521+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:06:39.649521+0000","last_undegraded":"2023-10-08T07:06:39.649521+0000","last_fullsized":"2023-10-08T07:06:39.649521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"39'1","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-08T07:06:42.126929+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:06:42.126929+0000","last_peered":"2023-10-08T07:06:42.126929+0000","last_clean":"2023-10-08T07:06:42.126929+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:06:42.126929+0000","last_undegraded":"2023-10-08T07:06:42.126929+0000","last_fullsized":"2023-10-08T07:06:42.126929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"39'1","reported_seq":10,"reported_epoch":39,"state":"active+undersized","last_fresh":"2023-10-08T07:06:42.126841+0000","last_change":"2023-10-08T07:06:39.131403+0000","last_active":"2023-10-08T07:06:42.126841+0000","last_peered":"2023-10-08T07:06:42.126841+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.131403+0000","last_became_peered":"2023-10-08T07:06:39.131403+0000","last_unstale":"2023-10-08T07:06:42.126841+0000","last_undegraded":"2023-10-08T07:06:42.126841+0000","last_fullsized":"2023-10-08T07:06:39.127172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:03:17.826581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"39'1","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-08T07:06:42.127263+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:06:42.127263+0000","last_peered":"2023-10-08T07:06:42.127263+0000","last_clean":"2023-10-08T07:06:42.127263+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:06:42.127263+0000","last_undegraded":"2023-10-08T07:06:42.127263+0000","last_fullsized":"2023-10-08T07:06:42.127263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"39'2","reported_seq":11,"reported_epoch":39,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:42.126196+0000","last_change":"2023-10-08T07:06:42.126196+0000","last_active":"2023-10-08T07:06:42.126196+0000","last_peered":"2023-10-08T07:06:42.126196+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.131965+0000","last_became_peered":"2023-10-08T07:06:39.131965+0000","last_unstale":"2023-10-08T07:06:42.126196+0000","last_undegraded":"2023-10-08T07:06:40.358961+0000","last_fullsized":"2023-10-08T07:06:39.127218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:05:21.630922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"39'1","reported_seq":10,"reported_epoch":39,"state":"active+undersized","last_fresh":"2023-10-08T07:06:42.127872+0000","last_change":"2023-10-08T07:06:39.134823+0000","last_active":"2023-10-08T07:06:42.127872+0000","last_peered":"2023-10-08T07:06:42.127872+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.134823+0000","last_became_peered":"2023-10-08T07:06:39.134823+0000","last_unstale":"2023-10-08T07:06:42.127872+0000","last_undegraded":"2023-10-08T07:06:42.127872+0000","last_fullsized":"2023-10-08T07:06:39.130752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:03.275806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"38'1","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.926477+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:06:39.926477+0000","last_peered":"2023-10-08T07:06:39.926477+0000","last_clean":"2023-10-08T07:06:39.926477+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:06:39.926477+0000","last_undegraded":"2023-10-08T07:06:39.926477+0000","last_fullsized":"2023-10-08T07:06:39.926477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.134942+0000","last_change":"2023-10-08T07:06:39.134199+0000","last_active":"2023-10-08T07:06:39.134942+0000","last_peered":"2023-10-08T07:06:39.134942+0000","last_clean":"2023-10-08T07:06:36.374383+0000","last_became_active":"2023-10-08T07:06:39.134199+0000","last_became_peered":"2023-10-08T07:06:39.134199+0000","last_unstale":"2023-10-08T07:06:39.134942+0000","last_undegraded":"2023-10-08T07:06:39.134942+0000","last_fullsized":"2023-10-08T07:06:39.129332+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:35:08.213616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.516091+0000","last_change":"2023-10-08T07:06:39.131971+0000","last_active":"2023-10-08T07:06:39.516091+0000","last_peered":"2023-10-08T07:06:39.516091+0000","last_clean":"2023-10-08T07:05:31.294234+0000","last_became_active":"2023-10-08T07:06:39.131971+0000","last_became_peered":"2023-10-08T07:06:39.131971+0000","last_unstale":"2023-10-08T07:06:39.516091+0000","last_undegraded":"2023-10-08T07:06:39.516091+0000","last_fullsized":"2023-10-08T07:06:39.128001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:30.401947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.521794+0000","last_change":"2023-10-08T07:06:39.133496+0000","last_active":"2023-10-08T07:06:39.521794+0000","last_peered":"2023-10-08T07:06:39.521794+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.133496+0000","last_became_peered":"2023-10-08T07:06:39.133496+0000","last_unstale":"2023-10-08T07:06:39.521794+0000","last_undegraded":"2023-10-08T07:06:39.521794+0000","last_fullsized":"2023-10-08T07:06:39.127864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:30:30.859248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.128493+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:06:39.128493+0000","last_peered":"2023-10-08T07:06:39.128493+0000","last_clean":"2023-10-08T07:06:39.128493+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:06:39.128493+0000","last_undegraded":"2023-10-08T07:06:39.128493+0000","last_fullsized":"2023-10-08T07:06:39.128493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.127870+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:06:39.127870+0000","last_peered":"2023-10-08T07:06:39.127870+0000","last_clean":"2023-10-08T07:06:39.127870+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:06:39.127870+0000","last_undegraded":"2023-10-08T07:06:39.127870+0000","last_fullsized":"2023-10-08T07:06:39.127870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.131831+0000","last_change":"2023-10-08T07:06:39.131642+0000","last_active":"2023-10-08T07:06:39.131831+0000","last_peered":"2023-10-08T07:06:39.131831+0000","last_clean":"2023-10-08T07:06:36.118691+0000","last_became_active":"2023-10-08T07:06:39.131642+0000","last_became_peered":"2023-10-08T07:06:39.131642+0000","last_unstale":"2023-10-08T07:06:39.131831+0000","last_undegraded":"2023-10-08T07:06:39.131831+0000","last_fullsized":"2023-10-08T07:06:39.127200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:36.027683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"39'1","reported_seq":10,"reported_epoch":39,"state":"active+undersized","last_fresh":"2023-10-08T07:06:42.127661+0000","last_change":"2023-10-08T07:06:39.133912+0000","last_active":"2023-10-08T07:06:42.127661+0000","last_peered":"2023-10-08T07:06:42.127661+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.133912+0000","last_became_peered":"2023-10-08T07:06:39.133912+0000","last_unstale":"2023-10-08T07:06:42.127661+0000","last_undegraded":"2023-10-08T07:06:42.127661+0000","last_fullsized":"2023-10-08T07:06:39.129304+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:23:30.253736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.129431+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:06:39.129431+0000","last_peered":"2023-10-08T07:06:39.129431+0000","last_clean":"2023-10-08T07:06:39.129431+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:06:39.129431+0000","last_undegraded":"2023-10-08T07:06:39.129431+0000","last_fullsized":"2023-10-08T07:06:39.129431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"38'1","reported_seq":36,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:41.278299+0000","last_change":"2023-10-08T07:06:42.126033+0000","last_active":"2023-10-08T07:06:41.278299+0000","last_peered":"2023-10-08T07:06:41.278299+0000","last_clean":"2023-10-08T07:06:36.118430+0000","last_became_active":"2023-10-08T07:06:39.130815+0000","last_became_peered":"2023-10-08T07:06:39.130815+0000","last_unstale":"2023-10-08T07:06:41.278299+0000","last_undegraded":"2023-10-08T07:06:41.278299+0000","last_fullsized":"2023-10-08T07:06:39.126415+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:37.702203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.127382+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:06:39.127382+0000","last_peered":"2023-10-08T07:06:39.127382+0000","last_clean":"2023-10-08T07:06:39.127382+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:06:39.127382+0000","last_undegraded":"2023-10-08T07:06:39.127382+0000","last_fullsized":"2023-10-08T07:06:39.127382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"38'1","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:40.186235+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:06:40.186235+0000","last_peered":"2023-10-08T07:06:40.186235+0000","last_clean":"2023-10-08T07:06:40.186235+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:06:40.186235+0000","last_undegraded":"2023-10-08T07:06:40.186235+0000","last_fullsized":"2023-10-08T07:06:40.186235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":18,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:39.521733+0000","last_change":"2023-10-08T07:06:39.132386+0000","last_active":"2023-10-08T07:06:39.521733+0000","last_peered":"2023-10-08T07:06:39.521733+0000","last_clean":"2023-10-08T07:05:33.313957+0000","last_became_active":"2023-10-08T07:06:39.132386+0000","last_became_peered":"2023-10-08T07:06:39.132386+0000","last_unstale":"2023-10-08T07:06:39.521733+0000","last_undegraded":"2023-10-08T07:06:39.127559+0000","last_fullsized":"2023-10-08T07:06:39.127424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:05:20.626044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"38'2","reported_seq":37,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:39.136080+0000","last_change":"2023-10-08T07:06:39.136080+0000","last_active":"2023-10-08T07:06:39.136080+0000","last_peered":"2023-10-08T07:06:39.136080+0000","last_clean":"2023-10-08T07:06:36.118657+0000","last_became_active":"2023-10-08T07:06:39.130846+0000","last_became_peered":"2023-10-08T07:06:39.130846+0000","last_unstale":"2023-10-08T07:06:39.136080+0000","last_undegraded":"2023-10-08T07:06:39.134814+0000","last_fullsized":"2023-10-08T07:06:39.126836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:59.164332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3024,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"39'21","reported_seq":57,"reported_epoch":39,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:42.127781+0000","last_change":"2023-10-08T07:06:39.132563+0000","last_active":"2023-10-08T07:06:42.127781+0000","last_peered":"2023-10-08T07:06:42.127781+0000","last_clean":"2023-10-08T07:06:36.373268+0000","last_became_active":"2023-10-08T07:06:39.132563+0000","last_became_peered":"2023-10-08T07:06:39.132563+0000","last_unstale":"2023-10-08T07:06:42.127781+0000","last_undegraded":"2023-10-08T07:06:39.129466+0000","last_fullsized":"2023-10-08T07:06:39.128404+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:42:41.376640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45222,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"38'1","reported_seq":36,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:39.999339+0000","last_change":"2023-10-08T07:06:42.127967+0000","last_active":"2023-10-08T07:06:39.999339+0000","last_peered":"2023-10-08T07:06:39.999339+0000","last_clean":"2023-10-08T07:06:36.374313+0000","last_became_active":"2023-10-08T07:06:39.133426+0000","last_became_peered":"2023-10-08T07:06:39.133426+0000","last_unstale":"2023-10-08T07:06:39.999339+0000","last_undegraded":"2023-10-08T07:06:39.999339+0000","last_fullsized":"2023-10-08T07:06:39.129220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:21:20.182635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.129255+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:06:39.129255+0000","last_peered":"2023-10-08T07:06:39.129255+0000","last_clean":"2023-10-08T07:06:39.129255+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:06:39.129255+0000","last_undegraded":"2023-10-08T07:06:39.129255+0000","last_fullsized":"2023-10-08T07:06:39.129255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"38'1","reported_seq":10,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:40.447933+0000","last_change":"2023-10-08T07:06:42.126862+0000","last_active":"2023-10-08T07:06:40.447933+0000","last_peered":"2023-10-08T07:06:40.447933+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.131990+0000","last_became_peered":"2023-10-08T07:06:39.131990+0000","last_unstale":"2023-10-08T07:06:40.447933+0000","last_undegraded":"2023-10-08T07:06:40.447933+0000","last_fullsized":"2023-10-08T07:06:39.126739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:14.234227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.127906+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:06:39.127906+0000","last_peered":"2023-10-08T07:06:39.127906+0000","last_clean":"2023-10-08T07:06:39.127906+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:06:39.127906+0000","last_undegraded":"2023-10-08T07:06:39.127906+0000","last_fullsized":"2023-10-08T07:06:39.127906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"39'2","reported_seq":11,"reported_epoch":39,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:42.127008+0000","last_change":"2023-10-08T07:06:42.127008+0000","last_active":"2023-10-08T07:06:42.127008+0000","last_peered":"2023-10-08T07:06:42.127008+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.129552+0000","last_became_peered":"2023-10-08T07:06:39.129552+0000","last_unstale":"2023-10-08T07:06:42.127008+0000","last_undegraded":"2023-10-08T07:06:39.747946+0000","last_fullsized":"2023-10-08T07:06:39.126749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:18.787577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.521337+0000","last_change":"2023-10-08T07:06:39.129471+0000","last_active":"2023-10-08T07:06:39.521337+0000","last_peered":"2023-10-08T07:06:39.521337+0000","last_clean":"2023-10-08T07:05:31.294234+0000","last_became_active":"2023-10-08T07:06:39.129471+0000","last_became_peered":"2023-10-08T07:06:39.129471+0000","last_unstale":"2023-10-08T07:06:39.521337+0000","last_undegraded":"2023-10-08T07:06:39.521337+0000","last_fullsized":"2023-10-08T07:06:39.126648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:48:06.680272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.128530+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:06:39.128530+0000","last_peered":"2023-10-08T07:06:39.128530+0000","last_clean":"2023-10-08T07:06:39.128530+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:06:39.128530+0000","last_undegraded":"2023-10-08T07:06:39.128530+0000","last_fullsized":"2023-10-08T07:06:39.128530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":44,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:39.133565+0000","last_change":"2023-10-08T07:06:39.132638+0000","last_active":"2023-10-08T07:06:39.133565+0000","last_peered":"2023-10-08T07:06:39.133565+0000","last_clean":"2023-10-08T07:06:36.373086+0000","last_became_active":"2023-10-08T07:06:39.132638+0000","last_became_peered":"2023-10-08T07:06:39.132638+0000","last_unstale":"2023-10-08T07:06:39.133565+0000","last_undegraded":"2023-10-08T07:06:39.128380+0000","last_fullsized":"2023-10-08T07:06:39.128189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:13.112195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.129544+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:06:39.129544+0000","last_peered":"2023-10-08T07:06:39.129544+0000","last_clean":"2023-10-08T07:06:39.129544+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:06:39.129544+0000","last_undegraded":"2023-10-08T07:06:39.129544+0000","last_fullsized":"2023-10-08T07:06:39.129544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":37,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:39.134706+0000","last_change":"2023-10-08T07:06:39.133409+0000","last_active":"2023-10-08T07:06:39.134706+0000","last_peered":"2023-10-08T07:06:39.134706+0000","last_clean":"2023-10-08T07:06:36.373519+0000","last_became_active":"2023-10-08T07:06:39.133409+0000","last_became_peered":"2023-10-08T07:06:39.133409+0000","last_unstale":"2023-10-08T07:06:39.134706+0000","last_undegraded":"2023-10-08T07:06:39.129552+0000","last_fullsized":"2023-10-08T07:06:39.129249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:19.849362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.521237+0000","last_change":"2023-10-08T07:06:39.130834+0000","last_active":"2023-10-08T07:06:39.521237+0000","last_peered":"2023-10-08T07:06:39.521237+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.130834+0000","last_became_peered":"2023-10-08T07:06:39.130834+0000","last_unstale":"2023-10-08T07:06:39.521237+0000","last_undegraded":"2023-10-08T07:06:39.521237+0000","last_fullsized":"2023-10-08T07:06:39.126660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:41:36.271624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":18,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:39.521889+0000","last_change":"2023-10-08T07:06:39.131135+0000","last_active":"2023-10-08T07:06:39.521889+0000","last_peered":"2023-10-08T07:06:39.521889+0000","last_clean":"2023-10-08T07:05:33.314212+0000","last_became_active":"2023-10-08T07:06:39.131135+0000","last_became_peered":"2023-10-08T07:06:39.131135+0000","last_unstale":"2023-10-08T07:06:39.521889+0000","last_undegraded":"2023-10-08T07:06:39.127635+0000","last_fullsized":"2023-10-08T07:06:39.127411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:57:30.401947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"39'1","reported_seq":10,"reported_epoch":39,"state":"active+undersized","last_fresh":"2023-10-08T07:06:42.126093+0000","last_change":"2023-10-08T07:06:39.129862+0000","last_active":"2023-10-08T07:06:42.126093+0000","last_peered":"2023-10-08T07:06:42.126093+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.129862+0000","last_became_peered":"2023-10-08T07:06:39.129862+0000","last_unstale":"2023-10-08T07:06:42.126093+0000","last_undegraded":"2023-10-08T07:06:42.126093+0000","last_fullsized":"2023-10-08T07:06:39.126393+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:27:10.771813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":37,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:39.134791+0000","last_change":"2023-10-08T07:06:39.134129+0000","last_active":"2023-10-08T07:06:39.134791+0000","last_peered":"2023-10-08T07:06:39.134791+0000","last_clean":"2023-10-08T07:06:36.373251+0000","last_became_active":"2023-10-08T07:06:39.134129+0000","last_became_peered":"2023-10-08T07:06:39.134129+0000","last_unstale":"2023-10-08T07:06:39.134791+0000","last_undegraded":"2023-10-08T07:06:39.129977+0000","last_fullsized":"2023-10-08T07:06:39.129532+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:11:20.335813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"38'1","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:41.839182+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:06:41.839182+0000","last_peered":"2023-10-08T07:06:41.839182+0000","last_clean":"2023-10-08T07:06:41.839182+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:06:41.839182+0000","last_undegraded":"2023-10-08T07:06:41.839182+0000","last_fullsized":"2023-10-08T07:06:41.839182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.127032+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:06:39.127032+0000","last_peered":"2023-10-08T07:06:39.127032+0000","last_clean":"2023-10-08T07:06:39.127032+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:06:39.127032+0000","last_undegraded":"2023-10-08T07:06:39.127032+0000","last_fullsized":"2023-10-08T07:06:39.127032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"39'1","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-08T07:06:42.126627+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:06:42.126627+0000","last_peered":"2023-10-08T07:06:42.126627+0000","last_clean":"2023-10-08T07:06:42.126627+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:06:42.126627+0000","last_undegraded":"2023-10-08T07:06:42.126627+0000","last_fullsized":"2023-10-08T07:06:42.126627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.127314+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:06:39.127314+0000","last_peered":"2023-10-08T07:06:39.127314+0000","last_clean":"2023-10-08T07:06:39.127314+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:06:39.127314+0000","last_undegraded":"2023-10-08T07:06:39.127314+0000","last_fullsized":"2023-10-08T07:06:39.127314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"38'2","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:41.014823+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:06:41.014823+0000","last_peered":"2023-10-08T07:06:41.014823+0000","last_clean":"2023-10-08T07:06:41.014823+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:06:41.014823+0000","last_undegraded":"2023-10-08T07:06:41.014823+0000","last_fullsized":"2023-10-08T07:06:41.014823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.127747+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:06:39.127747+0000","last_peered":"2023-10-08T07:06:39.127747+0000","last_clean":"2023-10-08T07:06:39.127747+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:06:39.127747+0000","last_undegraded":"2023-10-08T07:06:39.127747+0000","last_fullsized":"2023-10-08T07:06:39.127747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.135270+0000","last_change":"2023-10-08T07:06:39.135101+0000","last_active":"2023-10-08T07:06:39.135270+0000","last_peered":"2023-10-08T07:06:39.135270+0000","last_clean":"2023-10-08T07:06:36.374558+0000","last_became_active":"2023-10-08T07:06:39.135101+0000","last_became_peered":"2023-10-08T07:06:39.135101+0000","last_unstale":"2023-10-08T07:06:39.135270+0000","last_undegraded":"2023-10-08T07:06:39.135270+0000","last_fullsized":"2023-10-08T07:06:39.131077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:37:40.370358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.521391+0000","last_change":"2023-10-08T07:06:39.130842+0000","last_active":"2023-10-08T07:06:39.521391+0000","last_peered":"2023-10-08T07:06:39.521391+0000","last_clean":"2023-10-08T07:05:31.294234+0000","last_became_active":"2023-10-08T07:06:39.130842+0000","last_became_peered":"2023-10-08T07:06:39.130842+0000","last_unstale":"2023-10-08T07:06:39.521391+0000","last_undegraded":"2023-10-08T07:06:39.521391+0000","last_fullsized":"2023-10-08T07:06:39.127269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:15:58.665213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"39'2","reported_seq":37,"reported_epoch":39,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:42.127646+0000","last_change":"2023-10-08T07:06:42.127646+0000","last_active":"2023-10-08T07:06:42.127646+0000","last_peered":"2023-10-08T07:06:42.127646+0000","last_clean":"2023-10-08T07:06:36.374435+0000","last_became_active":"2023-10-08T07:06:39.131164+0000","last_became_peered":"2023-10-08T07:06:39.131164+0000","last_unstale":"2023-10-08T07:06:42.127646+0000","last_undegraded":"2023-10-08T07:06:41.743136+0000","last_fullsized":"2023-10-08T07:06:39.127486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:37.032561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.515934+0000","last_change":"2023-10-08T07:06:39.130602+0000","last_active":"2023-10-08T07:06:39.515934+0000","last_peered":"2023-10-08T07:06:39.515934+0000","last_clean":"2023-10-08T07:05:31.294234+0000","last_became_active":"2023-10-08T07:06:39.130602+0000","last_became_peered":"2023-10-08T07:06:39.130602+0000","last_unstale":"2023-10-08T07:06:39.515934+0000","last_undegraded":"2023-10-08T07:06:39.515934+0000","last_fullsized":"2023-10-08T07:06:39.126529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:31.780705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"38'1","reported_seq":36,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:41.467548+0000","last_change":"2023-10-08T07:06:42.127621+0000","last_active":"2023-10-08T07:06:41.467548+0000","last_peered":"2023-10-08T07:06:41.467548+0000","last_clean":"2023-10-08T07:06:36.119147+0000","last_became_active":"2023-10-08T07:06:39.134350+0000","last_became_peered":"2023-10-08T07:06:39.134350+0000","last_unstale":"2023-10-08T07:06:41.467548+0000","last_undegraded":"2023-10-08T07:06:41.467548+0000","last_fullsized":"2023-10-08T07:06:39.129258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:21:20.182635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.134552+0000","last_change":"2023-10-08T07:06:39.134363+0000","last_active":"2023-10-08T07:06:39.134552+0000","last_peered":"2023-10-08T07:06:39.134552+0000","last_clean":"2023-10-08T07:06:36.119094+0000","last_became_active":"2023-10-08T07:06:39.134363+0000","last_became_peered":"2023-10-08T07:06:39.134363+0000","last_unstale":"2023-10-08T07:06:39.134552+0000","last_undegraded":"2023-10-08T07:06:39.134552+0000","last_fullsized":"2023-10-08T07:06:39.129348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:14.836347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.130743+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:06:39.130743+0000","last_peered":"2023-10-08T07:06:39.130743+0000","last_clean":"2023-10-08T07:06:39.130743+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:06:39.130743+0000","last_undegraded":"2023-10-08T07:06:39.130743+0000","last_fullsized":"2023-10-08T07:06:39.130743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'1","reported_seq":10,"reported_epoch":39,"state":"active+undersized","last_fresh":"2023-10-08T07:06:42.126548+0000","last_change":"2023-10-08T07:06:39.130123+0000","last_active":"2023-10-08T07:06:42.126548+0000","last_peered":"2023-10-08T07:06:42.126548+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.130123+0000","last_became_peered":"2023-10-08T07:06:39.130123+0000","last_unstale":"2023-10-08T07:06:42.126548+0000","last_undegraded":"2023-10-08T07:06:42.126548+0000","last_fullsized":"2023-10-08T07:06:39.126762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:28:08.666993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.128011+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:06:39.128011+0000","last_peered":"2023-10-08T07:06:39.128011+0000","last_clean":"2023-10-08T07:06:39.128011+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:06:39.128011+0000","last_undegraded":"2023-10-08T07:06:39.128011+0000","last_fullsized":"2023-10-08T07:06:39.128011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.128488+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:06:39.128488+0000","last_peered":"2023-10-08T07:06:39.128488+0000","last_clean":"2023-10-08T07:06:39.128488+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:06:39.128488+0000","last_undegraded":"2023-10-08T07:06:39.128488+0000","last_fullsized":"2023-10-08T07:06:39.128488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"39'1","reported_seq":36,"reported_epoch":39,"state":"active+undersized","last_fresh":"2023-10-08T07:06:42.126979+0000","last_change":"2023-10-08T07:06:39.134332+0000","last_active":"2023-10-08T07:06:42.126979+0000","last_peered":"2023-10-08T07:06:42.126979+0000","last_clean":"2023-10-08T07:06:36.118948+0000","last_became_active":"2023-10-08T07:06:39.134332+0000","last_became_peered":"2023-10-08T07:06:39.134332+0000","last_unstale":"2023-10-08T07:06:42.126979+0000","last_undegraded":"2023-10-08T07:06:42.126979+0000","last_fullsized":"2023-10-08T07:06:39.129200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:24.850665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.132941+0000","last_change":"2023-10-08T07:06:39.132737+0000","last_active":"2023-10-08T07:06:39.132941+0000","last_peered":"2023-10-08T07:06:39.132941+0000","last_clean":"2023-10-08T07:06:36.118501+0000","last_became_active":"2023-10-08T07:06:39.132737+0000","last_became_peered":"2023-10-08T07:06:39.132737+0000","last_unstale":"2023-10-08T07:06:39.132941+0000","last_undegraded":"2023-10-08T07:06:39.132941+0000","last_fullsized":"2023-10-08T07:06:39.126929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:28:02.649100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.521269+0000","last_change":"2023-10-08T07:06:39.129780+0000","last_active":"2023-10-08T07:06:39.521269+0000","last_peered":"2023-10-08T07:06:39.521269+0000","last_clean":"2023-10-08T07:05:31.294234+0000","last_became_active":"2023-10-08T07:06:39.129780+0000","last_became_peered":"2023-10-08T07:06:39.129780+0000","last_unstale":"2023-10-08T07:06:39.521269+0000","last_undegraded":"2023-10-08T07:06:39.521269+0000","last_fullsized":"2023-10-08T07:06:39.126659+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:58.159454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'3","reported_seq":38,"reported_epoch":39,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:43.041564+0000","last_change":"2023-10-08T07:06:43.041564+0000","last_active":"2023-10-08T07:06:43.041564+0000","last_peered":"2023-10-08T07:06:43.041564+0000","last_clean":"2023-10-08T07:06:36.119241+0000","last_became_active":"2023-10-08T07:06:39.134600+0000","last_became_peered":"2023-10-08T07:06:39.134600+0000","last_unstale":"2023-10-08T07:06:43.041564+0000","last_undegraded":"2023-10-08T07:06:42.669751+0000","last_fullsized":"2023-10-08T07:06:39.129521+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:23:30.253736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":3}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.128523+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:06:39.128523+0000","last_peered":"2023-10-08T07:06:39.128523+0000","last_clean":"2023-10-08T07:06:39.128523+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:06:39.128523+0000","last_undegraded":"2023-10-08T07:06:39.128523+0000","last_fullsized":"2023-10-08T07:06:39.128523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":238,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:39.133365+0000","last_change":"2023-10-08T07:06:39.131433+0000","last_active":"2023-10-08T07:06:39.133365+0000","last_peered":"2023-10-08T07:06:39.133365+0000","last_clean":"2023-10-08T07:06:36.373791+0000","last_became_active":"2023-10-08T07:06:39.131433+0000","last_became_peered":"2023-10-08T07:06:39.131433+0000","last_unstale":"2023-10-08T07:06:39.133365+0000","last_undegraded":"2023-10-08T07:06:39.127807+0000","last_fullsized":"2023-10-08T07:06:39.127465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:40.459920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.131804+0000","last_change":"2023-10-08T07:06:39.131473+0000","last_active":"2023-10-08T07:06:39.131804+0000","last_peered":"2023-10-08T07:06:39.131804+0000","last_clean":"2023-10-08T07:06:36.118552+0000","last_became_active":"2023-10-08T07:06:39.131473+0000","last_became_peered":"2023-10-08T07:06:39.131473+0000","last_unstale":"2023-10-08T07:06:39.131804+0000","last_undegraded":"2023-10-08T07:06:39.131804+0000","last_fullsized":"2023-10-08T07:06:39.126760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:54.024491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"38'1","reported_seq":36,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:39.402221+0000","last_change":"2023-10-08T07:06:42.128171+0000","last_active":"2023-10-08T07:06:39.402221+0000","last_peered":"2023-10-08T07:06:39.402221+0000","last_clean":"2023-10-08T07:06:36.374511+0000","last_became_active":"2023-10-08T07:06:39.135459+0000","last_became_peered":"2023-10-08T07:06:39.135459+0000","last_unstale":"2023-10-08T07:06:39.402221+0000","last_undegraded":"2023-10-08T07:06:39.402221+0000","last_fullsized":"2023-10-08T07:06:39.131312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:21.567302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.133540+0000","last_change":"2023-10-08T07:06:39.132342+0000","last_active":"2023-10-08T07:06:39.133540+0000","last_peered":"2023-10-08T07:06:39.133540+0000","last_clean":"2023-10-08T07:06:36.373837+0000","last_became_active":"2023-10-08T07:06:39.132342+0000","last_became_peered":"2023-10-08T07:06:39.132342+0000","last_unstale":"2023-10-08T07:06:39.133540+0000","last_undegraded":"2023-10-08T07:06:39.133540+0000","last_fullsized":"2023-10-08T07:06:39.127677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:58:57.337368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.126756+0000","last_change":"2023-10-08T07:05:32.317723+0000","last_active":"2023-10-08T07:06:39.126756+0000","last_peered":"2023-10-08T07:06:39.126756+0000","last_clean":"2023-10-08T07:06:39.126756+0000","last_became_active":"2023-10-08T07:05:32.317444+0000","last_became_peered":"2023-10-08T07:05:32.317444+0000","last_unstale":"2023-10-08T07:06:39.126756+0000","last_undegraded":"2023-10-08T07:06:39.126756+0000","last_fullsized":"2023-10-08T07:06:39.126756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:29.242830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.516382+0000","last_change":"2023-10-08T07:06:39.130809+0000","last_active":"2023-10-08T07:06:39.516382+0000","last_peered":"2023-10-08T07:06:39.516382+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.130809+0000","last_became_peered":"2023-10-08T07:06:39.130809+0000","last_unstale":"2023-10-08T07:06:39.516382+0000","last_undegraded":"2023-10-08T07:06:39.516382+0000","last_fullsized":"2023-10-08T07:06:39.127050+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:35:03.930720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.516281+0000","last_change":"2023-10-08T07:06:39.131617+0000","last_active":"2023-10-08T07:06:39.516281+0000","last_peered":"2023-10-08T07:06:39.516281+0000","last_clean":"2023-10-08T07:05:26.281219+0000","last_became_active":"2023-10-08T07:06:39.131617+0000","last_became_peered":"2023-10-08T07:06:39.131617+0000","last_unstale":"2023-10-08T07:06:39.516281+0000","last_undegraded":"2023-10-08T07:06:39.516281+0000","last_fullsized":"2023-10-08T07:06:39.127132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:16.007241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.132978+0000","last_change":"2023-10-08T07:06:39.132780+0000","last_active":"2023-10-08T07:06:39.132978+0000","last_peered":"2023-10-08T07:06:39.132978+0000","last_clean":"2023-10-08T07:06:36.119009+0000","last_became_active":"2023-10-08T07:06:39.132780+0000","last_became_peered":"2023-10-08T07:06:39.132780+0000","last_unstale":"2023-10-08T07:06:39.132978+0000","last_undegraded":"2023-10-08T07:06:39.132978+0000","last_fullsized":"2023-10-08T07:06:39.128533+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:56:13.112195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.521573+0000","last_change":"2023-10-08T07:06:39.131328+0000","last_active":"2023-10-08T07:06:39.521573+0000","last_peered":"2023-10-08T07:06:39.521573+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.131328+0000","last_became_peered":"2023-10-08T07:06:39.131328+0000","last_unstale":"2023-10-08T07:06:39.521573+0000","last_undegraded":"2023-10-08T07:06:39.521573+0000","last_fullsized":"2023-10-08T07:06:39.127154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:22.025134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":38,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:39.133102+0000","last_change":"2023-10-08T07:06:39.132903+0000","last_active":"2023-10-08T07:06:39.133102+0000","last_peered":"2023-10-08T07:06:39.133102+0000","last_clean":"2023-10-08T07:06:36.119093+0000","last_became_active":"2023-10-08T07:06:39.132903+0000","last_became_peered":"2023-10-08T07:06:39.132903+0000","last_unstale":"2023-10-08T07:06:39.133102+0000","last_undegraded":"2023-10-08T07:06:39.129123+0000","last_fullsized":"2023-10-08T07:06:39.128530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:16.207843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.132839+0000","last_change":"2023-10-08T07:06:39.132217+0000","last_active":"2023-10-08T07:06:39.132839+0000","last_peered":"2023-10-08T07:06:39.132839+0000","last_clean":"2023-10-08T07:06:36.119126+0000","last_became_active":"2023-10-08T07:06:39.132217+0000","last_became_peered":"2023-10-08T07:06:39.132217+0000","last_unstale":"2023-10-08T07:06:39.132839+0000","last_undegraded":"2023-10-08T07:06:39.132839+0000","last_fullsized":"2023-10-08T07:06:39.128016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:06:24.728402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"38'1","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:40.635425+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:06:40.635425+0000","last_peered":"2023-10-08T07:06:40.635425+0000","last_clean":"2023-10-08T07:06:40.635425+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:06:40.635425+0000","last_undegraded":"2023-10-08T07:06:40.635425+0000","last_fullsized":"2023-10-08T07:06:40.635425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.134995+0000","last_change":"2023-10-08T07:06:39.134203+0000","last_active":"2023-10-08T07:06:39.134995+0000","last_peered":"2023-10-08T07:06:39.134995+0000","last_clean":"2023-10-08T07:06:36.374556+0000","last_became_active":"2023-10-08T07:06:39.134203+0000","last_became_peered":"2023-10-08T07:06:39.134203+0000","last_unstale":"2023-10-08T07:06:39.134995+0000","last_undegraded":"2023-10-08T07:06:39.134995+0000","last_fullsized":"2023-10-08T07:06:39.129802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:58.966447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"39'4","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-08T07:06:42.126816+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:06:42.126816+0000","last_peered":"2023-10-08T07:06:42.126816+0000","last_clean":"2023-10-08T07:06:42.126816+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:06:42.126816+0000","last_undegraded":"2023-10-08T07:06:42.126816+0000","last_fullsized":"2023-10-08T07:06:42.126816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"38'1","reported_seq":10,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:41.095479+0000","last_change":"2023-10-08T07:06:42.126470+0000","last_active":"2023-10-08T07:06:41.095479+0000","last_peered":"2023-10-08T07:06:41.095479+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.131983+0000","last_became_peered":"2023-10-08T07:06:39.131983+0000","last_unstale":"2023-10-08T07:06:41.095479+0000","last_undegraded":"2023-10-08T07:06:41.095479+0000","last_fullsized":"2023-10-08T07:06:39.126636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:25:30.930093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.521546+0000","last_change":"2023-10-08T07:06:39.130647+0000","last_active":"2023-10-08T07:06:39.521546+0000","last_peered":"2023-10-08T07:06:39.521546+0000","last_clean":"2023-10-08T07:05:31.294234+0000","last_became_active":"2023-10-08T07:06:39.130647+0000","last_became_peered":"2023-10-08T07:06:39.130647+0000","last_unstale":"2023-10-08T07:06:39.521546+0000","last_undegraded":"2023-10-08T07:06:39.521546+0000","last_fullsized":"2023-10-08T07:06:39.126929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:35:02.925843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.516221+0000","last_change":"2023-10-08T07:06:39.132766+0000","last_active":"2023-10-08T07:06:39.516221+0000","last_peered":"2023-10-08T07:06:39.516221+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.132766+0000","last_became_peered":"2023-10-08T07:06:39.132766+0000","last_unstale":"2023-10-08T07:06:39.516221+0000","last_undegraded":"2023-10-08T07:06:39.516221+0000","last_fullsized":"2023-10-08T07:06:39.127321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:59:03.355261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.128248+0000","last_change":"2023-10-08T07:05:32.320603+0000","last_active":"2023-10-08T07:06:39.128248+0000","last_peered":"2023-10-08T07:06:39.128248+0000","last_clean":"2023-10-08T07:06:39.128248+0000","last_became_active":"2023-10-08T07:05:32.320262+0000","last_became_peered":"2023-10-08T07:05:32.320262+0000","last_unstale":"2023-10-08T07:06:39.128248+0000","last_undegraded":"2023-10-08T07:06:39.128248+0000","last_fullsized":"2023-10-08T07:06:39.128248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:09.249029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"39'2","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-08T07:06:42.127047+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:06:42.127047+0000","last_peered":"2023-10-08T07:06:42.127047+0000","last_clean":"2023-10-08T07:06:42.127047+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:06:42.127047+0000","last_undegraded":"2023-10-08T07:06:42.127047+0000","last_fullsized":"2023-10-08T07:06:42.127047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":18,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:39.521765+0000","last_change":"2023-10-08T07:06:39.132154+0000","last_active":"2023-10-08T07:06:39.521765+0000","last_peered":"2023-10-08T07:06:39.521765+0000","last_clean":"2023-10-08T07:05:33.314151+0000","last_became_active":"2023-10-08T07:06:39.132154+0000","last_became_peered":"2023-10-08T07:06:39.132154+0000","last_unstale":"2023-10-08T07:06:39.521765+0000","last_undegraded":"2023-10-08T07:06:39.128051+0000","last_fullsized":"2023-10-08T07:06:39.127740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:36:39.140033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"38'1","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.582076+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:06:39.582076+0000","last_peered":"2023-10-08T07:06:39.582076+0000","last_clean":"2023-10-08T07:06:39.582076+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:06:39.582076+0000","last_undegraded":"2023-10-08T07:06:39.582076+0000","last_fullsized":"2023-10-08T07:06:39.582076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":37,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.134478+0000","last_change":"2023-10-08T07:06:39.134330+0000","last_active":"2023-10-08T07:06:39.134478+0000","last_peered":"2023-10-08T07:06:39.134478+0000","last_clean":"2023-10-08T07:06:36.119220+0000","last_became_active":"2023-10-08T07:06:39.134330+0000","last_became_peered":"2023-10-08T07:06:39.134330+0000","last_unstale":"2023-10-08T07:06:39.134478+0000","last_undegraded":"2023-10-08T07:06:39.134478+0000","last_fullsized":"2023-10-08T07:06:39.129092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:42:41.376640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"38'2","reported_seq":11,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:42.013327+0000","last_change":"2023-10-08T07:06:42.013327+0000","last_active":"2023-10-08T07:06:42.013327+0000","last_peered":"2023-10-08T07:06:42.013327+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.129995+0000","last_became_peered":"2023-10-08T07:06:39.129995+0000","last_unstale":"2023-10-08T07:06:42.013327+0000","last_undegraded":"2023-10-08T07:06:39.821406+0000","last_fullsized":"2023-10-08T07:06:39.126374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:35.269026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.129323+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:06:39.129323+0000","last_peered":"2023-10-08T07:06:39.129323+0000","last_clean":"2023-10-08T07:06:39.129323+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:06:39.129323+0000","last_undegraded":"2023-10-08T07:06:39.129323+0000","last_fullsized":"2023-10-08T07:06:39.129323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:39.129382+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:06:39.129382+0000","last_peered":"2023-10-08T07:06:39.129382+0000","last_clean":"2023-10-08T07:06:39.129382+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:06:39.129382+0000","last_undegraded":"2023-10-08T07:06:39.129382+0000","last_fullsized":"2023-10-08T07:06:39.129382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"38'3","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T07:06:41.380942+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:06:41.380942+0000","last_peered":"2023-10-08T07:06:41.380942+0000","last_clean":"2023-10-08T07:06:41.380942+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:06:41.380942+0000","last_undegraded":"2023-10-08T07:06:41.380942+0000","last_fullsized":"2023-10-08T07:06:41.380942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"38'1","reported_seq":36,"reported_epoch":38,"state":"active+undersized+degraded","last_fresh":"2023-10-08T07:06:40.270286+0000","last_change":"2023-10-08T07:06:42.127416+0000","last_active":"2023-10-08T07:06:40.270286+0000","last_peered":"2023-10-08T07:06:40.270286+0000","last_clean":"2023-10-08T07:06:36.118444+0000","last_became_active":"2023-10-08T07:06:39.131700+0000","last_became_peered":"2023-10-08T07:06:39.131700+0000","last_unstale":"2023-10-08T07:06:40.270286+0000","last_undegraded":"2023-10-08T07:06:40.270286+0000","last_fullsized":"2023-10-08T07:06:39.126836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:48:07.685150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.521429+0000","last_change":"2023-10-08T07:06:39.131100+0000","last_active":"2023-10-08T07:06:39.521429+0000","last_peered":"2023-10-08T07:06:39.521429+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.131100+0000","last_became_peered":"2023-10-08T07:06:39.131100+0000","last_unstale":"2023-10-08T07:06:39.521429+0000","last_undegraded":"2023-10-08T07:06:39.521429+0000","last_fullsized":"2023-10-08T07:06:39.126749+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:55.029369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+undersized","last_fresh":"2023-10-08T07:06:39.132177+0000","last_change":"2023-10-08T07:06:39.131957+0000","last_active":"2023-10-08T07:06:39.132177+0000","last_peered":"2023-10-08T07:06:39.132177+0000","last_clean":"2023-10-08T07:06:36.118827+0000","last_became_active":"2023-10-08T07:06:39.131957+0000","last_became_peered":"2023-10-08T07:06:39.131957+0000","last_unstale":"2023-10-08T07:06:39.132177+0000","last_undegraded":"2023-10-08T07:06:39.132177+0000","last_fullsized":"2023-10-08T07:06:39.127409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:09.828798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"39'1","reported_seq":10,"reported_epoch":39,"state":"active+undersized","last_fresh":"2023-10-08T07:06:42.127522+0000","last_change":"2023-10-08T07:06:39.131274+0000","last_active":"2023-10-08T07:06:42.127522+0000","last_peered":"2023-10-08T07:06:42.127522+0000","last_clean":"2023-10-08T07:05:32.299112+0000","last_became_active":"2023-10-08T07:06:39.131274+0000","last_became_peered":"2023-10-08T07:06:39.131274+0000","last_unstale":"2023-10-08T07:06:42.127522+0000","last_undegraded":"2023-10-08T07:06:42.127522+0000","last_fullsized":"2023-10-08T07:06:39.127452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:09.828798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":234910440,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":37,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":229406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327188480,"data_stored":327182380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59,"ondisk_log_size":59,"up":86,"acting":86,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":46020,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":15,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":53371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":46,"acting":46,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195288,"kb_used_data":168268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94176552,"statfs":{"total":96636764160,"available":96436789248,"internally_reserved":0,"allocated":172306432,"data_stored":172113546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.377}]},{"osd":1,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.85099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738388,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171444,"kb_used_data":140264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94200396,"statfs":{"total":96636764160,"available":96461205504,"internally_reserved":0,"allocated":143630336,"data_stored":143409810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.432},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738386,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":917504,"data_stored":722216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.66300000000000003}]},{"osd":2,"last update":"Sun Oct 8 07:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":46020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":146829312,"data_stored":146824284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":180359168,"data_stored":180358096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:06:48.594 INFO:tasks.thrashosds.thrasher:Setting 3.15 to [1, 0] 2023-10-08T07:06:48.594 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.15', '1', '0'] 2023-10-08T07:06:48.594 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.15 1 0 2023-10-08T07:06:48.633 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:48.634 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:48.644 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:48.687 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:48.686+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:48.762 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:48.761+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:48.821 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:48.821 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:48.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:48.876 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:48.875+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:48.964 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:48.963+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:48.999 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:48.999 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:49.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:49.064 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:49.063+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:49.165 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:49.164+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi017.stderr:set 3.15 pg_upmap mapping to [1,0] 2023-10-08T07:06:49.209 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:49.209 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:49.222 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:49.266 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:49.265+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:49.367 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:49.366+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:49.390 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:49.390 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:49.404 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:49.468 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:49.467+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:49.570 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:49.568+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:49.581 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:49.581 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:49.593 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:49.595 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:49.679 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:49.678+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:49.772 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:49.771+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:49.773 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:49.799 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:06:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:49.802 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:06:49.802 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:06:49.816 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:49.817 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:49.817 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:49.817 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:49.817 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:49.831 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:49.872 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:49.871+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:49.973 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:49.972+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:50.048 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:50.048 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:50.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:50.048 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:50.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.048 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:50.049 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:50.049 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 87.273005122000001, 2023-10-08T07:06:50.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015350007000000001, 2023-10-08T07:06:50.049 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.049 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.049 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.049 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:50.049 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:50.049 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 164 2023-10-08T07:06:50.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.050 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:50.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:50.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771860+0000", 2023-10-08T07:06:50.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1500000000000001e-07 2023-10-08T07:06:50.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771898+0000", 2023-10-08T07:06:50.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7233000000000001e-05 2023-10-08T07:06:50.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771903+0000", 2023-10-08T07:06:50.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4960000000000004e-06 2023-10-08T07:06:50.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771907+0000", 2023-10-08T07:06:50.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.354e-06 2023-10-08T07:06:50.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777327+0000", 2023-10-08T07:06:50.053 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054200419999999999 2023-10-08T07:06:50.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777415+0000", 2023-10-08T07:06:50.053 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8535000000000005e-05 2023-10-08T07:06:50.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:50.054 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.777553+0000", 2023-10-08T07:06:50.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013797500000000001 2023-10-08T07:06:50.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.057 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781065+0000", 2023-10-08T07:06:50.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003512331 2023-10-08T07:06:50.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.058 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.058 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787108+0000", 2023-10-08T07:06:50.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060427730000000004 2023-10-08T07:06:50.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.058 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.058 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787166+0000", 2023-10-08T07:06:50.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7899000000000002e-05 2023-10-08T07:06:50.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787210+0000", 2023-10-08T07:06:50.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4153999999999998e-05 2023-10-08T07:06:50.059 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.059 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.059 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.060 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:50.060 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:50.060 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 87.27295307, 2023-10-08T07:06:50.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:50.060 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.060 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.060 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.060 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:50.060 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:50.060 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:50.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.061 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:50.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:50.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:50.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:50.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:50.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:50.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:50.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:50.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:50.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:50.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:50.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:50.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.064 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:50.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:50.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.064 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:50.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:50.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:50.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.065 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.065 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:50.065 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:50.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.065 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.065 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:50.065 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:50.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.065 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:50.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:50.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:50.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:50.066 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.066 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.066 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.067 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.067 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:50.067 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:50.067 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 76.727256593000007, 2023-10-08T07:06:50.067 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:50.067 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.067 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.067 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.067 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.067 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.067 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:50.067 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.068 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:50.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.068 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:50.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:50.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:50.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:50.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:50.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:50.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:50.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:50.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:50.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:50.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:50.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:50.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:50.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:50.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:50.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:50.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:50.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.072 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.073 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:50.073 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:50.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.073 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.073 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.073 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:50.073 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:50.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.073 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.073 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.073 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:50.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:50.074 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.074 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.074 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.074 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.074 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:50.074 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:50.074 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 76.727204068000006, 2023-10-08T07:06:50.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:50.075 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.075 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.075 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:50.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:50.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:50.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:50.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:50.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:50.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.077 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:50.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:50.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.077 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:50.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:50.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:50.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:50.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:50.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:50.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:50.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:50.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:50.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:50.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:50.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:50.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:50.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.080 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:50.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:50.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.080 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:50.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:50.081 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.081 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.081 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.081 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:50.081 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:50.081 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 76.726212282999995, 2023-10-08T07:06:50.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:50.081 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.081 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.081 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:50.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:50.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:50.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:50.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.083 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:50.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:50.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.083 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:50.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:50.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:50.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:50.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:50.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:50.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:50.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:50.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:50.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:50.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:50.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:50.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:50.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:50.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:50.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.087 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.087 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:50.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:50.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.087 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.087 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.087 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:50.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:50.088 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.088 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.088 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.088 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:50.088 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:50.088 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 76.726159013, 2023-10-08T07:06:50.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:50.089 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.089 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.089 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.089 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.089 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:50.089 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.089 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:50.090 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.090 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:50.090 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:50.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.090 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.091 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:50.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:50.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:50.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:50.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:50.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:50.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:50.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:50.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:50.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:50.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:50.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:50.095 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.095 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.095 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.095 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:50.095 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:50.095 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 76.726123166999997, 2023-10-08T07:06:50.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:50.096 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.096 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.096 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:50.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:50.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:50.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:50.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:50.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:50.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.098 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:50.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:50.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.098 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:50.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:50.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:50.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:50.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:50.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:50.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:50.100 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:50.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:50.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.100 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.100 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:50.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:50.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.100 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.100 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:50.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:50.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:50.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:50.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:50.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:50.101 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.102 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.102 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.102 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:50.102 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:50.102 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 76.725690313000001, 2023-10-08T07:06:50.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369176, 2023-10-08T07:06:50.102 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.102 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.102 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:50.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319175+0000", 2023-10-08T07:06:50.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319176+0000", 2023-10-08T07:06:50.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3030000000000001e-06 2023-10-08T07:06:50.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319182+0000", 2023-10-08T07:06:50.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:06:50.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319208+0000", 2023-10-08T07:06:50.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6332000000000001e-05 2023-10-08T07:06:50.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319221+0000", 2023-10-08T07:06:50.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:06:50.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329558+0000", 2023-10-08T07:06:50.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010337005999999999 2023-10-08T07:06:50.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329700+0000", 2023-10-08T07:06:50.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014245600000000001 2023-10-08T07:06:50.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:50.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329847+0000", 2023-10-08T07:06:50.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014669800000000001 2023-10-08T07:06:50.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.107 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332794+0000", 2023-10-08T07:06:50.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029474710000000001 2023-10-08T07:06:50.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.107 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.107 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334440+0000", 2023-10-08T07:06:50.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016455040000000001 2023-10-08T07:06:50.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.107 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.107 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334504+0000", 2023-10-08T07:06:50.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3944999999999998e-05 2023-10-08T07:06:50.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.108 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.108 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.108 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334544+0000", 2023-10-08T07:06:50.108 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0618999999999999e-05 2023-10-08T07:06:50.108 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.108 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.108 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.108 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.108 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:50.109 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:50.109 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 76.725576670999999, 2023-10-08T07:06:50.109 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:50.109 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.109 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.109 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.109 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:50.109 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:50.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:50.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:50.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:50.111 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:50.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.111 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.111 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.111 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:50.111 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:50.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.111 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.111 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.111 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:50.111 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:50.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:50.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:50.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:50.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:50.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.113 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:50.113 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:50.113 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:50.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.113 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.113 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:50.113 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:50.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.113 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.113 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:50.114 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:50.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.114 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.114 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.114 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:50.114 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:50.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.114 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.114 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.114 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:50.114 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:50.114 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.115 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.115 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.115 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.115 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:25 4.c 4:31e28161:::10000000004.00000011:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:50.115 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.911542+0000", 2023-10-08T07:06:50.115 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.1333229239999998, 2023-10-08T07:06:50.115 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015283365, 2023-10-08T07:06:50.115 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.115 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.115 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.116 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:50.116 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.116 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 25 2023-10-08T07:06:50.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.116 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.116 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.116 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.116 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.911542+0000", 2023-10-08T07:06:50.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.116 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.116 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.117 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.911542+0000", 2023-10-08T07:06:50.117 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.117 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.117 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.117 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.911544+0000", 2023-10-08T07:06:50.117 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1370000000000001e-06 2023-10-08T07:06:50.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.117 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.117 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.117 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915273+0000", 2023-10-08T07:06:50.117 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003729539 2023-10-08T07:06:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915287+0000", 2023-10-08T07:06:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4058e-05 2023-10-08T07:06:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915295+0000", 2023-10-08T07:06:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.79e-06 2023-10-08T07:06:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.119 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.119 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915361+0000", 2023-10-08T07:06:50.119 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6490999999999997e-05 2023-10-08T07:06:50.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.119 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.119 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.119 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915528+0000", 2023-10-08T07:06:50.119 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016655399999999999 2023-10-08T07:06:50.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.120 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:50.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.915686+0000", 2023-10-08T07:06:50.120 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015756099999999999 2023-10-08T07:06:50.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.120 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.921741+0000", 2023-10-08T07:06:50.120 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060556569999999999 2023-10-08T07:06:50.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.121 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.121 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.121 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.926711+0000", 2023-10-08T07:06:50.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0049696719999999996 2023-10-08T07:06:50.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.121 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.121 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.121 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.926779+0000", 2023-10-08T07:06:50.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8079999999999999e-05 2023-10-08T07:06:50.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.121 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.121 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.122 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.926826+0000", 2023-10-08T07:06:50.122 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6826000000000002e-05 2023-10-08T07:06:50.122 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.122 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.122 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.122 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.122 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:26 4.c 4:3352c333:::10000000004.00000012:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:50.122 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:50.122 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.0454570410000006, 2023-10-08T07:06:50.122 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015456749000000001, 2023-10-08T07:06:50.122 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.123 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.123 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.123 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:50.123 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.123 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 26 2023-10-08T07:06:50.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.123 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.123 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.123 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.123 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:50.123 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.124 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.124 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.124 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:50.124 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.124 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.124 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.124 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999409+0000", 2023-10-08T07:06:50.124 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1570000000000001e-06 2023-10-08T07:06:50.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.124 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.125 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.125 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003237+0000", 2023-10-08T07:06:50.125 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003827619 2023-10-08T07:06:50.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.125 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.125 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003252+0000", 2023-10-08T07:06:50.125 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5068999999999999e-05 2023-10-08T07:06:50.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.125 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.125 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003259+0000", 2023-10-08T07:06:50.126 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1910000000000003e-06 2023-10-08T07:06:50.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.126 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003330+0000", 2023-10-08T07:06:50.126 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0469999999999994e-05 2023-10-08T07:06:50.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.126 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003504+0000", 2023-10-08T07:06:50.126 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017425700000000001 2023-10-08T07:06:50.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.127 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:50.127 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003675+0000", 2023-10-08T07:06:50.127 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000171137 2023-10-08T07:06:50.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.127 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.127 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.010247+0000", 2023-10-08T07:06:50.127 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065716569999999998 2023-10-08T07:06:50.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.128 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.128 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014747+0000", 2023-10-08T07:06:50.128 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045002740000000003 2023-10-08T07:06:50.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.128 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.128 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.128 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014820+0000", 2023-10-08T07:06:50.128 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3310000000000001e-05 2023-10-08T07:06:50.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.128 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.128 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.129 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014865+0000", 2023-10-08T07:06:50.129 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4607999999999997e-05 2023-10-08T07:06:50.129 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.129 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.129 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.129 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:28 4.30 4:0f322a22:::10000000004.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:50.129 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:50.129 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.8735010160000005, 2023-10-08T07:06:50.129 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015624149, 2023-10-08T07:06:50.129 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.130 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.130 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.130 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:50.130 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.130 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 28 2023-10-08T07:06:50.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.130 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:50.130 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171372+0000", 2023-10-08T07:06:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8220000000000007e-06 2023-10-08T07:06:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.132 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.132 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175253+0000", 2023-10-08T07:06:50.132 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038812529999999999 2023-10-08T07:06:50.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.132 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.132 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175268+0000", 2023-10-08T07:06:50.132 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4782e-05 2023-10-08T07:06:50.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.132 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.132 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175275+0000", 2023-10-08T07:06:50.133 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0899999999999999e-06 2023-10-08T07:06:50.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.133 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.133 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175345+0000", 2023-10-08T07:06:50.133 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9604000000000006e-05 2023-10-08T07:06:50.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.133 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.133 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175502+0000", 2023-10-08T07:06:50.133 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015699799999999999 2023-10-08T07:06:50.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.134 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:50.134 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175652+0000", 2023-10-08T07:06:50.134 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014977100000000001 2023-10-08T07:06:50.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.134 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.134 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.182743+0000", 2023-10-08T07:06:50.134 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070913800000000004 2023-10-08T07:06:50.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.135 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.135 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186876+0000", 2023-10-08T07:06:50.135 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041328670000000001 2023-10-08T07:06:50.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.135 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.135 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186941+0000", 2023-10-08T07:06:50.135 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5506999999999995e-05 2023-10-08T07:06:50.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.135 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.135 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186989+0000", 2023-10-08T07:06:50.136 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7074999999999999e-05 2023-10-08T07:06:50.136 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.136 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.136 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.136 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.136 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:35 4.a 4:524fba76:::10000000004.0000001b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:50.136 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:50.136 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.2216964939999997, 2023-10-08T07:06:50.136 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016047682000000001, 2023-10-08T07:06:50.136 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.137 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.137 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.137 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:50.137 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.137 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 35 2023-10-08T07:06:50.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.137 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.137 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.137 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:50.137 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:50.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823216+0000", 2023-10-08T07:06:50.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7559999999999999e-05 2023-10-08T07:06:50.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827333+0000", 2023-10-08T07:06:50.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041169290000000001 2023-10-08T07:06:50.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827352+0000", 2023-10-08T07:06:50.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9026e-05 2023-10-08T07:06:50.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827361+0000", 2023-10-08T07:06:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6999999999999997e-06 2023-10-08T07:06:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827414+0000", 2023-10-08T07:06:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3122999999999999e-05 2023-10-08T07:06:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827530+0000", 2023-10-08T07:06:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000115618 2023-10-08T07:06:50.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.141 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:50.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827626+0000", 2023-10-08T07:06:50.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5997999999999998e-05 2023-10-08T07:06:50.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.141 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.834016+0000", 2023-10-08T07:06:50.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.006390298 2023-10-08T07:06:50.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839139+0000", 2023-10-08T07:06:50.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0051226370000000002 2023-10-08T07:06:50.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839180+0000", 2023-10-08T07:06:50.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0905999999999998e-05 2023-10-08T07:06:50.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.143 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.143 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839217+0000", 2023-10-08T07:06:50.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6887000000000001e-05 2023-10-08T07:06:50.143 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.143 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.143 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.143 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:42 4.38 4:1e0977c7:::10000000004.00000022:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:50.143 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:50.143 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 7.5704915179999999, 2023-10-08T07:06:50.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015514448, 2023-10-08T07:06:50.144 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.144 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.144 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.144 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:50.144 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.144 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 42 2023-10-08T07:06:50.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.144 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.144 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.144 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.144 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:50.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.145 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.145 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:50.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.145 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.145 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474376+0000", 2023-10-08T07:06:50.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1150000000000001e-06 2023-10-08T07:06:50.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.146 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478104+0000", 2023-10-08T07:06:50.146 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003728514 2023-10-08T07:06:50.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.146 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478129+0000", 2023-10-08T07:06:50.146 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4655999999999999e-05 2023-10-08T07:06:50.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478140+0000", 2023-10-08T07:06:50.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1012000000000001e-05 2023-10-08T07:06:50.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478221+0000", 2023-10-08T07:06:50.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1099000000000004e-05 2023-10-08T07:06:50.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478343+0000", 2023-10-08T07:06:50.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012129 2023-10-08T07:06:50.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:50.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478444+0000", 2023-10-08T07:06:50.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000101587 2023-10-08T07:06:50.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.485040+0000", 2023-10-08T07:06:50.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065962260000000002 2023-10-08T07:06:50.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.149 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.149 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489774+0000", 2023-10-08T07:06:50.149 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047335889999999999 2023-10-08T07:06:50.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.149 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.149 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489841+0000", 2023-10-08T07:06:50.149 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7232999999999998e-05 2023-10-08T07:06:50.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.149 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.149 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489888+0000", 2023-10-08T07:06:50.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7126999999999998e-05 2023-10-08T07:06:50.150 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.150 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.150 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.150 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.150 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:49 4.2b 4:d7a77d67:::10000000004.00000029:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:50.150 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:43.118728+0000", 2023-10-08T07:06:50.150 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 6.9261376720000003, 2023-10-08T07:06:50.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369198000000001, 2023-10-08T07:06:50.150 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.150 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.151 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.151 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:50.151 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.151 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 49 2023-10-08T07:06:50.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.151 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.151 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.151 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.118728+0000", 2023-10-08T07:06:50.151 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.118728+0000", 2023-10-08T07:06:50.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.118730+0000", 2023-10-08T07:06:50.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4530000000000001e-06 2023-10-08T07:06:50.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122434+0000", 2023-10-08T07:06:50.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0037039220000000001 2023-10-08T07:06:50.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.153 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.153 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122452+0000", 2023-10-08T07:06:50.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7510999999999999e-05 2023-10-08T07:06:50.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.153 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.153 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122461+0000", 2023-10-08T07:06:50.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9760000000000001e-06 2023-10-08T07:06:50.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.154 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.154 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122521+0000", 2023-10-08T07:06:50.154 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0569999999999998e-05 2023-10-08T07:06:50.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.154 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.154 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122636+0000", 2023-10-08T07:06:50.154 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011464 2023-10-08T07:06:50.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:50.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122741+0000", 2023-10-08T07:06:50.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010555799999999999 2023-10-08T07:06:50.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.132341+0000", 2023-10-08T07:06:50.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0095995449999999993 2023-10-08T07:06:50.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.134008+0000", 2023-10-08T07:06:50.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001667015 2023-10-08T07:06:50.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.156 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.156 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.134049+0000", 2023-10-08T07:06:50.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1542000000000003e-05 2023-10-08T07:06:50.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.156 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.156 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.134097+0000", 2023-10-08T07:06:50.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7466000000000003e-05 2023-10-08T07:06:50.156 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.157 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.157 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.157 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1379 4.e 4:70352312:::10000000004.0000001a:head [write 3547136~4096,write 3588096~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:50.157 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:50.157 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.2253799399999998, 2023-10-08T07:06:50.157 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016369865000000001, 2023-10-08T07:06:50.157 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.157 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.157 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.158 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:50.158 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.158 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1379 2023-10-08T07:06:50.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.158 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.158 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.158 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:50.158 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.158 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:50.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819486+0000", 2023-10-08T07:06:50.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:06:50.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819560+0000", 2023-10-08T07:06:50.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4473000000000003e-05 2023-10-08T07:06:50.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819571+0000", 2023-10-08T07:06:50.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0769e-05 2023-10-08T07:06:50.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819576+0000", 2023-10-08T07:06:50.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5410000000000002e-06 2023-10-08T07:06:50.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.161 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.161 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.821667+0000", 2023-10-08T07:06:50.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020909069999999999 2023-10-08T07:06:50.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.161 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.161 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.821747+0000", 2023-10-08T07:06:50.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0260999999999996e-05 2023-10-08T07:06:50.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.161 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835701+0000", 2023-10-08T07:06:50.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013954148 2023-10-08T07:06:50.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.162 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835762+0000", 2023-10-08T07:06:50.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.084e-05 2023-10-08T07:06:50.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.162 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835855+0000", 2023-10-08T07:06:50.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3425999999999996e-05 2023-10-08T07:06:50.163 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.163 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.163 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.163 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.163 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2064 4.32 4:4efc9492:::10000000004.00000032:head [write 110592~4096,write 249856~4096,write 270336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:50.163 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:50.163 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.987034414, 2023-10-08T07:06:50.163 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019126292, 2023-10-08T07:06:50.163 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.163 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.164 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:50.164 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.164 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2064 2023-10-08T07:06:50.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.164 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.164 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:50.164 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:50.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057832+0000", 2023-10-08T07:06:50.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3699999999999999e-07 2023-10-08T07:06:50.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.166 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.166 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057886+0000", 2023-10-08T07:06:50.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4531999999999999e-05 2023-10-08T07:06:50.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.166 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.166 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.166 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057901+0000", 2023-10-08T07:06:50.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4518999999999999e-05 2023-10-08T07:06:50.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.167 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057910+0000", 2023-10-08T07:06:50.167 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4579999999999999e-06 2023-10-08T07:06:50.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.167 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057963+0000", 2023-10-08T07:06:50.167 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3161000000000001e-05 2023-10-08T07:06:50.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.058023+0000", 2023-10-08T07:06:50.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0027e-05 2023-10-08T07:06:50.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076814+0000", 2023-10-08T07:06:50.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018790187 2023-10-08T07:06:50.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076879+0000", 2023-10-08T07:06:50.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4999999999999994e-05 2023-10-08T07:06:50.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076957+0000", 2023-10-08T07:06:50.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8571000000000004e-05 2023-10-08T07:06:50.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.169 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.170 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.170 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2068 4.1a 4:5a59f83a:::10000000004.00000002:head [write 1794048~4096,write 1806336~4096,write 1937408~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:50.170 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:50.170 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.9858580039999998, 2023-10-08T07:06:50.170 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017795372, 2023-10-08T07:06:50.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.170 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.170 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.170 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:50.170 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.170 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2068 2023-10-08T07:06:50.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.171 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.171 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.171 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:50.171 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.171 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.171 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:50.171 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.172 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.172 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059008+0000", 2023-10-08T07:06:50.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1299999999999998e-07 2023-10-08T07:06:50.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.172 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.172 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059061+0000", 2023-10-08T07:06:50.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2905000000000003e-05 2023-10-08T07:06:50.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059077+0000", 2023-10-08T07:06:50.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6099e-05 2023-10-08T07:06:50.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059088+0000", 2023-10-08T07:06:50.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1056000000000001e-05 2023-10-08T07:06:50.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059146+0000", 2023-10-08T07:06:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7385e-05 2023-10-08T07:06:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059210+0000", 2023-10-08T07:06:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4509000000000002e-05 2023-10-08T07:06:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059307+0000", 2023-10-08T07:06:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6273000000000005e-05 2023-10-08T07:06:50.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.060916+0000", 2023-10-08T07:06:50.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001609365 2023-10-08T07:06:50.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076698+0000", 2023-10-08T07:06:50.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015781951999999998 2023-10-08T07:06:50.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076762+0000", 2023-10-08T07:06:50.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3744999999999994e-05 2023-10-08T07:06:50.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076803+0000", 2023-10-08T07:06:50.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1170000000000001e-05 2023-10-08T07:06:50.176 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.176 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.176 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.177 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2087 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1101824~12288,write 1150976~4096,write 1171456~4096,write 1265664~4096,write 1376256~4096,write 1519616~4096,write 1691648~4096,write 1724416~4096,write 1753088~4096,write 1794048~4096,write 1908736~4096,write 1921024~4096,write 2011136~4096,write 2207744~4096,write 2285568~4096,write 2744320~8192,write 2760704~4096,write 2879488~4096,write 2891776~4096,write 3129344~4096,write 3145728~4096,write 3215360~4096,write 3330048~8192,write 3362816~4096,write 3387392~4096,write 3485696~4096,write 3620864~4096,write 4120576~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:50.177 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:50.177 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.9808875549999998, 2023-10-08T07:06:50.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016557490000000001, 2023-10-08T07:06:50.177 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.177 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.177 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.177 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:50.177 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.177 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2087 2023-10-08T07:06:50.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.178 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:50.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:50.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:50.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:06:50.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064123+0000", 2023-10-08T07:06:50.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014467700000000001 2023-10-08T07:06:50.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064131+0000", 2023-10-08T07:06:50.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9230000000000002e-06 2023-10-08T07:06:50.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064139+0000", 2023-10-08T07:06:50.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5560000000000002e-06 2023-10-08T07:06:50.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.073553+0000", 2023-10-08T07:06:50.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0094146679999999993 2023-10-08T07:06:50.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.073655+0000", 2023-10-08T07:06:50.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010128000000000001 2023-10-08T07:06:50.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:50.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.074076+0000", 2023-10-08T07:06:50.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00042132399999999999 2023-10-08T07:06:50.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.077289+0000", 2023-10-08T07:06:50.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032133589999999998 2023-10-08T07:06:50.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080463+0000", 2023-10-08T07:06:50.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031740940000000001 2023-10-08T07:06:50.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080512+0000", 2023-10-08T07:06:50.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8343000000000001e-05 2023-10-08T07:06:50.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080535+0000", 2023-10-08T07:06:50.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3586000000000001e-05 2023-10-08T07:06:50.183 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.183 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.183 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.183 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2088 4.2a 4:5404a18c:::10000000004.00000025:head [write 774144~4096,write 811008~4096,write 884736~4096,write 909312~4096,write 958464~4096,write 1028096~4096,write 1191936~4096,write 1224704~4096,write 1261568~4096,write 1294336~4096,write 1331200~4096,write 1523712~4096,write 1540096~4096,write 1572864~4096,write 1667072~4096,write 1810432~4096,write 1818624~4096,write 1859584~4096,write 1892352~4096,write 1916928~4096,write 2084864~4096,write 2158592~4096,write 2494464~4096,write 2543616~4096,write 2703360~4096,write 2748416~8192,write 2777088~4096,write 3784704~4096,write 3911680~4096,write 4120576~4096,write 4145152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:50.184 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:50.184 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.9807034569999997, 2023-10-08T07:06:50.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017312658000000002, 2023-10-08T07:06:50.184 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:50.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:50.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:50.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.184 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2088 2023-10-08T07:06:50.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.184 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:50.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:50.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:50.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:50.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:50.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:50.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:50.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064163+0000", 2023-10-08T07:06:50.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:50.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:50.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064375+0000", 2023-10-08T07:06:50.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00021216599999999999 2023-10-08T07:06:50.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:50.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064385+0000", 2023-10-08T07:06:50.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0525e-05 2023-10-08T07:06:50.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064395+0000", 2023-10-08T07:06:50.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1689999999999998e-06 2023-10-08T07:06:50.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:50.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076644+0000", 2023-10-08T07:06:50.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012248991000000001 2023-10-08T07:06:50.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:50.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076709+0000", 2023-10-08T07:06:50.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5708000000000002e-05 2023-10-08T07:06:50.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:50.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081362+0000", 2023-10-08T07:06:50.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0046527449999999998 2023-10-08T07:06:50.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:50.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081425+0000", 2023-10-08T07:06:50.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3250000000000006e-05 2023-10-08T07:06:50.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:50.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:50.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:50.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081475+0000", 2023-10-08T07:06:50.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9246999999999998e-05 2023-10-08T07:06:50.189 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.189 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.189 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.189 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:50.190 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:50.190 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:50.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2023-10-08T07:06:50.191 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:50.192 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:50.190+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:50.216 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T07:06:50.292 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:50.291+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:50.359 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:50.359 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:50.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.360 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:13278 4.29 4:94216392:::10000000004.0000002b:head [write 3477504~4096 in=4096b,write 3620864~4096 in=4096b,write 3690496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.360 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.352658+0000", 2023-10-08T07:06:50.360 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0054459230000000001, 2023-10-08T07:06:50.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005476931, 2023-10-08T07:06:50.360 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.360 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:50.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.361 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.361 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13278 2023-10-08T07:06:50.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.361 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.352658+0000", 2023-10-08T07:06:50.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.352658+0000", 2023-10-08T07:06:50.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.352659+0000", 2023-10-08T07:06:50.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2200000000000003e-07 2023-10-08T07:06:50.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.352682+0000", 2023-10-08T07:06:50.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2963e-05 2023-10-08T07:06:50.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.352698+0000", 2023-10-08T07:06:50.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5670000000000001e-05 2023-10-08T07:06:50.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.352704+0000", 2023-10-08T07:06:50.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7680000000000003e-06 2023-10-08T07:06:50.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.352752+0000", 2023-10-08T07:06:50.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7815999999999998e-05 2023-10-08T07:06:50.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.352804+0000", 2023-10-08T07:06:50.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1753999999999999e-05 2023-10-08T07:06:50.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:50.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.352895+0000", 2023-10-08T07:06:50.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0958999999999994e-05 2023-10-08T07:06:50.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.354623+0000", 2023-10-08T07:06:50.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001728523 2023-10-08T07:06:50.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.365 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.366 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:13279 4.b 4:d0c991e0:::10000000004.0000002d:head [write 868352~4096 in=4096b,write 950272~4096 in=4096b,write 1003520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.366 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.352986+0000", 2023-10-08T07:06:50.366 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0051183349999999999, 2023-10-08T07:06:50.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052627689999999996, 2023-10-08T07:06:50.366 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.366 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:50.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.366 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13279 2023-10-08T07:06:50.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.352986+0000", 2023-10-08T07:06:50.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.352986+0000", 2023-10-08T07:06:50.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.352987+0000", 2023-10-08T07:06:50.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5799999999999998e-07 2023-10-08T07:06:50.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353011+0000", 2023-10-08T07:06:50.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4289000000000001e-05 2023-10-08T07:06:50.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353020+0000", 2023-10-08T07:06:50.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1600000000000004e-06 2023-10-08T07:06:50.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353025+0000", 2023-10-08T07:06:50.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7249999999999997e-06 2023-10-08T07:06:50.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353067+0000", 2023-10-08T07:06:50.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2055000000000003e-05 2023-10-08T07:06:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353113+0000", 2023-10-08T07:06:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5768e-05 2023-10-08T07:06:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353201+0000", 2023-10-08T07:06:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8801000000000006e-05 2023-10-08T07:06:50.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.355439+0000", 2023-10-08T07:06:50.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022375289999999998 2023-10-08T07:06:50.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.371 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.371 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:13282 4.11 4:8963efe6:::10000000004.00000009:head [write 1507328~4096 in=4096b,write 2084864~4096 in=4096b,write 2228224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.371 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.353909+0000", 2023-10-08T07:06:50.371 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0041954419999999997, 2023-10-08T07:06:50.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044496020000000004, 2023-10-08T07:06:50.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:50.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.372 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13282 2023-10-08T07:06:50.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.372 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353909+0000", 2023-10-08T07:06:50.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353909+0000", 2023-10-08T07:06:50.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353909+0000", 2023-10-08T07:06:50.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8299999999999996e-07 2023-10-08T07:06:50.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353919+0000", 2023-10-08T07:06:50.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9520000000000006e-06 2023-10-08T07:06:50.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353927+0000", 2023-10-08T07:06:50.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3760000000000002e-06 2023-10-08T07:06:50.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353932+0000", 2023-10-08T07:06:50.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2290000000000002e-06 2023-10-08T07:06:50.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.353970+0000", 2023-10-08T07:06:50.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8460000000000001e-05 2023-10-08T07:06:50.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.354021+0000", 2023-10-08T07:06:50.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0322999999999999e-05 2023-10-08T07:06:50.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:50.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.354107+0000", 2023-10-08T07:06:50.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5903999999999996e-05 2023-10-08T07:06:50.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356320+0000", 2023-10-08T07:06:50.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022130520000000001 2023-10-08T07:06:50.377 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.377 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.377 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.378 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:13286 4.19 4:9a1dab10:::10000000004.0000001d:head [write 2199552~4096 in=4096b,write 2490368~4096 in=4096b,write 2539520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.378 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.355330+0000", 2023-10-08T07:06:50.378 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0027744480000000001, 2023-10-08T07:06:50.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031066269999999998, 2023-10-08T07:06:50.378 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.378 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:50.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.379 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13286 2023-10-08T07:06:50.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.379 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.355330+0000", 2023-10-08T07:06:50.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.355330+0000", 2023-10-08T07:06:50.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.355330+0000", 2023-10-08T07:06:50.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8400000000000003e-07 2023-10-08T07:06:50.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.355345+0000", 2023-10-08T07:06:50.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2023-10-08T07:06:50.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.355354+0000", 2023-10-08T07:06:50.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1849999999999993e-06 2023-10-08T07:06:50.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.355361+0000", 2023-10-08T07:06:50.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.024e-06 2023-10-08T07:06:50.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.355409+0000", 2023-10-08T07:06:50.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7466999999999998e-05 2023-10-08T07:06:50.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.355491+0000", 2023-10-08T07:06:50.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1817000000000006e-05 2023-10-08T07:06:50.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.382 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.383 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:13287 4.3a e42/17 4:5fb70c0f:::10000000004.0000002e:head v 42'589, mlcod=42'586)", 2023-10-08T07:06:50.383 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.356286+0000", 2023-10-08T07:06:50.383 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0018182739999999999, 2023-10-08T07:06:50.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021906529999999999, 2023-10-08T07:06:50.383 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.383 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:50.383 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356286+0000", 2023-10-08T07:06:50.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356286+0000", 2023-10-08T07:06:50.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356286+0000", 2023-10-08T07:06:50.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.75e-07 2023-10-08T07:06:50.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356304+0000", 2023-10-08T07:06:50.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7836e-05 2023-10-08T07:06:50.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356311+0000", 2023-10-08T07:06:50.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8040000000000004e-06 2023-10-08T07:06:50.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356318+0000", 2023-10-08T07:06:50.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9349999999999997e-06 2023-10-08T07:06:50.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356355+0000", 2023-10-08T07:06:50.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7276e-05 2023-10-08T07:06:50.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356366+0000", 2023-10-08T07:06:50.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1389000000000001e-05 2023-10-08T07:06:50.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.387 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.387 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:13289 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 3887104~4096 in=4096b,write 3969024~4096 in=4096b,write 4030464~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.387 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.356429+0000", 2023-10-08T07:06:50.387 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001675078, 2023-10-08T07:06:50.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020861159999999998, 2023-10-08T07:06:50.388 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:50.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.388 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13289 2023-10-08T07:06:50.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.388 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356429+0000", 2023-10-08T07:06:50.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356429+0000", 2023-10-08T07:06:50.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356430+0000", 2023-10-08T07:06:50.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2699999999999999e-07 2023-10-08T07:06:50.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356438+0000", 2023-10-08T07:06:50.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5089999999999993e-06 2023-10-08T07:06:50.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356445+0000", 2023-10-08T07:06:50.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.421e-06 2023-10-08T07:06:50.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356449+0000", 2023-10-08T07:06:50.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3939999999999998e-06 2023-10-08T07:06:50.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356484+0000", 2023-10-08T07:06:50.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5410000000000001e-05 2023-10-08T07:06:50.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356534+0000", 2023-10-08T07:06:50.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.003e-05 2023-10-08T07:06:50.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.392 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.392 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:13290 4.7 4:e13e8cdb:::10000000004.00000028:head [write 2121728~4096 in=4096b,write 2355200~4096 in=4096b,write 2404352~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.392 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.356797+0000", 2023-10-08T07:06:50.393 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001307084, 2023-10-08T07:06:50.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017603969999999999, 2023-10-08T07:06:50.393 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.393 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:50.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.393 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13290 2023-10-08T07:06:50.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.393 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356797+0000", 2023-10-08T07:06:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356797+0000", 2023-10-08T07:06:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356797+0000", 2023-10-08T07:06:50.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1300000000000001e-07 2023-10-08T07:06:50.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356813+0000", 2023-10-08T07:06:50.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5956000000000001e-05 2023-10-08T07:06:50.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356818+0000", 2023-10-08T07:06:50.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9280000000000001e-06 2023-10-08T07:06:50.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356822+0000", 2023-10-08T07:06:50.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4649999999999999e-06 2023-10-08T07:06:50.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356866+0000", 2023-10-08T07:06:50.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4135999999999999e-05 2023-10-08T07:06:50.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.356918+0000", 2023-10-08T07:06:50.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2413000000000001e-05 2023-10-08T07:06:50.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.397 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.398 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:13291 4.7 4:e2479c46:::10000000004.00000024:head [write 3592192~4096 in=4096b,write 3612672~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.398 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.357076+0000", 2023-10-08T07:06:50.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001028008, 2023-10-08T07:06:50.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015247150000000001, 2023-10-08T07:06:50.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.398 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:50.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.398 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13291 2023-10-08T07:06:50.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.399 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357076+0000", 2023-10-08T07:06:50.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357076+0000", 2023-10-08T07:06:50.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357076+0000", 2023-10-08T07:06:50.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2100000000000002e-07 2023-10-08T07:06:50.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357095+0000", 2023-10-08T07:06:50.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8427000000000002e-05 2023-10-08T07:06:50.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357099+0000", 2023-10-08T07:06:50.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5510000000000001e-06 2023-10-08T07:06:50.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357103+0000", 2023-10-08T07:06:50.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1839999999999999e-06 2023-10-08T07:06:50.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357900+0000", 2023-10-08T07:06:50.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00079699199999999995 2023-10-08T07:06:50.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357957+0000", 2023-10-08T07:06:50.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6938999999999998e-05 2023-10-08T07:06:50.402 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.402 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.402 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.402 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:13292 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3424256~4096 in=4096b,write 3432448~4096 in=4096b,write 3461120~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.403 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.357429+0000", 2023-10-08T07:06:50.403 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00067484299999999995, 2023-10-08T07:06:50.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001247312, 2023-10-08T07:06:50.403 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.403 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:50.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.403 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13292 2023-10-08T07:06:50.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.403 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357429+0000", 2023-10-08T07:06:50.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357429+0000", 2023-10-08T07:06:50.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357430+0000", 2023-10-08T07:06:50.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1200000000000003e-07 2023-10-08T07:06:50.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357454+0000", 2023-10-08T07:06:50.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4258999999999999e-05 2023-10-08T07:06:50.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357462+0000", 2023-10-08T07:06:50.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7749999999999993e-06 2023-10-08T07:06:50.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357466+0000", 2023-10-08T07:06:50.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999996e-06 2023-10-08T07:06:50.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357512+0000", 2023-10-08T07:06:50.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5821000000000001e-05 2023-10-08T07:06:50.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357605+0000", 2023-10-08T07:06:50.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3185999999999999e-05 2023-10-08T07:06:50.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:50.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357761+0000", 2023-10-08T07:06:50.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015632800000000001 2023-10-08T07:06:50.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.408 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.408 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:13293 4.4 4:2158769a:::10000000004.0000002a:head [write 4046848~4096 in=4096b,write 4091904~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.408 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.357734+0000", 2023-10-08T07:06:50.408 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00036990599999999998, 2023-10-08T07:06:50.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001055474, 2023-10-08T07:06:50.409 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.409 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:50.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.409 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13293 2023-10-08T07:06:50.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.409 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357734+0000", 2023-10-08T07:06:50.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357734+0000", 2023-10-08T07:06:50.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357734+0000", 2023-10-08T07:06:50.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4799999999999999e-07 2023-10-08T07:06:50.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357740+0000", 2023-10-08T07:06:50.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5820000000000001e-06 2023-10-08T07:06:50.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357745+0000", 2023-10-08T07:06:50.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5689999999999998e-06 2023-10-08T07:06:50.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357748+0000", 2023-10-08T07:06:50.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0649999999999999e-06 2023-10-08T07:06:50.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357784+0000", 2023-10-08T07:06:50.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5896000000000003e-05 2023-10-08T07:06:50.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357830+0000", 2023-10-08T07:06:50.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6863999999999997e-05 2023-10-08T07:06:50.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.413 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.414 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:13294 4.10 4:0b5763e1:::10000000004.00000015:head [write 2326528~4096 in=4096b,write 2445312~4096 in=4096b,write 2506752~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.414 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.357935+0000", 2023-10-08T07:06:50.414 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00016861299999999999, 2023-10-08T07:06:50.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095182000000000003, 2023-10-08T07:06:50.414 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.414 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:50.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.414 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13294 2023-10-08T07:06:50.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.415 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357935+0000", 2023-10-08T07:06:50.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357935+0000", 2023-10-08T07:06:50.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357936+0000", 2023-10-08T07:06:50.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8400000000000003e-07 2023-10-08T07:06:50.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357963+0000", 2023-10-08T07:06:50.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7007000000000001e-05 2023-10-08T07:06:50.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357973+0000", 2023-10-08T07:06:50.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6080000000000002e-06 2023-10-08T07:06:50.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.357980+0000", 2023-10-08T07:06:50.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4789999999999999e-06 2023-10-08T07:06:50.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.358026+0000", 2023-10-08T07:06:50.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5861e-05 2023-10-08T07:06:50.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.358109+0000", 2023-10-08T07:06:50.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2867000000000005e-05 2023-10-08T07:06:50.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.418 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.418 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:13295 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 1720320~4096 in=4096b,write 1765376~4096 in=4096b,write 1785856~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.358243+0000", 2023-10-08T07:06:50.419 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9998612, 2023-10-08T07:06:50.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000751466, 2023-10-08T07:06:50.419 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.419 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:50.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.419 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13295 2023-10-08T07:06:50.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.419 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.358243+0000", 2023-10-08T07:06:50.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.358243+0000", 2023-10-08T07:06:50.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.358244+0000", 2023-10-08T07:06:50.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1399999999999996e-07 2023-10-08T07:06:50.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.358277+0000", 2023-10-08T07:06:50.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3225000000000001e-05 2023-10-08T07:06:50.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.358285+0000", 2023-10-08T07:06:50.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2050000000000002e-06 2023-10-08T07:06:50.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.358298+0000", 2023-10-08T07:06:50.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2488e-05 2023-10-08T07:06:50.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.358355+0000", 2023-10-08T07:06:50.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6944999999999998e-05 2023-10-08T07:06:50.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.358409+0000", 2023-10-08T07:06:50.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4274000000000002e-05 2023-10-08T07:06:50.423 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.423 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.423 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.423 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.423 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:06:50.423 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 12 2023-10-08T07:06:50.423 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:50.425 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:50.425 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:50.423+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:50.525 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:50.524+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:50.627 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:50.626+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:50.642 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:50.643 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:50.643 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:50.643 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:50.644 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:50.656 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:50.728 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:50.727+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:50.828 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:50.827+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:50.866 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:50.866 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:50.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:50.866 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:50.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.866 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:50.867 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:50.867 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.546621608999999, 2023-10-08T07:06:50.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013690043000000001, 2023-10-08T07:06:50.867 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.867 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.867 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:50.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316522+0000", 2023-10-08T07:06:50.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316530+0000", 2023-10-08T07:06:50.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:06:50.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316538+0000", 2023-10-08T07:06:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:06:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316554+0000", 2023-10-08T07:06:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467e-05 2023-10-08T07:06:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316569+0000", 2023-10-08T07:06:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4109e-05 2023-10-08T07:06:50.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317136+0000", 2023-10-08T07:06:50.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056756999999999999 2023-10-08T07:06:50.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317285+0000", 2023-10-08T07:06:50.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149111 2023-10-08T07:06:50.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:50.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317441+0000", 2023-10-08T07:06:50.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015584400000000001 2023-10-08T07:06:50.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319741+0000", 2023-10-08T07:06:50.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022994349999999998 2023-10-08T07:06:50.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330128+0000", 2023-10-08T07:06:50.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010387608 2023-10-08T07:06:50.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330181+0000", 2023-10-08T07:06:50.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2482000000000003e-05 2023-10-08T07:06:50.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330212+0000", 2023-10-08T07:06:50.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1667e-05 2023-10-08T07:06:50.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.873 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.873 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:50.873 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:50.873 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.546547825000005, 2023-10-08T07:06:50.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013731024999999999, 2023-10-08T07:06:50.873 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.873 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.873 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:50.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316596+0000", 2023-10-08T07:06:50.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316597+0000", 2023-10-08T07:06:50.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:06:50.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316602+0000", 2023-10-08T07:06:50.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8919999999999999e-06 2023-10-08T07:06:50.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316612+0000", 2023-10-08T07:06:50.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:06:50.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.316619+0000", 2023-10-08T07:06:50.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:06:50.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317820+0000", 2023-10-08T07:06:50.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001200574 2023-10-08T07:06:50.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318261+0000", 2023-10-08T07:06:50.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00044131200000000002 2023-10-08T07:06:50.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:50.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318447+0000", 2023-10-08T07:06:50.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018648499999999999 2023-10-08T07:06:50.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319748+0000", 2023-10-08T07:06:50.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013008609999999999 2023-10-08T07:06:50.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330253+0000", 2023-10-08T07:06:50.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010505059000000001 2023-10-08T07:06:50.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330300+0000", 2023-10-08T07:06:50.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6672000000000003e-05 2023-10-08T07:06:50.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330327+0000", 2023-10-08T07:06:50.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7168000000000001e-05 2023-10-08T07:06:50.879 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.879 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.879 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.879 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:50.880 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:50.880 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.545960077999993, 2023-10-08T07:06:50.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01353328, 2023-10-08T07:06:50.880 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.886 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.886 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:50.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317184+0000", 2023-10-08T07:06:50.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317185+0000", 2023-10-08T07:06:50.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5499999999999996e-07 2023-10-08T07:06:50.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317191+0000", 2023-10-08T07:06:50.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6510000000000004e-06 2023-10-08T07:06:50.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317201+0000", 2023-10-08T07:06:50.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7040000000000006e-06 2023-10-08T07:06:50.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317210+0000", 2023-10-08T07:06:50.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1470000000000007e-06 2023-10-08T07:06:50.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318738+0000", 2023-10-08T07:06:50.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015279099999999999 2023-10-08T07:06:50.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318826+0000", 2023-10-08T07:06:50.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7917999999999994e-05 2023-10-08T07:06:50.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:50.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.318988+0000", 2023-10-08T07:06:50.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161998 2023-10-08T07:06:50.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.320105+0000", 2023-10-08T07:06:50.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001117112 2023-10-08T07:06:50.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330655+0000", 2023-10-08T07:06:50.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010549384 2023-10-08T07:06:50.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330689+0000", 2023-10-08T07:06:50.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4113999999999999e-05 2023-10-08T07:06:50.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330717+0000", 2023-10-08T07:06:50.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8387000000000001e-05 2023-10-08T07:06:50.894 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.894 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.894 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.894 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:50.894 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:50.895 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 77.545814492000005, 2023-10-08T07:06:50.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01362142, 2023-10-08T07:06:50.895 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.895 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:50.895 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:50.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317329+0000", 2023-10-08T07:06:50.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317330+0000", 2023-10-08T07:06:50.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6200000000000006e-07 2023-10-08T07:06:50.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317334+0000", 2023-10-08T07:06:50.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.647e-06 2023-10-08T07:06:50.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317343+0000", 2023-10-08T07:06:50.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:06:50.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.317350+0000", 2023-10-08T07:06:50.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:06:50.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319434+0000", 2023-10-08T07:06:50.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020833869999999999 2023-10-08T07:06:50.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.319571+0000", 2023-10-08T07:06:50.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013715299999999999 2023-10-08T07:06:50.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:05:33.330951+0000", 2023-10-08T07:06:50.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011379998000000001 2023-10-08T07:06:50.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.901 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.901 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:48 4.7 4:e13e8cdb:::10000000004.00000028:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:50.901 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:43.026119+0000", 2023-10-08T07:06:50.901 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.8370245780000003, 2023-10-08T07:06:50.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015490617999999999, 2023-10-08T07:06:50.902 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.902 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.902 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 48 2023-10-08T07:06:50.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.903 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.026119+0000", 2023-10-08T07:06:50.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.026119+0000", 2023-10-08T07:06:50.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.026121+0000", 2023-10-08T07:06:50.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0389999999999999e-06 2023-10-08T07:06:50.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035074+0000", 2023-10-08T07:06:50.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089530200000000008 2023-10-08T07:06:50.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035104+0000", 2023-10-08T07:06:50.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9896999999999999e-05 2023-10-08T07:06:50.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035124+0000", 2023-10-08T07:06:50.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0188999999999999e-05 2023-10-08T07:06:50.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035225+0000", 2023-10-08T07:06:50.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100399 2023-10-08T07:06:50.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035360+0000", 2023-10-08T07:06:50.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013467199999999999 2023-10-08T07:06:50.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.041522+0000", 2023-10-08T07:06:50.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061625159999999998 2023-10-08T07:06:50.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.041561+0000", 2023-10-08T07:06:50.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9291e-05 2023-10-08T07:06:50.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.041610+0000", 2023-10-08T07:06:50.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8594999999999998e-05 2023-10-08T07:06:50.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.911 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.911 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:1391 4.16 4:69eefec8:::10000000004.0000003a:head [write 3039232~4096,write 3096576~4096,write 3104768~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:50.912 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:45.823106+0000", 2023-10-08T07:06:50.912 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.0400378699999999, 2023-10-08T07:06:50.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013965452, 2023-10-08T07:06:50.912 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.912 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.912 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.912 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.912 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.912 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1391 2023-10-08T07:06:50.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.912 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823106+0000", 2023-10-08T07:06:50.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823106+0000", 2023-10-08T07:06:50.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823107+0000", 2023-10-08T07:06:50.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8800000000000002e-07 2023-10-08T07:06:50.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823134+0000", 2023-10-08T07:06:50.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6968999999999999e-05 2023-10-08T07:06:50.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823144+0000", 2023-10-08T07:06:50.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0213e-05 2023-10-08T07:06:50.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823149+0000", 2023-10-08T07:06:50.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4650000000000002e-06 2023-10-08T07:06:50.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823189+0000", 2023-10-08T07:06:50.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9279000000000001e-05 2023-10-08T07:06:50.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823249+0000", 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0288999999999998e-05 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823349+0000", 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100084 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.826473+0000", 2023-10-08T07:06:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031240389999999999 2023-10-08T07:06:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.836982+0000", 2023-10-08T07:06:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010508721 2023-10-08T07:06:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.837035+0000", 2023-10-08T07:06:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3310000000000003e-05 2023-10-08T07:06:50.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.837071+0000", 2023-10-08T07:06:50.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6294999999999997e-05 2023-10-08T07:06:50.918 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.918 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.918 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.918 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:1393 4.26 4:672c55ca:::10000000004.00000006:head [write 2113536~4096,write 2392064~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:50.918 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:45.823661+0000", 2023-10-08T07:06:50.919 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.0394830769999999, 2023-10-08T07:06:50.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013366281000000001, 2023-10-08T07:06:50.919 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.919 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.919 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.919 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.919 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.919 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1393 2023-10-08T07:06:50.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.919 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823661+0000", 2023-10-08T07:06:50.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823661+0000", 2023-10-08T07:06:50.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823662+0000", 2023-10-08T07:06:50.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6700000000000003e-07 2023-10-08T07:06:50.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823672+0000", 2023-10-08T07:06:50.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2023-10-08T07:06:50.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823681+0000", 2023-10-08T07:06:50.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5320000000000006e-06 2023-10-08T07:06:50.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823689+0000", 2023-10-08T07:06:50.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7370000000000006e-06 2023-10-08T07:06:50.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823736+0000", 2023-10-08T07:06:50.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7346999999999999e-05 2023-10-08T07:06:50.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823818+0000", 2023-10-08T07:06:50.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1754000000000004e-05 2023-10-08T07:06:50.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:50.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.823951+0000", 2023-10-08T07:06:50.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013372199999999999 2023-10-08T07:06:50.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.826494+0000", 2023-10-08T07:06:50.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025422690000000002 2023-10-08T07:06:50.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.836959+0000", 2023-10-08T07:06:50.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010465275 2023-10-08T07:06:50.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.836992+0000", 2023-10-08T07:06:50.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3322999999999999e-05 2023-10-08T07:06:50.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:45.837027+0000", 2023-10-08T07:06:50.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4897999999999997e-05 2023-10-08T07:06:50.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.925 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.925 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:4930 4.10 4:0b5763e1:::10000000004.00000015:head [write 757760~4096,write 839680~4096,write 1126400~4096,write 1617920~4096,write 1634304~4096,write 1650688~4096,write 1667072~4096,write 1732608~4096,write 1765376~4096,write 1847296~4096,write 1970176~4096,write 2064384~4096,write 2072576~4096,write 2179072~4096,write 2240512~4096,write 2314240~4096,write 2342912~4096,write 2351104~4096,write 2568192~4096,write 2609152~4096,write 2920448~4096,write 3006464~4096,write 3047424~4096,write 3121152~4096,write 3567616~4096,write 3665920~4096,write 3674112~4096,write 3719168~4096,write 3743744~4096,write 3821568~4096,write 3981312~4096,write 4014080~4096,write 4112384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:50.925 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:47.079873+0000", 2023-10-08T07:06:50.925 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.7832713359999999, 2023-10-08T07:06:50.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014025734999999999, 2023-10-08T07:06:50.926 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.926 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.926 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.926 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.926 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.926 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 4930 2023-10-08T07:06:50.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.926 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.079873+0000", 2023-10-08T07:06:50.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.079873+0000", 2023-10-08T07:06:50.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.079873+0000", 2023-10-08T07:06:50.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2023-10-08T07:06:50.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.079966+0000", 2023-10-08T07:06:50.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3141999999999997e-05 2023-10-08T07:06:50.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.079973+0000", 2023-10-08T07:06:50.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3430000000000001e-06 2023-10-08T07:06:50.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.079977+0000", 2023-10-08T07:06:50.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.121e-06 2023-10-08T07:06:50.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.080023+0000", 2023-10-08T07:06:50.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5858e-05 2023-10-08T07:06:50.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.080135+0000", 2023-10-08T07:06:50.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112267 2023-10-08T07:06:50.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.093799+0000", 2023-10-08T07:06:50.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013663981 2023-10-08T07:06:50.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.093856+0000", 2023-10-08T07:06:50.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6990000000000002e-05 2023-10-08T07:06:50.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.093898+0000", 2023-10-08T07:06:50.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2450999999999997e-05 2023-10-08T07:06:50.931 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.931 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.931 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.931 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:5249 4.c e40/17 4:3352c333:::10000000004.00000012:head v 40'163, mlcod=40'161)", 2023-10-08T07:06:50.931 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:47.246107+0000", 2023-10-08T07:06:50.931 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.6170371819999998, 2023-10-08T07:06:50.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013364368, 2023-10-08T07:06:50.932 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.932 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.932 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.246107+0000", 2023-10-08T07:06:50.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.246107+0000", 2023-10-08T07:06:50.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.246107+0000", 2023-10-08T07:06:50.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.68e-07 2023-10-08T07:06:50.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.246117+0000", 2023-10-08T07:06:50.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9499999999999996e-06 2023-10-08T07:06:50.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.246126+0000", 2023-10-08T07:06:50.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6230000000000003e-06 2023-10-08T07:06:50.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.246131+0000", 2023-10-08T07:06:50.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2023-10-08T07:06:50.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.246174+0000", 2023-10-08T07:06:50.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3350999999999999e-05 2023-10-08T07:06:50.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.246195+0000", 2023-10-08T07:06:50.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1194000000000001e-05 2023-10-08T07:06:50.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.259439+0000", 2023-10-08T07:06:50.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013243761999999999 2023-10-08T07:06:50.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:47.259471+0000", 2023-10-08T07:06:50.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2030000000000003e-05 2023-10-08T07:06:50.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.936 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.936 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:12931 4.7 4:e2479c46:::10000000004.00000024:head [write 700416~4096,write 794624~4096,write 839680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.936 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.218715+0000", 2023-10-08T07:06:50.936 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64442889199999998, 2023-10-08T07:06:50.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013800058, 2023-10-08T07:06:50.937 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.937 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.937 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 12931 2023-10-08T07:06:50.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.937 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.218715+0000", 2023-10-08T07:06:50.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.218715+0000", 2023-10-08T07:06:50.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.218716+0000", 2023-10-08T07:06:50.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.13e-07 2023-10-08T07:06:50.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.218742+0000", 2023-10-08T07:06:50.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5921000000000001e-05 2023-10-08T07:06:50.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.218748+0000", 2023-10-08T07:06:50.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8770000000000004e-06 2023-10-08T07:06:50.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.218753+0000", 2023-10-08T07:06:50.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5800000000000002e-06 2023-10-08T07:06:50.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.220185+0000", 2023-10-08T07:06:50.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014317030000000001 2023-10-08T07:06:50.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.220265+0000", 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0448e-05 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.232386+0000", 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012121228 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.232443+0000", 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6818999999999999e-05 2023-10-08T07:06:50.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.232515+0000", 2023-10-08T07:06:50.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1868999999999999e-05 2023-10-08T07:06:50.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.942 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.942 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14151 4.3f 4:fc9a2d79:::10000000004.0000002f:head [write 3731456~4096,write 3739648~4096,write 3895296~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.942 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.674958+0000", 2023-10-08T07:06:50.943 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.188185451, 2023-10-08T07:06:50.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014681177, 2023-10-08T07:06:50.943 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.943 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.943 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14151 2023-10-08T07:06:50.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.943 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.674958+0000", 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.674958+0000", 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.674959+0000", 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5000000000000002e-07 2023-10-08T07:06:50.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.674969+0000", 2023-10-08T07:06:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6700000000000006e-06 2023-10-08T07:06:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.674979+0000", 2023-10-08T07:06:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6649999999999998e-06 2023-10-08T07:06:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.674986+0000", 2023-10-08T07:06:50.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0419999999999997e-06 2023-10-08T07:06:50.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675043+0000", 2023-10-08T07:06:50.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7188000000000002e-05 2023-10-08T07:06:50.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675095+0000", 2023-10-08T07:06:50.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2274000000000001e-05 2023-10-08T07:06:50.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689521+0000", 2023-10-08T07:06:50.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014425863000000001 2023-10-08T07:06:50.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689589+0000", 2023-10-08T07:06:50.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7722e-05 2023-10-08T07:06:50.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689640+0000", 2023-10-08T07:06:50.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1002999999999999e-05 2023-10-08T07:06:50.948 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.948 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.948 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.948 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:14150 4.30 e42/17 4:0f322a22:::10000000004.00000014:head v 42'237, mlcod=42'235)", 2023-10-08T07:06:50.948 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.675026+0000", 2023-10-08T07:06:50.948 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18811751099999999, 2023-10-08T07:06:50.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017643645999999999, 2023-10-08T07:06:50.949 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.949 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.949 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675026+0000", 2023-10-08T07:06:50.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675026+0000", 2023-10-08T07:06:50.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675027+0000", 2023-10-08T07:06:50.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6899999999999997e-07 2023-10-08T07:06:50.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675038+0000", 2023-10-08T07:06:50.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0716e-05 2023-10-08T07:06:50.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675045+0000", 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0450000000000003e-06 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675050+0000", 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1080000000000001e-06 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675089+0000", 2023-10-08T07:06:50.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9480000000000001e-05 2023-10-08T07:06:50.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675101+0000", 2023-10-08T07:06:50.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1708e-05 2023-10-08T07:06:50.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692618+0000", 2023-10-08T07:06:50.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017517245000000001 2023-10-08T07:06:50.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692670+0000", 2023-10-08T07:06:50.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1774999999999998e-05 2023-10-08T07:06:50.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.953 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.953 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14153 4.15 4:aa4cb2c5:::10000000004.0000003c:head [write 1294336~8192,write 1335296~4096,write 1503232~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.953 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.675598+0000", 2023-10-08T07:06:50.953 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18754622900000001, 2023-10-08T07:06:50.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014289494999999999, 2023-10-08T07:06:50.954 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.954 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.954 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14153 2023-10-08T07:06:50.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.954 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675598+0000", 2023-10-08T07:06:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675598+0000", 2023-10-08T07:06:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675598+0000", 2023-10-08T07:06:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1600000000000001e-07 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675612+0000", 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3869000000000001e-05 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675625+0000", 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2524000000000001e-05 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675634+0000", 2023-10-08T07:06:50.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0669999999999998e-06 2023-10-08T07:06:50.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675687+0000", 2023-10-08T07:06:50.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3001999999999998e-05 2023-10-08T07:06:50.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675777+0000", 2023-10-08T07:06:50.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0224999999999998e-05 2023-10-08T07:06:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689778+0000", 2023-10-08T07:06:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014001039999999999 2023-10-08T07:06:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689813+0000", 2023-10-08T07:06:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4836000000000003e-05 2023-10-08T07:06:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689887+0000", 2023-10-08T07:06:50.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4215999999999996e-05 2023-10-08T07:06:50.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.959 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.959 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14154 4.37 4:efdd41ff:::10000000004.0000001c:head [write 720896~4096,write 737280~4096,write 778240~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.959 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.676036+0000", 2023-10-08T07:06:50.959 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.187108309, 2023-10-08T07:06:50.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733146999999999, 2023-10-08T07:06:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14154 2023-10-08T07:06:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676036+0000", 2023-10-08T07:06:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676036+0000", 2023-10-08T07:06:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676036+0000", 2023-10-08T07:06:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0299999999999999e-07 2023-10-08T07:06:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676058+0000", 2023-10-08T07:06:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1974999999999999e-05 2023-10-08T07:06:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676064+0000", 2023-10-08T07:06:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0109999999999997e-06 2023-10-08T07:06:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676069+0000", 2023-10-08T07:06:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5979999999999999e-06 2023-10-08T07:06:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676117+0000", 2023-10-08T07:06:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000002e-05 2023-10-08T07:06:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676176+0000", 2023-10-08T07:06:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9055000000000003e-05 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689649+0000", 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013472649 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689700+0000", 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1100000000000002e-05 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689769+0000", 2023-10-08T07:06:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8555999999999999e-05 2023-10-08T07:06:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:14155 4.3a e42/17 4:5d52ad5e:::10000000004.00000026:head v 42'631, mlcod=42'629)", 2023-10-08T07:06:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.676658+0000", 2023-10-08T07:06:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18648600900000001, 2023-10-08T07:06:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014413881, 2023-10-08T07:06:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676658+0000", 2023-10-08T07:06:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676658+0000", 2023-10-08T07:06:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676658+0000", 2023-10-08T07:06:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2023-10-08T07:06:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676670+0000", 2023-10-08T07:06:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1514e-05 2023-10-08T07:06:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676681+0000", 2023-10-08T07:06:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1309e-05 2023-10-08T07:06:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676696+0000", 2023-10-08T07:06:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4966e-05 2023-10-08T07:06:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676749+0000", 2023-10-08T07:06:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2488999999999998e-05 2023-10-08T07:06:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676761+0000", 2023-10-08T07:06:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2762000000000001e-05 2023-10-08T07:06:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.691034+0000", 2023-10-08T07:06:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014272376999999999 2023-10-08T07:06:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.691072+0000", 2023-10-08T07:06:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8003999999999997e-05 2023-10-08T07:06:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14158 4.19 4:9b26afe3:::10000000004.00000005:head [write 557056~4096,write 696320~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.677136+0000", 2023-10-08T07:06:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18600809600000001, 2023-10-08T07:06:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014833242999999999, 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14158 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677136+0000", 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677136+0000", 2023-10-08T07:06:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677137+0000", 2023-10-08T07:06:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4799999999999997e-07 2023-10-08T07:06:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677162+0000", 2023-10-08T07:06:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5605e-05 2023-10-08T07:06:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677179+0000", 2023-10-08T07:06:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6169999999999999e-05 2023-10-08T07:06:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677186+0000", 2023-10-08T07:06:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7789999999999996e-06 2023-10-08T07:06:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677228+0000", 2023-10-08T07:06:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1600000000000002e-05 2023-10-08T07:06:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677287+0000", 2023-10-08T07:06:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8709000000000003e-05 2023-10-08T07:06:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.691828+0000", 2023-10-08T07:06:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014541421000000001 2023-10-08T07:06:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.691880+0000", 2023-10-08T07:06:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-05 2023-10-08T07:06:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.691969+0000", 2023-10-08T07:06:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9340999999999997e-05 2023-10-08T07:06:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:14159 4.1b e42/17 4:dbb7dde6:::10000000004.0000002c:head v 42'439, mlcod=42'437)", 2023-10-08T07:06:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.677869+0000", 2023-10-08T07:06:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18527487600000001, 2023-10-08T07:06:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014274352000000001, 2023-10-08T07:06:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677869+0000", 2023-10-08T07:06:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677869+0000", 2023-10-08T07:06:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677870+0000", 2023-10-08T07:06:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5799999999999999e-07 2023-10-08T07:06:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677878+0000", 2023-10-08T07:06:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8319999999999995e-06 2023-10-08T07:06:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677893+0000", 2023-10-08T07:06:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.414e-05 2023-10-08T07:06:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677900+0000", 2023-10-08T07:06:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4549999999999998e-06 2023-10-08T07:06:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677938+0000", 2023-10-08T07:06:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7979999999999999e-05 2023-10-08T07:06:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677953+0000", 2023-10-08T07:06:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4664000000000001e-05 2023-10-08T07:06:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692105+0000", 2023-10-08T07:06:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014152222000000001 2023-10-08T07:06:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692143+0000", 2023-10-08T07:06:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8501000000000003e-05 2023-10-08T07:06:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14161 4.28 4:16edf4d3:::10000000004.00000027:head [write 909312~4096,write 1196032~4096,write 1642496~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.678098+0000", 2023-10-08T07:06:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18504591000000001, 2023-10-08T07:06:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014823800999999999, 2023-10-08T07:06:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14161 2023-10-08T07:06:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678098+0000", 2023-10-08T07:06:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678098+0000", 2023-10-08T07:06:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678099+0000", 2023-10-08T07:06:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3099999999999998e-07 2023-10-08T07:06:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678142+0000", 2023-10-08T07:06:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3974999999999998e-05 2023-10-08T07:06:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678149+0000", 2023-10-08T07:06:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.861e-06 2023-10-08T07:06:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678153+0000", 2023-10-08T07:06:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.878e-06 2023-10-08T07:06:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678211+0000", 2023-10-08T07:06:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7565000000000002e-05 2023-10-08T07:06:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678304+0000", 2023-10-08T07:06:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3565000000000003e-05 2023-10-08T07:06:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692785+0000", 2023-10-08T07:06:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014481093 2023-10-08T07:06:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692845+0000", 2023-10-08T07:06:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9052999999999999e-05 2023-10-08T07:06:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692922+0000", 2023-10-08T07:06:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7280000000000005e-05 2023-10-08T07:06:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14164 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3125248~4096,write 3153920~4096,write 3194880~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.679192+0000", 2023-10-08T07:06:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18395214400000001, 2023-10-08T07:06:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013585160000000001, 2023-10-08T07:06:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14164 2023-10-08T07:06:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.679192+0000", 2023-10-08T07:06:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.679192+0000", 2023-10-08T07:06:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.679192+0000", 2023-10-08T07:06:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5899999999999996e-07 2023-10-08T07:06:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.679238+0000", 2023-10-08T07:06:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5710000000000001e-05 2023-10-08T07:06:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.679248+0000", 2023-10-08T07:06:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4939999999999992e-06 2023-10-08T07:06:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.679253+0000", 2023-10-08T07:06:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1710000000000001e-06 2023-10-08T07:06:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.679287+0000", 2023-10-08T07:06:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4181999999999999e-05 2023-10-08T07:06:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.679344+0000", 2023-10-08T07:06:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6539999999999997e-05 2023-10-08T07:06:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.679435+0000", 2023-10-08T07:06:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.179e-05 2023-10-08T07:06:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.680812+0000", 2023-10-08T07:06:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013771269999999999 2023-10-08T07:06:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692678+0000", 2023-10-08T07:06:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011865139 2023-10-08T07:06:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692731+0000", 2023-10-08T07:06:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3295999999999999e-05 2023-10-08T07:06:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692777+0000", 2023-10-08T07:06:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6051999999999999e-05 2023-10-08T07:06:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14300 4.15 4:aaa619cf:::10000000004.00000004:head [write 1908736~4096,write 3301376~4096,write 3334144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.728474+0000", 2023-10-08T07:06:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.13467030799999999, 2023-10-08T07:06:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016104286999999998, 2023-10-08T07:06:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14300 2023-10-08T07:06:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728474+0000", 2023-10-08T07:06:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728474+0000", 2023-10-08T07:06:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728474+0000", 2023-10-08T07:06:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1500000000000004e-07 2023-10-08T07:06:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728489+0000", 2023-10-08T07:06:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4905e-05 2023-10-08T07:06:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728509+0000", 2023-10-08T07:06:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0083999999999999e-05 2023-10-08T07:06:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728515+0000", 2023-10-08T07:06:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7599999999999999e-06 2023-10-08T07:06:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728560+0000", 2023-10-08T07:06:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4654000000000003e-05 2023-10-08T07:06:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728610+0000", 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0658999999999997e-05 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.744453+0000", 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015842617 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.744506+0000", 2023-10-08T07:06:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3315e-05 2023-10-08T07:06:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.744578+0000", 2023-10-08T07:06:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1577999999999998e-05 2023-10-08T07:06:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:51.001 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:51.002 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:51.001+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:51.002 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:51.102 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:51.101+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:51.176 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:51.176 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:51.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.176 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:15450 4.16 e42/17 4:69eefec8:::10000000004.0000003a:head v 42'251, mlcod=42'249)", 2023-10-08T07:06:51.176 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:51.173242+0000", 2023-10-08T07:06:51.176 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0017658859999999999, 2023-10-08T07:06:51.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001790858, 2023-10-08T07:06:51.176 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173242+0000", 2023-10-08T07:06:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173242+0000", 2023-10-08T07:06:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173242+0000", 2023-10-08T07:06:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2399999999999998e-07 2023-10-08T07:06:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173255+0000", 2023-10-08T07:06:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2811e-05 2023-10-08T07:06:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173262+0000", 2023-10-08T07:06:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9949999999999999e-06 2023-10-08T07:06:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173267+0000", 2023-10-08T07:06:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8049999999999997e-06 2023-10-08T07:06:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173309+0000", 2023-10-08T07:06:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2027999999999998e-05 2023-10-08T07:06:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173330+0000", 2023-10-08T07:06:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0826999999999999e-05 2023-10-08T07:06:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:15451 4.1b 4:d97fb168:::10000000004.00000008:head [write 1724416~4096 in=4096b,write 1753088~4096 in=4096b,write 1835008~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:51.173301+0000", 2023-10-08T07:06:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0017063880000000001, 2023-10-08T07:06:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018172500000000001, 2023-10-08T07:06:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 15451 2023-10-08T07:06:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173301+0000", 2023-10-08T07:06:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173301+0000", 2023-10-08T07:06:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173302+0000", 2023-10-08T07:06:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9400000000000004e-07 2023-10-08T07:06:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173316+0000", 2023-10-08T07:06:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3635000000000001e-05 2023-10-08T07:06:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173326+0000", 2023-10-08T07:06:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7259999999999997e-06 2023-10-08T07:06:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173333+0000", 2023-10-08T07:06:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8310000000000001e-06 2023-10-08T07:06:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173383+0000", 2023-10-08T07:06:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9812999999999999e-05 2023-10-08T07:06:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173430+0000", 2023-10-08T07:06:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7089000000000003e-05 2023-10-08T07:06:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.173518+0000", 2023-10-08T07:06:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7645000000000005e-05 2023-10-08T07:06:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174979+0000", 2023-10-08T07:06:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0014606370000000001 2023-10-08T07:06:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:15454 4.20 4:04004f2c:::10000000004.0000000d:head [write 3772416~4096 in=4096b,write 3850240~4096 in=4096b,write 4026368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:51.174329+0000", 2023-10-08T07:06:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00067831300000000005, 2023-10-08T07:06:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00091931800000000002, 2023-10-08T07:06:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 15454 2023-10-08T07:06:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174329+0000", 2023-10-08T07:06:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174329+0000", 2023-10-08T07:06:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174330+0000", 2023-10-08T07:06:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1600000000000001e-07 2023-10-08T07:06:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174360+0000", 2023-10-08T07:06:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9326999999999999e-05 2023-10-08T07:06:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174372+0000", 2023-10-08T07:06:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2469e-05 2023-10-08T07:06:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174380+0000", 2023-10-08T07:06:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0269999999999995e-06 2023-10-08T07:06:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174443+0000", 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2551000000000005e-05 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174532+0000", 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9431000000000005e-05 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174705+0000", 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017296999999999999 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:15453 4.26 e42/17 4:672c55ca:::10000000004.00000006:head v 42'240, mlcod=42'238)", 2023-10-08T07:06:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:51.174404+0000", 2023-10-08T07:06:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00060404000000000002, 2023-10-08T07:06:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00094642800000000003, 2023-10-08T07:06:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174404+0000", 2023-10-08T07:06:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174404+0000", 2023-10-08T07:06:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174404+0000", 2023-10-08T07:06:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7100000000000002e-07 2023-10-08T07:06:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174429+0000", 2023-10-08T07:06:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4355999999999999e-05 2023-10-08T07:06:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174436+0000", 2023-10-08T07:06:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2110000000000001e-06 2023-10-08T07:06:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174440+0000", 2023-10-08T07:06:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.34e-06 2023-10-08T07:06:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174485+0000", 2023-10-08T07:06:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4706000000000002e-05 2023-10-08T07:06:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174510+0000", 2023-10-08T07:06:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4800999999999999e-05 2023-10-08T07:06:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:15456 4.c 4:3352c333:::10000000004.00000012:head [write 3272704~4096 in=4096b,write 3338240~4096 in=4096b,write 3346432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:51.174977+0000", 2023-10-08T07:06:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.0599999999999998e-05, 2023-10-08T07:06:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00048290699999999998, 2023-10-08T07:06:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 15456 2023-10-08T07:06:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174977+0000", 2023-10-08T07:06:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174977+0000", 2023-10-08T07:06:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174978+0000", 2023-10-08T07:06:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0389999999999999e-06 2023-10-08T07:06:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174998+0000", 2023-10-08T07:06:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0032999999999999e-05 2023-10-08T07:06:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175011+0000", 2023-10-08T07:06:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2771e-05 2023-10-08T07:06:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175029+0000", 2023-10-08T07:06:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8185999999999998e-05 2023-10-08T07:06:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175079+0000", 2023-10-08T07:06:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9422999999999998e-05 2023-10-08T07:06:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175135+0000", 2023-10-08T07:06:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6143000000000001e-05 2023-10-08T07:06:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175238+0000", 2023-10-08T07:06:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000103074 2023-10-08T07:06:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:15455 4.0 e42/17 4:02bf98b6:::10000000004.0000000e:head v 42'240, mlcod=42'238)", 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:51.174993+0000", 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.5126999999999999e-05, 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00055199000000000003, 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174993+0000", 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174993+0000", 2023-10-08T07:06:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.174993+0000", 2023-10-08T07:06:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9599999999999999e-07 2023-10-08T07:06:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175011+0000", 2023-10-08T07:06:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7842999999999998e-05 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175031+0000", 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0234999999999999e-05 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175038+0000", 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1690000000000003e-06 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175181+0000", 2023-10-08T07:06:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000143015 2023-10-08T07:06:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175201+0000", 2023-10-08T07:06:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9296999999999998e-05 2023-10-08T07:06:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:15457 4.c 4.8681478c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:51.175221+0000", 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9997864, 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000399486, 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 15457 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175221+0000", 2023-10-08T07:06:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175221+0000", 2023-10-08T07:06:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175222+0000", 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3900000000000004e-07 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175242+0000", 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9877999999999998e-05 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175253+0000", 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1124999999999999e-05 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.175261+0000", 2023-10-08T07:06:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8339999999999999e-06 2023-10-08T07:06:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:06:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 7 2023-10-08T07:06:51.212 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:51.213 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2023-10-08T07:06:51.214 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:51.214 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:51.212+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:51.314 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:51.313+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:51.415 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:51.414+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:51.430 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:51.431 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:51.446 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:51.515 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:51.514+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:51.616 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:51.615+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:51.677 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 88.901971836000001, 2023-10-08T07:06:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 78.356275358999994, 2023-10-08T07:06:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 78.356222833999993, 2023-10-08T07:06:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 78.355231048999997, 2023-10-08T07:06:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 78.355177779000002, 2023-10-08T07:06:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 78.355141932999999, 2023-10-08T07:06:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 78.354595437, 2023-10-08T07:06:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:26 4.c 4:3352c333:::10000000004.00000012:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.674475807, 2023-10-08T07:06:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015456749000000001, 2023-10-08T07:06:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 26 2023-10-08T07:06:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999409+0000", 2023-10-08T07:06:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1570000000000001e-06 2023-10-08T07:06:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003237+0000", 2023-10-08T07:06:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003827619 2023-10-08T07:06:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003252+0000", 2023-10-08T07:06:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5068999999999999e-05 2023-10-08T07:06:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003259+0000", 2023-10-08T07:06:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1910000000000003e-06 2023-10-08T07:06:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003330+0000", 2023-10-08T07:06:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0469999999999994e-05 2023-10-08T07:06:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003504+0000", 2023-10-08T07:06:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017425700000000001 2023-10-08T07:06:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003675+0000", 2023-10-08T07:06:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000171137 2023-10-08T07:06:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.010247+0000", 2023-10-08T07:06:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065716569999999998 2023-10-08T07:06:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014747+0000", 2023-10-08T07:06:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045002740000000003 2023-10-08T07:06:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014820+0000", 2023-10-08T07:06:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3310000000000001e-05 2023-10-08T07:06:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014865+0000", 2023-10-08T07:06:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4607999999999997e-05 2023-10-08T07:06:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:28 4.30 4:0f322a22:::10000000004.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.502519782, 2023-10-08T07:06:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015624149, 2023-10-08T07:06:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 28 2023-10-08T07:06:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171372+0000", 2023-10-08T07:06:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8220000000000007e-06 2023-10-08T07:06:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175253+0000", 2023-10-08T07:06:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038812529999999999 2023-10-08T07:06:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175268+0000", 2023-10-08T07:06:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4782e-05 2023-10-08T07:06:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175275+0000", 2023-10-08T07:06:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0899999999999999e-06 2023-10-08T07:06:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175345+0000", 2023-10-08T07:06:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9604000000000006e-05 2023-10-08T07:06:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175502+0000", 2023-10-08T07:06:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015699799999999999 2023-10-08T07:06:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175652+0000", 2023-10-08T07:06:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014977100000000001 2023-10-08T07:06:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.182743+0000", 2023-10-08T07:06:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070913800000000004 2023-10-08T07:06:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186876+0000", 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041328670000000001 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186941+0000", 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5506999999999995e-05 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186989+0000", 2023-10-08T07:06:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7074999999999999e-05 2023-10-08T07:06:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:35 4.a 4:524fba76:::10000000004.0000001b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.8507152599999994, 2023-10-08T07:06:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016047682000000001, 2023-10-08T07:06:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 35 2023-10-08T07:06:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823216+0000", 2023-10-08T07:06:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7559999999999999e-05 2023-10-08T07:06:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827333+0000", 2023-10-08T07:06:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041169290000000001 2023-10-08T07:06:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827352+0000", 2023-10-08T07:06:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9026e-05 2023-10-08T07:06:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827361+0000", 2023-10-08T07:06:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6999999999999997e-06 2023-10-08T07:06:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827414+0000", 2023-10-08T07:06:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3122999999999999e-05 2023-10-08T07:06:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827530+0000", 2023-10-08T07:06:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000115618 2023-10-08T07:06:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827626+0000", 2023-10-08T07:06:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5997999999999998e-05 2023-10-08T07:06:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.834016+0000", 2023-10-08T07:06:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.006390298 2023-10-08T07:06:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839139+0000", 2023-10-08T07:06:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0051226370000000002 2023-10-08T07:06:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839180+0000", 2023-10-08T07:06:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0905999999999998e-05 2023-10-08T07:06:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839217+0000", 2023-10-08T07:06:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6887000000000001e-05 2023-10-08T07:06:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:42 4.38 4:1e0977c7:::10000000004.00000022:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.1995102840000005, 2023-10-08T07:06:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015514448, 2023-10-08T07:06:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 42 2023-10-08T07:06:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474376+0000", 2023-10-08T07:06:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1150000000000001e-06 2023-10-08T07:06:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478104+0000", 2023-10-08T07:06:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003728514 2023-10-08T07:06:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478129+0000", 2023-10-08T07:06:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4655999999999999e-05 2023-10-08T07:06:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478140+0000", 2023-10-08T07:06:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1012000000000001e-05 2023-10-08T07:06:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478221+0000", 2023-10-08T07:06:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1099000000000004e-05 2023-10-08T07:06:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478343+0000", 2023-10-08T07:06:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012129 2023-10-08T07:06:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478444+0000", 2023-10-08T07:06:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000101587 2023-10-08T07:06:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.485040+0000", 2023-10-08T07:06:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065962260000000002 2023-10-08T07:06:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489774+0000", 2023-10-08T07:06:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047335889999999999 2023-10-08T07:06:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489841+0000", 2023-10-08T07:06:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7232999999999998e-05 2023-10-08T07:06:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489888+0000", 2023-10-08T07:06:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7126999999999998e-05 2023-10-08T07:06:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:49 4.2b 4:d7a77d67:::10000000004.00000029:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:43.118728+0000", 2023-10-08T07:06:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.5551564380000009, 2023-10-08T07:06:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369198000000001, 2023-10-08T07:06:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 49 2023-10-08T07:06:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.118728+0000", 2023-10-08T07:06:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.118728+0000", 2023-10-08T07:06:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.118730+0000", 2023-10-08T07:06:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4530000000000001e-06 2023-10-08T07:06:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122434+0000", 2023-10-08T07:06:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0037039220000000001 2023-10-08T07:06:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122452+0000", 2023-10-08T07:06:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7510999999999999e-05 2023-10-08T07:06:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122461+0000", 2023-10-08T07:06:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9760000000000001e-06 2023-10-08T07:06:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122521+0000", 2023-10-08T07:06:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0569999999999998e-05 2023-10-08T07:06:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122636+0000", 2023-10-08T07:06:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011464 2023-10-08T07:06:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122741+0000", 2023-10-08T07:06:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010555799999999999 2023-10-08T07:06:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.132341+0000", 2023-10-08T07:06:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0095995449999999993 2023-10-08T07:06:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.134008+0000", 2023-10-08T07:06:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001667015 2023-10-08T07:06:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.134049+0000", 2023-10-08T07:06:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1542000000000003e-05 2023-10-08T07:06:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.134097+0000", 2023-10-08T07:06:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7466000000000003e-05 2023-10-08T07:06:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1379 4.e 4:70352312:::10000000004.0000001a:head [write 3547136~4096,write 3588096~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.8543987059999996, 2023-10-08T07:06:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016369865000000001, 2023-10-08T07:06:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1379 2023-10-08T07:06:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819486+0000", 2023-10-08T07:06:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:06:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819560+0000", 2023-10-08T07:06:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4473000000000003e-05 2023-10-08T07:06:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819571+0000", 2023-10-08T07:06:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0769e-05 2023-10-08T07:06:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819576+0000", 2023-10-08T07:06:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5410000000000002e-06 2023-10-08T07:06:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.821667+0000", 2023-10-08T07:06:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020909069999999999 2023-10-08T07:06:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.821747+0000", 2023-10-08T07:06:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0260999999999996e-05 2023-10-08T07:06:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835701+0000", 2023-10-08T07:06:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013954148 2023-10-08T07:06:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835762+0000", 2023-10-08T07:06:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.084e-05 2023-10-08T07:06:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835855+0000", 2023-10-08T07:06:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3425999999999996e-05 2023-10-08T07:06:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2064 4.32 4:4efc9492:::10000000004.00000032:head [write 110592~4096,write 249856~4096,write 270336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.6160531799999998, 2023-10-08T07:06:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019126292, 2023-10-08T07:06:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2064 2023-10-08T07:06:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057832+0000", 2023-10-08T07:06:51.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3699999999999999e-07 2023-10-08T07:06:51.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057886+0000", 2023-10-08T07:06:51.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4531999999999999e-05 2023-10-08T07:06:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057901+0000", 2023-10-08T07:06:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4518999999999999e-05 2023-10-08T07:06:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057910+0000", 2023-10-08T07:06:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4579999999999999e-06 2023-10-08T07:06:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057963+0000", 2023-10-08T07:06:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3161000000000001e-05 2023-10-08T07:06:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.058023+0000", 2023-10-08T07:06:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0027e-05 2023-10-08T07:06:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076814+0000", 2023-10-08T07:06:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018790187 2023-10-08T07:06:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076879+0000", 2023-10-08T07:06:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4999999999999994e-05 2023-10-08T07:06:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076957+0000", 2023-10-08T07:06:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8571000000000004e-05 2023-10-08T07:06:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2068 4.1a 4:5a59f83a:::10000000004.00000002:head [write 1794048~4096,write 1806336~4096,write 1937408~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.6148767700000004, 2023-10-08T07:06:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017795372, 2023-10-08T07:06:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2068 2023-10-08T07:06:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059008+0000", 2023-10-08T07:06:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1299999999999998e-07 2023-10-08T07:06:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059061+0000", 2023-10-08T07:06:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2905000000000003e-05 2023-10-08T07:06:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059077+0000", 2023-10-08T07:06:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6099e-05 2023-10-08T07:06:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059088+0000", 2023-10-08T07:06:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1056000000000001e-05 2023-10-08T07:06:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059146+0000", 2023-10-08T07:06:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7385e-05 2023-10-08T07:06:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059210+0000", 2023-10-08T07:06:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4509000000000002e-05 2023-10-08T07:06:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059307+0000", 2023-10-08T07:06:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6273000000000005e-05 2023-10-08T07:06:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.060916+0000", 2023-10-08T07:06:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001609365 2023-10-08T07:06:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076698+0000", 2023-10-08T07:06:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015781951999999998 2023-10-08T07:06:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076762+0000", 2023-10-08T07:06:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3744999999999994e-05 2023-10-08T07:06:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076803+0000", 2023-10-08T07:06:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1170000000000001e-05 2023-10-08T07:06:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2087 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1101824~12288,write 1150976~4096,write 1171456~4096,write 1265664~4096,write 1376256~4096,write 1519616~4096,write 1691648~4096,write 1724416~4096,write 1753088~4096,write 1794048~4096,write 1908736~4096,write 1921024~4096,write 2011136~4096,write 2207744~4096,write 2285568~4096,write 2744320~8192,write 2760704~4096,write 2879488~4096,write 2891776~4096,write 3129344~4096,write 3145728~4096,write 3215360~4096,write 3330048~8192,write 3362816~4096,write 3387392~4096,write 3485696~4096,write 3620864~4096,write 4120576~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.6099063210000004, 2023-10-08T07:06:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016557490000000001, 2023-10-08T07:06:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2087 2023-10-08T07:06:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:06:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064123+0000", 2023-10-08T07:06:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014467700000000001 2023-10-08T07:06:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064131+0000", 2023-10-08T07:06:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9230000000000002e-06 2023-10-08T07:06:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064139+0000", 2023-10-08T07:06:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5560000000000002e-06 2023-10-08T07:06:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.073553+0000", 2023-10-08T07:06:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0094146679999999993 2023-10-08T07:06:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.073655+0000", 2023-10-08T07:06:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010128000000000001 2023-10-08T07:06:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.074076+0000", 2023-10-08T07:06:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00042132399999999999 2023-10-08T07:06:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.077289+0000", 2023-10-08T07:06:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032133589999999998 2023-10-08T07:06:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080463+0000", 2023-10-08T07:06:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031740940000000001 2023-10-08T07:06:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080512+0000", 2023-10-08T07:06:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8343000000000001e-05 2023-10-08T07:06:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080535+0000", 2023-10-08T07:06:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3586000000000001e-05 2023-10-08T07:06:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2088 4.2a 4:5404a18c:::10000000004.00000025:head [write 774144~4096,write 811008~4096,write 884736~4096,write 909312~4096,write 958464~4096,write 1028096~4096,write 1191936~4096,write 1224704~4096,write 1261568~4096,write 1294336~4096,write 1331200~4096,write 1523712~4096,write 1540096~4096,write 1572864~4096,write 1667072~4096,write 1810432~4096,write 1818624~4096,write 1859584~4096,write 1892352~4096,write 1916928~4096,write 2084864~4096,write 2158592~4096,write 2494464~4096,write 2543616~4096,write 2703360~4096,write 2748416~8192,write 2777088~4096,write 3784704~4096,write 3911680~4096,write 4120576~4096,write 4145152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.6097222230000003, 2023-10-08T07:06:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017312658000000002, 2023-10-08T07:06:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2088 2023-10-08T07:06:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064163+0000", 2023-10-08T07:06:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064375+0000", 2023-10-08T07:06:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00021216599999999999 2023-10-08T07:06:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064385+0000", 2023-10-08T07:06:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0525e-05 2023-10-08T07:06:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064395+0000", 2023-10-08T07:06:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1689999999999998e-06 2023-10-08T07:06:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076644+0000", 2023-10-08T07:06:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012248991000000001 2023-10-08T07:06:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076709+0000", 2023-10-08T07:06:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5708000000000002e-05 2023-10-08T07:06:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081362+0000", 2023-10-08T07:06:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0046527449999999998 2023-10-08T07:06:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081425+0000", 2023-10-08T07:06:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3250000000000006e-05 2023-10-08T07:06:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081475+0000", 2023-10-08T07:06:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9246999999999998e-05 2023-10-08T07:06:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:14150 4.30 4:0f322a22:::10000000004.00000014:head [write 409600~4096,write 679936~4096,write 724992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:06:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.99933057800000002, 2023-10-08T07:06:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018347558999999999, 2023-10-08T07:06:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 14150 2023-10-08T07:06:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:06:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:06:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:06:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1200000000000002e-07 2023-10-08T07:06:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674566+0000", 2023-10-08T07:06:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1438e-05 2023-10-08T07:06:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674576+0000", 2023-10-08T07:06:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0259e-05 2023-10-08T07:06:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674590+0000", 2023-10-08T07:06:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.375e-05 2023-10-08T07:06:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674644+0000", 2023-10-08T07:06:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3878000000000002e-05 2023-10-08T07:06:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674755+0000", 2023-10-08T07:06:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011113 2023-10-08T07:06:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674931+0000", 2023-10-08T07:06:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000176587 2023-10-08T07:06:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.676318+0000", 2023-10-08T07:06:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0013863040000000001 2023-10-08T07:06:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.692819+0000", 2023-10-08T07:06:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016501722999999999 2023-10-08T07:06:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.692876+0000", 2023-10-08T07:06:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7005000000000001e-05 2023-10-08T07:06:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.692901+0000", 2023-10-08T07:06:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4672999999999999e-05 2023-10-08T07:06:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:14642 4.20 4:04004f2c:::10000000004.0000000d:head [write 1359872~4096,write 1409024~4096,write 1449984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:06:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.82136436700000004, 2023-10-08T07:06:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016449921999999999, 2023-10-08T07:06:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 14642 2023-10-08T07:06:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:06:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:06:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:06:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9999999999999997e-07 2023-10-08T07:06:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852556+0000", 2023-10-08T07:06:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5413999999999997e-05 2023-10-08T07:06:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852570+0000", 2023-10-08T07:06:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3735e-05 2023-10-08T07:06:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852577+0000", 2023-10-08T07:06:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1879999999999996e-06 2023-10-08T07:06:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852632+0000", 2023-10-08T07:06:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4753999999999998e-05 2023-10-08T07:06:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852719+0000", 2023-10-08T07:06:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7699000000000002e-05 2023-10-08T07:06:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852863+0000", 2023-10-08T07:06:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000143852 2023-10-08T07:06:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.857758+0000", 2023-10-08T07:06:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048950629999999998 2023-10-08T07:06:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.868863+0000", 2023-10-08T07:06:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011104563 2023-10-08T07:06:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.868928+0000", 2023-10-08T07:06:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5610000000000004e-05 2023-10-08T07:06:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.868970+0000", 2023-10-08T07:06:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1344000000000003e-05 2023-10-08T07:06:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:15687 4.c 4:3352c333:::10000000004.00000012:head [write 794624~4096,write 925696~4096,write 933888~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:51.262061+0000", 2023-10-08T07:06:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.41182320300000003, 2023-10-08T07:06:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016886580000000002, 2023-10-08T07:06:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 15687 2023-10-08T07:06:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262061+0000", 2023-10-08T07:06:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262061+0000", 2023-10-08T07:06:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262062+0000", 2023-10-08T07:06:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9000000000000005e-07 2023-10-08T07:06:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262078+0000", 2023-10-08T07:06:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6322999999999999e-05 2023-10-08T07:06:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262091+0000", 2023-10-08T07:06:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2323999999999999e-05 2023-10-08T07:06:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262106+0000", 2023-10-08T07:06:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5245999999999999e-05 2023-10-08T07:06:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.265173+0000", 2023-10-08T07:06:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003067148 2023-10-08T07:06:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.265267+0000", 2023-10-08T07:06:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3949000000000005e-05 2023-10-08T07:06:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.265420+0000", 2023-10-08T07:06:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015336500000000001 2023-10-08T07:06:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.270637+0000", 2023-10-08T07:06:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052167990000000003 2023-10-08T07:06:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.278841+0000", 2023-10-08T07:06:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0082038530000000005 2023-10-08T07:06:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.278903+0000", 2023-10-08T07:06:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1673000000000004e-05 2023-10-08T07:06:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.278948+0000", 2023-10-08T07:06:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4910000000000002e-05 2023-10-08T07:06:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:51.822 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:51.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:51.824 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:51.822+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:51.825 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:51.925 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:51.924+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:51.997 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:51.999 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:52.000 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:52.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.000 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17713 4.11 4:8963efe6:::10000000004.00000009:head [write 3706880~4096 in=4096b,write 3715072~4096 in=4096b,write 3735552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.000 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.991150+0000", 2023-10-08T07:06:52.000 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0068803659999999997, 2023-10-08T07:06:52.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069024120000000001, 2023-10-08T07:06:52.000 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.000 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:52.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.001 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17713 2023-10-08T07:06:52.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.001 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991150+0000", 2023-10-08T07:06:52.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991150+0000", 2023-10-08T07:06:52.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991150+0000", 2023-10-08T07:06:52.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:52.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991171+0000", 2023-10-08T07:06:52.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0438999999999999e-05 2023-10-08T07:06:52.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991180+0000", 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6120000000000005e-06 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991186+0000", 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3020000000000002e-06 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991237+0000", 2023-10-08T07:06:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0837000000000001e-05 2023-10-08T07:06:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991330+0000", 2023-10-08T07:06:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3666999999999996e-05 2023-10-08T07:06:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991476+0000", 2023-10-08T07:06:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014565199999999999 2023-10-08T07:06:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993481+0000", 2023-10-08T07:06:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020056700000000002 2023-10-08T07:06:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:17712 4.3a e43/17 4:5fb70c0f:::10000000004.0000002e:head v 43'779, mlcod=43'776)", 2023-10-08T07:06:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.991212+0000", 2023-10-08T07:06:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0068182370000000004, 2023-10-08T07:06:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069080870000000003, 2023-10-08T07:06:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991212+0000", 2023-10-08T07:06:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991212+0000", 2023-10-08T07:06:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991212+0000", 2023-10-08T07:06:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7199999999999999e-07 2023-10-08T07:06:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991227+0000", 2023-10-08T07:06:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4948e-05 2023-10-08T07:06:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991232+0000", 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.758e-06 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991235+0000", 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3299999999999999e-06 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991284+0000", 2023-10-08T07:06:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8704e-05 2023-10-08T07:06:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991312+0000", 2023-10-08T07:06:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8464999999999999e-05 2023-10-08T07:06:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17714 4.0 4:02bf98b6:::10000000004.0000000e:head [write 1867776~4096 in=4096b,write 1970176~4096 in=4096b,write 1986560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.991509+0000", 2023-10-08T07:06:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0065210119999999996, 2023-10-08T07:06:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066502610000000002, 2023-10-08T07:06:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17714 2023-10-08T07:06:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991509+0000", 2023-10-08T07:06:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991509+0000", 2023-10-08T07:06:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991510+0000", 2023-10-08T07:06:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7499999999999999e-07 2023-10-08T07:06:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991521+0000", 2023-10-08T07:06:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1416e-05 2023-10-08T07:06:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991532+0000", 2023-10-08T07:06:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0387000000000001e-05 2023-10-08T07:06:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991539+0000", 2023-10-08T07:06:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6960000000000005e-06 2023-10-08T07:06:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991612+0000", 2023-10-08T07:06:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3127000000000006e-05 2023-10-08T07:06:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991710+0000", 2023-10-08T07:06:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7706000000000003e-05 2023-10-08T07:06:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991863+0000", 2023-10-08T07:06:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000152578 2023-10-08T07:06:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993571+0000", 2023-10-08T07:06:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001708102 2023-10-08T07:06:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17715 4.7 4:e2479c46:::10000000004.00000024:head [write 8192~4096 in=4096b,write 69632~4096 in=4096b,write 147456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.991809+0000", 2023-10-08T07:06:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.006221224, 2023-10-08T07:06:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0064125919999999999, 2023-10-08T07:06:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17715 2023-10-08T07:06:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991809+0000", 2023-10-08T07:06:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991809+0000", 2023-10-08T07:06:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991810+0000", 2023-10-08T07:06:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9999999999999996e-07 2023-10-08T07:06:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991831+0000", 2023-10-08T07:06:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1277e-05 2023-10-08T07:06:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991839+0000", 2023-10-08T07:06:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4079999999999998e-06 2023-10-08T07:06:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991849+0000", 2023-10-08T07:06:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3729999999999999e-06 2023-10-08T07:06:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991932+0000", 2023-10-08T07:06:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2911000000000006e-05 2023-10-08T07:06:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992008+0000", 2023-10-08T07:06:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6598000000000001e-05 2023-10-08T07:06:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17716 4.3e 4:7cb83261:::10000000004.0000003b:head [write 622592~4096 in=4096b,write 630784~4096 in=4096b,write 651264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.992258+0000", 2023-10-08T07:06:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0057719060000000003, 2023-10-08T07:06:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060165410000000002, 2023-10-08T07:06:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17716 2023-10-08T07:06:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992258+0000", 2023-10-08T07:06:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992258+0000", 2023-10-08T07:06:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992259+0000", 2023-10-08T07:06:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7400000000000002e-07 2023-10-08T07:06:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992272+0000", 2023-10-08T07:06:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2921999999999999e-05 2023-10-08T07:06:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992281+0000", 2023-10-08T07:06:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4550000000000001e-06 2023-10-08T07:06:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992293+0000", 2023-10-08T07:06:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1841000000000001e-05 2023-10-08T07:06:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992350+0000", 2023-10-08T07:06:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6889999999999999e-05 2023-10-08T07:06:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992441+0000", 2023-10-08T07:06:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0636000000000004e-05 2023-10-08T07:06:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17717 4.7 4:e13e8cdb:::10000000004.00000028:head [write 1052672~4096 in=4096b,write 1130496~4096 in=4096b,write 1155072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.992601+0000", 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0054295109999999997, 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057365080000000004, 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17717 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992601+0000", 2023-10-08T07:06:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992601+0000", 2023-10-08T07:06:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992601+0000", 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.85e-07 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992613+0000", 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1625e-05 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992622+0000", 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5240000000000006e-06 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992630+0000", 2023-10-08T07:06:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4370000000000001e-06 2023-10-08T07:06:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993564+0000", 2023-10-08T07:06:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00093387600000000004 2023-10-08T07:06:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993625+0000", 2023-10-08T07:06:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1310999999999996e-05 2023-10-08T07:06:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:17718 4.2b e43/17 4:d7a77d67:::10000000004.00000029:head v 43'570, mlcod=43'568)", 2023-10-08T07:06:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.993455+0000", 2023-10-08T07:06:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045754999999999997, 2023-10-08T07:06:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049436050000000002, 2023-10-08T07:06:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993455+0000", 2023-10-08T07:06:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993455+0000", 2023-10-08T07:06:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993455+0000", 2023-10-08T07:06:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1e-07 2023-10-08T07:06:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993461+0000", 2023-10-08T07:06:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6490000000000002e-06 2023-10-08T07:06:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993467+0000", 2023-10-08T07:06:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5090000000000001e-06 2023-10-08T07:06:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993470+0000", 2023-10-08T07:06:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.428e-06 2023-10-08T07:06:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993505+0000", 2023-10-08T07:06:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4981999999999998e-05 2023-10-08T07:06:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993523+0000", 2023-10-08T07:06:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7448e-05 2023-10-08T07:06:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17721 4.15 4:a88808fa:::10000000004.0000001f:head [write 2002944~4096 in=4096b,write 2224128~4096 in=4096b,write 2322432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.994276+0000", 2023-10-08T07:06:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0037541549999999999, 2023-10-08T07:06:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041610789999999998, 2023-10-08T07:06:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17721 2023-10-08T07:06:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.994276+0000", 2023-10-08T07:06:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.994276+0000", 2023-10-08T07:06:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.994276+0000", 2023-10-08T07:06:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2500000000000005e-07 2023-10-08T07:06:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.994287+0000", 2023-10-08T07:06:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.049e-05 2023-10-08T07:06:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.994302+0000", 2023-10-08T07:06:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5418e-05 2023-10-08T07:06:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.994309+0000", 2023-10-08T07:06:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.117e-06 2023-10-08T07:06:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.994350+0000", 2023-10-08T07:06:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1323999999999999e-05 2023-10-08T07:06:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.994399+0000", 2023-10-08T07:06:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8718999999999999e-05 2023-10-08T07:06:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17724 4.3e 4:7cb83261:::10000000004.0000003b:head [write 3776512~4096 in=4096b,write 3813376~4096 in=4096b,write 3846144~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.995346+0000", 2023-10-08T07:06:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002684166, 2023-10-08T07:06:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031427489999999998, 2023-10-08T07:06:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17724 2023-10-08T07:06:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995346+0000", 2023-10-08T07:06:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995346+0000", 2023-10-08T07:06:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995347+0000", 2023-10-08T07:06:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6700000000000003e-07 2023-10-08T07:06:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995356+0000", 2023-10-08T07:06:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8360000000000004e-06 2023-10-08T07:06:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995364+0000", 2023-10-08T07:06:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0229999999999992e-06 2023-10-08T07:06:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995369+0000", 2023-10-08T07:06:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2429999999999999e-06 2023-10-08T07:06:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995405+0000", 2023-10-08T07:06:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6087999999999997e-05 2023-10-08T07:06:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995455+0000", 2023-10-08T07:06:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0068000000000002e-05 2023-10-08T07:06:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17725 4.9 4:90f7d93b:::10000000004.00000021:head [write 2220032~4096 in=4096b,write 2273280~4096 in=4096b,write 2338816~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.995740+0000", 2023-10-08T07:06:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0022903490000000001, 2023-10-08T07:06:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028286909999999999, 2023-10-08T07:06:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17725 2023-10-08T07:06:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995740+0000", 2023-10-08T07:06:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995740+0000", 2023-10-08T07:06:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995740+0000", 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5499999999999998e-07 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995749+0000", 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4379999999999995e-06 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995754+0000", 2023-10-08T07:06:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5790000000000003e-06 2023-10-08T07:06:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995758+0000", 2023-10-08T07:06:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7419999999999999e-06 2023-10-08T07:06:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995800+0000", 2023-10-08T07:06:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1468999999999999e-05 2023-10-08T07:06:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.995849+0000", 2023-10-08T07:06:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9616000000000001e-05 2023-10-08T07:06:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:17727 4.3a e43/17 4:5f183e4b:::10000000004.00000023:head v 43'780, mlcod=43'777)", 2023-10-08T07:06:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.997012+0000", 2023-10-08T07:06:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001017815, 2023-10-08T07:06:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016132659999999999, 2023-10-08T07:06:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997012+0000", 2023-10-08T07:06:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997012+0000", 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997013+0000", 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3000000000000001e-07 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997024+0000", 2023-10-08T07:06:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0859000000000001e-05 2023-10-08T07:06:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997032+0000", 2023-10-08T07:06:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6500000000000002e-06 2023-10-08T07:06:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997037+0000", 2023-10-08T07:06:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8930000000000004e-06 2023-10-08T07:06:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997077+0000", 2023-10-08T07:06:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9548999999999997e-05 2023-10-08T07:06:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997089+0000", 2023-10-08T07:06:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2611e-05 2023-10-08T07:06:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17729 4.7 4:e13e8cdb:::10000000004.00000028:head [write 1351680~4096 in=4096b,write 1466368~4096 in=4096b,write 1564672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.997183+0000", 2023-10-08T07:06:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00084719999999999999, 2023-10-08T07:06:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014880780000000001, 2023-10-08T07:06:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17729 2023-10-08T07:06:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997183+0000", 2023-10-08T07:06:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997183+0000", 2023-10-08T07:06:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997184+0000", 2023-10-08T07:06:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0100000000000004e-07 2023-10-08T07:06:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997197+0000", 2023-10-08T07:06:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2925000000000001e-05 2023-10-08T07:06:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997206+0000", 2023-10-08T07:06:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6059999999999992e-06 2023-10-08T07:06:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997212+0000", 2023-10-08T07:06:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3920000000000002e-06 2023-10-08T07:06:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997247+0000", 2023-10-08T07:06:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5644e-05 2023-10-08T07:06:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997302+0000", 2023-10-08T07:06:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5213999999999997e-05 2023-10-08T07:06:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:17728 4.1b e43/17 4:dbb7dde6:::10000000004.0000002c:head v 43'544, mlcod=43'542)", 2023-10-08T07:06:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.997341+0000", 2023-10-08T07:06:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00068858199999999997, 2023-10-08T07:06:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013896430000000001, 2023-10-08T07:06:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997341+0000", 2023-10-08T07:06:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997341+0000", 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997342+0000", 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0299999999999999e-07 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997361+0000", 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8567999999999999e-05 2023-10-08T07:06:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997367+0000", 2023-10-08T07:06:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6789999999999999e-06 2023-10-08T07:06:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997372+0000", 2023-10-08T07:06:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.561e-06 2023-10-08T07:06:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997410+0000", 2023-10-08T07:06:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8293000000000001e-05 2023-10-08T07:06:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.997423+0000", 2023-10-08T07:06:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3074000000000001e-05 2023-10-08T07:06:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17732 4.28 4:15b6682b:::10000000004.0000000b:head [write 16384~4096 in=4096b,write 126976~4096 in=4096b,write 376832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.998123+0000", 2023-10-08T07:06:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9999065, 2023-10-08T07:06:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00066806400000000001, 2023-10-08T07:06:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17732 2023-10-08T07:06:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998123+0000", 2023-10-08T07:06:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998123+0000", 2023-10-08T07:06:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998124+0000", 2023-10-08T07:06:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9299999999999996e-07 2023-10-08T07:06:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998136+0000", 2023-10-08T07:06:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2126e-05 2023-10-08T07:06:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998147+0000", 2023-10-08T07:06:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0533999999999999e-05 2023-10-08T07:06:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998153+0000", 2023-10-08T07:06:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7919999999999998e-06 2023-10-08T07:06:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998196+0000", 2023-10-08T07:06:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3358000000000001e-05 2023-10-08T07:06:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998252+0000", 2023-10-08T07:06:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6450999999999999e-05 2023-10-08T07:06:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:17731 4.3a e43/17 4:5f183e4b:::10000000004.00000023:head v 43'781, mlcod=43'777)", 2023-10-08T07:06:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.998192+0000", 2023-10-08T07:06:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9998384, 2023-10-08T07:06:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00067021300000000002, 2023-10-08T07:06:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998192+0000", 2023-10-08T07:06:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998192+0000", 2023-10-08T07:06:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998192+0000", 2023-10-08T07:06:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9100000000000004e-07 2023-10-08T07:06:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998204+0000", 2023-10-08T07:06:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2069000000000001e-05 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998213+0000", 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2600000000000005e-06 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998217+0000", 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.544e-06 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998262+0000", 2023-10-08T07:06:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4511000000000001e-05 2023-10-08T07:06:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998281+0000", 2023-10-08T07:06:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9556999999999999e-05 2023-10-08T07:06:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17733 4.16 4:69eefec8:::10000000004.0000003a:head [write 1523712~4096 in=4096b,write 1548288~4096 in=4096b,write 1642496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.998536+0000", 2023-10-08T07:06:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9994946, 2023-10-08T07:06:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037673399999999999, 2023-10-08T07:06:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17733 2023-10-08T07:06:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998536+0000", 2023-10-08T07:06:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998536+0000", 2023-10-08T07:06:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998536+0000", 2023-10-08T07:06:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6000000000000003e-07 2023-10-08T07:06:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998558+0000", 2023-10-08T07:06:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1563e-05 2023-10-08T07:06:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998566+0000", 2023-10-08T07:06:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4409999999999993e-06 2023-10-08T07:06:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998571+0000", 2023-10-08T07:06:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3259999999999997e-06 2023-10-08T07:06:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998619+0000", 2023-10-08T07:06:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8103999999999999e-05 2023-10-08T07:06:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998676+0000", 2023-10-08T07:06:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7008e-05 2023-10-08T07:06:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.998782+0000", 2023-10-08T07:06:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000106698 2023-10-08T07:06:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17709 4.28 4:16edf4d3:::10000000004.00000027:head [write 16384~4096 in=4096b,write 159744~4096 in=4096b,write 204800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.989822+0000", 2023-10-08T07:06:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0082080959999999998, 2023-10-08T07:06:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091474599999999996, 2023-10-08T07:06:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17709 2023-10-08T07:06:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989822+0000", 2023-10-08T07:06:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989822+0000", 2023-10-08T07:06:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989823+0000", 2023-10-08T07:06:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2399999999999998e-07 2023-10-08T07:06:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989833+0000", 2023-10-08T07:06:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0087e-05 2023-10-08T07:06:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989841+0000", 2023-10-08T07:06:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4200000000000007e-06 2023-10-08T07:06:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989846+0000", 2023-10-08T07:06:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7219999999999999e-06 2023-10-08T07:06:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989883+0000", 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7276e-05 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989956+0000", 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2773000000000003e-05 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17710 4.b 4:d0c991e0:::10000000004.0000002d:head [write 147456~4096 in=4096b,write 380928~4096 in=4096b,write 409600~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.990150+0000", 2023-10-08T07:06:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0078805219999999992, 2023-10-08T07:06:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088700480000000002, 2023-10-08T07:06:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17710 2023-10-08T07:06:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.990150+0000", 2023-10-08T07:06:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.990150+0000", 2023-10-08T07:06:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.990150+0000", 2023-10-08T07:06:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0999999999999998e-07 2023-10-08T07:06:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.990163+0000", 2023-10-08T07:06:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2914e-05 2023-10-08T07:06:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.990174+0000", 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0891e-05 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.990182+0000", 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1089999999999998e-06 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.990222+0000", 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0166999999999997e-05 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.990277+0000", 2023-10-08T07:06:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4941000000000001e-05 2023-10-08T07:06:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.990382+0000", 2023-10-08T07:06:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010442000000000001 2023-10-08T07:06:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993129+0000", 2023-10-08T07:06:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027472569999999999 2023-10-08T07:06:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:06:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 18 2023-10-08T07:06:52.085 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:52.086 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:52.087 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:06:52.087 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:52.088 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:52.085+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:52.088 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:52.088 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:06:52.088 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:52.088 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:06:52.187 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:52.186+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:52.287 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:52.286+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:52.294 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:52.294 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:52.309 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:52.393 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:52.392+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:52.489 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:52.488+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:52.523 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:52.523 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:52.537 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:52.615 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:52.589+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:52.691 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:52.690+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:52.703 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:52.703 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:52.717 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:52.791 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:52.790+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:52.892 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:52.891+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:52.931 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:52.931 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:52.945 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:52.993 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:52.992+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:53.095 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:53.093+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:53.135 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:53.136 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:53.152 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:53.196 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:53.195+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:53.222 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T07:06:53.296 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:53.295+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:53.318 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:53.318 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:53.332 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:53.397 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:53.396+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:53.498 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:53.497+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:53.540 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:53.540 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:53.553 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:53.599 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:53.598+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:53.701 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:53.700+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:53.727 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:53.728 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:53.742 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:53.801 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:53.800+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:53.902 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:53.901+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:53.923 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:53.924 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:53.939 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:54.004 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:54.003+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:54.089 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:54.105 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:54.104+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:54.156 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:54.156 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:54.169 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:54.206 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:54.205+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:54.212 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2023-10-08T07:06:54.215 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2023-10-08T07:06:54.215 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T07:06:54.216 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2023-10-08T07:06:54.216 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2023-10-08T07:06:54.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:54.293 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:54.293 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:06:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:54.296 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:06:54.297 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:06:54.306 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:54.305+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:54.391 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:54.391 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:54.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:54.391 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:54.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.392 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4141.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-10-08T07:06:54.392 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:54.392 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 91.616019485999999, 2023-10-08T07:06:54.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015392937000000001, 2023-10-08T07:06:54.392 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.392 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.392 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.392 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4141", 2023-10-08T07:06:54.392 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "172.21.15.17:0/2729107976", 2023-10-08T07:06:54.392 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 165 2023-10-08T07:06:54.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.393 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:54.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771912+0000", 2023-10-08T07:06:54.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771913+0000", 2023-10-08T07:06:54.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:06:54.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771915+0000", 2023-10-08T07:06:54.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.447e-06 2023-10-08T07:06:54.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771918+0000", 2023-10-08T07:06:54.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-06 2023-10-08T07:06:54.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.771922+0000", 2023-10-08T07:06:54.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0069999999999999e-06 2023-10-08T07:06:54.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780304+0000", 2023-10-08T07:06:54.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083813670000000007 2023-10-08T07:06:54.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780404+0000", 2023-10-08T07:06:54.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100287 2023-10-08T07:06:54.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:54.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.780559+0000", 2023-10-08T07:06:54.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015512499999999999 2023-10-08T07:06:54.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.781166+0000", 2023-10-08T07:06:54.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00060719400000000003 2023-10-08T07:06:54.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787249+0000", 2023-10-08T07:06:54.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060828690000000003 2023-10-08T07:06:54.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787283+0000", 2023-10-08T07:06:54.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4106999999999997e-05 2023-10-08T07:06:54.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:22.787305+0000", 2023-10-08T07:06:54.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1866e-05 2023-10-08T07:06:54.398 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.398 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.398 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.399 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:54.399 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:54.399 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 81.070323009000006, 2023-10-08T07:06:54.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:54.399 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.399 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.399 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:54.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.400 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.400 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:54.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.400 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.400 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:54.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:54.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:54.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:54.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:54.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:54.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:54.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:54.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:54.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:54.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:54.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:54.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:54.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:54.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:54.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:54.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:54.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:54.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:54.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:54.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:54.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:54.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:54.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:54.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:54.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:54.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:54.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:54.406 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.406 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.406 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.406 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:54.406 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:54.406 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 81.070270484000005, 2023-10-08T07:06:54.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:54.407 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.407 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.407 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:54.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:54.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:54.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:54.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:54.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:54.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:54.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:54.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:54.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:54.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:54.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:54.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:54.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:54.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:54.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:54.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:54.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:54.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:54.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:54.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:54.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:54.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:54.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:54.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:54.413 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.413 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.413 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.413 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:54.413 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:54.413 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 81.069278698999995, 2023-10-08T07:06:54.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:54.413 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.414 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.414 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:54.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:54.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:54.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:54.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:54.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:54.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:54.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:54.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:54.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:54.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:54.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:54.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:54.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:54.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:54.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:54.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:54.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:54.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:54.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:54.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:54.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:54.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:54.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:54.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:54.419 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 81.069225428999999, 2023-10-08T07:06:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:54.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:54.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:54.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:54.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:54.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:54.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:54.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:54.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:54.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:54.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:54.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:54.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:54.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:54.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:54.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:54.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:54.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:54.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:54.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:54.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:54.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:54.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:54.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:54.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:54.427 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.427 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.427 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.427 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:54.427 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:54.427 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 81.069189582999996, 2023-10-08T07:06:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:54.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:54.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:54.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:54.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:54.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:54.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:54.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:54.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:54.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:54.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:54.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:54.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:54.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:54.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:54.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:54.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:54.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:54.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:54.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:54.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:54.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:54.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:54.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:54.434 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.434 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.434 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.435 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:54.435 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:54.435 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 81.068643086999998, 2023-10-08T07:06:54.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015377396999999999, 2023-10-08T07:06:54.435 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.435 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.435 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:54.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:54.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319289+0000", 2023-10-08T07:06:54.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:54.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319306+0000", 2023-10-08T07:06:54.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6175999999999999e-05 2023-10-08T07:06:54.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319315+0000", 2023-10-08T07:06:54.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.577e-06 2023-10-08T07:06:54.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.319326+0000", 2023-10-08T07:06:54.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0403e-05 2023-10-08T07:06:54.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330523+0000", 2023-10-08T07:06:54.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011197008 2023-10-08T07:06:54.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330664+0000", 2023-10-08T07:06:54.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014174500000000001 2023-10-08T07:06:54.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:54.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330835+0000", 2023-10-08T07:06:54.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170586 2023-10-08T07:06:54.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332892+0000", 2023-10-08T07:06:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020566759999999999 2023-10-08T07:06:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334596+0000", 2023-10-08T07:06:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017047379999999999 2023-10-08T07:06:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334645+0000", 2023-10-08T07:06:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8216000000000001e-05 2023-10-08T07:06:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334666+0000", 2023-10-08T07:06:54.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1474000000000001e-05 2023-10-08T07:06:54.441 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.441 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.441 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.441 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:26 4.c 4:3352c333:::10000000004.00000012:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:54.441 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:54.441 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.388523457, 2023-10-08T07:06:54.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015456749000000001, 2023-10-08T07:06:54.442 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.442 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.442 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.442 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.442 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.442 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 26 2023-10-08T07:06:54.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.442 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.442 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:54.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:54.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999409+0000", 2023-10-08T07:06:54.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1570000000000001e-06 2023-10-08T07:06:54.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003237+0000", 2023-10-08T07:06:54.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003827619 2023-10-08T07:06:54.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003252+0000", 2023-10-08T07:06:54.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5068999999999999e-05 2023-10-08T07:06:54.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003259+0000", 2023-10-08T07:06:54.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1910000000000003e-06 2023-10-08T07:06:54.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003330+0000", 2023-10-08T07:06:54.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0469999999999994e-05 2023-10-08T07:06:54.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003504+0000", 2023-10-08T07:06:54.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017425700000000001 2023-10-08T07:06:54.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:54.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003675+0000", 2023-10-08T07:06:54.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000171137 2023-10-08T07:06:54.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.010247+0000", 2023-10-08T07:06:54.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065716569999999998 2023-10-08T07:06:54.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014747+0000", 2023-10-08T07:06:54.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045002740000000003 2023-10-08T07:06:54.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014820+0000", 2023-10-08T07:06:54.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3310000000000001e-05 2023-10-08T07:06:54.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014865+0000", 2023-10-08T07:06:54.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4607999999999997e-05 2023-10-08T07:06:54.448 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.448 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.448 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.448 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:28 4.30 4:0f322a22:::10000000004.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:54.448 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:54.448 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.216567432, 2023-10-08T07:06:54.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015624149, 2023-10-08T07:06:54.449 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.449 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.449 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.449 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.449 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.449 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 28 2023-10-08T07:06:54.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.449 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:54.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:54.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171372+0000", 2023-10-08T07:06:54.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8220000000000007e-06 2023-10-08T07:06:54.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175253+0000", 2023-10-08T07:06:54.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038812529999999999 2023-10-08T07:06:54.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175268+0000", 2023-10-08T07:06:54.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4782e-05 2023-10-08T07:06:54.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175275+0000", 2023-10-08T07:06:54.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0899999999999999e-06 2023-10-08T07:06:54.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175345+0000", 2023-10-08T07:06:54.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9604000000000006e-05 2023-10-08T07:06:54.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175502+0000", 2023-10-08T07:06:54.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015699799999999999 2023-10-08T07:06:54.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:54.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175652+0000", 2023-10-08T07:06:54.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014977100000000001 2023-10-08T07:06:54.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.182743+0000", 2023-10-08T07:06:54.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070913800000000004 2023-10-08T07:06:54.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186876+0000", 2023-10-08T07:06:54.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041328670000000001 2023-10-08T07:06:54.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186941+0000", 2023-10-08T07:06:54.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5506999999999995e-05 2023-10-08T07:06:54.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186989+0000", 2023-10-08T07:06:54.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7074999999999999e-05 2023-10-08T07:06:54.455 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.455 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.455 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.455 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:35 4.a 4:524fba76:::10000000004.0000001b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:54.455 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:54.455 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 12.564762910000001, 2023-10-08T07:06:54.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016047682000000001, 2023-10-08T07:06:54.456 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.456 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.456 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.456 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.456 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.456 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 35 2023-10-08T07:06:54.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.456 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:54.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:54.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823216+0000", 2023-10-08T07:06:54.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7559999999999999e-05 2023-10-08T07:06:54.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827333+0000", 2023-10-08T07:06:54.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041169290000000001 2023-10-08T07:06:54.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827352+0000", 2023-10-08T07:06:54.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9026e-05 2023-10-08T07:06:54.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827361+0000", 2023-10-08T07:06:54.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6999999999999997e-06 2023-10-08T07:06:54.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827414+0000", 2023-10-08T07:06:54.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3122999999999999e-05 2023-10-08T07:06:54.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827530+0000", 2023-10-08T07:06:54.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000115618 2023-10-08T07:06:54.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:54.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827626+0000", 2023-10-08T07:06:54.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5997999999999998e-05 2023-10-08T07:06:54.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.834016+0000", 2023-10-08T07:06:54.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.006390298 2023-10-08T07:06:54.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839139+0000", 2023-10-08T07:06:54.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0051226370000000002 2023-10-08T07:06:54.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839180+0000", 2023-10-08T07:06:54.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0905999999999998e-05 2023-10-08T07:06:54.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839217+0000", 2023-10-08T07:06:54.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6887000000000001e-05 2023-10-08T07:06:54.462 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.462 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.462 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.462 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:42 4.38 4:1e0977c7:::10000000004.00000022:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:54.462 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:54.462 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.913557934, 2023-10-08T07:06:54.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015514448, 2023-10-08T07:06:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 42 2023-10-08T07:06:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:54.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:54.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474376+0000", 2023-10-08T07:06:54.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1150000000000001e-06 2023-10-08T07:06:54.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478104+0000", 2023-10-08T07:06:54.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003728514 2023-10-08T07:06:54.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478129+0000", 2023-10-08T07:06:54.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4655999999999999e-05 2023-10-08T07:06:54.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478140+0000", 2023-10-08T07:06:54.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1012000000000001e-05 2023-10-08T07:06:54.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478221+0000", 2023-10-08T07:06:54.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1099000000000004e-05 2023-10-08T07:06:54.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478343+0000", 2023-10-08T07:06:54.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012129 2023-10-08T07:06:54.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:54.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478444+0000", 2023-10-08T07:06:54.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000101587 2023-10-08T07:06:54.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.485040+0000", 2023-10-08T07:06:54.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065962260000000002 2023-10-08T07:06:54.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489774+0000", 2023-10-08T07:06:54.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047335889999999999 2023-10-08T07:06:54.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489841+0000", 2023-10-08T07:06:54.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7232999999999998e-05 2023-10-08T07:06:54.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489888+0000", 2023-10-08T07:06:54.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7126999999999998e-05 2023-10-08T07:06:54.469 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.469 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.469 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.469 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:49 4.2b 4:d7a77d67:::10000000004.00000029:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:54.469 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:43.118728+0000", 2023-10-08T07:06:54.469 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.269204088, 2023-10-08T07:06:54.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015369198000000001, 2023-10-08T07:06:54.469 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.470 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.470 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.470 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.470 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.470 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 49 2023-10-08T07:06:54.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.470 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.118728+0000", 2023-10-08T07:06:54.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.118728+0000", 2023-10-08T07:06:54.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.118730+0000", 2023-10-08T07:06:54.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4530000000000001e-06 2023-10-08T07:06:54.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122434+0000", 2023-10-08T07:06:54.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0037039220000000001 2023-10-08T07:06:54.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122452+0000", 2023-10-08T07:06:54.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7510999999999999e-05 2023-10-08T07:06:54.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122461+0000", 2023-10-08T07:06:54.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9760000000000001e-06 2023-10-08T07:06:54.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122521+0000", 2023-10-08T07:06:54.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0569999999999998e-05 2023-10-08T07:06:54.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122636+0000", 2023-10-08T07:06:54.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011464 2023-10-08T07:06:54.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:54.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.122741+0000", 2023-10-08T07:06:54.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010555799999999999 2023-10-08T07:06:54.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.132341+0000", 2023-10-08T07:06:54.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0095995449999999993 2023-10-08T07:06:54.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.134008+0000", 2023-10-08T07:06:54.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001667015 2023-10-08T07:06:54.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.134049+0000", 2023-10-08T07:06:54.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1542000000000003e-05 2023-10-08T07:06:54.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:43.134097+0000", 2023-10-08T07:06:54.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7466000000000003e-05 2023-10-08T07:06:54.475 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.476 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.476 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.476 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1379 4.e 4:70352312:::10000000004.0000001a:head [write 3547136~4096,write 3588096~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:54.476 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:54.476 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.5684463560000008, 2023-10-08T07:06:54.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016369865000000001, 2023-10-08T07:06:54.476 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.476 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.476 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.477 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.477 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.477 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1379 2023-10-08T07:06:54.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.477 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:54.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:54.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819486+0000", 2023-10-08T07:06:54.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:06:54.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819560+0000", 2023-10-08T07:06:54.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4473000000000003e-05 2023-10-08T07:06:54.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819571+0000", 2023-10-08T07:06:54.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0769e-05 2023-10-08T07:06:54.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819576+0000", 2023-10-08T07:06:54.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5410000000000002e-06 2023-10-08T07:06:54.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.821667+0000", 2023-10-08T07:06:54.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020909069999999999 2023-10-08T07:06:54.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.821747+0000", 2023-10-08T07:06:54.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0260999999999996e-05 2023-10-08T07:06:54.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835701+0000", 2023-10-08T07:06:54.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013954148 2023-10-08T07:06:54.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835762+0000", 2023-10-08T07:06:54.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.084e-05 2023-10-08T07:06:54.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835855+0000", 2023-10-08T07:06:54.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3425999999999996e-05 2023-10-08T07:06:54.482 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.482 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.482 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.482 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2064 4.32 4:4efc9492:::10000000004.00000032:head [write 110592~4096,write 249856~4096,write 270336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:54.482 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:54.482 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.3301008299999992, 2023-10-08T07:06:54.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019126292, 2023-10-08T07:06:54.482 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.482 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.483 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2064 2023-10-08T07:06:54.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.483 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.483 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:54.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:54.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057832+0000", 2023-10-08T07:06:54.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3699999999999999e-07 2023-10-08T07:06:54.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057886+0000", 2023-10-08T07:06:54.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4531999999999999e-05 2023-10-08T07:06:54.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057901+0000", 2023-10-08T07:06:54.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4518999999999999e-05 2023-10-08T07:06:54.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057910+0000", 2023-10-08T07:06:54.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4579999999999999e-06 2023-10-08T07:06:54.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057963+0000", 2023-10-08T07:06:54.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3161000000000001e-05 2023-10-08T07:06:54.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.058023+0000", 2023-10-08T07:06:54.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0027e-05 2023-10-08T07:06:54.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076814+0000", 2023-10-08T07:06:54.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018790187 2023-10-08T07:06:54.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.487 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076879+0000", 2023-10-08T07:06:54.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4999999999999994e-05 2023-10-08T07:06:54.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.487 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076957+0000", 2023-10-08T07:06:54.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8571000000000004e-05 2023-10-08T07:06:54.488 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.488 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.488 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.488 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2068 4.1a 4:5a59f83a:::10000000004.00000002:head [write 1794048~4096,write 1806336~4096,write 1937408~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:54.488 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:54.488 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.3289244199999999, 2023-10-08T07:06:54.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017795372, 2023-10-08T07:06:54.488 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.488 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2068 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:54.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059008+0000", 2023-10-08T07:06:54.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1299999999999998e-07 2023-10-08T07:06:54.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059061+0000", 2023-10-08T07:06:54.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2905000000000003e-05 2023-10-08T07:06:54.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059077+0000", 2023-10-08T07:06:54.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6099e-05 2023-10-08T07:06:54.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059088+0000", 2023-10-08T07:06:54.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1056000000000001e-05 2023-10-08T07:06:54.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059146+0000", 2023-10-08T07:06:54.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7385e-05 2023-10-08T07:06:54.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059210+0000", 2023-10-08T07:06:54.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4509000000000002e-05 2023-10-08T07:06:54.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059307+0000", 2023-10-08T07:06:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6273000000000005e-05 2023-10-08T07:06:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.060916+0000", 2023-10-08T07:06:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001609365 2023-10-08T07:06:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076698+0000", 2023-10-08T07:06:54.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015781951999999998 2023-10-08T07:06:54.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076762+0000", 2023-10-08T07:06:54.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3744999999999994e-05 2023-10-08T07:06:54.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076803+0000", 2023-10-08T07:06:54.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1170000000000001e-05 2023-10-08T07:06:54.495 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.495 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.495 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.495 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2087 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1101824~12288,write 1150976~4096,write 1171456~4096,write 1265664~4096,write 1376256~4096,write 1519616~4096,write 1691648~4096,write 1724416~4096,write 1753088~4096,write 1794048~4096,write 1908736~4096,write 1921024~4096,write 2011136~4096,write 2207744~4096,write 2285568~4096,write 2744320~8192,write 2760704~4096,write 2879488~4096,write 2891776~4096,write 3129344~4096,write 3145728~4096,write 3215360~4096,write 3330048~8192,write 3362816~4096,write 3387392~4096,write 3485696~4096,write 3620864~4096,write 4120576~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:54.495 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:54.495 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.3239539709999999, 2023-10-08T07:06:54.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016557490000000001, 2023-10-08T07:06:54.495 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.495 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.495 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.496 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.496 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.496 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2087 2023-10-08T07:06:54.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.496 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:54.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:54.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:54.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:06:54.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064123+0000", 2023-10-08T07:06:54.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014467700000000001 2023-10-08T07:06:54.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064131+0000", 2023-10-08T07:06:54.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9230000000000002e-06 2023-10-08T07:06:54.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064139+0000", 2023-10-08T07:06:54.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5560000000000002e-06 2023-10-08T07:06:54.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.073553+0000", 2023-10-08T07:06:54.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0094146679999999993 2023-10-08T07:06:54.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.073655+0000", 2023-10-08T07:06:54.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010128000000000001 2023-10-08T07:06:54.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:54.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.074076+0000", 2023-10-08T07:06:54.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00042132399999999999 2023-10-08T07:06:54.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.077289+0000", 2023-10-08T07:06:54.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032133589999999998 2023-10-08T07:06:54.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080463+0000", 2023-10-08T07:06:54.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031740940000000001 2023-10-08T07:06:54.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080512+0000", 2023-10-08T07:06:54.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8343000000000001e-05 2023-10-08T07:06:54.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080535+0000", 2023-10-08T07:06:54.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3586000000000001e-05 2023-10-08T07:06:54.501 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.502 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.502 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.502 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2088 4.2a 4:5404a18c:::10000000004.00000025:head [write 774144~4096,write 811008~4096,write 884736~4096,write 909312~4096,write 958464~4096,write 1028096~4096,write 1191936~4096,write 1224704~4096,write 1261568~4096,write 1294336~4096,write 1331200~4096,write 1523712~4096,write 1540096~4096,write 1572864~4096,write 1667072~4096,write 1810432~4096,write 1818624~4096,write 1859584~4096,write 1892352~4096,write 1916928~4096,write 2084864~4096,write 2158592~4096,write 2494464~4096,write 2543616~4096,write 2703360~4096,write 2748416~8192,write 2777088~4096,write 3784704~4096,write 3911680~4096,write 4120576~4096,write 4145152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:54.502 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:54.502 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.3237698729999998, 2023-10-08T07:06:54.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017312658000000002, 2023-10-08T07:06:54.502 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.502 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.503 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.503 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.503 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.503 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2088 2023-10-08T07:06:54.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.503 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.503 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.503 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:54.504 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.504 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.504 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:54.504 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.504 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.504 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064163+0000", 2023-10-08T07:06:54.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:54.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064375+0000", 2023-10-08T07:06:54.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00021216599999999999 2023-10-08T07:06:54.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064385+0000", 2023-10-08T07:06:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0525e-05 2023-10-08T07:06:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064395+0000", 2023-10-08T07:06:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1689999999999998e-06 2023-10-08T07:06:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076644+0000", 2023-10-08T07:06:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012248991000000001 2023-10-08T07:06:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076709+0000", 2023-10-08T07:06:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5708000000000002e-05 2023-10-08T07:06:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081362+0000", 2023-10-08T07:06:54.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0046527449999999998 2023-10-08T07:06:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081425+0000", 2023-10-08T07:06:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3250000000000006e-05 2023-10-08T07:06:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081475+0000", 2023-10-08T07:06:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9246999999999998e-05 2023-10-08T07:06:54.508 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.509 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.509 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.509 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:14150 4.30 4:0f322a22:::10000000004.00000014:head [write 409600~4096,write 679936~4096,write 724992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:54.509 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:06:54.509 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.7133782279999998, 2023-10-08T07:06:54.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018347558999999999, 2023-10-08T07:06:54.509 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.509 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.509 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.509 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.510 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.510 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 14150 2023-10-08T07:06:54.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.510 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.510 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:06:54.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.511 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:06:54.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.511 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.511 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.511 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:06:54.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1200000000000002e-07 2023-10-08T07:06:54.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.511 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.511 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.511 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674566+0000", 2023-10-08T07:06:54.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1438e-05 2023-10-08T07:06:54.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674576+0000", 2023-10-08T07:06:54.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0259e-05 2023-10-08T07:06:54.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674590+0000", 2023-10-08T07:06:54.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.375e-05 2023-10-08T07:06:54.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674644+0000", 2023-10-08T07:06:54.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3878000000000002e-05 2023-10-08T07:06:54.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674755+0000", 2023-10-08T07:06:54.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011113 2023-10-08T07:06:54.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:54.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674931+0000", 2023-10-08T07:06:54.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000176587 2023-10-08T07:06:54.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.676318+0000", 2023-10-08T07:06:54.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0013863040000000001 2023-10-08T07:06:54.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.692819+0000", 2023-10-08T07:06:54.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016501722999999999 2023-10-08T07:06:54.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.692876+0000", 2023-10-08T07:06:54.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7005000000000001e-05 2023-10-08T07:06:54.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.692901+0000", 2023-10-08T07:06:54.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4672999999999999e-05 2023-10-08T07:06:54.515 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.515 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.516 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.516 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:14642 4.20 4:04004f2c:::10000000004.0000000d:head [write 1359872~4096,write 1409024~4096,write 1449984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:54.516 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:06:54.516 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.5354120170000001, 2023-10-08T07:06:54.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016449921999999999, 2023-10-08T07:06:54.516 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.516 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.516 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.516 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.517 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.517 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 14642 2023-10-08T07:06:54.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.517 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.517 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:06:54.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.517 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:06:54.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:06:54.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9999999999999997e-07 2023-10-08T07:06:54.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852556+0000", 2023-10-08T07:06:54.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5413999999999997e-05 2023-10-08T07:06:54.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852570+0000", 2023-10-08T07:06:54.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3735e-05 2023-10-08T07:06:54.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852577+0000", 2023-10-08T07:06:54.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1879999999999996e-06 2023-10-08T07:06:54.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852632+0000", 2023-10-08T07:06:54.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4753999999999998e-05 2023-10-08T07:06:54.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852719+0000", 2023-10-08T07:06:54.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7699000000000002e-05 2023-10-08T07:06:54.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:54.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852863+0000", 2023-10-08T07:06:54.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000143852 2023-10-08T07:06:54.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.857758+0000", 2023-10-08T07:06:54.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048950629999999998 2023-10-08T07:06:54.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.868863+0000", 2023-10-08T07:06:54.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011104563 2023-10-08T07:06:54.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.868928+0000", 2023-10-08T07:06:54.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5610000000000004e-05 2023-10-08T07:06:54.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.868970+0000", 2023-10-08T07:06:54.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1344000000000003e-05 2023-10-08T07:06:54.522 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.523 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.523 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.523 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:15687 4.c 4:3352c333:::10000000004.00000012:head [write 794624~4096,write 925696~4096,write 933888~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:54.523 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:51.262061+0000", 2023-10-08T07:06:54.523 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.1258708529999999, 2023-10-08T07:06:54.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016886580000000002, 2023-10-08T07:06:54.523 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:54.523 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:54.523 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:54.523 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:54.524 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.524 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 15687 2023-10-08T07:06:54.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.524 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:54.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:54.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262061+0000", 2023-10-08T07:06:54.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:54.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262061+0000", 2023-10-08T07:06:54.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:54.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:54.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262062+0000", 2023-10-08T07:06:54.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9000000000000005e-07 2023-10-08T07:06:54.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:54.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262078+0000", 2023-10-08T07:06:54.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6322999999999999e-05 2023-10-08T07:06:54.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.526 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:54.526 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262091+0000", 2023-10-08T07:06:54.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2323999999999999e-05 2023-10-08T07:06:54.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.526 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.526 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262106+0000", 2023-10-08T07:06:54.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5245999999999999e-05 2023-10-08T07:06:54.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:54.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.265173+0000", 2023-10-08T07:06:54.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003067148 2023-10-08T07:06:54.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:54.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.265267+0000", 2023-10-08T07:06:54.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3949000000000005e-05 2023-10-08T07:06:54.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:54.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.265420+0000", 2023-10-08T07:06:54.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015336500000000001 2023-10-08T07:06:54.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:54.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.270637+0000", 2023-10-08T07:06:54.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052167990000000003 2023-10-08T07:06:54.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:54.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.278841+0000", 2023-10-08T07:06:54.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0082038530000000005 2023-10-08T07:06:54.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:54.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.278903+0000", 2023-10-08T07:06:54.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1673000000000004e-05 2023-10-08T07:06:54.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:54.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:54.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:54.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.278948+0000", 2023-10-08T07:06:54.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4910000000000002e-05 2023-10-08T07:06:54.529 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.529 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.529 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.530 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:54.530 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:54.530 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:54.531 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:54.530+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:54.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:54.610 INFO:teuthology.orchestra.run.smithi017.stdout:moved 0 / 210 (0%) 2023-10-08T07:06:54.610 INFO:teuthology.orchestra.run.smithi017.stdout:avg 105 2023-10-08T07:06:54.611 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 33.5037 -> 33.5037 (expected baseline 7.24569) 2023-10-08T07:06:54.611 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.0 with 71 -> 71 pgs (0.67619 -> 0.67619 * mean) 2023-10-08T07:06:54.611 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.2 with 72 -> 72 pgs (0.685714 -> 0.685714 * mean) 2023-10-08T07:06:54.611 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:06:54.611 INFO:teuthology.orchestra.run.smithi017.stdout:oload 1000 2023-10-08T07:06:54.611 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 3 2023-10-08T07:06:54.611 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2023-10-08T07:06:54.611 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0016 2023-10-08T07:06:54.612 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0164 2023-10-08T07:06:54.614 INFO:teuthology.orchestra.run.smithi017.stderr:no change 2023-10-08T07:06:54.628 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2023-10-08T07:06:54.628 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2023-10-08T07:06:54.631 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:54.630+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:54.701 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:54.701 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:54.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.702 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:24875 4.f 4:f2537947:::10000000004.00000017:head [write 2535424~4096 in=4096b,write 2625536~4096 in=4096b,write 2654208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:54.702 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:54.697407+0000", 2023-10-08T07:06:54.702 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001711536, 2023-10-08T07:06:54.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001734275, 2023-10-08T07:06:54.702 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:54.702 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:54.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:54.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:54.703 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.703 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 24875 2023-10-08T07:06:54.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.703 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:54.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:54.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697407+0000", 2023-10-08T07:06:54.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:54.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697407+0000", 2023-10-08T07:06:54.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:54.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697408+0000", 2023-10-08T07:06:54.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9100000000000003e-07 2023-10-08T07:06:54.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:54.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697419+0000", 2023-10-08T07:06:54.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1620999999999999e-05 2023-10-08T07:06:54.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:54.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697430+0000", 2023-10-08T07:06:54.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0530000000000001e-05 2023-10-08T07:06:54.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697437+0000", 2023-10-08T07:06:54.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4320000000000002e-06 2023-10-08T07:06:54.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:54.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697489+0000", 2023-10-08T07:06:54.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1354000000000003e-05 2023-10-08T07:06:54.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:54.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697591+0000", 2023-10-08T07:06:54.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102142 2023-10-08T07:06:54.707 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.707 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:54.707 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.707 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:24876 4.3f 4:fc9a2d79:::10000000004.0000002f:head [write 2572288~4096 in=4096b,write 2732032~4096 in=4096b,write 2756608~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:54.707 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:54.697689+0000", 2023-10-08T07:06:54.708 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001429411, 2023-10-08T07:06:54.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015009929999999999, 2023-10-08T07:06:54.708 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:54.708 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:54.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:54.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:54.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.708 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 24876 2023-10-08T07:06:54.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.709 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:54.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:54.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697689+0000", 2023-10-08T07:06:54.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:54.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697689+0000", 2023-10-08T07:06:54.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:54.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697690+0000", 2023-10-08T07:06:54.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3099999999999997e-07 2023-10-08T07:06:54.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:54.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697704+0000", 2023-10-08T07:06:54.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4063000000000001e-05 2023-10-08T07:06:54.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:54.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697713+0000", 2023-10-08T07:06:54.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8990000000000007e-06 2023-10-08T07:06:54.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697720+0000", 2023-10-08T07:06:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0480000000000001e-06 2023-10-08T07:06:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697766+0000", 2023-10-08T07:06:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6121000000000001e-05 2023-10-08T07:06:54.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697854+0000", 2023-10-08T07:06:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8500999999999999e-05 2023-10-08T07:06:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.714 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:24863 4.c e44/17 4:3352c333:::10000000004.00000012:head v 44'786, mlcod=44'781)", 2023-10-08T07:06:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:54.698064+0000", 2023-10-08T07:06:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0010544549999999999, 2023-10-08T07:06:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001178482, 2023-10-08T07:06:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698064+0000", 2023-10-08T07:06:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698064+0000", 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698065+0000", 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-07 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698081+0000", 2023-10-08T07:06:54.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5851000000000001e-05 2023-10-08T07:06:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698091+0000", 2023-10-08T07:06:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0202e-05 2023-10-08T07:06:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698104+0000", 2023-10-08T07:06:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2921e-05 2023-10-08T07:06:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698154+0000", 2023-10-08T07:06:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0374999999999998e-05 2023-10-08T07:06:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698173+0000", 2023-10-08T07:06:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8983000000000001e-05 2023-10-08T07:06:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:24877 4.11 4:8963efe6:::10000000004.00000009:head [write 2940928~4096 in=4096b,write 2990080~4096 in=4096b,write 3104768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:54.698087+0000", 2023-10-08T07:06:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001031112, 2023-10-08T07:06:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00119275, 2023-10-08T07:06:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 24877 2023-10-08T07:06:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698087+0000", 2023-10-08T07:06:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698087+0000", 2023-10-08T07:06:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698088+0000", 2023-10-08T07:06:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6899999999999996e-07 2023-10-08T07:06:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698099+0000", 2023-10-08T07:06:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1046000000000001e-05 2023-10-08T07:06:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:54.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698110+0000", 2023-10-08T07:06:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0981999999999999e-05 2023-10-08T07:06:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698117+0000", 2023-10-08T07:06:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:06:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698184+0000", 2023-10-08T07:06:54.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6736000000000006e-05 2023-10-08T07:06:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698283+0000", 2023-10-08T07:06:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9096000000000001e-05 2023-10-08T07:06:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698445+0000", 2023-10-08T07:06:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016200000000000001 2023-10-08T07:06:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.723 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:54.724 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.724 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:24866 4.3a e44/17 4:5fb70c0f:::10000000004.0000002e:head v 44'1118, mlcod=44'1114)", 2023-10-08T07:06:54.724 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:54.698142+0000", 2023-10-08T07:06:54.724 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000976153, 2023-10-08T07:06:54.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001202039, 2023-10-08T07:06:54.724 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:54.724 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:54.724 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:54.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:54.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698142+0000", 2023-10-08T07:06:54.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:54.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698142+0000", 2023-10-08T07:06:54.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:54.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698143+0000", 2023-10-08T07:06:54.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8099999999999998e-07 2023-10-08T07:06:54.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:54.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698154+0000", 2023-10-08T07:06:54.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1195999999999999e-05 2023-10-08T07:06:54.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:54.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698162+0000", 2023-10-08T07:06:54.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.337e-06 2023-10-08T07:06:54.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698168+0000", 2023-10-08T07:06:54.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7660000000000004e-06 2023-10-08T07:06:54.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:54.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698208+0000", 2023-10-08T07:06:54.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0160000000000002e-05 2023-10-08T07:06:54.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:54.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698228+0000", 2023-10-08T07:06:54.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9644999999999999e-05 2023-10-08T07:06:54.728 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.728 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:54.728 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.728 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:24867 4.38 e44/17 4:1e0977c7:::10000000004.00000022:head v 44'386, mlcod=44'382)", 2023-10-08T07:06:54.728 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:54.698184+0000", 2023-10-08T07:06:54.728 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00093456500000000005, 2023-10-08T07:06:54.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012209219999999999, 2023-10-08T07:06:54.728 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698184+0000", 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698184+0000", 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:54.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698184+0000", 2023-10-08T07:06:54.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7300000000000002e-07 2023-10-08T07:06:54.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:54.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698220+0000", 2023-10-08T07:06:54.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6099000000000001e-05 2023-10-08T07:06:54.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:54.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698228+0000", 2023-10-08T07:06:54.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0739999999999993e-06 2023-10-08T07:06:54.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698234+0000", 2023-10-08T07:06:54.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7320000000000003e-06 2023-10-08T07:06:54.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:54.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698300+0000", 2023-10-08T07:06:54.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6266000000000006e-05 2023-10-08T07:06:54.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:54.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698320+0000", 2023-10-08T07:06:54.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0037000000000001e-05 2023-10-08T07:06:54.732 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.732 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:54.732 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.733 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:24879 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 3215360~4096 in=4096b,write 3227648~4096 in=4096b,write 3248128~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:54.733 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:54.698729+0000", 2023-10-08T07:06:54.733 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00038965499999999998, 2023-10-08T07:06:54.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076710000000000005, 2023-10-08T07:06:54.733 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:54.733 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:54.733 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:54.733 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:54.733 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.733 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 24879 2023-10-08T07:06:54.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.734 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:54.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:54.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698729+0000", 2023-10-08T07:06:54.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:54.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698729+0000", 2023-10-08T07:06:54.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:54.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698730+0000", 2023-10-08T07:06:54.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0800000000000003e-07 2023-10-08T07:06:54.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:54.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698740+0000", 2023-10-08T07:06:54.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0531e-05 2023-10-08T07:06:54.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:54.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698749+0000", 2023-10-08T07:06:54.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6750000000000008e-06 2023-10-08T07:06:54.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698756+0000", 2023-10-08T07:06:54.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5560000000000004e-06 2023-10-08T07:06:54.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:54.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698820+0000", 2023-10-08T07:06:54.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3991000000000004e-05 2023-10-08T07:06:54.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:54.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.698918+0000", 2023-10-08T07:06:54.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8721000000000006e-05 2023-10-08T07:06:54.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.737 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:54.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.737 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:24881 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:54.738 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:54.699468+0000", 2023-10-08T07:06:54.738 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999651, 2023-10-08T07:06:54.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4629999999999994e-05, 2023-10-08T07:06:54.738 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:54.738 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:06:54.738 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:54.738 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:54.738 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.738 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 24881 2023-10-08T07:06:54.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.699468+0000", 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.699468+0000", 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:54.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.699469+0000", 2023-10-08T07:06:54.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2399999999999997e-07 2023-10-08T07:06:54.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:54.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.699482+0000", 2023-10-08T07:06:54.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3701e-05 2023-10-08T07:06:54.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:54.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.699492+0000", 2023-10-08T07:06:54.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4339999999999998e-06 2023-10-08T07:06:54.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.699499+0000", 2023-10-08T07:06:54.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8499999999999996e-06 2023-10-08T07:06:54.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:54.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.699560+0000", 2023-10-08T07:06:54.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1446999999999996e-05 2023-10-08T07:06:54.741 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.741 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:54.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.742 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:24871 4.16 4:69eefec8:::10000000004.0000003a:head [write 3477504~4096 in=4096b,write 3710976~4096 in=4096b,write 3821568~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:54.742 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:54.696109+0000", 2023-10-08T07:06:54.742 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003009224, 2023-10-08T07:06:54.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035293859999999998, 2023-10-08T07:06:54.742 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:54.742 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:54.742 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:54.742 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:54.742 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.743 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 24871 2023-10-08T07:06:54.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.743 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:54.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:54.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696109+0000", 2023-10-08T07:06:54.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:54.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696109+0000", 2023-10-08T07:06:54.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:54.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696110+0000", 2023-10-08T07:06:54.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5999999999999991e-07 2023-10-08T07:06:54.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:54.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696123+0000", 2023-10-08T07:06:54.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2257e-05 2023-10-08T07:06:54.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:54.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696133+0000", 2023-10-08T07:06:54.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0281e-05 2023-10-08T07:06:54.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696140+0000", 2023-10-08T07:06:54.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1999999999999997e-06 2023-10-08T07:06:54.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:54.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696206+0000", 2023-10-08T07:06:54.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6136999999999994e-05 2023-10-08T07:06:54.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:54.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696305+0000", 2023-10-08T07:06:54.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8833999999999996e-05 2023-10-08T07:06:54.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:54.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696489+0000", 2023-10-08T07:06:54.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000184174 2023-10-08T07:06:54.746 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.747 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:54.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.747 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:24872 4.21 4:867af9ba:::10000000004.0000000a:head [write 1216512~4096 in=4096b,write 1388544~4096 in=4096b,write 1576960~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:54.747 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:54.696452+0000", 2023-10-08T07:06:54.747 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0026665059999999999, 2023-10-08T07:06:54.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032904739999999998, 2023-10-08T07:06:54.747 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:54.747 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:54.747 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:54.747 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:54.748 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.748 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 24872 2023-10-08T07:06:54.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.748 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:54.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:54.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696452+0000", 2023-10-08T07:06:54.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696452+0000", 2023-10-08T07:06:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696453+0000", 2023-10-08T07:06:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6000000000000004e-07 2023-10-08T07:06:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696462+0000", 2023-10-08T07:06:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0880000000000001e-06 2023-10-08T07:06:54.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:54.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696468+0000", 2023-10-08T07:06:54.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6320000000000002e-06 2023-10-08T07:06:54.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696473+0000", 2023-10-08T07:06:54.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6500000000000004e-06 2023-10-08T07:06:54.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:54.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696528+0000", 2023-10-08T07:06:54.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4592999999999997e-05 2023-10-08T07:06:54.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:54.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696616+0000", 2023-10-08T07:06:54.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8784999999999998e-05 2023-10-08T07:06:54.751 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.751 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:54.751 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.752 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:24873 4.15 4:a88808fa:::10000000004.0000001f:head [write 24576~4096 in=4096b,write 73728~4096 in=4096b,write 237568~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:54.752 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:54.696736+0000", 2023-10-08T07:06:54.752 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0023825500000000002, 2023-10-08T07:06:54.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030891009999999999, 2023-10-08T07:06:54.752 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:54.752 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:54.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:54.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:54.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.752 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 24873 2023-10-08T07:06:54.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.753 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:54.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:54.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696736+0000", 2023-10-08T07:06:54.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:54.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696736+0000", 2023-10-08T07:06:54.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:54.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696737+0000", 2023-10-08T07:06:54.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2023-10-08T07:06:54.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:54.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696748+0000", 2023-10-08T07:06:54.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0971999999999999e-05 2023-10-08T07:06:54.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:54.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696757+0000", 2023-10-08T07:06:54.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4239999999999999e-06 2023-10-08T07:06:54.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696764+0000", 2023-10-08T07:06:54.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0620000000000003e-06 2023-10-08T07:06:54.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:54.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696815+0000", 2023-10-08T07:06:54.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0667000000000001e-05 2023-10-08T07:06:54.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:54.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.696892+0000", 2023-10-08T07:06:54.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7132999999999995e-05 2023-10-08T07:06:54.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.756 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:54.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.756 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:24874 4.14 4:2b72a8af:::10000000004.0000000c:head [write 1798144~4096 in=4096b,write 1806336~4096 in=4096b,write 1839104~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:54.756 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:54.697070+0000", 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002048935, 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028335370000000001, 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 24874 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:54.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697070+0000", 2023-10-08T07:06:54.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:54.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697070+0000", 2023-10-08T07:06:54.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:54.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:54.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697070+0000", 2023-10-08T07:06:54.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6400000000000001e-07 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697086+0000", 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5170999999999999e-05 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697104+0000", 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7884e-05 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:54.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697112+0000", 2023-10-08T07:06:54.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7499999999999992e-06 2023-10-08T07:06:54.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:54.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697165+0000", 2023-10-08T07:06:54.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3062999999999997e-05 2023-10-08T07:06:54.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:54.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:54.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:54.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:54.697267+0000", 2023-10-08T07:06:54.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101328 2023-10-08T07:06:54.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.761 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:54.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:54.761 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:06:54.761 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 12 2023-10-08T07:06:54.761 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:54.763 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:54.763 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:54.761+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:54.864 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:54.863+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:54.964 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:54.963+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:54.979 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:54.980 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:54.980 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:54.980 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:54.980 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:54.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:55.053 INFO:tasks.ceph.mgr.y.smithi017.stderr:2023-10-08T07:06:55.052+0000 7f4c4f689700 -1 mgr.server reply reply (2) No such file or directory no change 2023-10-08T07:06:55.054 INFO:teuthology.orchestra.run.smithi017.stdout:moved 7 / 210 (3.33333%) 2023-10-08T07:06:55.054 INFO:teuthology.orchestra.run.smithi017.stdout:avg 105 2023-10-08T07:06:55.054 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 33.5037 -> 35.5317 (expected baseline 7.24569) 2023-10-08T07:06:55.054 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.0 with 71 -> 68 pgs (0.67619 -> 0.647619 * mean) 2023-10-08T07:06:55.054 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.2 with 72 -> 71 pgs (0.685714 -> 0.67619 * mean) 2023-10-08T07:06:55.054 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:06:55.054 INFO:teuthology.orchestra.run.smithi017.stdout:oload 110 2023-10-08T07:06:55.054 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 0.05 2023-10-08T07:06:55.055 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2023-10-08T07:06:55.055 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0016 2023-10-08T07:06:55.055 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0018 2023-10-08T07:06:55.055 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 weight 1.0000 -> 0.9500 2023-10-08T07:06:55.055 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 weight 1.0000 -> 0.9500 2023-10-08T07:06:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:no change 2023-10-08T07:06:55.065 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:55.064+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:55.070 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2023-10-08T07:06:55.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2023-10-08T07:06:55.164 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:48 4.7 4:e13e8cdb:::10000000004.00000028:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:43.026119+0000", 2023-10-08T07:06:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.135520551999999, 2023-10-08T07:06:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015490617999999999, 2023-10-08T07:06:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 48 2023-10-08T07:06:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.026119+0000", 2023-10-08T07:06:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.026119+0000", 2023-10-08T07:06:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.026121+0000", 2023-10-08T07:06:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0389999999999999e-06 2023-10-08T07:06:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035074+0000", 2023-10-08T07:06:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089530200000000008 2023-10-08T07:06:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035104+0000", 2023-10-08T07:06:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9896999999999999e-05 2023-10-08T07:06:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035124+0000", 2023-10-08T07:06:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0188999999999999e-05 2023-10-08T07:06:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035225+0000", 2023-10-08T07:06:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100399 2023-10-08T07:06:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.035360+0000", 2023-10-08T07:06:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013467199999999999 2023-10-08T07:06:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.041522+0000", 2023-10-08T07:06:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061625159999999998 2023-10-08T07:06:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.041561+0000", 2023-10-08T07:06:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9291e-05 2023-10-08T07:06:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:43.041610+0000", 2023-10-08T07:06:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8594999999999998e-05 2023-10-08T07:06:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14151 4.3f 4:fc9a2d79:::10000000004.0000002f:head [write 3731456~4096,write 3739648~4096,write 3895296~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.674958+0000", 2023-10-08T07:06:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4866814250000004, 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014681177, 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14151 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.674958+0000", 2023-10-08T07:06:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.674958+0000", 2023-10-08T07:06:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.674959+0000", 2023-10-08T07:06:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5000000000000002e-07 2023-10-08T07:06:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.674969+0000", 2023-10-08T07:06:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6700000000000006e-06 2023-10-08T07:06:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.674979+0000", 2023-10-08T07:06:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6649999999999998e-06 2023-10-08T07:06:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.674986+0000", 2023-10-08T07:06:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0419999999999997e-06 2023-10-08T07:06:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675043+0000", 2023-10-08T07:06:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7188000000000002e-05 2023-10-08T07:06:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675095+0000", 2023-10-08T07:06:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2274000000000001e-05 2023-10-08T07:06:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689521+0000", 2023-10-08T07:06:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014425863000000001 2023-10-08T07:06:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689589+0000", 2023-10-08T07:06:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7722e-05 2023-10-08T07:06:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689640+0000", 2023-10-08T07:06:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1002999999999999e-05 2023-10-08T07:06:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:14150 4.30 e42/17 4:0f322a22:::10000000004.00000014:head v 42'237, mlcod=42'235)", 2023-10-08T07:06:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.675026+0000", 2023-10-08T07:06:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4866134850000003, 2023-10-08T07:06:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017643645999999999, 2023-10-08T07:06:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675026+0000", 2023-10-08T07:06:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675026+0000", 2023-10-08T07:06:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675027+0000", 2023-10-08T07:06:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6899999999999997e-07 2023-10-08T07:06:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675038+0000", 2023-10-08T07:06:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0716e-05 2023-10-08T07:06:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675045+0000", 2023-10-08T07:06:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0450000000000003e-06 2023-10-08T07:06:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675050+0000", 2023-10-08T07:06:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1080000000000001e-06 2023-10-08T07:06:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675089+0000", 2023-10-08T07:06:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9480000000000001e-05 2023-10-08T07:06:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675101+0000", 2023-10-08T07:06:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1708e-05 2023-10-08T07:06:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692618+0000", 2023-10-08T07:06:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017517245000000001 2023-10-08T07:06:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692670+0000", 2023-10-08T07:06:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1774999999999998e-05 2023-10-08T07:06:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14153 4.15 4:aa4cb2c5:::10000000004.0000003c:head [write 1294336~8192,write 1335296~4096,write 1503232~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.675598+0000", 2023-10-08T07:06:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4860422030000002, 2023-10-08T07:06:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014289494999999999, 2023-10-08T07:06:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14153 2023-10-08T07:06:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675598+0000", 2023-10-08T07:06:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675598+0000", 2023-10-08T07:06:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675598+0000", 2023-10-08T07:06:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1600000000000001e-07 2023-10-08T07:06:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675612+0000", 2023-10-08T07:06:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3869000000000001e-05 2023-10-08T07:06:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675625+0000", 2023-10-08T07:06:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2524000000000001e-05 2023-10-08T07:06:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675634+0000", 2023-10-08T07:06:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0669999999999998e-06 2023-10-08T07:06:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675687+0000", 2023-10-08T07:06:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3001999999999998e-05 2023-10-08T07:06:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675777+0000", 2023-10-08T07:06:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0224999999999998e-05 2023-10-08T07:06:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689778+0000", 2023-10-08T07:06:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014001039999999999 2023-10-08T07:06:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689813+0000", 2023-10-08T07:06:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4836000000000003e-05 2023-10-08T07:06:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.689887+0000", 2023-10-08T07:06:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4215999999999996e-05 2023-10-08T07:06:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:14155 4.3a e42/17 4:5d52ad5e:::10000000004.00000026:head v 42'631, mlcod=42'629)", 2023-10-08T07:06:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.676658+0000", 2023-10-08T07:06:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4849819829999999, 2023-10-08T07:06:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014413881, 2023-10-08T07:06:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676658+0000", 2023-10-08T07:06:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676658+0000", 2023-10-08T07:06:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676658+0000", 2023-10-08T07:06:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2023-10-08T07:06:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676670+0000", 2023-10-08T07:06:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1514e-05 2023-10-08T07:06:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676681+0000", 2023-10-08T07:06:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1309e-05 2023-10-08T07:06:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676696+0000", 2023-10-08T07:06:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4966e-05 2023-10-08T07:06:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676749+0000", 2023-10-08T07:06:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2488999999999998e-05 2023-10-08T07:06:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.676761+0000", 2023-10-08T07:06:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2762000000000001e-05 2023-10-08T07:06:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.691034+0000", 2023-10-08T07:06:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014272376999999999 2023-10-08T07:06:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.691072+0000", 2023-10-08T07:06:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8003999999999997e-05 2023-10-08T07:06:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14158 4.19 4:9b26afe3:::10000000004.00000005:head [write 557056~4096,write 696320~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.677136+0000", 2023-10-08T07:06:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4845040699999998, 2023-10-08T07:06:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014833242999999999, 2023-10-08T07:06:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14158 2023-10-08T07:06:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677136+0000", 2023-10-08T07:06:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677136+0000", 2023-10-08T07:06:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677137+0000", 2023-10-08T07:06:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4799999999999997e-07 2023-10-08T07:06:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677162+0000", 2023-10-08T07:06:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5605e-05 2023-10-08T07:06:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677179+0000", 2023-10-08T07:06:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6169999999999999e-05 2023-10-08T07:06:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677186+0000", 2023-10-08T07:06:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7789999999999996e-06 2023-10-08T07:06:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677228+0000", 2023-10-08T07:06:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1600000000000002e-05 2023-10-08T07:06:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677287+0000", 2023-10-08T07:06:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8709000000000003e-05 2023-10-08T07:06:55.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.691828+0000", 2023-10-08T07:06:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014541421000000001 2023-10-08T07:06:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.691880+0000", 2023-10-08T07:06:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-05 2023-10-08T07:06:55.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.691969+0000", 2023-10-08T07:06:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9340999999999997e-05 2023-10-08T07:06:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:14159 4.1b e42/17 4:dbb7dde6:::10000000004.0000002c:head v 42'439, mlcod=42'437)", 2023-10-08T07:06:55.206 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.677869+0000", 2023-10-08T07:06:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.48377085, 2023-10-08T07:06:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014274352000000001, 2023-10-08T07:06:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677869+0000", 2023-10-08T07:06:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677869+0000", 2023-10-08T07:06:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677870+0000", 2023-10-08T07:06:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5799999999999999e-07 2023-10-08T07:06:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677878+0000", 2023-10-08T07:06:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8319999999999995e-06 2023-10-08T07:06:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677893+0000", 2023-10-08T07:06:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.414e-05 2023-10-08T07:06:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677900+0000", 2023-10-08T07:06:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4549999999999998e-06 2023-10-08T07:06:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677938+0000", 2023-10-08T07:06:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7979999999999999e-05 2023-10-08T07:06:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.677953+0000", 2023-10-08T07:06:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4664000000000001e-05 2023-10-08T07:06:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692105+0000", 2023-10-08T07:06:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014152222000000001 2023-10-08T07:06:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692143+0000", 2023-10-08T07:06:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8501000000000003e-05 2023-10-08T07:06:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.212 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14161 4.28 4:16edf4d3:::10000000004.00000027:head [write 909312~4096,write 1196032~4096,write 1642496~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.678098+0000", 2023-10-08T07:06:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4835418840000001, 2023-10-08T07:06:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014823800999999999, 2023-10-08T07:06:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14161 2023-10-08T07:06:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.213 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678098+0000", 2023-10-08T07:06:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678098+0000", 2023-10-08T07:06:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678099+0000", 2023-10-08T07:06:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3099999999999998e-07 2023-10-08T07:06:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678142+0000", 2023-10-08T07:06:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3974999999999998e-05 2023-10-08T07:06:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678149+0000", 2023-10-08T07:06:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.861e-06 2023-10-08T07:06:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678153+0000", 2023-10-08T07:06:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.878e-06 2023-10-08T07:06:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678211+0000", 2023-10-08T07:06:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7565000000000002e-05 2023-10-08T07:06:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.678304+0000", 2023-10-08T07:06:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3565000000000003e-05 2023-10-08T07:06:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692785+0000", 2023-10-08T07:06:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014481093 2023-10-08T07:06:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692845+0000", 2023-10-08T07:06:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9052999999999999e-05 2023-10-08T07:06:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692922+0000", 2023-10-08T07:06:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7280000000000005e-05 2023-10-08T07:06:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.219 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14300 4.15 4:aaa619cf:::10000000004.00000004:head [write 1908736~4096,write 3301376~4096,write 3334144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.728474+0000", 2023-10-08T07:06:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4331662820000002, 2023-10-08T07:06:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016104286999999998, 2023-10-08T07:06:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14300 2023-10-08T07:06:55.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728474+0000", 2023-10-08T07:06:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728474+0000", 2023-10-08T07:06:55.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728474+0000", 2023-10-08T07:06:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1500000000000004e-07 2023-10-08T07:06:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728489+0000", 2023-10-08T07:06:55.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4905e-05 2023-10-08T07:06:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728509+0000", 2023-10-08T07:06:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0083999999999999e-05 2023-10-08T07:06:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728515+0000", 2023-10-08T07:06:55.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7599999999999999e-06 2023-10-08T07:06:55.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728560+0000", 2023-10-08T07:06:55.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4654000000000003e-05 2023-10-08T07:06:55.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.728610+0000", 2023-10-08T07:06:55.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0658999999999997e-05 2023-10-08T07:06:55.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.744453+0000", 2023-10-08T07:06:55.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015842617 2023-10-08T07:06:55.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.744506+0000", 2023-10-08T07:06:55.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3315e-05 2023-10-08T07:06:55.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.744578+0000", 2023-10-08T07:06:55.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1577999999999998e-05 2023-10-08T07:06:55.228 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.228 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.228 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.228 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14638 4.2f 4:f790ef75:::10000000004.00000038:head [write 2977792~4096,write 3022848~4096,write 3043328~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:55.228 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.851242+0000", 2023-10-08T07:06:55.228 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3103974940000001, 2023-10-08T07:06:55.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016802940999999998, 2023-10-08T07:06:55.229 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.229 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.229 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.229 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.229 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.229 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14638 2023-10-08T07:06:55.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.229 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851242+0000", 2023-10-08T07:06:55.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851242+0000", 2023-10-08T07:06:55.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851243+0000", 2023-10-08T07:06:55.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2799999999999995e-07 2023-10-08T07:06:55.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851282+0000", 2023-10-08T07:06:55.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9181000000000003e-05 2023-10-08T07:06:55.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851300+0000", 2023-10-08T07:06:55.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7190999999999999e-05 2023-10-08T07:06:55.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851306+0000", 2023-10-08T07:06:55.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.888e-06 2023-10-08T07:06:55.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851373+0000", 2023-10-08T07:06:55.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6833000000000002e-05 2023-10-08T07:06:55.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851465+0000", 2023-10-08T07:06:55.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1978000000000006e-05 2023-10-08T07:06:55.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.867944+0000", 2023-10-08T07:06:55.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016478282 2023-10-08T07:06:55.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.867997+0000", 2023-10-08T07:06:55.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3640999999999997e-05 2023-10-08T07:06:55.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.868045+0000", 2023-10-08T07:06:55.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8118999999999998e-05 2023-10-08T07:06:55.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.235 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.235 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14639 4.b 4:d0c991e0:::10000000004.0000002d:head [write 2207744~4096,write 2269184~4096,write 2310144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:55.235 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.851520+0000", 2023-10-08T07:06:55.235 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3101194390000002, 2023-10-08T07:06:55.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018887537999999999, 2023-10-08T07:06:55.235 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.236 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.236 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.236 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.236 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.236 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14639 2023-10-08T07:06:55.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.236 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851520+0000", 2023-10-08T07:06:55.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851520+0000", 2023-10-08T07:06:55.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851521+0000", 2023-10-08T07:06:55.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0900000000000001e-07 2023-10-08T07:06:55.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851569+0000", 2023-10-08T07:06:55.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7552999999999997e-05 2023-10-08T07:06:55.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851578+0000", 2023-10-08T07:06:55.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8570000000000001e-06 2023-10-08T07:06:55.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851585+0000", 2023-10-08T07:06:55.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0230000000000004e-06 2023-10-08T07:06:55.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851639+0000", 2023-10-08T07:06:55.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4214e-05 2023-10-08T07:06:55.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851729+0000", 2023-10-08T07:06:55.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0687999999999996e-05 2023-10-08T07:06:55.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:55.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851918+0000", 2023-10-08T07:06:55.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018832899999999999 2023-10-08T07:06:55.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:55.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.858649+0000", 2023-10-08T07:06:55.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067308250000000002 2023-10-08T07:06:55.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.870299+0000", 2023-10-08T07:06:55.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011650162 2023-10-08T07:06:55.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.870357+0000", 2023-10-08T07:06:55.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8418999999999998e-05 2023-10-08T07:06:55.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.870408+0000", 2023-10-08T07:06:55.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0759e-05 2023-10-08T07:06:55.242 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.243 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.243 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:14642 4.20 e42/17 4:04004f2c:::10000000004.0000000d:head v 42'684, mlcod=42'681)", 2023-10-08T07:06:55.243 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.852964+0000", 2023-10-08T07:06:55.243 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3086754919999999, 2023-10-08T07:06:55.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015218938, 2023-10-08T07:06:55.244 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.244 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.244 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.852964+0000", 2023-10-08T07:06:55.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.852964+0000", 2023-10-08T07:06:55.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.852965+0000", 2023-10-08T07:06:55.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2023-10-08T07:06:55.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.852977+0000", 2023-10-08T07:06:55.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2381999999999999e-05 2023-10-08T07:06:55.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.852985+0000", 2023-10-08T07:06:55.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6490000000000008e-06 2023-10-08T07:06:55.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.852990+0000", 2023-10-08T07:06:55.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.792e-06 2023-10-08T07:06:55.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.854487+0000", 2023-10-08T07:06:55.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014972430000000001 2023-10-08T07:06:55.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.854506+0000", 2023-10-08T07:06:55.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8918000000000001e-05 2023-10-08T07:06:55.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.868140+0000", 2023-10-08T07:06:55.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013633721999999999 2023-10-08T07:06:55.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.868183+0000", 2023-10-08T07:06:55.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3711000000000002e-05 2023-10-08T07:06:55.249 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.249 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.249 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.250 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14646 4.b 4:d0c991e0:::10000000004.0000002d:head [write 3731456~4096,write 3743744~4096,write 3919872~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:55.250 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.853800+0000", 2023-10-08T07:06:55.250 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.307839897, 2023-10-08T07:06:55.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016663898999999999, 2023-10-08T07:06:55.250 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.250 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.250 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.250 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.250 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.250 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14646 2023-10-08T07:06:55.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.251 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.853800+0000", 2023-10-08T07:06:55.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.853800+0000", 2023-10-08T07:06:55.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.853801+0000", 2023-10-08T07:06:55.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9400000000000004e-07 2023-10-08T07:06:55.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.853810+0000", 2023-10-08T07:06:55.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6090000000000007e-06 2023-10-08T07:06:55.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.853820+0000", 2023-10-08T07:06:55.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0128e-05 2023-10-08T07:06:55.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.853827+0000", 2023-10-08T07:06:55.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3409999999999999e-06 2023-10-08T07:06:55.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.857494+0000", 2023-10-08T07:06:55.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003667114 2023-10-08T07:06:55.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.857571+0000", 2023-10-08T07:06:55.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7162000000000004e-05 2023-10-08T07:06:55.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:55.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.857719+0000", 2023-10-08T07:06:55.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014758499999999999 2023-10-08T07:06:55.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:55.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.864544+0000", 2023-10-08T07:06:55.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068255859999999998 2023-10-08T07:06:55.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.870415+0000", 2023-10-08T07:06:55.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058702670000000002 2023-10-08T07:06:55.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.870446+0000", 2023-10-08T07:06:55.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1801999999999998e-05 2023-10-08T07:06:55.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.870464+0000", 2023-10-08T07:06:55.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7510999999999999e-05 2023-10-08T07:06:55.257 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.258 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.258 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.258 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:14652 4.1b e42/17 4:dbb7dde6:::10000000004.0000002c:head v 42'453, mlcod=42'450)", 2023-10-08T07:06:55.258 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.856153+0000", 2023-10-08T07:06:55.258 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3054865099999997, 2023-10-08T07:06:55.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014434786, 2023-10-08T07:06:55.258 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.258 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.258 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.856153+0000", 2023-10-08T07:06:55.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.856153+0000", 2023-10-08T07:06:55.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.856154+0000", 2023-10-08T07:06:55.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0699999999999997e-07 2023-10-08T07:06:55.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.856164+0000", 2023-10-08T07:06:55.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0134e-05 2023-10-08T07:06:55.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.856172+0000", 2023-10-08T07:06:55.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8830000000000006e-06 2023-10-08T07:06:55.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.856176+0000", 2023-10-08T07:06:55.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5240000000000002e-06 2023-10-08T07:06:55.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.858625+0000", 2023-10-08T07:06:55.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002448942 2023-10-08T07:06:55.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.858638+0000", 2023-10-08T07:06:55.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2892e-05 2023-10-08T07:06:55.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.870555+0000", 2023-10-08T07:06:55.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011916515000000001 2023-10-08T07:06:55.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.870588+0000", 2023-10-08T07:06:55.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3389000000000002e-05 2023-10-08T07:06:55.263 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.263 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.263 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.264 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:17036 4.20 e43/17 4:04004f2c:::10000000004.0000000d:head v 43'803, mlcod=43'800)", 2023-10-08T07:06:55.264 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.738428+0000", 2023-10-08T07:06:55.264 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.4232119499999998, 2023-10-08T07:06:55.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014309888999999999, 2023-10-08T07:06:55.264 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.264 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.264 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738428+0000", 2023-10-08T07:06:55.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738428+0000", 2023-10-08T07:06:55.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738428+0000", 2023-10-08T07:06:55.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:06:55.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738443+0000", 2023-10-08T07:06:55.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4090999999999999e-05 2023-10-08T07:06:55.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738453+0000", 2023-10-08T07:06:55.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.077e-05 2023-10-08T07:06:55.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738460+0000", 2023-10-08T07:06:55.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7360000000000004e-06 2023-10-08T07:06:55.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738497+0000", 2023-10-08T07:06:55.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6579000000000003e-05 2023-10-08T07:06:55.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738508+0000", 2023-10-08T07:06:55.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1703e-05 2023-10-08T07:06:55.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.752702+0000", 2023-10-08T07:06:55.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0141934 2023-10-08T07:06:55.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.752738+0000", 2023-10-08T07:06:55.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6032999999999999e-05 2023-10-08T07:06:55.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.272 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.272 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17038 4.19 4:9b26afe3:::10000000004.00000005:head [write 3284992~4096,write 3452928~4096,write 3584000~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:55.272 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.738629+0000", 2023-10-08T07:06:55.272 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.423010814, 2023-10-08T07:06:55.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01423226, 2023-10-08T07:06:55.272 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.273 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.273 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17038 2023-10-08T07:06:55.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.273 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738629+0000", 2023-10-08T07:06:55.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738629+0000", 2023-10-08T07:06:55.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738630+0000", 2023-10-08T07:06:55.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5700000000000002e-07 2023-10-08T07:06:55.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738644+0000", 2023-10-08T07:06:55.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4633e-05 2023-10-08T07:06:55.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738654+0000", 2023-10-08T07:06:55.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3850000000000008e-06 2023-10-08T07:06:55.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.738663+0000", 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8300000000000002e-06 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.740505+0000", 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001842804 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.740589+0000", 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4040000000000002e-05 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.752719+0000", 2023-10-08T07:06:55.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012129937 2023-10-08T07:06:55.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.752775+0000", 2023-10-08T07:06:55.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5612000000000002e-05 2023-10-08T07:06:55.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.752861+0000", 2023-10-08T07:06:55.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6261999999999995e-05 2023-10-08T07:06:55.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.278 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.278 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17709 4.28 4:16edf4d3:::10000000004.00000027:head [write 16384~4096 in=4096b,write 159744~4096 in=4096b,write 204800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:55.278 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.989822+0000", 2023-10-08T07:06:55.278 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.1718179320000002, 2023-10-08T07:06:55.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016860443999999999, 2023-10-08T07:06:55.278 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.278 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.279 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17709 2023-10-08T07:06:55.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.279 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989822+0000", 2023-10-08T07:06:55.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989822+0000", 2023-10-08T07:06:55.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989823+0000", 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2399999999999998e-07 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989833+0000", 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0087e-05 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989841+0000", 2023-10-08T07:06:55.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4200000000000007e-06 2023-10-08T07:06:55.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989846+0000", 2023-10-08T07:06:55.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7219999999999999e-06 2023-10-08T07:06:55.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989883+0000", 2023-10-08T07:06:55.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7276e-05 2023-10-08T07:06:55.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989956+0000", 2023-10-08T07:06:55.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2773000000000003e-05 2023-10-08T07:06:55.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006556+0000", 2023-10-08T07:06:55.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016599820000000001 2023-10-08T07:06:55.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006607+0000", 2023-10-08T07:06:55.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1622000000000001e-05 2023-10-08T07:06:55.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006682+0000", 2023-10-08T07:06:55.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5099999999999996e-05 2023-10-08T07:06:55.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.284 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.285 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17713 4.11 4:8963efe6:::10000000004.00000009:head [write 3706880~4096 in=4096b,write 3715072~4096 in=4096b,write 3735552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:55.285 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.991150+0000", 2023-10-08T07:06:55.285 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.1704902019999999, 2023-10-08T07:06:55.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015020947999999999, 2023-10-08T07:06:55.285 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.285 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.286 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.286 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.286 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.286 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17713 2023-10-08T07:06:55.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.286 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991150+0000", 2023-10-08T07:06:55.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991150+0000", 2023-10-08T07:06:55.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991150+0000", 2023-10-08T07:06:55.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:55.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991171+0000", 2023-10-08T07:06:55.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0438999999999999e-05 2023-10-08T07:06:55.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991180+0000", 2023-10-08T07:06:55.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6120000000000005e-06 2023-10-08T07:06:55.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991186+0000", 2023-10-08T07:06:55.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3020000000000002e-06 2023-10-08T07:06:55.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991237+0000", 2023-10-08T07:06:55.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0837000000000001e-05 2023-10-08T07:06:55.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991330+0000", 2023-10-08T07:06:55.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3666999999999996e-05 2023-10-08T07:06:55.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:55.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991476+0000", 2023-10-08T07:06:55.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014565199999999999 2023-10-08T07:06:55.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:55.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993481+0000", 2023-10-08T07:06:55.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020056700000000002 2023-10-08T07:06:55.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006073+0000", 2023-10-08T07:06:55.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012591791999999999 2023-10-08T07:06:55.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006127+0000", 2023-10-08T07:06:55.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3489000000000002e-05 2023-10-08T07:06:55.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006171+0000", 2023-10-08T07:06:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3829999999999999e-05 2023-10-08T07:06:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17714 4.0 4:02bf98b6:::10000000004.0000000e:head [write 1867776~4096 in=4096b,write 1970176~4096 in=4096b,write 1986560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.991509+0000", 2023-10-08T07:06:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.1701308479999999, 2023-10-08T07:06:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015265767, 2023-10-08T07:06:55.292 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.293 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.293 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17714 2023-10-08T07:06:55.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.293 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991509+0000", 2023-10-08T07:06:55.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991509+0000", 2023-10-08T07:06:55.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991510+0000", 2023-10-08T07:06:55.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7499999999999999e-07 2023-10-08T07:06:55.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991521+0000", 2023-10-08T07:06:55.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1416e-05 2023-10-08T07:06:55.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991532+0000", 2023-10-08T07:06:55.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0387000000000001e-05 2023-10-08T07:06:55.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991539+0000", 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6960000000000005e-06 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991612+0000", 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3127000000000006e-05 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991710+0000", 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7706000000000003e-05 2023-10-08T07:06:55.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:55.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991863+0000", 2023-10-08T07:06:55.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000152578 2023-10-08T07:06:55.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:55.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.993571+0000", 2023-10-08T07:06:55.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001708102 2023-10-08T07:06:55.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006693+0000", 2023-10-08T07:06:55.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013122399 2023-10-08T07:06:55.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006741+0000", 2023-10-08T07:06:55.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735000000000003e-05 2023-10-08T07:06:55.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006775+0000", 2023-10-08T07:06:55.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3846000000000001e-05 2023-10-08T07:06:55.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.299 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.299 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17715 4.7 4:e2479c46:::10000000004.00000024:head [write 8192~4096 in=4096b,write 69632~4096 in=4096b,write 147456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:55.299 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.991809+0000", 2023-10-08T07:06:55.299 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.1698310599999999, 2023-10-08T07:06:55.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014868004000000001, 2023-10-08T07:06:55.300 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:55.300 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:55.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:55.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.300 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17715 2023-10-08T07:06:55.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.300 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:55.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:55.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991809+0000", 2023-10-08T07:06:55.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:55.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991809+0000", 2023-10-08T07:06:55.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:55.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:55.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991810+0000", 2023-10-08T07:06:55.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9999999999999996e-07 2023-10-08T07:06:55.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:55.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991831+0000", 2023-10-08T07:06:55.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1277e-05 2023-10-08T07:06:55.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:55.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991839+0000", 2023-10-08T07:06:55.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4079999999999998e-06 2023-10-08T07:06:55.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991849+0000", 2023-10-08T07:06:55.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3729999999999999e-06 2023-10-08T07:06:55.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:55.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.991932+0000", 2023-10-08T07:06:55.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2911000000000006e-05 2023-10-08T07:06:55.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:55.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.992008+0000", 2023-10-08T07:06:55.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6598000000000001e-05 2023-10-08T07:06:55.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:55.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006538+0000", 2023-10-08T07:06:55.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014530207999999999 2023-10-08T07:06:55.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:55.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006597+0000", 2023-10-08T07:06:55.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8257000000000001e-05 2023-10-08T07:06:55.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:55.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:55.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:55.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006677+0000", 2023-10-08T07:06:55.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0072000000000002e-05 2023-10-08T07:06:55.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.305 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:55.305 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:55.305 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:55.307 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:55.305+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:55.307 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:55.408 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:55.407+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:55.488 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:55.488 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:55.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.488 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:26809 4.20 4:05b3915c:::10000000004.00000016:head [write 2150400~4096 in=4096b,write 2166784~4096 in=4096b,write 2260992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:55.488 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:55.484557+0000", 2023-10-08T07:06:55.488 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0035245810000000002, 2023-10-08T07:06:55.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0035477579999999998, 2023-10-08T07:06:55.489 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:55.489 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:55.489 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:55.489 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:55.489 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.489 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 26809 2023-10-08T07:06:55.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.489 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:55.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:55.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.484557+0000", 2023-10-08T07:06:55.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:55.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:55.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.484557+0000", 2023-10-08T07:06:55.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:55.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:55.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.484558+0000", 2023-10-08T07:06:55.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.78e-07 2023-10-08T07:06:55.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:55.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.484627+0000", 2023-10-08T07:06:55.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8375999999999997e-05 2023-10-08T07:06:55.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:55.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.484639+0000", 2023-10-08T07:06:55.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1826e-05 2023-10-08T07:06:55.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.484647+0000", 2023-10-08T07:06:55.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4239999999999993e-06 2023-10-08T07:06:55.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:55.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.484721+0000", 2023-10-08T07:06:55.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4146000000000005e-05 2023-10-08T07:06:55.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:55.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.484797+0000", 2023-10-08T07:06:55.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6130999999999993e-05 2023-10-08T07:06:55.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:55.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.484891+0000", 2023-10-08T07:06:55.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3733000000000005e-05 2023-10-08T07:06:55.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:55.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.487044+0000", 2023-10-08T07:06:55.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0021531720000000001 2023-10-08T07:06:55.494 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.495 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:55.495 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.495 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.495 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:06:55.495 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 1 2023-10-08T07:06:55.495 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:55.502 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:55.506 INFO:teuthology.orchestra.run.smithi017.stdout:moved 0 / 210 (0%) 2023-10-08T07:06:55.507 INFO:teuthology.orchestra.run.smithi017.stdout:avg 105 2023-10-08T07:06:55.507 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 33.5037 -> 33.5037 (expected baseline 7.24569) 2023-10-08T07:06:55.507 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.0 with 71 -> 71 pgs (0.67619 -> 0.67619 * mean) 2023-10-08T07:06:55.507 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.2 with 72 -> 72 pgs (0.685714 -> 0.685714 * mean) 2023-10-08T07:06:55.507 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:06:55.507 INFO:teuthology.orchestra.run.smithi017.stdout:oload 1000 2023-10-08T07:06:55.507 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 1 2023-10-08T07:06:55.507 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2023-10-08T07:06:55.507 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0016 2023-10-08T07:06:55.507 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0164 2023-10-08T07:06:55.508 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:55.507+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:55.510 INFO:teuthology.orchestra.run.smithi017.stderr:no change 2023-10-08T07:06:55.523 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2023-10-08T07:06:55.523 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2023-10-08T07:06:55.609 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:55.608+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:55.710 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:55.709+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:55.717 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:55.717 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:06:55.717 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:06:55.717 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:06:55.717 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:55.729 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:55.811 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:55.809+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:55.911 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:55.910+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:55.955 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:55.955 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:06:55.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:06:55.955 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:55.955 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.955 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:55.956 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:55.956 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 82.635111706999993, 2023-10-08T07:06:55.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016151867, 2023-10-08T07:06:55.956 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:55.956 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.956 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:55.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.956 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:55.956 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:55.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:55.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:55.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317609+0000", 2023-10-08T07:06:55.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:55.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:55.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317610+0000", 2023-10-08T07:06:55.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.252e-06 2023-10-08T07:06:55.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:55.958 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317617+0000", 2023-10-08T07:06:55.958 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:06:55.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:55.958 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317635+0000", 2023-10-08T07:06:55.958 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:06:55.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.959 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317646+0000", 2023-10-08T07:06:55.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0267e-05 2023-10-08T07:06:55.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.959 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.959 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:55.959 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317731+0000", 2023-10-08T07:06:55.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5425000000000003e-05 2023-10-08T07:06:55.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.959 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.960 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting_for_map not empty", 2023-10-08T07:06:55.960 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317736+0000", 2023-10-08T07:06:55.960 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1970000000000004e-06 2023-10-08T07:06:55.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.960 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:55.960 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.328345+0000", 2023-10-08T07:06:55.960 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010608482000000001 2023-10-08T07:06:55.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.960 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:55.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329100+0000", 2023-10-08T07:06:55.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00075525799999999997 2023-10-08T07:06:55.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:55.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329266+0000", 2023-10-08T07:06:55.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016657400000000001 2023-10-08T07:06:55.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:55.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332692+0000", 2023-10-08T07:06:55.962 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003425417 2023-10-08T07:06:55.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:55.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333691+0000", 2023-10-08T07:06:55.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099943600000000003 2023-10-08T07:06:55.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:55.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333733+0000", 2023-10-08T07:06:55.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2119000000000001e-05 2023-10-08T07:06:55.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:55.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.333761+0000", 2023-10-08T07:06:55.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7236000000000001e-05 2023-10-08T07:06:55.964 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.964 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:55.964 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.964 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:55.964 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:55.964 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 82.635059182000006, 2023-10-08T07:06:55.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:06:55.964 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:55.964 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:55.966 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:06:55.966 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:06:55.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.966 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.966 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:55.966 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:06:55.966 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:06:55.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.966 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.966 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:55.966 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:06:55.967 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:06:55.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.967 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.967 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.967 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:06:55.967 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:06:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:06:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:06:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:06:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:06:55.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.972 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:55.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:06:55.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:06:55.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.972 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:55.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:06:55.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:06:55.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:55.973 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:06:55.973 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:06:55.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:55.974 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:06:55.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:06:55.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.974 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.974 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:55.974 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:06:55.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:06:55.974 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.974 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:55.974 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.974 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.975 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:22 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:55.975 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:55.975 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 82.634067396999995, 2023-10-08T07:06:55.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015941829000000001, 2023-10-08T07:06:55.975 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:55.975 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.975 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:55.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.975 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:55.975 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:55.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:55.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:55.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318653+0000", 2023-10-08T07:06:55.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:55.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:55.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318654+0000", 2023-10-08T07:06:55.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7100000000000011e-07 2023-10-08T07:06:55.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:55.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318670+0000", 2023-10-08T07:06:55.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5455999999999999e-05 2023-10-08T07:06:55.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:55.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318680+0000", 2023-10-08T07:06:55.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0264e-05 2023-10-08T07:06:55.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318689+0000", 2023-10-08T07:06:55.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:06:55.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:55.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330908+0000", 2023-10-08T07:06:55.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012219816 2023-10-08T07:06:55.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.330986+0000", 2023-10-08T07:06:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7916000000000004e-05 2023-10-08T07:06:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331064+0000", 2023-10-08T07:06:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7175000000000006e-05 2023-10-08T07:06:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332871+0000", 2023-10-08T07:06:55.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018071789999999999 2023-10-08T07:06:55.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.980 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.980 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:55.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334519+0000", 2023-10-08T07:06:55.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016481639999999999 2023-10-08T07:06:55.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.982 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.982 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:55.982 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334559+0000", 2023-10-08T07:06:55.982 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0071000000000003e-05 2023-10-08T07:06:55.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.983 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:55.983 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334595+0000", 2023-10-08T07:06:55.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:06:55.983 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.983 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:55.983 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.983 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:24 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:55.984 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:55.984 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 82.634014127, 2023-10-08T07:06:55.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01602493, 2023-10-08T07:06:55.984 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:55.984 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.984 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:55.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.984 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:55.984 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:55.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:55.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.985 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:55.985 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318706+0000", 2023-10-08T07:06:55.985 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:55.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.985 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:55.985 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318707+0000", 2023-10-08T07:06:55.985 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:06:55.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318712+0000", 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4320000000000001e-06 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318721+0000", 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5929999999999995e-06 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318730+0000", 2023-10-08T07:06:55.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7169999999999997e-06 2023-10-08T07:06:55.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.987 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.987 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:55.987 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331269+0000", 2023-10-08T07:06:55.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012538821 2023-10-08T07:06:55.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.987 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.987 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:55.987 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331354+0000", 2023-10-08T07:06:55.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5470999999999995e-05 2023-10-08T07:06:55.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:55.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331503+0000", 2023-10-08T07:06:55.988 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149092 2023-10-08T07:06:55.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:55.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332903+0000", 2023-10-08T07:06:55.988 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001399502 2023-10-08T07:06:55.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:55.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334643+0000", 2023-10-08T07:06:55.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001739993 2023-10-08T07:06:55.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:55.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334699+0000", 2023-10-08T07:06:55.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6289000000000003e-05 2023-10-08T07:06:55.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:55.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334731+0000", 2023-10-08T07:06:55.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2295999999999997e-05 2023-10-08T07:06:55.990 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.990 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:55.990 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.990 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:25 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:06:55.990 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:55.990 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 82.633978280999997, 2023-10-08T07:06:55.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016081303000000002, 2023-10-08T07:06:55.990 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:55.990 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.991 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:55.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:55.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:55.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:55.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:55.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318742+0000", 2023-10-08T07:06:55.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:55.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.992 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:55.992 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318743+0000", 2023-10-08T07:06:55.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:06:55.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.992 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:55.992 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318748+0000", 2023-10-08T07:06:55.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4160000000000003e-06 2023-10-08T07:06:55.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.992 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318758+0000", 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8500000000000006e-06 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.318766+0000", 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.055e-06 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331693+0000", 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012926995 2023-10-08T07:06:55.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331741+0000", 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7856999999999999e-05 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.331814+0000", 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2903000000000003e-05 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:55.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332925+0000", 2023-10-08T07:06:55.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011116500000000001 2023-10-08T07:06:55.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:55.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334764+0000", 2023-10-08T07:06:55.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018385229999999999 2023-10-08T07:06:55.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.997 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:55.997 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334803+0000", 2023-10-08T07:06:55.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8719e-05 2023-10-08T07:06:55.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.997 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:55.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334824+0000", 2023-10-08T07:06:55.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0797000000000001e-05 2023-10-08T07:06:55.998 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.998 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:55.998 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:55.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.998 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.998 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:26 4.c 4:3352c333:::10000000004.00000012:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:55.998 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:55.998 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.953312155000001, 2023-10-08T07:06:55.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015456749000000001, 2023-10-08T07:06:55.999 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:55.999 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:55.999 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:55.999 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:55.999 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:55.999 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 26 2023-10-08T07:06:55.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:55.999 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:55.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:55.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:55.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:56.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999408+0000", 2023-10-08T07:06:56.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:40.999409+0000", 2023-10-08T07:06:56.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1570000000000001e-06 2023-10-08T07:06:56.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003237+0000", 2023-10-08T07:06:56.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003827619 2023-10-08T07:06:56.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003252+0000", 2023-10-08T07:06:56.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5068999999999999e-05 2023-10-08T07:06:56.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.002 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003259+0000", 2023-10-08T07:06:56.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1910000000000003e-06 2023-10-08T07:06:56.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.002 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003330+0000", 2023-10-08T07:06:56.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0469999999999994e-05 2023-10-08T07:06:56.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.002 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003504+0000", 2023-10-08T07:06:56.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017425700000000001 2023-10-08T07:06:56.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:56.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.003675+0000", 2023-10-08T07:06:56.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000171137 2023-10-08T07:06:56.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.010247+0000", 2023-10-08T07:06:56.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065716569999999998 2023-10-08T07:06:56.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:56.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014747+0000", 2023-10-08T07:06:56.005 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045002740000000003 2023-10-08T07:06:56.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.006 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.006 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014820+0000", 2023-10-08T07:06:56.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3310000000000001e-05 2023-10-08T07:06:56.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.007 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.007 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.014865+0000", 2023-10-08T07:06:56.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4607999999999997e-05 2023-10-08T07:06:56.007 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.008 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.008 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.008 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:28 4.30 4:0f322a22:::10000000004.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:56.008 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:56.008 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.781356130000001, 2023-10-08T07:06:56.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015624149, 2023-10-08T07:06:56.008 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.008 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.008 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 28 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171364+0000", 2023-10-08T07:06:56.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.171372+0000", 2023-10-08T07:06:56.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8220000000000007e-06 2023-10-08T07:06:56.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175253+0000", 2023-10-08T07:06:56.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038812529999999999 2023-10-08T07:06:56.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175268+0000", 2023-10-08T07:06:56.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4782e-05 2023-10-08T07:06:56.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175275+0000", 2023-10-08T07:06:56.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0899999999999999e-06 2023-10-08T07:06:56.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.012 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.012 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175345+0000", 2023-10-08T07:06:56.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9604000000000006e-05 2023-10-08T07:06:56.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.012 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.012 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175502+0000", 2023-10-08T07:06:56.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015699799999999999 2023-10-08T07:06:56.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:56.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.175652+0000", 2023-10-08T07:06:56.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014977100000000001 2023-10-08T07:06:56.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.182743+0000", 2023-10-08T07:06:56.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070913800000000004 2023-10-08T07:06:56.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:56.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186876+0000", 2023-10-08T07:06:56.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041328670000000001 2023-10-08T07:06:56.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186941+0000", 2023-10-08T07:06:56.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5506999999999995e-05 2023-10-08T07:06:56.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.186989+0000", 2023-10-08T07:06:56.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7074999999999999e-05 2023-10-08T07:06:56.015 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.015 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.015 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.015 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:35 4.a 4:524fba76:::10000000004.0000001b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-10-08T07:06:56.015 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:56.015 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.129551608, 2023-10-08T07:06:56.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016047682000000001, 2023-10-08T07:06:56.015 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.015 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.016 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.016 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.016 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.016 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 35 2023-10-08T07:06:56.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.016 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:56.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823169+0000", 2023-10-08T07:06:56.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.823216+0000", 2023-10-08T07:06:56.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7559999999999999e-05 2023-10-08T07:06:56.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827333+0000", 2023-10-08T07:06:56.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0041169290000000001 2023-10-08T07:06:56.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827352+0000", 2023-10-08T07:06:56.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9026e-05 2023-10-08T07:06:56.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827361+0000", 2023-10-08T07:06:56.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6999999999999997e-06 2023-10-08T07:06:56.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827414+0000", 2023-10-08T07:06:56.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3122999999999999e-05 2023-10-08T07:06:56.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827530+0000", 2023-10-08T07:06:56.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000115618 2023-10-08T07:06:56.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:56.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.827626+0000", 2023-10-08T07:06:56.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5997999999999998e-05 2023-10-08T07:06:56.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.834016+0000", 2023-10-08T07:06:56.021 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.006390298 2023-10-08T07:06:56.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:56.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839139+0000", 2023-10-08T07:06:56.021 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0051226370000000002 2023-10-08T07:06:56.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839180+0000", 2023-10-08T07:06:56.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0905999999999998e-05 2023-10-08T07:06:56.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.022 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.022 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:41.839217+0000", 2023-10-08T07:06:56.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6887000000000001e-05 2023-10-08T07:06:56.022 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.022 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.023 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.023 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:42 4.38 4:1e0977c7:::10000000004.00000022:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-10-08T07:06:56.023 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:56.023 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.478346631999999, 2023-10-08T07:06:56.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015514448, 2023-10-08T07:06:56.023 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.023 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.023 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.023 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.023 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.024 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 42 2023-10-08T07:06:56.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.024 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:56.024 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474374+0000", 2023-10-08T07:06:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.474376+0000", 2023-10-08T07:06:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1150000000000001e-06 2023-10-08T07:06:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478104+0000", 2023-10-08T07:06:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003728514 2023-10-08T07:06:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478129+0000", 2023-10-08T07:06:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4655999999999999e-05 2023-10-08T07:06:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478140+0000", 2023-10-08T07:06:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1012000000000001e-05 2023-10-08T07:06:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478221+0000", 2023-10-08T07:06:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1099000000000004e-05 2023-10-08T07:06:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478343+0000", 2023-10-08T07:06:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012129 2023-10-08T07:06:56.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:56.028 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.478444+0000", 2023-10-08T07:06:56.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000101587 2023-10-08T07:06:56.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.028 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.485040+0000", 2023-10-08T07:06:56.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065962260000000002 2023-10-08T07:06:56.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:56.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489774+0000", 2023-10-08T07:06:56.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047335889999999999 2023-10-08T07:06:56.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489841+0000", 2023-10-08T07:06:56.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7232999999999998e-05 2023-10-08T07:06:56.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:42.489888+0000", 2023-10-08T07:06:56.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7126999999999998e-05 2023-10-08T07:06:56.030 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.030 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.030 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.030 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1379 4.e 4:70352312:::10000000004.0000001a:head [write 3547136~4096,write 3588096~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:56.030 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:56.030 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.133235054, 2023-10-08T07:06:56.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016369865000000001, 2023-10-08T07:06:56.030 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.030 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.030 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.031 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.031 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.031 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1379 2023-10-08T07:06:56.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.031 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.031 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.031 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:56.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.032 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.032 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:06:56.032 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.032 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.032 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819486+0000", 2023-10-08T07:06:56.032 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:06:56.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.032 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.032 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819560+0000", 2023-10-08T07:06:56.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4473000000000003e-05 2023-10-08T07:06:56.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819571+0000", 2023-10-08T07:06:56.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0769e-05 2023-10-08T07:06:56.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819576+0000", 2023-10-08T07:06:56.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5410000000000002e-06 2023-10-08T07:06:56.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.034 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.821667+0000", 2023-10-08T07:06:56.034 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020909069999999999 2023-10-08T07:06:56.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.034 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.821747+0000", 2023-10-08T07:06:56.034 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0260999999999996e-05 2023-10-08T07:06:56.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.034 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835701+0000", 2023-10-08T07:06:56.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013954148 2023-10-08T07:06:56.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835762+0000", 2023-10-08T07:06:56.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.084e-05 2023-10-08T07:06:56.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835855+0000", 2023-10-08T07:06:56.036 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3425999999999996e-05 2023-10-08T07:06:56.036 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.036 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.036 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.036 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2064 4.32 4:4efc9492:::10000000004.00000032:head [write 110592~4096,write 249856~4096,write 270336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:56.036 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:56.039 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.8948895280000002, 2023-10-08T07:06:56.040 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019126292, 2023-10-08T07:06:56.040 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.040 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.040 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.041 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.041 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2064 2023-10-08T07:06:56.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.041 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.041 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.041 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.041 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:56.041 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.041 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:06:56.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057832+0000", 2023-10-08T07:06:56.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3699999999999999e-07 2023-10-08T07:06:56.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057886+0000", 2023-10-08T07:06:56.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4531999999999999e-05 2023-10-08T07:06:56.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057901+0000", 2023-10-08T07:06:56.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4518999999999999e-05 2023-10-08T07:06:56.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057910+0000", 2023-10-08T07:06:56.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4579999999999999e-06 2023-10-08T07:06:56.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057963+0000", 2023-10-08T07:06:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3161000000000001e-05 2023-10-08T07:06:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.058023+0000", 2023-10-08T07:06:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0027e-05 2023-10-08T07:06:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076814+0000", 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018790187 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076879+0000", 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4999999999999994e-05 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076957+0000", 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8571000000000004e-05 2023-10-08T07:06:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2068 4.1a 4:5a59f83a:::10000000004.00000002:head [write 1794048~4096,write 1806336~4096,write 1937408~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.8937131180000009, 2023-10-08T07:06:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017795372, 2023-10-08T07:06:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2068 2023-10-08T07:06:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:06:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059008+0000", 2023-10-08T07:06:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1299999999999998e-07 2023-10-08T07:06:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059061+0000", 2023-10-08T07:06:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2905000000000003e-05 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059077+0000", 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6099e-05 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059088+0000", 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1056000000000001e-05 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059146+0000", 2023-10-08T07:06:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7385e-05 2023-10-08T07:06:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059210+0000", 2023-10-08T07:06:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4509000000000002e-05 2023-10-08T07:06:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059307+0000", 2023-10-08T07:06:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6273000000000005e-05 2023-10-08T07:06:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.060916+0000", 2023-10-08T07:06:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001609365 2023-10-08T07:06:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076698+0000", 2023-10-08T07:06:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015781951999999998 2023-10-08T07:06:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076762+0000", 2023-10-08T07:06:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3744999999999994e-05 2023-10-08T07:06:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076803+0000", 2023-10-08T07:06:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1170000000000001e-05 2023-10-08T07:06:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2087 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1101824~12288,write 1150976~4096,write 1171456~4096,write 1265664~4096,write 1376256~4096,write 1519616~4096,write 1691648~4096,write 1724416~4096,write 1753088~4096,write 1794048~4096,write 1908736~4096,write 1921024~4096,write 2011136~4096,write 2207744~4096,write 2285568~4096,write 2744320~8192,write 2760704~4096,write 2879488~4096,write 2891776~4096,write 3129344~4096,write 3145728~4096,write 3215360~4096,write 3330048~8192,write 3362816~4096,write 3387392~4096,write 3485696~4096,write 3620864~4096,write 4120576~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.8887426689999991, 2023-10-08T07:06:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016557490000000001, 2023-10-08T07:06:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2087 2023-10-08T07:06:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064123+0000", 2023-10-08T07:06:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014467700000000001 2023-10-08T07:06:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064131+0000", 2023-10-08T07:06:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9230000000000002e-06 2023-10-08T07:06:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064139+0000", 2023-10-08T07:06:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5560000000000002e-06 2023-10-08T07:06:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.073553+0000", 2023-10-08T07:06:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0094146679999999993 2023-10-08T07:06:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.073655+0000", 2023-10-08T07:06:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010128000000000001 2023-10-08T07:06:56.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.058 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:56.058 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.074076+0000", 2023-10-08T07:06:56.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00042132399999999999 2023-10-08T07:06:56.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.058 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.058 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.077289+0000", 2023-10-08T07:06:56.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032133589999999998 2023-10-08T07:06:56.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:56.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080463+0000", 2023-10-08T07:06:56.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031740940000000001 2023-10-08T07:06:56.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080512+0000", 2023-10-08T07:06:56.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8343000000000001e-05 2023-10-08T07:06:56.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.060 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.060 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080535+0000", 2023-10-08T07:06:56.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3586000000000001e-05 2023-10-08T07:06:56.060 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.060 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.060 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.060 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2088 4.2a 4:5404a18c:::10000000004.00000025:head [write 774144~4096,write 811008~4096,write 884736~4096,write 909312~4096,write 958464~4096,write 1028096~4096,write 1191936~4096,write 1224704~4096,write 1261568~4096,write 1294336~4096,write 1331200~4096,write 1523712~4096,write 1540096~4096,write 1572864~4096,write 1667072~4096,write 1810432~4096,write 1818624~4096,write 1859584~4096,write 1892352~4096,write 1916928~4096,write 2084864~4096,write 2158592~4096,write 2494464~4096,write 2543616~4096,write 2703360~4096,write 2748416~8192,write 2777088~4096,write 3784704~4096,write 3911680~4096,write 4120576~4096,write 4145152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:06:56.060 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:56.060 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.8885585710000008, 2023-10-08T07:06:56.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017312658000000002, 2023-10-08T07:06:56.061 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.061 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.061 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.061 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.061 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.061 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2088 2023-10-08T07:06:56.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.061 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:56.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:06:56.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064163+0000", 2023-10-08T07:06:56.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:06:56.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064375+0000", 2023-10-08T07:06:56.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00021216599999999999 2023-10-08T07:06:56.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064385+0000", 2023-10-08T07:06:56.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0525e-05 2023-10-08T07:06:56.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064395+0000", 2023-10-08T07:06:56.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1689999999999998e-06 2023-10-08T07:06:56.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.064 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076644+0000", 2023-10-08T07:06:56.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012248991000000001 2023-10-08T07:06:56.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.064 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076709+0000", 2023-10-08T07:06:56.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5708000000000002e-05 2023-10-08T07:06:56.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081362+0000", 2023-10-08T07:06:56.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0046527449999999998 2023-10-08T07:06:56.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081425+0000", 2023-10-08T07:06:56.067 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3250000000000006e-05 2023-10-08T07:06:56.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.067 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.067 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.067 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081475+0000", 2023-10-08T07:06:56.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9246999999999998e-05 2023-10-08T07:06:56.068 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.068 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.068 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.068 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:14150 4.30 4:0f322a22:::10000000004.00000014:head [write 409600~4096,write 679936~4096,write 724992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:56.068 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:06:56.068 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2781669259999999, 2023-10-08T07:06:56.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018347558999999999, 2023-10-08T07:06:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 14150 2023-10-08T07:06:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:06:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:06:56.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:06:56.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1200000000000002e-07 2023-10-08T07:06:56.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674566+0000", 2023-10-08T07:06:56.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1438e-05 2023-10-08T07:06:56.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674576+0000", 2023-10-08T07:06:56.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0259e-05 2023-10-08T07:06:56.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.072 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.072 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674590+0000", 2023-10-08T07:06:56.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.375e-05 2023-10-08T07:06:56.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.072 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.072 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674644+0000", 2023-10-08T07:06:56.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3878000000000002e-05 2023-10-08T07:06:56.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.072 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.073 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674755+0000", 2023-10-08T07:06:56.073 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011113 2023-10-08T07:06:56.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.073 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.073 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:56.074 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674931+0000", 2023-10-08T07:06:56.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000176587 2023-10-08T07:06:56.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.074 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.074 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.074 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.676318+0000", 2023-10-08T07:06:56.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0013863040000000001 2023-10-08T07:06:56.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:56.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.692819+0000", 2023-10-08T07:06:56.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016501722999999999 2023-10-08T07:06:56.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.692876+0000", 2023-10-08T07:06:56.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7005000000000001e-05 2023-10-08T07:06:56.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.692901+0000", 2023-10-08T07:06:56.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4672999999999999e-05 2023-10-08T07:06:56.076 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.076 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.076 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.076 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:14642 4.20 4:04004f2c:::10000000004.0000000d:head [write 1359872~4096,write 1409024~4096,write 1449984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:56.076 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:06:56.077 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.1002007149999997, 2023-10-08T07:06:56.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016449921999999999, 2023-10-08T07:06:56.077 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.077 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.077 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.077 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.077 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.077 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 14642 2023-10-08T07:06:56.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.077 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:06:56.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:06:56.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:06:56.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9999999999999997e-07 2023-10-08T07:06:56.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852556+0000", 2023-10-08T07:06:56.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5413999999999997e-05 2023-10-08T07:06:56.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852570+0000", 2023-10-08T07:06:56.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3735e-05 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852577+0000", 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1879999999999996e-06 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852632+0000", 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4753999999999998e-05 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.080 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.081 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852719+0000", 2023-10-08T07:06:56.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7699000000000002e-05 2023-10-08T07:06:56.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.081 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:56.081 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852863+0000", 2023-10-08T07:06:56.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000143852 2023-10-08T07:06:56.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.081 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.081 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.857758+0000", 2023-10-08T07:06:56.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048950629999999998 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.868863+0000", 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011104563 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.868928+0000", 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5610000000000004e-05 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.868970+0000", 2023-10-08T07:06:56.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1344000000000003e-05 2023-10-08T07:06:56.083 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.083 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.083 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.083 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:15687 4.c 4:3352c333:::10000000004.00000012:head [write 794624~4096,write 925696~4096,write 933888~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:56.083 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:51.262061+0000", 2023-10-08T07:06:56.084 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.6906595509999995, 2023-10-08T07:06:56.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016886580000000002, 2023-10-08T07:06:56.084 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.084 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.084 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.084 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.084 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.084 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 15687 2023-10-08T07:06:56.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.084 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262061+0000", 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262061+0000", 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262062+0000", 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9000000000000005e-07 2023-10-08T07:06:56.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262078+0000", 2023-10-08T07:06:56.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6322999999999999e-05 2023-10-08T07:06:56.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262091+0000", 2023-10-08T07:06:56.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2323999999999999e-05 2023-10-08T07:06:56.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.087 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262106+0000", 2023-10-08T07:06:56.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5245999999999999e-05 2023-10-08T07:06:56.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.088 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.088 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.265173+0000", 2023-10-08T07:06:56.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003067148 2023-10-08T07:06:56.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.088 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.088 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.265267+0000", 2023-10-08T07:06:56.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3949000000000005e-05 2023-10-08T07:06:56.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.089 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:56.089 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.265420+0000", 2023-10-08T07:06:56.089 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015336500000000001 2023-10-08T07:06:56.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.089 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:56.089 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.270637+0000", 2023-10-08T07:06:56.089 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052167990000000003 2023-10-08T07:06:56.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.278841+0000", 2023-10-08T07:06:56.090 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0082038530000000005 2023-10-08T07:06:56.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.090 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.278903+0000", 2023-10-08T07:06:56.090 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1673000000000004e-05 2023-10-08T07:06:56.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.090 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.278948+0000", 2023-10-08T07:06:56.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4910000000000002e-05 2023-10-08T07:06:56.091 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.091 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.091 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.091 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:26065 4.2c 4:352c144c:::10000000004.00000003:head [write 2613248~4096,write 2633728~4096,write 2703360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:56.091 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:55.161166+0000", 2023-10-08T07:06:56.091 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.79155424900000004, 2023-10-08T07:06:56.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017045265, 2023-10-08T07:06:56.091 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.091 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 26065 2023-10-08T07:06:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161166+0000", 2023-10-08T07:06:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161166+0000", 2023-10-08T07:06:56.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161167+0000", 2023-10-08T07:06:56.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8000000000000005e-07 2023-10-08T07:06:56.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161177+0000", 2023-10-08T07:06:56.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7399999999999999e-06 2023-10-08T07:06:56.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161199+0000", 2023-10-08T07:06:56.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2013000000000001e-05 2023-10-08T07:06:56.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161206+0000", 2023-10-08T07:06:56.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.956e-06 2023-10-08T07:06:56.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161246+0000", 2023-10-08T07:06:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0259000000000002e-05 2023-10-08T07:06:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161325+0000", 2023-10-08T07:06:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9190000000000006e-05 2023-10-08T07:06:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161448+0000", 2023-10-08T07:06:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012301599999999999 2023-10-08T07:06:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.175430+0000", 2023-10-08T07:06:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013981675000000001 2023-10-08T07:06:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.178084+0000", 2023-10-08T07:06:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0026542890000000002 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.178189+0000", 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000104647 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.178212+0000", 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.27e-05 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.097 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.098 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:26069 4.c 4:31e28161:::10000000004.00000011:head [write 1216512~4096,write 1265664~4096,write 1396736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:56.098 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:55.162591+0000", 2023-10-08T07:06:56.098 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.79012901800000002, 2023-10-08T07:06:56.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015636166, 2023-10-08T07:06:56.098 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.098 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.098 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.098 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.098 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.098 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 26069 2023-10-08T07:06:56.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.099 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.162591+0000", 2023-10-08T07:06:56.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.162591+0000", 2023-10-08T07:06:56.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.100 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.100 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.162592+0000", 2023-10-08T07:06:56.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1999999999999999e-07 2023-10-08T07:06:56.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.100 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.100 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.162602+0000", 2023-10-08T07:06:56.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0128e-05 2023-10-08T07:06:56.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.100 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.162613+0000", 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.08e-05 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.162619+0000", 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6189999999999999e-06 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.162679+0000", 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0677999999999997e-05 2023-10-08T07:06:56.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.162744+0000", 2023-10-08T07:06:56.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4892000000000001e-05 2023-10-08T07:06:56.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:56.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.162855+0000", 2023-10-08T07:06:56.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000110782 2023-10-08T07:06:56.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.175435+0000", 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012580324 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.178132+0000", 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0026964630000000001 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.178202+0000", 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9950999999999995e-05 2023-10-08T07:06:56.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.178228+0000", 2023-10-08T07:06:56.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5809e-05 2023-10-08T07:06:56.104 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.104 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.104 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.104 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:27281 4.20 4:07572838:::10000000004.00000010:head [write 3670016~4096,write 3751936~4096,write 3764224~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:06:56.104 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:55.668942+0000", 2023-10-08T07:06:56.104 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.28377881300000002, 2023-10-08T07:06:56.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015620623, 2023-10-08T07:06:56.105 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:56.105 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:56.105 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:56.105 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:56.105 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.105 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 27281 2023-10-08T07:06:56.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.105 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:56.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:56.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.668942+0000", 2023-10-08T07:06:56.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:56.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.668942+0000", 2023-10-08T07:06:56.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:56.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:56.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.668942+0000", 2023-10-08T07:06:56.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5799999999999999e-07 2023-10-08T07:06:56.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.107 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:56.107 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.668959+0000", 2023-10-08T07:06:56.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6311e-05 2023-10-08T07:06:56.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.107 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:56.107 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.668969+0000", 2023-10-08T07:06:56.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8649999999999996e-06 2023-10-08T07:06:56.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.107 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.108 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.668976+0000", 2023-10-08T07:06:56.108 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4359999999999996e-06 2023-10-08T07:06:56.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.108 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.108 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:56.108 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.669050+0000", 2023-10-08T07:06:56.108 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3916000000000002e-05 2023-10-08T07:06:56.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.108 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.108 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:56.108 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.669141+0000", 2023-10-08T07:06:56.108 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1101999999999996e-05 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.669341+0000", 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019958700000000001 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.675808+0000", 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0064675590000000003 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:56.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.684465+0000", 2023-10-08T07:06:56.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0086571570000000004 2023-10-08T07:06:56.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:06:56.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.684523+0000", 2023-10-08T07:06:56.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7617000000000001e-05 2023-10-08T07:06:56.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:56.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:56.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:06:56.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.684562+0000", 2023-10-08T07:06:56.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9415000000000001e-05 2023-10-08T07:06:56.111 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.111 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.111 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.111 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:56.111 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:56.111 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:56.113 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:56.111+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:56.113 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:56.210 INFO:teuthology.orchestra.run.smithi017.stdout:moved 7 / 210 (3.33333%) 2023-10-08T07:06:56.210 INFO:teuthology.orchestra.run.smithi017.stdout:avg 105 2023-10-08T07:06:56.210 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 33.5037 -> 35.5317 (expected baseline 7.24569) 2023-10-08T07:06:56.210 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.0 with 71 -> 68 pgs (0.67619 -> 0.647619 * mean) 2023-10-08T07:06:56.210 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.2 with 72 -> 71 pgs (0.685714 -> 0.67619 * mean) 2023-10-08T07:06:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:06:56.211 INFO:teuthology.orchestra.run.smithi017.stdout:oload 110 2023-10-08T07:06:56.211 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 0.05 2023-10-08T07:06:56.211 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2023-10-08T07:06:56.211 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0016 2023-10-08T07:06:56.211 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0018 2023-10-08T07:06:56.211 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 weight 1.0000 -> 0.9500 2023-10-08T07:06:56.211 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 weight 1.0000 -> 0.9500 2023-10-08T07:06:56.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2023-10-08T07:06:56.213 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:56.213+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:56.226 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T07:06:56.228 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2023-10-08T07:06:56.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2023-10-08T07:06:56.279 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:56.279 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:56.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.279 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28702 4.31 4.eecd8371 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.279 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.222764+0000", 2023-10-08T07:06:56.279 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.054979654000000003, 2023-10-08T07:06:56.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054995747999999997, 2023-10-08T07:06:56.279 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.279 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2023-10-08T07:06:56.280 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.280 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.280 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.280 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28702 2023-10-08T07:06:56.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.280 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.222764+0000", 2023-10-08T07:06:56.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.222764+0000", 2023-10-08T07:06:56.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.222765+0000", 2023-10-08T07:06:56.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6400000000000001e-07 2023-10-08T07:06:56.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.222785+0000", 2023-10-08T07:06:56.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9332000000000001e-05 2023-10-08T07:06:56.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.222795+0000", 2023-10-08T07:06:56.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0022e-05 2023-10-08T07:06:56.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.222802+0000", 2023-10-08T07:06:56.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7249999999999997e-06 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.222858+0000", 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5272999999999997e-05 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.222867+0000", 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2480000000000002e-06 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.284 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28777 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.284 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.252031+0000", 2023-10-08T07:06:56.284 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.025713573, 2023-10-08T07:06:56.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025773951999999999, 2023-10-08T07:06:56.284 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.284 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2023-10-08T07:06:56.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28777 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.252031+0000", 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.252031+0000", 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.252032+0000", 2023-10-08T07:06:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5999999999999991e-07 2023-10-08T07:06:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.252044+0000", 2023-10-08T07:06:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2294e-05 2023-10-08T07:06:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.252057+0000", 2023-10-08T07:06:56.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2894999999999999e-05 2023-10-08T07:06:56.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.252065+0000", 2023-10-08T07:06:56.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8490000000000006e-06 2023-10-08T07:06:56.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.252107+0000", 2023-10-08T07:06:56.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2741000000000003e-05 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.252112+0000", 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6759999999999998e-06 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28706 4.31 4.eecd8371 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.223993+0000", 2023-10-08T07:06:56.288 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.053751395, 2023-10-08T07:06:56.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.053850164999999998, 2023-10-08T07:06:56.289 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.289 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2023-10-08T07:06:56.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.289 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28706 2023-10-08T07:06:56.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.289 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.223993+0000", 2023-10-08T07:06:56.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.223993+0000", 2023-10-08T07:06:56.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.223994+0000", 2023-10-08T07:06:56.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5300000000000003e-07 2023-10-08T07:06:56.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.224006+0000", 2023-10-08T07:06:56.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2877999999999999e-05 2023-10-08T07:06:56.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.224016+0000", 2023-10-08T07:06:56.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6160000000000008e-06 2023-10-08T07:06:56.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.224024+0000", 2023-10-08T07:06:56.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5229999999999998e-06 2023-10-08T07:06:56.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.224070+0000", 2023-10-08T07:06:56.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6409999999999998e-05 2023-10-08T07:06:56.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:06:56.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.224075+0000", 2023-10-08T07:06:56.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8280000000000002e-06 2023-10-08T07:06:56.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.293 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.293 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28826 4.31 4.eecd8371 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.293 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.272061+0000", 2023-10-08T07:06:56.293 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0056832050000000002, 2023-10-08T07:06:56.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058186760000000001, 2023-10-08T07:06:56.293 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.293 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2023-10-08T07:06:56.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.294 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28826 2023-10-08T07:06:56.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.294 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.272061+0000", 2023-10-08T07:06:56.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.272061+0000", 2023-10-08T07:06:56.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.272062+0000", 2023-10-08T07:06:56.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.75e-07 2023-10-08T07:06:56.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.272071+0000", 2023-10-08T07:06:56.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2070000000000001e-06 2023-10-08T07:06:56.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.272084+0000", 2023-10-08T07:06:56.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3093e-05 2023-10-08T07:06:56.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.272089+0000", 2023-10-08T07:06:56.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1290000000000004e-06 2023-10-08T07:06:56.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.272130+0000", 2023-10-08T07:06:56.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0842e-05 2023-10-08T07:06:56.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:06:56.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.272135+0000", 2023-10-08T07:06:56.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2259999999999996e-06 2023-10-08T07:06:56.298 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.298 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.298 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.298 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28709 4.31 4.eecd8371 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.298 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.225263+0000", 2023-10-08T07:06:56.299 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.052480954000000003, 2023-10-08T07:06:56.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052654174999999998, 2023-10-08T07:06:56.299 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.299 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2023-10-08T07:06:56.299 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.299 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.299 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.299 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28709 2023-10-08T07:06:56.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.299 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.225263+0000", 2023-10-08T07:06:56.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.225263+0000", 2023-10-08T07:06:56.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.225264+0000", 2023-10-08T07:06:56.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3799999999999996e-07 2023-10-08T07:06:56.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.225276+0000", 2023-10-08T07:06:56.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1454000000000001e-05 2023-10-08T07:06:56.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.225296+0000", 2023-10-08T07:06:56.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0615000000000002e-05 2023-10-08T07:06:56.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.225307+0000", 2023-10-08T07:06:56.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.129e-05 2023-10-08T07:06:56.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.225357+0000", 2023-10-08T07:06:56.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9492e-05 2023-10-08T07:06:56.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:06:56.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.225363+0000", 2023-10-08T07:06:56.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9379999999999997e-06 2023-10-08T07:06:56.303 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.303 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.303 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.303 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28713 4.31 4.eecd8371 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.303 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.226970+0000", 2023-10-08T07:06:56.303 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.050774597999999997, 2023-10-08T07:06:56.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050984040000000001, 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28713 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.226970+0000", 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.226970+0000", 2023-10-08T07:06:56.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.226970+0000", 2023-10-08T07:06:56.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9699999999999995e-07 2023-10-08T07:06:56.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.226988+0000", 2023-10-08T07:06:56.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7841000000000001e-05 2023-10-08T07:06:56.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.226997+0000", 2023-10-08T07:06:56.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2180000000000005e-06 2023-10-08T07:06:56.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.227002+0000", 2023-10-08T07:06:56.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1630000000000004e-06 2023-10-08T07:06:56.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.227049+0000", 2023-10-08T07:06:56.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6885999999999998e-05 2023-10-08T07:06:56.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:06:56.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.227056+0000", 2023-10-08T07:06:56.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.109e-06 2023-10-08T07:06:56.307 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.307 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.308 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.308 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28716 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.308 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.228031+0000", 2023-10-08T07:06:56.308 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.049712669000000001, 2023-10-08T07:06:56.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049958518, 2023-10-08T07:06:56.308 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.308 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2023-10-08T07:06:56.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28716 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.228031+0000", 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.228031+0000", 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.228032+0000", 2023-10-08T07:06:56.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5799999999999999e-07 2023-10-08T07:06:56.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.228038+0000", 2023-10-08T07:06:56.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.28e-06 2023-10-08T07:06:56.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.228045+0000", 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6109999999999999e-06 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.228049+0000", 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0840000000000002e-06 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.228088+0000", 2023-10-08T07:06:56.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8853999999999998e-05 2023-10-08T07:06:56.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:06:56.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.228094+0000", 2023-10-08T07:06:56.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9139999999999996e-06 2023-10-08T07:06:56.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.312 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.312 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28832 4.3f 4:fc9a2d79:::10000000004.0000002f:head [write 2850816~4096 in=4096b,write 2887680~4096 in=4096b,write 2912256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.313 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.274930+0000", 2023-10-08T07:06:56.313 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0028140249999999999, 2023-10-08T07:06:56.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031020259999999999, 2023-10-08T07:06:56.313 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.313 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:56.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.313 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28832 2023-10-08T07:06:56.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.313 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.274930+0000", 2023-10-08T07:06:56.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.274930+0000", 2023-10-08T07:06:56.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.274931+0000", 2023-10-08T07:06:56.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8700000000000005e-07 2023-10-08T07:06:56.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.274942+0000", 2023-10-08T07:06:56.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0912e-05 2023-10-08T07:06:56.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.274953+0000", 2023-10-08T07:06:56.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0772e-05 2023-10-08T07:06:56.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.274960+0000", 2023-10-08T07:06:56.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.362e-06 2023-10-08T07:06:56.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.275000+0000", 2023-10-08T07:06:56.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9918e-05 2023-10-08T07:06:56.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:56.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.275053+0000", 2023-10-08T07:06:56.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3032999999999999e-05 2023-10-08T07:06:56.317 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.317 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.317 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.317 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28833 4.16 4:69eefec8:::10000000004.0000003a:head [write 3960832~4096 in=4096b,write 3993600~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.318 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.275469+0000", 2023-10-08T07:06:56.318 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0022751999999999998, 2023-10-08T07:06:56.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026011160000000001, 2023-10-08T07:06:56.318 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.318 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:56.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.318 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28833 2023-10-08T07:06:56.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.318 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.275469+0000", 2023-10-08T07:06:56.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.275469+0000", 2023-10-08T07:06:56.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.275470+0000", 2023-10-08T07:06:56.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9899999999999999e-07 2023-10-08T07:06:56.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.275481+0000", 2023-10-08T07:06:56.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1488000000000001e-05 2023-10-08T07:06:56.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.275491+0000", 2023-10-08T07:06:56.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5119999999999997e-06 2023-10-08T07:06:56.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.275498+0000", 2023-10-08T07:06:56.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4590000000000001e-06 2023-10-08T07:06:56.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.275551+0000", 2023-10-08T07:06:56.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2515000000000001e-05 2023-10-08T07:06:56.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.275656+0000", 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010522900000000001 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.275827+0000", 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017153000000000001 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.322 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28835 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.323 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.276257+0000", 2023-10-08T07:06:56.323 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0014870689999999999, 2023-10-08T07:06:56.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018522269999999999, 2023-10-08T07:06:56.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2023-10-08T07:06:56.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.323 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28835 2023-10-08T07:06:56.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.323 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276257+0000", 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276257+0000", 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276258+0000", 2023-10-08T07:06:56.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9999999999999996e-07 2023-10-08T07:06:56.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276286+0000", 2023-10-08T07:06:56.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8466000000000002e-05 2023-10-08T07:06:56.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276301+0000", 2023-10-08T07:06:56.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4735999999999999e-05 2023-10-08T07:06:56.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276310+0000", 2023-10-08T07:06:56.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7299999999999994e-06 2023-10-08T07:06:56.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276359+0000", 2023-10-08T07:06:56.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9465999999999997e-05 2023-10-08T07:06:56.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:06:56.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276367+0000", 2023-10-08T07:06:56.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4909999999999999e-06 2023-10-08T07:06:56.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.327 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.327 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28836 4.11 4:8963efe6:::10000000004.00000009:head [write 843776~4096 in=4096b,write 856064~4096 in=4096b,write 897024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.327 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.276679+0000", 2023-10-08T07:06:56.327 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001064855, 2023-10-08T07:06:56.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014687039999999999, 2023-10-08T07:06:56.327 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:56.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.328 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28836 2023-10-08T07:06:56.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.328 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276679+0000", 2023-10-08T07:06:56.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276679+0000", 2023-10-08T07:06:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276680+0000", 2023-10-08T07:06:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5400000000000001e-07 2023-10-08T07:06:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276710+0000", 2023-10-08T07:06:56.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0467000000000002e-05 2023-10-08T07:06:56.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276718+0000", 2023-10-08T07:06:56.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2590000000000003e-06 2023-10-08T07:06:56.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276722+0000", 2023-10-08T07:06:56.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3900000000000003e-06 2023-10-08T07:06:56.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276761+0000", 2023-10-08T07:06:56.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8503e-05 2023-10-08T07:06:56.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:56.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276811+0000", 2023-10-08T07:06:56.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0034999999999998e-05 2023-10-08T07:06:56.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:56.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.276908+0000", 2023-10-08T07:06:56.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7192000000000001e-05 2023-10-08T07:06:56.332 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.332 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.332 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.332 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28728 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.332 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.232961+0000", 2023-10-08T07:06:56.332 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.044783614999999999, 2023-10-08T07:06:56.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.045226861, 2023-10-08T07:06:56.333 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.333 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2023-10-08T07:06:56.333 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.333 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.333 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.333 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28728 2023-10-08T07:06:56.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.333 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.232961+0000", 2023-10-08T07:06:56.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.232961+0000", 2023-10-08T07:06:56.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.232961+0000", 2023-10-08T07:06:56.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5900000000000005e-07 2023-10-08T07:06:56.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.232975+0000", 2023-10-08T07:06:56.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3455000000000001e-05 2023-10-08T07:06:56.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.232985+0000", 2023-10-08T07:06:56.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7780000000000002e-06 2023-10-08T07:06:56.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.232991+0000", 2023-10-08T07:06:56.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7059999999999998e-06 2023-10-08T07:06:56.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.233033+0000", 2023-10-08T07:06:56.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1321e-05 2023-10-08T07:06:56.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:06:56.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.233040+0000", 2023-10-08T07:06:56.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.114e-06 2023-10-08T07:06:56.336 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.337 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.337 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.337 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28814 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.337 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.265509+0000", 2023-10-08T07:06:56.337 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012235528000000001, 2023-10-08T07:06:56.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012715162, 2023-10-08T07:06:56.337 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.337 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2023-10-08T07:06:56.337 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.337 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.338 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28814 2023-10-08T07:06:56.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.338 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.265509+0000", 2023-10-08T07:06:56.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.265509+0000", 2023-10-08T07:06:56.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.265509+0000", 2023-10-08T07:06:56.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9400000000000004e-07 2023-10-08T07:06:56.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.265522+0000", 2023-10-08T07:06:56.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2442e-05 2023-10-08T07:06:56.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.265539+0000", 2023-10-08T07:06:56.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6878999999999999e-05 2023-10-08T07:06:56.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.265548+0000", 2023-10-08T07:06:56.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4530000000000008e-06 2023-10-08T07:06:56.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.265605+0000", 2023-10-08T07:06:56.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6915e-05 2023-10-08T07:06:56.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:06:56.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.265613+0000", 2023-10-08T07:06:56.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2700000000000004e-06 2023-10-08T07:06:56.341 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.341 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.341 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.342 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:28771 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:56.342 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.249762+0000", 2023-10-08T07:06:56.342 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.027982502999999999, 2023-10-08T07:06:56.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028497926999999999, 2023-10-08T07:06:56.342 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:56.342 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for peered", 2023-10-08T07:06:56.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:56.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:56.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:56.342 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 28771 2023-10-08T07:06:56.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.343 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:56.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:56.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.249762+0000", 2023-10-08T07:06:56.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:56.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.249762+0000", 2023-10-08T07:06:56.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:56.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.249762+0000", 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.23e-07 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.249775+0000", 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2312e-05 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.249787+0000", 2023-10-08T07:06:56.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2529e-05 2023-10-08T07:06:56.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:56.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.249795+0000", 2023-10-08T07:06:56.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1249999999999993e-06 2023-10-08T07:06:56.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:56.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.249849+0000", 2023-10-08T07:06:56.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4079999999999997e-05 2023-10-08T07:06:56.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:56.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:56.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:06:56.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.249857+0000", 2023-10-08T07:06:56.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6650000000000003e-06 2023-10-08T07:06:56.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.346 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:56.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:56.346 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:06:56.347 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 14 2023-10-08T07:06:56.347 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:56.347 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:06:56.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:56.349 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:56.347+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:56.449 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:56.448+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:56.524 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:56.524 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:56.525 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:56.525 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:56.525 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:56.538 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:56.542 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:56.567 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:06:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:06:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:06:56.570 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:06:56.571 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:06:56.581 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:56.580+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:56.651 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:56.650+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:56.707 INFO:teuthology.orchestra.run.smithi017.stdout:moved 0 / 210 (0%) 2023-10-08T07:06:56.707 INFO:teuthology.orchestra.run.smithi017.stdout:avg 105 2023-10-08T07:06:56.708 INFO:teuthology.orchestra.run.smithi017.stdout:stddev 35.5317 -> 35.5317 (expected baseline 7.24569) 2023-10-08T07:06:56.708 INFO:teuthology.orchestra.run.smithi017.stdout:min osd.0 with 68 -> 68 pgs (0.647619 -> 0.647619 * mean) 2023-10-08T07:06:56.708 INFO:teuthology.orchestra.run.smithi017.stdout:max osd.2 with 71 -> 71 pgs (0.67619 -> 0.67619 * mean) 2023-10-08T07:06:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:06:56.708 INFO:teuthology.orchestra.run.smithi017.stdout:oload 1000 2023-10-08T07:06:56.708 INFO:teuthology.orchestra.run.smithi017.stdout:max_change 1 2023-10-08T07:06:56.708 INFO:teuthology.orchestra.run.smithi017.stdout:max_change_osds 4 2023-10-08T07:06:56.708 INFO:teuthology.orchestra.run.smithi017.stdout:average_utilization 0.0018 2023-10-08T07:06:56.708 INFO:teuthology.orchestra.run.smithi017.stdout:overload_utilization 0.0179 2023-10-08T07:06:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:56.708 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:56.710 INFO:teuthology.orchestra.run.smithi017.stderr:no change 2023-10-08T07:06:56.721 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:56.766 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:56.765+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:56.855 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:56.854+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:56.901 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:56.901 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:56.916 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:56.957 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:56.956+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:57.056 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:57.055+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:57.133 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:57.133 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:57.148 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:57.192 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:57.191+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:57.212 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2023-10-08T07:06:57.258 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:57.257+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:57.336 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:57.336 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:57.349 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:57.391 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:57.390+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:57.460 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:57.459+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:57.527 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:57.527 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:57.542 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:57.583 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:57.582+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:57.662 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:57.661+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:57.763 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:57.763 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:57.763 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:57.762+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:57.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:57.864 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:57.863+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:57.964 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:57.963+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:58.004 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:58.004 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:58.018 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:58.065 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:58.064+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:58.166 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:58.165+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:58.195 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:58.195 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:58.206 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:58.291 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:58.289+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:58.369 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:58.367+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:58.458 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:58.459 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:58.469 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:58.468+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:58.475 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:06:58.569 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:58.569+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:58.572 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:06:58.670 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:58.670+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:58.709 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:06:58.709 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:06:58.724 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:06:58.771 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:58.770+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:58.773 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:06:58.773 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:06:58.773 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:06:58.773 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:06:58.776 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:06:58.777 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:06:58.872 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:58.871+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:58.907 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:35857 4.21 4:867af9ba:::10000000004.0000000a:head [write 3268608~12288 in=12288b,write 3301376~4096 in=4096b,write 3362816~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:06:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.902567+0000", 2023-10-08T07:06:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0040665800000000002, 2023-10-08T07:06:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040976850000000002, 2023-10-08T07:06:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 35857 2023-10-08T07:06:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902567+0000", 2023-10-08T07:06:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902567+0000", 2023-10-08T07:06:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902568+0000", 2023-10-08T07:06:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1999999999999999e-07 2023-10-08T07:06:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902591+0000", 2023-10-08T07:06:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3218999999999999e-05 2023-10-08T07:06:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902606+0000", 2023-10-08T07:06:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5038999999999999e-05 2023-10-08T07:06:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902624+0000", 2023-10-08T07:06:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8502999999999999e-05 2023-10-08T07:06:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902674+0000", 2023-10-08T07:06:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9265999999999999e-05 2023-10-08T07:06:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902768+0000", 2023-10-08T07:06:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4828999999999996e-05 2023-10-08T07:06:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:35850 4.3a e47/17 4:5d52ad5e:::10000000004.00000026:head v 47'1634, mlcod=47'1630)", 2023-10-08T07:06:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.902596+0000", 2023-10-08T07:06:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0040370570000000001, 2023-10-08T07:06:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00415935, 2023-10-08T07:06:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902596+0000", 2023-10-08T07:06:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902596+0000", 2023-10-08T07:06:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902597+0000", 2023-10-08T07:06:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:06:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902612+0000", 2023-10-08T07:06:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5396999999999998e-05 2023-10-08T07:06:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902622+0000", 2023-10-08T07:06:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4849999999999998e-06 2023-10-08T07:06:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902629+0000", 2023-10-08T07:06:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0489999999999998e-06 2023-10-08T07:06:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903029+0000", 2023-10-08T07:06:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000400391 2023-10-08T07:06:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903048+0000", 2023-10-08T07:06:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8853999999999999e-05 2023-10-08T07:06:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:58.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.925 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:35853 4.3a e47/17 4:5d52ad5e:::10000000004.00000026:head v 47'1635, mlcod=47'1630)", 2023-10-08T07:06:58.925 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.903691+0000", 2023-10-08T07:06:58.925 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0029421870000000002, 2023-10-08T07:06:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003133046, 2023-10-08T07:06:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903691+0000", 2023-10-08T07:06:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903691+0000", 2023-10-08T07:06:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903692+0000", 2023-10-08T07:06:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-07 2023-10-08T07:06:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903703+0000", 2023-10-08T07:06:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1569000000000001e-05 2023-10-08T07:06:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903710+0000", 2023-10-08T07:06:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8140000000000003e-06 2023-10-08T07:06:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903721+0000", 2023-10-08T07:06:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0764999999999999e-05 2023-10-08T07:06:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.904314+0000", 2023-10-08T07:06:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00059314600000000002 2023-10-08T07:06:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.904341+0000", 2023-10-08T07:06:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7319999999999999e-05 2023-10-08T07:06:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:35859 4.20 e47/17 4:04004f2c:::10000000004.0000000d:head v 47'1678, mlcod=47'1674)", 2023-10-08T07:06:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.903741+0000", 2023-10-08T07:06:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0028926550000000001, 2023-10-08T07:06:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031259769999999998, 2023-10-08T07:06:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903741+0000", 2023-10-08T07:06:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903741+0000", 2023-10-08T07:06:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903741+0000", 2023-10-08T07:06:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9900000000000001e-07 2023-10-08T07:06:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903773+0000", 2023-10-08T07:06:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1467999999999998e-05 2023-10-08T07:06:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903782+0000", 2023-10-08T07:06:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8320000000000001e-06 2023-10-08T07:06:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903786+0000", 2023-10-08T07:06:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.709e-06 2023-10-08T07:06:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903828+0000", 2023-10-08T07:06:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1486999999999998e-05 2023-10-08T07:06:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903853+0000", 2023-10-08T07:06:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4967999999999999e-05 2023-10-08T07:06:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:35860 4.c e47/17 4:31e28161:::10000000004.00000011:head v 47'1126, mlcod=47'1124)", 2023-10-08T07:06:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.903940+0000", 2023-10-08T07:06:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002693151, 2023-10-08T07:06:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029640769999999999, 2023-10-08T07:06:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903940+0000", 2023-10-08T07:06:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903940+0000", 2023-10-08T07:06:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903941+0000", 2023-10-08T07:06:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9000000000000002e-07 2023-10-08T07:06:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903950+0000", 2023-10-08T07:06:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4280000000000002e-06 2023-10-08T07:06:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903957+0000", 2023-10-08T07:06:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5459999999999997e-06 2023-10-08T07:06:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903960+0000", 2023-10-08T07:06:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2160000000000002e-06 2023-10-08T07:06:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.903992+0000", 2023-10-08T07:06:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2518999999999998e-05 2023-10-08T07:06:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.904005+0000", 2023-10-08T07:06:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2313999999999999e-05 2023-10-08T07:06:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:35863 4.28 4:16edf4d3:::10000000004.00000027:head [write 643072~4096 in=4096b,write 790528~4096 in=4096b,write 823296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:06:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.904458+0000", 2023-10-08T07:06:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0021749619999999999, 2023-10-08T07:06:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024821880000000002, 2023-10-08T07:06:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 35863 2023-10-08T07:06:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.904458+0000", 2023-10-08T07:06:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.904458+0000", 2023-10-08T07:06:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.904459+0000", 2023-10-08T07:06:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.54e-07 2023-10-08T07:06:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.904469+0000", 2023-10-08T07:06:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4779999999999997e-06 2023-10-08T07:06:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.904479+0000", 2023-10-08T07:06:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.91e-06 2023-10-08T07:06:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.904484+0000", 2023-10-08T07:06:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4920000000000001e-06 2023-10-08T07:06:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.904526+0000", 2023-10-08T07:06:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1875000000000001e-05 2023-10-08T07:06:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.904601+0000", 2023-10-08T07:06:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4833999999999995e-05 2023-10-08T07:06:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:35862 4.2c e47/17 4:352c144c:::10000000004.00000003:head v 47'564, mlcod=47'562)", 2023-10-08T07:06:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.905130+0000", 2023-10-08T07:06:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001502965, 2023-10-08T07:06:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001847256, 2023-10-08T07:06:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905130+0000", 2023-10-08T07:06:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905130+0000", 2023-10-08T07:06:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905131+0000", 2023-10-08T07:06:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4600000000000005e-07 2023-10-08T07:06:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905142+0000", 2023-10-08T07:06:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0852999999999999e-05 2023-10-08T07:06:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905149+0000", 2023-10-08T07:06:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.114e-06 2023-10-08T07:06:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905155+0000", 2023-10-08T07:06:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8860000000000001e-06 2023-10-08T07:06:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905200+0000", 2023-10-08T07:06:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5303000000000003e-05 2023-10-08T07:06:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905218+0000", 2023-10-08T07:06:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7691999999999999e-05 2023-10-08T07:06:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:35861 4.c e47/17 4:3352c333:::10000000004.00000012:head v 47'1127, mlcod=47'1124)", 2023-10-08T07:06:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.905174+0000", 2023-10-08T07:06:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001459709, 2023-10-08T07:06:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018364810000000001, 2023-10-08T07:06:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905174+0000", 2023-10-08T07:06:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905174+0000", 2023-10-08T07:06:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905174+0000", 2023-10-08T07:06:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2023-10-08T07:06:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905184+0000", 2023-10-08T07:06:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0256e-05 2023-10-08T07:06:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905191+0000", 2023-10-08T07:06:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4200000000000004e-06 2023-10-08T07:06:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905197+0000", 2023-10-08T07:06:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9320000000000001e-06 2023-10-08T07:06:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905244+0000", 2023-10-08T07:06:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6906000000000001e-05 2023-10-08T07:06:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905262+0000", 2023-10-08T07:06:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8029999999999998e-05 2023-10-08T07:06:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:35865 4.10 4:0b5763e1:::10000000004.00000015:head [write 3420160~8192 in=8192b,write 3432448~4096 in=4096b,write 3784704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:06:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.905567+0000", 2023-10-08T07:06:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0010662860000000001, 2023-10-08T07:06:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014806769999999999, 2023-10-08T07:06:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 35865 2023-10-08T07:06:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905567+0000", 2023-10-08T07:06:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905567+0000", 2023-10-08T07:06:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905568+0000", 2023-10-08T07:06:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7800000000000001e-07 2023-10-08T07:06:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905585+0000", 2023-10-08T07:06:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6823000000000001e-05 2023-10-08T07:06:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905596+0000", 2023-10-08T07:06:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1231e-05 2023-10-08T07:06:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905602+0000", 2023-10-08T07:06:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2009999999999996e-06 2023-10-08T07:06:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905651+0000", 2023-10-08T07:06:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8433999999999997e-05 2023-10-08T07:06:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.905737+0000", 2023-10-08T07:06:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6104000000000001e-05 2023-10-08T07:06:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.996 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:58.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:58.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.996 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:35867 4.3b 4:df82de1b:::10000000004.0000000f:head [write 348160~4096 in=4096b,write 430080~4096 in=4096b,write 446464~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:06:58.997 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.906337+0000", 2023-10-08T07:06:58.997 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00029636899999999999, 2023-10-08T07:06:58.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00074891900000000002, 2023-10-08T07:06:58.997 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:58.997 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:58.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:58.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:58.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:58.998 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 35867 2023-10-08T07:06:58.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.998 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:58.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:58.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906337+0000", 2023-10-08T07:06:58.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:58.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906337+0000", 2023-10-08T07:06:58.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:58.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:58.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:58.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:58.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906338+0000", 2023-10-08T07:06:58.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9500000000000001e-07 2023-10-08T07:06:59.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906352+0000", 2023-10-08T07:06:59.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3807e-05 2023-10-08T07:06:59.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906362+0000", 2023-10-08T07:06:59.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0019e-05 2023-10-08T07:06:59.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906369+0000", 2023-10-08T07:06:59.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0990000000000001e-06 2023-10-08T07:06:59.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906411+0000", 2023-10-08T07:06:59.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2412e-05 2023-10-08T07:06:59.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906490+0000", 2023-10-08T07:06:59.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8651000000000003e-05 2023-10-08T07:06:59.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.002 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.002 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:35866 4.3a e47/17 4:5d52ad5e:::10000000004.00000026:head v 47'1636, mlcod=47'1631)", 2023-10-08T07:06:59.002 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.906518+0000", 2023-10-08T07:06:59.002 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000115522, 2023-10-08T07:06:59.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060336400000000001, 2023-10-08T07:06:59.002 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.002 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:59.003 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906518+0000", 2023-10-08T07:06:59.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906518+0000", 2023-10-08T07:06:59.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906518+0000", 2023-10-08T07:06:59.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6100000000000001e-07 2023-10-08T07:06:59.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906533+0000", 2023-10-08T07:06:59.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4771e-05 2023-10-08T07:06:59.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906541+0000", 2023-10-08T07:06:59.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6979999999999998e-06 2023-10-08T07:06:59.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906548+0000", 2023-10-08T07:06:59.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7020000000000004e-06 2023-10-08T07:06:59.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906804+0000", 2023-10-08T07:06:59.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00025598500000000002 2023-10-08T07:06:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.906820+0000", 2023-10-08T07:06:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6441000000000001e-05 2023-10-08T07:06:59.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:35846 4.20 e47/17 4:04004f2c:::10000000004.0000000d:head v 47'1676, mlcod=47'1674)", 2023-10-08T07:06:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.899501+0000", 2023-10-08T07:06:59.008 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0071320589999999996, 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076534530000000002, 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.899501+0000", 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.899501+0000", 2023-10-08T07:06:59.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.899502+0000", 2023-10-08T07:06:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5000000000000003e-07 2023-10-08T07:06:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.899513+0000", 2023-10-08T07:06:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0713999999999999e-05 2023-10-08T07:06:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.899520+0000", 2023-10-08T07:06:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4449999999999999e-06 2023-10-08T07:06:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.899525+0000", 2023-10-08T07:06:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6700000000000002e-06 2023-10-08T07:06:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.899562+0000", 2023-10-08T07:06:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7616e-05 2023-10-08T07:06:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.899582+0000", 2023-10-08T07:06:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9967e-05 2023-10-08T07:06:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:35851 4.20 e47/17 4:04004f2c:::10000000004.0000000d:head v 47'1677, mlcod=47'1674)", 2023-10-08T07:06:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.901000+0000", 2023-10-08T07:06:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0056329589999999999, 2023-10-08T07:06:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006187438, 2023-10-08T07:06:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.901000+0000", 2023-10-08T07:06:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.901000+0000", 2023-10-08T07:06:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.901001+0000", 2023-10-08T07:06:59.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4000000000000002e-07 2023-10-08T07:06:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.901026+0000", 2023-10-08T07:06:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5205e-05 2023-10-08T07:06:59.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.901034+0000", 2023-10-08T07:06:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2800000000000003e-06 2023-10-08T07:06:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.901041+0000", 2023-10-08T07:06:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9890000000000003e-06 2023-10-08T07:06:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.901095+0000", 2023-10-08T07:06:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4014999999999997e-05 2023-10-08T07:06:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.901115+0000", 2023-10-08T07:06:59.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9769999999999999e-05 2023-10-08T07:06:59.020 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.020 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.020 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.020 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:35855 4.3b 4:df0e4bf8:::10000000004.00000018:head [write 1953792~4096 in=4096b,write 1974272~4096 in=4096b,write 2002944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:06:59.021 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:58.902023+0000", 2023-10-08T07:06:59.021 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0046103630000000001, 2023-10-08T07:06:59.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052008760000000001, 2023-10-08T07:06:59.021 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.021 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:06:59.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.022 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.022 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.022 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 35855 2023-10-08T07:06:59.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.022 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902023+0000", 2023-10-08T07:06:59.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902023+0000", 2023-10-08T07:06:59.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902024+0000", 2023-10-08T07:06:59.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2200000000000003e-07 2023-10-08T07:06:59.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902035+0000", 2023-10-08T07:06:59.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0913e-05 2023-10-08T07:06:59.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902043+0000", 2023-10-08T07:06:59.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.585e-06 2023-10-08T07:06:59.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902050+0000", 2023-10-08T07:06:59.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2530000000000001e-06 2023-10-08T07:06:59.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902099+0000", 2023-10-08T07:06:59.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2023-10-08T07:06:59.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:58.902178+0000", 2023-10-08T07:06:59.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9005999999999995e-05 2023-10-08T07:06:59.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.029 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.029 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:06:59.029 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 14 2023-10-08T07:06:59.030 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:59.031 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:06:59.032 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:59.030+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:59.131 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:59.130+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:59.229 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T07:06:59.233 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:59.232+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:59.249 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:59.249 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:06:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:06:59.250 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:06:59.250 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:59.260 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:06:59.333 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:59.332+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:59.435 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:59.433+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:59.438 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:06:59.438 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:06:59.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:06:59.438 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:06:59.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.438 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:14150 4.30 e42/17 4:0f322a22:::10000000004.00000014:head v 42'237, mlcod=42'235)", 2023-10-08T07:06:59.438 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.675026+0000", 2023-10-08T07:06:59.438 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.7605305310000006, 2023-10-08T07:06:59.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017643645999999999, 2023-10-08T07:06:59.439 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.439 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.439 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675026+0000", 2023-10-08T07:06:59.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675026+0000", 2023-10-08T07:06:59.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675027+0000", 2023-10-08T07:06:59.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6899999999999997e-07 2023-10-08T07:06:59.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675038+0000", 2023-10-08T07:06:59.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0716e-05 2023-10-08T07:06:59.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675045+0000", 2023-10-08T07:06:59.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0450000000000003e-06 2023-10-08T07:06:59.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675050+0000", 2023-10-08T07:06:59.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1080000000000001e-06 2023-10-08T07:06:59.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675089+0000", 2023-10-08T07:06:59.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9480000000000001e-05 2023-10-08T07:06:59.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.675101+0000", 2023-10-08T07:06:59.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1708e-05 2023-10-08T07:06:59.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692618+0000", 2023-10-08T07:06:59.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017517245000000001 2023-10-08T07:06:59.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.692670+0000", 2023-10-08T07:06:59.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1774999999999998e-05 2023-10-08T07:06:59.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.444 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.444 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14638 4.2f 4:f790ef75:::10000000004.00000038:head [write 2977792~4096,write 3022848~4096,write 3043328~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:59.445 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.851242+0000", 2023-10-08T07:06:59.445 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.5843145399999994, 2023-10-08T07:06:59.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016802940999999998, 2023-10-08T07:06:59.445 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.446 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.446 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14638 2023-10-08T07:06:59.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.447 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851242+0000", 2023-10-08T07:06:59.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851242+0000", 2023-10-08T07:06:59.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851243+0000", 2023-10-08T07:06:59.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2799999999999995e-07 2023-10-08T07:06:59.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851282+0000", 2023-10-08T07:06:59.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9181000000000003e-05 2023-10-08T07:06:59.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851300+0000", 2023-10-08T07:06:59.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7190999999999999e-05 2023-10-08T07:06:59.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851306+0000", 2023-10-08T07:06:59.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.888e-06 2023-10-08T07:06:59.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851373+0000", 2023-10-08T07:06:59.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6833000000000002e-05 2023-10-08T07:06:59.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851465+0000", 2023-10-08T07:06:59.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1978000000000006e-05 2023-10-08T07:06:59.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.867944+0000", 2023-10-08T07:06:59.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016478282 2023-10-08T07:06:59.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.867997+0000", 2023-10-08T07:06:59.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3640999999999997e-05 2023-10-08T07:06:59.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.868045+0000", 2023-10-08T07:06:59.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8118999999999998e-05 2023-10-08T07:06:59.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.455 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.457 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:14639 4.b 4:d0c991e0:::10000000004.0000002d:head [write 2207744~4096,write 2269184~4096,write 2310144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:06:59.457 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:50.851520+0000", 2023-10-08T07:06:59.457 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.5840364850000004, 2023-10-08T07:06:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018887537999999999, 2023-10-08T07:06:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 14639 2023-10-08T07:06:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851520+0000", 2023-10-08T07:06:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851520+0000", 2023-10-08T07:06:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851521+0000", 2023-10-08T07:06:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0900000000000001e-07 2023-10-08T07:06:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851569+0000", 2023-10-08T07:06:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7552999999999997e-05 2023-10-08T07:06:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851578+0000", 2023-10-08T07:06:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8570000000000001e-06 2023-10-08T07:06:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851585+0000", 2023-10-08T07:06:59.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0230000000000004e-06 2023-10-08T07:06:59.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851639+0000", 2023-10-08T07:06:59.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4214e-05 2023-10-08T07:06:59.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851729+0000", 2023-10-08T07:06:59.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0687999999999996e-05 2023-10-08T07:06:59.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:59.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.851918+0000", 2023-10-08T07:06:59.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018832899999999999 2023-10-08T07:06:59.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:59.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.858649+0000", 2023-10-08T07:06:59.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067308250000000002 2023-10-08T07:06:59.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.870299+0000", 2023-10-08T07:06:59.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011650162 2023-10-08T07:06:59.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.870357+0000", 2023-10-08T07:06:59.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8418999999999998e-05 2023-10-08T07:06:59.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:50.870408+0000", 2023-10-08T07:06:59.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0759e-05 2023-10-08T07:06:59.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.464 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.464 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:17709 4.28 4:16edf4d3:::10000000004.00000027:head [write 16384~4096 in=4096b,write 159744~4096 in=4096b,write 204800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:06:59.465 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:51.989822+0000", 2023-10-08T07:06:59.465 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.4457349779999999, 2023-10-08T07:06:59.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016860443999999999, 2023-10-08T07:06:59.465 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.465 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.465 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 17709 2023-10-08T07:06:59.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.465 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989822+0000", 2023-10-08T07:06:59.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989822+0000", 2023-10-08T07:06:59.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989823+0000", 2023-10-08T07:06:59.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2399999999999998e-07 2023-10-08T07:06:59.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989833+0000", 2023-10-08T07:06:59.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0087e-05 2023-10-08T07:06:59.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989841+0000", 2023-10-08T07:06:59.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4200000000000007e-06 2023-10-08T07:06:59.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989846+0000", 2023-10-08T07:06:59.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7219999999999999e-06 2023-10-08T07:06:59.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989883+0000", 2023-10-08T07:06:59.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7276e-05 2023-10-08T07:06:59.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:51.989956+0000", 2023-10-08T07:06:59.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2773000000000003e-05 2023-10-08T07:06:59.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006556+0000", 2023-10-08T07:06:59.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016599820000000001 2023-10-08T07:06:59.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006607+0000", 2023-10-08T07:06:59.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1622000000000001e-05 2023-10-08T07:06:59.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:52.006682+0000", 2023-10-08T07:06:59.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5099999999999996e-05 2023-10-08T07:06:59.471 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.471 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.471 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.471 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:29085 4.0 4:02bf98b6:::10000000004.0000000e:head [write 4055040~4096,write 4091904~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-10-08T07:06:59.471 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:56.382554+0000", 2023-10-08T07:06:59.472 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.0530029710000002, 2023-10-08T07:06:59.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016814381999999999, 2023-10-08T07:06:59.472 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.472 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.472 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 29085 2023-10-08T07:06:59.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.472 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.382554+0000", 2023-10-08T07:06:59.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.382554+0000", 2023-10-08T07:06:59.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.382555+0000", 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6000000000000003e-07 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.382564+0000", 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0189999999999995e-06 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.382574+0000", 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0115000000000001e-05 2023-10-08T07:06:59.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.382579+0000", 2023-10-08T07:06:59.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4779999999999999e-06 2023-10-08T07:06:59.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.382624+0000", 2023-10-08T07:06:59.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4487000000000003e-05 2023-10-08T07:06:59.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.382712+0000", 2023-10-08T07:06:59.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8157000000000003e-05 2023-10-08T07:06:59.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:59.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.382852+0000", 2023-10-08T07:06:59.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013977799999999999 2023-10-08T07:06:59.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:59.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.386066+0000", 2023-10-08T07:06:59.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032137860000000002 2023-10-08T07:06:59.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.399312+0000", 2023-10-08T07:06:59.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013246056000000001 2023-10-08T07:06:59.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.399345+0000", 2023-10-08T07:06:59.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3386999999999997e-05 2023-10-08T07:06:59.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:56.399368+0000", 2023-10-08T07:06:59.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3359000000000001e-05 2023-10-08T07:06:59.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.481 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.482 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:36590 4.c e47/17 4:31e28161:::10000000004.00000011:head v 47'1146, mlcod=47'1144)", 2023-10-08T07:06:59.482 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.167204+0000", 2023-10-08T07:06:59.482 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26835260100000002, 2023-10-08T07:06:59.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017472642, 2023-10-08T07:06:59.482 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.482 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.482 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167204+0000", 2023-10-08T07:06:59.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167204+0000", 2023-10-08T07:06:59.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167205+0000", 2023-10-08T07:06:59.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3000000000000001e-07 2023-10-08T07:06:59.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167215+0000", 2023-10-08T07:06:59.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0352e-05 2023-10-08T07:06:59.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167222+0000", 2023-10-08T07:06:59.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2910000000000002e-06 2023-10-08T07:06:59.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167228+0000", 2023-10-08T07:06:59.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000001e-06 2023-10-08T07:06:59.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167272+0000", 2023-10-08T07:06:59.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3454000000000001e-05 2023-10-08T07:06:59.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167295+0000", 2023-10-08T07:06:59.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2779999999999999e-05 2023-10-08T07:06:59.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.184634+0000", 2023-10-08T07:06:59.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017339229000000001 2023-10-08T07:06:59.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.184677+0000", 2023-10-08T07:06:59.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3096000000000002e-05 2023-10-08T07:06:59.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.487 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:36584 4.1a e47/17 4:5a59f83a:::10000000004.00000002:head v 47'583, mlcod=47'581)", 2023-10-08T07:06:59.487 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.167246+0000", 2023-10-08T07:06:59.487 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26831043700000001, 2023-10-08T07:06:59.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017565879, 2023-10-08T07:06:59.487 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.487 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.488 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167246+0000", 2023-10-08T07:06:59.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167246+0000", 2023-10-08T07:06:59.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167247+0000", 2023-10-08T07:06:59.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2023-10-08T07:06:59.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167257+0000", 2023-10-08T07:06:59.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0339e-05 2023-10-08T07:06:59.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167263+0000", 2023-10-08T07:06:59.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2559999999999999e-06 2023-10-08T07:06:59.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167270+0000", 2023-10-08T07:06:59.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0889999999999996e-06 2023-10-08T07:06:59.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167317+0000", 2023-10-08T07:06:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7203000000000002e-05 2023-10-08T07:06:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167337+0000", 2023-10-08T07:06:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0737000000000002e-05 2023-10-08T07:06:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.184774+0000", 2023-10-08T07:06:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017436692 2023-10-08T07:06:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.184812+0000", 2023-10-08T07:06:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8194000000000001e-05 2023-10-08T07:06:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:36591 4.38 e47/46 4:1e0977c7:::10000000004.00000022:head v 47'577, mlcod=47'575)", 2023-10-08T07:06:59.492 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.167658+0000", 2023-10-08T07:06:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26789878499999997, 2023-10-08T07:06:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019568096, 2023-10-08T07:06:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167658+0000", 2023-10-08T07:06:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167658+0000", 2023-10-08T07:06:59.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167659+0000", 2023-10-08T07:06:59.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2499999999999995e-07 2023-10-08T07:06:59.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167671+0000", 2023-10-08T07:06:59.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1902999999999999e-05 2023-10-08T07:06:59.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167680+0000", 2023-10-08T07:06:59.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3389999999999999e-06 2023-10-08T07:06:59.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167687+0000", 2023-10-08T07:06:59.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6900000000000003e-06 2023-10-08T07:06:59.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167736+0000", 2023-10-08T07:06:59.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.956e-05 2023-10-08T07:06:59.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.167757+0000", 2023-10-08T07:06:59.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1047e-05 2023-10-08T07:06:59.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.187191+0000", 2023-10-08T07:06:59.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019433771999999998 2023-10-08T07:06:59.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.187226+0000", 2023-10-08T07:06:59.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5259999999999998e-05 2023-10-08T07:06:59.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.497 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.498 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36593 4.26 4:672c55ca:::10000000004.00000006:head [write 2203648~4096,write 2289664~4096,write 2347008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:06:59.498 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.168067+0000", 2023-10-08T07:06:59.498 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26748948099999997, 2023-10-08T07:06:59.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016988248000000001, 2023-10-08T07:06:59.498 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.498 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.498 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36593 2023-10-08T07:06:59.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.498 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.168067+0000", 2023-10-08T07:06:59.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.168067+0000", 2023-10-08T07:06:59.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.168068+0000", 2023-10-08T07:06:59.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:06:59.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.168077+0000", 2023-10-08T07:06:59.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2080000000000006e-06 2023-10-08T07:06:59.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.168085+0000", 2023-10-08T07:06:59.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7200000000000006e-06 2023-10-08T07:06:59.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.168091+0000", 2023-10-08T07:06:59.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3510000000000001e-06 2023-10-08T07:06:59.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.168139+0000", 2023-10-08T07:06:59.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8497e-05 2023-10-08T07:06:59.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.168233+0000", 2023-10-08T07:06:59.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3760999999999999e-05 2023-10-08T07:06:59.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:59.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.168367+0000", 2023-10-08T07:06:59.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013432599999999999 2023-10-08T07:06:59.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:59.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.177562+0000", 2023-10-08T07:06:59.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091946830000000004 2023-10-08T07:06:59.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.184961+0000", 2023-10-08T07:06:59.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073988989999999996 2023-10-08T07:06:59.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.185017+0000", 2023-10-08T07:06:59.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6752999999999997e-05 2023-10-08T07:06:59.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.185056+0000", 2023-10-08T07:06:59.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8251999999999999e-05 2023-10-08T07:06:59.504 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.504 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.504 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.505 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:36594 4.38 e47/46 4:1e0977c7:::10000000004.00000022:head v 47'578, mlcod=47'575)", 2023-10-08T07:06:59.505 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.169208+0000", 2023-10-08T07:06:59.505 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26634924100000001, 2023-10-08T07:06:59.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018049834000000001, 2023-10-08T07:06:59.505 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.505 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.505 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.169208+0000", 2023-10-08T07:06:59.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.169208+0000", 2023-10-08T07:06:59.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.169208+0000", 2023-10-08T07:06:59.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1999999999999999e-07 2023-10-08T07:06:59.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.169240+0000", 2023-10-08T07:06:59.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1377999999999997e-05 2023-10-08T07:06:59.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.169251+0000", 2023-10-08T07:06:59.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1508000000000001e-05 2023-10-08T07:06:59.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.169257+0000", 2023-10-08T07:06:59.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2149999999999998e-06 2023-10-08T07:06:59.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.177557+0000", 2023-10-08T07:06:59.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082993249999999998 2023-10-08T07:06:59.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.177580+0000", 2023-10-08T07:06:59.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3337999999999999e-05 2023-10-08T07:06:59.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.187229+0000", 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0096494219999999995 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.187258+0000", 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8028e-05 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.510 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36597 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2478080~4096,write 2658304~4096,write 2764800~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:06:59.510 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.169546+0000", 2023-10-08T07:06:59.510 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26601132599999999, 2023-10-08T07:06:59.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024070218000000001, 2023-10-08T07:06:59.510 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.510 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.510 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36597 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.169546+0000", 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.169546+0000", 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.169547+0000", 2023-10-08T07:06:59.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3099999999999996e-07 2023-10-08T07:06:59.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.169565+0000", 2023-10-08T07:06:59.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8550999999999999e-05 2023-10-08T07:06:59.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.169580+0000", 2023-10-08T07:06:59.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4701e-05 2023-10-08T07:06:59.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.169589+0000", 2023-10-08T07:06:59.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7469999999999994e-06 2023-10-08T07:06:59.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.181877+0000", 2023-10-08T07:06:59.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01228841 2023-10-08T07:06:59.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.181934+0000", 2023-10-08T07:06:59.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6888000000000001e-05 2023-10-08T07:06:59.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:59.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.182025+0000", 2023-10-08T07:06:59.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1503999999999997e-05 2023-10-08T07:06:59.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:59.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.192189+0000", 2023-10-08T07:06:59.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010163841 2023-10-08T07:06:59.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.193540+0000", 2023-10-08T07:06:59.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013510309999999999 2023-10-08T07:06:59.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.193592+0000", 2023-10-08T07:06:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1628000000000001e-05 2023-10-08T07:06:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.193616+0000", 2023-10-08T07:06:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3986e-05 2023-10-08T07:06:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36601 4.10 4:08d50e0e:::10000000004.0000003f:head [write 1658880~4096,write 1691648~4096,write 1875968~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:06:59.518 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.170742+0000", 2023-10-08T07:06:59.518 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26481511800000002, 2023-10-08T07:06:59.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021755210000000001, 2023-10-08T07:06:59.518 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.518 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.518 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36601 2023-10-08T07:06:59.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.518 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.170742+0000", 2023-10-08T07:06:59.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.170742+0000", 2023-10-08T07:06:59.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.170742+0000", 2023-10-08T07:06:59.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:06:59.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.170753+0000", 2023-10-08T07:06:59.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0276e-05 2023-10-08T07:06:59.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.170758+0000", 2023-10-08T07:06:59.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2020000000000003e-06 2023-10-08T07:06:59.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.170761+0000", 2023-10-08T07:06:59.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6370000000000001e-06 2023-10-08T07:06:59.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.182024+0000", 2023-10-08T07:06:59.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011262110000000001 2023-10-08T07:06:59.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.182104+0000", 2023-10-08T07:06:59.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0062999999999996e-05 2023-10-08T07:06:59.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.192350+0000", 2023-10-08T07:06:59.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010246243 2023-10-08T07:06:59.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.192415+0000", 2023-10-08T07:06:59.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5607999999999999e-05 2023-10-08T07:06:59.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.192497+0000", 2023-10-08T07:06:59.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1515999999999997e-05 2023-10-08T07:06:59.523 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.523 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.523 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.524 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36602 4.7 4:e13e8cdb:::10000000004.00000028:head [write 835584~4096,write 1081344~4096,write 1163264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:06:59.524 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.171440+0000", 2023-10-08T07:06:59.524 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26411686400000001, 2023-10-08T07:06:59.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016994746000000002, 2023-10-08T07:06:59.524 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.524 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.524 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36602 2023-10-08T07:06:59.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.525 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.171440+0000", 2023-10-08T07:06:59.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.171440+0000", 2023-10-08T07:06:59.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.171441+0000", 2023-10-08T07:06:59.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:06:59.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.171454+0000", 2023-10-08T07:06:59.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3441999999999999e-05 2023-10-08T07:06:59.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.171460+0000", 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2670000000000003e-06 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.171464+0000", 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4910000000000001e-06 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.171532+0000", 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7858e-05 2023-10-08T07:06:59.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.171589+0000", 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7525000000000002e-05 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.188344+0000", 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016755091999999999 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.188383+0000", 2023-10-08T07:06:59.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8590999999999997e-05 2023-10-08T07:06:59.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.188435+0000", 2023-10-08T07:06:59.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1903000000000001e-05 2023-10-08T07:06:59.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.529 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.529 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:36603 4.38 e47/46 4:1e0977c7:::10000000004.00000022:head v 47'579, mlcod=47'575)", 2023-10-08T07:06:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.172048+0000", 2023-10-08T07:06:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.263509033, 2023-10-08T07:06:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020147816999999998, 2023-10-08T07:06:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.172048+0000", 2023-10-08T07:06:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.172048+0000", 2023-10-08T07:06:59.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.172048+0000", 2023-10-08T07:06:59.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5600000000000001e-07 2023-10-08T07:06:59.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.172060+0000", 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.206e-05 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.172069+0000", 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1110000000000008e-06 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.172075+0000", 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4930000000000003e-06 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.178282+0000", 2023-10-08T07:06:59.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062071519999999996 2023-10-08T07:06:59.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.178303+0000", 2023-10-08T07:06:59.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1018000000000001e-05 2023-10-08T07:06:59.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.192149+0000", 2023-10-08T07:06:59.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013846328 2023-10-08T07:06:59.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.192196+0000", 2023-10-08T07:06:59.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199000000000003e-05 2023-10-08T07:06:59.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.534 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.535 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36614 4.28 4:15b6682b:::10000000004.0000000b:head [write 73728~4096,write 131072~4096,write 262144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:06:59.535 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.175132+0000", 2023-10-08T07:06:59.535 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26042445400000003, 2023-10-08T07:06:59.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018596356000000001, 2023-10-08T07:06:59.535 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.535 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.535 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36614 2023-10-08T07:06:59.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.536 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.175132+0000", 2023-10-08T07:06:59.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.175132+0000", 2023-10-08T07:06:59.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.175133+0000", 2023-10-08T07:06:59.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8400000000000005e-07 2023-10-08T07:06:59.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.175157+0000", 2023-10-08T07:06:59.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4138000000000002e-05 2023-10-08T07:06:59.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.175164+0000", 2023-10-08T07:06:59.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4999999999999996e-06 2023-10-08T07:06:59.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.175167+0000", 2023-10-08T07:06:59.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4460000000000001e-06 2023-10-08T07:06:59.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.184953+0000", 2023-10-08T07:06:59.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097855709999999999 2023-10-08T07:06:59.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.185031+0000", 2023-10-08T07:06:59.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8576000000000001e-05 2023-10-08T07:06:59.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.193626+0000", 2023-10-08T07:06:59.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085944049999999994 2023-10-08T07:06:59.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.193663+0000", 2023-10-08T07:06:59.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7731999999999997e-05 2023-10-08T07:06:59.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.193729+0000", 2023-10-08T07:06:59.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5504000000000002e-05 2023-10-08T07:06:59.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.541 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.541 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36618 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3502080~8192,write 3559424~4096,write 3584000~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:06:59.541 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.176161+0000", 2023-10-08T07:06:59.541 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.25939602499999997, 2023-10-08T07:06:59.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017644487, 2023-10-08T07:06:59.541 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.541 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.542 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36618 2023-10-08T07:06:59.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.542 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.176161+0000", 2023-10-08T07:06:59.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.176161+0000", 2023-10-08T07:06:59.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.176161+0000", 2023-10-08T07:06:59.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5600000000000001e-07 2023-10-08T07:06:59.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.176173+0000", 2023-10-08T07:06:59.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1384e-05 2023-10-08T07:06:59.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.176178+0000", 2023-10-08T07:06:59.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5389999999999998e-06 2023-10-08T07:06:59.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.176181+0000", 2023-10-08T07:06:59.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.128e-06 2023-10-08T07:06:59.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.185100+0000", 2023-10-08T07:06:59.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089184680000000006 2023-10-08T07:06:59.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.185178+0000", 2023-10-08T07:06:59.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8442999999999994e-05 2023-10-08T07:06:59.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:06:59.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.185567+0000", 2023-10-08T07:06:59.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038854900000000002 2023-10-08T07:06:59.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:06:59.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.192324+0000", 2023-10-08T07:06:59.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067568330000000003 2023-10-08T07:06:59.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.193736+0000", 2023-10-08T07:06:59.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001412396 2023-10-08T07:06:59.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.193775+0000", 2023-10-08T07:06:59.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8841000000000003e-05 2023-10-08T07:06:59.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.193805+0000", 2023-10-08T07:06:59.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0549999999999997e-05 2023-10-08T07:06:59.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36637 4.10 4:08d50e0e:::10000000004.0000003f:head [write 1519616~4096,write 1556480~4096,write 1613824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.181685+0000", 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.25387223399999997, 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017651936, 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.550 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36637 2023-10-08T07:06:59.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.550 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.181685+0000", 2023-10-08T07:06:59.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.181685+0000", 2023-10-08T07:06:59.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.181686+0000", 2023-10-08T07:06:59.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4e-07 2023-10-08T07:06:59.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.181784+0000", 2023-10-08T07:06:59.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8397e-05 2023-10-08T07:06:59.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.181792+0000", 2023-10-08T07:06:59.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8299999999999996e-06 2023-10-08T07:06:59.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.181799+0000", 2023-10-08T07:06:59.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0709999999999997e-06 2023-10-08T07:06:59.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.193513+0000", 2023-10-08T07:06:59.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011714587 2023-10-08T07:06:59.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.193610+0000", 2023-10-08T07:06:59.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6323999999999995e-05 2023-10-08T07:06:59.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.199225+0000", 2023-10-08T07:06:59.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056156549999999998 2023-10-08T07:06:59.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.199274+0000", 2023-10-08T07:06:59.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8127999999999997e-05 2023-10-08T07:06:59.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.199337+0000", 2023-10-08T07:06:59.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3103999999999998e-05 2023-10-08T07:06:59.555 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.555 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.555 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.555 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36761 4.21 4:867af9ba:::10000000004.0000000a:head [write 245760~4096,write 368640~4096,write 966656~4096,write 1568768~4096,write 2101248~4096,write 2564096~4096,write 2629632~4096,write 2674688~4096,write 2969600~4096,write 3117056~4096,write 3170304~4096,write 3358720~4096,write 3407872~4096,write 3416064~4096,write 3567616~8192,write 3719168~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:06:59.555 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.226534+0000", 2023-10-08T07:06:59.555 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.209023349, 2023-10-08T07:06:59.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017464515, 2023-10-08T07:06:59.555 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.555 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36761 2023-10-08T07:06:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.226534+0000", 2023-10-08T07:06:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.226534+0000", 2023-10-08T07:06:59.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.226534+0000", 2023-10-08T07:06:59.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7100000000000001e-07 2023-10-08T07:06:59.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.226587+0000", 2023-10-08T07:06:59.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2346999999999999e-05 2023-10-08T07:06:59.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.226594+0000", 2023-10-08T07:06:59.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6590000000000007e-06 2023-10-08T07:06:59.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.226601+0000", 2023-10-08T07:06:59.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2689999999999996e-06 2023-10-08T07:06:59.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.232933+0000", 2023-10-08T07:06:59.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063329090000000003 2023-10-08T07:06:59.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.233038+0000", 2023-10-08T07:06:59.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000104116 2023-10-08T07:06:59.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.243839+0000", 2023-10-08T07:06:59.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010801086999999999 2023-10-08T07:06:59.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.243908+0000", 2023-10-08T07:06:59.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9568999999999997e-05 2023-10-08T07:06:59.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.243998+0000", 2023-10-08T07:06:59.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9888000000000004e-05 2023-10-08T07:06:59.561 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.561 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.561 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.561 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36763 4.9 4:9258b67d:::10000000005.00000000:head [write 0~1048576] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:06:59.561 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.226685+0000", 2023-10-08T07:06:59.562 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.20887176299999999, 2023-10-08T07:06:59.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020046801999999999, 2023-10-08T07:06:59.562 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.562 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:06:59.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:06:59.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.562 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36763 2023-10-08T07:06:59.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.562 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.226685+0000", 2023-10-08T07:06:59.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.226685+0000", 2023-10-08T07:06:59.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.226686+0000", 2023-10-08T07:06:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3399999999999999e-07 2023-10-08T07:06:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.230782+0000", 2023-10-08T07:06:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040959450000000001 2023-10-08T07:06:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.230794+0000", 2023-10-08T07:06:59.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2078e-05 2023-10-08T07:06:59.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.230802+0000", 2023-10-08T07:06:59.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9789999999999993e-06 2023-10-08T07:06:59.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.240992+0000", 2023-10-08T07:06:59.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010190289999999999 2023-10-08T07:06:59.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.241080+0000", 2023-10-08T07:06:59.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7466000000000006e-05 2023-10-08T07:06:59.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:06:59.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.246631+0000", 2023-10-08T07:06:59.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005551495 2023-10-08T07:06:59.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.246676+0000", 2023-10-08T07:06:59.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5139999999999998e-05 2023-10-08T07:06:59.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.246732+0000", 2023-10-08T07:06:59.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5775e-05 2023-10-08T07:06:59.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.568 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.568 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:36755 4.3a e48/17 4:5f183e4b:::10000000004.00000023:head v 48'1675, mlcod=47'1673)", 2023-10-08T07:06:59.568 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.229556+0000", 2023-10-08T07:06:59.568 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.20600058600000001, 2023-10-08T07:06:59.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017011934999999999, 2023-10-08T07:06:59.569 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:06:59.569 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:06:59.569 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:06:59.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:06:59.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.229556+0000", 2023-10-08T07:06:59.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:06:59.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.229556+0000", 2023-10-08T07:06:59.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:06:59.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:06:59.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.229557+0000", 2023-10-08T07:06:59.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8299999999999998e-07 2023-10-08T07:06:59.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:06:59.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.229663+0000", 2023-10-08T07:06:59.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010631 2023-10-08T07:06:59.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:06:59.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.229671+0000", 2023-10-08T07:06:59.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.875e-06 2023-10-08T07:06:59.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.229678+0000", 2023-10-08T07:06:59.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.542e-06 2023-10-08T07:06:59.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:06:59.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.229851+0000", 2023-10-08T07:06:59.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172585 2023-10-08T07:06:59.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:06:59.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.229870+0000", 2023-10-08T07:06:59.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9402000000000002e-05 2023-10-08T07:06:59.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:06:59.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.246528+0000", 2023-10-08T07:06:59.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016657261999999999 2023-10-08T07:06:59.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:06:59.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:06:59.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:06:59.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.246568+0000", 2023-10-08T07:06:59.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0575999999999999e-05 2023-10-08T07:06:59.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.574 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:06:59.574 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:06:59.574 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:06:59.575 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:59.574+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:59.576 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:06:59.676 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:59.675+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:06:59.750 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:06:59.751 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:06:59.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.751 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:38068 4.20 4:05b3915c:::10000000004.00000016:head [write 3092480~4096 in=4096b,write 3190784~4096 in=4096b,write 3207168~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:06:59.751 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.747374+0000", 2023-10-08T07:06:59.751 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0023444400000000002, 2023-10-08T07:06:59.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0023647189999999999, 2023-10-08T07:06:59.751 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:59.751 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:59.751 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:59.751 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:59.751 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.751 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 38068 2023-10-08T07:06:59.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.752 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:59.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:59.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747374+0000", 2023-10-08T07:06:59.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:59.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747374+0000", 2023-10-08T07:06:59.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:59.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747375+0000", 2023-10-08T07:06:59.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.54e-07 2023-10-08T07:06:59.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:59.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747387+0000", 2023-10-08T07:06:59.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2347999999999999e-05 2023-10-08T07:06:59.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:59.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747399+0000", 2023-10-08T07:06:59.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2285e-05 2023-10-08T07:06:59.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747407+0000", 2023-10-08T07:06:59.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2559999999999996e-06 2023-10-08T07:06:59.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:59.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747465+0000", 2023-10-08T07:06:59.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8860000000000002e-05 2023-10-08T07:06:59.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:59.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747562+0000", 2023-10-08T07:06:59.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6702999999999999e-05 2023-10-08T07:06:59.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:59.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747721+0000", 2023-10-08T07:06:59.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015853699999999999 2023-10-08T07:06:59.756 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.756 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:59.756 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.756 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:38070 4.e 4:7242a848:::10000000004.00000020:head [write 3514368~4096 in=4096b,write 3936256~4096 in=4096b,write 4001792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:06:59.756 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.748021+0000", 2023-10-08T07:06:59.756 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0016967670000000001, 2023-10-08T07:06:59.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001768426, 2023-10-08T07:06:59.757 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:59.757 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:59.757 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:59.757 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:59.757 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.757 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 38070 2023-10-08T07:06:59.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.757 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:59.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:59.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748021+0000", 2023-10-08T07:06:59.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:59.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748021+0000", 2023-10-08T07:06:59.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:59.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748022+0000", 2023-10-08T07:06:59.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3200000000000005e-07 2023-10-08T07:06:59.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:59.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748032+0000", 2023-10-08T07:06:59.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8600000000000005e-06 2023-10-08T07:06:59.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:59.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748043+0000", 2023-10-08T07:06:59.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0947e-05 2023-10-08T07:06:59.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748048+0000", 2023-10-08T07:06:59.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3689999999999998e-06 2023-10-08T07:06:59.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:59.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748103+0000", 2023-10-08T07:06:59.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.507e-05 2023-10-08T07:06:59.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:59.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748206+0000", 2023-10-08T07:06:59.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010230000000000001 2023-10-08T07:06:59.761 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.761 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:59.761 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.761 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:38067 4.29 e48/17 4:94216392:::10000000004.0000002b:head v 48'603, mlcod=48'600)", 2023-10-08T07:06:59.762 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.748272+0000", 2023-10-08T07:06:59.762 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0014464689999999999, 2023-10-08T07:06:59.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001567525, 2023-10-08T07:06:59.762 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:59.762 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:59.762 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:59.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:59.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748272+0000", 2023-10-08T07:06:59.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:59.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748272+0000", 2023-10-08T07:06:59.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:59.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748272+0000", 2023-10-08T07:06:59.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.37e-07 2023-10-08T07:06:59.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:59.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748286+0000", 2023-10-08T07:06:59.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4012999999999999e-05 2023-10-08T07:06:59.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:59.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748299+0000", 2023-10-08T07:06:59.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2468e-05 2023-10-08T07:06:59.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748306+0000", 2023-10-08T07:06:59.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5889999999999997e-06 2023-10-08T07:06:59.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:59.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748352+0000", 2023-10-08T07:06:59.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5210000000000003e-05 2023-10-08T07:06:59.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748365+0000", 2023-10-08T07:06:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2846e-05 2023-10-08T07:06:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:38071 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2236416~8192 in=8192b,write 2248704~4096 in=4096b,write 2269184~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:06:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.748606+0000", 2023-10-08T07:06:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0011125779999999999, 2023-10-08T07:06:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0012714849999999999, 2023-10-08T07:06:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:06:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 38071 2023-10-08T07:06:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:59.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748606+0000", 2023-10-08T07:06:59.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:59.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748606+0000", 2023-10-08T07:06:59.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:59.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748606+0000", 2023-10-08T07:06:59.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1800000000000005e-07 2023-10-08T07:06:59.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:59.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748620+0000", 2023-10-08T07:06:59.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3081999999999999e-05 2023-10-08T07:06:59.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:59.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748631+0000", 2023-10-08T07:06:59.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1756999999999999e-05 2023-10-08T07:06:59.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748641+0000", 2023-10-08T07:06:59.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9809999999999998e-06 2023-10-08T07:06:59.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:59.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748714+0000", 2023-10-08T07:06:59.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2818000000000007e-05 2023-10-08T07:06:59.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:59.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.748821+0000", 2023-10-08T07:06:59.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010737499999999999 2023-10-08T07:06:59.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:06:59.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749022+0000", 2023-10-08T07:06:59.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020053700000000001 2023-10-08T07:06:59.772 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.772 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:59.772 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.772 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:38073 4.3a 4.d27c18fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:06:59.772 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.749537+0000", 2023-10-08T07:06:59.773 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00018081299999999999, 2023-10-08T07:06:59.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00042322799999999999, 2023-10-08T07:06:59.773 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:59.773 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:06:59.773 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:59.773 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:59.773 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.773 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 38073 2023-10-08T07:06:59.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.773 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:59.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:59.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749537+0000", 2023-10-08T07:06:59.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:59.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749537+0000", 2023-10-08T07:06:59.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:59.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749538+0000", 2023-10-08T07:06:59.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4399999999999999e-07 2023-10-08T07:06:59.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:59.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749548+0000", 2023-10-08T07:06:59.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3980000000000005e-06 2023-10-08T07:06:59.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:59.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749556+0000", 2023-10-08T07:06:59.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2919999999999996e-06 2023-10-08T07:06:59.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749561+0000", 2023-10-08T07:06:59.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0159999999999999e-06 2023-10-08T07:06:59.777 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.777 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:59.777 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.777 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:38074 4.e 4:70352312:::10000000004.0000001a:head [write 663552~4096 in=4096b,write 999424~4096 in=4096b,write 1134592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:06:59.777 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.749771+0000", 2023-10-08T07:06:59.777 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9999471, 2023-10-08T07:06:59.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00025357199999999998, 2023-10-08T07:06:59.777 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:59.778 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:59.778 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:59.778 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:59.778 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.778 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 38074 2023-10-08T07:06:59.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.778 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:59.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:59.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749771+0000", 2023-10-08T07:06:59.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:59.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749771+0000", 2023-10-08T07:06:59.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:59.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749772+0000", 2023-10-08T07:06:59.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8999999999999996e-07 2023-10-08T07:06:59.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:59.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749780+0000", 2023-10-08T07:06:59.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.636e-06 2023-10-08T07:06:59.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:59.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749787+0000", 2023-10-08T07:06:59.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4250000000000003e-06 2023-10-08T07:06:59.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749791+0000", 2023-10-08T07:06:59.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4229999999999998e-06 2023-10-08T07:06:59.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:59.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749840+0000", 2023-10-08T07:06:59.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9230000000000001e-05 2023-10-08T07:06:59.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:59.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.749902+0000", 2023-10-08T07:06:59.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1433999999999995e-05 2023-10-08T07:06:59.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.782 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:59.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.782 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:38053 4.2 4:40ea7945:::10000000004.0000003e:head [write 3301376~8192 in=8192b,write 3354624~4096 in=4096b,write 3383296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:06:59.782 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.742537+0000", 2023-10-08T07:06:59.783 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0071812960000000002, 2023-10-08T07:06:59.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0075651349999999997, 2023-10-08T07:06:59.783 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:59.783 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:59.783 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:06:59.783 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:06:59.783 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:06:59.783 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 38053 2023-10-08T07:06:59.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.783 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:59.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:59.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.742537+0000", 2023-10-08T07:06:59.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:59.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.742537+0000", 2023-10-08T07:06:59.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:59.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.742538+0000", 2023-10-08T07:06:59.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7299999999999995e-07 2023-10-08T07:06:59.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:59.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.742563+0000", 2023-10-08T07:06:59.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5140999999999999e-05 2023-10-08T07:06:59.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:59.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.742578+0000", 2023-10-08T07:06:59.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5381999999999999e-05 2023-10-08T07:06:59.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.742583+0000", 2023-10-08T07:06:59.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2619999999999998e-06 2023-10-08T07:06:59.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:59.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.744007+0000", 2023-10-08T07:06:59.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001424027 2023-10-08T07:06:59.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:59.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.744057+0000", 2023-10-08T07:06:59.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9759000000000003e-05 2023-10-08T07:06:59.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.787 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:59.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.788 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:38060 4.0 e48/17 4:02bf98b6:::10000000004.0000000e:head v 48'571, mlcod=48'569)", 2023-10-08T07:06:59.788 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.745113+0000", 2023-10-08T07:06:59.788 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0046052970000000004, 2023-10-08T07:06:59.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.005041406, 2023-10-08T07:06:59.788 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:59.788 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:59.788 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:59.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:59.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.745113+0000", 2023-10-08T07:06:59.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:59.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.745113+0000", 2023-10-08T07:06:59.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:59.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.745114+0000", 2023-10-08T07:06:59.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6199999999999997e-07 2023-10-08T07:06:59.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:59.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.745129+0000", 2023-10-08T07:06:59.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5775999999999999e-05 2023-10-08T07:06:59.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:59.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.745141+0000", 2023-10-08T07:06:59.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2035000000000001e-05 2023-10-08T07:06:59.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.745150+0000", 2023-10-08T07:06:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6580000000000008e-06 2023-10-08T07:06:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.745203+0000", 2023-10-08T07:06:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3258999999999999e-05 2023-10-08T07:06:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:59.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.745217+0000", 2023-10-08T07:06:59.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3371e-05 2023-10-08T07:06:59.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.792 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:59.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.793 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:38066 4.29 e48/17 4:94216392:::10000000004.0000002b:head v 48'602, mlcod=48'600)", 2023-10-08T07:06:59.793 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.747101+0000", 2023-10-08T07:06:59.793 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0026174850000000001, 2023-10-08T07:06:59.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031148619999999999, 2023-10-08T07:06:59.793 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:06:59.794 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:06:59.794 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:06:59.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:06:59.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747101+0000", 2023-10-08T07:06:59.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:06:59.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747101+0000", 2023-10-08T07:06:59.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:06:59.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:06:59.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747101+0000", 2023-10-08T07:06:59.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4799999999999998e-07 2023-10-08T07:06:59.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:06:59.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747131+0000", 2023-10-08T07:06:59.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9833999999999999e-05 2023-10-08T07:06:59.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:06:59.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747141+0000", 2023-10-08T07:06:59.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5540000000000003e-06 2023-10-08T07:06:59.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:06:59.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747147+0000", 2023-10-08T07:06:59.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.925e-06 2023-10-08T07:06:59.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:06:59.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747194+0000", 2023-10-08T07:06:59.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7098000000000002e-05 2023-10-08T07:06:59.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:06:59.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:06:59.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:06:59.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.747213+0000", 2023-10-08T07:06:59.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.914e-05 2023-10-08T07:06:59.797 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.797 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:06:59.797 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.797 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:06:59.798 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:06:59.798 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 9 2023-10-08T07:06:59.798 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:06:59.799 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:06:59.798+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:06:59.800 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:06:59.900 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:59.899+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:00.000 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:06:59.999+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:00.022 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:00.022 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:00.023 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:00.023 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:00.023 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:00.037 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:00.121 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:00.120+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:00.202 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:00.201+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:00.232 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2023-10-08T07:07:00.263 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:00.264 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:00.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:00.264 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:00.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.264 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-10-08T07:07:00.264 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:07:00.264 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 86.943166449000003, 2023-10-08T07:07:00.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016812437, 2023-10-08T07:07:00.264 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.264 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.265 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.265 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:07:00.265 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.265 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317661+0000", 2023-10-08T07:07:00.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317662+0000", 2023-10-08T07:07:00.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:07:00.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317667+0000", 2023-10-08T07:07:00.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:07:00.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317692+0000", 2023-10-08T07:07:00.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5488999999999999e-05 2023-10-08T07:07:00.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.317702+0000", 2023-10-08T07:07:00.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:07:00.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329634+0000", 2023-10-08T07:07:00.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011932702 2023-10-08T07:07:00.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.269 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329764+0000", 2023-10-08T07:07:00.269 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012916100000000001 2023-10-08T07:07:00.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.269 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 1", 2023-10-08T07:07:00.269 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.329925+0000", 2023-10-08T07:07:00.269 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000160977 2023-10-08T07:07:00.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.269 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.270 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.332766+0000", 2023-10-08T07:07:00.270 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002841143 2023-10-08T07:07:00.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.270 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334399+0000", 2023-10-08T07:07:00.270 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016330920000000001 2023-10-08T07:07:00.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334437+0000", 2023-10-08T07:07:00.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7709000000000001e-05 2023-10-08T07:07:00.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:05:33.334474+0000", 2023-10-08T07:07:00.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7159000000000001e-05 2023-10-08T07:07:00.271 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.271 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.271 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.272 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:1379 4.e 4:70352312:::10000000004.0000001a:head [write 3547136~4096,write 3588096~4096,write 3772416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:07:00.272 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:07:00.272 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.441342321, 2023-10-08T07:07:00.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016369865000000001, 2023-10-08T07:07:00.272 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.272 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.272 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.272 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.272 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.272 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 1379 2023-10-08T07:07:00.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.273 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.273 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:07:00.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.274 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.274 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819485+0000", 2023-10-08T07:07:00.274 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.275 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.275 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819486+0000", 2023-10-08T07:07:00.275 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:07:00.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.275 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.276 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819560+0000", 2023-10-08T07:07:00.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4473000000000003e-05 2023-10-08T07:07:00.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.276 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819571+0000", 2023-10-08T07:07:00.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0769e-05 2023-10-08T07:07:00.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.819576+0000", 2023-10-08T07:07:00.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5410000000000002e-06 2023-10-08T07:07:00.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.821667+0000", 2023-10-08T07:07:00.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020909069999999999 2023-10-08T07:07:00.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.821747+0000", 2023-10-08T07:07:00.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0260999999999996e-05 2023-10-08T07:07:00.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835701+0000", 2023-10-08T07:07:00.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013954148 2023-10-08T07:07:00.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835762+0000", 2023-10-08T07:07:00.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.084e-05 2023-10-08T07:07:00.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:45.835855+0000", 2023-10-08T07:07:00.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3425999999999996e-05 2023-10-08T07:07:00.279 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.280 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.280 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.280 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2064 4.32 4:4efc9492:::10000000004.00000032:head [write 110592~4096,write 249856~4096,write 270336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:07:00.280 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:07:00.280 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.202996795000001, 2023-10-08T07:07:00.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019126292, 2023-10-08T07:07:00.280 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.280 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.280 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.281 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.281 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.281 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2064 2023-10-08T07:07:00.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.281 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.281 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.281 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.281 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:07:00.281 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:07:00.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057832+0000", 2023-10-08T07:07:00.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3699999999999999e-07 2023-10-08T07:07:00.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.283 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057886+0000", 2023-10-08T07:07:00.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4531999999999999e-05 2023-10-08T07:07:00.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.283 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057901+0000", 2023-10-08T07:07:00.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4518999999999999e-05 2023-10-08T07:07:00.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.284 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.284 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057910+0000", 2023-10-08T07:07:00.284 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4579999999999999e-06 2023-10-08T07:07:00.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.284 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.284 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057963+0000", 2023-10-08T07:07:00.284 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3161000000000001e-05 2023-10-08T07:07:00.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.285 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.058023+0000", 2023-10-08T07:07:00.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0027e-05 2023-10-08T07:07:00.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.287 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076814+0000", 2023-10-08T07:07:00.287 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018790187 2023-10-08T07:07:00.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.287 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.287 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.287 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076879+0000", 2023-10-08T07:07:00.287 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4999999999999994e-05 2023-10-08T07:07:00.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.288 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076957+0000", 2023-10-08T07:07:00.288 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8571000000000004e-05 2023-10-08T07:07:00.288 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.288 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.288 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.288 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2068 4.1a 4:5a59f83a:::10000000004.00000002:head [write 1794048~4096,write 1806336~4096,write 1937408~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:07:00.288 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:07:00.288 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.201820385, 2023-10-08T07:07:00.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017795372, 2023-10-08T07:07:00.289 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.289 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.289 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.289 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.289 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.289 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2068 2023-10-08T07:07:00.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.289 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.289 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.289 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:07:00.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.290 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.290 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059007+0000", 2023-10-08T07:07:00.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.290 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.290 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059008+0000", 2023-10-08T07:07:00.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1299999999999998e-07 2023-10-08T07:07:00.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.291 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.291 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059061+0000", 2023-10-08T07:07:00.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2905000000000003e-05 2023-10-08T07:07:00.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.291 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.291 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059077+0000", 2023-10-08T07:07:00.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6099e-05 2023-10-08T07:07:00.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059088+0000", 2023-10-08T07:07:00.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1056000000000001e-05 2023-10-08T07:07:00.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059146+0000", 2023-10-08T07:07:00.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7385e-05 2023-10-08T07:07:00.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059210+0000", 2023-10-08T07:07:00.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4509000000000002e-05 2023-10-08T07:07:00.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.059307+0000", 2023-10-08T07:07:00.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6273000000000005e-05 2023-10-08T07:07:00.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.060916+0000", 2023-10-08T07:07:00.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001609365 2023-10-08T07:07:00.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076698+0000", 2023-10-08T07:07:00.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015781951999999998 2023-10-08T07:07:00.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076762+0000", 2023-10-08T07:07:00.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3744999999999994e-05 2023-10-08T07:07:00.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.297 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076803+0000", 2023-10-08T07:07:00.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1170000000000001e-05 2023-10-08T07:07:00.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.297 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.297 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2087 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1101824~12288,write 1150976~4096,write 1171456~4096,write 1265664~4096,write 1376256~4096,write 1519616~4096,write 1691648~4096,write 1724416~4096,write 1753088~4096,write 1794048~4096,write 1908736~4096,write 1921024~4096,write 2011136~4096,write 2207744~4096,write 2285568~4096,write 2744320~8192,write 2760704~4096,write 2879488~4096,write 2891776~4096,write 3129344~4096,write 3145728~4096,write 3215360~4096,write 3330048~8192,write 3362816~4096,write 3387392~4096,write 3485696~4096,write 3620864~4096,write 4120576~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:07:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:07:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.196849936, 2023-10-08T07:07:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016557490000000001, 2023-10-08T07:07:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2087 2023-10-08T07:07:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:07:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:07:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.063978+0000", 2023-10-08T07:07:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:07:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064123+0000", 2023-10-08T07:07:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014467700000000001 2023-10-08T07:07:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064131+0000", 2023-10-08T07:07:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9230000000000002e-06 2023-10-08T07:07:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064139+0000", 2023-10-08T07:07:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5560000000000002e-06 2023-10-08T07:07:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.073553+0000", 2023-10-08T07:07:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0094146679999999993 2023-10-08T07:07:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.073655+0000", 2023-10-08T07:07:00.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010128000000000001 2023-10-08T07:07:00.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.074076+0000", 2023-10-08T07:07:00.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00042132399999999999 2023-10-08T07:07:00.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.077289+0000", 2023-10-08T07:07:00.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032133589999999998 2023-10-08T07:07:00.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.303 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080463+0000", 2023-10-08T07:07:00.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031740940000000001 2023-10-08T07:07:00.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.303 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080512+0000", 2023-10-08T07:07:00.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8343000000000001e-05 2023-10-08T07:07:00.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.080535+0000", 2023-10-08T07:07:00.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3586000000000001e-05 2023-10-08T07:07:00.304 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.304 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.304 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.304 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2088 4.2a 4:5404a18c:::10000000004.00000025:head [write 774144~4096,write 811008~4096,write 884736~4096,write 909312~4096,write 958464~4096,write 1028096~4096,write 1191936~4096,write 1224704~4096,write 1261568~4096,write 1294336~4096,write 1331200~4096,write 1523712~4096,write 1540096~4096,write 1572864~4096,write 1667072~4096,write 1810432~4096,write 1818624~4096,write 1859584~4096,write 1892352~4096,write 1916928~4096,write 2084864~4096,write 2158592~4096,write 2494464~4096,write 2543616~4096,write 2703360~4096,write 2748416~8192,write 2777088~4096,write 3784704~4096,write 3911680~4096,write 4120576~4096,write 4145152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:07:00.304 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:07:00.304 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.196665837999999, 2023-10-08T07:07:00.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017312658000000002, 2023-10-08T07:07:00.305 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.305 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.305 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.305 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.305 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.305 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2088 2023-10-08T07:07:00.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.305 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:07:00.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064162+0000", 2023-10-08T07:07:00.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064163+0000", 2023-10-08T07:07:00.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:07:00.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064375+0000", 2023-10-08T07:07:00.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00021216599999999999 2023-10-08T07:07:00.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064385+0000", 2023-10-08T07:07:00.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0525e-05 2023-10-08T07:07:00.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.064395+0000", 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1689999999999998e-06 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076644+0000", 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012248991000000001 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076709+0000", 2023-10-08T07:07:00.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5708000000000002e-05 2023-10-08T07:07:00.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081362+0000", 2023-10-08T07:07:00.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0046527449999999998 2023-10-08T07:07:00.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081425+0000", 2023-10-08T07:07:00.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3250000000000006e-05 2023-10-08T07:07:00.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.310 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.081475+0000", 2023-10-08T07:07:00.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9246999999999998e-05 2023-10-08T07:07:00.310 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.310 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.310 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.310 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:14150 4.30 4:0f322a22:::10000000004.00000014:head [write 409600~4096,write 679936~4096,write 724992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:07:00.310 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:07:00.310 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.5862741929999995, 2023-10-08T07:07:00.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018347558999999999, 2023-10-08T07:07:00.311 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.311 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.311 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.311 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.311 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.311 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 14150 2023-10-08T07:07:00.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.311 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.311 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:07:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:07:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674554+0000", 2023-10-08T07:07:00.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1200000000000002e-07 2023-10-08T07:07:00.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674566+0000", 2023-10-08T07:07:00.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1438e-05 2023-10-08T07:07:00.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674576+0000", 2023-10-08T07:07:00.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0259e-05 2023-10-08T07:07:00.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.314 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674590+0000", 2023-10-08T07:07:00.314 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.375e-05 2023-10-08T07:07:00.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.314 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674644+0000", 2023-10-08T07:07:00.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3878000000000002e-05 2023-10-08T07:07:00.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.315 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674755+0000", 2023-10-08T07:07:00.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011113 2023-10-08T07:07:00.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.316 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.674931+0000", 2023-10-08T07:07:00.316 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000176587 2023-10-08T07:07:00.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.316 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.316 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.676318+0000", 2023-10-08T07:07:00.316 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0013863040000000001 2023-10-08T07:07:00.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.317 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.317 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.692819+0000", 2023-10-08T07:07:00.317 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016501722999999999 2023-10-08T07:07:00.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.318 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.692876+0000", 2023-10-08T07:07:00.318 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7005000000000001e-05 2023-10-08T07:07:00.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.318 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.692901+0000", 2023-10-08T07:07:00.318 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4672999999999999e-05 2023-10-08T07:07:00.319 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.319 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.319 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.319 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:14642 4.20 4:04004f2c:::10000000004.0000000d:head [write 1359872~4096,write 1409024~4096,write 1449984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-10-08T07:07:00.319 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:07:00.319 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.4083079820000002, 2023-10-08T07:07:00.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016449921999999999, 2023-10-08T07:07:00.320 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.320 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.320 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.320 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.320 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.320 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 14642 2023-10-08T07:07:00.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.320 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:07:00.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:07:00.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852520+0000", 2023-10-08T07:07:00.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9999999999999997e-07 2023-10-08T07:07:00.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852556+0000", 2023-10-08T07:07:00.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5413999999999997e-05 2023-10-08T07:07:00.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852570+0000", 2023-10-08T07:07:00.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3735e-05 2023-10-08T07:07:00.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852577+0000", 2023-10-08T07:07:00.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1879999999999996e-06 2023-10-08T07:07:00.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852632+0000", 2023-10-08T07:07:00.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4753999999999998e-05 2023-10-08T07:07:00.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852719+0000", 2023-10-08T07:07:00.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7699000000000002e-05 2023-10-08T07:07:00.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.324 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.324 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.852863+0000", 2023-10-08T07:07:00.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000143852 2023-10-08T07:07:00.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.324 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.324 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.857758+0000", 2023-10-08T07:07:00.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048950629999999998 2023-10-08T07:07:00.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.868863+0000", 2023-10-08T07:07:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011104563 2023-10-08T07:07:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.868928+0000", 2023-10-08T07:07:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5610000000000004e-05 2023-10-08T07:07:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:50.868970+0000", 2023-10-08T07:07:00.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1344000000000003e-05 2023-10-08T07:07:00.326 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.326 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.326 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.326 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:15687 4.c 4:3352c333:::10000000004.00000012:head [write 794624~4096,write 925696~4096,write 933888~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-10-08T07:07:00.326 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:51.262061+0000", 2023-10-08T07:07:00.326 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.998766818, 2023-10-08T07:07:00.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016886580000000002, 2023-10-08T07:07:00.327 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.327 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.327 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.327 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.327 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.327 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 15687 2023-10-08T07:07:00.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.327 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.327 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262061+0000", 2023-10-08T07:07:00.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.328 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262061+0000", 2023-10-08T07:07:00.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262062+0000", 2023-10-08T07:07:00.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9000000000000005e-07 2023-10-08T07:07:00.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262078+0000", 2023-10-08T07:07:00.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6322999999999999e-05 2023-10-08T07:07:00.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262091+0000", 2023-10-08T07:07:00.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2323999999999999e-05 2023-10-08T07:07:00.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.262106+0000", 2023-10-08T07:07:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5245999999999999e-05 2023-10-08T07:07:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.265173+0000", 2023-10-08T07:07:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003067148 2023-10-08T07:07:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.265267+0000", 2023-10-08T07:07:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3949000000000005e-05 2023-10-08T07:07:00.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.332 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.332 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.265420+0000", 2023-10-08T07:07:00.332 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015336500000000001 2023-10-08T07:07:00.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.332 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.332 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.270637+0000", 2023-10-08T07:07:00.332 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052167990000000003 2023-10-08T07:07:00.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.332 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.278841+0000", 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0082038530000000005 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.278903+0000", 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1673000000000004e-05 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:51.278948+0000", 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4910000000000002e-05 2023-10-08T07:07:00.333 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.334 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.334 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.334 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:26065 4.2c 4:352c144c:::10000000004.00000003:head [write 2613248~4096,write 2633728~4096,write 2703360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-10-08T07:07:00.334 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:55.161166+0000", 2023-10-08T07:07:00.334 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.0996615160000003, 2023-10-08T07:07:00.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017045265, 2023-10-08T07:07:00.334 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.334 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.335 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.335 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.335 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.335 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 26065 2023-10-08T07:07:00.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.335 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161166+0000", 2023-10-08T07:07:00.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161166+0000", 2023-10-08T07:07:00.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161167+0000", 2023-10-08T07:07:00.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8000000000000005e-07 2023-10-08T07:07:00.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.337 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.337 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161177+0000", 2023-10-08T07:07:00.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7399999999999999e-06 2023-10-08T07:07:00.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.337 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.337 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161199+0000", 2023-10-08T07:07:00.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2013000000000001e-05 2023-10-08T07:07:00.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.337 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161206+0000", 2023-10-08T07:07:00.338 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.956e-06 2023-10-08T07:07:00.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161246+0000", 2023-10-08T07:07:00.338 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0259000000000002e-05 2023-10-08T07:07:00.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161325+0000", 2023-10-08T07:07:00.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9190000000000006e-05 2023-10-08T07:07:00.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.161448+0000", 2023-10-08T07:07:00.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012301599999999999 2023-10-08T07:07:00.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.175430+0000", 2023-10-08T07:07:00.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013981675000000001 2023-10-08T07:07:00.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.178084+0000", 2023-10-08T07:07:00.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0026542890000000002 2023-10-08T07:07:00.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.178189+0000", 2023-10-08T07:07:00.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000104647 2023-10-08T07:07:00.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.341 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:55.178212+0000", 2023-10-08T07:07:00.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.27e-05 2023-10-08T07:07:00.341 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.341 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.341 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.341 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36109 4.2b 4:d7a77d67:::10000000004.00000029:head [write 2060288~4096,write 2220032~4096,write 2228224~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:00.342 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:58.991606+0000", 2023-10-08T07:07:00.342 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.2692220789999999, 2023-10-08T07:07:00.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017237974, 2023-10-08T07:07:00.342 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.342 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.342 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.342 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.342 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.342 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36109 2023-10-08T07:07:00.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.342 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.991606+0000", 2023-10-08T07:07:00.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.991606+0000", 2023-10-08T07:07:00.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.991606+0000", 2023-10-08T07:07:00.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0500000000000003e-07 2023-10-08T07:07:00.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.991616+0000", 2023-10-08T07:07:00.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5370000000000003e-06 2023-10-08T07:07:00.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.991624+0000", 2023-10-08T07:07:00.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0439999999999996e-06 2023-10-08T07:07:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.991628+0000", 2023-10-08T07:07:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4050000000000002e-06 2023-10-08T07:07:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.991680+0000", 2023-10-08T07:07:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2105999999999999e-05 2023-10-08T07:07:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.991758+0000", 2023-10-08T07:07:00.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7886999999999995e-05 2023-10-08T07:07:00.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.991848+0000", 2023-10-08T07:07:00.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9722999999999995e-05 2023-10-08T07:07:00.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.994645+0000", 2023-10-08T07:07:00.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027967560000000001 2023-10-08T07:07:00.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.347 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.347 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.008753+0000", 2023-10-08T07:07:00.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014108541 2023-10-08T07:07:00.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.347 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.347 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.008808+0000", 2023-10-08T07:07:00.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4744999999999998e-05 2023-10-08T07:07:00.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.348 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.348 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.008844+0000", 2023-10-08T07:07:00.348 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5624999999999999e-05 2023-10-08T07:07:00.348 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.348 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.348 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.348 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36130 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 3895296~4096,write 3911680~4096,write 4141056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:00.348 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:58.999137+0000", 2023-10-08T07:07:00.349 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.2616909869999999, 2023-10-08T07:07:00.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018936008000000001, 2023-10-08T07:07:00.349 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.349 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.349 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.349 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.349 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.349 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36130 2023-10-08T07:07:00.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.349 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.999137+0000", 2023-10-08T07:07:00.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.999137+0000", 2023-10-08T07:07:00.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.999137+0000", 2023-10-08T07:07:00.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4499999999999997e-07 2023-10-08T07:07:00.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.351 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.351 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.999145+0000", 2023-10-08T07:07:00.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4560000000000003e-06 2023-10-08T07:07:00.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.351 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.351 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.999152+0000", 2023-10-08T07:07:00.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2699999999999999e-06 2023-10-08T07:07:00.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.999156+0000", 2023-10-08T07:07:00.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3900000000000003e-06 2023-10-08T07:07:00.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000909+0000", 2023-10-08T07:07:00.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001752853 2023-10-08T07:07:00.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000974+0000", 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4768000000000001e-05 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.001112+0000", 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000137918 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.015718+0000", 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014606156 2023-10-08T07:07:00.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.354 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.354 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.017977+0000", 2023-10-08T07:07:00.354 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022591289999999999 2023-10-08T07:07:00.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.354 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.354 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.018028+0000", 2023-10-08T07:07:00.354 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.113e-05 2023-10-08T07:07:00.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.355 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.018073+0000", 2023-10-08T07:07:00.355 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4393e-05 2023-10-08T07:07:00.355 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.355 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.355 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.355 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36135 4.1b 4:d97fb168:::10000000004.00000008:head [write 3981312~8192,write 4050944~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:00.355 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.000619+0000", 2023-10-08T07:07:00.355 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.2602085110000001, 2023-10-08T07:07:00.356 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019040867999999999, 2023-10-08T07:07:00.356 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.356 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.356 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.356 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.356 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.356 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36135 2023-10-08T07:07:00.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.356 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.356 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.356 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.356 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000619+0000", 2023-10-08T07:07:00.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000619+0000", 2023-10-08T07:07:00.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000620+0000", 2023-10-08T07:07:00.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.23e-07 2023-10-08T07:07:00.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000644+0000", 2023-10-08T07:07:00.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3949999999999999e-05 2023-10-08T07:07:00.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000657+0000", 2023-10-08T07:07:00.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2604e-05 2023-10-08T07:07:00.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000664+0000", 2023-10-08T07:07:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.926e-06 2023-10-08T07:07:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.004936+0000", 2023-10-08T07:07:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042710780000000002 2023-10-08T07:07:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.359 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.004987+0000", 2023-10-08T07:07:00.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1848000000000002e-05 2023-10-08T07:07:00.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.360 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.005077+0000", 2023-10-08T07:07:00.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0117999999999993e-05 2023-10-08T07:07:00.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.360 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.018082+0000", 2023-10-08T07:07:00.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013004454 2023-10-08T07:07:00.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.019605+0000", 2023-10-08T07:07:00.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001523513 2023-10-08T07:07:00.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.019639+0000", 2023-10-08T07:07:00.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3105999999999998e-05 2023-10-08T07:07:00.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.019660+0000", 2023-10-08T07:07:00.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1548000000000001e-05 2023-10-08T07:07:00.362 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.362 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.362 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.362 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36584 4.1a 4:5a59f83a:::10000000004.00000002:head [write 2334720~4096,write 2727936~4096,write 2785280~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:00.362 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.164916+0000", 2023-10-08T07:07:00.362 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.0959117599999999, 2023-10-08T07:07:00.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020061165999999998, 2023-10-08T07:07:00.363 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.363 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.363 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.363 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.363 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.363 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36584 2023-10-08T07:07:00.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.363 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.363 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.164916+0000", 2023-10-08T07:07:00.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.364 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.364 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.164916+0000", 2023-10-08T07:07:00.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.364 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.364 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.164917+0000", 2023-10-08T07:07:00.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4300000000000002e-07 2023-10-08T07:07:00.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.164956+0000", 2023-10-08T07:07:00.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9496000000000003e-05 2023-10-08T07:07:00.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.164964+0000", 2023-10-08T07:07:00.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2799999999999998e-06 2023-10-08T07:07:00.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.164968+0000", 2023-10-08T07:07:00.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1139999999999999e-06 2023-10-08T07:07:00.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.166928+0000", 2023-10-08T07:07:00.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0019605209999999998 2023-10-08T07:07:00.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167002+0000", 2023-10-08T07:07:00.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4194000000000001e-05 2023-10-08T07:07:00.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.367 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.367 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167140+0000", 2023-10-08T07:07:00.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000137768 2023-10-08T07:07:00.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.367 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.367 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.173717+0000", 2023-10-08T07:07:00.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065771919999999999 2023-10-08T07:07:00.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.184920+0000", 2023-10-08T07:07:00.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011202782999999999 2023-10-08T07:07:00.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.184954+0000", 2023-10-08T07:07:00.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4298999999999998e-05 2023-10-08T07:07:00.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.184977+0000", 2023-10-08T07:07:00.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2776e-05 2023-10-08T07:07:00.369 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.369 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.369 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.369 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36590 4.c 4:31e28161:::10000000004.00000011:head [write 3534848~4096,write 3551232~4096,write 3559424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:00.369 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.166869+0000", 2023-10-08T07:07:00.369 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.093958985, 2023-10-08T07:07:00.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018029144, 2023-10-08T07:07:00.369 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.370 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.370 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.370 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.370 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.370 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36590 2023-10-08T07:07:00.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.370 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.166869+0000", 2023-10-08T07:07:00.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.166869+0000", 2023-10-08T07:07:00.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.166869+0000", 2023-10-08T07:07:00.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0699999999999996e-07 2023-10-08T07:07:00.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.372 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.166881+0000", 2023-10-08T07:07:00.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1887e-05 2023-10-08T07:07:00.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.372 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.166892+0000", 2023-10-08T07:07:00.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0358e-05 2023-10-08T07:07:00.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.372 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.166901+0000", 2023-10-08T07:07:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3000000000000007e-06 2023-10-08T07:07:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.166950+0000", 2023-10-08T07:07:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9051999999999997e-05 2023-10-08T07:07:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167023+0000", 2023-10-08T07:07:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3170999999999995e-05 2023-10-08T07:07:00.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167115+0000", 2023-10-08T07:07:00.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1334000000000003e-05 2023-10-08T07:07:00.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.173541+0000", 2023-10-08T07:07:00.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0064266719999999996 2023-10-08T07:07:00.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.184782+0000", 2023-10-08T07:07:00.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011240303 2023-10-08T07:07:00.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.184849+0000", 2023-10-08T07:07:00.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7408000000000002e-05 2023-10-08T07:07:00.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.184898+0000", 2023-10-08T07:07:00.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8952000000000002e-05 2023-10-08T07:07:00.376 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.376 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.376 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.376 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36591 4.38 4:1e0977c7:::10000000004.00000022:head [write 954368~4096,write 1089536~4096,write 1118208~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:00.376 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.167358+0000", 2023-10-08T07:07:00.376 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.093469966, 2023-10-08T07:07:00.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.02065931, 2023-10-08T07:07:00.377 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.377 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.377 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.377 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.377 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.377 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36591 2023-10-08T07:07:00.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.377 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.377 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167358+0000", 2023-10-08T07:07:00.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.378 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167358+0000", 2023-10-08T07:07:00.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.378 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167358+0000", 2023-10-08T07:07:00.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6899999999999997e-07 2023-10-08T07:07:00.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167369+0000", 2023-10-08T07:07:00.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1042e-05 2023-10-08T07:07:00.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167377+0000", 2023-10-08T07:07:00.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7649999999999993e-06 2023-10-08T07:07:00.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.380 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167382+0000", 2023-10-08T07:07:00.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7539999999999997e-06 2023-10-08T07:07:00.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.380 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167425+0000", 2023-10-08T07:07:00.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.269e-05 2023-10-08T07:07:00.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167474+0000", 2023-10-08T07:07:00.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9515999999999998e-05 2023-10-08T07:07:00.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.381 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167566+0000", 2023-10-08T07:07:00.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1402000000000003e-05 2023-10-08T07:07:00.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.381 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.173487+0000", 2023-10-08T07:07:00.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0059214910000000001 2023-10-08T07:07:00.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.187922+0000", 2023-10-08T07:07:00.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014435353999999999 2023-10-08T07:07:00.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.187965+0000", 2023-10-08T07:07:00.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2061999999999998e-05 2023-10-08T07:07:00.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.188017+0000", 2023-10-08T07:07:00.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2565000000000002e-05 2023-10-08T07:07:00.383 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.383 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.383 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.383 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36592 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 933888~4096,write 1015808~4096,write 1024000~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:00.383 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.167713+0000", 2023-10-08T07:07:00.383 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.093114691, 2023-10-08T07:07:00.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017825901000000002, 2023-10-08T07:07:00.384 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.384 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.384 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.384 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.384 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.384 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36592 2023-10-08T07:07:00.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.384 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.384 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167713+0000", 2023-10-08T07:07:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167713+0000", 2023-10-08T07:07:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167714+0000", 2023-10-08T07:07:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6400000000000001e-07 2023-10-08T07:07:00.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.386 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.386 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167725+0000", 2023-10-08T07:07:00.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1593999999999999e-05 2023-10-08T07:07:00.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.386 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.386 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167736+0000", 2023-10-08T07:07:00.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0207000000000001e-05 2023-10-08T07:07:00.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.387 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167742+0000", 2023-10-08T07:07:00.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8650000000000003e-06 2023-10-08T07:07:00.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.387 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168360+0000", 2023-10-08T07:07:00.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00061797600000000001 2023-10-08T07:07:00.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168443+0000", 2023-10-08T07:07:00.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2832999999999998e-05 2023-10-08T07:07:00.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168598+0000", 2023-10-08T07:07:00.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000154377 2023-10-08T07:07:00.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.176030+0000", 2023-10-08T07:07:00.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074321420000000001 2023-10-08T07:07:00.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.185451+0000", 2023-10-08T07:07:00.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0094216019999999994 2023-10-08T07:07:00.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.185505+0000", 2023-10-08T07:07:00.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3458000000000002e-05 2023-10-08T07:07:00.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.185539+0000", 2023-10-08T07:07:00.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4082999999999999e-05 2023-10-08T07:07:00.390 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.390 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.390 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.390 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36594 4.38 4:1e0977c7:::10000000004.00000022:head [write 3059712~4096,write 3133440~4096,write 3198976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:00.390 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.168669+0000", 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.0921588799999999, 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019530400999999999, 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36594 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168669+0000", 2023-10-08T07:07:00.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.392 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168669+0000", 2023-10-08T07:07:00.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.392 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168670+0000", 2023-10-08T07:07:00.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1200000000000002e-07 2023-10-08T07:07:00.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168682+0000", 2023-10-08T07:07:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2347000000000001e-05 2023-10-08T07:07:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168695+0000", 2023-10-08T07:07:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2855e-05 2023-10-08T07:07:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168703+0000", 2023-10-08T07:07:00.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9880000000000004e-06 2023-10-08T07:07:00.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168823+0000", 2023-10-08T07:07:00.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000120086 2023-10-08T07:07:00.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168928+0000", 2023-10-08T07:07:00.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000104682 2023-10-08T07:07:00.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.169105+0000", 2023-10-08T07:07:00.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017693599999999999 2023-10-08T07:07:00.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.176001+0000", 2023-10-08T07:07:00.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00689618 2023-10-08T07:07:00.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.188074+0000", 2023-10-08T07:07:00.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012073105000000001 2023-10-08T07:07:00.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.188113+0000", 2023-10-08T07:07:00.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9520000000000001e-05 2023-10-08T07:07:00.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.188199+0000", 2023-10-08T07:07:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5890000000000006e-05 2023-10-08T07:07:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36603 4.38 4:1e0977c7:::10000000004.00000022:head [write 2863104~4096,write 2949120~12288] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.171717+0000", 2023-10-08T07:07:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.0891105889999999, 2023-10-08T07:07:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020705431, 2023-10-08T07:07:00.397 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36603 2023-10-08T07:07:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171717+0000", 2023-10-08T07:07:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171717+0000", 2023-10-08T07:07:00.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171718+0000", 2023-10-08T07:07:00.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:07:00.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.400 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171730+0000", 2023-10-08T07:07:00.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1647999999999999e-05 2023-10-08T07:07:00.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.400 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.400 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171741+0000", 2023-10-08T07:07:00.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1482e-05 2023-10-08T07:07:00.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.400 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.400 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171747+0000", 2023-10-08T07:07:00.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8529999999999997e-06 2023-10-08T07:07:00.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171799+0000", 2023-10-08T07:07:00.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2018000000000002e-05 2023-10-08T07:07:00.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171857+0000", 2023-10-08T07:07:00.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7908999999999997e-05 2023-10-08T07:07:00.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171950+0000", 2023-10-08T07:07:00.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2813999999999996e-05 2023-10-08T07:07:00.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.176466+0000", 2023-10-08T07:07:00.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045161109999999997 2023-10-08T07:07:00.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.192318+0000", 2023-10-08T07:07:00.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015852445 2023-10-08T07:07:00.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.192357+0000", 2023-10-08T07:07:00.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8512e-05 2023-10-08T07:07:00.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.192423+0000", 2023-10-08T07:07:00.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5931000000000003e-05 2023-10-08T07:07:00.403 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.404 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.404 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.404 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36755 4.3a 4:5f183e4b:::10000000004.00000023:head [write 372736~4096,write 409600~4096,write 638976~4096,write 704512~4096,write 1011712~4096,write 1019904~4096,write 1081344~4096,write 1306624~4096,write 1335296~4096,write 1363968~4096,write 1441792~4096,write 1581056~4096,write 1597440~4096,write 1691648~4096,write 1843200~4096,write 1884160~8192,write 2260992~4096,write 2326528~4096,write 2383872~4096,write 2535424~4096,write 2760704~4096,write 3256320~4096,write 3264512~4096,write 3297280~4096,write 3403776~4096,write 3502080~4096,write 3653632~4096,write 3751936~4096,write 4034560~4096,write 4075520~4096,write 4100096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:00.404 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.226377+0000", 2023-10-08T07:07:00.404 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.0344508160000001, 2023-10-08T07:07:00.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020698510999999999, 2023-10-08T07:07:00.404 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:00.404 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:00.404 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:00.404 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36755 2023-10-08T07:07:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226377+0000", 2023-10-08T07:07:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:00.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226377+0000", 2023-10-08T07:07:00.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:00.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:00.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226378+0000", 2023-10-08T07:07:00.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4199999999999995e-07 2023-10-08T07:07:00.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:00.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226439+0000", 2023-10-08T07:07:00.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1398999999999999e-05 2023-10-08T07:07:00.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:00.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226450+0000", 2023-10-08T07:07:00.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0627e-05 2023-10-08T07:07:00.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226458+0000", 2023-10-08T07:07:00.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5229999999999995e-06 2023-10-08T07:07:00.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:00.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226504+0000", 2023-10-08T07:07:00.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5847999999999999e-05 2023-10-08T07:07:00.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:00.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226609+0000", 2023-10-08T07:07:00.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000104924 2023-10-08T07:07:00.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:00.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.227180+0000", 2023-10-08T07:07:00.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057061700000000004 2023-10-08T07:07:00.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:00.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.235535+0000", 2023-10-08T07:07:00.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083550780000000002 2023-10-08T07:07:00.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:00.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.246850+0000", 2023-10-08T07:07:00.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01131573 2023-10-08T07:07:00.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:00.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.247000+0000", 2023-10-08T07:07:00.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014989100000000001 2023-10-08T07:07:00.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:00.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:00.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:00.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.247075+0000", 2023-10-08T07:07:00.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5232000000000001e-05 2023-10-08T07:07:00.410 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.410 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.410 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.410 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:00.411 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:00.411 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:00.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:00.413 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:00.411+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:00.513 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:00.512+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:00.599 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:00.599 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:00.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.599 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:40372 4.15 4:aaa619cf:::10000000004.00000004:head [write 401408~8192 in=8192b,write 507904~4096 in=4096b,write 614400~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T07:07:00.599 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:00.592031+0000", 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0059173740000000004, 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059413479999999999, 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 40372 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.592031+0000", 2023-10-08T07:07:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.592031+0000", 2023-10-08T07:07:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.592032+0000", 2023-10-08T07:07:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1489999999999999e-06 2023-10-08T07:07:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:00.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.592047+0000", 2023-10-08T07:07:00.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5277e-05 2023-10-08T07:07:00.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:00.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.592057+0000", 2023-10-08T07:07:00.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8239999999999995e-06 2023-10-08T07:07:00.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.592065+0000", 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5039999999999996e-06 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.592247+0000", 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000182318 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.592333+0000", 2023-10-08T07:07:00.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5659000000000001e-05 2023-10-08T07:07:00.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.604 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:00.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.604 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:40375 4.38 e49/46 4:1e0977c7:::10000000004.00000022:head v 49'638, mlcod=49'636)", 2023-10-08T07:07:00.604 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:00.593450+0000", 2023-10-08T07:07:00.604 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0044983999999999996, 2023-10-08T07:07:00.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004575689, 2023-10-08T07:07:00.604 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:00.604 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:00.604 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:00.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:00.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.593450+0000", 2023-10-08T07:07:00.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:00.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.593450+0000", 2023-10-08T07:07:00.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:00.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.593450+0000", 2023-10-08T07:07:00.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2399999999999998e-07 2023-10-08T07:07:00.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:00.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.593462+0000", 2023-10-08T07:07:00.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1195e-05 2023-10-08T07:07:00.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:00.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.593470+0000", 2023-10-08T07:07:00.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2549999999999997e-06 2023-10-08T07:07:00.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.593475+0000", 2023-10-08T07:07:00.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2870000000000004e-06 2023-10-08T07:07:00.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:00.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.593512+0000", 2023-10-08T07:07:00.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6959000000000003e-05 2023-10-08T07:07:00.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.593525+0000", 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2836999999999999e-05 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:40378 4.9 4:90f7d93b:::10000000004.00000021:head [write 3637248~4096 in=4096b,write 3682304~4096 in=4096b,write 3702784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:00.594094+0000", 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038542759999999998, 2023-10-08T07:07:00.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039715000000000002, 2023-10-08T07:07:00.609 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:00.609 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:00.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:00.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:00.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.609 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 40378 2023-10-08T07:07:00.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.609 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:00.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:00.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594094+0000", 2023-10-08T07:07:00.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594094+0000", 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594095+0000", 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0610000000000001e-06 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:00.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594104+0000", 2023-10-08T07:07:00.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.149e-06 2023-10-08T07:07:00.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:00.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594114+0000", 2023-10-08T07:07:00.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9240000000000002e-06 2023-10-08T07:07:00.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594120+0000", 2023-10-08T07:07:00.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2023-10-08T07:07:00.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:00.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594156+0000", 2023-10-08T07:07:00.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6028999999999997e-05 2023-10-08T07:07:00.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:00.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594203+0000", 2023-10-08T07:07:00.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7000999999999999e-05 2023-10-08T07:07:00.613 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.613 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:00.613 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.613 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:40379 4.19 4:9a1dab10:::10000000004.0000001d:head [write 2359296~4096 in=4096b,write 2592768~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T07:07:00.613 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:00.594332+0000", 2023-10-08T07:07:00.613 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003615839, 2023-10-08T07:07:00.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037762809999999998, 2023-10-08T07:07:00.613 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:00.613 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:00.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:00.614 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:00.614 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.614 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 40379 2023-10-08T07:07:00.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.614 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:00.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:00.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594332+0000", 2023-10-08T07:07:00.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:00.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594332+0000", 2023-10-08T07:07:00.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:00.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594333+0000", 2023-10-08T07:07:00.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8500000000000002e-07 2023-10-08T07:07:00.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:00.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594355+0000", 2023-10-08T07:07:00.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2433e-05 2023-10-08T07:07:00.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:00.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594362+0000", 2023-10-08T07:07:00.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1450000000000002e-06 2023-10-08T07:07:00.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594366+0000", 2023-10-08T07:07:00.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.805e-06 2023-10-08T07:07:00.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594397+0000", 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0707999999999998e-05 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594460+0000", 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2818999999999996e-05 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.618 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:40380 4.15 4:aaa619cf:::10000000004.00000004:head [write 3588096~4096 in=4096b,write 3739648~4096 in=4096b,write 3747840~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T07:07:00.618 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:00.594656+0000", 2023-10-08T07:07:00.618 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003292124, 2023-10-08T07:07:00.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035021900000000001, 2023-10-08T07:07:00.618 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:00.618 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:00.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:00.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:00.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.618 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 40380 2023-10-08T07:07:00.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.619 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:00.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:00.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594656+0000", 2023-10-08T07:07:00.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:00.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594656+0000", 2023-10-08T07:07:00.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:00.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594657+0000", 2023-10-08T07:07:00.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7800000000000002e-07 2023-10-08T07:07:00.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:00.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594674+0000", 2023-10-08T07:07:00.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7221e-05 2023-10-08T07:07:00.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:00.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594685+0000", 2023-10-08T07:07:00.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0689999999999999e-05 2023-10-08T07:07:00.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594689+0000", 2023-10-08T07:07:00.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4000000000000002e-06 2023-10-08T07:07:00.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:00.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594733+0000", 2023-10-08T07:07:00.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4129999999999999e-05 2023-10-08T07:07:00.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:00.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.594805+0000", 2023-10-08T07:07:00.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2084999999999998e-05 2023-10-08T07:07:00.624 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.624 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:00.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.625 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:40381 4.3e 4:7cb83261:::10000000004.0000003b:head [write 2535424~8192 in=8192b,write 2625536~4096 in=4096b,write 2973696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T07:07:00.625 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:00.595131+0000", 2023-10-08T07:07:00.625 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0028175769999999999, 2023-10-08T07:07:00.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030882259999999999, 2023-10-08T07:07:00.625 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:00.625 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:00.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:00.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:00.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.626 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 40381 2023-10-08T07:07:00.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.626 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:00.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:00.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.595131+0000", 2023-10-08T07:07:00.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:00.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.595131+0000", 2023-10-08T07:07:00.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:00.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.595131+0000", 2023-10-08T07:07:00.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4499999999999997e-07 2023-10-08T07:07:00.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:00.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.595154+0000", 2023-10-08T07:07:00.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3030000000000001e-05 2023-10-08T07:07:00.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:00.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.595161+0000", 2023-10-08T07:07:00.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9280000000000004e-06 2023-10-08T07:07:00.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.595165+0000", 2023-10-08T07:07:00.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3529999999999999e-06 2023-10-08T07:07:00.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:00.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.595198+0000", 2023-10-08T07:07:00.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3108000000000002e-05 2023-10-08T07:07:00.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:00.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.595275+0000", 2023-10-08T07:07:00.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7787999999999995e-05 2023-10-08T07:07:00.631 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.631 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:00.631 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.631 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:40386 4.21 4:867af9ba:::10000000004.0000000a:head [write 573440~4096 in=4096b,write 716800~4096 in=4096b,write 987136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T07:07:00.631 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:00.597002+0000", 2023-10-08T07:07:00.632 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00094625099999999995, 2023-10-08T07:07:00.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001328737, 2023-10-08T07:07:00.632 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:00.632 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:00.632 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:00.632 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:00.632 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.632 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 40386 2023-10-08T07:07:00.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.632 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:00.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:00.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597002+0000", 2023-10-08T07:07:00.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:00.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597002+0000", 2023-10-08T07:07:00.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:00.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597003+0000", 2023-10-08T07:07:00.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9000000000000005e-07 2023-10-08T07:07:00.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:00.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597016+0000", 2023-10-08T07:07:00.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3171e-05 2023-10-08T07:07:00.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:00.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597031+0000", 2023-10-08T07:07:00.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4858000000000001e-05 2023-10-08T07:07:00.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597042+0000", 2023-10-08T07:07:00.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0499999999999999e-05 2023-10-08T07:07:00.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:00.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597087+0000", 2023-10-08T07:07:00.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5636999999999997e-05 2023-10-08T07:07:00.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:00.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597143+0000", 2023-10-08T07:07:00.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5977000000000003e-05 2023-10-08T07:07:00.636 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.636 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:00.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.637 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:40385 4.a e49/17 4:524fba76:::10000000004.0000001b:head v 49'615, mlcod=49'613)", 2023-10-08T07:07:00.637 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:00.597182+0000", 2023-10-08T07:07:00.637 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00076618200000000002, 2023-10-08T07:07:00.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001232995, 2023-10-08T07:07:00.637 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:00.638 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:00.638 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:00.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:00.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597182+0000", 2023-10-08T07:07:00.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:00.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597182+0000", 2023-10-08T07:07:00.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:00.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597183+0000", 2023-10-08T07:07:00.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0500000000000003e-07 2023-10-08T07:07:00.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:00.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597197+0000", 2023-10-08T07:07:00.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4144e-05 2023-10-08T07:07:00.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:00.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597205+0000", 2023-10-08T07:07:00.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3569999999999998e-06 2023-10-08T07:07:00.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597214+0000", 2023-10-08T07:07:00.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7690000000000002e-06 2023-10-08T07:07:00.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:00.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597262+0000", 2023-10-08T07:07:00.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7728000000000001e-05 2023-10-08T07:07:00.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:00.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597309+0000", 2023-10-08T07:07:00.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6904999999999999e-05 2023-10-08T07:07:00.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.642 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:00.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.642 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:40387 4.7 4:e2d089ed:::10000000004.00000033:head [write 1458176~4096 in=4096b,write 1617920~4096 in=4096b,write 1646592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T07:07:00.643 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:00.597285+0000", 2023-10-08T07:07:00.643 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000663216, 2023-10-08T07:07:00.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0011988019999999999, 2023-10-08T07:07:00.643 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:00.643 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:00.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:00.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:00.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.643 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 40387 2023-10-08T07:07:00.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.644 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:00.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:00.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597285+0000", 2023-10-08T07:07:00.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:00.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597285+0000", 2023-10-08T07:07:00.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:00.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597286+0000", 2023-10-08T07:07:00.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9100000000000002e-07 2023-10-08T07:07:00.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:00.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597304+0000", 2023-10-08T07:07:00.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7581e-05 2023-10-08T07:07:00.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:00.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597314+0000", 2023-10-08T07:07:00.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0414999999999999e-05 2023-10-08T07:07:00.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597321+0000", 2023-10-08T07:07:00.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0740000000000004e-06 2023-10-08T07:07:00.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:00.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597364+0000", 2023-10-08T07:07:00.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2743000000000001e-05 2023-10-08T07:07:00.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:00.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597412+0000", 2023-10-08T07:07:00.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7951999999999998e-05 2023-10-08T07:07:00.651 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.651 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:00.651 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.652 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:40389 4.21 4:867af9ba:::10000000004.0000000a:head [write 110592~4096 in=4096b,write 434176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T07:07:00.652 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:00.597846+0000", 2023-10-08T07:07:00.652 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000102636, 2023-10-08T07:07:00.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00072115600000000003, 2023-10-08T07:07:00.652 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:00.652 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:00.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:00.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:00.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.652 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 40389 2023-10-08T07:07:00.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.653 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:00.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:00.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597846+0000", 2023-10-08T07:07:00.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:00.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597846+0000", 2023-10-08T07:07:00.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:00.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597846+0000", 2023-10-08T07:07:00.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-07 2023-10-08T07:07:00.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:00.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597856+0000", 2023-10-08T07:07:00.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0006e-05 2023-10-08T07:07:00.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597867+0000", 2023-10-08T07:07:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0721e-05 2023-10-08T07:07:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597874+0000", 2023-10-08T07:07:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7499999999999997e-06 2023-10-08T07:07:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.597979+0000", 2023-10-08T07:07:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105201 2023-10-08T07:07:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598060+0000", 2023-10-08T07:07:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0395999999999994e-05 2023-10-08T07:07:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:40391 4.21 4.5d9f5e61 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T07:07:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:00.598318+0000", 2023-10-08T07:07:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9996305, 2023-10-08T07:07:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00032686899999999998, 2023-10-08T07:07:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 40391 2023-10-08T07:07:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598318+0000", 2023-10-08T07:07:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598318+0000", 2023-10-08T07:07:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598318+0000", 2023-10-08T07:07:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4600000000000004e-07 2023-10-08T07:07:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598332+0000", 2023-10-08T07:07:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3943e-05 2023-10-08T07:07:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598343+0000", 2023-10-08T07:07:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1107000000000001e-05 2023-10-08T07:07:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598352+0000", 2023-10-08T07:07:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3790000000000006e-06 2023-10-08T07:07:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:40388 4.3a e49/17 4:5f183e4b:::10000000004.00000023:head v 49'1854, mlcod=49'1852)", 2023-10-08T07:07:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:00.598517+0000", 2023-10-08T07:07:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9994316, 2023-10-08T07:07:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000186847, 2023-10-08T07:07:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598517+0000", 2023-10-08T07:07:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598517+0000", 2023-10-08T07:07:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598517+0000", 2023-10-08T07:07:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2e-07 2023-10-08T07:07:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598529+0000", 2023-10-08T07:07:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1919999999999999e-05 2023-10-08T07:07:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598538+0000", 2023-10-08T07:07:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2320000000000007e-06 2023-10-08T07:07:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598544+0000", 2023-10-08T07:07:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6550000000000001e-06 2023-10-08T07:07:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598589+0000", 2023-10-08T07:07:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5142999999999998e-05 2023-10-08T07:07:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.598609+0000", 2023-10-08T07:07:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0069e-05 2023-10-08T07:07:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:00.666 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:00.666 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 12 2023-10-08T07:07:00.666 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:00.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:00.668 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:00.666+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:00.768 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:00.767+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:00.777 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:00.869 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:00.868+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:00.891 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:00.892 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:00.892 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:00.892 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:00.892 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:00.905 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:00.964 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:00.970 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:00.969+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:00.992 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:00.993 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:00.993 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:00.993 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:00.995 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:00.996 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:01.071 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:01.070+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:01.133 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:01.134 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:01.148 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:01.193 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:01.192+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:01.273 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:01.272+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:01.332 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:01.332 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:01.347 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:01.374 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:01.372+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:01.474 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:01.473+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:01.564 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:01.564 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:01.575 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:01.574+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:01.578 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:01.676 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:01.675+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:01.724 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2023-10-08T07:07:01.725 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T07:07:01.725 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-10-08T07:07:01.725 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-10-08T07:07:01.725 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-10-08T07:07:01.725 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-10-08T07:07:01.777 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:01.776+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:01.807 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:01.808 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:01.825 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:01.877 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:01.876+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:01.921 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:01.921 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "" 2023-10-08T07:07:01.921 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:01.979 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:01.978+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:02.014 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:02.014 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:02.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~24s 2023-10-08T07:07:02.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:02.080 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:02.078+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:02.180 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:02.179+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:02.217 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:02.217 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:02.232 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:02.247 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T07:07:02.316 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:02.315+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:02.382 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:02.381+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:02.447 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:02.448 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:02.463 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:02.504 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:02.503+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:02.585 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:02.584+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:02.647 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:02.647 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:02.662 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:02.703 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:02.702+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:02.787 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:02.786+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:02.888 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:02.887+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:02.890 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:02.890 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:02.904 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:02.989 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:02.987+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:02.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:07:03.090 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:03.089+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:03.126 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:03.126 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:03.140 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:03.189 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:03.191 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:03.190+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:03.216 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:03.216 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:07:03.216 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:03.216 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:07:03.219 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:03.220 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2023-10-08T07:07:03.293 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:03.291+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:03.327 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:03.327 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:03.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.327 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:47727 4.3a e50/17 4:5fb70c0f:::10000000004.0000002e:head v 50'2187, mlcod=50'2184)", 2023-10-08T07:07:03.328 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:03.321879+0000", 2023-10-08T07:07:03.328 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0042554619999999998, 2023-10-08T07:07:03.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042746559999999999, 2023-10-08T07:07:03.328 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:03.328 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321879+0000", 2023-10-08T07:07:03.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321879+0000", 2023-10-08T07:07:03.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321879+0000", 2023-10-08T07:07:03.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1800000000000001e-07 2023-10-08T07:07:03.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321890+0000", 2023-10-08T07:07:03.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0703999999999999e-05 2023-10-08T07:07:03.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321896+0000", 2023-10-08T07:07:03.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9270000000000002e-06 2023-10-08T07:07:03.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321900+0000", 2023-10-08T07:07:03.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4050000000000002e-06 2023-10-08T07:07:03.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.322351+0000", 2023-10-08T07:07:03.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045036300000000001 2023-10-08T07:07:03.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.322370+0000", 2023-10-08T07:07:03.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9434000000000001e-05 2023-10-08T07:07:03.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.335 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.336 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:47732 4.21 4:867af9ba:::10000000004.0000000a:head [write 1429504~4096 in=4096b,write 1474560~4096 in=4096b,write 1507328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:03.336 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:03.323643+0000", 2023-10-08T07:07:03.336 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024917060000000002, 2023-10-08T07:07:03.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025630700000000002, 2023-10-08T07:07:03.336 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.336 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:03.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.336 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 47732 2023-10-08T07:07:03.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.336 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323643+0000", 2023-10-08T07:07:03.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323643+0000", 2023-10-08T07:07:03.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323644+0000", 2023-10-08T07:07:03.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0559999999999999e-06 2023-10-08T07:07:03.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323656+0000", 2023-10-08T07:07:03.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.257e-05 2023-10-08T07:07:03.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323666+0000", 2023-10-08T07:07:03.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0114e-05 2023-10-08T07:07:03.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323674+0000", 2023-10-08T07:07:03.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1780000000000003e-06 2023-10-08T07:07:03.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323929+0000", 2023-10-08T07:07:03.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00025452599999999998 2023-10-08T07:07:03.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.324011+0000", 2023-10-08T07:07:03.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1588000000000006e-05 2023-10-08T07:07:03.340 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.340 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.340 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.341 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:47734 4.c e50/17 4:3352c333:::10000000004.00000012:head v 50'1465, mlcod=50'1463)", 2023-10-08T07:07:03.341 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:03.323646+0000", 2023-10-08T07:07:03.341 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024884270000000001, 2023-10-08T07:07:03.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026118209999999998, 2023-10-08T07:07:03.341 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.341 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:03.341 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323646+0000", 2023-10-08T07:07:03.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323646+0000", 2023-10-08T07:07:03.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323646+0000", 2023-10-08T07:07:03.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4099999999999999e-07 2023-10-08T07:07:03.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323662+0000", 2023-10-08T07:07:03.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5446000000000001e-05 2023-10-08T07:07:03.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323670+0000", 2023-10-08T07:07:03.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3180000000000007e-06 2023-10-08T07:07:03.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323677+0000", 2023-10-08T07:07:03.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5899999999999996e-06 2023-10-08T07:07:03.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323753+0000", 2023-10-08T07:07:03.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6292999999999996e-05 2023-10-08T07:07:03.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323773+0000", 2023-10-08T07:07:03.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9707e-05 2023-10-08T07:07:03.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.345 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.346 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:47735 4.36 4:6d7df329:::10000000004.00000034:head [write 3784704~4096 in=4096b,write 3813376~4096 in=4096b,write 3825664~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:03.346 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:03.323693+0000", 2023-10-08T07:07:03.346 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024410569999999999, 2023-10-08T07:07:03.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026312969999999999, 2023-10-08T07:07:03.346 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.346 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:03.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.346 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 47735 2023-10-08T07:07:03.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.347 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323693+0000", 2023-10-08T07:07:03.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323693+0000", 2023-10-08T07:07:03.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323694+0000", 2023-10-08T07:07:03.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9599999999999999e-07 2023-10-08T07:07:03.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323704+0000", 2023-10-08T07:07:03.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0575e-05 2023-10-08T07:07:03.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323712+0000", 2023-10-08T07:07:03.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7770000000000002e-06 2023-10-08T07:07:03.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323719+0000", 2023-10-08T07:07:03.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1779999999999997e-06 2023-10-08T07:07:03.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323834+0000", 2023-10-08T07:07:03.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011506 2023-10-08T07:07:03.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323917+0000", 2023-10-08T07:07:03.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2111e-05 2023-10-08T07:07:03.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.350 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.350 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:47736 4.21 4:867af9ba:::10000000004.0000000a:head [write 2383872~4096 in=4096b,write 2396160~4096 in=4096b,write 2908160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:03.351 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:03.323735+0000", 2023-10-08T07:07:03.351 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0023989369999999999, 2023-10-08T07:07:03.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026320290000000001, 2023-10-08T07:07:03.351 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.351 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:03.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.354 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 47736 2023-10-08T07:07:03.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.354 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323735+0000", 2023-10-08T07:07:03.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323735+0000", 2023-10-08T07:07:03.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323736+0000", 2023-10-08T07:07:03.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.75e-07 2023-10-08T07:07:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323745+0000", 2023-10-08T07:07:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5219999999999996e-06 2023-10-08T07:07:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323753+0000", 2023-10-08T07:07:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0770000000000008e-06 2023-10-08T07:07:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323759+0000", 2023-10-08T07:07:03.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8869999999999997e-06 2023-10-08T07:07:03.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.325125+0000", 2023-10-08T07:07:03.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001365364 2023-10-08T07:07:03.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.325208+0000", 2023-10-08T07:07:03.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3066999999999996e-05 2023-10-08T07:07:03.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.358 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.358 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:47704 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3596288~4096 in=4096b,write 3629056~4096 in=4096b,write 3731456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:03.358 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:03.312689+0000", 2023-10-08T07:07:03.358 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013445733, 2023-10-08T07:07:03.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013730691999999999, 2023-10-08T07:07:03.358 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.359 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:03.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.359 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 47704 2023-10-08T07:07:03.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.359 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.312689+0000", 2023-10-08T07:07:03.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.312689+0000", 2023-10-08T07:07:03.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.312689+0000", 2023-10-08T07:07:03.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7199999999999998e-07 2023-10-08T07:07:03.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.312703+0000", 2023-10-08T07:07:03.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4073999999999999e-05 2023-10-08T07:07:03.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.312713+0000", 2023-10-08T07:07:03.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8970000000000003e-06 2023-10-08T07:07:03.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.312719+0000", 2023-10-08T07:07:03.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4190000000000001e-06 2023-10-08T07:07:03.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.322161+0000", 2023-10-08T07:07:03.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0094421969999999994 2023-10-08T07:07:03.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.322259+0000", 2023-10-08T07:07:03.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8590000000000003e-05 2023-10-08T07:07:03.363 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.363 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.363 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.363 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:47737 4.19 4:9a1dab10:::10000000004.0000001d:head [write 1400832~12288 in=12288b,write 1478656~4096 in=4096b,write 1581056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:03.363 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:03.324487+0000", 2023-10-08T07:07:03.363 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0016470740000000001, 2023-10-08T07:07:03.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00197292, 2023-10-08T07:07:03.363 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.363 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:03.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.364 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 47737 2023-10-08T07:07:03.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.364 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.324487+0000", 2023-10-08T07:07:03.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.324487+0000", 2023-10-08T07:07:03.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.324488+0000", 2023-10-08T07:07:03.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4200000000000005e-07 2023-10-08T07:07:03.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.324505+0000", 2023-10-08T07:07:03.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6668999999999999e-05 2023-10-08T07:07:03.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.324515+0000", 2023-10-08T07:07:03.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9019999999999994e-06 2023-10-08T07:07:03.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.324522+0000", 2023-10-08T07:07:03.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5190000000000003e-06 2023-10-08T07:07:03.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.325111+0000", 2023-10-08T07:07:03.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00058858499999999998 2023-10-08T07:07:03.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.325192+0000", 2023-10-08T07:07:03.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1508000000000006e-05 2023-10-08T07:07:03.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.368 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.368 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:47738 4.16 4:69eefec8:::10000000004.0000003a:head [write 3866624~4096 in=4096b,write 3923968~4096 in=4096b,write 4124672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:03.368 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:03.326022+0000", 2023-10-08T07:07:03.368 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000112595, 2023-10-08T07:07:03.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000479197, 2023-10-08T07:07:03.369 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.369 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:03.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.369 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 47738 2023-10-08T07:07:03.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.369 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.326022+0000", 2023-10-08T07:07:03.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.326022+0000", 2023-10-08T07:07:03.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.326022+0000", 2023-10-08T07:07:03.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1800000000000005e-07 2023-10-08T07:07:03.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.326032+0000", 2023-10-08T07:07:03.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2040000000000003e-06 2023-10-08T07:07:03.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.326038+0000", 2023-10-08T07:07:03.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4479999999999999e-06 2023-10-08T07:07:03.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.326043+0000", 2023-10-08T07:07:03.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6369999999999998e-06 2023-10-08T07:07:03.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.326080+0000", 2023-10-08T07:07:03.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6804000000000002e-05 2023-10-08T07:07:03.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.326136+0000", 2023-10-08T07:07:03.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6329000000000002e-05 2023-10-08T07:07:03.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.326222+0000", 2023-10-08T07:07:03.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6316000000000005e-05 2023-10-08T07:07:03.373 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.373 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.374 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:47680 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3395584~4096 in=4096b,write 3465216~4096 in=4096b,write 3727360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:03.374 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:03.304528+0000", 2023-10-08T07:07:03.374 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.021606567, 2023-10-08T07:07:03.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022016582999999999, 2023-10-08T07:07:03.374 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.374 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:03.374 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.374 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.374 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.375 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 47680 2023-10-08T07:07:03.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.375 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.304528+0000", 2023-10-08T07:07:03.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.304528+0000", 2023-10-08T07:07:03.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.304528+0000", 2023-10-08T07:07:03.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.58e-07 2023-10-08T07:07:03.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.304539+0000", 2023-10-08T07:07:03.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0881e-05 2023-10-08T07:07:03.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.304544+0000", 2023-10-08T07:07:03.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3329999999999996e-06 2023-10-08T07:07:03.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.304548+0000", 2023-10-08T07:07:03.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.693e-06 2023-10-08T07:07:03.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321750+0000", 2023-10-08T07:07:03.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017201832 2023-10-08T07:07:03.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321826+0000", 2023-10-08T07:07:03.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5807000000000001e-05 2023-10-08T07:07:03.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321967+0000", 2023-10-08T07:07:03.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014172100000000001 2023-10-08T07:07:03.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.325373+0000", 2023-10-08T07:07:03.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034050970000000002 2023-10-08T07:07:03.379 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.379 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.379 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.379 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:47719 4.28 4:15b6682b:::10000000004.0000000b:head [write 2203648~4096 in=4096b,write 2383872~4096 in=4096b,write 2707456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:03.317349+0000", 2023-10-08T07:07:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0087856310000000003, 2023-10-08T07:07:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092408839999999996, 2023-10-08T07:07:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 47719 2023-10-08T07:07:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.317349+0000", 2023-10-08T07:07:03.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.317349+0000", 2023-10-08T07:07:03.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.317350+0000", 2023-10-08T07:07:03.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.569999999999999e-07 2023-10-08T07:07:03.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.317362+0000", 2023-10-08T07:07:03.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2874000000000001e-05 2023-10-08T07:07:03.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.317374+0000", 2023-10-08T07:07:03.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2016e-05 2023-10-08T07:07:03.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.317382+0000", 2023-10-08T07:07:03.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8630000000000008e-06 2023-10-08T07:07:03.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323169+0000", 2023-10-08T07:07:03.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057862579999999999 2023-10-08T07:07:03.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.323231+0000", 2023-10-08T07:07:03.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2309000000000003e-05 2023-10-08T07:07:03.384 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.384 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.384 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.384 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:47724 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3366912~4096 in=4096b,write 3481600~4096 in=4096b,write 3534848~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:03.384 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:03.319119+0000", 2023-10-08T07:07:03.384 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0070149890000000001, 2023-10-08T07:07:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075095020000000004, 2023-10-08T07:07:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 47724 2023-10-08T07:07:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.319119+0000", 2023-10-08T07:07:03.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.319119+0000", 2023-10-08T07:07:03.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.319120+0000", 2023-10-08T07:07:03.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2699999999999998e-07 2023-10-08T07:07:03.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.319131+0000", 2023-10-08T07:07:03.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1361e-05 2023-10-08T07:07:03.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.319140+0000", 2023-10-08T07:07:03.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5110000000000003e-06 2023-10-08T07:07:03.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.319146+0000", 2023-10-08T07:07:03.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4919999999999998e-06 2023-10-08T07:07:03.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.324371+0000", 2023-10-08T07:07:03.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005224299 2023-10-08T07:07:03.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.324419+0000", 2023-10-08T07:07:03.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8219e-05 2023-10-08T07:07:03.389 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.389 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.389 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.389 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:47729 4.26 4:672c55ca:::10000000004.00000006:head [write 573440~4096 in=4096b,write 774144~4096 in=4096b,write 835584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:03.389 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:03.321131+0000", 2023-10-08T07:07:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0050033930000000001, 2023-10-08T07:07:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055371600000000002, 2023-10-08T07:07:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 47729 2023-10-08T07:07:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321131+0000", 2023-10-08T07:07:03.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321131+0000", 2023-10-08T07:07:03.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321132+0000", 2023-10-08T07:07:03.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3500000000000005e-07 2023-10-08T07:07:03.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321142+0000", 2023-10-08T07:07:03.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0400999999999999e-05 2023-10-08T07:07:03.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321149+0000", 2023-10-08T07:07:03.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0899999999999999e-06 2023-10-08T07:07:03.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321154+0000", 2023-10-08T07:07:03.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1240000000000004e-06 2023-10-08T07:07:03.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321898+0000", 2023-10-08T07:07:03.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00074347200000000001 2023-10-08T07:07:03.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.321969+0000", 2023-10-08T07:07:03.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1418e-05 2023-10-08T07:07:03.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.322105+0000", 2023-10-08T07:07:03.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013558900000000001 2023-10-08T07:07:03.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:03.325347+0000", 2023-10-08T07:07:03.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032421870000000001 2023-10-08T07:07:03.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.395 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.395 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:03.396 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 12 2023-10-08T07:07:03.396 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:03.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:03.398 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:03.396+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:03.497 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:03.496+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:03.599 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:03.598+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:03.623 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:03.624 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:03.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:03.734 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:03.728+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:03.800 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:03.799+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:03.869 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:03.869 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:03.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:03.870 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:03.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.870 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36811 4.31 4:8ec1b377:::10000000004.00000019:head [write 3362816~4096,write 3395584~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.870 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:03.870 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5905816689999996, 2023-10-08T07:07:03.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96838670299999996, 2023-10-08T07:07:03.870 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.870 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.870 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36811 2023-10-08T07:07:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:03.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:03.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:07:03.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275541+0000", 2023-10-08T07:07:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3360000000000001e-06 2023-10-08T07:07:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275551+0000", 2023-10-08T07:07:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.825e-06 2023-10-08T07:07:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275556+0000", 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275592+0000", 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6554000000000003e-05 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275599+0000", 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4640000000000003e-06 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.238899+0000", 2023-10-08T07:07:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96330046999999996 2023-10-08T07:07:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239016+0000", 2023-10-08T07:07:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116919 2023-10-08T07:07:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239123+0000", 2023-10-08T07:07:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010675000000000001 2023-10-08T07:07:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243715+0000", 2023-10-08T07:07:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045922469999999998 2023-10-08T07:07:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243760+0000", 2023-10-08T07:07:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4666000000000002e-05 2023-10-08T07:07:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243820+0000", 2023-10-08T07:07:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9760999999999999e-05 2023-10-08T07:07:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243917+0000", 2023-10-08T07:07:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7822e-05 2023-10-08T07:07:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36831 4.31 4:8de29a03:::10000000004.00000001:head [write 806912~8192,write 847872~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5835617509999995, 2023-10-08T07:07:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96330879000000003, 2023-10-08T07:07:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36831 2023-10-08T07:07:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282564+0000", 2023-10-08T07:07:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2303999999999999e-05 2023-10-08T07:07:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282572+0000", 2023-10-08T07:07:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7849999999999992e-06 2023-10-08T07:07:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282579+0000", 2023-10-08T07:07:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4610000000000002e-06 2023-10-08T07:07:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282631+0000", 2023-10-08T07:07:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2404999999999997e-05 2023-10-08T07:07:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282640+0000", 2023-10-08T07:07:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2640000000000008e-06 2023-10-08T07:07:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239925+0000", 2023-10-08T07:07:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95728506499999999 2023-10-08T07:07:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240097+0000", 2023-10-08T07:07:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172497 2023-10-08T07:07:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240235+0000", 2023-10-08T07:07:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000137861 2023-10-08T07:07:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243935+0000", 2023-10-08T07:07:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037000819999999999 2023-10-08T07:07:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245706+0000", 2023-10-08T07:07:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001770972 2023-10-08T07:07:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245773+0000", 2023-10-08T07:07:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6840000000000004e-05 2023-10-08T07:07:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245859+0000", 2023-10-08T07:07:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6442999999999999e-05 2023-10-08T07:07:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36859 4.31 4:8de29a03:::10000000004.00000001:head [write 3850240~4096,write 3891200~4096,write 3919872~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5728182090000002, 2023-10-08T07:07:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95269757099999997, 2023-10-08T07:07:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36859 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293295+0000", 2023-10-08T07:07:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9500000000000001e-07 2023-10-08T07:07:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293335+0000", 2023-10-08T07:07:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9867999999999998e-05 2023-10-08T07:07:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293346+0000", 2023-10-08T07:07:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1070000000000001e-05 2023-10-08T07:07:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293353+0000", 2023-10-08T07:07:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2640000000000002e-06 2023-10-08T07:07:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293409+0000", 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5926e-05 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293418+0000", 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9940000000000006e-06 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240889+0000", 2023-10-08T07:07:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94747106400000003 2023-10-08T07:07:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240963+0000", 2023-10-08T07:07:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3431999999999998e-05 2023-10-08T07:07:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241104+0000", 2023-10-08T07:07:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014119800000000001 2023-10-08T07:07:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243944+0000", 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028404200000000002 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245909+0000", 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001964351 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245942+0000", 2023-10-08T07:07:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3526999999999999e-05 2023-10-08T07:07:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245992+0000", 2023-10-08T07:07:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9561999999999997e-05 2023-10-08T07:07:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36861 4.31 4:8ec1b377:::10000000004.00000019:head [write 385024~4096,write 434176~4096,write 540672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5719094130000002, 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.955921154, 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36861 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294204+0000", 2023-10-08T07:07:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294216+0000", 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2323999999999999e-05 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294226+0000", 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0217000000000001e-05 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294234+0000", 2023-10-08T07:07:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6020000000000002e-06 2023-10-08T07:07:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294300+0000", 2023-10-08T07:07:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6515999999999998e-05 2023-10-08T07:07:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294312+0000", 2023-10-08T07:07:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1379000000000001e-05 2023-10-08T07:07:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241814+0000", 2023-10-08T07:07:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.947501751 2023-10-08T07:07:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241863+0000", 2023-10-08T07:07:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9135999999999998e-05 2023-10-08T07:07:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241953+0000", 2023-10-08T07:07:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0124000000000007e-05 2023-10-08T07:07:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243952+0000", 2023-10-08T07:07:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019988749999999998 2023-10-08T07:07:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250028+0000", 2023-10-08T07:07:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060766350000000004 2023-10-08T07:07:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250069+0000", 2023-10-08T07:07:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0794000000000003e-05 2023-10-08T07:07:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250124+0000", 2023-10-08T07:07:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991000000000003e-05 2023-10-08T07:07:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36869 4.31 4:8ec1b377:::10000000004.00000019:head [write 917504~4096,write 983040~4096,write 1171456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5685931489999998, 2023-10-08T07:07:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95596831699999996, 2023-10-08T07:07:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36869 2023-10-08T07:07:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297520+0000", 2023-10-08T07:07:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.23e-07 2023-10-08T07:07:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297532+0000", 2023-10-08T07:07:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1420000000000001e-05 2023-10-08T07:07:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297548+0000", 2023-10-08T07:07:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6711e-05 2023-10-08T07:07:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297557+0000", 2023-10-08T07:07:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3250000000000008e-06 2023-10-08T07:07:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297606+0000", 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9724e-05 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297614+0000", 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.242809+0000", 2023-10-08T07:07:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94519444900000005 2023-10-08T07:07:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.242885+0000", 2023-10-08T07:07:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6784000000000002e-05 2023-10-08T07:07:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243025+0000", 2023-10-08T07:07:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013984300000000001 2023-10-08T07:07:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246003+0000", 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002978072 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253322+0000", 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073190779999999997 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253391+0000", 2023-10-08T07:07:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8285000000000001e-05 2023-10-08T07:07:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253488+0000", 2023-10-08T07:07:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7014000000000003e-05 2023-10-08T07:07:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36881 4.31 4:8ec1b377:::10000000004.00000019:head [write 888832~4096,write 1191936~4096,write 1327104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.564525605, 2023-10-08T07:07:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95214402799999998, 2023-10-08T07:07:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36881 2023-10-08T07:07:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301588+0000", 2023-10-08T07:07:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.02e-06 2023-10-08T07:07:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301600+0000", 2023-10-08T07:07:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2377e-05 2023-10-08T07:07:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301611+0000", 2023-10-08T07:07:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0446e-05 2023-10-08T07:07:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301621+0000", 2023-10-08T07:07:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0338e-05 2023-10-08T07:07:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301668+0000", 2023-10-08T07:07:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7459000000000001e-05 2023-10-08T07:07:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301674+0000", 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7910000000000001e-06 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244001+0000", 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94232701200000002 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244082+0000", 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0615e-05 2023-10-08T07:07:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244202+0000", 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120427 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246009+0000", 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018070899999999999 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253544+0000", 2023-10-08T07:07:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075350729999999998 2023-10-08T07:07:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253607+0000", 2023-10-08T07:07:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2810000000000003e-05 2023-10-08T07:07:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253731+0000", 2023-10-08T07:07:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012357000000000001 2023-10-08T07:07:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36900 4.31 4:8de29a03:::10000000004.00000001:head [write 3239936~4096,write 3371008~4096,write 3878912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5582022989999995, 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94607822699999999, 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36900 2023-10-08T07:07:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307911+0000", 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0210000000000001e-06 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307926+0000", 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4375e-05 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307936+0000", 2023-10-08T07:07:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0124e-05 2023-10-08T07:07:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307950+0000", 2023-10-08T07:07:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4659e-05 2023-10-08T07:07:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307998+0000", 2023-10-08T07:07:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8170000000000001e-05 2023-10-08T07:07:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.308005+0000", 2023-10-08T07:07:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3339999999999998e-06 2023-10-08T07:07:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244911+0000", 2023-10-08T07:07:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93690596699999995 2023-10-08T07:07:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244972+0000", 2023-10-08T07:07:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0854999999999999e-05 2023-10-08T07:07:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245073+0000", 2023-10-08T07:07:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101406 2023-10-08T07:07:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250135+0000", 2023-10-08T07:07:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050614620000000001 2023-10-08T07:07:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253786+0000", 2023-10-08T07:07:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003651615 2023-10-08T07:07:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253860+0000", 2023-10-08T07:07:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3631e-05 2023-10-08T07:07:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253988+0000", 2023-10-08T07:07:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000128608 2023-10-08T07:07:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36907 4.31 4:8de29a03:::10000000004.00000001:head [write 53248~4096,write 192512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5549611930000005, 2023-10-08T07:07:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94298633799999998, 2023-10-08T07:07:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36907 2023-10-08T07:07:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311152+0000", 2023-10-08T07:07:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3200000000000005e-07 2023-10-08T07:07:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311158+0000", 2023-10-08T07:07:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2219999999999999e-06 2023-10-08T07:07:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311166+0000", 2023-10-08T07:07:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5209999999999997e-06 2023-10-08T07:07:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311169+0000", 2023-10-08T07:07:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.568e-06 2023-10-08T07:07:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311202+0000", 2023-10-08T07:07:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3346000000000002e-05 2023-10-08T07:07:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311208+0000", 2023-10-08T07:07:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.259e-06 2023-10-08T07:07:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246041+0000", 2023-10-08T07:07:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93483340400000003 2023-10-08T07:07:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246088+0000", 2023-10-08T07:07:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6653999999999998e-05 2023-10-08T07:07:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246173+0000", 2023-10-08T07:07:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5327999999999993e-05 2023-10-08T07:07:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253252+0000", 2023-10-08T07:07:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070788170000000003 2023-10-08T07:07:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254057+0000", 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00080496300000000001 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254090+0000", 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3325999999999999e-05 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254138+0000", 2023-10-08T07:07:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7398000000000003e-05 2023-10-08T07:07:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36955 4.31 4:8ec1b377:::10000000004.00000019:head [write 3538944~8192,write 3620864~4096,write 3641344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5379182489999996, 2023-10-08T07:07:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92903069999999999, 2023-10-08T07:07:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.933 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.933 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.933 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36955 2023-10-08T07:07:03.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.933 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:03.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:03.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328195+0000", 2023-10-08T07:07:03.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1600000000000001e-07 2023-10-08T07:07:03.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328208+0000", 2023-10-08T07:07:03.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3592e-05 2023-10-08T07:07:03.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328218+0000", 2023-10-08T07:07:03.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7270000000000002e-06 2023-10-08T07:07:03.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328226+0000", 2023-10-08T07:07:03.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.328e-06 2023-10-08T07:07:03.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328282+0000", 2023-10-08T07:07:03.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6156000000000002e-05 2023-10-08T07:07:03.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328300+0000", 2023-10-08T07:07:03.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7805e-05 2023-10-08T07:07:03.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246679+0000", 2023-10-08T07:07:03.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91837927200000002 2023-10-08T07:07:03.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246743+0000", 2023-10-08T07:07:03.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4599999999999998e-05 2023-10-08T07:07:03.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246838+0000", 2023-10-08T07:07:03.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5063999999999996e-05 2023-10-08T07:07:03.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253747+0000", 2023-10-08T07:07:03.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069086210000000002 2023-10-08T07:07:03.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257129+0000", 2023-10-08T07:07:03.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033818210000000001 2023-10-08T07:07:03.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257167+0000", 2023-10-08T07:07:03.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8318999999999997e-05 2023-10-08T07:07:03.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257225+0000", 2023-10-08T07:07:03.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7679000000000001e-05 2023-10-08T07:07:03.939 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.939 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.939 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.940 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36966 4.31 4:8de29a03:::10000000004.00000001:head [write 2809856~4096,write 3076096~4096,write 3096576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.940 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:03.940 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5340135249999998, 2023-10-08T07:07:03.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92525588800000003, 2023-10-08T07:07:03.940 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.940 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.940 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36966 2023-10-08T07:07:03.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332100+0000", 2023-10-08T07:07:03.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:03.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332121+0000", 2023-10-08T07:07:03.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0914999999999999e-05 2023-10-08T07:07:03.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332128+0000", 2023-10-08T07:07:03.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8709999999999997e-06 2023-10-08T07:07:03.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332134+0000", 2023-10-08T07:07:03.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0839999999999999e-06 2023-10-08T07:07:03.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332182+0000", 2023-10-08T07:07:03.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8310000000000003e-05 2023-10-08T07:07:03.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332187+0000", 2023-10-08T07:07:03.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.242e-06 2023-10-08T07:07:03.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248280+0000", 2023-10-08T07:07:03.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91609321899999996 2023-10-08T07:07:03.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248369+0000", 2023-10-08T07:07:03.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8895999999999997e-05 2023-10-08T07:07:03.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248536+0000", 2023-10-08T07:07:03.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016709099999999999 2023-10-08T07:07:03.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257075+0000", 2023-10-08T07:07:03.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085385300000000008 2023-10-08T07:07:03.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257266+0000", 2023-10-08T07:07:03.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019079399999999999 2023-10-08T07:07:03.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257305+0000", 2023-10-08T07:07:03.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8996999999999999e-05 2023-10-08T07:07:03.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257355+0000", 2023-10-08T07:07:03.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0129000000000001e-05 2023-10-08T07:07:03.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.947 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.947 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36968 4.31 4:8ec1b377:::10000000004.00000019:head [write 835584~4096,write 1372160~4096,write 1646592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.947 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:03.947 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5322934549999996, 2023-10-08T07:07:03.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92599244700000005, 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36968 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:03.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333820+0000", 2023-10-08T07:07:03.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1999999999999998e-07 2023-10-08T07:07:03.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333833+0000", 2023-10-08T07:07:03.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3574000000000001e-05 2023-10-08T07:07:03.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333848+0000", 2023-10-08T07:07:03.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4912999999999999e-05 2023-10-08T07:07:03.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333857+0000", 2023-10-08T07:07:03.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1270000000000003e-06 2023-10-08T07:07:03.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333903+0000", 2023-10-08T07:07:03.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6782e-05 2023-10-08T07:07:03.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333911+0000", 2023-10-08T07:07:03.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5020000000000003e-06 2023-10-08T07:07:03.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250170+0000", 2023-10-08T07:07:03.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91625966299999995 2023-10-08T07:07:03.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250263+0000", 2023-10-08T07:07:03.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2252999999999999e-05 2023-10-08T07:07:03.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250454+0000", 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019164400000000001 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258723+0000", 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082687699999999999 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259685+0000", 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00096196599999999997 2023-10-08T07:07:03.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259739+0000", 2023-10-08T07:07:03.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4147999999999997e-05 2023-10-08T07:07:03.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259811+0000", 2023-10-08T07:07:03.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2185000000000001e-05 2023-10-08T07:07:03.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.954 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.955 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.955 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37036 4.31 4:8ec1b377:::10000000004.00000019:head [write 3309568~4096,write 3510272~4096,write 3620864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.955 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:03.955 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5068766040000003, 2023-10-08T07:07:03.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.90288029999999997, 2023-10-08T07:07:03.955 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.955 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37036 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:03.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6899999999999997e-07 2023-10-08T07:07:03.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359246+0000", 2023-10-08T07:07:03.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2369999999999998e-06 2023-10-08T07:07:03.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359254+0000", 2023-10-08T07:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4989999999999994e-06 2023-10-08T07:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359260+0000", 2023-10-08T07:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0209999999999996e-06 2023-10-08T07:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359319+0000", 2023-10-08T07:07:03.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9042999999999997e-05 2023-10-08T07:07:03.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359330+0000", 2023-10-08T07:07:03.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0633e-05 2023-10-08T07:07:03.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.251788+0000", 2023-10-08T07:07:03.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89245758100000006 2023-10-08T07:07:03.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.251887+0000", 2023-10-08T07:07:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9223999999999997e-05 2023-10-08T07:07:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.252083+0000", 2023-10-08T07:07:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019611800000000001 2023-10-08T07:07:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258731+0000", 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006648307 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262036+0000", 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033046550000000001 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262069+0000", 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2753000000000003e-05 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262116+0000", 2023-10-08T07:07:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7559999999999999e-05 2023-10-08T07:07:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37068 4.31 4:8de29a03:::10000000004.00000001:head [write 987136~4096,write 1011712~4096,write 1044480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.962 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4951976330000001, 2023-10-08T07:07:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89311213899999997, 2023-10-08T07:07:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.965 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37068 2023-10-08T07:07:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:03.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370916+0000", 2023-10-08T07:07:03.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5000000000000002e-07 2023-10-08T07:07:03.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370956+0000", 2023-10-08T07:07:03.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0898e-05 2023-10-08T07:07:03.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370966+0000", 2023-10-08T07:07:03.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6209999999999999e-06 2023-10-08T07:07:03.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370973+0000", 2023-10-08T07:07:03.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.601e-06 2023-10-08T07:07:03.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.371022+0000", 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9811999999999997e-05 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.371032+0000", 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8120000000000002e-06 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254175+0000", 2023-10-08T07:07:03.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88314265599999997 2023-10-08T07:07:03.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254256+0000", 2023-10-08T07:07:03.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0820000000000002e-05 2023-10-08T07:07:03.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254436+0000", 2023-10-08T07:07:03.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000180044 2023-10-08T07:07:03.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261274+0000", 2023-10-08T07:07:03.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006838434 2023-10-08T07:07:03.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.263950+0000", 2023-10-08T07:07:03.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026753829999999999 2023-10-08T07:07:03.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.263981+0000", 2023-10-08T07:07:03.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1568e-05 2023-10-08T07:07:03.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.264027+0000", 2023-10-08T07:07:03.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5739999999999999e-05 2023-10-08T07:07:03.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.972 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.973 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37088 4.31 4:8de29a03:::10000000004.00000001:head [write 1466368~8192,write 1515520~4096,write 1523712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.973 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:03.973 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4872887559999999, 2023-10-08T07:07:03.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88701907199999996, 2023-10-08T07:07:03.973 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.973 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.973 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.973 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.973 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.973 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37088 2023-10-08T07:07:03.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.974 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:03.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:03.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378825+0000", 2023-10-08T07:07:03.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7199999999999997e-07 2023-10-08T07:07:03.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378841+0000", 2023-10-08T07:07:03.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5999e-05 2023-10-08T07:07:03.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378851+0000", 2023-10-08T07:07:03.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0474e-05 2023-10-08T07:07:03.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378858+0000", 2023-10-08T07:07:03.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9840000000000004e-06 2023-10-08T07:07:03.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378904+0000", 2023-10-08T07:07:03.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5704999999999997e-05 2023-10-08T07:07:03.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378910+0000", 2023-10-08T07:07:03.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5039999999999999e-06 2023-10-08T07:07:03.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255278+0000", 2023-10-08T07:07:03.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.87636765000000005 2023-10-08T07:07:03.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255385+0000", 2023-10-08T07:07:03.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000106667 2023-10-08T07:07:03.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255557+0000", 2023-10-08T07:07:03.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172957 2023-10-08T07:07:03.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261279+0000", 2023-10-08T07:07:03.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00572195 2023-10-08T07:07:03.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265761+0000", 2023-10-08T07:07:03.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004481423 2023-10-08T07:07:03.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265796+0000", 2023-10-08T07:07:03.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4727000000000001e-05 2023-10-08T07:07:03.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265843+0000", 2023-10-08T07:07:03.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7160000000000002e-05 2023-10-08T07:07:03.980 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.981 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.981 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37130 4.31 4:8ec1b377:::10000000004.00000019:head [write 1658880~4096,write 1736704~4096,write 1794048~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.981 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:03.981 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4701188720000005, 2023-10-08T07:07:03.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86998378399999998, 2023-10-08T07:07:03.981 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.981 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.982 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37130 2023-10-08T07:07:03.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.982 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:03.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:03.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395995+0000", 2023-10-08T07:07:03.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600000000000008e-07 2023-10-08T07:07:03.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396008+0000", 2023-10-08T07:07:03.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3067999999999999e-05 2023-10-08T07:07:03.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396019+0000", 2023-10-08T07:07:03.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1561e-05 2023-10-08T07:07:03.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396027+0000", 2023-10-08T07:07:03.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9039999999999992e-06 2023-10-08T07:07:03.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396075+0000", 2023-10-08T07:07:03.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8165999999999999e-05 2023-10-08T07:07:03.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396081+0000", 2023-10-08T07:07:03.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8279999999999999e-06 2023-10-08T07:07:03.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256171+0000", 2023-10-08T07:07:03.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86008956199999997 2023-10-08T07:07:03.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256218+0000", 2023-10-08T07:07:03.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7018000000000003e-05 2023-10-08T07:07:03.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256315+0000", 2023-10-08T07:07:03.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7285000000000001e-05 2023-10-08T07:07:03.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262125+0000", 2023-10-08T07:07:03.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058099110000000001 2023-10-08T07:07:03.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265890+0000", 2023-10-08T07:07:03.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037655829999999999 2023-10-08T07:07:03.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265929+0000", 2023-10-08T07:07:03.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8068999999999998e-05 2023-10-08T07:07:03.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265977+0000", 2023-10-08T07:07:03.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8832999999999998e-05 2023-10-08T07:07:03.991 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.991 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:03.991 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:03.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.992 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37183 4.31 4:8ec1b377:::10000000004.00000019:head [write 16384~4096,write 364544~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:03.992 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:03.992 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4509378149999996, 2023-10-08T07:07:03.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.85095945399999995, 2023-10-08T07:07:03.992 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:03.992 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:03.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:03.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:03.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:03.992 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37183 2023-10-08T07:07:03.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.992 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:03.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:03.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:03.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:03.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:03.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:03.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:03.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:03.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6499999999999998e-07 2023-10-08T07:07:03.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:03.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415186+0000", 2023-10-08T07:07:03.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0404999999999999e-05 2023-10-08T07:07:03.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:03.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415198+0000", 2023-10-08T07:07:03.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.187e-05 2023-10-08T07:07:03.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:03.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415204+0000", 2023-10-08T07:07:03.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5119999999999997e-06 2023-10-08T07:07:03.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415259+0000", 2023-10-08T07:07:03.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5269999999999998e-05 2023-10-08T07:07:03.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:03.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415270+0000", 2023-10-08T07:07:03.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0716e-05 2023-10-08T07:07:03.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:03.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257384+0000", 2023-10-08T07:07:03.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84211341500000003 2023-10-08T07:07:03.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:03.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257442+0000", 2023-10-08T07:07:03.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8780999999999998e-05 2023-10-08T07:07:03.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:03.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257538+0000", 2023-10-08T07:07:03.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5956000000000001e-05 2023-10-08T07:07:03.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:03.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265987+0000", 2023-10-08T07:07:03.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008449069 2023-10-08T07:07:03.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:03.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266053+0000", 2023-10-08T07:07:03.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5813000000000002e-05 2023-10-08T07:07:03.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:03.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266089+0000", 2023-10-08T07:07:03.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5827000000000001e-05 2023-10-08T07:07:03.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:03.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:03.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:03.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266134+0000", 2023-10-08T07:07:03.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5055000000000001e-05 2023-10-08T07:07:04.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:04.000 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:04.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:04.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.000 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37188 4.31 4:8de29a03:::10000000004.00000001:head [write 2031616~4096,write 2191360~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:04.000 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:04.000 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4488104939999999, 2023-10-08T07:07:04.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.850341613, 2023-10-08T07:07:04.000 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:04.000 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:04.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:04.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.001 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37188 2023-10-08T07:07:04.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.001 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:04.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:04.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:04.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:04.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:04.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:04.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:04.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:04.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417303+0000", 2023-10-08T07:07:04.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0599999999999999e-07 2023-10-08T07:07:04.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:04.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417315+0000", 2023-10-08T07:07:04.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2325e-05 2023-10-08T07:07:04.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:04.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417324+0000", 2023-10-08T07:07:04.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8489999999999995e-06 2023-10-08T07:07:04.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417331+0000", 2023-10-08T07:07:04.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4599999999999997e-06 2023-10-08T07:07:04.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:04.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417437+0000", 2023-10-08T07:07:04.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105305 2023-10-08T07:07:04.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:04.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417445+0000", 2023-10-08T07:07:04.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3040000000000005e-06 2023-10-08T07:07:04.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:04.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258113+0000", 2023-10-08T07:07:04.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84066830699999995 2023-10-08T07:07:04.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:04.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258168+0000", 2023-10-08T07:07:04.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4258999999999997e-05 2023-10-08T07:07:04.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:04.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258255+0000", 2023-10-08T07:07:04.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7235000000000001e-05 2023-10-08T07:07:04.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:04.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265993+0000", 2023-10-08T07:07:04.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077377599999999998 2023-10-08T07:07:04.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267565+0000", 2023-10-08T07:07:04.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001572314 2023-10-08T07:07:04.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:04.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267597+0000", 2023-10-08T07:07:04.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2361999999999999e-05 2023-10-08T07:07:04.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:04.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267644+0000", 2023-10-08T07:07:04.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6326999999999999e-05 2023-10-08T07:07:04.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:04.008 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:04.008 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:04.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.008 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37197 4.31 4:8de29a03:::10000000004.00000001:head [write 1859584~4096,write 2220032~4096,write 2322432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:04.008 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:04.008 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4451565139999998, 2023-10-08T07:07:04.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84767678599999996, 2023-10-08T07:07:04.008 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:04.008 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:04.009 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:04.009 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.009 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37197 2023-10-08T07:07:04.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.009 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:04.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:04.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:04.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:04.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:04.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:04.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:04.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:04.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420957+0000", 2023-10-08T07:07:04.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9199999999999999e-07 2023-10-08T07:07:04.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:04.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420969+0000", 2023-10-08T07:07:04.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1753000000000001e-05 2023-10-08T07:07:04.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:04.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420981+0000", 2023-10-08T07:07:04.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2479e-05 2023-10-08T07:07:04.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420989+0000", 2023-10-08T07:07:04.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0949999999999996e-06 2023-10-08T07:07:04.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:04.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.421053+0000", 2023-10-08T07:07:04.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4134999999999995e-05 2023-10-08T07:07:04.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:04.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.421062+0000", 2023-10-08T07:07:04.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8440000000000004e-06 2023-10-08T07:07:04.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258760+0000", 2023-10-08T07:07:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83769823499999996 2023-10-08T07:07:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258814+0000", 2023-10-08T07:07:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3876999999999999e-05 2023-10-08T07:07:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258913+0000", 2023-10-08T07:07:04.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8323e-05 2023-10-08T07:07:04.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:04.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265997+0000", 2023-10-08T07:07:04.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070839830000000003 2023-10-08T07:07:04.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268535+0000", 2023-10-08T07:07:04.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002538836 2023-10-08T07:07:04.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268574+0000", 2023-10-08T07:07:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8606000000000003e-05 2023-10-08T07:07:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268633+0000", 2023-10-08T07:07:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8727999999999997e-05 2023-10-08T07:07:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:04.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.016 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37227 4.31 4:8ec1b377:::10000000004.00000019:head [write 2760704~4096,write 2781184~4096,write 2850816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:04.016 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:04.016 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4346325430000002, 2023-10-08T07:07:04.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83736361400000003, 2023-10-08T07:07:04.016 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:04.016 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:04.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:04.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.016 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37227 2023-10-08T07:07:04.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.017 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:04.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:04.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:04.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:04.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:04.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:04.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:04.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:04.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431481+0000", 2023-10-08T07:07:04.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8400000000000003e-07 2023-10-08T07:07:04.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:04.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431512+0000", 2023-10-08T07:07:04.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0803999999999998e-05 2023-10-08T07:07:04.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:04.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431525+0000", 2023-10-08T07:07:04.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3704e-05 2023-10-08T07:07:04.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431535+0000", 2023-10-08T07:07:04.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2350000000000005e-06 2023-10-08T07:07:04.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431585+0000", 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0531000000000001e-05 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431594+0000", 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7499999999999992e-06 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259851+0000", 2023-10-08T07:07:04.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82825699399999997 2023-10-08T07:07:04.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:04.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259914+0000", 2023-10-08T07:07:04.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2928999999999993e-05 2023-10-08T07:07:04.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:04.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.260024+0000", 2023-10-08T07:07:04.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000110556 2023-10-08T07:07:04.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:04.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266001+0000", 2023-10-08T07:07:04.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059769910000000001 2023-10-08T07:07:04.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268694+0000", 2023-10-08T07:07:04.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026924119999999999 2023-10-08T07:07:04.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:04.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268754+0000", 2023-10-08T07:07:04.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0562000000000001e-05 2023-10-08T07:07:04.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:04.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268843+0000", 2023-10-08T07:07:04.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9262e-05 2023-10-08T07:07:04.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:04.023 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:04.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:04.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.024 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37233 4.31 4:8de29a03:::10000000004.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:04.024 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:04.024 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4324255839999998, 2023-10-08T07:07:04.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83766958000000002, 2023-10-08T07:07:04.024 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:04.025 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:04.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:04.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.025 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37233 2023-10-08T07:07:04.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.025 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:04.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:04.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:04.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:04.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:04.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:04.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:04.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:04.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433688+0000", 2023-10-08T07:07:04.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2023-10-08T07:07:04.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:04.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433701+0000", 2023-10-08T07:07:04.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3869000000000001e-05 2023-10-08T07:07:04.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:04.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433714+0000", 2023-10-08T07:07:04.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2173e-05 2023-10-08T07:07:04.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433720+0000", 2023-10-08T07:07:04.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7449999999999998e-06 2023-10-08T07:07:04.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:04.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433772+0000", 2023-10-08T07:07:04.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1242999999999997e-05 2023-10-08T07:07:04.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:04.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433781+0000", 2023-10-08T07:07:04.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1360000000000003e-06 2023-10-08T07:07:04.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:04.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261313+0000", 2023-10-08T07:07:04.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82753250300000003 2023-10-08T07:07:04.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261367+0000", 2023-10-08T07:07:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3664e-05 2023-10-08T07:07:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261467+0000", 2023-10-08T07:07:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9668999999999997e-05 2023-10-08T07:07:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266010+0000", 2023-10-08T07:07:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045437189999999999 2023-10-08T07:07:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271269+0000", 2023-10-08T07:07:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052584900000000002 2023-10-08T07:07:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271310+0000", 2023-10-08T07:07:04.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1057999999999999e-05 2023-10-08T07:07:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271356+0000", 2023-10-08T07:07:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6582999999999998e-05 2023-10-08T07:07:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:04.032 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:04.032 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:04.034 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:04.032+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:04.034 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:04.135 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:04.134+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:04.220 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:04.249 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:04.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.250 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:50173 4.c 4:3352c333:::10000000004.00000012:head [write 2441216~4096 in=4096b,write 2527232~4096 in=4096b,write 2535424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.250 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:04.213301+0000", 2023-10-08T07:07:04.250 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0060915079999999998, 2023-10-08T07:07:04.251 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0061236169999999996, 2023-10-08T07:07:04.251 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.251 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:04.251 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.251 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.252 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.252 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 50173 2023-10-08T07:07:04.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.252 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.213301+0000", 2023-10-08T07:07:04.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.213301+0000", 2023-10-08T07:07:04.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.213301+0000", 2023-10-08T07:07:04.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:07:04.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.213313+0000", 2023-10-08T07:07:04.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1355999999999999e-05 2023-10-08T07:07:04.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.254 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.213322+0000", 2023-10-08T07:07:04.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4399999999999994e-06 2023-10-08T07:07:04.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.254 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.213329+0000", 2023-10-08T07:07:04.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8600000000000004e-06 2023-10-08T07:07:04.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.255 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.255 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.216493+0000", 2023-10-08T07:07:04.255 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031642189999999998 2023-10-08T07:07:04.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.255 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.255 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.255 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.216579+0000", 2023-10-08T07:07:04.255 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5995000000000006e-05 2023-10-08T07:07:04.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.255 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.255 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.255 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.216760+0000", 2023-10-08T07:07:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000181189 2023-10-08T07:07:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.219144+0000", 2023-10-08T07:07:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0023831880000000001 2023-10-08T07:07:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.256 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:50177 4.20 4:04004f2c:::10000000004.0000000d:head [write 2371584~4096 in=4096b,write 2383872~4096 in=4096b,write 2416640~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:04.214264+0000", 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0051286020000000003, 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052720110000000001, 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 50177 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.258 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.214264+0000", 2023-10-08T07:07:04.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.258 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.258 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.214264+0000", 2023-10-08T07:07:04.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.258 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.258 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.214264+0000", 2023-10-08T07:07:04.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4099999999999997e-07 2023-10-08T07:07:04.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.259 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.259 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.214280+0000", 2023-10-08T07:07:04.259 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5358000000000001e-05 2023-10-08T07:07:04.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.259 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.259 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.214292+0000", 2023-10-08T07:07:04.259 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1790000000000001e-05 2023-10-08T07:07:04.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.260 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.214300+0000", 2023-10-08T07:07:04.260 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1890000000000007e-06 2023-10-08T07:07:04.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.260 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.214398+0000", 2023-10-08T07:07:04.260 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8228999999999998e-05 2023-10-08T07:07:04.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.261 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.214479+0000", 2023-10-08T07:07:04.261 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0694999999999999e-05 2023-10-08T07:07:04.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.261 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.261 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.261 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.214625+0000", 2023-10-08T07:07:04.262 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000146069 2023-10-08T07:07:04.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.262 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.262 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.262 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.217733+0000", 2023-10-08T07:07:04.263 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031079050000000002 2023-10-08T07:07:04.263 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.263 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.263 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.264 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:50186 4.e 4:70352312:::10000000004.0000001a:head [write 57344~4096 in=4096b,write 73728~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.264 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:04.218373+0000", 2023-10-08T07:07:04.264 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.001019205, 2023-10-08T07:07:04.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001286674, 2023-10-08T07:07:04.264 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.265 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:04.265 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.265 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.265 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.265 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 50186 2023-10-08T07:07:04.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.265 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.265 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218373+0000", 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218373+0000", 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218374+0000", 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218384+0000", 2023-10-08T07:07:04.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0271999999999999e-05 2023-10-08T07:07:04.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218393+0000", 2023-10-08T07:07:04.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7630000000000006e-06 2023-10-08T07:07:04.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218398+0000", 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4060000000000004e-06 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218438+0000", 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9860000000000001e-05 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218497+0000", 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9092999999999998e-05 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.268 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.269 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.269 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:50187 4.e 4:7242a848:::10000000004.00000020:head [write 1740800~4096 in=4096b,write 1810432~4096 in=4096b,write 1818624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.269 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:04.218602+0000", 2023-10-08T07:07:04.269 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00079027999999999998, 2023-10-08T07:07:04.269 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011598940000000001, 2023-10-08T07:07:04.269 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.269 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:04.269 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.270 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.270 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.270 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 50187 2023-10-08T07:07:04.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.270 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.270 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218602+0000", 2023-10-08T07:07:04.270 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218602+0000", 2023-10-08T07:07:04.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218603+0000", 2023-10-08T07:07:04.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0809999999999999e-06 2023-10-08T07:07:04.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218618+0000", 2023-10-08T07:07:04.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5313999999999999e-05 2023-10-08T07:07:04.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218630+0000", 2023-10-08T07:07:04.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1537e-05 2023-10-08T07:07:04.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.218639+0000", 2023-10-08T07:07:04.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8650000000000007e-06 2023-10-08T07:07:04.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.273 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.219505+0000", 2023-10-08T07:07:04.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00086595300000000004 2023-10-08T07:07:04.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.273 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.219614+0000", 2023-10-08T07:07:04.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000109157 2023-10-08T07:07:04.273 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.273 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.274 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.274 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:50189 4.a 4:524fba76:::10000000004.0000001b:head [write 180224~4096 in=4096b,write 311296~4096 in=4096b,write 348160~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.274 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:04.219313+0000", 2023-10-08T07:07:04.274 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 7.8767e-05, 2023-10-08T07:07:04.274 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00053106900000000001, 2023-10-08T07:07:04.274 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.274 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:04.274 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.275 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.275 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.275 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 50189 2023-10-08T07:07:04.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.275 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.275 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.275 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.275 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.219313+0000", 2023-10-08T07:07:04.275 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.276 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.219313+0000", 2023-10-08T07:07:04.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.276 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.219314+0000", 2023-10-08T07:07:04.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7300000000000005e-07 2023-10-08T07:07:04.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.219337+0000", 2023-10-08T07:07:04.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2583999999999999e-05 2023-10-08T07:07:04.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.219348+0000", 2023-10-08T07:07:04.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.084e-05 2023-10-08T07:07:04.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.219354+0000", 2023-10-08T07:07:04.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.195e-06 2023-10-08T07:07:04.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.219407+0000", 2023-10-08T07:07:04.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3099000000000001e-05 2023-10-08T07:07:04.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.219502+0000", 2023-10-08T07:07:04.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5177e-05 2023-10-08T07:07:04.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.219669+0000", 2023-10-08T07:07:04.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016640599999999999 2023-10-08T07:07:04.280 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.280 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.280 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.280 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.280 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:07:04.280 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 5 2023-10-08T07:07:04.280 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:04.283 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:04.280+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:04.284 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:04.382 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:04.381+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:04.483 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:04.481+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:04.497 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:04.497 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:04.497 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:04.497 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:04.498 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:04.512 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:04.584 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:04.583+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:04.685 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:04.684+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:04.709 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:04.709 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:04.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:04.709 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:04.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.710 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:2064 4.32 4:4efc9492:::10000000004.00000032:head [write 110592~4096,write 249856~4096,write 270336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-10-08T07:07:04.710 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:07:04.710 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 18.647378811999999, 2023-10-08T07:07:04.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019126292, 2023-10-08T07:07:04.710 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.710 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.710 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.710 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.711 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.711 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 2064 2023-10-08T07:07:04.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.711 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:07:04.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057831+0000", 2023-10-08T07:07:04.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057832+0000", 2023-10-08T07:07:04.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3699999999999999e-07 2023-10-08T07:07:04.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057886+0000", 2023-10-08T07:07:04.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4531999999999999e-05 2023-10-08T07:07:04.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057901+0000", 2023-10-08T07:07:04.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4518999999999999e-05 2023-10-08T07:07:04.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057910+0000", 2023-10-08T07:07:04.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4579999999999999e-06 2023-10-08T07:07:04.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.057963+0000", 2023-10-08T07:07:04.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3161000000000001e-05 2023-10-08T07:07:04.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.058023+0000", 2023-10-08T07:07:04.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0027e-05 2023-10-08T07:07:04.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076814+0000", 2023-10-08T07:07:04.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018790187 2023-10-08T07:07:04.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076879+0000", 2023-10-08T07:07:04.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4999999999999994e-05 2023-10-08T07:07:04.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:46.076957+0000", 2023-10-08T07:07:04.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8571000000000004e-05 2023-10-08T07:07:04.716 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.716 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.717 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.717 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36130 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 3895296~4096,write 3911680~4096,write 4141056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:04.717 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:58.999137+0000", 2023-10-08T07:07:04.717 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.7060730040000003, 2023-10-08T07:07:04.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018936008000000001, 2023-10-08T07:07:04.717 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.717 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.717 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.718 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.718 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.718 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36130 2023-10-08T07:07:04.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.718 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.999137+0000", 2023-10-08T07:07:04.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.999137+0000", 2023-10-08T07:07:04.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.999137+0000", 2023-10-08T07:07:04.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4499999999999997e-07 2023-10-08T07:07:04.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.999145+0000", 2023-10-08T07:07:04.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4560000000000003e-06 2023-10-08T07:07:04.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.999152+0000", 2023-10-08T07:07:04.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2699999999999999e-06 2023-10-08T07:07:04.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:58.999156+0000", 2023-10-08T07:07:04.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3900000000000003e-06 2023-10-08T07:07:04.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000909+0000", 2023-10-08T07:07:04.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001752853 2023-10-08T07:07:04.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000974+0000", 2023-10-08T07:07:04.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4768000000000001e-05 2023-10-08T07:07:04.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.001112+0000", 2023-10-08T07:07:04.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000137918 2023-10-08T07:07:04.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.723 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.723 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.015718+0000", 2023-10-08T07:07:04.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014606156 2023-10-08T07:07:04.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.723 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.017977+0000", 2023-10-08T07:07:04.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022591289999999999 2023-10-08T07:07:04.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.018028+0000", 2023-10-08T07:07:04.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.113e-05 2023-10-08T07:07:04.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.018073+0000", 2023-10-08T07:07:04.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4393e-05 2023-10-08T07:07:04.726 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.726 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.726 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.726 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36135 4.1b 4:d97fb168:::10000000004.00000008:head [write 3981312~8192,write 4050944~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:04.726 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.000619+0000", 2023-10-08T07:07:04.726 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.7045905279999998, 2023-10-08T07:07:04.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019040867999999999, 2023-10-08T07:07:04.727 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.727 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.727 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.727 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.727 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.727 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36135 2023-10-08T07:07:04.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.727 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000619+0000", 2023-10-08T07:07:04.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000619+0000", 2023-10-08T07:07:04.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000620+0000", 2023-10-08T07:07:04.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.23e-07 2023-10-08T07:07:04.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000644+0000", 2023-10-08T07:07:04.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3949999999999999e-05 2023-10-08T07:07:04.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000657+0000", 2023-10-08T07:07:04.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2604e-05 2023-10-08T07:07:04.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.000664+0000", 2023-10-08T07:07:04.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.926e-06 2023-10-08T07:07:04.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.004936+0000", 2023-10-08T07:07:04.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042710780000000002 2023-10-08T07:07:04.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.004987+0000", 2023-10-08T07:07:04.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1848000000000002e-05 2023-10-08T07:07:04.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.005077+0000", 2023-10-08T07:07:04.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0117999999999993e-05 2023-10-08T07:07:04.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.018082+0000", 2023-10-08T07:07:04.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013004454 2023-10-08T07:07:04.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.019605+0000", 2023-10-08T07:07:04.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001523513 2023-10-08T07:07:04.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.019639+0000", 2023-10-08T07:07:04.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3105999999999998e-05 2023-10-08T07:07:04.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.019660+0000", 2023-10-08T07:07:04.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1548000000000001e-05 2023-10-08T07:07:04.733 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.733 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.733 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.733 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36584 4.1a 4:5a59f83a:::10000000004.00000002:head [write 2334720~4096,write 2727936~4096,write 2785280~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:04.733 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.164916+0000", 2023-10-08T07:07:04.733 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.5402937770000005, 2023-10-08T07:07:04.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020061165999999998, 2023-10-08T07:07:04.734 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.734 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.734 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.734 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.734 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.734 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36584 2023-10-08T07:07:04.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.734 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.164916+0000", 2023-10-08T07:07:04.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.164916+0000", 2023-10-08T07:07:04.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.164917+0000", 2023-10-08T07:07:04.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4300000000000002e-07 2023-10-08T07:07:04.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.164956+0000", 2023-10-08T07:07:04.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9496000000000003e-05 2023-10-08T07:07:04.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.164964+0000", 2023-10-08T07:07:04.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2799999999999998e-06 2023-10-08T07:07:04.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.164968+0000", 2023-10-08T07:07:04.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1139999999999999e-06 2023-10-08T07:07:04.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.166928+0000", 2023-10-08T07:07:04.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0019605209999999998 2023-10-08T07:07:04.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167002+0000", 2023-10-08T07:07:04.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4194000000000001e-05 2023-10-08T07:07:04.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167140+0000", 2023-10-08T07:07:04.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000137768 2023-10-08T07:07:04.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.173717+0000", 2023-10-08T07:07:04.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065771919999999999 2023-10-08T07:07:04.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.184920+0000", 2023-10-08T07:07:04.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011202782999999999 2023-10-08T07:07:04.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.184954+0000", 2023-10-08T07:07:04.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4298999999999998e-05 2023-10-08T07:07:04.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.184977+0000", 2023-10-08T07:07:04.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2776e-05 2023-10-08T07:07:04.740 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.740 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.740 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.741 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36591 4.38 4:1e0977c7:::10000000004.00000022:head [write 954368~4096,write 1089536~4096,write 1118208~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:04.741 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.167358+0000", 2023-10-08T07:07:04.741 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.5378519830000004, 2023-10-08T07:07:04.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.02065931, 2023-10-08T07:07:04.741 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.741 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.742 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.742 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.742 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.742 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36591 2023-10-08T07:07:04.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.742 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167358+0000", 2023-10-08T07:07:04.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167358+0000", 2023-10-08T07:07:04.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167358+0000", 2023-10-08T07:07:04.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6899999999999997e-07 2023-10-08T07:07:04.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167369+0000", 2023-10-08T07:07:04.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1042e-05 2023-10-08T07:07:04.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.744 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.744 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167377+0000", 2023-10-08T07:07:04.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7649999999999993e-06 2023-10-08T07:07:04.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167382+0000", 2023-10-08T07:07:04.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7539999999999997e-06 2023-10-08T07:07:04.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167425+0000", 2023-10-08T07:07:04.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.269e-05 2023-10-08T07:07:04.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167474+0000", 2023-10-08T07:07:04.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9515999999999998e-05 2023-10-08T07:07:04.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167566+0000", 2023-10-08T07:07:04.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1402000000000003e-05 2023-10-08T07:07:04.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.173487+0000", 2023-10-08T07:07:04.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0059214910000000001 2023-10-08T07:07:04.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.187922+0000", 2023-10-08T07:07:04.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014435353999999999 2023-10-08T07:07:04.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.187965+0000", 2023-10-08T07:07:04.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2061999999999998e-05 2023-10-08T07:07:04.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.188017+0000", 2023-10-08T07:07:04.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2565000000000002e-05 2023-10-08T07:07:04.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.748 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.749 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36594 4.38 4:1e0977c7:::10000000004.00000022:head [write 3059712~4096,write 3133440~4096,write 3198976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:04.749 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.168669+0000", 2023-10-08T07:07:04.749 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.5365408970000001, 2023-10-08T07:07:04.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019530400999999999, 2023-10-08T07:07:04.749 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.749 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.749 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.749 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.750 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.750 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36594 2023-10-08T07:07:04.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.750 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168669+0000", 2023-10-08T07:07:04.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168669+0000", 2023-10-08T07:07:04.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168670+0000", 2023-10-08T07:07:04.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1200000000000002e-07 2023-10-08T07:07:04.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168682+0000", 2023-10-08T07:07:04.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2347000000000001e-05 2023-10-08T07:07:04.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168695+0000", 2023-10-08T07:07:04.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2855e-05 2023-10-08T07:07:04.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168703+0000", 2023-10-08T07:07:04.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9880000000000004e-06 2023-10-08T07:07:04.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168823+0000", 2023-10-08T07:07:04.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000120086 2023-10-08T07:07:04.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.168928+0000", 2023-10-08T07:07:04.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000104682 2023-10-08T07:07:04.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.169105+0000", 2023-10-08T07:07:04.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017693599999999999 2023-10-08T07:07:04.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.176001+0000", 2023-10-08T07:07:04.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00689618 2023-10-08T07:07:04.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.188074+0000", 2023-10-08T07:07:04.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012073105000000001 2023-10-08T07:07:04.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.188113+0000", 2023-10-08T07:07:04.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9520000000000001e-05 2023-10-08T07:07:04.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.188199+0000", 2023-10-08T07:07:04.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5890000000000006e-05 2023-10-08T07:07:04.756 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.756 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.756 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.756 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36603 4.38 4:1e0977c7:::10000000004.00000022:head [write 2863104~4096,write 2949120~12288] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:04.756 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.171717+0000", 2023-10-08T07:07:04.756 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.5334926060000003, 2023-10-08T07:07:04.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020705431, 2023-10-08T07:07:04.756 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36603 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171717+0000", 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171717+0000", 2023-10-08T07:07:04.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171718+0000", 2023-10-08T07:07:04.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:07:04.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.758 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171730+0000", 2023-10-08T07:07:04.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1647999999999999e-05 2023-10-08T07:07:04.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171741+0000", 2023-10-08T07:07:04.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1482e-05 2023-10-08T07:07:04.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171747+0000", 2023-10-08T07:07:04.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8529999999999997e-06 2023-10-08T07:07:04.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171799+0000", 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2018000000000002e-05 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171857+0000", 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7908999999999997e-05 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171950+0000", 2023-10-08T07:07:04.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2813999999999996e-05 2023-10-08T07:07:04.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.176466+0000", 2023-10-08T07:07:04.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045161109999999997 2023-10-08T07:07:04.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.192318+0000", 2023-10-08T07:07:04.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015852445 2023-10-08T07:07:04.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.192357+0000", 2023-10-08T07:07:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8512e-05 2023-10-08T07:07:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.192423+0000", 2023-10-08T07:07:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5931000000000003e-05 2023-10-08T07:07:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.762 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.763 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36755 4.3a 4:5f183e4b:::10000000004.00000023:head [write 372736~4096,write 409600~4096,write 638976~4096,write 704512~4096,write 1011712~4096,write 1019904~4096,write 1081344~4096,write 1306624~4096,write 1335296~4096,write 1363968~4096,write 1441792~4096,write 1581056~4096,write 1597440~4096,write 1691648~4096,write 1843200~4096,write 1884160~8192,write 2260992~4096,write 2326528~4096,write 2383872~4096,write 2535424~4096,write 2760704~4096,write 3256320~4096,write 3264512~4096,write 3297280~4096,write 3403776~4096,write 3502080~4096,write 3653632~4096,write 3751936~4096,write 4034560~4096,write 4075520~4096,write 4100096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:04.763 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.226377+0000", 2023-10-08T07:07:04.763 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.4788328330000002, 2023-10-08T07:07:04.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020698510999999999, 2023-10-08T07:07:04.763 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.763 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.763 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.763 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.763 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.764 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36755 2023-10-08T07:07:04.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.764 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226377+0000", 2023-10-08T07:07:04.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226377+0000", 2023-10-08T07:07:04.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226378+0000", 2023-10-08T07:07:04.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4199999999999995e-07 2023-10-08T07:07:04.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226439+0000", 2023-10-08T07:07:04.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1398999999999999e-05 2023-10-08T07:07:04.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226450+0000", 2023-10-08T07:07:04.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0627e-05 2023-10-08T07:07:04.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226458+0000", 2023-10-08T07:07:04.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5229999999999995e-06 2023-10-08T07:07:04.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226504+0000", 2023-10-08T07:07:04.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5847999999999999e-05 2023-10-08T07:07:04.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226609+0000", 2023-10-08T07:07:04.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000104924 2023-10-08T07:07:04.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.227180+0000", 2023-10-08T07:07:04.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057061700000000004 2023-10-08T07:07:04.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.235535+0000", 2023-10-08T07:07:04.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083550780000000002 2023-10-08T07:07:04.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.246850+0000", 2023-10-08T07:07:04.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01131573 2023-10-08T07:07:04.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.247000+0000", 2023-10-08T07:07:04.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014989100000000001 2023-10-08T07:07:04.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.247075+0000", 2023-10-08T07:07:04.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5232000000000001e-05 2023-10-08T07:07:04.769 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.769 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.769 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.770 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:39453 4.29 e49/17 4:94216392:::10000000004.0000002b:head v 49'621, mlcod=48'618)", 2023-10-08T07:07:04.770 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:00.340093+0000", 2023-10-08T07:07:04.770 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.3651166269999999, 2023-10-08T07:07:04.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018691751, 2023-10-08T07:07:04.770 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.770 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.770 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.340093+0000", 2023-10-08T07:07:04.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.340093+0000", 2023-10-08T07:07:04.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.340094+0000", 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9699999999999996e-07 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.340106+0000", 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.205e-05 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.340125+0000", 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9349000000000001e-05 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.340134+0000", 2023-10-08T07:07:04.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5690000000000005e-06 2023-10-08T07:07:04.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.340197+0000", 2023-10-08T07:07:04.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3136e-05 2023-10-08T07:07:04.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.340210+0000", 2023-10-08T07:07:04.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3540000000000001e-05 2023-10-08T07:07:04.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.358747+0000", 2023-10-08T07:07:04.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018536548 2023-10-08T07:07:04.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.358785+0000", 2023-10-08T07:07:04.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7962e-05 2023-10-08T07:07:04.775 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.775 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.775 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.775 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:39474 4.31 e49/48 4:8de29a03:::10000000004.00000001:head v 49'1198, mlcod=49'1194)", 2023-10-08T07:07:04.775 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:00.343224+0000", 2023-10-08T07:07:04.775 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.3619853610000003, 2023-10-08T07:07:04.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018471822999999998, 2023-10-08T07:07:04.775 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.775 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.775 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.343224+0000", 2023-10-08T07:07:04.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.343224+0000", 2023-10-08T07:07:04.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.343225+0000", 2023-10-08T07:07:04.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1200000000000003e-07 2023-10-08T07:07:04.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.343321+0000", 2023-10-08T07:07:04.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6379000000000007e-05 2023-10-08T07:07:04.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.343331+0000", 2023-10-08T07:07:04.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8099999999999992e-06 2023-10-08T07:07:04.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.343337+0000", 2023-10-08T07:07:04.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4820000000000002e-06 2023-10-08T07:07:04.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.343602+0000", 2023-10-08T07:07:04.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00026518400000000001 2023-10-08T07:07:04.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.343624+0000", 2023-10-08T07:07:04.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2041000000000001e-05 2023-10-08T07:07:04.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.361645+0000", 2023-10-08T07:07:04.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018021663 2023-10-08T07:07:04.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.361696+0000", 2023-10-08T07:07:04.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0751999999999998e-05 2023-10-08T07:07:04.780 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.780 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.780 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.780 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:39475 4.31 e49/48 4:8ec1b377:::10000000004.00000019:head v 49'1199, mlcod=49'1196)", 2023-10-08T07:07:04.780 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:00.347030+0000", 2023-10-08T07:07:04.781 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.3581795230000004, 2023-10-08T07:07:04.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019561927999999999, 2023-10-08T07:07:04.781 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.781 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.781 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.347030+0000", 2023-10-08T07:07:04.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.347030+0000", 2023-10-08T07:07:04.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.347031+0000", 2023-10-08T07:07:04.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6300000000000005e-07 2023-10-08T07:07:04.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.347127+0000", 2023-10-08T07:07:04.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5873999999999997e-05 2023-10-08T07:07:04.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.347144+0000", 2023-10-08T07:07:04.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7493999999999999e-05 2023-10-08T07:07:04.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.347154+0000", 2023-10-08T07:07:04.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7380000000000006e-06 2023-10-08T07:07:04.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.353493+0000", 2023-10-08T07:07:04.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0063390779999999997 2023-10-08T07:07:04.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.353508+0000", 2023-10-08T07:07:04.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4793e-05 2023-10-08T07:07:04.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.366539+0000", 2023-10-08T07:07:04.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013031437999999999 2023-10-08T07:07:04.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.366592+0000", 2023-10-08T07:07:04.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.295e-05 2023-10-08T07:07:04.785 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.785 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.785 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.785 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:39963 4.20 4:07572838:::10000000004.00000010:head [write 2719744~8192,write 2838528~4096,write 2981888~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-10-08T07:07:04.786 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:00.448077+0000", 2023-10-08T07:07:04.786 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.2571325450000002, 2023-10-08T07:07:04.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019097777, 2023-10-08T07:07:04.786 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.786 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.786 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.786 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.786 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.786 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 39963 2023-10-08T07:07:04.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.786 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.448077+0000", 2023-10-08T07:07:04.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.448077+0000", 2023-10-08T07:07:04.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.448078+0000", 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5199999999999996e-07 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.448090+0000", 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2587e-05 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.448099+0000", 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5890000000000003e-06 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.448107+0000", 2023-10-08T07:07:04.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:07:04.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.448619+0000", 2023-10-08T07:07:04.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00051275500000000005 2023-10-08T07:07:04.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.448723+0000", 2023-10-08T07:07:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000103429 2023-10-08T07:07:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.448875+0000", 2023-10-08T07:07:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015200899999999999 2023-10-08T07:07:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.454573+0000", 2023-10-08T07:07:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0056981380000000002 2023-10-08T07:07:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.467087+0000", 2023-10-08T07:07:04.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012513857999999999 2023-10-08T07:07:04.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.467142+0000", 2023-10-08T07:07:04.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4710999999999998e-05 2023-10-08T07:07:04.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:00.467175+0000", 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.341e-05 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:47672 4.20 4:07572838:::10000000004.00000010:head [write 2793472~4096,write 2936832~4096,write 3117056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:03.301898+0000", 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.4033118440000001, 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018710091000000002, 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.792 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.793 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.793 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.793 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.793 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 47672 2023-10-08T07:07:04.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.793 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.301898+0000", 2023-10-08T07:07:04.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.301898+0000", 2023-10-08T07:07:04.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.301899+0000", 2023-10-08T07:07:04.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2600000000000001e-07 2023-10-08T07:07:04.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.301911+0000", 2023-10-08T07:07:04.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2301e-05 2023-10-08T07:07:04.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.301933+0000", 2023-10-08T07:07:04.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2410999999999999e-05 2023-10-08T07:07:04.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.301942+0000", 2023-10-08T07:07:04.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3440000000000001e-06 2023-10-08T07:07:04.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.301997+0000", 2023-10-08T07:07:04.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4854e-05 2023-10-08T07:07:04.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.302062+0000", 2023-10-08T07:07:04.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5011999999999994e-05 2023-10-08T07:07:04.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.302165+0000", 2023-10-08T07:07:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010315999999999999 2023-10-08T07:07:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.303592+0000", 2023-10-08T07:07:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0014274380000000001 2023-10-08T07:07:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.320528+0000", 2023-10-08T07:07:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016936118 2023-10-08T07:07:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.320565+0000", 2023-10-08T07:07:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6565e-05 2023-10-08T07:07:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.320608+0000", 2023-10-08T07:07:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3062000000000002e-05 2023-10-08T07:07:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:48269 4.20 4:05b3915c:::10000000004.00000016:head [write 0~4096,write 73728~4096,write 303104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:03.531752+0000", 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.173457934, 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019030409000000002, 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.799 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 48269 2023-10-08T07:07:04.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.800 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.531752+0000", 2023-10-08T07:07:04.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.531752+0000", 2023-10-08T07:07:04.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.531752+0000", 2023-10-08T07:07:04.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4700000000000001e-07 2023-10-08T07:07:04.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.531761+0000", 2023-10-08T07:07:04.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6889999999999993e-06 2023-10-08T07:07:04.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.531769+0000", 2023-10-08T07:07:04.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8259999999999993e-06 2023-10-08T07:07:04.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.531773+0000", 2023-10-08T07:07:04.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3100000000000002e-06 2023-10-08T07:07:04.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.532403+0000", 2023-10-08T07:07:04.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00062954199999999997 2023-10-08T07:07:04.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.532491+0000", 2023-10-08T07:07:04.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7915000000000001e-05 2023-10-08T07:07:04.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.532653+0000", 2023-10-08T07:07:04.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000161939 2023-10-08T07:07:04.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.535425+0000", 2023-10-08T07:07:04.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027718529999999999 2023-10-08T07:07:04.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.550709+0000", 2023-10-08T07:07:04.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015284300000000001 2023-10-08T07:07:04.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.550757+0000", 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8384999999999998e-05 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.550782+0000", 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5003000000000001e-05 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:48491 4.2b 4:d776c1c9:::10000000004.0000003d:head [write 3043328~4096,write 3133440~4096,write 3563520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.805 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:03.611672+0000", 2023-10-08T07:07:04.806 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.093537303, 2023-10-08T07:07:04.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021034442, 2023-10-08T07:07:04.806 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.806 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.806 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.806 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.806 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.806 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 48491 2023-10-08T07:07:04.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.806 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611672+0000", 2023-10-08T07:07:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611672+0000", 2023-10-08T07:07:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611673+0000", 2023-10-08T07:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1099999999999995e-07 2023-10-08T07:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611683+0000", 2023-10-08T07:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0073e-05 2023-10-08T07:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611692+0000", 2023-10-08T07:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2059999999999996e-06 2023-10-08T07:07:04.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611698+0000", 2023-10-08T07:07:04.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4929999999999998e-06 2023-10-08T07:07:04.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611747+0000", 2023-10-08T07:07:04.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9190999999999997e-05 2023-10-08T07:07:04.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611803+0000", 2023-10-08T07:07:04.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6273999999999997e-05 2023-10-08T07:07:04.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611914+0000", 2023-10-08T07:07:04.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011047100000000001 2023-10-08T07:07:04.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.614504+0000", 2023-10-08T07:07:04.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0025900490000000001 2023-10-08T07:07:04.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.632638+0000", 2023-10-08T07:07:04.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018133719 2023-10-08T07:07:04.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.632673+0000", 2023-10-08T07:07:04.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5649999999999999e-05 2023-10-08T07:07:04.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.632707+0000", 2023-10-08T07:07:04.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3605000000000001e-05 2023-10-08T07:07:04.813 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.813 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.813 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.813 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:48492 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 2052096~4096,write 2113536~4096,write 2158592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.813 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:03.611986+0000", 2023-10-08T07:07:04.813 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.093223346, 2023-10-08T07:07:04.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024276833000000001, 2023-10-08T07:07:04.814 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.814 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.814 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.814 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.814 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.814 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 48492 2023-10-08T07:07:04.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.814 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611986+0000", 2023-10-08T07:07:04.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611986+0000", 2023-10-08T07:07:04.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611987+0000", 2023-10-08T07:07:04.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7000000000000004e-07 2023-10-08T07:07:04.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611995+0000", 2023-10-08T07:07:04.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2719999999999997e-06 2023-10-08T07:07:04.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612003+0000", 2023-10-08T07:07:04.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2710000000000003e-06 2023-10-08T07:07:04.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612009+0000", 2023-10-08T07:07:04.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1689999999999997e-06 2023-10-08T07:07:04.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612063+0000", 2023-10-08T07:07:04.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4608999999999998e-05 2023-10-08T07:07:04.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612153+0000", 2023-10-08T07:07:04.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9269000000000002e-05 2023-10-08T07:07:04.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612333+0000", 2023-10-08T07:07:04.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000179944 2023-10-08T07:07:04.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.616694+0000", 2023-10-08T07:07:04.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004361658 2023-10-08T07:07:04.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636189+0000", 2023-10-08T07:07:04.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019494880999999999 2023-10-08T07:07:04.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636232+0000", 2023-10-08T07:07:04.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2500000000000003e-05 2023-10-08T07:07:04.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.820 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636263+0000", 2023-10-08T07:07:04.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1590000000000001e-05 2023-10-08T07:07:04.821 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.821 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.821 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.821 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:48494 4.2b 4:d7a77d67:::10000000004.00000029:head [write 3076096~4096,write 3215360~4096,write 3485696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.821 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:03.612886+0000", 2023-10-08T07:07:04.821 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.0923242360000001, 2023-10-08T07:07:04.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023426592999999999, 2023-10-08T07:07:04.821 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.821 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 48494 2023-10-08T07:07:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612886+0000", 2023-10-08T07:07:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612886+0000", 2023-10-08T07:07:04.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612886+0000", 2023-10-08T07:07:04.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4499999999999997e-07 2023-10-08T07:07:04.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612896+0000", 2023-10-08T07:07:04.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.329e-06 2023-10-08T07:07:04.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612906+0000", 2023-10-08T07:07:04.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0631e-05 2023-10-08T07:07:04.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612912+0000", 2023-10-08T07:07:04.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4840000000000003e-06 2023-10-08T07:07:04.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.613623+0000", 2023-10-08T07:07:04.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00071140600000000004 2023-10-08T07:07:04.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.613673+0000", 2023-10-08T07:07:04.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0259000000000001e-05 2023-10-08T07:07:04.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.826 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.826 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.613770+0000", 2023-10-08T07:07:04.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6984999999999994e-05 2023-10-08T07:07:04.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.826 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.826 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.826 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.617057+0000", 2023-10-08T07:07:04.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003287192 2023-10-08T07:07:04.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.826 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.826 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.826 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636213+0000", 2023-10-08T07:07:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019155798000000002 2023-10-08T07:07:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636274+0000", 2023-10-08T07:07:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0639e-05 2023-10-08T07:07:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636312+0000", 2023-10-08T07:07:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8225000000000001e-05 2023-10-08T07:07:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:48497 4.30 4:0f322a22:::10000000004.00000014:head [write 2670592~4096,write 2711552~4096,write 2797568~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:03.614016+0000", 2023-10-08T07:07:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.091193294, 2023-10-08T07:07:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019796786, 2023-10-08T07:07:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.829 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.829 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 48497 2023-10-08T07:07:04.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.829 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.614016+0000", 2023-10-08T07:07:04.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.614016+0000", 2023-10-08T07:07:04.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.614017+0000", 2023-10-08T07:07:04.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0299999999999998e-07 2023-10-08T07:07:04.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.614028+0000", 2023-10-08T07:07:04.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1134999999999999e-05 2023-10-08T07:07:04.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.614052+0000", 2023-10-08T07:07:04.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3884999999999999e-05 2023-10-08T07:07:04.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.614058+0000", 2023-10-08T07:07:04.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7960000000000001e-06 2023-10-08T07:07:04.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.614101+0000", 2023-10-08T07:07:04.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3068000000000002e-05 2023-10-08T07:07:04.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.614171+0000", 2023-10-08T07:07:04.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0168999999999999e-05 2023-10-08T07:07:04.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.614273+0000", 2023-10-08T07:07:04.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010197800000000001 2023-10-08T07:07:04.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.833 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.617086+0000", 2023-10-08T07:07:04.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0028132539999999998 2023-10-08T07:07:04.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.833 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.633722+0000", 2023-10-08T07:07:04.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016635985999999998 2023-10-08T07:07:04.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.633775+0000", 2023-10-08T07:07:04.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2611999999999997e-05 2023-10-08T07:07:04.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.633813+0000", 2023-10-08T07:07:04.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.82e-05 2023-10-08T07:07:04.834 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.834 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.835 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.835 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:48767 4.20 4:05b3915c:::10000000004.00000016:head [write 1679360~4096,write 1777664~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.835 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:03.710532+0000", 2023-10-08T07:07:04.835 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.994677963, 2023-10-08T07:07:04.835 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018822530000000001, 2023-10-08T07:07:04.835 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.835 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.835 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.835 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.836 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.836 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 48767 2023-10-08T07:07:04.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.836 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.710532+0000", 2023-10-08T07:07:04.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.710532+0000", 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.710533+0000", 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7199999999999997e-07 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.710548+0000", 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4898e-05 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.710559+0000", 2023-10-08T07:07:04.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1368e-05 2023-10-08T07:07:04.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.710567+0000", 2023-10-08T07:07:04.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7749999999999993e-06 2023-10-08T07:07:04.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.714007+0000", 2023-10-08T07:07:04.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003440149 2023-10-08T07:07:04.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.714054+0000", 2023-10-08T07:07:04.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7568000000000003e-05 2023-10-08T07:07:04.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:04.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.714153+0000", 2023-10-08T07:07:04.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8171999999999995e-05 2023-10-08T07:07:04.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.716596+0000", 2023-10-08T07:07:04.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0024429719999999999 2023-10-08T07:07:04.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:04.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.729252+0000", 2023-10-08T07:07:04.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012656426 2023-10-08T07:07:04.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.841 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.729315+0000", 2023-10-08T07:07:04.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2813999999999999e-05 2023-10-08T07:07:04.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.841 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.841 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.729354+0000", 2023-10-08T07:07:04.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9515999999999999e-05 2023-10-08T07:07:04.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.841 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:50123 4.5 4:a367a3e8:::10000000004.00000000:head [write 1253376~4096,write 1302528~4096,write 1376256~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:04.195055+0000", 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.51015447999999997, 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020785788999999999, 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 50123 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:04.842 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:04.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195055+0000", 2023-10-08T07:07:04.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:04.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195055+0000", 2023-10-08T07:07:04.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:04.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:04.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195056+0000", 2023-10-08T07:07:04.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8599999999999998e-07 2023-10-08T07:07:04.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:04.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195071+0000", 2023-10-08T07:07:04.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4749000000000001e-05 2023-10-08T07:07:04.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:04.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195083+0000", 2023-10-08T07:07:04.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2024999999999999e-05 2023-10-08T07:07:04.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:04.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195102+0000", 2023-10-08T07:07:04.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8970999999999998e-05 2023-10-08T07:07:04.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:04.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195153+0000", 2023-10-08T07:07:04.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1078999999999997e-05 2023-10-08T07:07:04.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:04.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195214+0000", 2023-10-08T07:07:04.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1118000000000007e-05 2023-10-08T07:07:04.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:04.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.215698+0000", 2023-10-08T07:07:04.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020484316999999998 2023-10-08T07:07:04.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:04.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.215758+0000", 2023-10-08T07:07:04.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9576e-05 2023-10-08T07:07:04.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:04.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:04.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:04.847 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.215841+0000", 2023-10-08T07:07:04.847 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3368000000000005e-05 2023-10-08T07:07:04.847 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.847 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.847 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.847 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:04.847 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:04.847 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:04.849 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:04.849 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:04.847+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:04.949 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:04.948+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:05.039 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:05.039 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:05.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.039 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:52389 4.2b e50/17 4:d776c1c9:::10000000004.0000003d:head v 50'1673, mlcod=50'1670)", 2023-10-08T07:07:05.039 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:05.035483+0000", 2023-10-08T07:07:05.039 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0023910070000000001, 2023-10-08T07:07:05.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024135319999999999, 2023-10-08T07:07:05.039 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:05.040 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:05.040 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:05.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:05.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.035483+0000", 2023-10-08T07:07:05.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:05.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.035483+0000", 2023-10-08T07:07:05.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:05.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.035484+0000", 2023-10-08T07:07:05.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:07:05.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:05.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.035495+0000", 2023-10-08T07:07:05.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0728e-05 2023-10-08T07:07:05.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:05.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.035500+0000", 2023-10-08T07:07:05.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2719999999999997e-06 2023-10-08T07:07:05.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:05.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.035503+0000", 2023-10-08T07:07:05.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.579e-06 2023-10-08T07:07:05.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:05.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.035540+0000", 2023-10-08T07:07:05.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6467999999999997e-05 2023-10-08T07:07:05.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:05.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.035552+0000", 2023-10-08T07:07:05.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2152e-05 2023-10-08T07:07:05.044 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.044 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:05.044 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.045 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:52391 4.37 4:efdd41ff:::10000000004.0000001c:head [write 655360~4096 in=4096b,write 716800~4096 in=4096b,write 1646592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:05.045 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:05.036581+0000", 2023-10-08T07:07:05.045 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001293343, 2023-10-08T07:07:05.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013939759999999999, 2023-10-08T07:07:05.045 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:05.045 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:05.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:05.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:05.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:05.046 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 52391 2023-10-08T07:07:05.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.046 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:05.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:05.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036581+0000", 2023-10-08T07:07:05.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:05.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036581+0000", 2023-10-08T07:07:05.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:05.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036582+0000", 2023-10-08T07:07:05.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6400000000000001e-07 2023-10-08T07:07:05.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:05.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036593+0000", 2023-10-08T07:07:05.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.115e-05 2023-10-08T07:07:05.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:05.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036603+0000", 2023-10-08T07:07:05.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0059e-05 2023-10-08T07:07:05.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:05.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036608+0000", 2023-10-08T07:07:05.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.198e-06 2023-10-08T07:07:05.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:05.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036649+0000", 2023-10-08T07:07:05.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1125999999999999e-05 2023-10-08T07:07:05.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:05.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036700+0000", 2023-10-08T07:07:05.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1020000000000003e-05 2023-10-08T07:07:05.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.050 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:05.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.050 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:52390 4.1b e50/17 4:d97fb168:::10000000004.00000008:head v 50'1620, mlcod=50'1618)", 2023-10-08T07:07:05.050 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:05.036583+0000", 2023-10-08T07:07:05.050 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0012911890000000001, 2023-10-08T07:07:05.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001468685, 2023-10-08T07:07:05.051 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:05.051 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:05.051 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:05.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:05.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036583+0000", 2023-10-08T07:07:05.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:05.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036583+0000", 2023-10-08T07:07:05.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:05.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036584+0000", 2023-10-08T07:07:05.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2023-10-08T07:07:05.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:05.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036602+0000", 2023-10-08T07:07:05.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8640000000000001e-05 2023-10-08T07:07:05.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:05.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036609+0000", 2023-10-08T07:07:05.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0700000000000001e-06 2023-10-08T07:07:05.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:05.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036614+0000", 2023-10-08T07:07:05.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7299999999999996e-06 2023-10-08T07:07:05.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:05.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036655+0000", 2023-10-08T07:07:05.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0701999999999998e-05 2023-10-08T07:07:05.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:05.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.036667+0000", 2023-10-08T07:07:05.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1707e-05 2023-10-08T07:07:05.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.055 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:05.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.055 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:52393 4.11 4:8963efe6:::10000000004.00000009:head [write 3973120~8192 in=8192b,write 3985408~4096 in=4096b,write 4169728~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:05.055 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:05.037156+0000", 2023-10-08T07:07:05.055 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00071866200000000001, 2023-10-08T07:07:05.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00096994300000000002, 2023-10-08T07:07:05.055 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:05.055 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:05.055 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:05.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:05.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:05.056 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 52393 2023-10-08T07:07:05.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.056 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:05.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:05.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037156+0000", 2023-10-08T07:07:05.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:05.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037156+0000", 2023-10-08T07:07:05.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:05.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037157+0000", 2023-10-08T07:07:05.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2900000000000002e-07 2023-10-08T07:07:05.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:05.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037168+0000", 2023-10-08T07:07:05.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1849e-05 2023-10-08T07:07:05.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:05.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037180+0000", 2023-10-08T07:07:05.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1634000000000001e-05 2023-10-08T07:07:05.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:05.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037187+0000", 2023-10-08T07:07:05.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8759999999999999e-06 2023-10-08T07:07:05.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:05.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037235+0000", 2023-10-08T07:07:05.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8140000000000003e-05 2023-10-08T07:07:05.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:05.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037283+0000", 2023-10-08T07:07:05.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7530000000000001e-05 2023-10-08T07:07:05.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:05.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037376+0000", 2023-10-08T07:07:05.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3129999999999998e-05 2023-10-08T07:07:05.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.060 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:05.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.060 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:52392 4.20 e50/17 4:05b3915c:::10000000004.00000016:head v 50'2444, mlcod=50'2442)", 2023-10-08T07:07:05.061 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:05.037369+0000", 2023-10-08T07:07:05.061 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00050542399999999998, 2023-10-08T07:07:05.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00083930599999999995, 2023-10-08T07:07:05.061 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:05.061 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:05.061 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:05.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:05.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037369+0000", 2023-10-08T07:07:05.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:05.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037369+0000", 2023-10-08T07:07:05.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:05.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037370+0000", 2023-10-08T07:07:05.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6000000000000004e-07 2023-10-08T07:07:05.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:05.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037382+0000", 2023-10-08T07:07:05.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2689e-05 2023-10-08T07:07:05.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:05.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037391+0000", 2023-10-08T07:07:05.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6719999999999993e-06 2023-10-08T07:07:05.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:05.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037398+0000", 2023-10-08T07:07:05.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8190000000000003e-06 2023-10-08T07:07:05.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:05.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037448+0000", 2023-10-08T07:07:05.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0661999999999997e-05 2023-10-08T07:07:05.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:05.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037468+0000", 2023-10-08T07:07:05.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9704e-05 2023-10-08T07:07:05.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.065 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:05.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.066 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:52384 4.16 4:69eefec8:::10000000004.0000003a:head [write 1478656~4096 in=4096b,write 1515520~4096 in=4096b,write 1617920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:05.066 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:05.033154+0000", 2023-10-08T07:07:05.066 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0047203569999999997, 2023-10-08T07:07:05.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051264199999999996, 2023-10-08T07:07:05.066 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:05.066 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:05.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:05.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:05.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:05.067 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 52384 2023-10-08T07:07:05.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.067 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:05.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:05.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.033154+0000", 2023-10-08T07:07:05.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:05.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.033154+0000", 2023-10-08T07:07:05.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:05.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.033155+0000", 2023-10-08T07:07:05.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5899999999999995e-07 2023-10-08T07:07:05.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:05.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.033198+0000", 2023-10-08T07:07:05.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2023-10-08T07:07:05.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:05.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.033210+0000", 2023-10-08T07:07:05.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1922999999999999e-05 2023-10-08T07:07:05.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:05.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.033215+0000", 2023-10-08T07:07:05.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9570000000000001e-06 2023-10-08T07:07:05.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:05.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.033264+0000", 2023-10-08T07:07:05.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9202000000000001e-05 2023-10-08T07:07:05.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:05.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.033351+0000", 2023-10-08T07:07:05.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6934999999999994e-05 2023-10-08T07:07:05.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:05.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.033515+0000", 2023-10-08T07:07:05.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000164029 2023-10-08T07:07:05.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:05.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.037678+0000", 2023-10-08T07:07:05.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041631339999999998 2023-10-08T07:07:05.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.072 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:05.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.072 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:52386 4.16 4:69eefec8:::10000000004.0000003a:head [write 1363968~4096 in=4096b,write 1433600~4096 in=4096b,write 1716224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:05.072 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:05.033858+0000", 2023-10-08T07:07:05.073 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0040168390000000003, 2023-10-08T07:07:05.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044974500000000001, 2023-10-08T07:07:05.073 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:05.073 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:05.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:05.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:05.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:05.073 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 52386 2023-10-08T07:07:05.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.073 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:05.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:05.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.033858+0000", 2023-10-08T07:07:05.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:05.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.033858+0000", 2023-10-08T07:07:05.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:05.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.033859+0000", 2023-10-08T07:07:05.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9199999999999999e-07 2023-10-08T07:07:05.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:05.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034020+0000", 2023-10-08T07:07:05.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161371 2023-10-08T07:07:05.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:05.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034032+0000", 2023-10-08T07:07:05.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1714e-05 2023-10-08T07:07:05.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:05.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034040+0000", 2023-10-08T07:07:05.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9650000000000008e-06 2023-10-08T07:07:05.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:05.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034717+0000", 2023-10-08T07:07:05.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000677346 2023-10-08T07:07:05.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:05.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034768+0000", 2023-10-08T07:07:05.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0949000000000003e-05 2023-10-08T07:07:05.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:05.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034866+0000", 2023-10-08T07:07:05.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8061999999999997e-05 2023-10-08T07:07:05.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:05.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.038162+0000", 2023-10-08T07:07:05.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032959999999999999 2023-10-08T07:07:05.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.078 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:05.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.078 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:52387 4.28 4:16edf4d3:::10000000004.00000027:head [write 2248704~4096 in=4096b,write 2408448~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:05.079 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:05.034117+0000", 2023-10-08T07:07:05.079 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0037572069999999998, 2023-10-08T07:07:05.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042857889999999999, 2023-10-08T07:07:05.079 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:05.079 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:05.079 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:05.079 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:05.079 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:05.079 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 52387 2023-10-08T07:07:05.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.080 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:05.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:05.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034117+0000", 2023-10-08T07:07:05.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:05.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034117+0000", 2023-10-08T07:07:05.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:05.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:05.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034118+0000", 2023-10-08T07:07:05.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3200000000000005e-07 2023-10-08T07:07:05.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:05.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034130+0000", 2023-10-08T07:07:05.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1939e-05 2023-10-08T07:07:05.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:05.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034136+0000", 2023-10-08T07:07:05.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4099999999999996e-06 2023-10-08T07:07:05.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:05.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034144+0000", 2023-10-08T07:07:05.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3889999999999999e-06 2023-10-08T07:07:05.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:05.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034243+0000", 2023-10-08T07:07:05.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600999999999997e-05 2023-10-08T07:07:05.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:05.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:05.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:05.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:05.034352+0000", 2023-10-08T07:07:05.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108688 2023-10-08T07:07:05.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.083 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:05.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:05.084 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:05.084 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 8 2023-10-08T07:07:05.084 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:05.085 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:05.086 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:05.084+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:05.185 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:05.184+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:05.221 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:05.256 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T07:07:05.286 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:05.285+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:05.311 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:05.311 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:05.311 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:05.311 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:05.311 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:05.326 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:05.388 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:05.387+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:05.415 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:05.443 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:05.446 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:05.447 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:05.489 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:05.488+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:05.505 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:05.505 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:05.520 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:05.590 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:05.589+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:05.691 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:05.690+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:05.705 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:05.705 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:05.719 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:05.803 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:05.802+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:05.893 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:05.891+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:05.951 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:05.951 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:05.968 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:05.994 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:05.993+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:06.095 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:06.094+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:06.195 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:06.194+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:06.199 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:06.199 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:06.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:06.243 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2023-10-08T07:07:06.297 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:06.296+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:06.398 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:06.396+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:06.414 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:06.415 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:06.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:06.498 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:06.498+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:06.599 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:06.598+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:06.659 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:06.660 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:06.676 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:06.720 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:06.719+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:06.801 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:06.800+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:06.869 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:06.869 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:06.882 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:06.924 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:06.923+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:06.936 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2023-10-08T07:07:06.937 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2023-10-08T07:07:06.937 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi086.front.sepia.ceph.com 2023-10-08T07:07:06.937 INFO:teuthology.orchestra.console.smithi086:Power on 2023-10-08T07:07:06.937 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-08T07:07:06.961 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2023-10-08T07:07:06.961 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:07:06.985 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-10-08T07:07:07.003 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:07.002+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:07.078 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:07.078 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:07.093 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:07.104 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:07.103+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:07.205 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:07.204+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:07.278 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:07.278 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:07.292 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:07.336 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:07.335+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:07.407 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:07.406+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:07.449 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:07:07.468 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:07.468 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:07.482 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:07.526 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:07.525+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:07.610 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:07.609+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:07.628 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:07.657 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:07:07.658 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:07.658 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:07:07.660 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:07.660 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:07.669 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:59436 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 421888~4096 in=4096b,write 458752~4096 in=4096b,write 503808~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:07.664595+0000", 2023-10-08T07:07:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003703685, 2023-10-08T07:07:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037340450000000001, 2023-10-08T07:07:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59436 2023-10-08T07:07:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664595+0000", 2023-10-08T07:07:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664595+0000", 2023-10-08T07:07:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664595+0000", 2023-10-08T07:07:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.54e-07 2023-10-08T07:07:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664605+0000", 2023-10-08T07:07:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0009e-05 2023-10-08T07:07:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664619+0000", 2023-10-08T07:07:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.34e-05 2023-10-08T07:07:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664625+0000", 2023-10-08T07:07:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0569999999999998e-06 2023-10-08T07:07:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664683+0000", 2023-10-08T07:07:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8020999999999999e-05 2023-10-08T07:07:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664775+0000", 2023-10-08T07:07:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2236000000000003e-05 2023-10-08T07:07:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:59437 4.7 4:e2479c46:::10000000004.00000024:head [write 2273280~4096 in=4096b,write 2293760~4096 in=4096b,write 2334720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:07.664852+0000", 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003446326, 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035537139999999999, 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59437 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664852+0000", 2023-10-08T07:07:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664852+0000", 2023-10-08T07:07:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664853+0000", 2023-10-08T07:07:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1800000000000005e-07 2023-10-08T07:07:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664887+0000", 2023-10-08T07:07:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4168000000000002e-05 2023-10-08T07:07:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664896+0000", 2023-10-08T07:07:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8109999999999992e-06 2023-10-08T07:07:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664903+0000", 2023-10-08T07:07:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1250000000000004e-06 2023-10-08T07:07:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.664958+0000", 2023-10-08T07:07:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5615000000000002e-05 2023-10-08T07:07:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665046+0000", 2023-10-08T07:07:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7711000000000001e-05 2023-10-08T07:07:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:59439 4.2b e51/17 4:d776c1c9:::10000000004.0000003d:head v 51'1901, mlcod=51'1897)", 2023-10-08T07:07:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:07.665732+0000", 2023-10-08T07:07:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025659670000000002, 2023-10-08T07:07:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002738702, 2023-10-08T07:07:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665732+0000", 2023-10-08T07:07:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665732+0000", 2023-10-08T07:07:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665733+0000", 2023-10-08T07:07:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6499999999999999e-07 2023-10-08T07:07:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665746+0000", 2023-10-08T07:07:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3478999999999999e-05 2023-10-08T07:07:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665755+0000", 2023-10-08T07:07:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2649999999999996e-06 2023-10-08T07:07:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665761+0000", 2023-10-08T07:07:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5060000000000001e-06 2023-10-08T07:07:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665809+0000", 2023-10-08T07:07:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7521999999999997e-05 2023-10-08T07:07:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665829+0000", 2023-10-08T07:07:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0186999999999998e-05 2023-10-08T07:07:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:59440 4.19 4:9a1dab10:::10000000004.0000001d:head [write 1003520~4096 in=4096b,write 1024000~4096 in=4096b,write 1032192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:07.665796+0000", 2023-10-08T07:07:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025022389999999999, 2023-10-08T07:07:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002737274, 2023-10-08T07:07:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59440 2023-10-08T07:07:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665796+0000", 2023-10-08T07:07:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665796+0000", 2023-10-08T07:07:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665797+0000", 2023-10-08T07:07:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3600000000000002e-07 2023-10-08T07:07:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665807+0000", 2023-10-08T07:07:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0593e-05 2023-10-08T07:07:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665815+0000", 2023-10-08T07:07:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1659999999999997e-06 2023-10-08T07:07:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665821+0000", 2023-10-08T07:07:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.071e-06 2023-10-08T07:07:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665899+0000", 2023-10-08T07:07:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8059000000000006e-05 2023-10-08T07:07:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665999+0000", 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9858000000000005e-05 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:59441 4.7 4:e2479c46:::10000000004.00000024:head [write 241664~4096 in=4096b,write 589824~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:07.665950+0000", 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0023485799999999999, 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00265263, 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59441 2023-10-08T07:07:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665950+0000", 2023-10-08T07:07:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665950+0000", 2023-10-08T07:07:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665950+0000", 2023-10-08T07:07:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6899999999999996e-07 2023-10-08T07:07:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665960+0000", 2023-10-08T07:07:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0990000000000005e-06 2023-10-08T07:07:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665969+0000", 2023-10-08T07:07:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1549999999999996e-06 2023-10-08T07:07:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.665976+0000", 2023-10-08T07:07:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9809999999999997e-06 2023-10-08T07:07:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667387+0000", 2023-10-08T07:07:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014117019999999999 2023-10-08T07:07:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667478+0000", 2023-10-08T07:07:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0274999999999999e-05 2023-10-08T07:07:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:59442 4.28 4:15b6682b:::10000000004.0000000b:head [write 1294336~4096 in=4096b,write 1400832~4096 in=4096b,write 1695744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:07.666171+0000", 2023-10-08T07:07:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0021276889999999999, 2023-10-08T07:07:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002500866, 2023-10-08T07:07:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59442 2023-10-08T07:07:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.666171+0000", 2023-10-08T07:07:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.666171+0000", 2023-10-08T07:07:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.666171+0000", 2023-10-08T07:07:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5499999999999997e-07 2023-10-08T07:07:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.666184+0000", 2023-10-08T07:07:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2717e-05 2023-10-08T07:07:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.666194+0000", 2023-10-08T07:07:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0113e-05 2023-10-08T07:07:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.666202+0000", 2023-10-08T07:07:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3969999999999997e-06 2023-10-08T07:07:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.666261+0000", 2023-10-08T07:07:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9867000000000001e-05 2023-10-08T07:07:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.666331+0000", 2023-10-08T07:07:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9623999999999996e-05 2023-10-08T07:07:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:59443 4.15 4:a88808fa:::10000000004.0000001f:head [write 1024000~4096 in=4096b,write 1171456~4096 in=4096b,write 1474560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:07.667216+0000", 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0010826049999999999, 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001525212, 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59443 2023-10-08T07:07:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667216+0000", 2023-10-08T07:07:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667216+0000", 2023-10-08T07:07:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667217+0000", 2023-10-08T07:07:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0400000000000005e-07 2023-10-08T07:07:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667229+0000", 2023-10-08T07:07:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-05 2023-10-08T07:07:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667240+0000", 2023-10-08T07:07:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0896999999999999e-05 2023-10-08T07:07:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667248+0000", 2023-10-08T07:07:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7209999999999994e-06 2023-10-08T07:07:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667369+0000", 2023-10-08T07:07:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012069 2023-10-08T07:07:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667449+0000", 2023-10-08T07:07:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0090000000000001e-05 2023-10-08T07:07:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:59444 4.29 4:94216392:::10000000004.0000002b:head [write 864256~4096 in=4096b,write 905216~4096 in=4096b,write 946176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:07.667266+0000", 2023-10-08T07:07:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001031962, 2023-10-08T07:07:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015476719999999999, 2023-10-08T07:07:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59444 2023-10-08T07:07:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667266+0000", 2023-10-08T07:07:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667266+0000", 2023-10-08T07:07:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667267+0000", 2023-10-08T07:07:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0200000000000002e-07 2023-10-08T07:07:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667278+0000", 2023-10-08T07:07:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0728e-05 2023-10-08T07:07:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667287+0000", 2023-10-08T07:07:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4150000000000005e-06 2023-10-08T07:07:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667297+0000", 2023-10-08T07:07:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0117e-05 2023-10-08T07:07:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667907+0000", 2023-10-08T07:07:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060937800000000005 2023-10-08T07:07:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667991+0000", 2023-10-08T07:07:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4647000000000005e-05 2023-10-08T07:07:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.668112+0000", 2023-10-08T07:07:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120921 2023-10-08T07:07:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:59446 4.1b e51/17 4:d97fb168:::10000000004.00000008:head v 51'1839, mlcod=51'1834)", 2023-10-08T07:07:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:07.667654+0000", 2023-10-08T07:07:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00064396199999999998, 2023-10-08T07:07:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001239396, 2023-10-08T07:07:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667654+0000", 2023-10-08T07:07:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667654+0000", 2023-10-08T07:07:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667655+0000", 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6100000000000001e-07 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667687+0000", 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1680999999999997e-05 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667696+0000", 2023-10-08T07:07:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5480000000000007e-06 2023-10-08T07:07:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667703+0000", 2023-10-08T07:07:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1250000000000004e-06 2023-10-08T07:07:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667763+0000", 2023-10-08T07:07:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9945999999999998e-05 2023-10-08T07:07:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.667783+0000", 2023-10-08T07:07:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0060000000000001e-05 2023-10-08T07:07:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:59424 4.7 4:e13e8cdb:::10000000004.00000028:head [write 1900544~4096 in=4096b,write 1921024~4096 in=4096b,write 1929216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:07.660602+0000", 2023-10-08T07:07:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0076961750000000004, 2023-10-08T07:07:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008365117, 2023-10-08T07:07:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59424 2023-10-08T07:07:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.660602+0000", 2023-10-08T07:07:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.660602+0000", 2023-10-08T07:07:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.660603+0000", 2023-10-08T07:07:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0699999999999997e-07 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.660612+0000", 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6180000000000001e-06 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.660621+0000", 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9369999999999993e-06 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.660626+0000", 2023-10-08T07:07:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2023-10-08T07:07:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.660668+0000", 2023-10-08T07:07:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2169000000000002e-05 2023-10-08T07:07:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.660727+0000", 2023-10-08T07:07:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.838e-05 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:59429 4.37 4:efdd41ff:::10000000004.0000001c:head [write 2981888~4096 in=4096b,write 3108864~4096 in=4096b,write 3309568~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:07.662370+0000", 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0059281120000000001, 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006679183, 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59429 2023-10-08T07:07:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.662370+0000", 2023-10-08T07:07:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.662370+0000", 2023-10-08T07:07:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.662371+0000", 2023-10-08T07:07:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.85e-07 2023-10-08T07:07:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.662383+0000", 2023-10-08T07:07:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1829e-05 2023-10-08T07:07:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.662395+0000", 2023-10-08T07:07:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1708999999999999e-05 2023-10-08T07:07:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.662402+0000", 2023-10-08T07:07:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2710000000000003e-06 2023-10-08T07:07:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.662455+0000", 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3452000000000003e-05 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:07.662547+0000", 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1658999999999998e-05 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 11 2023-10-08T07:07:07.732 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:07.733 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:07.734 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:07.732+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:07.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2023-10-08T07:07:07.834 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:07.833+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:07.934 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:07.933+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:07.966 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:07.966 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:07.982 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:08.035 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:08.034+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:08.136 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:08.135+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:08.219 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:08.219 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36811 4.31 4:8ec1b377:::10000000004.00000019:head [write 3362816~4096,write 3395584~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.939967201, 2023-10-08T07:07:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96838670299999996, 2023-10-08T07:07:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36811 2023-10-08T07:07:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:08.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:07:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275541+0000", 2023-10-08T07:07:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3360000000000001e-06 2023-10-08T07:07:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275551+0000", 2023-10-08T07:07:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.825e-06 2023-10-08T07:07:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275556+0000", 2023-10-08T07:07:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2023-10-08T07:07:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275592+0000", 2023-10-08T07:07:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6554000000000003e-05 2023-10-08T07:07:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275599+0000", 2023-10-08T07:07:08.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4640000000000003e-06 2023-10-08T07:07:08.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.238899+0000", 2023-10-08T07:07:08.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96330046999999996 2023-10-08T07:07:08.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239016+0000", 2023-10-08T07:07:08.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116919 2023-10-08T07:07:08.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239123+0000", 2023-10-08T07:07:08.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010675000000000001 2023-10-08T07:07:08.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243715+0000", 2023-10-08T07:07:08.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045922469999999998 2023-10-08T07:07:08.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243760+0000", 2023-10-08T07:07:08.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4666000000000002e-05 2023-10-08T07:07:08.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243820+0000", 2023-10-08T07:07:08.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9760999999999999e-05 2023-10-08T07:07:08.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243917+0000", 2023-10-08T07:07:08.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7822e-05 2023-10-08T07:07:08.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.230 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.230 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36831 4.31 4:8de29a03:::10000000004.00000001:head [write 806912~8192,write 847872~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.230 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:08.230 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.9329472830000007, 2023-10-08T07:07:08.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96330879000000003, 2023-10-08T07:07:08.231 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.232 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.232 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.232 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.232 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.232 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36831 2023-10-08T07:07:08.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.233 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:08.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:08.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:08.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:08.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282564+0000", 2023-10-08T07:07:08.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2303999999999999e-05 2023-10-08T07:07:08.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282572+0000", 2023-10-08T07:07:08.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7849999999999992e-06 2023-10-08T07:07:08.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282579+0000", 2023-10-08T07:07:08.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4610000000000002e-06 2023-10-08T07:07:08.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282631+0000", 2023-10-08T07:07:08.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2404999999999997e-05 2023-10-08T07:07:08.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282640+0000", 2023-10-08T07:07:08.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2640000000000008e-06 2023-10-08T07:07:08.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239925+0000", 2023-10-08T07:07:08.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95728506499999999 2023-10-08T07:07:08.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240097+0000", 2023-10-08T07:07:08.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172497 2023-10-08T07:07:08.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240235+0000", 2023-10-08T07:07:08.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000137861 2023-10-08T07:07:08.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243935+0000", 2023-10-08T07:07:08.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037000819999999999 2023-10-08T07:07:08.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245706+0000", 2023-10-08T07:07:08.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001770972 2023-10-08T07:07:08.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245773+0000", 2023-10-08T07:07:08.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6840000000000004e-05 2023-10-08T07:07:08.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245859+0000", 2023-10-08T07:07:08.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6442999999999999e-05 2023-10-08T07:07:08.242 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.242 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.242 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.243 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36859 4.31 4:8de29a03:::10000000004.00000001:head [write 3850240~4096,write 3891200~4096,write 3919872~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.243 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:08.243 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.9222037410000006, 2023-10-08T07:07:08.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95269757099999997, 2023-10-08T07:07:08.243 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.243 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.243 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.243 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.243 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.243 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36859 2023-10-08T07:07:08.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.244 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:08.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:08.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293295+0000", 2023-10-08T07:07:08.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9500000000000001e-07 2023-10-08T07:07:08.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293335+0000", 2023-10-08T07:07:08.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9867999999999998e-05 2023-10-08T07:07:08.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293346+0000", 2023-10-08T07:07:08.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1070000000000001e-05 2023-10-08T07:07:08.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293353+0000", 2023-10-08T07:07:08.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2640000000000002e-06 2023-10-08T07:07:08.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293409+0000", 2023-10-08T07:07:08.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5926e-05 2023-10-08T07:07:08.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293418+0000", 2023-10-08T07:07:08.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9940000000000006e-06 2023-10-08T07:07:08.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240889+0000", 2023-10-08T07:07:08.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94747106400000003 2023-10-08T07:07:08.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240963+0000", 2023-10-08T07:07:08.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3431999999999998e-05 2023-10-08T07:07:08.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241104+0000", 2023-10-08T07:07:08.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014119800000000001 2023-10-08T07:07:08.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243944+0000", 2023-10-08T07:07:08.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028404200000000002 2023-10-08T07:07:08.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245909+0000", 2023-10-08T07:07:08.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001964351 2023-10-08T07:07:08.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245942+0000", 2023-10-08T07:07:08.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3526999999999999e-05 2023-10-08T07:07:08.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245992+0000", 2023-10-08T07:07:08.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9561999999999997e-05 2023-10-08T07:07:08.251 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.251 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.251 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.251 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36861 4.31 4:8ec1b377:::10000000004.00000019:head [write 385024~4096,write 434176~4096,write 540672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.252 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:08.252 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.9212949449999996, 2023-10-08T07:07:08.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.955921154, 2023-10-08T07:07:08.252 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.252 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.252 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.252 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.252 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.253 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36861 2023-10-08T07:07:08.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.253 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:08.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:08.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294204+0000", 2023-10-08T07:07:08.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:08.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294216+0000", 2023-10-08T07:07:08.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2323999999999999e-05 2023-10-08T07:07:08.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294226+0000", 2023-10-08T07:07:08.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0217000000000001e-05 2023-10-08T07:07:08.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294234+0000", 2023-10-08T07:07:08.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6020000000000002e-06 2023-10-08T07:07:08.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294300+0000", 2023-10-08T07:07:08.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6515999999999998e-05 2023-10-08T07:07:08.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294312+0000", 2023-10-08T07:07:08.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1379000000000001e-05 2023-10-08T07:07:08.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241814+0000", 2023-10-08T07:07:08.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.947501751 2023-10-08T07:07:08.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241863+0000", 2023-10-08T07:07:08.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9135999999999998e-05 2023-10-08T07:07:08.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241953+0000", 2023-10-08T07:07:08.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0124000000000007e-05 2023-10-08T07:07:08.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243952+0000", 2023-10-08T07:07:08.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019988749999999998 2023-10-08T07:07:08.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250028+0000", 2023-10-08T07:07:08.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060766350000000004 2023-10-08T07:07:08.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250069+0000", 2023-10-08T07:07:08.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0794000000000003e-05 2023-10-08T07:07:08.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250124+0000", 2023-10-08T07:07:08.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991000000000003e-05 2023-10-08T07:07:08.265 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.265 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.265 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.266 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36869 4.31 4:8ec1b377:::10000000004.00000019:head [write 917504~4096,write 983040~4096,write 1171456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.266 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:08.266 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.9179786809999992, 2023-10-08T07:07:08.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95596831699999996, 2023-10-08T07:07:08.266 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.266 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.266 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.267 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36869 2023-10-08T07:07:08.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.267 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:08.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:08.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297520+0000", 2023-10-08T07:07:08.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.23e-07 2023-10-08T07:07:08.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297532+0000", 2023-10-08T07:07:08.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1420000000000001e-05 2023-10-08T07:07:08.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297548+0000", 2023-10-08T07:07:08.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6711e-05 2023-10-08T07:07:08.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297557+0000", 2023-10-08T07:07:08.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3250000000000008e-06 2023-10-08T07:07:08.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297606+0000", 2023-10-08T07:07:08.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9724e-05 2023-10-08T07:07:08.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297614+0000", 2023-10-08T07:07:08.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2023-10-08T07:07:08.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.242809+0000", 2023-10-08T07:07:08.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94519444900000005 2023-10-08T07:07:08.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.242885+0000", 2023-10-08T07:07:08.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6784000000000002e-05 2023-10-08T07:07:08.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243025+0000", 2023-10-08T07:07:08.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013984300000000001 2023-10-08T07:07:08.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246003+0000", 2023-10-08T07:07:08.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002978072 2023-10-08T07:07:08.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253322+0000", 2023-10-08T07:07:08.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073190779999999997 2023-10-08T07:07:08.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253391+0000", 2023-10-08T07:07:08.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8285000000000001e-05 2023-10-08T07:07:08.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253488+0000", 2023-10-08T07:07:08.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7014000000000003e-05 2023-10-08T07:07:08.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.282 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.283 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36881 4.31 4:8ec1b377:::10000000004.00000019:head [write 888832~4096,write 1191936~4096,write 1327104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.283 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:08.283 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.9139111369999995, 2023-10-08T07:07:08.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95214402799999998, 2023-10-08T07:07:08.283 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.284 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.284 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36881 2023-10-08T07:07:08.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.284 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:08.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:08.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301588+0000", 2023-10-08T07:07:08.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.02e-06 2023-10-08T07:07:08.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301600+0000", 2023-10-08T07:07:08.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2377e-05 2023-10-08T07:07:08.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301611+0000", 2023-10-08T07:07:08.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0446e-05 2023-10-08T07:07:08.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301621+0000", 2023-10-08T07:07:08.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0338e-05 2023-10-08T07:07:08.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301668+0000", 2023-10-08T07:07:08.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7459000000000001e-05 2023-10-08T07:07:08.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301674+0000", 2023-10-08T07:07:08.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7910000000000001e-06 2023-10-08T07:07:08.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244001+0000", 2023-10-08T07:07:08.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94232701200000002 2023-10-08T07:07:08.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244082+0000", 2023-10-08T07:07:08.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0615e-05 2023-10-08T07:07:08.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244202+0000", 2023-10-08T07:07:08.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120427 2023-10-08T07:07:08.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246009+0000", 2023-10-08T07:07:08.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018070899999999999 2023-10-08T07:07:08.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253544+0000", 2023-10-08T07:07:08.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075350729999999998 2023-10-08T07:07:08.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253607+0000", 2023-10-08T07:07:08.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2810000000000003e-05 2023-10-08T07:07:08.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253731+0000", 2023-10-08T07:07:08.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012357000000000001 2023-10-08T07:07:08.296 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36900 4.31 4:8de29a03:::10000000004.00000001:head [write 3239936~4096,write 3371008~4096,write 3878912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.9075878310000007, 2023-10-08T07:07:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94607822699999999, 2023-10-08T07:07:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.299 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.299 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.299 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36900 2023-10-08T07:07:08.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.299 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:08.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:08.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307911+0000", 2023-10-08T07:07:08.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0210000000000001e-06 2023-10-08T07:07:08.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307926+0000", 2023-10-08T07:07:08.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4375e-05 2023-10-08T07:07:08.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307936+0000", 2023-10-08T07:07:08.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0124e-05 2023-10-08T07:07:08.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307950+0000", 2023-10-08T07:07:08.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4659e-05 2023-10-08T07:07:08.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307998+0000", 2023-10-08T07:07:08.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8170000000000001e-05 2023-10-08T07:07:08.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.308005+0000", 2023-10-08T07:07:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3339999999999998e-06 2023-10-08T07:07:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244911+0000", 2023-10-08T07:07:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93690596699999995 2023-10-08T07:07:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244972+0000", 2023-10-08T07:07:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0854999999999999e-05 2023-10-08T07:07:08.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245073+0000", 2023-10-08T07:07:08.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101406 2023-10-08T07:07:08.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250135+0000", 2023-10-08T07:07:08.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050614620000000001 2023-10-08T07:07:08.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253786+0000", 2023-10-08T07:07:08.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003651615 2023-10-08T07:07:08.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253860+0000", 2023-10-08T07:07:08.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3631e-05 2023-10-08T07:07:08.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253988+0000", 2023-10-08T07:07:08.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000128608 2023-10-08T07:07:08.308 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.308 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.308 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.308 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36907 4.31 4:8de29a03:::10000000004.00000001:head [write 53248~4096,write 192512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.308 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:08.308 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.9043467249999999, 2023-10-08T07:07:08.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94298633799999998, 2023-10-08T07:07:08.308 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.308 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.309 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.309 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.309 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36907 2023-10-08T07:07:08.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.309 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:08.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:08.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311152+0000", 2023-10-08T07:07:08.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3200000000000005e-07 2023-10-08T07:07:08.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311158+0000", 2023-10-08T07:07:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2219999999999999e-06 2023-10-08T07:07:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311166+0000", 2023-10-08T07:07:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5209999999999997e-06 2023-10-08T07:07:08.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311169+0000", 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.568e-06 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311202+0000", 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3346000000000002e-05 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311208+0000", 2023-10-08T07:07:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.259e-06 2023-10-08T07:07:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246041+0000", 2023-10-08T07:07:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93483340400000003 2023-10-08T07:07:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246088+0000", 2023-10-08T07:07:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6653999999999998e-05 2023-10-08T07:07:08.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246173+0000", 2023-10-08T07:07:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5327999999999993e-05 2023-10-08T07:07:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253252+0000", 2023-10-08T07:07:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070788170000000003 2023-10-08T07:07:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254057+0000", 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00080496300000000001 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254090+0000", 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3325999999999999e-05 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254138+0000", 2023-10-08T07:07:08.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7398000000000003e-05 2023-10-08T07:07:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36955 4.31 4:8ec1b377:::10000000004.00000019:head [write 3538944~8192,write 3620864~4096,write 3641344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.887303781, 2023-10-08T07:07:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92903069999999999, 2023-10-08T07:07:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.316 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36955 2023-10-08T07:07:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328195+0000", 2023-10-08T07:07:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1600000000000001e-07 2023-10-08T07:07:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328208+0000", 2023-10-08T07:07:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3592e-05 2023-10-08T07:07:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328218+0000", 2023-10-08T07:07:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7270000000000002e-06 2023-10-08T07:07:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328226+0000", 2023-10-08T07:07:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.328e-06 2023-10-08T07:07:08.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328282+0000", 2023-10-08T07:07:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6156000000000002e-05 2023-10-08T07:07:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328300+0000", 2023-10-08T07:07:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7805e-05 2023-10-08T07:07:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246679+0000", 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91837927200000002 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246743+0000", 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4599999999999998e-05 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246838+0000", 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5063999999999996e-05 2023-10-08T07:07:08.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253747+0000", 2023-10-08T07:07:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069086210000000002 2023-10-08T07:07:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257129+0000", 2023-10-08T07:07:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033818210000000001 2023-10-08T07:07:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257167+0000", 2023-10-08T07:07:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8318999999999997e-05 2023-10-08T07:07:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257225+0000", 2023-10-08T07:07:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7679000000000001e-05 2023-10-08T07:07:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36966 4.31 4:8de29a03:::10000000004.00000001:head [write 2809856~4096,write 3076096~4096,write 3096576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8833990570000001, 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92525588800000003, 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36966 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.324 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332100+0000", 2023-10-08T07:07:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332121+0000", 2023-10-08T07:07:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0914999999999999e-05 2023-10-08T07:07:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332128+0000", 2023-10-08T07:07:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8709999999999997e-06 2023-10-08T07:07:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332134+0000", 2023-10-08T07:07:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0839999999999999e-06 2023-10-08T07:07:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332182+0000", 2023-10-08T07:07:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8310000000000003e-05 2023-10-08T07:07:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332187+0000", 2023-10-08T07:07:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.242e-06 2023-10-08T07:07:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248280+0000", 2023-10-08T07:07:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91609321899999996 2023-10-08T07:07:08.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248369+0000", 2023-10-08T07:07:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8895999999999997e-05 2023-10-08T07:07:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248536+0000", 2023-10-08T07:07:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016709099999999999 2023-10-08T07:07:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257075+0000", 2023-10-08T07:07:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085385300000000008 2023-10-08T07:07:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257266+0000", 2023-10-08T07:07:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019079399999999999 2023-10-08T07:07:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257305+0000", 2023-10-08T07:07:08.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8996999999999999e-05 2023-10-08T07:07:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257355+0000", 2023-10-08T07:07:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0129000000000001e-05 2023-10-08T07:07:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36968 4.31 4:8ec1b377:::10000000004.00000019:head [write 835584~4096,write 1372160~4096,write 1646592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.331 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8816789870000008, 2023-10-08T07:07:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92599244700000005, 2023-10-08T07:07:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36968 2023-10-08T07:07:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333820+0000", 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1999999999999998e-07 2023-10-08T07:07:08.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333833+0000", 2023-10-08T07:07:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3574000000000001e-05 2023-10-08T07:07:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333848+0000", 2023-10-08T07:07:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4912999999999999e-05 2023-10-08T07:07:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333857+0000", 2023-10-08T07:07:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1270000000000003e-06 2023-10-08T07:07:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333903+0000", 2023-10-08T07:07:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6782e-05 2023-10-08T07:07:08.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333911+0000", 2023-10-08T07:07:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5020000000000003e-06 2023-10-08T07:07:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250170+0000", 2023-10-08T07:07:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91625966299999995 2023-10-08T07:07:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250263+0000", 2023-10-08T07:07:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2252999999999999e-05 2023-10-08T07:07:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250454+0000", 2023-10-08T07:07:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019164400000000001 2023-10-08T07:07:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258723+0000", 2023-10-08T07:07:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082687699999999999 2023-10-08T07:07:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259685+0000", 2023-10-08T07:07:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00096196599999999997 2023-10-08T07:07:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259739+0000", 2023-10-08T07:07:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4147999999999997e-05 2023-10-08T07:07:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259811+0000", 2023-10-08T07:07:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2185000000000001e-05 2023-10-08T07:07:08.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37036 4.31 4:8ec1b377:::10000000004.00000019:head [write 3309568~4096,write 3510272~4096,write 3620864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8562621359999998, 2023-10-08T07:07:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.90288029999999997, 2023-10-08T07:07:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37036 2023-10-08T07:07:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6899999999999997e-07 2023-10-08T07:07:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359246+0000", 2023-10-08T07:07:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2369999999999998e-06 2023-10-08T07:07:08.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359254+0000", 2023-10-08T07:07:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4989999999999994e-06 2023-10-08T07:07:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359260+0000", 2023-10-08T07:07:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0209999999999996e-06 2023-10-08T07:07:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359319+0000", 2023-10-08T07:07:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9042999999999997e-05 2023-10-08T07:07:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359330+0000", 2023-10-08T07:07:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0633e-05 2023-10-08T07:07:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.251788+0000", 2023-10-08T07:07:08.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89245758100000006 2023-10-08T07:07:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.251887+0000", 2023-10-08T07:07:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9223999999999997e-05 2023-10-08T07:07:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.252083+0000", 2023-10-08T07:07:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019611800000000001 2023-10-08T07:07:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258731+0000", 2023-10-08T07:07:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006648307 2023-10-08T07:07:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262036+0000", 2023-10-08T07:07:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033046550000000001 2023-10-08T07:07:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262069+0000", 2023-10-08T07:07:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2753000000000003e-05 2023-10-08T07:07:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262116+0000", 2023-10-08T07:07:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7559999999999999e-05 2023-10-08T07:07:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.347 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37068 4.31 4:8de29a03:::10000000004.00000001:head [write 987136~4096,write 1011712~4096,write 1044480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8445831649999995, 2023-10-08T07:07:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89311213899999997, 2023-10-08T07:07:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37068 2023-10-08T07:07:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370916+0000", 2023-10-08T07:07:08.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5000000000000002e-07 2023-10-08T07:07:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370956+0000", 2023-10-08T07:07:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0898e-05 2023-10-08T07:07:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370966+0000", 2023-10-08T07:07:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6209999999999999e-06 2023-10-08T07:07:08.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370973+0000", 2023-10-08T07:07:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.601e-06 2023-10-08T07:07:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.371022+0000", 2023-10-08T07:07:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9811999999999997e-05 2023-10-08T07:07:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.371032+0000", 2023-10-08T07:07:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8120000000000002e-06 2023-10-08T07:07:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254175+0000", 2023-10-08T07:07:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88314265599999997 2023-10-08T07:07:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254256+0000", 2023-10-08T07:07:08.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0820000000000002e-05 2023-10-08T07:07:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254436+0000", 2023-10-08T07:07:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000180044 2023-10-08T07:07:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261274+0000", 2023-10-08T07:07:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006838434 2023-10-08T07:07:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.263950+0000", 2023-10-08T07:07:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026753829999999999 2023-10-08T07:07:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.263981+0000", 2023-10-08T07:07:08.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1568e-05 2023-10-08T07:07:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.264027+0000", 2023-10-08T07:07:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5739999999999999e-05 2023-10-08T07:07:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37088 4.31 4:8de29a03:::10000000004.00000001:head [write 1466368~8192,write 1515520~4096,write 1523712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.356 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8366742879999993, 2023-10-08T07:07:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88701907199999996, 2023-10-08T07:07:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37088 2023-10-08T07:07:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378825+0000", 2023-10-08T07:07:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7199999999999997e-07 2023-10-08T07:07:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378841+0000", 2023-10-08T07:07:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5999e-05 2023-10-08T07:07:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378851+0000", 2023-10-08T07:07:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0474e-05 2023-10-08T07:07:08.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378858+0000", 2023-10-08T07:07:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9840000000000004e-06 2023-10-08T07:07:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378904+0000", 2023-10-08T07:07:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5704999999999997e-05 2023-10-08T07:07:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378910+0000", 2023-10-08T07:07:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5039999999999999e-06 2023-10-08T07:07:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255278+0000", 2023-10-08T07:07:08.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.87636765000000005 2023-10-08T07:07:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255385+0000", 2023-10-08T07:07:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000106667 2023-10-08T07:07:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255557+0000", 2023-10-08T07:07:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172957 2023-10-08T07:07:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261279+0000", 2023-10-08T07:07:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00572195 2023-10-08T07:07:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265761+0000", 2023-10-08T07:07:08.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004481423 2023-10-08T07:07:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265796+0000", 2023-10-08T07:07:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4727000000000001e-05 2023-10-08T07:07:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265843+0000", 2023-10-08T07:07:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7160000000000002e-05 2023-10-08T07:07:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.364 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37130 4.31 4:8ec1b377:::10000000004.00000019:head [write 1658880~4096,write 1736704~4096,write 1794048~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8195044039999999, 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86998378399999998, 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.365 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37130 2023-10-08T07:07:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395995+0000", 2023-10-08T07:07:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600000000000008e-07 2023-10-08T07:07:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396008+0000", 2023-10-08T07:07:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3067999999999999e-05 2023-10-08T07:07:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396019+0000", 2023-10-08T07:07:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1561e-05 2023-10-08T07:07:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396027+0000", 2023-10-08T07:07:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9039999999999992e-06 2023-10-08T07:07:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396075+0000", 2023-10-08T07:07:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8165999999999999e-05 2023-10-08T07:07:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396081+0000", 2023-10-08T07:07:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8279999999999999e-06 2023-10-08T07:07:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256171+0000", 2023-10-08T07:07:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86008956199999997 2023-10-08T07:07:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256218+0000", 2023-10-08T07:07:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7018000000000003e-05 2023-10-08T07:07:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256315+0000", 2023-10-08T07:07:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7285000000000001e-05 2023-10-08T07:07:08.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262125+0000", 2023-10-08T07:07:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058099110000000001 2023-10-08T07:07:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265890+0000", 2023-10-08T07:07:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037655829999999999 2023-10-08T07:07:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265929+0000", 2023-10-08T07:07:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8068999999999998e-05 2023-10-08T07:07:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265977+0000", 2023-10-08T07:07:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8832999999999998e-05 2023-10-08T07:07:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37183 4.31 4:8ec1b377:::10000000004.00000019:head [write 16384~4096,write 364544~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.8003233469999991, 2023-10-08T07:07:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.85095945399999995, 2023-10-08T07:07:08.373 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37183 2023-10-08T07:07:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6499999999999998e-07 2023-10-08T07:07:08.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415186+0000", 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0404999999999999e-05 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415198+0000", 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.187e-05 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415204+0000", 2023-10-08T07:07:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5119999999999997e-06 2023-10-08T07:07:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415259+0000", 2023-10-08T07:07:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5269999999999998e-05 2023-10-08T07:07:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415270+0000", 2023-10-08T07:07:08.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0716e-05 2023-10-08T07:07:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257384+0000", 2023-10-08T07:07:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84211341500000003 2023-10-08T07:07:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257442+0000", 2023-10-08T07:07:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8780999999999998e-05 2023-10-08T07:07:08.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257538+0000", 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5956000000000001e-05 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265987+0000", 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008449069 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266053+0000", 2023-10-08T07:07:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5813000000000002e-05 2023-10-08T07:07:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266089+0000", 2023-10-08T07:07:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5827000000000001e-05 2023-10-08T07:07:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266134+0000", 2023-10-08T07:07:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5055000000000001e-05 2023-10-08T07:07:08.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37188 4.31 4:8de29a03:::10000000004.00000001:head [write 2031616~4096,write 2191360~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.7981960259999994, 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.850341613, 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37188 2023-10-08T07:07:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417303+0000", 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0599999999999999e-07 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417315+0000", 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2325e-05 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417324+0000", 2023-10-08T07:07:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8489999999999995e-06 2023-10-08T07:07:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417331+0000", 2023-10-08T07:07:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4599999999999997e-06 2023-10-08T07:07:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417437+0000", 2023-10-08T07:07:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105305 2023-10-08T07:07:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417445+0000", 2023-10-08T07:07:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3040000000000005e-06 2023-10-08T07:07:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258113+0000", 2023-10-08T07:07:08.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84066830699999995 2023-10-08T07:07:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258168+0000", 2023-10-08T07:07:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4258999999999997e-05 2023-10-08T07:07:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258255+0000", 2023-10-08T07:07:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7235000000000001e-05 2023-10-08T07:07:08.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265993+0000", 2023-10-08T07:07:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077377599999999998 2023-10-08T07:07:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267565+0000", 2023-10-08T07:07:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001572314 2023-10-08T07:07:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267597+0000", 2023-10-08T07:07:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2361999999999999e-05 2023-10-08T07:07:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267644+0000", 2023-10-08T07:07:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6326999999999999e-05 2023-10-08T07:07:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.388 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37197 4.31 4:8de29a03:::10000000004.00000001:head [write 1859584~4096,write 2220032~4096,write 2322432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.7945420460000001, 2023-10-08T07:07:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84767678599999996, 2023-10-08T07:07:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37197 2023-10-08T07:07:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420957+0000", 2023-10-08T07:07:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9199999999999999e-07 2023-10-08T07:07:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420969+0000", 2023-10-08T07:07:08.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1753000000000001e-05 2023-10-08T07:07:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420981+0000", 2023-10-08T07:07:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2479e-05 2023-10-08T07:07:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420989+0000", 2023-10-08T07:07:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0949999999999996e-06 2023-10-08T07:07:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.421053+0000", 2023-10-08T07:07:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4134999999999995e-05 2023-10-08T07:07:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.421062+0000", 2023-10-08T07:07:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8440000000000004e-06 2023-10-08T07:07:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258760+0000", 2023-10-08T07:07:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83769823499999996 2023-10-08T07:07:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258814+0000", 2023-10-08T07:07:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3876999999999999e-05 2023-10-08T07:07:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258913+0000", 2023-10-08T07:07:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8323e-05 2023-10-08T07:07:08.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265997+0000", 2023-10-08T07:07:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070839830000000003 2023-10-08T07:07:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268535+0000", 2023-10-08T07:07:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002538836 2023-10-08T07:07:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268574+0000", 2023-10-08T07:07:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8606000000000003e-05 2023-10-08T07:07:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268633+0000", 2023-10-08T07:07:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8727999999999997e-05 2023-10-08T07:07:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37227 4.31 4:8ec1b377:::10000000004.00000019:head [write 2760704~4096,write 2781184~4096,write 2850816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.7840180750000005, 2023-10-08T07:07:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83736361400000003, 2023-10-08T07:07:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37227 2023-10-08T07:07:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.397 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431481+0000", 2023-10-08T07:07:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8400000000000003e-07 2023-10-08T07:07:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431512+0000", 2023-10-08T07:07:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0803999999999998e-05 2023-10-08T07:07:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431525+0000", 2023-10-08T07:07:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3704e-05 2023-10-08T07:07:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431535+0000", 2023-10-08T07:07:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2350000000000005e-06 2023-10-08T07:07:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431585+0000", 2023-10-08T07:07:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0531000000000001e-05 2023-10-08T07:07:08.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431594+0000", 2023-10-08T07:07:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7499999999999992e-06 2023-10-08T07:07:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259851+0000", 2023-10-08T07:07:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82825699399999997 2023-10-08T07:07:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259914+0000", 2023-10-08T07:07:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2928999999999993e-05 2023-10-08T07:07:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.260024+0000", 2023-10-08T07:07:08.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000110556 2023-10-08T07:07:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266001+0000", 2023-10-08T07:07:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059769910000000001 2023-10-08T07:07:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268694+0000", 2023-10-08T07:07:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026924119999999999 2023-10-08T07:07:08.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268754+0000", 2023-10-08T07:07:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0562000000000001e-05 2023-10-08T07:07:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268843+0000", 2023-10-08T07:07:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9262e-05 2023-10-08T07:07:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37233 4.31 4:8de29a03:::10000000004.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.7818111160000001, 2023-10-08T07:07:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83766958000000002, 2023-10-08T07:07:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.405 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37233 2023-10-08T07:07:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:08.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433688+0000", 2023-10-08T07:07:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2023-10-08T07:07:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433701+0000", 2023-10-08T07:07:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3869000000000001e-05 2023-10-08T07:07:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433714+0000", 2023-10-08T07:07:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2173e-05 2023-10-08T07:07:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433720+0000", 2023-10-08T07:07:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7449999999999998e-06 2023-10-08T07:07:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433772+0000", 2023-10-08T07:07:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1242999999999997e-05 2023-10-08T07:07:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433781+0000", 2023-10-08T07:07:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1360000000000003e-06 2023-10-08T07:07:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:08.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261313+0000", 2023-10-08T07:07:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82753250300000003 2023-10-08T07:07:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261367+0000", 2023-10-08T07:07:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3664e-05 2023-10-08T07:07:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:08.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261467+0000", 2023-10-08T07:07:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9668999999999997e-05 2023-10-08T07:07:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266010+0000", 2023-10-08T07:07:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045437189999999999 2023-10-08T07:07:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271269+0000", 2023-10-08T07:07:08.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052584900000000002 2023-10-08T07:07:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271310+0000", 2023-10-08T07:07:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1057999999999999e-05 2023-10-08T07:07:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271356+0000", 2023-10-08T07:07:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6582999999999998e-05 2023-10-08T07:07:08.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:08.413 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:08.413 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:08.413 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T07:07:08.415 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:08.416 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:08.415+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:08.515 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:08.514+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:08.594 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:08.594 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:08.594 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.595 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:61969 4.1b 4:d97fb168:::10000000004.00000008:head [write 32768~4096 in=4096b,write 73728~4096 in=4096b,write 196608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:08.595 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:08.591990+0000", 2023-10-08T07:07:08.595 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.002009088, 2023-10-08T07:07:08.596 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020415289999999998, 2023-10-08T07:07:08.596 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:08.596 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:08.596 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:08.596 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:08.597 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:08.597 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 61969 2023-10-08T07:07:08.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.598 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:08.598 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.598 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:08.598 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.591990+0000", 2023-10-08T07:07:08.598 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:08.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.598 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.598 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:08.598 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.591990+0000", 2023-10-08T07:07:08.599 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:08.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.599 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.599 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:08.599 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.591991+0000", 2023-10-08T07:07:08.599 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5099999999999999e-07 2023-10-08T07:07:08.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.599 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.599 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:08.599 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.592003+0000", 2023-10-08T07:07:08.599 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1821000000000001e-05 2023-10-08T07:07:08.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.600 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.600 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:08.600 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.592013+0000", 2023-10-08T07:07:08.600 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.062e-05 2023-10-08T07:07:08.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.600 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.600 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.600 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.592020+0000", 2023-10-08T07:07:08.600 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1180000000000003e-06 2023-10-08T07:07:08.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.600 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.600 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:08.601 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.592070+0000", 2023-10-08T07:07:08.601 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9638000000000001e-05 2023-10-08T07:07:08.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.601 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:08.601 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.592142+0000", 2023-10-08T07:07:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1982000000000003e-05 2023-10-08T07:07:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.592309+0000", 2023-10-08T07:07:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016667299999999999 2023-10-08T07:07:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:08.602 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.594004+0000", 2023-10-08T07:07:08.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016951080000000001 2023-10-08T07:07:08.603 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:08.603 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:08.603 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:08.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.603 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.603 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:61971 4.31 e51/48 4:8de29a03:::10000000004.00000001:head v 51'1905, mlcod=51'1903)", 2023-10-08T07:07:08.603 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:08.593235+0000", 2023-10-08T07:07:08.603 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00076393499999999998, 2023-10-08T07:07:08.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00088477800000000002, 2023-10-08T07:07:08.603 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:08.603 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:08.604 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:08.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.604 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:08.604 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.593235+0000", 2023-10-08T07:07:08.604 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:08.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.604 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:08.604 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.593235+0000", 2023-10-08T07:07:08.604 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:08.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.605 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.605 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:08.605 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.593236+0000", 2023-10-08T07:07:08.605 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0100000000000005e-07 2023-10-08T07:07:08.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.605 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.605 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:08.605 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.593250+0000", 2023-10-08T07:07:08.605 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4405e-05 2023-10-08T07:07:08.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.606 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.606 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:08.606 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.593257+0000", 2023-10-08T07:07:08.606 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2529999999999998e-06 2023-10-08T07:07:08.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.606 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.606 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:08.606 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.593263+0000", 2023-10-08T07:07:08.606 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2780000000000001e-06 2023-10-08T07:07:08.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.607 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:08.607 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.593309+0000", 2023-10-08T07:07:08.607 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5827e-05 2023-10-08T07:07:08.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:08.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:08.607 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:08.607 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.593326+0000", 2023-10-08T07:07:08.608 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7425e-05 2023-10-08T07:07:08.608 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:08.608 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:08.608 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:08.608 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:08.608 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:07:08.608 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 2 2023-10-08T07:07:08.608 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:08.609 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:08.650 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:08.649+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:08.718 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:08.716+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:08.818 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:08.817+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:08.839 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:08.839 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:08.840 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:08.854 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:08.938 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:08.937+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:09.021 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:09.020+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:09.091 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:09.091 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:09.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:09.091 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:09.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.092 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36591 4.38 4:1e0977c7:::10000000004.00000022:head [write 954368~4096,write 1089536~4096,write 1118208~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:09.092 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.167358+0000", 2023-10-08T07:07:09.092 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.9201262880000005, 2023-10-08T07:07:09.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.02065931, 2023-10-08T07:07:09.092 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.092 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.092 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.092 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.092 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.092 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36591 2023-10-08T07:07:09.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167358+0000", 2023-10-08T07:07:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167358+0000", 2023-10-08T07:07:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167358+0000", 2023-10-08T07:07:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6899999999999997e-07 2023-10-08T07:07:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167369+0000", 2023-10-08T07:07:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1042e-05 2023-10-08T07:07:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167377+0000", 2023-10-08T07:07:09.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7649999999999993e-06 2023-10-08T07:07:09.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167382+0000", 2023-10-08T07:07:09.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7539999999999997e-06 2023-10-08T07:07:09.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167425+0000", 2023-10-08T07:07:09.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.269e-05 2023-10-08T07:07:09.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167474+0000", 2023-10-08T07:07:09.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9515999999999998e-05 2023-10-08T07:07:09.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.167566+0000", 2023-10-08T07:07:09.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1402000000000003e-05 2023-10-08T07:07:09.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.173487+0000", 2023-10-08T07:07:09.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0059214910000000001 2023-10-08T07:07:09.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.187922+0000", 2023-10-08T07:07:09.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014435353999999999 2023-10-08T07:07:09.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.098 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.187965+0000", 2023-10-08T07:07:09.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2061999999999998e-05 2023-10-08T07:07:09.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.188017+0000", 2023-10-08T07:07:09.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2565000000000002e-05 2023-10-08T07:07:09.099 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.099 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.099 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.099 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36603 4.38 4:1e0977c7:::10000000004.00000022:head [write 2863104~4096,write 2949120~12288] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-10-08T07:07:09.099 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.171717+0000", 2023-10-08T07:07:09.100 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.9157669110000004, 2023-10-08T07:07:09.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020705431, 2023-10-08T07:07:09.100 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.100 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.100 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.100 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.100 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.100 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36603 2023-10-08T07:07:09.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.101 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171717+0000", 2023-10-08T07:07:09.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171717+0000", 2023-10-08T07:07:09.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171718+0000", 2023-10-08T07:07:09.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:07:09.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171730+0000", 2023-10-08T07:07:09.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1647999999999999e-05 2023-10-08T07:07:09.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171741+0000", 2023-10-08T07:07:09.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1482e-05 2023-10-08T07:07:09.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171747+0000", 2023-10-08T07:07:09.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8529999999999997e-06 2023-10-08T07:07:09.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171799+0000", 2023-10-08T07:07:09.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2018000000000002e-05 2023-10-08T07:07:09.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171857+0000", 2023-10-08T07:07:09.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7908999999999997e-05 2023-10-08T07:07:09.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.171950+0000", 2023-10-08T07:07:09.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2813999999999996e-05 2023-10-08T07:07:09.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.176466+0000", 2023-10-08T07:07:09.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045161109999999997 2023-10-08T07:07:09.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.192318+0000", 2023-10-08T07:07:09.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015852445 2023-10-08T07:07:09.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.107 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.107 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.192357+0000", 2023-10-08T07:07:09.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8512e-05 2023-10-08T07:07:09.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.107 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.107 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.192423+0000", 2023-10-08T07:07:09.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5931000000000003e-05 2023-10-08T07:07:09.108 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.108 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.108 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.108 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.108 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:36755 4.3a 4:5f183e4b:::10000000004.00000023:head [write 372736~4096,write 409600~4096,write 638976~4096,write 704512~4096,write 1011712~4096,write 1019904~4096,write 1081344~4096,write 1306624~4096,write 1335296~4096,write 1363968~4096,write 1441792~4096,write 1581056~4096,write 1597440~4096,write 1691648~4096,write 1843200~4096,write 1884160~8192,write 2260992~4096,write 2326528~4096,write 2383872~4096,write 2535424~4096,write 2760704~4096,write 3256320~4096,write 3264512~4096,write 3297280~4096,write 3403776~4096,write 3502080~4096,write 3653632~4096,write 3751936~4096,write 4034560~4096,write 4075520~4096,write 4100096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:09.108 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:06:59.226377+0000", 2023-10-08T07:07:09.108 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.8611071379999995, 2023-10-08T07:07:09.108 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020698510999999999, 2023-10-08T07:07:09.108 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.109 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.109 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.109 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.109 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.109 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 36755 2023-10-08T07:07:09.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.109 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226377+0000", 2023-10-08T07:07:09.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226377+0000", 2023-10-08T07:07:09.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.111 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.111 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226378+0000", 2023-10-08T07:07:09.111 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4199999999999995e-07 2023-10-08T07:07:09.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.111 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.111 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.111 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226439+0000", 2023-10-08T07:07:09.111 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1398999999999999e-05 2023-10-08T07:07:09.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226450+0000", 2023-10-08T07:07:09.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0627e-05 2023-10-08T07:07:09.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226458+0000", 2023-10-08T07:07:09.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5229999999999995e-06 2023-10-08T07:07:09.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.113 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.113 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226504+0000", 2023-10-08T07:07:09.113 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5847999999999999e-05 2023-10-08T07:07:09.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.113 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.113 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.226609+0000", 2023-10-08T07:07:09.113 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000104924 2023-10-08T07:07:09.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.114 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.114 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.114 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.227180+0000", 2023-10-08T07:07:09.114 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00057061700000000004 2023-10-08T07:07:09.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.114 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.114 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.114 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.235535+0000", 2023-10-08T07:07:09.114 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083550780000000002 2023-10-08T07:07:09.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.115 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.115 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.115 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.246850+0000", 2023-10-08T07:07:09.115 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01131573 2023-10-08T07:07:09.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.115 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.115 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.115 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.247000+0000", 2023-10-08T07:07:09.115 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014989100000000001 2023-10-08T07:07:09.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:06:59.247075+0000", 2023-10-08T07:07:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5232000000000001e-05 2023-10-08T07:07:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:48491 4.2b 4:d776c1c9:::10000000004.0000003d:head [write 3043328~4096,write 3133440~4096,write 3563520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:09.116 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:03.611672+0000", 2023-10-08T07:07:09.117 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.4758116079999999, 2023-10-08T07:07:09.117 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021034442, 2023-10-08T07:07:09.117 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.117 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.117 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.117 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.117 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.117 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 48491 2023-10-08T07:07:09.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.117 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.117 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.118 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.118 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611672+0000", 2023-10-08T07:07:09.118 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.118 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.118 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.118 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611672+0000", 2023-10-08T07:07:09.118 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.118 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.119 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.119 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611673+0000", 2023-10-08T07:07:09.119 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1099999999999995e-07 2023-10-08T07:07:09.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.119 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.119 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.119 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611683+0000", 2023-10-08T07:07:09.119 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0073e-05 2023-10-08T07:07:09.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.119 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611692+0000", 2023-10-08T07:07:09.120 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2059999999999996e-06 2023-10-08T07:07:09.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.120 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611698+0000", 2023-10-08T07:07:09.120 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4929999999999998e-06 2023-10-08T07:07:09.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.120 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611747+0000", 2023-10-08T07:07:09.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9190999999999997e-05 2023-10-08T07:07:09.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.121 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.121 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.121 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611803+0000", 2023-10-08T07:07:09.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6273999999999997e-05 2023-10-08T07:07:09.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.121 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.121 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.121 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611914+0000", 2023-10-08T07:07:09.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011047100000000001 2023-10-08T07:07:09.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.122 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.122 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.122 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.614504+0000", 2023-10-08T07:07:09.122 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0025900490000000001 2023-10-08T07:07:09.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.122 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.122 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.122 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.632638+0000", 2023-10-08T07:07:09.122 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018133719 2023-10-08T07:07:09.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.123 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.123 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.123 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.632673+0000", 2023-10-08T07:07:09.123 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5649999999999999e-05 2023-10-08T07:07:09.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.123 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.123 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.123 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.632707+0000", 2023-10-08T07:07:09.123 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3605000000000001e-05 2023-10-08T07:07:09.123 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.123 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.124 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.124 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.124 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:48492 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 2052096~4096,write 2113536~4096,write 2158592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:09.124 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:03.611986+0000", 2023-10-08T07:07:09.124 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.4754976510000004, 2023-10-08T07:07:09.124 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024276833000000001, 2023-10-08T07:07:09.124 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.124 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.124 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.124 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.125 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.125 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 48492 2023-10-08T07:07:09.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.125 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.125 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.125 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611986+0000", 2023-10-08T07:07:09.125 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.125 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.126 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611986+0000", 2023-10-08T07:07:09.126 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.126 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611987+0000", 2023-10-08T07:07:09.126 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7000000000000004e-07 2023-10-08T07:07:09.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.126 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611995+0000", 2023-10-08T07:07:09.127 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2719999999999997e-06 2023-10-08T07:07:09.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.127 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.127 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612003+0000", 2023-10-08T07:07:09.127 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2710000000000003e-06 2023-10-08T07:07:09.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.127 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.127 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612009+0000", 2023-10-08T07:07:09.128 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1689999999999997e-06 2023-10-08T07:07:09.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.128 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.128 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.128 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612063+0000", 2023-10-08T07:07:09.128 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4608999999999998e-05 2023-10-08T07:07:09.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.128 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.128 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.128 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612153+0000", 2023-10-08T07:07:09.129 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9269000000000002e-05 2023-10-08T07:07:09.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.129 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.129 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612333+0000", 2023-10-08T07:07:09.129 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000179944 2023-10-08T07:07:09.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.129 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.129 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.616694+0000", 2023-10-08T07:07:09.129 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004361658 2023-10-08T07:07:09.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636189+0000", 2023-10-08T07:07:09.130 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019494880999999999 2023-10-08T07:07:09.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636232+0000", 2023-10-08T07:07:09.130 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2500000000000003e-05 2023-10-08T07:07:09.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.131 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.131 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636263+0000", 2023-10-08T07:07:09.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1590000000000001e-05 2023-10-08T07:07:09.131 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.131 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.131 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.131 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:48494 4.2b 4:d7a77d67:::10000000004.00000029:head [write 3076096~4096,write 3215360~4096,write 3485696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:09.132 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:03.612886+0000", 2023-10-08T07:07:09.132 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.4745985409999998, 2023-10-08T07:07:09.132 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023426592999999999, 2023-10-08T07:07:09.132 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.132 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.132 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.132 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.132 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.132 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 48494 2023-10-08T07:07:09.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.133 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.133 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.133 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612886+0000", 2023-10-08T07:07:09.133 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.133 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.133 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612886+0000", 2023-10-08T07:07:09.133 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.134 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.134 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612886+0000", 2023-10-08T07:07:09.134 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4499999999999997e-07 2023-10-08T07:07:09.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.134 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.134 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612896+0000", 2023-10-08T07:07:09.134 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.329e-06 2023-10-08T07:07:09.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.135 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.135 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612906+0000", 2023-10-08T07:07:09.135 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0631e-05 2023-10-08T07:07:09.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.135 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.135 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612912+0000", 2023-10-08T07:07:09.135 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4840000000000003e-06 2023-10-08T07:07:09.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.136 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.136 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.613623+0000", 2023-10-08T07:07:09.136 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00071140600000000004 2023-10-08T07:07:09.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.136 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.136 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.136 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.613673+0000", 2023-10-08T07:07:09.136 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0259000000000001e-05 2023-10-08T07:07:09.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.136 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.136 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.136 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.613770+0000", 2023-10-08T07:07:09.137 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6984999999999994e-05 2023-10-08T07:07:09.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.137 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.137 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.617057+0000", 2023-10-08T07:07:09.137 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003287192 2023-10-08T07:07:09.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.137 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.137 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636213+0000", 2023-10-08T07:07:09.137 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019155798000000002 2023-10-08T07:07:09.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636274+0000", 2023-10-08T07:07:09.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0639e-05 2023-10-08T07:07:09.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636312+0000", 2023-10-08T07:07:09.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8225000000000001e-05 2023-10-08T07:07:09.138 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.139 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.139 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.139 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:50123 4.5 4:a367a3e8:::10000000004.00000000:head [write 1253376~4096,write 1302528~4096,write 1376256~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:09.139 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:04.195055+0000", 2023-10-08T07:07:09.139 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.8924287849999999, 2023-10-08T07:07:09.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020785788999999999, 2023-10-08T07:07:09.139 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.139 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.139 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 50123 2023-10-08T07:07:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195055+0000", 2023-10-08T07:07:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.140 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195055+0000", 2023-10-08T07:07:09.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.141 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195056+0000", 2023-10-08T07:07:09.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8599999999999998e-07 2023-10-08T07:07:09.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.141 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195071+0000", 2023-10-08T07:07:09.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4749000000000001e-05 2023-10-08T07:07:09.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195083+0000", 2023-10-08T07:07:09.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2024999999999999e-05 2023-10-08T07:07:09.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195102+0000", 2023-10-08T07:07:09.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8970999999999998e-05 2023-10-08T07:07:09.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.143 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.143 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195153+0000", 2023-10-08T07:07:09.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1078999999999997e-05 2023-10-08T07:07:09.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.143 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.143 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.195214+0000", 2023-10-08T07:07:09.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1118000000000007e-05 2023-10-08T07:07:09.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.144 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.144 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.144 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.215698+0000", 2023-10-08T07:07:09.144 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020484316999999998 2023-10-08T07:07:09.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.144 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.144 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.144 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.215758+0000", 2023-10-08T07:07:09.144 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9576e-05 2023-10-08T07:07:09.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.145 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.145 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.215841+0000", 2023-10-08T07:07:09.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3368000000000005e-05 2023-10-08T07:07:09.145 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.145 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.145 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.145 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:51988 4.c 4:31e28161:::10000000004.00000011:head [write 2572288~4096,write 2744320~4096,write 2760704~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:09.146 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:04.887895+0000", 2023-10-08T07:07:09.146 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1995889010000003, 2023-10-08T07:07:09.146 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021392278000000001, 2023-10-08T07:07:09.146 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.146 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.146 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.146 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.146 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.146 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 51988 2023-10-08T07:07:09.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.147 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.887895+0000", 2023-10-08T07:07:09.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.887895+0000", 2023-10-08T07:07:09.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.887896+0000", 2023-10-08T07:07:09.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3e-07 2023-10-08T07:07:09.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.887908+0000", 2023-10-08T07:07:09.149 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2490000000000001e-05 2023-10-08T07:07:09.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.149 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.149 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.887918+0000", 2023-10-08T07:07:09.149 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5689999999999994e-06 2023-10-08T07:07:09.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.149 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.150 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.887924+0000", 2023-10-08T07:07:09.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5709999999999997e-06 2023-10-08T07:07:09.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.150 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.150 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.150 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.887976+0000", 2023-10-08T07:07:09.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2327999999999998e-05 2023-10-08T07:07:09.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.150 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.150 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.151 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.888023+0000", 2023-10-08T07:07:09.151 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6977000000000001e-05 2023-10-08T07:07:09.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.151 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.151 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.888150+0000", 2023-10-08T07:07:09.151 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000127389 2023-10-08T07:07:09.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.889887+0000", 2023-10-08T07:07:09.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001736694 2023-10-08T07:07:09.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.909232+0000", 2023-10-08T07:07:09.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019345187 2023-10-08T07:07:09.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.909266+0000", 2023-10-08T07:07:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3797999999999997e-05 2023-10-08T07:07:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:04.909287+0000", 2023-10-08T07:07:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1545000000000001e-05 2023-10-08T07:07:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.154 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.154 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:52657 4.3a 4:5f183e4b:::10000000004.00000023:head [write 3547136~4096,write 3555328~4096,write 3567616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:09.154 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:05.130922+0000", 2023-10-08T07:07:09.154 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.9565621589999997, 2023-10-08T07:07:09.154 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.02085507, 2023-10-08T07:07:09.154 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.154 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.154 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.155 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.155 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.155 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 52657 2023-10-08T07:07:09.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.155 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.130922+0000", 2023-10-08T07:07:09.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.156 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.156 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.130922+0000", 2023-10-08T07:07:09.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.156 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.156 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.130923+0000", 2023-10-08T07:07:09.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3799999999999996e-07 2023-10-08T07:07:09.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.157 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.157 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.130933+0000", 2023-10-08T07:07:09.157 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0730000000000001e-05 2023-10-08T07:07:09.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.157 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.157 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.130944+0000", 2023-10-08T07:07:09.157 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0845999999999999e-05 2023-10-08T07:07:09.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.158 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.158 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.130952+0000", 2023-10-08T07:07:09.158 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9039999999999992e-06 2023-10-08T07:07:09.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.158 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.158 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.132383+0000", 2023-10-08T07:07:09.158 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001430771 2023-10-08T07:07:09.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.132462+0000", 2023-10-08T07:07:09.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8898000000000003e-05 2023-10-08T07:07:09.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.132604+0000", 2023-10-08T07:07:09.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000142168 2023-10-08T07:07:09.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.137088+0000", 2023-10-08T07:07:09.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0044842199999999997 2023-10-08T07:07:09.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.151671+0000", 2023-10-08T07:07:09.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014582975 2023-10-08T07:07:09.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.161 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.161 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.151734+0000", 2023-10-08T07:07:09.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3128999999999998e-05 2023-10-08T07:07:09.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.161 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.161 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.151777+0000", 2023-10-08T07:07:09.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2590999999999999e-05 2023-10-08T07:07:09.161 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.161 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.162 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.162 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:52678 4.20 4:04004f2c:::10000000004.0000000d:head [write 3887104~4096,write 4038656~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:09.162 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:05.137785+0000", 2023-10-08T07:07:09.162 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.9496988559999999, 2023-10-08T07:07:09.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021343342000000001, 2023-10-08T07:07:09.162 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.163 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.163 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.163 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.163 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 52678 2023-10-08T07:07:09.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.163 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.163 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.163 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.163 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.137785+0000", 2023-10-08T07:07:09.163 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.164 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.137785+0000", 2023-10-08T07:07:09.164 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.164 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.137786+0000", 2023-10-08T07:07:09.164 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9100000000000004e-07 2023-10-08T07:07:09.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.137794+0000", 2023-10-08T07:07:09.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4290000000000001e-06 2023-10-08T07:07:09.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.137808+0000", 2023-10-08T07:07:09.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3292000000000001e-05 2023-10-08T07:07:09.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.166 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.166 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.166 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.137813+0000", 2023-10-08T07:07:09.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9050000000000002e-06 2023-10-08T07:07:09.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.166 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.166 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.166 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.137853+0000", 2023-10-08T07:07:09.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9668e-05 2023-10-08T07:07:09.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.167 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.137903+0000", 2023-10-08T07:07:09.167 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0084999999999999e-05 2023-10-08T07:07:09.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.167 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.137994+0000", 2023-10-08T07:07:09.167 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0685000000000003e-05 2023-10-08T07:07:09.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.144219+0000", 2023-10-08T07:07:09.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0062246300000000001 2023-10-08T07:07:09.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.159063+0000", 2023-10-08T07:07:09.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014844731999999999 2023-10-08T07:07:09.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.159105+0000", 2023-10-08T07:07:09.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1863999999999998e-05 2023-10-08T07:07:09.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.159129+0000", 2023-10-08T07:07:09.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3461000000000001e-05 2023-10-08T07:07:09.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.169 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.170 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.170 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.170 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:52690 4.20 4:05b3915c:::10000000004.00000016:head [write 1794048~4096,write 1814528~4096,write 1822720~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:09.170 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:05.141518+0000", 2023-10-08T07:07:09.170 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 3.9459658389999999, 2023-10-08T07:07:09.170 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021914303999999999, 2023-10-08T07:07:09.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.170 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.170 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.170 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.171 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.171 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 52690 2023-10-08T07:07:09.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.171 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.171 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.171 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.141518+0000", 2023-10-08T07:07:09.171 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.172 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.172 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.141518+0000", 2023-10-08T07:07:09.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.172 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.172 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.141519+0000", 2023-10-08T07:07:09.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7899999999999997e-07 2023-10-08T07:07:09.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.172 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.141535+0000", 2023-10-08T07:07:09.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5512e-05 2023-10-08T07:07:09.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.141552+0000", 2023-10-08T07:07:09.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7506000000000001e-05 2023-10-08T07:07:09.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.141559+0000", 2023-10-08T07:07:09.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7209999999999997e-06 2023-10-08T07:07:09.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.142432+0000", 2023-10-08T07:07:09.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00087327499999999996 2023-10-08T07:07:09.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.142496+0000", 2023-10-08T07:07:09.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4321999999999998e-05 2023-10-08T07:07:09.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.142651+0000", 2023-10-08T07:07:09.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000154838 2023-10-08T07:07:09.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.146095+0000", 2023-10-08T07:07:09.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0034441530000000001 2023-10-08T07:07:09.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.163322+0000", 2023-10-08T07:07:09.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017227047999999998 2023-10-08T07:07:09.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.163384+0000", 2023-10-08T07:07:09.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1539999999999997e-05 2023-10-08T07:07:09.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.177 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.177 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:05.163433+0000", 2023-10-08T07:07:09.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8609999999999997e-05 2023-10-08T07:07:09.177 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.177 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.177 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.177 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:59756 4.20 4:05b3915c:::10000000004.00000016:head [write 2002944~4096,write 2453504~4096,write 2490368~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:09.177 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:07.776189+0000", 2023-10-08T07:07:09.177 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.3112954290000001, 2023-10-08T07:07:09.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.031212054999999999, 2023-10-08T07:07:09.178 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.178 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.178 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.178 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.178 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.178 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 59756 2023-10-08T07:07:09.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.178 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.776189+0000", 2023-10-08T07:07:09.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.776189+0000", 2023-10-08T07:07:09.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.776189+0000", 2023-10-08T07:07:09.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3099999999999997e-07 2023-10-08T07:07:09.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.776202+0000", 2023-10-08T07:07:09.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2768999999999999e-05 2023-10-08T07:07:09.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.776216+0000", 2023-10-08T07:07:09.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4132e-05 2023-10-08T07:07:09.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.776224+0000", 2023-10-08T07:07:09.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2810000000000003e-06 2023-10-08T07:07:09.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.777666+0000", 2023-10-08T07:07:09.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0014421900000000001 2023-10-08T07:07:09.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.777757+0000", 2023-10-08T07:07:09.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0841000000000007e-05 2023-10-08T07:07:09.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.777915+0000", 2023-10-08T07:07:09.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000157954 2023-10-08T07:07:09.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.780221+0000", 2023-10-08T07:07:09.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0023064050000000001 2023-10-08T07:07:09.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807270+0000", 2023-10-08T07:07:09.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027049281000000001 2023-10-08T07:07:09.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.184 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.184 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807359+0000", 2023-10-08T07:07:09.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9104000000000006e-05 2023-10-08T07:07:09.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.184 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.184 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807401+0000", 2023-10-08T07:07:09.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1366999999999999e-05 2023-10-08T07:07:09.185 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.185 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.185 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.185 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:59774 4.20 4:04004f2c:::10000000004.0000000d:head [write 3502080~4096,write 3510272~4096,write 3727360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:09.185 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:07.782396+0000", 2023-10-08T07:07:09.185 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.3050882449999999, 2023-10-08T07:07:09.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.025220902999999999, 2023-10-08T07:07:09.186 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.186 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.186 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.186 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.186 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.186 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 59774 2023-10-08T07:07:09.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.186 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782396+0000", 2023-10-08T07:07:09.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782396+0000", 2023-10-08T07:07:09.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782397+0000", 2023-10-08T07:07:09.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.71e-07 2023-10-08T07:07:09.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782408+0000", 2023-10-08T07:07:09.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1208e-05 2023-10-08T07:07:09.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782420+0000", 2023-10-08T07:07:09.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2449000000000001e-05 2023-10-08T07:07:09.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782431+0000", 2023-10-08T07:07:09.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0798999999999999e-05 2023-10-08T07:07:09.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782481+0000", 2023-10-08T07:07:09.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9601000000000002e-05 2023-10-08T07:07:09.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782537+0000", 2023-10-08T07:07:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6678999999999997e-05 2023-10-08T07:07:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782648+0000", 2023-10-08T07:07:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000110467 2023-10-08T07:07:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785684+0000", 2023-10-08T07:07:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0030359670000000001 2023-10-08T07:07:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807502+0000", 2023-10-08T07:07:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021818626000000001 2023-10-08T07:07:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807573+0000", 2023-10-08T07:07:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0927999999999996e-05 2023-10-08T07:07:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807617+0000", 2023-10-08T07:07:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3307999999999999e-05 2023-10-08T07:07:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:59776 4.20 4:07572838:::10000000004.00000010:head [write 1818624~4096,write 1900544~4096,write 1978368~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:07.783175+0000", 2023-10-08T07:07:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.304309156, 2023-10-08T07:07:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024626939, 2023-10-08T07:07:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.194 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 59776 2023-10-08T07:07:09.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.194 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783175+0000", 2023-10-08T07:07:09.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783175+0000", 2023-10-08T07:07:09.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783176+0000", 2023-10-08T07:07:09.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7100000000000001e-07 2023-10-08T07:07:09.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783192+0000", 2023-10-08T07:07:09.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6707000000000001e-05 2023-10-08T07:07:09.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783203+0000", 2023-10-08T07:07:09.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0995000000000001e-05 2023-10-08T07:07:09.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.197 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.197 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783212+0000", 2023-10-08T07:07:09.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9150000000000002e-06 2023-10-08T07:07:09.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.197 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.197 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783841+0000", 2023-10-08T07:07:09.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00062854000000000002 2023-10-08T07:07:09.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783920+0000", 2023-10-08T07:07:09.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8887000000000006e-05 2023-10-08T07:07:09.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.784096+0000", 2023-10-08T07:07:09.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000175885 2023-10-08T07:07:09.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.787210+0000", 2023-10-08T07:07:09.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031141630000000001 2023-10-08T07:07:09.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807671+0000", 2023-10-08T07:07:09.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020461081999999998 2023-10-08T07:07:09.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807759+0000", 2023-10-08T07:07:09.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8012999999999999e-05 2023-10-08T07:07:09.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807802+0000", 2023-10-08T07:07:09.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3081000000000003e-05 2023-10-08T07:07:09.200 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.201 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.201 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.201 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:59784 4.20 4:07572838:::10000000004.00000010:head [write 3723264~4096,write 3764224~4096,write 3825664~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:09.201 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:07.785654+0000", 2023-10-08T07:07:09.201 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.3018303, 2023-10-08T07:07:09.201 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022246847, 2023-10-08T07:07:09.201 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.201 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.201 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.201 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.202 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.202 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 59784 2023-10-08T07:07:09.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.202 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.202 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.202 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785654+0000", 2023-10-08T07:07:09.202 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.202 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785654+0000", 2023-10-08T07:07:09.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785654+0000", 2023-10-08T07:07:09.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9699999999999995e-07 2023-10-08T07:07:09.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785669+0000", 2023-10-08T07:07:09.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4403000000000001e-05 2023-10-08T07:07:09.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785685+0000", 2023-10-08T07:07:09.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5977e-05 2023-10-08T07:07:09.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785692+0000", 2023-10-08T07:07:09.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5490000000000001e-06 2023-10-08T07:07:09.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.205 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.205 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785740+0000", 2023-10-08T07:07:09.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7799000000000001e-05 2023-10-08T07:07:09.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.205 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785806+0000", 2023-10-08T07:07:09.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5518999999999994e-05 2023-10-08T07:07:09.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785934+0000", 2023-10-08T07:07:09.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000128477 2023-10-08T07:07:09.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.207 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.792748+0000", 2023-10-08T07:07:09.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0068142130000000004 2023-10-08T07:07:09.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.207 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807844+0000", 2023-10-08T07:07:09.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015095188000000001 2023-10-08T07:07:09.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807879+0000", 2023-10-08T07:07:09.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5200000000000002e-05 2023-10-08T07:07:09.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807901+0000", 2023-10-08T07:07:09.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1824999999999999e-05 2023-10-08T07:07:09.208 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.208 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.208 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.209 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:59791 4.20 4:05b3915c:::10000000004.00000016:head [write 20480~4096,write 53248~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:09.209 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:07.788014+0000", 2023-10-08T07:07:09.209 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.299469623, 2023-10-08T07:07:09.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021240363000000002, 2023-10-08T07:07:09.209 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.209 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.209 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.209 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.210 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.210 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 59791 2023-10-08T07:07:09.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.210 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.788014+0000", 2023-10-08T07:07:09.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.788014+0000", 2023-10-08T07:07:09.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.788015+0000", 2023-10-08T07:07:09.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1399999999999996e-07 2023-10-08T07:07:09.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.788045+0000", 2023-10-08T07:07:09.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.0000000000000001e-05 2023-10-08T07:07:09.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.788056+0000", 2023-10-08T07:07:09.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0913999999999999e-05 2023-10-08T07:07:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.788063+0000", 2023-10-08T07:07:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2609999999999996e-06 2023-10-08T07:07:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.789391+0000", 2023-10-08T07:07:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001327981 2023-10-08T07:07:09.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.214 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.789480+0000", 2023-10-08T07:07:09.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8436000000000005e-05 2023-10-08T07:07:09.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.214 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.789635+0000", 2023-10-08T07:07:09.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015553999999999999 2023-10-08T07:07:09.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.215 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.795605+0000", 2023-10-08T07:07:09.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0059700129999999997 2023-10-08T07:07:09.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.215 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.809160+0000", 2023-10-08T07:07:09.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013554212 2023-10-08T07:07:09.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.216 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.809214+0000", 2023-10-08T07:07:09.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4122000000000001e-05 2023-10-08T07:07:09.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.216 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.216 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.809255+0000", 2023-10-08T07:07:09.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1069999999999998e-05 2023-10-08T07:07:09.216 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.216 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.216 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.217 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:60827 4.30 4:0f322a22:::10000000004.00000014:head [write 507904~4096,write 786432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:09.217 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:08.150981+0000", 2023-10-08T07:07:09.217 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.93650261400000001, 2023-10-08T07:07:09.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024981400000000001, 2023-10-08T07:07:09.217 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.217 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.217 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.217 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.217 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.218 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 60827 2023-10-08T07:07:09.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.218 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.150981+0000", 2023-10-08T07:07:09.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.150981+0000", 2023-10-08T07:07:09.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.150982+0000", 2023-10-08T07:07:09.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9500000000000002e-07 2023-10-08T07:07:09.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.150990+0000", 2023-10-08T07:07:09.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0940000000000008e-06 2023-10-08T07:07:09.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.220 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.220 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.151001+0000", 2023-10-08T07:07:09.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0691e-05 2023-10-08T07:07:09.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.220 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.220 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.151007+0000", 2023-10-08T07:07:09.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6370000000000004e-06 2023-10-08T07:07:09.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.151951+0000", 2023-10-08T07:07:09.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000944684 2023-10-08T07:07:09.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.152025+0000", 2023-10-08T07:07:09.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3832999999999996e-05 2023-10-08T07:07:09.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.152177+0000", 2023-10-08T07:07:09.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015178899999999999 2023-10-08T07:07:09.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.158267+0000", 2023-10-08T07:07:09.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060902200000000004 2023-10-08T07:07:09.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.175908+0000", 2023-10-08T07:07:09.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017640876 2023-10-08T07:07:09.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.175941+0000", 2023-10-08T07:07:09.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3197000000000001e-05 2023-10-08T07:07:09.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.175963+0000", 2023-10-08T07:07:09.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1684000000000001e-05 2023-10-08T07:07:09.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.224 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.224 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:60833 4.20 4:07572838:::10000000004.00000010:head [write 2863104~4096,write 3026944~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:09.224 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:08.153455+0000", 2023-10-08T07:07:09.224 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.93402945299999995, 2023-10-08T07:07:09.224 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022554904000000001, 2023-10-08T07:07:09.225 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.225 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.225 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.225 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.225 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.225 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 60833 2023-10-08T07:07:09.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.225 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.225 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.225 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.225 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153455+0000", 2023-10-08T07:07:09.225 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.226 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.226 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153455+0000", 2023-10-08T07:07:09.226 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.226 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.226 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153455+0000", 2023-10-08T07:07:09.226 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4900000000000005e-07 2023-10-08T07:07:09.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.227 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153465+0000", 2023-10-08T07:07:09.227 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0074e-05 2023-10-08T07:07:09.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.227 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153477+0000", 2023-10-08T07:07:09.227 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1368e-05 2023-10-08T07:07:09.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.228 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.228 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153482+0000", 2023-10-08T07:07:09.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2909999999999998e-06 2023-10-08T07:07:09.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.228 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.228 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153524+0000", 2023-10-08T07:07:09.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2076999999999997e-05 2023-10-08T07:07:09.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.229 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.229 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153571+0000", 2023-10-08T07:07:09.229 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7252000000000001e-05 2023-10-08T07:07:09.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.229 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.229 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153667+0000", 2023-10-08T07:07:09.229 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5444000000000003e-05 2023-10-08T07:07:09.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.229 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.160221+0000", 2023-10-08T07:07:09.230 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065544560000000002 2023-10-08T07:07:09.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.230 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.175931+0000", 2023-10-08T07:07:09.230 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015709813 2023-10-08T07:07:09.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.230 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.175979+0000", 2023-10-08T07:07:09.231 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7710000000000002e-05 2023-10-08T07:07:09.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.231 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.231 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.231 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.176010+0000", 2023-10-08T07:07:09.231 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.0670000000000003e-05 2023-10-08T07:07:09.231 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.231 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.231 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.231 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.231 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:60837 4.20 4:04004f2c:::10000000004.0000000d:head [write 1433600~4096,write 2097152~4096,write 2162688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:09.232 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:08.154619+0000", 2023-10-08T07:07:09.232 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.93286534700000001, 2023-10-08T07:07:09.232 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021478527000000001, 2023-10-08T07:07:09.232 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.232 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.232 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.232 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.232 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.232 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 60837 2023-10-08T07:07:09.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.233 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.233 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.233 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.154619+0000", 2023-10-08T07:07:09.233 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.233 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.233 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.154619+0000", 2023-10-08T07:07:09.233 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.234 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.234 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.154619+0000", 2023-10-08T07:07:09.234 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1900000000000002e-07 2023-10-08T07:07:09.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.234 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.234 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.154644+0000", 2023-10-08T07:07:09.234 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4558000000000001e-05 2023-10-08T07:07:09.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.234 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.154655+0000", 2023-10-08T07:07:09.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1151e-05 2023-10-08T07:07:09.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.154661+0000", 2023-10-08T07:07:09.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1879999999999999e-06 2023-10-08T07:07:09.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.154702+0000", 2023-10-08T07:07:09.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0858000000000001e-05 2023-10-08T07:07:09.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.154753+0000", 2023-10-08T07:07:09.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1323999999999999e-05 2023-10-08T07:07:09.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.154847+0000", 2023-10-08T07:07:09.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3925999999999995e-05 2023-10-08T07:07:09.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.160229+0000", 2023-10-08T07:07:09.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0053815319999999996 2023-10-08T07:07:09.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.176043+0000", 2023-10-08T07:07:09.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015813925999999999 2023-10-08T07:07:09.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.238 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.176076+0000", 2023-10-08T07:07:09.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2916999999999997e-05 2023-10-08T07:07:09.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.238 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.176097+0000", 2023-10-08T07:07:09.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1528000000000001e-05 2023-10-08T07:07:09.238 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.238 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.238 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.239 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.239 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:60845 4.2c 4:352c144c:::10000000004.00000003:head [write 720896~4096,write 802816~4096,write 991232~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:09.239 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:08.156987+0000", 2023-10-08T07:07:09.239 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.93049743299999998, 2023-10-08T07:07:09.239 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020766429999999999, 2023-10-08T07:07:09.239 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:09.239 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:09.239 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:09.239 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:09.240 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.240 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 60845 2023-10-08T07:07:09.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.240 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:09.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:09.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.156987+0000", 2023-10-08T07:07:09.241 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:09.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.156987+0000", 2023-10-08T07:07:09.241 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:09.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:09.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.156988+0000", 2023-10-08T07:07:09.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6600000000000005e-07 2023-10-08T07:07:09.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:09.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.156999+0000", 2023-10-08T07:07:09.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.146e-05 2023-10-08T07:07:09.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:09.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.157009+0000", 2023-10-08T07:07:09.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6630000000000005e-06 2023-10-08T07:07:09.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.243 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.243 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.243 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.157016+0000", 2023-10-08T07:07:09.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1019999999999999e-06 2023-10-08T07:07:09.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.243 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.243 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:09.243 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.157075+0000", 2023-10-08T07:07:09.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9246999999999997e-05 2023-10-08T07:07:09.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.157143+0000", 2023-10-08T07:07:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7836999999999994e-05 2023-10-08T07:07:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.157245+0000", 2023-10-08T07:07:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010255900000000001 2023-10-08T07:07:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.159761+0000", 2023-10-08T07:07:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0025157719999999999 2023-10-08T07:07:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.177663+0000", 2023-10-08T07:07:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017901567 2023-10-08T07:07:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.177716+0000", 2023-10-08T07:07:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3429e-05 2023-10-08T07:07:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.177753+0000", 2023-10-08T07:07:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6928000000000003e-05 2023-10-08T07:07:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:09.247 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:09.247 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:09.248 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:09.249 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:09.247+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:09.251 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2023-10-08T07:07:09.348 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:09.347+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:09.449 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:09.448+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:09.452 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:09.453 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:09.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.453 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64279 4.37 4:efdd41ff:::10000000004.0000001c:head [write 167936~4096 in=4096b,write 303104~4096 in=4096b,write 446464~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.453 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.429226+0000", 2023-10-08T07:07:09.453 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.017236878000000001, 2023-10-08T07:07:09.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017271014000000001, 2023-10-08T07:07:09.453 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.453 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.454 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64279 2023-10-08T07:07:09.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.454 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429226+0000", 2023-10-08T07:07:09.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429226+0000", 2023-10-08T07:07:09.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429227+0000", 2023-10-08T07:07:09.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6799999999999999e-07 2023-10-08T07:07:09.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429238+0000", 2023-10-08T07:07:09.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1141999999999999e-05 2023-10-08T07:07:09.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429247+0000", 2023-10-08T07:07:09.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9239999999999996e-06 2023-10-08T07:07:09.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429252+0000", 2023-10-08T07:07:09.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9470000000000002e-06 2023-10-08T07:07:09.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435643+0000", 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063916010000000002 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435735+0000", 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1240000000000001e-05 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.457 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64311 4.19 4:9b26afe3:::10000000004.00000005:head [write 3358720~4096 in=4096b,write 3366912~4096 in=4096b,write 3379200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.440697+0000", 2023-10-08T07:07:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0057662210000000002, 2023-10-08T07:07:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058789300000000001, 2023-10-08T07:07:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64311 2023-10-08T07:07:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440697+0000", 2023-10-08T07:07:09.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440697+0000", 2023-10-08T07:07:09.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440698+0000", 2023-10-08T07:07:09.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0470000000000001e-06 2023-10-08T07:07:09.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440709+0000", 2023-10-08T07:07:09.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1761e-05 2023-10-08T07:07:09.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440740+0000", 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0877000000000003e-05 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440759+0000", 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8553999999999999e-05 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.446180+0000", 2023-10-08T07:07:09.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054209050000000002 2023-10-08T07:07:09.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.446261+0000", 2023-10-08T07:07:09.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1023e-05 2023-10-08T07:07:09.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.462 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.464 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64276 4.c e52/17 4:31e28161:::10000000004.00000011:head v 52'2004, mlcod=52'1999)", 2023-10-08T07:07:09.464 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.429692+0000", 2023-10-08T07:07:09.464 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016771133000000001, 2023-10-08T07:07:09.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016953902, 2023-10-08T07:07:09.464 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.464 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.465 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429692+0000", 2023-10-08T07:07:09.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429692+0000", 2023-10-08T07:07:09.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429692+0000", 2023-10-08T07:07:09.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5999999999999999e-07 2023-10-08T07:07:09.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429701+0000", 2023-10-08T07:07:09.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8219999999999996e-06 2023-10-08T07:07:09.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429711+0000", 2023-10-08T07:07:09.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0076e-05 2023-10-08T07:07:09.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429716+0000", 2023-10-08T07:07:09.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2023-10-08T07:07:09.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.438174+0000", 2023-10-08T07:07:09.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084576960000000007 2023-10-08T07:07:09.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.438195+0000", 2023-10-08T07:07:09.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1132999999999999e-05 2023-10-08T07:07:09.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.470 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.470 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64312 4.1b e52/17 4:dbb7dde6:::10000000004.0000002c:head v 52'1989, mlcod=52'1986)", 2023-10-08T07:07:09.471 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.440791+0000", 2023-10-08T07:07:09.471 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.005672234, 2023-10-08T07:07:09.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059207720000000004, 2023-10-08T07:07:09.471 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.471 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.471 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440791+0000", 2023-10-08T07:07:09.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440791+0000", 2023-10-08T07:07:09.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440791+0000", 2023-10-08T07:07:09.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:07:09.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440802+0000", 2023-10-08T07:07:09.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0579e-05 2023-10-08T07:07:09.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440811+0000", 2023-10-08T07:07:09.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3270000000000007e-06 2023-10-08T07:07:09.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440819+0000", 2023-10-08T07:07:09.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4699999999999996e-06 2023-10-08T07:07:09.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442569+0000", 2023-10-08T07:07:09.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017503379999999999 2023-10-08T07:07:09.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442586+0000", 2023-10-08T07:07:09.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6659000000000001e-05 2023-10-08T07:07:09.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.475 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.475 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64283 4.15 4:a88808fa:::10000000004.0000001f:head [write 1638400~4096 in=4096b,write 1675264~4096 in=4096b,write 1921024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.475 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.430452+0000", 2023-10-08T07:07:09.476 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016010412000000002, 2023-10-08T07:07:09.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016332908, 2023-10-08T07:07:09.476 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.476 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.476 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64283 2023-10-08T07:07:09.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.476 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.430452+0000", 2023-10-08T07:07:09.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.430452+0000", 2023-10-08T07:07:09.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.430453+0000", 2023-10-08T07:07:09.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9599999999999998e-07 2023-10-08T07:07:09.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.430465+0000", 2023-10-08T07:07:09.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1950000000000001e-05 2023-10-08T07:07:09.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.430476+0000", 2023-10-08T07:07:09.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0488e-05 2023-10-08T07:07:09.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.430483+0000", 2023-10-08T07:07:09.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0210000000000002e-06 2023-10-08T07:07:09.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437218+0000", 2023-10-08T07:07:09.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067348479999999999 2023-10-08T07:07:09.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437299+0000", 2023-10-08T07:07:09.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1088999999999996e-05 2023-10-08T07:07:09.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.480 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.480 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64316 4.3b 4:df0e4bf8:::10000000004.00000018:head [write 3665920~4096 in=4096b,write 3825664~4096 in=4096b,write 3842048~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.480 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.441600+0000", 2023-10-08T07:07:09.481 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0048630360000000003, 2023-10-08T07:07:09.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052567500000000001, 2023-10-08T07:07:09.481 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.481 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64316 2023-10-08T07:07:09.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.481 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.441600+0000", 2023-10-08T07:07:09.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.441600+0000", 2023-10-08T07:07:09.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.441601+0000", 2023-10-08T07:07:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8800000000000001e-07 2023-10-08T07:07:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.441612+0000", 2023-10-08T07:07:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1474000000000001e-05 2023-10-08T07:07:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.441623+0000", 2023-10-08T07:07:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0857e-05 2023-10-08T07:07:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.441631+0000", 2023-10-08T07:07:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5329999999999997e-06 2023-10-08T07:07:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442537+0000", 2023-10-08T07:07:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00090621699999999996 2023-10-08T07:07:09.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442618+0000", 2023-10-08T07:07:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1335999999999995e-05 2023-10-08T07:07:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64284 4.b 4:d0c991e0:::10000000004.0000002d:head [write 2146304~8192 in=8192b,write 2228224~4096 in=4096b,write 2281472~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.430781+0000", 2023-10-08T07:07:09.485 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.015681937, 2023-10-08T07:07:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016117269, 2023-10-08T07:07:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64284 2023-10-08T07:07:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.430781+0000", 2023-10-08T07:07:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.430781+0000", 2023-10-08T07:07:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.430782+0000", 2023-10-08T07:07:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6499999999999999e-07 2023-10-08T07:07:09.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.430798+0000", 2023-10-08T07:07:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6614000000000001e-05 2023-10-08T07:07:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.430807+0000", 2023-10-08T07:07:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4579999999999993e-06 2023-10-08T07:07:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.430811+0000", 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5719999999999996e-06 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431207+0000", 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00039625000000000001 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431285+0000", 2023-10-08T07:07:09.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7093000000000002e-05 2023-10-08T07:07:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431438+0000", 2023-10-08T07:07:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000153454 2023-10-08T07:07:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434238+0000", 2023-10-08T07:07:09.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028000960000000002 2023-10-08T07:07:09.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.491 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.491 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64317 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.491 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.441894+0000", 2023-10-08T07:07:09.491 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045686529999999998, 2023-10-08T07:07:09.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005050756, 2023-10-08T07:07:09.491 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.491 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:09.491 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.492 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64317 2023-10-08T07:07:09.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.492 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.441894+0000", 2023-10-08T07:07:09.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.441894+0000", 2023-10-08T07:07:09.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.441895+0000", 2023-10-08T07:07:09.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0109999999999999e-06 2023-10-08T07:07:09.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.441906+0000", 2023-10-08T07:07:09.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.04e-05 2023-10-08T07:07:09.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.441918+0000", 2023-10-08T07:07:09.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2559e-05 2023-10-08T07:07:09.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.441927+0000", 2023-10-08T07:07:09.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4910000000000005e-06 2023-10-08T07:07:09.494 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.494 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.497 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64251 4.15 4:a88808fa:::10000000004.0000001f:head [write 2330624~4096 in=4096b,write 2437120~4096 in=4096b,write 2486272~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.497 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.420208+0000", 2023-10-08T07:07:09.497 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026254408, 2023-10-08T07:07:09.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026773089999999999, 2023-10-08T07:07:09.497 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.497 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.498 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64251 2023-10-08T07:07:09.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.498 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.420208+0000", 2023-10-08T07:07:09.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.420208+0000", 2023-10-08T07:07:09.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.420209+0000", 2023-10-08T07:07:09.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6600000000000002e-07 2023-10-08T07:07:09.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.420262+0000", 2023-10-08T07:07:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3001999999999998e-05 2023-10-08T07:07:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.420269+0000", 2023-10-08T07:07:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5240000000000003e-06 2023-10-08T07:07:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.420276+0000", 2023-10-08T07:07:09.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2580000000000001e-06 2023-10-08T07:07:09.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.428587+0000", 2023-10-08T07:07:09.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008311611 2023-10-08T07:07:09.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.428693+0000", 2023-10-08T07:07:09.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105691 2023-10-08T07:07:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64285 4.14 4:2b72a8af:::10000000004.0000000c:head [write 1699840~4096 in=4096b,write 1712128~12288 in=12288b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.431179+0000", 2023-10-08T07:07:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.015283863, 2023-10-08T07:07:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015861897, 2023-10-08T07:07:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64285 2023-10-08T07:07:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431179+0000", 2023-10-08T07:07:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431179+0000", 2023-10-08T07:07:09.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431180+0000", 2023-10-08T07:07:09.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8999999999999995e-07 2023-10-08T07:07:09.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431195+0000", 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5204e-05 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431206+0000", 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0642000000000001e-05 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431213+0000", 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.362e-06 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439454+0000", 2023-10-08T07:07:09.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082410090000000005 2023-10-08T07:07:09.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439535+0000", 2023-10-08T07:07:09.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1191000000000002e-05 2023-10-08T07:07:09.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.506 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.507 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64315 4.a e52/17 4:524fba76:::10000000004.0000001b:head v 52'979, mlcod=52'977)", 2023-10-08T07:07:09.507 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.442098+0000", 2023-10-08T07:07:09.507 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0043652400000000003, 2023-10-08T07:07:09.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050197180000000003, 2023-10-08T07:07:09.507 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.507 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.507 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442098+0000", 2023-10-08T07:07:09.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442098+0000", 2023-10-08T07:07:09.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442098+0000", 2023-10-08T07:07:09.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0800000000000005e-07 2023-10-08T07:07:09.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442110+0000", 2023-10-08T07:07:09.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1824999999999999e-05 2023-10-08T07:07:09.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442124+0000", 2023-10-08T07:07:09.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3815000000000001e-05 2023-10-08T07:07:09.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442129+0000", 2023-10-08T07:07:09.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5809999999999996e-06 2023-10-08T07:07:09.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442177+0000", 2023-10-08T07:07:09.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7159e-05 2023-10-08T07:07:09.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442197+0000", 2023-10-08T07:07:09.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0726000000000001e-05 2023-10-08T07:07:09.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.511 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.511 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64280 4.c e52/17 4:3352c333:::10000000004.00000012:head v 52'2005, mlcod=52'1999)", 2023-10-08T07:07:09.511 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.431603+0000", 2023-10-08T07:07:09.511 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014859672000000001, 2023-10-08T07:07:09.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015582689, 2023-10-08T07:07:09.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.512 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431603+0000", 2023-10-08T07:07:09.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431603+0000", 2023-10-08T07:07:09.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431604+0000", 2023-10-08T07:07:09.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:07:09.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431615+0000", 2023-10-08T07:07:09.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1379999999999999e-05 2023-10-08T07:07:09.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431623+0000", 2023-10-08T07:07:09.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0430000000000008e-06 2023-10-08T07:07:09.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431629+0000", 2023-10-08T07:07:09.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.195e-06 2023-10-08T07:07:09.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440180+0000", 2023-10-08T07:07:09.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085503709999999993 2023-10-08T07:07:09.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440196+0000", 2023-10-08T07:07:09.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6059999999999999e-05 2023-10-08T07:07:09.515 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.515 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.515 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.515 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64319 4.21 4.5d9f5e61 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.516 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.442334+0000", 2023-10-08T07:07:09.516 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0041283839999999997, 2023-10-08T07:07:09.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049870610000000001, 2023-10-08T07:07:09.516 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.516 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:09.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.516 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.516 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64319 2023-10-08T07:07:09.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.516 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442334+0000", 2023-10-08T07:07:09.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442334+0000", 2023-10-08T07:07:09.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442335+0000", 2023-10-08T07:07:09.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8299999999999996e-07 2023-10-08T07:07:09.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442347+0000", 2023-10-08T07:07:09.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1463e-05 2023-10-08T07:07:09.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442357+0000", 2023-10-08T07:07:09.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8309999999999996e-06 2023-10-08T07:07:09.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442363+0000", 2023-10-08T07:07:09.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.421e-06 2023-10-08T07:07:09.519 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.519 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.519 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.520 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64253 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 1036288~4096 in=4096b,write 1462272~4096 in=4096b,write 1519616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.520 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.420920+0000", 2023-10-08T07:07:09.520 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.025543010000000001, 2023-10-08T07:07:09.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026479459, 2023-10-08T07:07:09.520 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.520 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.520 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.520 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.520 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.520 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64253 2023-10-08T07:07:09.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.520 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.420920+0000", 2023-10-08T07:07:09.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.420920+0000", 2023-10-08T07:07:09.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.420921+0000", 2023-10-08T07:07:09.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6000000000000003e-07 2023-10-08T07:07:09.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.420936+0000", 2023-10-08T07:07:09.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5034e-05 2023-10-08T07:07:09.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.420945+0000", 2023-10-08T07:07:09.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0140000000000004e-06 2023-10-08T07:07:09.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.420952+0000", 2023-10-08T07:07:09.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1389999999999998e-06 2023-10-08T07:07:09.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427694+0000", 2023-10-08T07:07:09.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067425219999999999 2023-10-08T07:07:09.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427780+0000", 2023-10-08T07:07:09.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5469000000000004e-05 2023-10-08T07:07:09.524 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.524 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.524 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.524 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64286 4.14 4:2b72a8af:::10000000004.0000000c:head [write 3911680~4096 in=4096b,write 4026368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.524 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.431664+0000", 2023-10-08T07:07:09.524 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014799323, 2023-10-08T07:07:09.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015858114999999999, 2023-10-08T07:07:09.525 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.525 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.525 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.525 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.525 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.525 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64286 2023-10-08T07:07:09.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.525 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431664+0000", 2023-10-08T07:07:09.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431664+0000", 2023-10-08T07:07:09.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431664+0000", 2023-10-08T07:07:09.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3200000000000004e-07 2023-10-08T07:07:09.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431674+0000", 2023-10-08T07:07:09.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0088999999999999e-05 2023-10-08T07:07:09.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431684+0000", 2023-10-08T07:07:09.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8660000000000001e-06 2023-10-08T07:07:09.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431691+0000", 2023-10-08T07:07:09.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.635e-06 2023-10-08T07:07:09.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443805+0000", 2023-10-08T07:07:09.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012114213 2023-10-08T07:07:09.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443903+0000", 2023-10-08T07:07:09.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7353000000000001e-05 2023-10-08T07:07:09.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.529 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.529 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64320 4.2b e52/17 4:d776c1c9:::10000000004.0000003d:head v 52'2033, mlcod=52'2029)", 2023-10-08T07:07:09.529 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.443168+0000", 2023-10-08T07:07:09.529 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0032951679999999998, 2023-10-08T07:07:09.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044505009999999999, 2023-10-08T07:07:09.529 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.530 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443168+0000", 2023-10-08T07:07:09.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443168+0000", 2023-10-08T07:07:09.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443168+0000", 2023-10-08T07:07:09.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2e-07 2023-10-08T07:07:09.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443177+0000", 2023-10-08T07:07:09.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9250000000000001e-06 2023-10-08T07:07:09.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443187+0000", 2023-10-08T07:07:09.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5230000000000001e-06 2023-10-08T07:07:09.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443192+0000", 2023-10-08T07:07:09.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9409999999999998e-06 2023-10-08T07:07:09.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444266+0000", 2023-10-08T07:07:09.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001074569 2023-10-08T07:07:09.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444287+0000", 2023-10-08T07:07:09.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1092999999999999e-05 2023-10-08T07:07:09.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.534 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.534 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64287 4.0 4:02bf98b6:::10000000004.0000000e:head [write 1073152~4096 in=4096b,write 1130496~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.534 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.431865+0000", 2023-10-08T07:07:09.534 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014597966, 2023-10-08T07:07:09.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015829639, 2023-10-08T07:07:09.534 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.534 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64287 2023-10-08T07:07:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431865+0000", 2023-10-08T07:07:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431865+0000", 2023-10-08T07:07:09.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431866+0000", 2023-10-08T07:07:09.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-07 2023-10-08T07:07:09.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431892+0000", 2023-10-08T07:07:09.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6701000000000001e-05 2023-10-08T07:07:09.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431900+0000", 2023-10-08T07:07:09.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8359999999999992e-06 2023-10-08T07:07:09.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431906+0000", 2023-10-08T07:07:09.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.587e-06 2023-10-08T07:07:09.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.431953+0000", 2023-10-08T07:07:09.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7778000000000002e-05 2023-10-08T07:07:09.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432037+0000", 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3462999999999997e-05 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432203+0000", 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016571899999999999 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435680+0000", 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034777010000000001 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.539 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.540 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64322 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.540 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.443739+0000", 2023-10-08T07:07:09.540 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0027237749999999999, 2023-10-08T07:07:09.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040290409999999997, 2023-10-08T07:07:09.540 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.540 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:09.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.541 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64322 2023-10-08T07:07:09.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.541 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443739+0000", 2023-10-08T07:07:09.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443739+0000", 2023-10-08T07:07:09.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443740+0000", 2023-10-08T07:07:09.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3799999999999996e-07 2023-10-08T07:07:09.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443754+0000", 2023-10-08T07:07:09.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.364e-05 2023-10-08T07:07:09.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443771+0000", 2023-10-08T07:07:09.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7784000000000001e-05 2023-10-08T07:07:09.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443781+0000", 2023-10-08T07:07:09.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7899999999999994e-06 2023-10-08T07:07:09.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.544 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.544 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64288 4.7 4:e2d089ed:::10000000004.00000033:head [write 2416640~4096 in=4096b,write 2449408~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.544 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.432181+0000", 2023-10-08T07:07:09.544 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014281419, 2023-10-08T07:07:09.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015652694000000002, 2023-10-08T07:07:09.544 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.544 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.544 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64288 2023-10-08T07:07:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432181+0000", 2023-10-08T07:07:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432181+0000", 2023-10-08T07:07:09.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432182+0000", 2023-10-08T07:07:09.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.85e-07 2023-10-08T07:07:09.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432194+0000", 2023-10-08T07:07:09.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1535000000000001e-05 2023-10-08T07:07:09.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432204+0000", 2023-10-08T07:07:09.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0594999999999999e-05 2023-10-08T07:07:09.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432212+0000", 2023-10-08T07:07:09.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7819999999999994e-06 2023-10-08T07:07:09.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439116+0000", 2023-10-08T07:07:09.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069036540000000004 2023-10-08T07:07:09.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439199+0000", 2023-10-08T07:07:09.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3100000000000001e-05 2023-10-08T07:07:09.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.548 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.549 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64289 4.29 4:94216392:::10000000004.0000002b:head [write 2588672~4096 in=4096b,write 2646016~4096 in=4096b,write 3538944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.549 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.432476+0000", 2023-10-08T07:07:09.549 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013986458, 2023-10-08T07:07:09.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015399596999999999, 2023-10-08T07:07:09.549 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:09.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.550 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64289 2023-10-08T07:07:09.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.550 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432476+0000", 2023-10-08T07:07:09.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432476+0000", 2023-10-08T07:07:09.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432477+0000", 2023-10-08T07:07:09.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9299999999999997e-07 2023-10-08T07:07:09.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432514+0000", 2023-10-08T07:07:09.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6647000000000003e-05 2023-10-08T07:07:09.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432524+0000", 2023-10-08T07:07:09.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.893e-06 2023-10-08T07:07:09.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432532+0000", 2023-10-08T07:07:09.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6039999999999993e-06 2023-10-08T07:07:09.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432586+0000", 2023-10-08T07:07:09.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3672999999999999e-05 2023-10-08T07:07:09.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432671+0000", 2023-10-08T07:07:09.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4509e-05 2023-10-08T07:07:09.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:09.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432815+0000", 2023-10-08T07:07:09.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014487899999999999 2023-10-08T07:07:09.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439402+0000", 2023-10-08T07:07:09.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006586789 2023-10-08T07:07:09.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.554 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.554 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64324 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 2498560~4096 in=4096b,write 2633728~4096 in=4096b,write 2686976~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.554 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.444245+0000", 2023-10-08T07:07:09.554 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0022174260000000002, 2023-10-08T07:07:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003676861, 2023-10-08T07:07:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64324 2023-10-08T07:07:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444245+0000", 2023-10-08T07:07:09.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444245+0000", 2023-10-08T07:07:09.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444246+0000", 2023-10-08T07:07:09.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4300000000000002e-07 2023-10-08T07:07:09.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444259+0000", 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2659e-05 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444268+0000", 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8349999999999993e-06 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444275+0000", 2023-10-08T07:07:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8249999999999999e-06 2023-10-08T07:07:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445104+0000", 2023-10-08T07:07:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082954299999999997 2023-10-08T07:07:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445186+0000", 2023-10-08T07:07:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1877000000000002e-05 2023-10-08T07:07:09.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64290 4.36 4:6d7df329:::10000000004.00000034:head [write 2203648~4096 in=4096b,write 2301952~4096 in=4096b,write 2363392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.432756+0000", 2023-10-08T07:07:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013707353, 2023-10-08T07:07:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015207007999999999, 2023-10-08T07:07:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64290 2023-10-08T07:07:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432756+0000", 2023-10-08T07:07:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432756+0000", 2023-10-08T07:07:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432756+0000", 2023-10-08T07:07:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8599999999999998e-07 2023-10-08T07:07:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432795+0000", 2023-10-08T07:07:09.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8396999999999998e-05 2023-10-08T07:07:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432802+0000", 2023-10-08T07:07:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5809999999999999e-06 2023-10-08T07:07:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432809+0000", 2023-10-08T07:07:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9059999999999996e-06 2023-10-08T07:07:09.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432849+0000", 2023-10-08T07:07:09.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0021000000000002e-05 2023-10-08T07:07:09.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432899+0000", 2023-10-08T07:07:09.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0241000000000002e-05 2023-10-08T07:07:09.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.563 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.564 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64323 4.1a e52/17 4:5a59f83a:::10000000004.00000002:head v 52'1026, mlcod=52'1024)", 2023-10-08T07:07:09.564 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.444437+0000", 2023-10-08T07:07:09.564 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0020262209999999999, 2023-10-08T07:07:09.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035806229999999998, 2023-10-08T07:07:09.564 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.564 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.564 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444437+0000", 2023-10-08T07:07:09.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444437+0000", 2023-10-08T07:07:09.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444437+0000", 2023-10-08T07:07:09.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6800000000000001e-07 2023-10-08T07:07:09.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444447+0000", 2023-10-08T07:07:09.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6719999999999999e-06 2023-10-08T07:07:09.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444457+0000", 2023-10-08T07:07:09.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8919999999999995e-06 2023-10-08T07:07:09.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444462+0000", 2023-10-08T07:07:09.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2100000000000001e-06 2023-10-08T07:07:09.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444601+0000", 2023-10-08T07:07:09.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000139095 2023-10-08T07:07:09.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444621+0000", 2023-10-08T07:07:09.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0492999999999998e-05 2023-10-08T07:07:09.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.568 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.568 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64291 4.19 4:9b26afe3:::10000000004.00000005:head [write 163840~4096 in=4096b,write 598016~4096 in=4096b,write 647168~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.568 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.433048+0000", 2023-10-08T07:07:09.568 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013414587, 2023-10-08T07:07:09.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015049290999999999, 2023-10-08T07:07:09.568 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.568 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.569 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64291 2023-10-08T07:07:09.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.569 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433048+0000", 2023-10-08T07:07:09.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433048+0000", 2023-10-08T07:07:09.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433049+0000", 2023-10-08T07:07:09.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1500000000000004e-07 2023-10-08T07:07:09.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433060+0000", 2023-10-08T07:07:09.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0937e-05 2023-10-08T07:07:09.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433068+0000", 2023-10-08T07:07:09.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5490000000000006e-06 2023-10-08T07:07:09.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433075+0000", 2023-10-08T07:07:09.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5379999999999999e-06 2023-10-08T07:07:09.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433120+0000", 2023-10-08T07:07:09.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5393999999999999e-05 2023-10-08T07:07:09.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433202+0000", 2023-10-08T07:07:09.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1755000000000006e-05 2023-10-08T07:07:09.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.572 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.573 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64325 4.7 4:e13e8cdb:::10000000004.00000028:head [write 3346432~4096 in=4096b,write 3411968~4096 in=4096b,write 3420160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.573 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.444556+0000", 2023-10-08T07:07:09.573 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0019073219999999999, 2023-10-08T07:07:09.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003615699, 2023-10-08T07:07:09.573 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.573 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64325 2023-10-08T07:07:09.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.574 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444556+0000", 2023-10-08T07:07:09.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444556+0000", 2023-10-08T07:07:09.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444557+0000", 2023-10-08T07:07:09.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.569999999999999e-07 2023-10-08T07:07:09.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444571+0000", 2023-10-08T07:07:09.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4606999999999999e-05 2023-10-08T07:07:09.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444583+0000", 2023-10-08T07:07:09.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1486e-05 2023-10-08T07:07:09.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444591+0000", 2023-10-08T07:07:09.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3229999999999998e-06 2023-10-08T07:07:09.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445768+0000", 2023-10-08T07:07:09.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001177216 2023-10-08T07:07:09.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445859+0000", 2023-10-08T07:07:09.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1131999999999994e-05 2023-10-08T07:07:09.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.577 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.578 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64329 4.3f 4:fc9a2d79:::10000000004.0000002f:head [write 1462272~4096 in=4096b,write 1515520~4096 in=4096b,write 1736704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.578 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.445728+0000", 2023-10-08T07:07:09.578 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00073523000000000002, 2023-10-08T07:07:09.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024906640000000001, 2023-10-08T07:07:09.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.579 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64329 2023-10-08T07:07:09.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.579 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445728+0000", 2023-10-08T07:07:09.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445728+0000", 2023-10-08T07:07:09.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445729+0000", 2023-10-08T07:07:09.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5199999999999995e-07 2023-10-08T07:07:09.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445745+0000", 2023-10-08T07:07:09.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.613e-05 2023-10-08T07:07:09.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445755+0000", 2023-10-08T07:07:09.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0569e-05 2023-10-08T07:07:09.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445763+0000", 2023-10-08T07:07:09.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2099999999999996e-06 2023-10-08T07:07:09.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445966+0000", 2023-10-08T07:07:09.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000203165 2023-10-08T07:07:09.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.446044+0000", 2023-10-08T07:07:09.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8151000000000004e-05 2023-10-08T07:07:09.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.582 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.583 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64293 4.10 4:08d50e0e:::10000000004.0000003f:head [write 1626112~4096 in=4096b,write 1789952~4096 in=4096b,write 2002944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.583 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.433643+0000", 2023-10-08T07:07:09.583 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012820094000000001, 2023-10-08T07:07:09.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014728542000000001, 2023-10-08T07:07:09.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64293 2023-10-08T07:07:09.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433643+0000", 2023-10-08T07:07:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433643+0000", 2023-10-08T07:07:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433644+0000", 2023-10-08T07:07:09.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9999999999999996e-07 2023-10-08T07:07:09.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433657+0000", 2023-10-08T07:07:09.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2909e-05 2023-10-08T07:07:09.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433667+0000", 2023-10-08T07:07:09.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0329000000000001e-05 2023-10-08T07:07:09.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433674+0000", 2023-10-08T07:07:09.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5020000000000003e-06 2023-10-08T07:07:09.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433874+0000", 2023-10-08T07:07:09.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019997600000000001 2023-10-08T07:07:09.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.433976+0000", 2023-10-08T07:07:09.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101288 2023-10-08T07:07:09.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.587 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.587 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64328 4.a e52/17 4:524fba76:::10000000004.0000001b:head v 52'980, mlcod=52'977)", 2023-10-08T07:07:09.587 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.445986+0000", 2023-10-08T07:07:09.588 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00047704300000000002, 2023-10-08T07:07:09.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024986589999999999, 2023-10-08T07:07:09.588 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.588 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.588 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445986+0000", 2023-10-08T07:07:09.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445986+0000", 2023-10-08T07:07:09.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445986+0000", 2023-10-08T07:07:09.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3600000000000003e-07 2023-10-08T07:07:09.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445999+0000", 2023-10-08T07:07:09.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2516e-05 2023-10-08T07:07:09.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.446008+0000", 2023-10-08T07:07:09.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9400000000000008e-06 2023-10-08T07:07:09.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.446015+0000", 2023-10-08T07:07:09.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1269999999999997e-06 2023-10-08T07:07:09.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.446084+0000", 2023-10-08T07:07:09.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9101000000000001e-05 2023-10-08T07:07:09.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.446103+0000", 2023-10-08T07:07:09.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9028000000000001e-05 2023-10-08T07:07:09.592 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.592 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.592 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.592 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64260 4.7 4:e2d089ed:::10000000004.00000033:head [write 1232896~4096 in=4096b,write 1257472~4096 in=4096b,write 1302528~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.592 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.423153+0000", 2023-10-08T07:07:09.592 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.023309456999999999, 2023-10-08T07:07:09.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025407890999999998, 2023-10-08T07:07:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64260 2023-10-08T07:07:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.423153+0000", 2023-10-08T07:07:09.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.423153+0000", 2023-10-08T07:07:09.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.423154+0000", 2023-10-08T07:07:09.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0699999999999996e-07 2023-10-08T07:07:09.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.423191+0000", 2023-10-08T07:07:09.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6436000000000001e-05 2023-10-08T07:07:09.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.423203+0000", 2023-10-08T07:07:09.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2792999999999999e-05 2023-10-08T07:07:09.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.423212+0000", 2023-10-08T07:07:09.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8999999999999995e-06 2023-10-08T07:07:09.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429478+0000", 2023-10-08T07:07:09.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062661399999999999 2023-10-08T07:07:09.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.429545+0000", 2023-10-08T07:07:09.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6528999999999999e-05 2023-10-08T07:07:09.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.597 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.597 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64330 4.37 4.ff82bbf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.597 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.447015+0000", 2023-10-08T07:07:09.597 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9994478, 2023-10-08T07:07:09.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016263639999999999, 2023-10-08T07:07:09.597 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.598 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:09.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.598 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64330 2023-10-08T07:07:09.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.598 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447015+0000", 2023-10-08T07:07:09.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447015+0000", 2023-10-08T07:07:09.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447016+0000", 2023-10-08T07:07:09.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4900000000000005e-07 2023-10-08T07:07:09.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447029+0000", 2023-10-08T07:07:09.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3249e-05 2023-10-08T07:07:09.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447040+0000", 2023-10-08T07:07:09.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0805000000000001e-05 2023-10-08T07:07:09.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447047+0000", 2023-10-08T07:07:09.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5900000000000002e-06 2023-10-08T07:07:09.601 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.601 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.601 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.601 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64294 4.21 4:867af9ba:::10000000004.0000000a:head [write 1019904~4096 in=4096b,write 1097728~4096 in=4096b,write 1130496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.601 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.434028+0000", 2023-10-08T07:07:09.601 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012434801000000001, 2023-10-08T07:07:09.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014681537999999999, 2023-10-08T07:07:09.601 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.601 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.602 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.602 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.602 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.602 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64294 2023-10-08T07:07:09.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.602 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434028+0000", 2023-10-08T07:07:09.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434028+0000", 2023-10-08T07:07:09.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434029+0000", 2023-10-08T07:07:09.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1999999999999999e-07 2023-10-08T07:07:09.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434041+0000", 2023-10-08T07:07:09.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2577e-05 2023-10-08T07:07:09.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434050+0000", 2023-10-08T07:07:09.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4940000000000003e-06 2023-10-08T07:07:09.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434057+0000", 2023-10-08T07:07:09.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2309999999999999e-06 2023-10-08T07:07:09.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.438224+0000", 2023-10-08T07:07:09.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041673109999999999 2023-10-08T07:07:09.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.438329+0000", 2023-10-08T07:07:09.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000104351 2023-10-08T07:07:09.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64295 4.11 4:8963efe6:::10000000004.00000009:head [write 1540096~4096 in=4096b,write 1601536~4096 in=4096b,write 1884160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.434472+0000", 2023-10-08T07:07:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01199134, 2023-10-08T07:07:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014324860999999999, 2023-10-08T07:07:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.607 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.607 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64295 2023-10-08T07:07:09.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.607 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434472+0000", 2023-10-08T07:07:09.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434472+0000", 2023-10-08T07:07:09.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434472+0000", 2023-10-08T07:07:09.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8999999999999995e-07 2023-10-08T07:07:09.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434484+0000", 2023-10-08T07:07:09.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1905e-05 2023-10-08T07:07:09.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434494+0000", 2023-10-08T07:07:09.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9189999999999994e-06 2023-10-08T07:07:09.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.434502+0000", 2023-10-08T07:07:09.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5889999999999997e-06 2023-10-08T07:07:09.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439584+0000", 2023-10-08T07:07:09.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050826209999999998 2023-10-08T07:07:09.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439654+0000", 2023-10-08T07:07:09.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9709000000000006e-05 2023-10-08T07:07:09.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439784+0000", 2023-10-08T07:07:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012990500000000001 2023-10-08T07:07:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445958+0000", 2023-10-08T07:07:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061738019999999999 2023-10-08T07:07:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.612 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64331 4.a e52/17 4:524fba76:::10000000004.0000001b:head v 52'981, mlcod=52'977)", 2023-10-08T07:07:09.612 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.447305+0000", 2023-10-08T07:07:09.612 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9991574, 2023-10-08T07:07:09.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015792219999999999, 2023-10-08T07:07:09.612 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.612 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.612 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447305+0000", 2023-10-08T07:07:09.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447305+0000", 2023-10-08T07:07:09.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447306+0000", 2023-10-08T07:07:09.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0200000000000002e-07 2023-10-08T07:07:09.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447322+0000", 2023-10-08T07:07:09.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5764e-05 2023-10-08T07:07:09.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447348+0000", 2023-10-08T07:07:09.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.669e-05 2023-10-08T07:07:09.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447356+0000", 2023-10-08T07:07:09.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5109999999999997e-06 2023-10-08T07:07:09.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447398+0000", 2023-10-08T07:07:09.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2339999999999998e-05 2023-10-08T07:07:09.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447410+0000", 2023-10-08T07:07:09.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2288e-05 2023-10-08T07:07:09.616 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.616 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.616 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.616 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64297 4.11 4:8963efe6:::10000000004.00000009:head [write 1986560~4096 in=4096b,write 2043904~4096 in=4096b,write 2195456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.616 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.435360+0000", 2023-10-08T07:07:09.616 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011102951, 2023-10-08T07:07:09.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013597392999999999, 2023-10-08T07:07:09.616 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.616 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:09.617 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.617 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.617 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.617 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64297 2023-10-08T07:07:09.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.617 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435360+0000", 2023-10-08T07:07:09.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435360+0000", 2023-10-08T07:07:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435361+0000", 2023-10-08T07:07:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4900000000000005e-07 2023-10-08T07:07:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435374+0000", 2023-10-08T07:07:09.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3334e-05 2023-10-08T07:07:09.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435384+0000", 2023-10-08T07:07:09.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5510000000000005e-06 2023-10-08T07:07:09.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435391+0000", 2023-10-08T07:07:09.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1029999999999996e-06 2023-10-08T07:07:09.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443884+0000", 2023-10-08T07:07:09.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084932540000000004 2023-10-08T07:07:09.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443935+0000", 2023-10-08T07:07:09.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1325000000000001e-05 2023-10-08T07:07:09.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:09.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.444023+0000", 2023-10-08T07:07:09.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7525e-05 2023-10-08T07:07:09.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:09.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447405+0000", 2023-10-08T07:07:09.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033825449999999998 2023-10-08T07:07:09.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.621 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.622 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64334 4.19 4.c7f564d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.622 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.447226+0000", 2023-10-08T07:07:09.622 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9992371, 2023-10-08T07:07:09.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018224510000000001, 2023-10-08T07:07:09.622 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.622 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:09.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.622 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64334 2023-10-08T07:07:09.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.622 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447226+0000", 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447226+0000", 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447227+0000", 2023-10-08T07:07:09.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6499999999999999e-07 2023-10-08T07:07:09.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447363+0000", 2023-10-08T07:07:09.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013647099999999999 2023-10-08T07:07:09.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447371+0000", 2023-10-08T07:07:09.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.525e-06 2023-10-08T07:07:09.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447377+0000", 2023-10-08T07:07:09.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6050000000000003e-06 2023-10-08T07:07:09.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.625 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.625 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64336 4.f 4.e29eca4f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.625 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.447479+0000", 2023-10-08T07:07:09.626 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9989834, 2023-10-08T07:07:09.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001709035, 2023-10-08T07:07:09.626 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.626 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:09.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.626 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64336 2023-10-08T07:07:09.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.626 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447479+0000", 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447479+0000", 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447480+0000", 2023-10-08T07:07:09.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0200000000000001e-07 2023-10-08T07:07:09.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447599+0000", 2023-10-08T07:07:09.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011854900000000001 2023-10-08T07:07:09.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447608+0000", 2023-10-08T07:07:09.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4290000000000007e-06 2023-10-08T07:07:09.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447615+0000", 2023-10-08T07:07:09.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.939e-06 2023-10-08T07:07:09.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.629 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.629 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64335 4.38 e52/46 4:1e0977c7:::10000000004.00000022:head v 52'1026, mlcod=52'1024)", 2023-10-08T07:07:09.629 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.447618+0000", 2023-10-08T07:07:09.629 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9988451, 2023-10-08T07:07:09.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001879426, 2023-10-08T07:07:09.630 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.630 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.630 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447618+0000", 2023-10-08T07:07:09.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447618+0000", 2023-10-08T07:07:09.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447619+0000", 2023-10-08T07:07:09.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8500000000000001e-07 2023-10-08T07:07:09.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447632+0000", 2023-10-08T07:07:09.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3842000000000001e-05 2023-10-08T07:07:09.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447645+0000", 2023-10-08T07:07:09.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2023-10-08T07:07:09.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447653+0000", 2023-10-08T07:07:09.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1099999999999997e-06 2023-10-08T07:07:09.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447699+0000", 2023-10-08T07:07:09.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6387999999999997e-05 2023-10-08T07:07:09.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447719+0000", 2023-10-08T07:07:09.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9964000000000001e-05 2023-10-08T07:07:09.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.633 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.634 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64301 4.19 4:9a1dab10:::10000000004.0000001d:head [write 2953216~4096 in=4096b,write 3088384~4096 in=4096b,write 3203072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.634 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.436535+0000", 2023-10-08T07:07:09.634 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.009927455, 2023-10-08T07:07:09.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013018736, 2023-10-08T07:07:09.634 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.634 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.634 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64301 2023-10-08T07:07:09.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.635 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.436535+0000", 2023-10-08T07:07:09.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.436535+0000", 2023-10-08T07:07:09.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.436536+0000", 2023-10-08T07:07:09.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8299999999999995e-07 2023-10-08T07:07:09.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.436548+0000", 2023-10-08T07:07:09.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2001000000000001e-05 2023-10-08T07:07:09.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.436559+0000", 2023-10-08T07:07:09.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0417999999999999e-05 2023-10-08T07:07:09.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.436566+0000", 2023-10-08T07:07:09.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6020000000000002e-06 2023-10-08T07:07:09.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443880+0000", 2023-10-08T07:07:09.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073134630000000001 2023-10-08T07:07:09.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.443953+0000", 2023-10-08T07:07:09.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2688999999999995e-05 2023-10-08T07:07:09.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.638 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.638 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64338 4.7 4.b7910b47 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.639 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.447751+0000", 2023-10-08T07:07:09.639 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9987116, 2023-10-08T07:07:09.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001854409, 2023-10-08T07:07:09.639 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.639 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:09.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.639 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64338 2023-10-08T07:07:09.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.639 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447751+0000", 2023-10-08T07:07:09.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447751+0000", 2023-10-08T07:07:09.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447752+0000", 2023-10-08T07:07:09.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.85e-07 2023-10-08T07:07:09.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447796+0000", 2023-10-08T07:07:09.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3290000000000001e-05 2023-10-08T07:07:09.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447806+0000", 2023-10-08T07:07:09.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9410000000000002e-06 2023-10-08T07:07:09.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.447813+0000", 2023-10-08T07:07:09.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.233e-06 2023-10-08T07:07:09.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.642 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.642 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64302 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3682304~4096 in=4096b,write 3764224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.643 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.436985+0000", 2023-10-08T07:07:09.643 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0094774279999999995, 2023-10-08T07:07:09.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012662609, 2023-10-08T07:07:09.643 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.643 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.643 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64302 2023-10-08T07:07:09.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.643 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.436985+0000", 2023-10-08T07:07:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.436985+0000", 2023-10-08T07:07:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.436986+0000", 2023-10-08T07:07:09.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:07:09.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.436995+0000", 2023-10-08T07:07:09.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2579999999999995e-06 2023-10-08T07:07:09.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437001+0000", 2023-10-08T07:07:09.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9929999999999998e-06 2023-10-08T07:07:09.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437006+0000", 2023-10-08T07:07:09.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2023-10-08T07:07:09.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439335+0000", 2023-10-08T07:07:09.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023290979999999999 2023-10-08T07:07:09.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439424+0000", 2023-10-08T07:07:09.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8391000000000001e-05 2023-10-08T07:07:09.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.647 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.647 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64340 4.7 4.db317c87 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.647 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.448005+0000", 2023-10-08T07:07:09.647 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9984579, 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016994639999999999, 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64340 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448005+0000", 2023-10-08T07:07:09.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448005+0000", 2023-10-08T07:07:09.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448006+0000", 2023-10-08T07:07:09.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6300000000000005e-07 2023-10-08T07:07:09.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448126+0000", 2023-10-08T07:07:09.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012054599999999999 2023-10-08T07:07:09.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448135+0000", 2023-10-08T07:07:09.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4889999999999995e-06 2023-10-08T07:07:09.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448141+0000", 2023-10-08T07:07:09.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4540000000000004e-06 2023-10-08T07:07:09.651 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.651 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.651 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.651 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64303 4.3b 4:df0e4bf8:::10000000004.00000018:head [write 2768896~4096 in=4096b,write 2822144~4096 in=4096b,write 2834432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.651 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.437187+0000", 2023-10-08T07:07:09.651 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0092763189999999999, 2023-10-08T07:07:09.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012601518000000001, 2023-10-08T07:07:09.652 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.652 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.652 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64303 2023-10-08T07:07:09.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.652 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437187+0000", 2023-10-08T07:07:09.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437187+0000", 2023-10-08T07:07:09.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437187+0000", 2023-10-08T07:07:09.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8899999999999999e-07 2023-10-08T07:07:09.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437204+0000", 2023-10-08T07:07:09.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7101000000000001e-05 2023-10-08T07:07:09.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437211+0000", 2023-10-08T07:07:09.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6889999999999998e-06 2023-10-08T07:07:09.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437216+0000", 2023-10-08T07:07:09.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3879999999999999e-06 2023-10-08T07:07:09.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437252+0000", 2023-10-08T07:07:09.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6128999999999999e-05 2023-10-08T07:07:09.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437308+0000", 2023-10-08T07:07:09.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5562000000000001e-05 2023-10-08T07:07:09.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.656 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.656 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64332 4.30 e52/17 4:0f322a22:::10000000004.00000014:head v 52'1010, mlcod=52'1008)", 2023-10-08T07:07:09.656 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.448123+0000", 2023-10-08T07:07:09.656 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9983397, 2023-10-08T07:07:09.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001716476, 2023-10-08T07:07:09.656 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.656 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.656 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448123+0000", 2023-10-08T07:07:09.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448123+0000", 2023-10-08T07:07:09.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448124+0000", 2023-10-08T07:07:09.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2023-10-08T07:07:09.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448259+0000", 2023-10-08T07:07:09.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013478700000000001 2023-10-08T07:07:09.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448267+0000", 2023-10-08T07:07:09.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3359999999999995e-06 2023-10-08T07:07:09.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448274+0000", 2023-10-08T07:07:09.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9439999999999999e-06 2023-10-08T07:07:09.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448320+0000", 2023-10-08T07:07:09.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6492000000000001e-05 2023-10-08T07:07:09.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448340+0000", 2023-10-08T07:07:09.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9680000000000001e-05 2023-10-08T07:07:09.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.660 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.660 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64304 4.14 4:2b72a8af:::10000000004.0000000c:head [write 1114112~4096 in=4096b,write 1200128~4096 in=4096b,write 1581056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.660 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.437546+0000", 2023-10-08T07:07:09.661 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0089166909999999992, 2023-10-08T07:07:09.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012339790999999999, 2023-10-08T07:07:09.661 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.661 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.661 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64304 2023-10-08T07:07:09.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.661 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437546+0000", 2023-10-08T07:07:09.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437546+0000", 2023-10-08T07:07:09.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437547+0000", 2023-10-08T07:07:09.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9599999999999998e-07 2023-10-08T07:07:09.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437558+0000", 2023-10-08T07:07:09.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0662000000000001e-05 2023-10-08T07:07:09.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437567+0000", 2023-10-08T07:07:09.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4080000000000004e-06 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437574+0000", 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6490000000000002e-06 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445009+0000", 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074352890000000003 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.445092+0000", 2023-10-08T07:07:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3187000000000002e-05 2023-10-08T07:07:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64343 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.448252+0000", 2023-10-08T07:07:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9982104, 2023-10-08T07:07:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001691438, 2023-10-08T07:07:09.665 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64343 2023-10-08T07:07:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448252+0000", 2023-10-08T07:07:09.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448252+0000", 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448259+0000", 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6610000000000003e-06 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448417+0000", 2023-10-08T07:07:09.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015757100000000001 2023-10-08T07:07:09.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448425+0000", 2023-10-08T07:07:09.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7660000000000004e-06 2023-10-08T07:07:09.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448434+0000", 2023-10-08T07:07:09.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7960000000000001e-06 2023-10-08T07:07:09.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.669 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.669 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64271 4.7 4:e2d089ed:::10000000004.00000033:head [write 380928~4096 in=4096b,write 471040~4096 in=4096b,write 753664~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.669 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.426708+0000", 2023-10-08T07:07:09.669 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.019754872, 2023-10-08T07:07:09.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023304794, 2023-10-08T07:07:09.669 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.669 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.670 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64271 2023-10-08T07:07:09.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.670 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.426708+0000", 2023-10-08T07:07:09.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.426708+0000", 2023-10-08T07:07:09.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.426709+0000", 2023-10-08T07:07:09.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0699999999999996e-07 2023-10-08T07:07:09.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.426721+0000", 2023-10-08T07:07:09.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1769e-05 2023-10-08T07:07:09.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.426731+0000", 2023-10-08T07:07:09.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9850000000000001e-06 2023-10-08T07:07:09.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.426738+0000", 2023-10-08T07:07:09.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:07:09.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432298+0000", 2023-10-08T07:07:09.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055605400000000001 2023-10-08T07:07:09.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.432385+0000", 2023-10-08T07:07:09.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6209000000000001e-05 2023-10-08T07:07:09.673 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.673 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.673 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.674 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64305 4.21 4:867af9ba:::10000000004.0000000a:head [write 1785856~8192 in=8192b,write 2007040~4096 in=4096b,write 2023424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.674 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.437818+0000", 2023-10-08T07:07:09.674 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0086444480000000008, 2023-10-08T07:07:09.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012263942, 2023-10-08T07:07:09.674 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.674 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.674 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.674 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.674 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.674 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64305 2023-10-08T07:07:09.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.675 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437818+0000", 2023-10-08T07:07:09.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437818+0000", 2023-10-08T07:07:09.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437819+0000", 2023-10-08T07:07:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2900000000000003e-07 2023-10-08T07:07:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437846+0000", 2023-10-08T07:07:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6732000000000001e-05 2023-10-08T07:07:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437856+0000", 2023-10-08T07:07:09.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0606e-05 2023-10-08T07:07:09.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.437864+0000", 2023-10-08T07:07:09.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8939999999999993e-06 2023-10-08T07:07:09.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.446004+0000", 2023-10-08T07:07:09.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081394859999999996 2023-10-08T07:07:09.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.446088+0000", 2023-10-08T07:07:09.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3656e-05 2023-10-08T07:07:09.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.678 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.678 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64344 4.15 4:a88808fa:::10000000004.0000001f:head [write 4112384~4096 in=4096b,write 4153344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.678 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.448445+0000", 2023-10-08T07:07:09.679 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9980178, 2023-10-08T07:07:09.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001706094, 2023-10-08T07:07:09.679 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.679 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.679 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64344 2023-10-08T07:07:09.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.679 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448445+0000", 2023-10-08T07:07:09.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448445+0000", 2023-10-08T07:07:09.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448446+0000", 2023-10-08T07:07:09.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9800000000000003e-07 2023-10-08T07:07:09.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448460+0000", 2023-10-08T07:07:09.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3633e-05 2023-10-08T07:07:09.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448467+0000", 2023-10-08T07:07:09.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5209999999999997e-06 2023-10-08T07:07:09.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448474+0000", 2023-10-08T07:07:09.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.545e-06 2023-10-08T07:07:09.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448508+0000", 2023-10-08T07:07:09.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4873000000000003e-05 2023-10-08T07:07:09.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448583+0000", 2023-10-08T07:07:09.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4476999999999999e-05 2023-10-08T07:07:09.683 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.683 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.683 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.683 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64272 4.7 4:e13e8cdb:::10000000004.00000028:head [write 3465216~4096 in=4096b,write 3497984~4096 in=4096b,write 3563520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.683 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.427014+0000", 2023-10-08T07:07:09.683 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.019449332999999999, 2023-10-08T07:07:09.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023207966999999999, 2023-10-08T07:07:09.684 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.684 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.684 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.684 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.684 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.684 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64272 2023-10-08T07:07:09.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.684 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427014+0000", 2023-10-08T07:07:09.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427014+0000", 2023-10-08T07:07:09.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427014+0000", 2023-10-08T07:07:09.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9299999999999997e-07 2023-10-08T07:07:09.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427050+0000", 2023-10-08T07:07:09.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5256999999999998e-05 2023-10-08T07:07:09.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427060+0000", 2023-10-08T07:07:09.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0803e-05 2023-10-08T07:07:09.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427067+0000", 2023-10-08T07:07:09.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6579999999999996e-06 2023-10-08T07:07:09.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435666+0000", 2023-10-08T07:07:09.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085994230000000001 2023-10-08T07:07:09.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435757+0000", 2023-10-08T07:07:09.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0105000000000006e-05 2023-10-08T07:07:09.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.688 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.688 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64342 4.3a e52/17 4:5d52ad5e:::10000000004.00000026:head v 52'2956, mlcod=52'2953)", 2023-10-08T07:07:09.688 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.449262+0000", 2023-10-08T07:07:09.688 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9972005, 2023-10-08T07:07:09.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010249429999999999, 2023-10-08T07:07:09.688 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.689 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.689 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.449262+0000", 2023-10-08T07:07:09.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.449262+0000", 2023-10-08T07:07:09.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.449263+0000", 2023-10-08T07:07:09.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8800000000000002e-07 2023-10-08T07:07:09.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.449275+0000", 2023-10-08T07:07:09.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1921e-05 2023-10-08T07:07:09.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.449284+0000", 2023-10-08T07:07:09.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1390000000000001e-06 2023-10-08T07:07:09.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.449294+0000", 2023-10-08T07:07:09.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0399e-05 2023-10-08T07:07:09.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.449354+0000", 2023-10-08T07:07:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9960000000000002e-05 2023-10-08T07:07:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.449373+0000", 2023-10-08T07:07:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8464000000000001e-05 2023-10-08T07:07:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64345 4.9 4.be6d1a49 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.693 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.448483+0000", 2023-10-08T07:07:09.693 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9979796, 2023-10-08T07:07:09.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018739220000000001, 2023-10-08T07:07:09.693 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.693 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:09.693 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.693 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.693 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.693 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64345 2023-10-08T07:07:09.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.693 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448483+0000", 2023-10-08T07:07:09.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448483+0000", 2023-10-08T07:07:09.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.448484+0000", 2023-10-08T07:07:09.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0900000000000001e-07 2023-10-08T07:07:09.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.449676+0000", 2023-10-08T07:07:09.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001191786 2023-10-08T07:07:09.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.449686+0000", 2023-10-08T07:07:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0747000000000001e-05 2023-10-08T07:07:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.449695+0000", 2023-10-08T07:07:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.081e-06 2023-10-08T07:07:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.696 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64274 4.15 4:a88808fa:::10000000004.0000001f:head [write 884736~4096 in=4096b,write 1294336~4096 in=4096b,write 1355776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.427899+0000", 2023-10-08T07:07:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018563525000000001, 2023-10-08T07:07:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022518415, 2023-10-08T07:07:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64274 2023-10-08T07:07:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427899+0000", 2023-10-08T07:07:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427899+0000", 2023-10-08T07:07:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427900+0000", 2023-10-08T07:07:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8800000000000002e-07 2023-10-08T07:07:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427913+0000", 2023-10-08T07:07:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2424e-05 2023-10-08T07:07:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427923+0000", 2023-10-08T07:07:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0207000000000001e-05 2023-10-08T07:07:09.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.427930+0000", 2023-10-08T07:07:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2219999999999996e-06 2023-10-08T07:07:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435271+0000", 2023-10-08T07:07:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007341462 2023-10-08T07:07:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.435386+0000", 2023-10-08T07:07:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011453799999999999 2023-10-08T07:07:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64307 4.1b e52/17 4:dbb7dde6:::10000000004.0000002c:head v 52'1988, mlcod=52'1986)", 2023-10-08T07:07:09.701 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.438929+0000", 2023-10-08T07:07:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0075342819999999998, 2023-10-08T07:07:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011569516, 2023-10-08T07:07:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.438929+0000", 2023-10-08T07:07:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.438929+0000", 2023-10-08T07:07:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.438929+0000", 2023-10-08T07:07:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4000000000000002e-07 2023-10-08T07:07:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.438943+0000", 2023-10-08T07:07:09.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3729e-05 2023-10-08T07:07:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.438951+0000", 2023-10-08T07:07:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0160000000000008e-06 2023-10-08T07:07:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.438958+0000", 2023-10-08T07:07:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1210000000000001e-06 2023-10-08T07:07:09.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439023+0000", 2023-10-08T07:07:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4951999999999997e-05 2023-10-08T07:07:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439042+0000", 2023-10-08T07:07:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9454e-05 2023-10-08T07:07:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:64308 4.7 4:e13e8cdb:::10000000004.00000028:head [write 1904640~4096 in=4096b,write 2011136~4096 in=4096b,write 2080768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.439034+0000", 2023-10-08T07:07:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0074286389999999999, 2023-10-08T07:07:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011566836, 2023-10-08T07:07:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:09.706 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 64308 2023-10-08T07:07:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439034+0000", 2023-10-08T07:07:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439034+0000", 2023-10-08T07:07:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439035+0000", 2023-10-08T07:07:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2999999999999999e-07 2023-10-08T07:07:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439045+0000", 2023-10-08T07:07:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0198e-05 2023-10-08T07:07:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439055+0000", 2023-10-08T07:07:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8949999999999993e-06 2023-10-08T07:07:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.439062+0000", 2023-10-08T07:07:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4370000000000004e-06 2023-10-08T07:07:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442641+0000", 2023-10-08T07:07:09.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035797899999999998 2023-10-08T07:07:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.442731+0000", 2023-10-08T07:07:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9425999999999994e-05 2023-10-08T07:07:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:64310 4.3a e52/17 4:5f183e4b:::10000000004.00000023:head v 52'2955, mlcod=52'2953)", 2023-10-08T07:07:09.710 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:09.440066+0000", 2023-10-08T07:07:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0063971710000000001, 2023-10-08T07:07:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010617503, 2023-10-08T07:07:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440066+0000", 2023-10-08T07:07:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440066+0000", 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440066+0000", 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7199999999999999e-07 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440081+0000", 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4994000000000001e-05 2023-10-08T07:07:09.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440090+0000", 2023-10-08T07:07:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2e-06 2023-10-08T07:07:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440097+0000", 2023-10-08T07:07:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7880000000000001e-06 2023-10-08T07:07:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440172+0000", 2023-10-08T07:07:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4315999999999998e-05 2023-10-08T07:07:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:09.440189+0000", 2023-10-08T07:07:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7566000000000001e-05 2023-10-08T07:07:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:09.714 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:09.715 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 55 2023-10-08T07:07:09.715 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:09.715 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:09.716 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:09.715+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:09.718 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:09.817 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:09.815+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:09.906 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:09.917 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:09.916+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:09.931 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:09.931 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:09.931 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:09.932 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:09.934 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:09.934 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:09.944 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:09.944 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:09.959 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:10.045 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:10.044+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:10.119 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:10.118+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:10.196 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:10.196 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:10.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:10.256 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:10.255+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:10.321 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:10.320+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:10.408 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:10.408 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:10.423 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:10.421+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:10.424 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:10.524 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:10.523+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:10.624 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:10.623+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:10.645 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:10.645 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:10.659 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:10.743 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:10.742+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:10.826 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:10.825+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:10.889 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:10.889 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:10.903 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:10.944 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:10.943+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:10.986 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:07:11.029 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:11.028+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:11.095 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:11.095 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:11.095 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-10-08T07:07:11.111 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:11.129 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:11.128+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:11.196 INFO:teuthology.orchestra.console.smithi086:Power on completed 2023-10-08T07:07:11.230 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:11.229+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:11.265 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T07:07:11.297 DEBUG:teuthology.orchestra.console.smithi086:Waiting for login prompt 2023-10-08T07:07:11.297 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi086 2023-10-08T07:07:11.309 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:11.309 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:11.321 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:11.362 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:11.361+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:11.435 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:11.434+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:11.538 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:11.535+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:11.538 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:11.539 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:11.557 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:11.637 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:11.636+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:11.738 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:11.737+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:11.748 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:11.748 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:11.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:11.839 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:11.838+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:11.935 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:07:11.940 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:11.939+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:12.010 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:12.042 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:12.040+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:12.105 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:12.130 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:07:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:12.131 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:07:12.133 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:12.133 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:12.143 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:12.142+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:12.204 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:48492 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 2052096~4096,write 2113536~4096,write 2158592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:12.205 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:03.611986+0000", 2023-10-08T07:07:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.5890905209999993, 2023-10-08T07:07:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024276833000000001, 2023-10-08T07:07:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.206 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 48492 2023-10-08T07:07:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611986+0000", 2023-10-08T07:07:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611986+0000", 2023-10-08T07:07:12.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611987+0000", 2023-10-08T07:07:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7000000000000004e-07 2023-10-08T07:07:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.611995+0000", 2023-10-08T07:07:12.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2719999999999997e-06 2023-10-08T07:07:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612003+0000", 2023-10-08T07:07:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2710000000000003e-06 2023-10-08T07:07:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612009+0000", 2023-10-08T07:07:12.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1689999999999997e-06 2023-10-08T07:07:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612063+0000", 2023-10-08T07:07:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4608999999999998e-05 2023-10-08T07:07:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612153+0000", 2023-10-08T07:07:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9269000000000002e-05 2023-10-08T07:07:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612333+0000", 2023-10-08T07:07:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000179944 2023-10-08T07:07:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.616694+0000", 2023-10-08T07:07:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004361658 2023-10-08T07:07:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636189+0000", 2023-10-08T07:07:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019494880999999999 2023-10-08T07:07:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636232+0000", 2023-10-08T07:07:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2500000000000003e-05 2023-10-08T07:07:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636263+0000", 2023-10-08T07:07:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1590000000000001e-05 2023-10-08T07:07:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.214 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:48494 4.2b 4:d7a77d67:::10000000004.00000029:head [write 3076096~4096,write 3215360~4096,write 3485696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-10-08T07:07:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:03.612886+0000", 2023-10-08T07:07:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.5881914110000004, 2023-10-08T07:07:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023426592999999999, 2023-10-08T07:07:12.215 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.216 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 48494 2023-10-08T07:07:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612886+0000", 2023-10-08T07:07:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612886+0000", 2023-10-08T07:07:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612886+0000", 2023-10-08T07:07:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4499999999999997e-07 2023-10-08T07:07:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612896+0000", 2023-10-08T07:07:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.329e-06 2023-10-08T07:07:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612906+0000", 2023-10-08T07:07:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0631e-05 2023-10-08T07:07:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.612912+0000", 2023-10-08T07:07:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4840000000000003e-06 2023-10-08T07:07:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.613623+0000", 2023-10-08T07:07:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00071140600000000004 2023-10-08T07:07:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.613673+0000", 2023-10-08T07:07:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0259000000000001e-05 2023-10-08T07:07:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.613770+0000", 2023-10-08T07:07:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6984999999999994e-05 2023-10-08T07:07:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.617057+0000", 2023-10-08T07:07:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003287192 2023-10-08T07:07:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636213+0000", 2023-10-08T07:07:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019155798000000002 2023-10-08T07:07:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636274+0000", 2023-10-08T07:07:12.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0639e-05 2023-10-08T07:07:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:03.636312+0000", 2023-10-08T07:07:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8225000000000001e-05 2023-10-08T07:07:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.223 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:59756 4.20 4:05b3915c:::10000000004.00000016:head [write 2002944~4096,write 2453504~4096,write 2490368~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:07.776189+0000", 2023-10-08T07:07:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.424888299, 2023-10-08T07:07:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.031212054999999999, 2023-10-08T07:07:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 59756 2023-10-08T07:07:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.776189+0000", 2023-10-08T07:07:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.776189+0000", 2023-10-08T07:07:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.225 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.776189+0000", 2023-10-08T07:07:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3099999999999997e-07 2023-10-08T07:07:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.776202+0000", 2023-10-08T07:07:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2768999999999999e-05 2023-10-08T07:07:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.226 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.776216+0000", 2023-10-08T07:07:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4132e-05 2023-10-08T07:07:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.776224+0000", 2023-10-08T07:07:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2810000000000003e-06 2023-10-08T07:07:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.777666+0000", 2023-10-08T07:07:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0014421900000000001 2023-10-08T07:07:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.777757+0000", 2023-10-08T07:07:12.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0841000000000007e-05 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.777915+0000", 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000157954 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.780221+0000", 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0023064050000000001 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.229 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807270+0000", 2023-10-08T07:07:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027049281000000001 2023-10-08T07:07:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807359+0000", 2023-10-08T07:07:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9104000000000006e-05 2023-10-08T07:07:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807401+0000", 2023-10-08T07:07:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1366999999999999e-05 2023-10-08T07:07:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:59774 4.20 4:04004f2c:::10000000004.0000000d:head [write 3502080~4096,write 3510272~4096,write 3727360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:07.782396+0000", 2023-10-08T07:07:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.418681115, 2023-10-08T07:07:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.025220902999999999, 2023-10-08T07:07:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.231 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 59774 2023-10-08T07:07:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782396+0000", 2023-10-08T07:07:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782396+0000", 2023-10-08T07:07:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782397+0000", 2023-10-08T07:07:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.71e-07 2023-10-08T07:07:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.233 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782408+0000", 2023-10-08T07:07:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1208e-05 2023-10-08T07:07:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782420+0000", 2023-10-08T07:07:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2449000000000001e-05 2023-10-08T07:07:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782431+0000", 2023-10-08T07:07:12.234 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0798999999999999e-05 2023-10-08T07:07:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782481+0000", 2023-10-08T07:07:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9601000000000002e-05 2023-10-08T07:07:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782537+0000", 2023-10-08T07:07:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6678999999999997e-05 2023-10-08T07:07:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.782648+0000", 2023-10-08T07:07:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000110467 2023-10-08T07:07:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785684+0000", 2023-10-08T07:07:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0030359670000000001 2023-10-08T07:07:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807502+0000", 2023-10-08T07:07:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021818626000000001 2023-10-08T07:07:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807573+0000", 2023-10-08T07:07:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0927999999999996e-05 2023-10-08T07:07:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807617+0000", 2023-10-08T07:07:12.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3307999999999999e-05 2023-10-08T07:07:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:59776 4.20 4:07572838:::10000000004.00000010:head [write 1818624~4096,write 1900544~4096,write 1978368~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:07.783175+0000", 2023-10-08T07:07:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4179020260000001, 2023-10-08T07:07:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024626939, 2023-10-08T07:07:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.238 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 59776 2023-10-08T07:07:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783175+0000", 2023-10-08T07:07:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783175+0000", 2023-10-08T07:07:12.240 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783176+0000", 2023-10-08T07:07:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7100000000000001e-07 2023-10-08T07:07:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783192+0000", 2023-10-08T07:07:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6707000000000001e-05 2023-10-08T07:07:12.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783203+0000", 2023-10-08T07:07:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0995000000000001e-05 2023-10-08T07:07:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783212+0000", 2023-10-08T07:07:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9150000000000002e-06 2023-10-08T07:07:12.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783841+0000", 2023-10-08T07:07:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00062854000000000002 2023-10-08T07:07:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.783920+0000", 2023-10-08T07:07:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8887000000000006e-05 2023-10-08T07:07:12.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.784096+0000", 2023-10-08T07:07:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000175885 2023-10-08T07:07:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.787210+0000", 2023-10-08T07:07:12.244 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031141630000000001 2023-10-08T07:07:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807671+0000", 2023-10-08T07:07:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020461081999999998 2023-10-08T07:07:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807759+0000", 2023-10-08T07:07:12.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8012999999999999e-05 2023-10-08T07:07:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807802+0000", 2023-10-08T07:07:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3081000000000003e-05 2023-10-08T07:07:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.246 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:59784 4.20 4:07572838:::10000000004.00000010:head [write 3723264~4096,write 3764224~4096,write 3825664~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:07.785654+0000", 2023-10-08T07:07:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4154231700000004, 2023-10-08T07:07:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022246847, 2023-10-08T07:07:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 59784 2023-10-08T07:07:12.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785654+0000", 2023-10-08T07:07:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785654+0000", 2023-10-08T07:07:12.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785654+0000", 2023-10-08T07:07:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9699999999999995e-07 2023-10-08T07:07:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785669+0000", 2023-10-08T07:07:12.249 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4403000000000001e-05 2023-10-08T07:07:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785685+0000", 2023-10-08T07:07:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5977e-05 2023-10-08T07:07:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785692+0000", 2023-10-08T07:07:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5490000000000001e-06 2023-10-08T07:07:12.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785740+0000", 2023-10-08T07:07:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7799000000000001e-05 2023-10-08T07:07:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785806+0000", 2023-10-08T07:07:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5518999999999994e-05 2023-10-08T07:07:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.251 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.785934+0000", 2023-10-08T07:07:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000128477 2023-10-08T07:07:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.792748+0000", 2023-10-08T07:07:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0068142130000000004 2023-10-08T07:07:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807844+0000", 2023-10-08T07:07:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015095188000000001 2023-10-08T07:07:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807879+0000", 2023-10-08T07:07:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5200000000000002e-05 2023-10-08T07:07:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:07.807901+0000", 2023-10-08T07:07:12.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1824999999999999e-05 2023-10-08T07:07:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:60827 4.30 4:0f322a22:::10000000004.00000014:head [write 507904~4096,write 786432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:08.150981+0000", 2023-10-08T07:07:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.0500954839999999, 2023-10-08T07:07:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024981400000000001, 2023-10-08T07:07:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.254 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 60827 2023-10-08T07:07:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.150981+0000", 2023-10-08T07:07:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.150981+0000", 2023-10-08T07:07:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.150982+0000", 2023-10-08T07:07:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9500000000000002e-07 2023-10-08T07:07:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.150990+0000", 2023-10-08T07:07:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0940000000000008e-06 2023-10-08T07:07:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.151001+0000", 2023-10-08T07:07:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0691e-05 2023-10-08T07:07:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.257 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.151007+0000", 2023-10-08T07:07:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6370000000000004e-06 2023-10-08T07:07:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.151951+0000", 2023-10-08T07:07:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000944684 2023-10-08T07:07:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.152025+0000", 2023-10-08T07:07:12.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3832999999999996e-05 2023-10-08T07:07:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.152177+0000", 2023-10-08T07:07:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015178899999999999 2023-10-08T07:07:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.158267+0000", 2023-10-08T07:07:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060902200000000004 2023-10-08T07:07:12.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.175908+0000", 2023-10-08T07:07:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017640876 2023-10-08T07:07:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.175941+0000", 2023-10-08T07:07:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3197000000000001e-05 2023-10-08T07:07:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.175963+0000", 2023-10-08T07:07:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1684000000000001e-05 2023-10-08T07:07:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:60833 4.20 4:07572838:::10000000004.00000010:head [write 2863104~4096,write 3026944~4096,write 3301376~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-10-08T07:07:12.261 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:08.153455+0000", 2023-10-08T07:07:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.0476223229999997, 2023-10-08T07:07:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022554904000000001, 2023-10-08T07:07:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 60833 2023-10-08T07:07:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.262 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153455+0000", 2023-10-08T07:07:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153455+0000", 2023-10-08T07:07:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153455+0000", 2023-10-08T07:07:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4900000000000005e-07 2023-10-08T07:07:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153465+0000", 2023-10-08T07:07:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0074e-05 2023-10-08T07:07:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.264 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153477+0000", 2023-10-08T07:07:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1368e-05 2023-10-08T07:07:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153482+0000", 2023-10-08T07:07:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2909999999999998e-06 2023-10-08T07:07:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.265 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153524+0000", 2023-10-08T07:07:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2076999999999997e-05 2023-10-08T07:07:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153571+0000", 2023-10-08T07:07:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7252000000000001e-05 2023-10-08T07:07:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.153667+0000", 2023-10-08T07:07:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5444000000000003e-05 2023-10-08T07:07:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.160221+0000", 2023-10-08T07:07:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065544560000000002 2023-10-08T07:07:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.175931+0000", 2023-10-08T07:07:12.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015709813 2023-10-08T07:07:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.175979+0000", 2023-10-08T07:07:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7710000000000002e-05 2023-10-08T07:07:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:08.176010+0000", 2023-10-08T07:07:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.0670000000000003e-05 2023-10-08T07:07:12.268 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:63784 4.2b 4:d7a77d67:::10000000004.00000029:head [write 2379776~4096,write 2564096~4096,write 2748416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.255100+0000", 2023-10-08T07:07:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.9459767700000001, 2023-10-08T07:07:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037549842999999999, 2023-10-08T07:07:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.269 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 63784 2023-10-08T07:07:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255100+0000", 2023-10-08T07:07:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255100+0000", 2023-10-08T07:07:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255101+0000", 2023-10-08T07:07:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5300000000000004e-07 2023-10-08T07:07:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255111+0000", 2023-10-08T07:07:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0002e-05 2023-10-08T07:07:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255121+0000", 2023-10-08T07:07:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0488e-05 2023-10-08T07:07:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255126+0000", 2023-10-08T07:07:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1250000000000001e-06 2023-10-08T07:07:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255172+0000", 2023-10-08T07:07:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5133000000000003e-05 2023-10-08T07:07:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.273 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255271+0000", 2023-10-08T07:07:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9729999999999996e-05 2023-10-08T07:07:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255463+0000", 2023-10-08T07:07:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000191807 2023-10-08T07:07:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.274 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.259736+0000", 2023-10-08T07:07:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042731959999999999 2023-10-08T07:07:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.292524+0000", 2023-10-08T07:07:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032787281000000001 2023-10-08T07:07:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.292593+0000", 2023-10-08T07:07:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8997000000000004e-05 2023-10-08T07:07:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.292650+0000", 2023-10-08T07:07:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7431e-05 2023-10-08T07:07:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.276 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:63787 4.20 4:07572838:::10000000004.00000010:head [write 1835008~4096,write 1966080~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.255951+0000", 2023-10-08T07:07:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.945125682, 2023-10-08T07:07:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026686237000000002, 2023-10-08T07:07:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.277 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 63787 2023-10-08T07:07:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255951+0000", 2023-10-08T07:07:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255951+0000", 2023-10-08T07:07:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255952+0000", 2023-10-08T07:07:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9400000000000004e-07 2023-10-08T07:07:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255965+0000", 2023-10-08T07:07:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3335e-05 2023-10-08T07:07:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255979+0000", 2023-10-08T07:07:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3703000000000001e-05 2023-10-08T07:07:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255988+0000", 2023-10-08T07:07:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.952e-06 2023-10-08T07:07:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256044+0000", 2023-10-08T07:07:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5554999999999999e-05 2023-10-08T07:07:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256134+0000", 2023-10-08T07:07:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0047e-05 2023-10-08T07:07:12.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256302+0000", 2023-10-08T07:07:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016839099999999999 2023-10-08T07:07:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.259703+0000", 2023-10-08T07:07:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0034012080000000002 2023-10-08T07:07:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.282542+0000", 2023-10-08T07:07:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022838461000000001 2023-10-08T07:07:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.282597+0000", 2023-10-08T07:07:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4871999999999999e-05 2023-10-08T07:07:12.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.282637+0000", 2023-10-08T07:07:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0818999999999997e-05 2023-10-08T07:07:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:63789 4.1b 4:d97fb168:::10000000004.00000008:head [write 602112~4096,write 712704~4096,write 831488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.256522+0000", 2023-10-08T07:07:12.284 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.9445548820000003, 2023-10-08T07:07:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.036945542999999997, 2023-10-08T07:07:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 63789 2023-10-08T07:07:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256522+0000", 2023-10-08T07:07:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256522+0000", 2023-10-08T07:07:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256523+0000", 2023-10-08T07:07:12.286 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6299999999999993e-07 2023-10-08T07:07:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256539+0000", 2023-10-08T07:07:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5999999999999999e-05 2023-10-08T07:07:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256549+0000", 2023-10-08T07:07:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0462000000000001e-05 2023-10-08T07:07:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256557+0000", 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.345e-06 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256637+0000", 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9764000000000004e-05 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256716+0000", 2023-10-08T07:07:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8944999999999997e-05 2023-10-08T07:07:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256825+0000", 2023-10-08T07:07:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000109033 2023-10-08T07:07:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.259676+0000", 2023-10-08T07:07:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0028511869999999998 2023-10-08T07:07:12.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.293346+0000", 2023-10-08T07:07:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033669957 2023-10-08T07:07:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.293402+0000", 2023-10-08T07:07:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6314999999999999e-05 2023-10-08T07:07:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.293468+0000", 2023-10-08T07:07:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5572000000000002e-05 2023-10-08T07:07:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:63790 4.2b 4:d7a77d67:::10000000004.00000029:head [write 3555328~4096,write 3739648~4096,write 3805184~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.256889+0000", 2023-10-08T07:07:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.9441877669999998, 2023-10-08T07:07:12.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.036532685000000002, 2023-10-08T07:07:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 63790 2023-10-08T07:07:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256889+0000", 2023-10-08T07:07:12.292 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256889+0000", 2023-10-08T07:07:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256890+0000", 2023-10-08T07:07:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6199999999999997e-07 2023-10-08T07:07:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256906+0000", 2023-10-08T07:07:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6073999999999999e-05 2023-10-08T07:07:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256917+0000", 2023-10-08T07:07:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1106e-05 2023-10-08T07:07:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.256940+0000", 2023-10-08T07:07:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3033000000000001e-05 2023-10-08T07:07:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.257062+0000", 2023-10-08T07:07:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000121886 2023-10-08T07:07:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.257146+0000", 2023-10-08T07:07:12.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3700000000000002e-05 2023-10-08T07:07:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.257319+0000", 2023-10-08T07:07:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017285400000000001 2023-10-08T07:07:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.259760+0000", 2023-10-08T07:07:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0024414390000000001 2023-10-08T07:07:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.293355+0000", 2023-10-08T07:07:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033595446000000001 2023-10-08T07:07:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.293390+0000", 2023-10-08T07:07:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4699000000000001e-05 2023-10-08T07:07:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.293422+0000", 2023-10-08T07:07:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1686000000000001e-05 2023-10-08T07:07:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:63844 4.20 4:07572838:::10000000004.00000010:head [write 3932160~4096,write 3964928~4096,write 4026368~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.274890+0000", 2023-10-08T07:07:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.9261870829999999, 2023-10-08T07:07:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024770156000000002, 2023-10-08T07:07:12.298 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 63844 2023-10-08T07:07:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.274890+0000", 2023-10-08T07:07:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.274890+0000", 2023-10-08T07:07:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.274891+0000", 2023-10-08T07:07:12.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3900000000000004e-07 2023-10-08T07:07:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.274935+0000", 2023-10-08T07:07:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4224000000000002e-05 2023-10-08T07:07:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.274945+0000", 2023-10-08T07:07:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.696e-06 2023-10-08T07:07:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.274951+0000", 2023-10-08T07:07:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2199999999999997e-06 2023-10-08T07:07:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.275008+0000", 2023-10-08T07:07:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7231000000000001e-05 2023-10-08T07:07:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.275100+0000", 2023-10-08T07:07:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2516000000000007e-05 2023-10-08T07:07:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.275310+0000", 2023-10-08T07:07:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000209545 2023-10-08T07:07:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.278447+0000", 2023-10-08T07:07:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031374319999999999 2023-10-08T07:07:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.299561+0000", 2023-10-08T07:07:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021113432000000001 2023-10-08T07:07:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.299615+0000", 2023-10-08T07:07:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4227000000000001e-05 2023-10-08T07:07:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.299660+0000", 2023-10-08T07:07:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4894000000000001e-05 2023-10-08T07:07:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:63845 4.20 4:04004f2c:::10000000004.0000000d:head [write 626688~4096,write 1163264~4096,write 1384448~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.275176+0000", 2023-10-08T07:07:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.9259004530000001, 2023-10-08T07:07:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024611023999999999, 2023-10-08T07:07:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 63845 2023-10-08T07:07:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.275176+0000", 2023-10-08T07:07:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.275176+0000", 2023-10-08T07:07:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.275177+0000", 2023-10-08T07:07:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3300000000000001e-07 2023-10-08T07:07:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.275221+0000", 2023-10-08T07:07:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3741e-05 2023-10-08T07:07:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.275234+0000", 2023-10-08T07:07:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3149999999999999e-05 2023-10-08T07:07:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.275239+0000", 2023-10-08T07:07:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7949999999999998e-06 2023-10-08T07:07:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.276914+0000", 2023-10-08T07:07:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016752539999999999 2023-10-08T07:07:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.276979+0000", 2023-10-08T07:07:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4958999999999999e-05 2023-10-08T07:07:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.277114+0000", 2023-10-08T07:07:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013459299999999999 2023-10-08T07:07:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.279045+0000", 2023-10-08T07:07:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001931323 2023-10-08T07:07:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.299710+0000", 2023-10-08T07:07:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020664901999999999 2023-10-08T07:07:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.299766+0000", 2023-10-08T07:07:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6424000000000001e-05 2023-10-08T07:07:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.299788+0000", 2023-10-08T07:07:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1149999999999999e-05 2023-10-08T07:07:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:63851 4.30 4:0f322a22:::10000000004.00000014:head [write 3809280~4096,write 3928064~4096,write 3981312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.277503+0000", 2023-10-08T07:07:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.9235740310000002, 2023-10-08T07:07:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022149076, 2023-10-08T07:07:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 63851 2023-10-08T07:07:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.277503+0000", 2023-10-08T07:07:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.277503+0000", 2023-10-08T07:07:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.277504+0000", 2023-10-08T07:07:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8100000000000002e-07 2023-10-08T07:07:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.277515+0000", 2023-10-08T07:07:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1646e-05 2023-10-08T07:07:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.277526+0000", 2023-10-08T07:07:12.316 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0366999999999999e-05 2023-10-08T07:07:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.277533+0000", 2023-10-08T07:07:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6350000000000006e-06 2023-10-08T07:07:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.277573+0000", 2023-10-08T07:07:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9190999999999998e-05 2023-10-08T07:07:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.317 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.277632+0000", 2023-10-08T07:07:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9874999999999998e-05 2023-10-08T07:07:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.277728+0000", 2023-10-08T07:07:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6025000000000003e-05 2023-10-08T07:07:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.279347+0000", 2023-10-08T07:07:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016187770000000001 2023-10-08T07:07:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.299578+0000", 2023-10-08T07:07:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.02023109 2023-10-08T07:07:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.299613+0000", 2023-10-08T07:07:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4931999999999997e-05 2023-10-08T07:07:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.299652+0000", 2023-10-08T07:07:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8757000000000002e-05 2023-10-08T07:07:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.320 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:64266 4.c 4:3352c333:::10000000004.00000012:head [write 2842624~4096,write 3428352~4096,write 3485696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.425093+0000", 2023-10-08T07:07:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.7759841060000001, 2023-10-08T07:07:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022138924000000001, 2023-10-08T07:07:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 64266 2023-10-08T07:07:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425093+0000", 2023-10-08T07:07:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425093+0000", 2023-10-08T07:07:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425094+0000", 2023-10-08T07:07:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3600000000000002e-07 2023-10-08T07:07:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425110+0000", 2023-10-08T07:07:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6229999999999999e-05 2023-10-08T07:07:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425120+0000", 2023-10-08T07:07:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0553e-05 2023-10-08T07:07:12.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425128+0000", 2023-10-08T07:07:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2960000000000001e-06 2023-10-08T07:07:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425179+0000", 2023-10-08T07:07:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1428000000000003e-05 2023-10-08T07:07:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.324 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425261+0000", 2023-10-08T07:07:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1351000000000001e-05 2023-10-08T07:07:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425413+0000", 2023-10-08T07:07:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015208600000000001 2023-10-08T07:07:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.428140+0000", 2023-10-08T07:07:12.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027271980000000001 2023-10-08T07:07:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.447131+0000", 2023-10-08T07:07:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018991004999999998 2023-10-08T07:07:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.447190+0000", 2023-10-08T07:07:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9249999999999997e-05 2023-10-08T07:07:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.447232+0000", 2023-10-08T07:07:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1690999999999998e-05 2023-10-08T07:07:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:64267 4.c 4:31e28161:::10000000004.00000011:head [write 36864~4096,write 57344~4096,write 172032~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.425387+0000", 2023-10-08T07:07:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.7756899750000001, 2023-10-08T07:07:12.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023506767000000001, 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 64267 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425387+0000", 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425387+0000", 2023-10-08T07:07:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425388+0000", 2023-10-08T07:07:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6599999999999996e-07 2023-10-08T07:07:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425397+0000", 2023-10-08T07:07:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1749999999999994e-06 2023-10-08T07:07:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425404+0000", 2023-10-08T07:07:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4030000000000001e-06 2023-10-08T07:07:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.425409+0000", 2023-10-08T07:07:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3869999999999997e-06 2023-10-08T07:07:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.427036+0000", 2023-10-08T07:07:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016275599999999999 2023-10-08T07:07:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.427085+0000", 2023-10-08T07:07:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8563000000000002e-05 2023-10-08T07:07:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.427174+0000", 2023-10-08T07:07:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9019999999999998e-05 2023-10-08T07:07:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.430767+0000", 2023-10-08T07:07:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003593705 2023-10-08T07:07:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.448789+0000", 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018021220000000001 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.448853+0000", 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3948999999999994e-05 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.448894+0000", 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1118999999999997e-05 2023-10-08T07:07:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:64270 4.c 4:31e28161:::10000000004.00000011:head [write 2371584~4096,write 2478080~4096,write 2519040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.426301+0000", 2023-10-08T07:07:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.7747762429999998, 2023-10-08T07:07:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024118097000000002, 2023-10-08T07:07:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.335 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.335 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 64270 2023-10-08T07:07:12.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.335 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.426301+0000", 2023-10-08T07:07:12.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.426301+0000", 2023-10-08T07:07:12.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.426301+0000", 2023-10-08T07:07:12.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:07:12.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.426328+0000", 2023-10-08T07:07:12.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6723000000000001e-05 2023-10-08T07:07:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.426336+0000", 2023-10-08T07:07:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2979999999999992e-06 2023-10-08T07:07:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.426341+0000", 2023-10-08T07:07:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9579999999999998e-06 2023-10-08T07:07:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.428167+0000", 2023-10-08T07:07:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001825711 2023-10-08T07:07:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.428222+0000", 2023-10-08T07:07:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5285999999999999e-05 2023-10-08T07:07:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.428341+0000", 2023-10-08T07:07:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000118336 2023-10-08T07:07:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.430772+0000", 2023-10-08T07:07:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002431547 2023-10-08T07:07:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.450327+0000", 2023-10-08T07:07:12.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019555004000000001 2023-10-08T07:07:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.450384+0000", 2023-10-08T07:07:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6570000000000002e-05 2023-10-08T07:07:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.450419+0000", 2023-10-08T07:07:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5111999999999999e-05 2023-10-08T07:07:12.340 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:64276 4.c 4:31e28161:::10000000004.00000011:head [write 3076096~4096,write 3395584~4096,write 3686400~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.428270+0000", 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.7728069450000001, 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022253735, 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.341 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 64276 2023-10-08T07:07:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.428270+0000", 2023-10-08T07:07:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.428270+0000", 2023-10-08T07:07:12.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.428271+0000", 2023-10-08T07:07:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5899999999999996e-07 2023-10-08T07:07:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.428284+0000", 2023-10-08T07:07:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.344e-05 2023-10-08T07:07:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.428293+0000", 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5040000000000002e-06 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.428298+0000", 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7509999999999997e-06 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.429319+0000", 2023-10-08T07:07:12.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001020588 2023-10-08T07:07:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.429407+0000", 2023-10-08T07:07:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8319999999999995e-05 2023-10-08T07:07:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.429563+0000", 2023-10-08T07:07:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015604700000000001 2023-10-08T07:07:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.433374+0000", 2023-10-08T07:07:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038109419999999999 2023-10-08T07:07:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.450465+0000", 2023-10-08T07:07:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017090375000000001 2023-10-08T07:07:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.450502+0000", 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7138999999999998e-05 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.450524+0000", 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1970000000000001e-05 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:64280 4.c 4:3352c333:::10000000004.00000012:head [write 1757184~4096,write 1847296~4096,write 1867776~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.429508+0000", 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 2.7715689279999998, 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.025236376000000001, 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 64280 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:12.348 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.429508+0000", 2023-10-08T07:07:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.429508+0000", 2023-10-08T07:07:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.429509+0000", 2023-10-08T07:07:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:07:12.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.429521+0000", 2023-10-08T07:07:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1987000000000001e-05 2023-10-08T07:07:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.429531+0000", 2023-10-08T07:07:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:07:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.429537+0000", 2023-10-08T07:07:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:07:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.430804+0000", 2023-10-08T07:07:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001267469 2023-10-08T07:07:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.430904+0000", 2023-10-08T07:07:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9852999999999994e-05 2023-10-08T07:07:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.431079+0000", 2023-10-08T07:07:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017449800000000001 2023-10-08T07:07:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.433540+0000", 2023-10-08T07:07:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00246102 2023-10-08T07:07:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.454640+0000", 2023-10-08T07:07:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021100648999999999 2023-10-08T07:07:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.454703+0000", 2023-10-08T07:07:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2750999999999996e-05 2023-10-08T07:07:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:12.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.454744+0000", 2023-10-08T07:07:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1384999999999998e-05 2023-10-08T07:07:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:12.354 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:12.357 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2023-10-08T07:07:12.358 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:12.358 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:12.354+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:12.456 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:12.455+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:12.543 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:12.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72581 4.f 4.e29eca4f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.540256+0000", 2023-10-08T07:07:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011779690000000001, 2023-10-08T07:07:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00120156, 2023-10-08T07:07:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72581 2023-10-08T07:07:12.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540256+0000", 2023-10-08T07:07:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540256+0000", 2023-10-08T07:07:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540257+0000", 2023-10-08T07:07:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1299999999999998e-07 2023-10-08T07:07:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540269+0000", 2023-10-08T07:07:12.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2092999999999999e-05 2023-10-08T07:07:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540280+0000", 2023-10-08T07:07:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1483e-05 2023-10-08T07:07:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540292+0000", 2023-10-08T07:07:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2109999999999999e-05 2023-10-08T07:07:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:72547 4.20 e53/17 4:05b3915c:::10000000004.00000016:head v 53'3405, mlcod=53'3403)", 2023-10-08T07:07:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.529527+0000", 2023-10-08T07:07:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011907086000000001, 2023-10-08T07:07:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01199427, 2023-10-08T07:07:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.529527+0000", 2023-10-08T07:07:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.529527+0000", 2023-10-08T07:07:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.529527+0000", 2023-10-08T07:07:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8700000000000005e-07 2023-10-08T07:07:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.529543+0000", 2023-10-08T07:07:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5522000000000001e-05 2023-10-08T07:07:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.529554+0000", 2023-10-08T07:07:12.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0723999999999999e-05 2023-10-08T07:07:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.529561+0000", 2023-10-08T07:07:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6690000000000006e-06 2023-10-08T07:07:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.529604+0000", 2023-10-08T07:07:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2981000000000001e-05 2023-10-08T07:07:12.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.529624+0000", 2023-10-08T07:07:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9924000000000001e-05 2023-10-08T07:07:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.553 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72582 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.540615+0000", 2023-10-08T07:07:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00081907599999999996, 2023-10-08T07:07:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00096712399999999998, 2023-10-08T07:07:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72582 2023-10-08T07:07:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.554 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540615+0000", 2023-10-08T07:07:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540615+0000", 2023-10-08T07:07:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540616+0000", 2023-10-08T07:07:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9800000000000002e-07 2023-10-08T07:07:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540627+0000", 2023-10-08T07:07:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1348999999999999e-05 2023-10-08T07:07:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540640+0000", 2023-10-08T07:07:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3246e-05 2023-10-08T07:07:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540648+0000", 2023-10-08T07:07:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0669999999999992e-06 2023-10-08T07:07:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:72577 4.20 e53/17)", 2023-10-08T07:07:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.540689+0000", 2023-10-08T07:07:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00074454700000000003, 2023-10-08T07:07:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00094797499999999999, 2023-10-08T07:07:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540689+0000", 2023-10-08T07:07:12.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540689+0000", 2023-10-08T07:07:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540690+0000", 2023-10-08T07:07:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.89e-07 2023-10-08T07:07:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540701+0000", 2023-10-08T07:07:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1392999999999999e-05 2023-10-08T07:07:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540710+0000", 2023-10-08T07:07:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5609999999999999e-06 2023-10-08T07:07:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540715+0000", 2023-10-08T07:07:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9060000000000001e-06 2023-10-08T07:07:12.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72584 4.11 4:8963efe6:::10000000004.00000009:head [write 237568~4096 in=4096b,write 258048~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.541269+0000", 2023-10-08T07:07:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000165119, 2023-10-08T07:07:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000420281, 2023-10-08T07:07:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.564 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72584 2023-10-08T07:07:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541269+0000", 2023-10-08T07:07:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541269+0000", 2023-10-08T07:07:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541270+0000", 2023-10-08T07:07:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2023-10-08T07:07:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541280+0000", 2023-10-08T07:07:12.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0631e-05 2023-10-08T07:07:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541305+0000", 2023-10-08T07:07:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.525e-05 2023-10-08T07:07:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541313+0000", 2023-10-08T07:07:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2490000000000004e-06 2023-10-08T07:07:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541370+0000", 2023-10-08T07:07:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7738000000000002e-05 2023-10-08T07:07:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541452+0000", 2023-10-08T07:07:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2076999999999994e-05 2023-10-08T07:07:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541579+0000", 2023-10-08T07:07:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000126332 2023-10-08T07:07:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72550 4.7 4:e2479c46:::10000000004.00000024:head [write 3141632~4096 in=4096b,write 3280896~4096 in=4096b,write 3514368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.530153+0000", 2023-10-08T07:07:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011281272, 2023-10-08T07:07:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011615176, 2023-10-08T07:07:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72550 2023-10-08T07:07:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530153+0000", 2023-10-08T07:07:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530153+0000", 2023-10-08T07:07:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530153+0000", 2023-10-08T07:07:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6000000000000002e-07 2023-10-08T07:07:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530165+0000", 2023-10-08T07:07:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1987000000000001e-05 2023-10-08T07:07:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530176+0000", 2023-10-08T07:07:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.007e-05 2023-10-08T07:07:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530183+0000", 2023-10-08T07:07:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3030000000000002e-06 2023-10-08T07:07:12.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530234+0000", 2023-10-08T07:07:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1683e-05 2023-10-08T07:07:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530318+0000", 2023-10-08T07:07:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3273e-05 2023-10-08T07:07:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72585 4.31 4:8ec1b377:::10000000004.00000019:head [write 884736~4096 in=4096b,write 917504~4096 in=4096b,write 929792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.541536+0000", 2023-10-08T07:07:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999898, 2023-10-08T07:07:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00031813799999999998, 2023-10-08T07:07:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72585 2023-10-08T07:07:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541536+0000", 2023-10-08T07:07:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541536+0000", 2023-10-08T07:07:12.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541536+0000", 2023-10-08T07:07:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:07:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541550+0000", 2023-10-08T07:07:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3149999999999999e-05 2023-10-08T07:07:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541556+0000", 2023-10-08T07:07:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6429999999999998e-06 2023-10-08T07:07:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541561+0000", 2023-10-08T07:07:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5129999999999998e-06 2023-10-08T07:07:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541607+0000", 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6415000000000002e-05 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541691+0000", 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3824000000000002e-05 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541858+0000", 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016738500000000001 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.581 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72551 4.7 4:e2479c46:::10000000004.00000024:head [write 3522560~4096 in=4096b,write 3629056~4096 in=4096b,write 3932160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.530426+0000", 2023-10-08T07:07:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011007381, 2023-10-08T07:07:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011505459000000001, 2023-10-08T07:07:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72551 2023-10-08T07:07:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530426+0000", 2023-10-08T07:07:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530426+0000", 2023-10-08T07:07:12.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530427+0000", 2023-10-08T07:07:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530445+0000", 2023-10-08T07:07:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7521999999999999e-05 2023-10-08T07:07:12.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530455+0000", 2023-10-08T07:07:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.961e-06 2023-10-08T07:07:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.530462+0000", 2023-10-08T07:07:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9059999999999996e-06 2023-10-08T07:07:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.532462+0000", 2023-10-08T07:07:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020003429999999999 2023-10-08T07:07:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.532533+0000", 2023-10-08T07:07:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000001e-05 2023-10-08T07:07:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72553 4.2f 4:f790ef75:::10000000004.00000038:head [write 561152~4096 in=4096b,write 847872~4096 in=4096b,write 876544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.531153+0000", 2023-10-08T07:07:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.010280754, 2023-10-08T07:07:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01084152, 2023-10-08T07:07:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72553 2023-10-08T07:07:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.587 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.531153+0000", 2023-10-08T07:07:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.531153+0000", 2023-10-08T07:07:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.531154+0000", 2023-10-08T07:07:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0400000000000005e-07 2023-10-08T07:07:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.531166+0000", 2023-10-08T07:07:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.236e-05 2023-10-08T07:07:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.531181+0000", 2023-10-08T07:07:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4348000000000001e-05 2023-10-08T07:07:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.531188+0000", 2023-10-08T07:07:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2010000000000002e-06 2023-10-08T07:07:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.532451+0000", 2023-10-08T07:07:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012636279999999999 2023-10-08T07:07:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.532520+0000", 2023-10-08T07:07:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8807999999999996e-05 2023-10-08T07:07:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72560 4.f 4:f2537947:::10000000004.00000017:head [write 2117632~4096 in=4096b,write 2134016~4096 in=4096b,write 2158592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.533107+0000", 2023-10-08T07:07:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0083269079999999992, 2023-10-08T07:07:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089393389999999993, 2023-10-08T07:07:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72560 2023-10-08T07:07:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533107+0000", 2023-10-08T07:07:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533107+0000", 2023-10-08T07:07:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533108+0000", 2023-10-08T07:07:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3900000000000003e-07 2023-10-08T07:07:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533144+0000", 2023-10-08T07:07:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5714999999999999e-05 2023-10-08T07:07:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533157+0000", 2023-10-08T07:07:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2948999999999999e-05 2023-10-08T07:07:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533165+0000", 2023-10-08T07:07:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.585e-06 2023-10-08T07:07:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.534428+0000", 2023-10-08T07:07:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012625290000000001 2023-10-08T07:07:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.534544+0000", 2023-10-08T07:07:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116332 2023-10-08T07:07:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:72559 4.30 e53/17 4:0f322a22:::10000000004.00000014:head v 53'1141, mlcod=53'1139)", 2023-10-08T07:07:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.533364+0000", 2023-10-08T07:07:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0080694730000000006, 2023-10-08T07:07:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087216930000000008, 2023-10-08T07:07:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533364+0000", 2023-10-08T07:07:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533364+0000", 2023-10-08T07:07:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533365+0000", 2023-10-08T07:07:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6699999999999999e-07 2023-10-08T07:07:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533374+0000", 2023-10-08T07:07:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3810000000000005e-06 2023-10-08T07:07:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533389+0000", 2023-10-08T07:07:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4378e-05 2023-10-08T07:07:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533394+0000", 2023-10-08T07:07:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9109999999999998e-06 2023-10-08T07:07:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533454+0000", 2023-10-08T07:07:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9784000000000002e-05 2023-10-08T07:07:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533475+0000", 2023-10-08T07:07:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0367e-05 2023-10-08T07:07:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72561 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3682304~4096 in=4096b,write 3792896~4096 in=4096b,write 3829760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.533368+0000", 2023-10-08T07:07:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0080658410000000007, 2023-10-08T07:07:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087555329999999994, 2023-10-08T07:07:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72561 2023-10-08T07:07:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533368+0000", 2023-10-08T07:07:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533368+0000", 2023-10-08T07:07:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533369+0000", 2023-10-08T07:07:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4e-07 2023-10-08T07:07:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533403+0000", 2023-10-08T07:07:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3810000000000003e-05 2023-10-08T07:07:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533413+0000", 2023-10-08T07:07:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9969999999999993e-06 2023-10-08T07:07:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533421+0000", 2023-10-08T07:07:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2023-10-08T07:07:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533487+0000", 2023-10-08T07:07:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6338000000000001e-05 2023-10-08T07:07:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533567+0000", 2023-10-08T07:07:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0397999999999998e-05 2023-10-08T07:07:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.533727+0000", 2023-10-08T07:07:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016018400000000001 2023-10-08T07:07:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72564 4.7 4:e2d089ed:::10000000004.00000033:head [write 4005888~4096 in=4096b,write 4018176~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.534666+0000", 2023-10-08T07:07:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0067680659999999997, 2023-10-08T07:07:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075053999999999997, 2023-10-08T07:07:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72564 2023-10-08T07:07:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.534666+0000", 2023-10-08T07:07:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.534666+0000", 2023-10-08T07:07:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.534667+0000", 2023-10-08T07:07:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4300000000000002e-07 2023-10-08T07:07:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.534679+0000", 2023-10-08T07:07:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2351000000000001e-05 2023-10-08T07:07:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.534691+0000", 2023-10-08T07:07:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1770000000000001e-05 2023-10-08T07:07:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.534699+0000", 2023-10-08T07:07:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2023-10-08T07:07:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536602+0000", 2023-10-08T07:07:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019026189999999999 2023-10-08T07:07:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536689+0000", 2023-10-08T07:07:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7409000000000003e-05 2023-10-08T07:07:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72567 4.7 4:e13e8cdb:::10000000004.00000028:head [write 3989504~4096 in=4096b,write 4087808~4096 in=4096b,write 4096000~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.535247+0000", 2023-10-08T07:07:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0061870900000000001, 2023-10-08T07:07:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069683590000000004, 2023-10-08T07:07:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72567 2023-10-08T07:07:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.535247+0000", 2023-10-08T07:07:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.535247+0000", 2023-10-08T07:07:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.535248+0000", 2023-10-08T07:07:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9599999999999998e-07 2023-10-08T07:07:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.535318+0000", 2023-10-08T07:07:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0222000000000006e-05 2023-10-08T07:07:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.535328+0000", 2023-10-08T07:07:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7280000000000007e-06 2023-10-08T07:07:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.535335+0000", 2023-10-08T07:07:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1590000000000004e-06 2023-10-08T07:07:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540954+0000", 2023-10-08T07:07:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056189660000000004 2023-10-08T07:07:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.541028+0000", 2023-10-08T07:07:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4055999999999997e-05 2023-10-08T07:07:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72570 4.f 4:f2537947:::10000000004.00000017:head [write 20480~4096 in=4096b,write 204800~4096 in=4096b,write 352256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.536200+0000", 2023-10-08T07:07:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0052336379999999997, 2023-10-08T07:07:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060549050000000002, 2023-10-08T07:07:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72570 2023-10-08T07:07:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536200+0000", 2023-10-08T07:07:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536200+0000", 2023-10-08T07:07:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536201+0000", 2023-10-08T07:07:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3300000000000001e-07 2023-10-08T07:07:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536209+0000", 2023-10-08T07:07:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3259999999999996e-06 2023-10-08T07:07:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536223+0000", 2023-10-08T07:07:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3511e-05 2023-10-08T07:07:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536229+0000", 2023-10-08T07:07:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2559999999999999e-06 2023-10-08T07:07:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540129+0000", 2023-10-08T07:07:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038995520000000001 2023-10-08T07:07:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540216+0000", 2023-10-08T07:07:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7199000000000003e-05 2023-10-08T07:07:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72571 4.7 4.6239e247 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.536545+0000", 2023-10-08T07:07:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0048890499999999998, 2023-10-08T07:07:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057605299999999998, 2023-10-08T07:07:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72571 2023-10-08T07:07:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536545+0000", 2023-10-08T07:07:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536545+0000", 2023-10-08T07:07:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536546+0000", 2023-10-08T07:07:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:07:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536557+0000", 2023-10-08T07:07:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1185999999999999e-05 2023-10-08T07:07:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536566+0000", 2023-10-08T07:07:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9609999999999994e-06 2023-10-08T07:07:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.536572+0000", 2023-10-08T07:07:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7610000000000002e-06 2023-10-08T07:07:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72573 4.7 4.b7910b47 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.537231+0000", 2023-10-08T07:07:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0042026920000000001, 2023-10-08T07:07:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051044339999999997, 2023-10-08T07:07:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72573 2023-10-08T07:07:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.537231+0000", 2023-10-08T07:07:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.537231+0000", 2023-10-08T07:07:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.537232+0000", 2023-10-08T07:07:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:07:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.537243+0000", 2023-10-08T07:07:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1167e-05 2023-10-08T07:07:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.537250+0000", 2023-10-08T07:07:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0790000000000003e-06 2023-10-08T07:07:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.537255+0000", 2023-10-08T07:07:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0719999999999999e-06 2023-10-08T07:07:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:72574 4.20 e53/17 4:04004f2c:::10000000004.0000000d:head v 53'3406, mlcod=53'3403)", 2023-10-08T07:07:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.537995+0000", 2023-10-08T07:07:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0034392170000000001, 2023-10-08T07:07:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043714030000000003, 2023-10-08T07:07:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.537995+0000", 2023-10-08T07:07:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.537995+0000", 2023-10-08T07:07:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.537995+0000", 2023-10-08T07:07:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4299999999999998e-07 2023-10-08T07:07:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538013+0000", 2023-10-08T07:07:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8320000000000001e-05 2023-10-08T07:07:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538022+0000", 2023-10-08T07:07:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8480000000000007e-06 2023-10-08T07:07:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538027+0000", 2023-10-08T07:07:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9919999999999998e-06 2023-10-08T07:07:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538369+0000", 2023-10-08T07:07:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00034171400000000002 2023-10-08T07:07:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538390+0000", 2023-10-08T07:07:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1035000000000001e-05 2023-10-08T07:07:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72575 4.28 4:15b6682b:::10000000004.0000000b:head [write 2498560~4096 in=4096b,write 2519040~4096 in=4096b,write 2543616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.538047+0000", 2023-10-08T07:07:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0033867250000000002, 2023-10-08T07:07:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043545809999999997, 2023-10-08T07:07:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72575 2023-10-08T07:07:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538047+0000", 2023-10-08T07:07:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538047+0000", 2023-10-08T07:07:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538048+0000", 2023-10-08T07:07:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2023-10-08T07:07:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538056+0000", 2023-10-08T07:07:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7610000000000007e-06 2023-10-08T07:07:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538063+0000", 2023-10-08T07:07:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6850000000000001e-06 2023-10-08T07:07:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538067+0000", 2023-10-08T07:07:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2023-10-08T07:07:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538400+0000", 2023-10-08T07:07:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033290899999999999 2023-10-08T07:07:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538498+0000", 2023-10-08T07:07:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8293000000000002e-05 2023-10-08T07:07:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:72576 4.1b e53/17 4:dbb7dde6:::10000000004.0000002c:head v 53'2261, mlcod=53'2258)", 2023-10-08T07:07:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.538725+0000", 2023-10-08T07:07:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0027089179999999998, 2023-10-08T07:07:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037126210000000002, 2023-10-08T07:07:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538725+0000", 2023-10-08T07:07:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538725+0000", 2023-10-08T07:07:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538725+0000", 2023-10-08T07:07:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5799999999999999e-07 2023-10-08T07:07:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538739+0000", 2023-10-08T07:07:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3322000000000001e-05 2023-10-08T07:07:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538747+0000", 2023-10-08T07:07:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0479999999999999e-06 2023-10-08T07:07:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538753+0000", 2023-10-08T07:07:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9410000000000004e-06 2023-10-08T07:07:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538791+0000", 2023-10-08T07:07:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8269000000000002e-05 2023-10-08T07:07:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.538809+0000", 2023-10-08T07:07:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7881e-05 2023-10-08T07:07:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:72578 4.1a e53/17 4:5a59f83a:::10000000004.00000002:head v 53'1163, mlcod=53'1160)", 2023-10-08T07:07:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.539356+0000", 2023-10-08T07:07:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002078267, 2023-10-08T07:07:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003114651, 2023-10-08T07:07:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539356+0000", 2023-10-08T07:07:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539356+0000", 2023-10-08T07:07:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539356+0000", 2023-10-08T07:07:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1300000000000001e-07 2023-10-08T07:07:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539374+0000", 2023-10-08T07:07:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7957000000000001e-05 2023-10-08T07:07:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539381+0000", 2023-10-08T07:07:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.401e-06 2023-10-08T07:07:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539385+0000", 2023-10-08T07:07:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0890000000000002e-06 2023-10-08T07:07:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539427+0000", 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1338999999999998e-05 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539444+0000", 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6782999999999998e-05 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72544 4.3f 4:fc9a2d79:::10000000004.0000002f:head [write 1687552~4096 in=4096b,write 1712128~4096 in=4096b,write 1720320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.528274+0000", 2023-10-08T07:07:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013159878, 2023-10-08T07:07:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014232022, 2023-10-08T07:07:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72544 2023-10-08T07:07:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.528274+0000", 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.528274+0000", 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.528274+0000", 2023-10-08T07:07:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9200000000000002e-07 2023-10-08T07:07:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.528284+0000", 2023-10-08T07:07:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5359999999999998e-06 2023-10-08T07:07:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.528297+0000", 2023-10-08T07:07:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2867000000000001e-05 2023-10-08T07:07:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.528300+0000", 2023-10-08T07:07:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6569999999999999e-06 2023-10-08T07:07:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.528340+0000", 2023-10-08T07:07:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9959999999999997e-05 2023-10-08T07:07:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.528413+0000", 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2867000000000006e-05 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:72580 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 3538944~4096 in=4096b,write 3547136~4096 in=4096b,write 3907584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:12.539953+0000", 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0014805879999999999, 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025935860000000002, 2023-10-08T07:07:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 72580 2023-10-08T07:07:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539953+0000", 2023-10-08T07:07:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539953+0000", 2023-10-08T07:07:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539954+0000", 2023-10-08T07:07:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1299999999999999e-07 2023-10-08T07:07:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539965+0000", 2023-10-08T07:07:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0529e-05 2023-10-08T07:07:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539974+0000", 2023-10-08T07:07:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7180000000000008e-06 2023-10-08T07:07:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.539981+0000", 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9550000000000003e-06 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540039+0000", 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7516000000000003e-05 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:12.540130+0000", 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1099000000000003e-05 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.672 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:12.673 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.673 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:12.673 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:12.673 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 23 2023-10-08T07:07:12.673 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:12.674 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:12.673+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:12.675 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:12.775 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:12.774+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:12.876 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:12.876+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:12.910 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:12.911 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:12.911 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:12.926 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:12.977 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:12.976+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:13.077 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:13.077+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:13.170 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:13.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36811 4.31 4:8ec1b377:::10000000004.00000019:head [write 3362816~4096,write 3395584~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.890913139, 2023-10-08T07:07:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96838670299999996, 2023-10-08T07:07:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.171 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36811 2023-10-08T07:07:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:07:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275541+0000", 2023-10-08T07:07:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3360000000000001e-06 2023-10-08T07:07:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275551+0000", 2023-10-08T07:07:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.825e-06 2023-10-08T07:07:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275556+0000", 2023-10-08T07:07:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2023-10-08T07:07:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275592+0000", 2023-10-08T07:07:13.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6554000000000003e-05 2023-10-08T07:07:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275599+0000", 2023-10-08T07:07:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4640000000000003e-06 2023-10-08T07:07:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.238899+0000", 2023-10-08T07:07:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96330046999999996 2023-10-08T07:07:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239016+0000", 2023-10-08T07:07:13.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116919 2023-10-08T07:07:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239123+0000", 2023-10-08T07:07:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010675000000000001 2023-10-08T07:07:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243715+0000", 2023-10-08T07:07:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045922469999999998 2023-10-08T07:07:13.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243760+0000", 2023-10-08T07:07:13.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4666000000000002e-05 2023-10-08T07:07:13.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243820+0000", 2023-10-08T07:07:13.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9760999999999999e-05 2023-10-08T07:07:13.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243917+0000", 2023-10-08T07:07:13.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7822e-05 2023-10-08T07:07:13.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.179 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36831 4.31 4:8de29a03:::10000000004.00000001:head [write 806912~8192,write 847872~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.883893220999999, 2023-10-08T07:07:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96330879000000003, 2023-10-08T07:07:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36831 2023-10-08T07:07:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282564+0000", 2023-10-08T07:07:13.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2303999999999999e-05 2023-10-08T07:07:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282572+0000", 2023-10-08T07:07:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7849999999999992e-06 2023-10-08T07:07:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282579+0000", 2023-10-08T07:07:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4610000000000002e-06 2023-10-08T07:07:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282631+0000", 2023-10-08T07:07:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2404999999999997e-05 2023-10-08T07:07:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282640+0000", 2023-10-08T07:07:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2640000000000008e-06 2023-10-08T07:07:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239925+0000", 2023-10-08T07:07:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95728506499999999 2023-10-08T07:07:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240097+0000", 2023-10-08T07:07:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172497 2023-10-08T07:07:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240235+0000", 2023-10-08T07:07:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000137861 2023-10-08T07:07:13.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243935+0000", 2023-10-08T07:07:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037000819999999999 2023-10-08T07:07:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245706+0000", 2023-10-08T07:07:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001770972 2023-10-08T07:07:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245773+0000", 2023-10-08T07:07:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6840000000000004e-05 2023-10-08T07:07:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245859+0000", 2023-10-08T07:07:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6442999999999999e-05 2023-10-08T07:07:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36859 4.31 4:8de29a03:::10000000004.00000001:head [write 3850240~4096,write 3891200~4096,write 3919872~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.873149679000001, 2023-10-08T07:07:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95269757099999997, 2023-10-08T07:07:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36859 2023-10-08T07:07:13.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.189 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:13.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:13.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293295+0000", 2023-10-08T07:07:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9500000000000001e-07 2023-10-08T07:07:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293335+0000", 2023-10-08T07:07:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9867999999999998e-05 2023-10-08T07:07:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293346+0000", 2023-10-08T07:07:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1070000000000001e-05 2023-10-08T07:07:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293353+0000", 2023-10-08T07:07:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2640000000000002e-06 2023-10-08T07:07:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293409+0000", 2023-10-08T07:07:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5926e-05 2023-10-08T07:07:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293418+0000", 2023-10-08T07:07:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9940000000000006e-06 2023-10-08T07:07:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240889+0000", 2023-10-08T07:07:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94747106400000003 2023-10-08T07:07:13.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240963+0000", 2023-10-08T07:07:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3431999999999998e-05 2023-10-08T07:07:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241104+0000", 2023-10-08T07:07:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014119800000000001 2023-10-08T07:07:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243944+0000", 2023-10-08T07:07:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028404200000000002 2023-10-08T07:07:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245909+0000", 2023-10-08T07:07:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001964351 2023-10-08T07:07:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245942+0000", 2023-10-08T07:07:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3526999999999999e-05 2023-10-08T07:07:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245992+0000", 2023-10-08T07:07:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9561999999999997e-05 2023-10-08T07:07:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36861 4.31 4:8ec1b377:::10000000004.00000019:head [write 385024~4096,write 434176~4096,write 540672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.872240883, 2023-10-08T07:07:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.955921154, 2023-10-08T07:07:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36861 2023-10-08T07:07:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.196 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294204+0000", 2023-10-08T07:07:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294216+0000", 2023-10-08T07:07:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2323999999999999e-05 2023-10-08T07:07:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294226+0000", 2023-10-08T07:07:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0217000000000001e-05 2023-10-08T07:07:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294234+0000", 2023-10-08T07:07:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6020000000000002e-06 2023-10-08T07:07:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294300+0000", 2023-10-08T07:07:13.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6515999999999998e-05 2023-10-08T07:07:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294312+0000", 2023-10-08T07:07:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1379000000000001e-05 2023-10-08T07:07:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241814+0000", 2023-10-08T07:07:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.947501751 2023-10-08T07:07:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241863+0000", 2023-10-08T07:07:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9135999999999998e-05 2023-10-08T07:07:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241953+0000", 2023-10-08T07:07:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0124000000000007e-05 2023-10-08T07:07:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243952+0000", 2023-10-08T07:07:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019988749999999998 2023-10-08T07:07:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250028+0000", 2023-10-08T07:07:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060766350000000004 2023-10-08T07:07:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250069+0000", 2023-10-08T07:07:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0794000000000003e-05 2023-10-08T07:07:13.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250124+0000", 2023-10-08T07:07:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991000000000003e-05 2023-10-08T07:07:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36869 4.31 4:8ec1b377:::10000000004.00000019:head [write 917504~4096,write 983040~4096,write 1171456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:13.203 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.868924619, 2023-10-08T07:07:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95596831699999996, 2023-10-08T07:07:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36869 2023-10-08T07:07:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297520+0000", 2023-10-08T07:07:13.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.23e-07 2023-10-08T07:07:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297532+0000", 2023-10-08T07:07:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1420000000000001e-05 2023-10-08T07:07:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297548+0000", 2023-10-08T07:07:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6711e-05 2023-10-08T07:07:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297557+0000", 2023-10-08T07:07:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3250000000000008e-06 2023-10-08T07:07:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297606+0000", 2023-10-08T07:07:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9724e-05 2023-10-08T07:07:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297614+0000", 2023-10-08T07:07:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2023-10-08T07:07:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.242809+0000", 2023-10-08T07:07:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94519444900000005 2023-10-08T07:07:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.242885+0000", 2023-10-08T07:07:13.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6784000000000002e-05 2023-10-08T07:07:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243025+0000", 2023-10-08T07:07:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013984300000000001 2023-10-08T07:07:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246003+0000", 2023-10-08T07:07:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002978072 2023-10-08T07:07:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253322+0000", 2023-10-08T07:07:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073190779999999997 2023-10-08T07:07:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253391+0000", 2023-10-08T07:07:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8285000000000001e-05 2023-10-08T07:07:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253488+0000", 2023-10-08T07:07:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7014000000000003e-05 2023-10-08T07:07:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36881 4.31 4:8ec1b377:::10000000004.00000019:head [write 888832~4096,write 1191936~4096,write 1327104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:13.211 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.864857075, 2023-10-08T07:07:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95214402799999998, 2023-10-08T07:07:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36881 2023-10-08T07:07:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301588+0000", 2023-10-08T07:07:13.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.02e-06 2023-10-08T07:07:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301600+0000", 2023-10-08T07:07:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2377e-05 2023-10-08T07:07:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301611+0000", 2023-10-08T07:07:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0446e-05 2023-10-08T07:07:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301621+0000", 2023-10-08T07:07:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0338e-05 2023-10-08T07:07:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301668+0000", 2023-10-08T07:07:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7459000000000001e-05 2023-10-08T07:07:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301674+0000", 2023-10-08T07:07:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7910000000000001e-06 2023-10-08T07:07:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244001+0000", 2023-10-08T07:07:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94232701200000002 2023-10-08T07:07:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244082+0000", 2023-10-08T07:07:13.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0615e-05 2023-10-08T07:07:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244202+0000", 2023-10-08T07:07:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120427 2023-10-08T07:07:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246009+0000", 2023-10-08T07:07:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018070899999999999 2023-10-08T07:07:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253544+0000", 2023-10-08T07:07:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075350729999999998 2023-10-08T07:07:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253607+0000", 2023-10-08T07:07:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2810000000000003e-05 2023-10-08T07:07:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253731+0000", 2023-10-08T07:07:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012357000000000001 2023-10-08T07:07:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36900 4.31 4:8de29a03:::10000000004.00000001:head [write 3239936~4096,write 3371008~4096,write 3878912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.858533768999999, 2023-10-08T07:07:13.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94607822699999999, 2023-10-08T07:07:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36900 2023-10-08T07:07:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:13.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307911+0000", 2023-10-08T07:07:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0210000000000001e-06 2023-10-08T07:07:13.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307926+0000", 2023-10-08T07:07:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4375e-05 2023-10-08T07:07:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307936+0000", 2023-10-08T07:07:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0124e-05 2023-10-08T07:07:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307950+0000", 2023-10-08T07:07:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4659e-05 2023-10-08T07:07:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307998+0000", 2023-10-08T07:07:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8170000000000001e-05 2023-10-08T07:07:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.308005+0000", 2023-10-08T07:07:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3339999999999998e-06 2023-10-08T07:07:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244911+0000", 2023-10-08T07:07:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93690596699999995 2023-10-08T07:07:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244972+0000", 2023-10-08T07:07:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0854999999999999e-05 2023-10-08T07:07:13.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245073+0000", 2023-10-08T07:07:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101406 2023-10-08T07:07:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250135+0000", 2023-10-08T07:07:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050614620000000001 2023-10-08T07:07:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253786+0000", 2023-10-08T07:07:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003651615 2023-10-08T07:07:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253860+0000", 2023-10-08T07:07:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3631e-05 2023-10-08T07:07:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253988+0000", 2023-10-08T07:07:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000128608 2023-10-08T07:07:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36907 4.31 4:8de29a03:::10000000004.00000001:head [write 53248~4096,write 192512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.855292663, 2023-10-08T07:07:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94298633799999998, 2023-10-08T07:07:13.227 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36907 2023-10-08T07:07:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311152+0000", 2023-10-08T07:07:13.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3200000000000005e-07 2023-10-08T07:07:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311158+0000", 2023-10-08T07:07:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2219999999999999e-06 2023-10-08T07:07:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311166+0000", 2023-10-08T07:07:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5209999999999997e-06 2023-10-08T07:07:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311169+0000", 2023-10-08T07:07:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.568e-06 2023-10-08T07:07:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311202+0000", 2023-10-08T07:07:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3346000000000002e-05 2023-10-08T07:07:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311208+0000", 2023-10-08T07:07:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.259e-06 2023-10-08T07:07:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246041+0000", 2023-10-08T07:07:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93483340400000003 2023-10-08T07:07:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246088+0000", 2023-10-08T07:07:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6653999999999998e-05 2023-10-08T07:07:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246173+0000", 2023-10-08T07:07:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5327999999999993e-05 2023-10-08T07:07:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253252+0000", 2023-10-08T07:07:13.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070788170000000003 2023-10-08T07:07:13.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254057+0000", 2023-10-08T07:07:13.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00080496300000000001 2023-10-08T07:07:13.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254090+0000", 2023-10-08T07:07:13.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3325999999999999e-05 2023-10-08T07:07:13.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254138+0000", 2023-10-08T07:07:13.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7398000000000003e-05 2023-10-08T07:07:13.236 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.236 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.236 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.236 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36955 4.31 4:8ec1b377:::10000000004.00000019:head [write 3538944~8192,write 3620864~4096,write 3641344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.236 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:13.236 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.838249719, 2023-10-08T07:07:13.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92903069999999999, 2023-10-08T07:07:13.236 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.237 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.237 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36955 2023-10-08T07:07:13.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.237 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:13.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:13.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328195+0000", 2023-10-08T07:07:13.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1600000000000001e-07 2023-10-08T07:07:13.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328208+0000", 2023-10-08T07:07:13.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3592e-05 2023-10-08T07:07:13.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328218+0000", 2023-10-08T07:07:13.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7270000000000002e-06 2023-10-08T07:07:13.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328226+0000", 2023-10-08T07:07:13.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.328e-06 2023-10-08T07:07:13.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328282+0000", 2023-10-08T07:07:13.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6156000000000002e-05 2023-10-08T07:07:13.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328300+0000", 2023-10-08T07:07:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7805e-05 2023-10-08T07:07:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246679+0000", 2023-10-08T07:07:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91837927200000002 2023-10-08T07:07:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246743+0000", 2023-10-08T07:07:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4599999999999998e-05 2023-10-08T07:07:13.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246838+0000", 2023-10-08T07:07:13.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5063999999999996e-05 2023-10-08T07:07:13.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253747+0000", 2023-10-08T07:07:13.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069086210000000002 2023-10-08T07:07:13.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257129+0000", 2023-10-08T07:07:13.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033818210000000001 2023-10-08T07:07:13.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257167+0000", 2023-10-08T07:07:13.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8318999999999997e-05 2023-10-08T07:07:13.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257225+0000", 2023-10-08T07:07:13.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7679000000000001e-05 2023-10-08T07:07:13.244 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.244 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.244 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.244 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36966 4.31 4:8de29a03:::10000000004.00000001:head [write 2809856~4096,write 3076096~4096,write 3096576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.244 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:13.244 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.834344995, 2023-10-08T07:07:13.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92525588800000003, 2023-10-08T07:07:13.244 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.244 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.245 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36966 2023-10-08T07:07:13.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.245 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:13.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:13.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332100+0000", 2023-10-08T07:07:13.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:13.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332121+0000", 2023-10-08T07:07:13.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0914999999999999e-05 2023-10-08T07:07:13.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332128+0000", 2023-10-08T07:07:13.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8709999999999997e-06 2023-10-08T07:07:13.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332134+0000", 2023-10-08T07:07:13.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0839999999999999e-06 2023-10-08T07:07:13.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332182+0000", 2023-10-08T07:07:13.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8310000000000003e-05 2023-10-08T07:07:13.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332187+0000", 2023-10-08T07:07:13.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.242e-06 2023-10-08T07:07:13.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248280+0000", 2023-10-08T07:07:13.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91609321899999996 2023-10-08T07:07:13.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248369+0000", 2023-10-08T07:07:13.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8895999999999997e-05 2023-10-08T07:07:13.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248536+0000", 2023-10-08T07:07:13.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016709099999999999 2023-10-08T07:07:13.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257075+0000", 2023-10-08T07:07:13.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085385300000000008 2023-10-08T07:07:13.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257266+0000", 2023-10-08T07:07:13.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019079399999999999 2023-10-08T07:07:13.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257305+0000", 2023-10-08T07:07:13.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8996999999999999e-05 2023-10-08T07:07:13.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257355+0000", 2023-10-08T07:07:13.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0129000000000001e-05 2023-10-08T07:07:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36968 4.31 4:8ec1b377:::10000000004.00000019:head [write 835584~4096,write 1372160~4096,write 1646592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.832624924999999, 2023-10-08T07:07:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92599244700000005, 2023-10-08T07:07:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.253 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36968 2023-10-08T07:07:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333820+0000", 2023-10-08T07:07:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1999999999999998e-07 2023-10-08T07:07:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333833+0000", 2023-10-08T07:07:13.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3574000000000001e-05 2023-10-08T07:07:13.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333848+0000", 2023-10-08T07:07:13.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4912999999999999e-05 2023-10-08T07:07:13.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333857+0000", 2023-10-08T07:07:13.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1270000000000003e-06 2023-10-08T07:07:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333903+0000", 2023-10-08T07:07:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6782e-05 2023-10-08T07:07:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333911+0000", 2023-10-08T07:07:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5020000000000003e-06 2023-10-08T07:07:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250170+0000", 2023-10-08T07:07:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91625966299999995 2023-10-08T07:07:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250263+0000", 2023-10-08T07:07:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2252999999999999e-05 2023-10-08T07:07:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250454+0000", 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019164400000000001 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258723+0000", 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082687699999999999 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259685+0000", 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00096196599999999997 2023-10-08T07:07:13.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259739+0000", 2023-10-08T07:07:13.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4147999999999997e-05 2023-10-08T07:07:13.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259811+0000", 2023-10-08T07:07:13.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2185000000000001e-05 2023-10-08T07:07:13.260 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.260 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.261 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37036 4.31 4:8ec1b377:::10000000004.00000019:head [write 3309568~4096,write 3510272~4096,write 3620864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.261 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:13.261 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.807208074, 2023-10-08T07:07:13.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.90288029999999997, 2023-10-08T07:07:13.261 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.261 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.262 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37036 2023-10-08T07:07:13.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.262 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:13.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:13.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:13.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6899999999999997e-07 2023-10-08T07:07:13.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359246+0000", 2023-10-08T07:07:13.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2369999999999998e-06 2023-10-08T07:07:13.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359254+0000", 2023-10-08T07:07:13.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4989999999999994e-06 2023-10-08T07:07:13.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359260+0000", 2023-10-08T07:07:13.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0209999999999996e-06 2023-10-08T07:07:13.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359319+0000", 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9042999999999997e-05 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359330+0000", 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0633e-05 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.251788+0000", 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89245758100000006 2023-10-08T07:07:13.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.251887+0000", 2023-10-08T07:07:13.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9223999999999997e-05 2023-10-08T07:07:13.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.252083+0000", 2023-10-08T07:07:13.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019611800000000001 2023-10-08T07:07:13.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258731+0000", 2023-10-08T07:07:13.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006648307 2023-10-08T07:07:13.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262036+0000", 2023-10-08T07:07:13.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033046550000000001 2023-10-08T07:07:13.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262069+0000", 2023-10-08T07:07:13.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2753000000000003e-05 2023-10-08T07:07:13.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262116+0000", 2023-10-08T07:07:13.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7559999999999999e-05 2023-10-08T07:07:13.268 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.268 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.268 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.268 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37068 4.31 4:8de29a03:::10000000004.00000001:head [write 987136~4096,write 1011712~4096,write 1044480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.269 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:13.269 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.795529103, 2023-10-08T07:07:13.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89311213899999997, 2023-10-08T07:07:13.269 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.269 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.269 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37068 2023-10-08T07:07:13.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.269 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:13.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:13.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370916+0000", 2023-10-08T07:07:13.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5000000000000002e-07 2023-10-08T07:07:13.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370956+0000", 2023-10-08T07:07:13.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0898e-05 2023-10-08T07:07:13.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370966+0000", 2023-10-08T07:07:13.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6209999999999999e-06 2023-10-08T07:07:13.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370973+0000", 2023-10-08T07:07:13.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.601e-06 2023-10-08T07:07:13.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.371022+0000", 2023-10-08T07:07:13.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9811999999999997e-05 2023-10-08T07:07:13.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.371032+0000", 2023-10-08T07:07:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8120000000000002e-06 2023-10-08T07:07:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254175+0000", 2023-10-08T07:07:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88314265599999997 2023-10-08T07:07:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254256+0000", 2023-10-08T07:07:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0820000000000002e-05 2023-10-08T07:07:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254436+0000", 2023-10-08T07:07:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000180044 2023-10-08T07:07:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261274+0000", 2023-10-08T07:07:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006838434 2023-10-08T07:07:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.263950+0000", 2023-10-08T07:07:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026753829999999999 2023-10-08T07:07:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.263981+0000", 2023-10-08T07:07:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1568e-05 2023-10-08T07:07:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.264027+0000", 2023-10-08T07:07:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5739999999999999e-05 2023-10-08T07:07:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37088 4.31 4:8de29a03:::10000000004.00000001:head [write 1466368~8192,write 1515520~4096,write 1523712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.787620226, 2023-10-08T07:07:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88701907199999996, 2023-10-08T07:07:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37088 2023-10-08T07:07:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378825+0000", 2023-10-08T07:07:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7199999999999997e-07 2023-10-08T07:07:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378841+0000", 2023-10-08T07:07:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5999e-05 2023-10-08T07:07:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378851+0000", 2023-10-08T07:07:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0474e-05 2023-10-08T07:07:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378858+0000", 2023-10-08T07:07:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9840000000000004e-06 2023-10-08T07:07:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378904+0000", 2023-10-08T07:07:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5704999999999997e-05 2023-10-08T07:07:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378910+0000", 2023-10-08T07:07:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5039999999999999e-06 2023-10-08T07:07:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255278+0000", 2023-10-08T07:07:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.87636765000000005 2023-10-08T07:07:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255385+0000", 2023-10-08T07:07:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000106667 2023-10-08T07:07:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255557+0000", 2023-10-08T07:07:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172957 2023-10-08T07:07:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261279+0000", 2023-10-08T07:07:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00572195 2023-10-08T07:07:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265761+0000", 2023-10-08T07:07:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004481423 2023-10-08T07:07:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265796+0000", 2023-10-08T07:07:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4727000000000001e-05 2023-10-08T07:07:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265843+0000", 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7160000000000002e-05 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37130 4.31 4:8ec1b377:::10000000004.00000019:head [write 1658880~4096,write 1736704~4096,write 1794048~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.770450342, 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86998378399999998, 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37130 2023-10-08T07:07:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395995+0000", 2023-10-08T07:07:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600000000000008e-07 2023-10-08T07:07:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396008+0000", 2023-10-08T07:07:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3067999999999999e-05 2023-10-08T07:07:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396019+0000", 2023-10-08T07:07:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1561e-05 2023-10-08T07:07:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396027+0000", 2023-10-08T07:07:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9039999999999992e-06 2023-10-08T07:07:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396075+0000", 2023-10-08T07:07:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8165999999999999e-05 2023-10-08T07:07:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396081+0000", 2023-10-08T07:07:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8279999999999999e-06 2023-10-08T07:07:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256171+0000", 2023-10-08T07:07:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86008956199999997 2023-10-08T07:07:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256218+0000", 2023-10-08T07:07:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7018000000000003e-05 2023-10-08T07:07:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256315+0000", 2023-10-08T07:07:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7285000000000001e-05 2023-10-08T07:07:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262125+0000", 2023-10-08T07:07:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058099110000000001 2023-10-08T07:07:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265890+0000", 2023-10-08T07:07:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037655829999999999 2023-10-08T07:07:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265929+0000", 2023-10-08T07:07:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8068999999999998e-05 2023-10-08T07:07:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265977+0000", 2023-10-08T07:07:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8832999999999998e-05 2023-10-08T07:07:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37183 4.31 4:8ec1b377:::10000000004.00000019:head [write 16384~4096,write 364544~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.751269284999999, 2023-10-08T07:07:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.85095945399999995, 2023-10-08T07:07:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37183 2023-10-08T07:07:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6499999999999998e-07 2023-10-08T07:07:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415186+0000", 2023-10-08T07:07:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0404999999999999e-05 2023-10-08T07:07:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415198+0000", 2023-10-08T07:07:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.187e-05 2023-10-08T07:07:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415204+0000", 2023-10-08T07:07:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5119999999999997e-06 2023-10-08T07:07:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415259+0000", 2023-10-08T07:07:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5269999999999998e-05 2023-10-08T07:07:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415270+0000", 2023-10-08T07:07:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0716e-05 2023-10-08T07:07:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257384+0000", 2023-10-08T07:07:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84211341500000003 2023-10-08T07:07:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257442+0000", 2023-10-08T07:07:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8780999999999998e-05 2023-10-08T07:07:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257538+0000", 2023-10-08T07:07:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5956000000000001e-05 2023-10-08T07:07:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265987+0000", 2023-10-08T07:07:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008449069 2023-10-08T07:07:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266053+0000", 2023-10-08T07:07:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5813000000000002e-05 2023-10-08T07:07:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266089+0000", 2023-10-08T07:07:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5827000000000001e-05 2023-10-08T07:07:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266134+0000", 2023-10-08T07:07:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5055000000000001e-05 2023-10-08T07:07:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37188 4.31 4:8de29a03:::10000000004.00000001:head [write 2031616~4096,write 2191360~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.749141964, 2023-10-08T07:07:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.850341613, 2023-10-08T07:07:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37188 2023-10-08T07:07:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417303+0000", 2023-10-08T07:07:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0599999999999999e-07 2023-10-08T07:07:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417315+0000", 2023-10-08T07:07:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2325e-05 2023-10-08T07:07:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417324+0000", 2023-10-08T07:07:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8489999999999995e-06 2023-10-08T07:07:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417331+0000", 2023-10-08T07:07:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4599999999999997e-06 2023-10-08T07:07:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417437+0000", 2023-10-08T07:07:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105305 2023-10-08T07:07:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417445+0000", 2023-10-08T07:07:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3040000000000005e-06 2023-10-08T07:07:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258113+0000", 2023-10-08T07:07:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84066830699999995 2023-10-08T07:07:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258168+0000", 2023-10-08T07:07:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4258999999999997e-05 2023-10-08T07:07:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258255+0000", 2023-10-08T07:07:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7235000000000001e-05 2023-10-08T07:07:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265993+0000", 2023-10-08T07:07:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077377599999999998 2023-10-08T07:07:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267565+0000", 2023-10-08T07:07:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001572314 2023-10-08T07:07:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267597+0000", 2023-10-08T07:07:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2361999999999999e-05 2023-10-08T07:07:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267644+0000", 2023-10-08T07:07:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6326999999999999e-05 2023-10-08T07:07:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37197 4.31 4:8de29a03:::10000000004.00000001:head [write 1859584~4096,write 2220032~4096,write 2322432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.745487984, 2023-10-08T07:07:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84767678599999996, 2023-10-08T07:07:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37197 2023-10-08T07:07:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420957+0000", 2023-10-08T07:07:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9199999999999999e-07 2023-10-08T07:07:13.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420969+0000", 2023-10-08T07:07:13.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1753000000000001e-05 2023-10-08T07:07:13.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420981+0000", 2023-10-08T07:07:13.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2479e-05 2023-10-08T07:07:13.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420989+0000", 2023-10-08T07:07:13.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0949999999999996e-06 2023-10-08T07:07:13.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.421053+0000", 2023-10-08T07:07:13.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4134999999999995e-05 2023-10-08T07:07:13.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.421062+0000", 2023-10-08T07:07:13.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8440000000000004e-06 2023-10-08T07:07:13.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258760+0000", 2023-10-08T07:07:13.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83769823499999996 2023-10-08T07:07:13.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258814+0000", 2023-10-08T07:07:13.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3876999999999999e-05 2023-10-08T07:07:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258913+0000", 2023-10-08T07:07:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8323e-05 2023-10-08T07:07:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265997+0000", 2023-10-08T07:07:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070839830000000003 2023-10-08T07:07:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268535+0000", 2023-10-08T07:07:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002538836 2023-10-08T07:07:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268574+0000", 2023-10-08T07:07:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8606000000000003e-05 2023-10-08T07:07:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268633+0000", 2023-10-08T07:07:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8727999999999997e-05 2023-10-08T07:07:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37227 4.31 4:8ec1b377:::10000000004.00000019:head [write 2760704~4096,write 2781184~4096,write 2850816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.734964013000001, 2023-10-08T07:07:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83736361400000003, 2023-10-08T07:07:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37227 2023-10-08T07:07:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431481+0000", 2023-10-08T07:07:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8400000000000003e-07 2023-10-08T07:07:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431512+0000", 2023-10-08T07:07:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0803999999999998e-05 2023-10-08T07:07:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431525+0000", 2023-10-08T07:07:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3704e-05 2023-10-08T07:07:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431535+0000", 2023-10-08T07:07:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2350000000000005e-06 2023-10-08T07:07:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431585+0000", 2023-10-08T07:07:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0531000000000001e-05 2023-10-08T07:07:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431594+0000", 2023-10-08T07:07:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7499999999999992e-06 2023-10-08T07:07:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259851+0000", 2023-10-08T07:07:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82825699399999997 2023-10-08T07:07:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259914+0000", 2023-10-08T07:07:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2928999999999993e-05 2023-10-08T07:07:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.260024+0000", 2023-10-08T07:07:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000110556 2023-10-08T07:07:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266001+0000", 2023-10-08T07:07:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059769910000000001 2023-10-08T07:07:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268694+0000", 2023-10-08T07:07:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026924119999999999 2023-10-08T07:07:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268754+0000", 2023-10-08T07:07:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0562000000000001e-05 2023-10-08T07:07:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268843+0000", 2023-10-08T07:07:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9262e-05 2023-10-08T07:07:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37233 4.31 4:8de29a03:::10000000004.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.732757054, 2023-10-08T07:07:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83766958000000002, 2023-10-08T07:07:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37233 2023-10-08T07:07:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433688+0000", 2023-10-08T07:07:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2023-10-08T07:07:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433701+0000", 2023-10-08T07:07:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3869000000000001e-05 2023-10-08T07:07:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433714+0000", 2023-10-08T07:07:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2173e-05 2023-10-08T07:07:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433720+0000", 2023-10-08T07:07:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7449999999999998e-06 2023-10-08T07:07:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433772+0000", 2023-10-08T07:07:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1242999999999997e-05 2023-10-08T07:07:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433781+0000", 2023-10-08T07:07:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1360000000000003e-06 2023-10-08T07:07:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261313+0000", 2023-10-08T07:07:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82753250300000003 2023-10-08T07:07:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261367+0000", 2023-10-08T07:07:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3664e-05 2023-10-08T07:07:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261467+0000", 2023-10-08T07:07:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9668999999999997e-05 2023-10-08T07:07:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266010+0000", 2023-10-08T07:07:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045437189999999999 2023-10-08T07:07:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271269+0000", 2023-10-08T07:07:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052584900000000002 2023-10-08T07:07:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271310+0000", 2023-10-08T07:07:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1057999999999999e-05 2023-10-08T07:07:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271356+0000", 2023-10-08T07:07:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6582999999999998e-05 2023-10-08T07:07:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:13.331 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:13.331 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:13.332 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:13.332+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:13.332 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:13.433 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:13.432+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:13.516 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:13.517 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:13.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.517 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:75283 4.2 4:40ea7945:::10000000004.0000003e:head [write 565248~4096 in=4096b,write 782336~4096 in=4096b,write 897024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:13.517 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:13.493374+0000", 2023-10-08T07:07:13.517 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.022598590000000002, 2023-10-08T07:07:13.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022619956, 2023-10-08T07:07:13.517 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:13.517 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:13.518 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:13.518 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:13.518 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.518 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 75283 2023-10-08T07:07:13.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.518 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:13.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:13.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.493374+0000", 2023-10-08T07:07:13.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:13.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.493374+0000", 2023-10-08T07:07:13.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:13.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.493374+0000", 2023-10-08T07:07:13.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9699999999999995e-07 2023-10-08T07:07:13.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:13.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.493387+0000", 2023-10-08T07:07:13.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2512e-05 2023-10-08T07:07:13.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:13.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.493400+0000", 2023-10-08T07:07:13.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2517999999999999e-05 2023-10-08T07:07:13.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.493410+0000", 2023-10-08T07:07:13.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0023e-05 2023-10-08T07:07:13.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:13.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.496918+0000", 2023-10-08T07:07:13.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0035079579999999998 2023-10-08T07:07:13.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:13.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.496968+0000", 2023-10-08T07:07:13.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0640000000000003e-05 2023-10-08T07:07:13.522 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.522 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:13.522 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.522 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop_reply(client.4556.0:75309 4.3a e53/17)", 2023-10-08T07:07:13.522 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:13.515756+0000", 2023-10-08T07:07:13.522 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.000216283, 2023-10-08T07:07:13.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00028088400000000002, 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.515756+0000", 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.515756+0000", 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:13.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.515757+0000", 2023-10-08T07:07:13.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4600000000000004e-07 2023-10-08T07:07:13.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:13.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.515761+0000", 2023-10-08T07:07:13.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5839999999999996e-06 2023-10-08T07:07:13.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:13.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.515776+0000", 2023-10-08T07:07:13.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4438e-05 2023-10-08T07:07:13.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.515784+0000", 2023-10-08T07:07:13.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9500000000000001e-06 2023-10-08T07:07:13.525 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.525 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:13.525 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.526 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:75294 4.2 4:43cef10a:::10000000004.00000030:head [write 1069056~4096 in=4096b,write 1257472~4096 in=4096b,write 1282048~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:13.526 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:13.496786+0000", 2023-10-08T07:07:13.526 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.019186473999999999, 2023-10-08T07:07:13.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019284196, 2023-10-08T07:07:13.526 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:13.526 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:13.526 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:13.526 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:13.526 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.526 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 75294 2023-10-08T07:07:13.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.527 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:13.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:13.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.496786+0000", 2023-10-08T07:07:13.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:13.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.496786+0000", 2023-10-08T07:07:13.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:13.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.496787+0000", 2023-10-08T07:07:13.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7599999999999996e-07 2023-10-08T07:07:13.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.496818+0000", 2023-10-08T07:07:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1547000000000001e-05 2023-10-08T07:07:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.496827+0000", 2023-10-08T07:07:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1910000000000006e-06 2023-10-08T07:07:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.496834+0000", 2023-10-08T07:07:13.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1180000000000003e-06 2023-10-08T07:07:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.498772+0000", 2023-10-08T07:07:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001937963 2023-10-08T07:07:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.498859+0000", 2023-10-08T07:07:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6699000000000005e-05 2023-10-08T07:07:13.530 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:75297 4.2 4:43cef10a:::10000000004.00000030:head [write 1957888~4096 in=4096b,write 2039808~4096 in=4096b,write 2052096~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:13.497675+0000", 2023-10-08T07:07:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.018297593000000001, 2023-10-08T07:07:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018437234, 2023-10-08T07:07:13.531 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 75297 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.497675+0000", 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.497675+0000", 2023-10-08T07:07:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.497675+0000", 2023-10-08T07:07:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.61e-07 2023-10-08T07:07:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.533 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:13.534 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.497719+0000", 2023-10-08T07:07:13.534 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3877e-05 2023-10-08T07:07:13.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.534 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.534 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:13.534 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.497727+0000", 2023-10-08T07:07:13.534 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2479999999999996e-06 2023-10-08T07:07:13.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.534 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.534 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.534 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.497734+0000", 2023-10-08T07:07:13.535 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9929999999999998e-06 2023-10-08T07:07:13.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:13.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.500703+0000", 2023-10-08T07:07:13.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029684149999999999 2023-10-08T07:07:13.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.536 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:13.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.500792+0000", 2023-10-08T07:07:13.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9217999999999999e-05 2023-10-08T07:07:13.536 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.537 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:13.537 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.537 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:75309 4.3a 4:5f183e4b:::10000000004.00000023:head [write 159744~8192 in=8192b,write 331776~4096 in=4096b,write 352256~4096 in=4096b,write 577536~4096 in=4096b,write 753664~4096 in=4096b,write 864256~4096 in=4096b,write 925696~4096 in=4096b,write 974848~4096 in=4096b,write 999424~4096 in=4096b,write 1138688~4096 in=4096b,write 2048000~4096 in=4096b,write 2174976~4096 in=4096b,write 2265088~4096 in=4096b,write 2310144~4096 in=4096b,write 2416640~4096 in=4096b,write 2502656~4096 in=4096b,write 2564096~4096 in=4096b,write 2670592~4096 in=4096b,write 2682880~4096 in=4096b,write 2752512~4096 in=4096b,write 2945024~4096 in=4096b,write 2953216~4096 in=4096b,write 2977792~4096 in=4096b,write 3035136~4096 in=4096b,write 3092480~4096 in=4096b,write 3297280~4096 in=4096b,write 3313664~4096 in=4096b,write 3325952~4096 in=4096b,write 3772416~4096 in=4096b,write 3911680~4096 in=4096b,write 4120576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:13.537 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:13.501945+0000", 2023-10-08T07:07:13.537 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.014027235000000001, 2023-10-08T07:07:13.537 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014229636, 2023-10-08T07:07:13.537 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:13.537 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:13.538 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:13.538 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:13.538 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.538 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 75309 2023-10-08T07:07:13.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.538 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:13.538 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.538 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:13.538 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.501945+0000", 2023-10-08T07:07:13.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.539 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.539 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:13.539 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.501945+0000", 2023-10-08T07:07:13.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.539 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.501946+0000", 2023-10-08T07:07:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.09e-07 2023-10-08T07:07:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.501999+0000", 2023-10-08T07:07:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3400999999999999e-05 2023-10-08T07:07:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502011+0000", 2023-10-08T07:07:13.541 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1731e-05 2023-10-08T07:07:13.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.541 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.541 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.541 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502019+0000", 2023-10-08T07:07:13.541 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8709999999999997e-06 2023-10-08T07:07:13.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.541 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.541 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:13.541 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502065+0000", 2023-10-08T07:07:13.541 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6629999999999999e-05 2023-10-08T07:07:13.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.542 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:13.542 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502167+0000", 2023-10-08T07:07:13.542 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000101984 2023-10-08T07:07:13.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.542 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:13.542 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502693+0000", 2023-10-08T07:07:13.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00052510399999999998 2023-10-08T07:07:13.543 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.543 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:13.543 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.543 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:75310 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1355776~8192 in=8192b,write 1421312~4096 in=4096b,write 1544192~8192 in=8192b,write 1658880~4096 in=4096b,write 1691648~8192 in=8192b,write 1728512~4096 in=4096b,write 1740800~4096 in=4096b,write 1769472~4096 in=4096b,write 1957888~4096 in=4096b,write 2019328~4096 in=4096b,write 2072576~4096 in=4096b,write 2088960~4096 in=4096b,write 2097152~4096 in=4096b,write 2121728~4096 in=4096b,write 2129920~4096 in=4096b,write 2195456~4096 in=4096b,write 2457600~4096 in=4096b,write 2560000~4096 in=4096b,write 2826240~4096 in=4096b,write 2854912~4096 in=4096b,write 2924544~4096 in=4096b,write 2945024~8192 in=8192b,write 3051520~4096 in=4096b,write 3088384~4096 in=4096b,write 3096576~4096 in=4096b,write 3616768~4096 in=4096b,write 3645440~4096 in=4096b,write 3723264~4096 in=4096b,write 4014080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:13.543 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:13.502042+0000", 2023-10-08T07:07:13.543 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013930117000000001, 2023-10-08T07:07:13.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014205186, 2023-10-08T07:07:13.543 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:13.543 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:13.544 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:13.544 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:13.544 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.544 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 75310 2023-10-08T07:07:13.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.544 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:13.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:13.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502042+0000", 2023-10-08T07:07:13.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.545 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:13.545 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502042+0000", 2023-10-08T07:07:13.545 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.545 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.545 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:13.545 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502043+0000", 2023-10-08T07:07:13.545 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3799999999999997e-07 2023-10-08T07:07:13.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.545 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.545 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:13.545 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502152+0000", 2023-10-08T07:07:13.546 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000108875 2023-10-08T07:07:13.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.546 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.546 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:13.546 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502162+0000", 2023-10-08T07:07:13.546 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0176e-05 2023-10-08T07:07:13.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.546 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.546 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.546 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502169+0000", 2023-10-08T07:07:13.546 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8530000000000003e-06 2023-10-08T07:07:13.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.547 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:13.547 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.509825+0000", 2023-10-08T07:07:13.547 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0076567090000000003 2023-10-08T07:07:13.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.547 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:13.547 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.509945+0000", 2023-10-08T07:07:13.547 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011951900000000001 2023-10-08T07:07:13.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.548 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:13.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.510544+0000", 2023-10-08T07:07:13.548 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000599246 2023-10-08T07:07:13.548 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.548 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:13.548 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.548 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:75312 4.32 4:4efc9492:::10000000004.00000032:head [write 1892352~4096 in=4096b,write 1994752~4096 in=4096b,write 2084864~4096 in=4096b,write 2129920~4096 in=4096b,write 2146304~4096 in=4096b,write 2433024~4096 in=4096b,write 2691072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:13.548 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:13.502522+0000", 2023-10-08T07:07:13.549 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013450389, 2023-10-08T07:07:13.549 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013813881, 2023-10-08T07:07:13.549 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:13.549 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:13.550 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:13.550 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:13.550 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.550 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 75312 2023-10-08T07:07:13.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.550 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:13.550 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.550 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:13.550 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502522+0000", 2023-10-08T07:07:13.550 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.551 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.551 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:13.551 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502522+0000", 2023-10-08T07:07:13.551 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.551 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.551 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:13.551 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502523+0000", 2023-10-08T07:07:13.551 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6400000000000002e-07 2023-10-08T07:07:13.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.552 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.552 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:13.552 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502556+0000", 2023-10-08T07:07:13.552 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2968e-05 2023-10-08T07:07:13.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.552 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.552 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:13.553 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502564+0000", 2023-10-08T07:07:13.553 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1049999999999995e-06 2023-10-08T07:07:13.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.553 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.553 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502570+0000", 2023-10-08T07:07:13.553 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1709999999999999e-06 2023-10-08T07:07:13.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.553 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:13.553 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.509803+0000", 2023-10-08T07:07:13.553 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0072334610000000001 2023-10-08T07:07:13.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.554 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:13.554 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.509857+0000", 2023-10-08T07:07:13.554 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3607999999999999e-05 2023-10-08T07:07:13.554 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.554 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:13.554 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.554 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:75313 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 368640~4096 in=4096b,write 663552~4096 in=4096b,write 929792~4096 in=4096b,write 1015808~4096 in=4096b,write 1249280~4096 in=4096b,write 1417216~4096 in=4096b,write 1642496~4096 in=4096b,write 1708032~4096 in=4096b,write 1970176~4096 in=4096b,write 2232320~4096 in=4096b,write 2572288~4096 in=4096b,write 2723840~4096 in=4096b,write 2985984~4096 in=4096b,write 3411968~4096 in=4096b,write 3665920~4096 in=4096b,write 3784704~4096 in=4096b,write 4046848~4096 in=4096b,write 4096000~4096 in=4096b,write 4190208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:13.555 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:13.502580+0000", 2023-10-08T07:07:13.555 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013391953999999999, 2023-10-08T07:07:13.555 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013812721, 2023-10-08T07:07:13.555 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:13.555 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:13.555 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:13.555 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:13.555 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.555 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 75313 2023-10-08T07:07:13.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.556 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:13.556 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.556 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:13.556 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502580+0000", 2023-10-08T07:07:13.556 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.556 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.557 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:13.557 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502580+0000", 2023-10-08T07:07:13.557 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.557 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:13.557 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502581+0000", 2023-10-08T07:07:13.557 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0999999999999999e-07 2023-10-08T07:07:13.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.558 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:13.558 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502635+0000", 2023-10-08T07:07:13.558 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4286999999999997e-05 2023-10-08T07:07:13.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.558 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.558 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:13.558 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502643+0000", 2023-10-08T07:07:13.558 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3629999999999994e-06 2023-10-08T07:07:13.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.558 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.558 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.559 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.502650+0000", 2023-10-08T07:07:13.559 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.516e-06 2023-10-08T07:07:13.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.559 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.559 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:13.559 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.516246+0000", 2023-10-08T07:07:13.559 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013596306000000001 2023-10-08T07:07:13.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.559 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.559 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:13.559 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.516305+0000", 2023-10-08T07:07:13.560 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8471999999999999e-05 2023-10-08T07:07:13.560 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.560 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:13.560 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.560 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.560 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:75319 4.1a 4.5c1f9a5a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:13.560 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:13.503231+0000", 2023-10-08T07:07:13.560 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.012741786, 2023-10-08T07:07:13.560 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013203032, 2023-10-08T07:07:13.560 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:13.560 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:13.561 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:13.561 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:13.561 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:13.561 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 75319 2023-10-08T07:07:13.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.561 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:13.561 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.561 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:13.561 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.503231+0000", 2023-10-08T07:07:13.561 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.561 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.503231+0000", 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.503231+0000", 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2900000000000004e-07 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.503258+0000", 2023-10-08T07:07:13.562 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7376e-05 2023-10-08T07:07:13.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.563 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.563 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:13.563 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.503265+0000", 2023-10-08T07:07:13.563 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0269999999999998e-06 2023-10-08T07:07:13.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:13.564 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:13.564 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:13.564 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:13.503271+0000", 2023-10-08T07:07:13.564 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4530000000000001e-06 2023-10-08T07:07:13.564 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.564 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:13.564 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.564 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:13.564 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:07:13.564 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 9 2023-10-08T07:07:13.564 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:13.566 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:13.567 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:13.566+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:13.666 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:13.666+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:13.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2023-10-08T07:07:13.769 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:13.768+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:13.807 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:13.807 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:13.807 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:13.807 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:13.807 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:13.820 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:13.905 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:13.904+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:13.971 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:13.970+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:14.063 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:14.063 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:14.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:14.063 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:14.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.063 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:63784 4.2b 4:d7a77d67:::10000000004.00000029:head [write 2379776~4096,write 2564096~4096,write 2748416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-10-08T07:07:14.064 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:09.255100+0000", 2023-10-08T07:07:14.064 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.8041377929999998, 2023-10-08T07:07:14.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037549842999999999, 2023-10-08T07:07:14.064 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.064 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.064 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.064 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.064 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.064 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 63784 2023-10-08T07:07:14.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.065 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.065 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.065 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255100+0000", 2023-10-08T07:07:14.065 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255100+0000", 2023-10-08T07:07:14.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.067 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255101+0000", 2023-10-08T07:07:14.067 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5300000000000004e-07 2023-10-08T07:07:14.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.067 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.067 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255111+0000", 2023-10-08T07:07:14.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0002e-05 2023-10-08T07:07:14.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.068 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255121+0000", 2023-10-08T07:07:14.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0488e-05 2023-10-08T07:07:14.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255126+0000", 2023-10-08T07:07:14.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1250000000000001e-06 2023-10-08T07:07:14.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255172+0000", 2023-10-08T07:07:14.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5133000000000003e-05 2023-10-08T07:07:14.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255271+0000", 2023-10-08T07:07:14.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9729999999999996e-05 2023-10-08T07:07:14.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.255463+0000", 2023-10-08T07:07:14.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000191807 2023-10-08T07:07:14.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.259736+0000", 2023-10-08T07:07:14.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042731959999999999 2023-10-08T07:07:14.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.072 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.072 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.292524+0000", 2023-10-08T07:07:14.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032787281000000001 2023-10-08T07:07:14.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.072 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.072 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.292593+0000", 2023-10-08T07:07:14.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8997000000000004e-05 2023-10-08T07:07:14.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.074 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.074 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.074 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:09.292650+0000", 2023-10-08T07:07:14.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7431e-05 2023-10-08T07:07:14.074 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.074 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.074 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.074 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72413 4.20 4:07572838:::10000000004.00000010:head [write 3772416~8192,write 3903488~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.453084+0000", 2023-10-08T07:07:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.6061543199999999, 2023-10-08T07:07:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.038374026999999998, 2023-10-08T07:07:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72413 2023-10-08T07:07:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.453084+0000", 2023-10-08T07:07:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.453084+0000", 2023-10-08T07:07:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.453084+0000", 2023-10-08T07:07:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4399999999999999e-07 2023-10-08T07:07:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.453115+0000", 2023-10-08T07:07:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1010000000000003e-05 2023-10-08T07:07:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.453126+0000", 2023-10-08T07:07:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0249e-05 2023-10-08T07:07:14.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.453132+0000", 2023-10-08T07:07:14.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5989999999999998e-06 2023-10-08T07:07:14.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.455347+0000", 2023-10-08T07:07:14.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022149050000000001 2023-10-08T07:07:14.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.455399+0000", 2023-10-08T07:07:14.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1934000000000001e-05 2023-10-08T07:07:14.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.455490+0000", 2023-10-08T07:07:14.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0618000000000006e-05 2023-10-08T07:07:14.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.462161+0000", 2023-10-08T07:07:14.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0066711690000000002 2023-10-08T07:07:14.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.080 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.491361+0000", 2023-10-08T07:07:14.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.029199695000000001 2023-10-08T07:07:14.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.080 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.491420+0000", 2023-10-08T07:07:14.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9723999999999999e-05 2023-10-08T07:07:14.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.081 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.081 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.491458+0000", 2023-10-08T07:07:14.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7379999999999998e-05 2023-10-08T07:07:14.081 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.081 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.081 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.081 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72574 4.20 4:04004f2c:::10000000004.0000000d:head [write 3334144~4096,write 3764224~4096,write 3784704~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.082 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.537531+0000", 2023-10-08T07:07:14.082 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.5217072809999999, 2023-10-08T07:07:14.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.038668988000000001, 2023-10-08T07:07:14.082 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.082 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.082 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.082 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.082 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.082 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72574 2023-10-08T07:07:14.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.083 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.083 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537531+0000", 2023-10-08T07:07:14.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.083 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537531+0000", 2023-10-08T07:07:14.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537531+0000", 2023-10-08T07:07:14.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9500000000000001e-07 2023-10-08T07:07:14.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537542+0000", 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0769e-05 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537553+0000", 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1192000000000001e-05 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537561+0000", 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9719999999999992e-06 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537617+0000", 2023-10-08T07:07:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5757999999999997e-05 2023-10-08T07:07:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537715+0000", 2023-10-08T07:07:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8102000000000004e-05 2023-10-08T07:07:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537907+0000", 2023-10-08T07:07:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019132700000000001 2023-10-08T07:07:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544033+0000", 2023-10-08T07:07:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0061259749999999996 2023-10-08T07:07:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.576135+0000", 2023-10-08T07:07:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032102670999999999 2023-10-08T07:07:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.088 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.088 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.576170+0000", 2023-10-08T07:07:14.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4974000000000001e-05 2023-10-08T07:07:14.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.088 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.088 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.576200+0000", 2023-10-08T07:07:14.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9453000000000001e-05 2023-10-08T07:07:14.088 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.088 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.089 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.089 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72576 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 2682880~4096,write 3039232~4096,write 3063808~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.089 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.538374+0000", 2023-10-08T07:07:14.089 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.520864038, 2023-10-08T07:07:14.089 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.040481140999999998, 2023-10-08T07:07:14.089 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.089 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.089 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.090 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.090 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.093 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72576 2023-10-08T07:07:14.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.093 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538374+0000", 2023-10-08T07:07:14.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538374+0000", 2023-10-08T07:07:14.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538375+0000", 2023-10-08T07:07:14.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3200000000000004e-07 2023-10-08T07:07:14.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538386+0000", 2023-10-08T07:07:14.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1491000000000001e-05 2023-10-08T07:07:14.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538395+0000", 2023-10-08T07:07:14.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8999999999999995e-06 2023-10-08T07:07:14.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538399+0000", 2023-10-08T07:07:14.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4460000000000003e-06 2023-10-08T07:07:14.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538445+0000", 2023-10-08T07:07:14.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5800000000000002e-05 2023-10-08T07:07:14.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538504+0000", 2023-10-08T07:07:14.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8369000000000003e-05 2023-10-08T07:07:14.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538631+0000", 2023-10-08T07:07:14.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012735700000000001 2023-10-08T07:07:14.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.098 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544010+0000", 2023-10-08T07:07:14.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0053793280000000001 2023-10-08T07:07:14.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.098 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578794+0000", 2023-10-08T07:07:14.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.034783364999999997 2023-10-08T07:07:14.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578830+0000", 2023-10-08T07:07:14.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6233999999999999e-05 2023-10-08T07:07:14.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578855+0000", 2023-10-08T07:07:14.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5119000000000001e-05 2023-10-08T07:07:14.099 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.099 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.100 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.100 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72577 4.20 4:07572838:::10000000004.00000010:head [write 577536~4096,write 659456~4096,write 823296~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.100 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.538752+0000", 2023-10-08T07:07:14.100 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.520485541, 2023-10-08T07:07:14.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.043883168, 2023-10-08T07:07:14.100 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.100 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.100 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.100 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.101 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.101 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72577 2023-10-08T07:07:14.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.101 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538752+0000", 2023-10-08T07:07:14.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538752+0000", 2023-10-08T07:07:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538753+0000", 2023-10-08T07:07:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2799999999999995e-07 2023-10-08T07:07:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538764+0000", 2023-10-08T07:07:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1263e-05 2023-10-08T07:07:14.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538777+0000", 2023-10-08T07:07:14.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3042e-05 2023-10-08T07:07:14.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538785+0000", 2023-10-08T07:07:14.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7330000000000003e-06 2023-10-08T07:07:14.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.540416+0000", 2023-10-08T07:07:14.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00163061 2023-10-08T07:07:14.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.540484+0000", 2023-10-08T07:07:14.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8625000000000001e-05 2023-10-08T07:07:14.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.540586+0000", 2023-10-08T07:07:14.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000101372 2023-10-08T07:07:14.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547848+0000", 2023-10-08T07:07:14.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0072625370000000003 2023-10-08T07:07:14.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.582558+0000", 2023-10-08T07:07:14.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.034709679 2023-10-08T07:07:14.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.582593+0000", 2023-10-08T07:07:14.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4892999999999999e-05 2023-10-08T07:07:14.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.582636+0000", 2023-10-08T07:07:14.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2685999999999998e-05 2023-10-08T07:07:14.106 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.106 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.106 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.107 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72578 4.1a 4:5a59f83a:::10000000004.00000002:head [write 581632~4096,write 614400~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.107 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.538954+0000", 2023-10-08T07:07:14.107 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.5202840210000002, 2023-10-08T07:07:14.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045067301999999997, 2023-10-08T07:07:14.107 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.107 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.107 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.107 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.107 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.108 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72578 2023-10-08T07:07:14.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.108 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.108 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.108 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.108 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538954+0000", 2023-10-08T07:07:14.108 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.108 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.108 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.108 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538954+0000", 2023-10-08T07:07:14.108 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538955+0000", 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7700000000000004e-07 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538966+0000", 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1403000000000001e-05 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538976+0000", 2023-10-08T07:07:14.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9150000000000008e-06 2023-10-08T07:07:14.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538984+0000", 2023-10-08T07:07:14.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4649999999999997e-06 2023-10-08T07:07:14.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.539039+0000", 2023-10-08T07:07:14.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5417999999999997e-05 2023-10-08T07:07:14.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.111 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.111 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.111 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.539139+0000", 2023-10-08T07:07:14.111 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100029 2023-10-08T07:07:14.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.111 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.111 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.111 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.539269+0000", 2023-10-08T07:07:14.111 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013011500000000001 2023-10-08T07:07:14.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546574+0000", 2023-10-08T07:07:14.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0073052120000000002 2023-10-08T07:07:14.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.583918+0000", 2023-10-08T07:07:14.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037344048999999997 2023-10-08T07:07:14.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.113 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.583981+0000", 2023-10-08T07:07:14.113 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2403999999999994e-05 2023-10-08T07:07:14.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.113 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.113 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.584021+0000", 2023-10-08T07:07:14.113 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0515000000000001e-05 2023-10-08T07:07:14.113 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.113 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.113 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.114 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72592 4.2b 4:d7a77d67:::10000000004.00000029:head [write 1245184~4096,write 2768896~4096,write 2813952~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.114 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.544339+0000", 2023-10-08T07:07:14.114 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.5148989099999999, 2023-10-08T07:07:14.114 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.039804996000000002, 2023-10-08T07:07:14.114 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.114 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.114 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.114 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.114 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.114 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72592 2023-10-08T07:07:14.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.114 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.115 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.115 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.115 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544339+0000", 2023-10-08T07:07:14.115 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.115 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.115 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.115 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544339+0000", 2023-10-08T07:07:14.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.116 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.116 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.116 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544340+0000", 2023-10-08T07:07:14.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.24e-06 2023-10-08T07:07:14.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.116 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.116 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.116 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544355+0000", 2023-10-08T07:07:14.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4375999999999999e-05 2023-10-08T07:07:14.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.117 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.117 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.117 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544374+0000", 2023-10-08T07:07:14.117 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9553000000000001e-05 2023-10-08T07:07:14.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.117 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.117 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.117 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544385+0000", 2023-10-08T07:07:14.117 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0919e-05 2023-10-08T07:07:14.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.117 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.117 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.118 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544462+0000", 2023-10-08T07:07:14.118 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6981e-05 2023-10-08T07:07:14.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.118 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.118 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.118 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544523+0000", 2023-10-08T07:07:14.118 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1328000000000006e-05 2023-10-08T07:07:14.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.118 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.118 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.118 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544622+0000", 2023-10-08T07:07:14.118 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8654999999999996e-05 2023-10-08T07:07:14.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.119 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.119 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.119 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.550605+0000", 2023-10-08T07:07:14.119 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0059832490000000004 2023-10-08T07:07:14.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.119 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.119 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.119 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.584042+0000", 2023-10-08T07:07:14.119 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033436968999999997 2023-10-08T07:07:14.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.119 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.584104+0000", 2023-10-08T07:07:14.120 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1768999999999998e-05 2023-10-08T07:07:14.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.120 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.584144+0000", 2023-10-08T07:07:14.120 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9956999999999997e-05 2023-10-08T07:07:14.120 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.121 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.121 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.121 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.121 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72598 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2424832~4096,write 2437120~4096,write 2531328~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.121 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.546345+0000", 2023-10-08T07:07:14.121 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.5128931290000001, 2023-10-08T07:07:14.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.043758261999999999, 2023-10-08T07:07:14.121 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.121 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.121 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.122 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.122 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.122 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72598 2023-10-08T07:07:14.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.122 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.122 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.122 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.122 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546345+0000", 2023-10-08T07:07:14.122 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.122 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.123 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.123 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546345+0000", 2023-10-08T07:07:14.123 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.123 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.123 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.123 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546346+0000", 2023-10-08T07:07:14.123 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.37e-07 2023-10-08T07:07:14.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.123 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.123 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.123 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546359+0000", 2023-10-08T07:07:14.124 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3524e-05 2023-10-08T07:07:14.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.124 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.124 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.124 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546369+0000", 2023-10-08T07:07:14.124 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8579999999999995e-06 2023-10-08T07:07:14.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.124 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.124 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.124 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546376+0000", 2023-10-08T07:07:14.124 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4309999999999997e-06 2023-10-08T07:07:14.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.125 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.125 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546427+0000", 2023-10-08T07:07:14.125 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.062e-05 2023-10-08T07:07:14.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.125 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.125 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546474+0000", 2023-10-08T07:07:14.125 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7227e-05 2023-10-08T07:07:14.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.126 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546573+0000", 2023-10-08T07:07:14.126 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8974999999999993e-05 2023-10-08T07:07:14.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.126 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556680+0000", 2023-10-08T07:07:14.126 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010106499999999999 2023-10-08T07:07:14.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.127 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590041+0000", 2023-10-08T07:07:14.127 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033361518999999999 2023-10-08T07:07:14.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.127 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.127 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590078+0000", 2023-10-08T07:07:14.127 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6346000000000001e-05 2023-10-08T07:07:14.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.127 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.127 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590103+0000", 2023-10-08T07:07:14.127 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5525e-05 2023-10-08T07:07:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72601 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2727936~4096,write 2826240~4096,write 2879488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.547272+0000", 2023-10-08T07:07:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.5119655939999999, 2023-10-08T07:07:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.042932953000000003, 2023-10-08T07:07:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.128 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.129 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.129 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.129 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72601 2023-10-08T07:07:14.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.129 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.129 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.129 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547272+0000", 2023-10-08T07:07:14.129 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.129 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547272+0000", 2023-10-08T07:07:14.130 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547273+0000", 2023-10-08T07:07:14.130 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7100000000000001e-07 2023-10-08T07:07:14.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547283+0000", 2023-10-08T07:07:14.130 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6609999999999995e-06 2023-10-08T07:07:14.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.131 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.131 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547295+0000", 2023-10-08T07:07:14.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1857e-05 2023-10-08T07:07:14.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.131 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.131 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547306+0000", 2023-10-08T07:07:14.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1178999999999999e-05 2023-10-08T07:07:14.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.132 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.132 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548790+0000", 2023-10-08T07:07:14.132 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0014839020000000001 2023-10-08T07:07:14.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.132 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.132 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548847+0000", 2023-10-08T07:07:14.132 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7108999999999998e-05 2023-10-08T07:07:14.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.133 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.133 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548984+0000", 2023-10-08T07:07:14.133 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013750599999999999 2023-10-08T07:07:14.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.133 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.133 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556692+0000", 2023-10-08T07:07:14.133 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0077079519999999997 2023-10-08T07:07:14.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.133 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.134 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590140+0000", 2023-10-08T07:07:14.134 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033447986999999998 2023-10-08T07:07:14.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.134 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.134 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590175+0000", 2023-10-08T07:07:14.134 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4857000000000002e-05 2023-10-08T07:07:14.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.134 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.135 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590205+0000", 2023-10-08T07:07:14.135 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:07:14.135 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.135 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.135 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.135 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72603 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1417216~4096,write 1564672~4096,write 1576960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.135 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.547830+0000", 2023-10-08T07:07:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.511407825, 2023-10-08T07:07:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.042451044, 2023-10-08T07:07:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72603 2023-10-08T07:07:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547830+0000", 2023-10-08T07:07:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547830+0000", 2023-10-08T07:07:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547831+0000", 2023-10-08T07:07:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8500000000000002e-07 2023-10-08T07:07:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547850+0000", 2023-10-08T07:07:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9638000000000001e-05 2023-10-08T07:07:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547874+0000", 2023-10-08T07:07:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.366e-05 2023-10-08T07:07:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547892+0000", 2023-10-08T07:07:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:07:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.550708+0000", 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0028162930000000001 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.550778+0000", 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9561999999999996e-05 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.550916+0000", 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000138446 2023-10-08T07:07:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556701+0000", 2023-10-08T07:07:14.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0057844910000000001 2023-10-08T07:07:14.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590230+0000", 2023-10-08T07:07:14.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033529033 2023-10-08T07:07:14.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.143 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590260+0000", 2023-10-08T07:07:14.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.0246000000000001e-05 2023-10-08T07:07:14.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.143 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.143 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590281+0000", 2023-10-08T07:07:14.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1098e-05 2023-10-08T07:07:14.143 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.143 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.143 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.144 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.144 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72607 4.3a 4:5f183e4b:::10000000004.00000023:head [write 1433600~4096,write 1736704~4096,write 1810432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.144 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.548926+0000", 2023-10-08T07:07:14.144 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.5103124569999999, 2023-10-08T07:07:14.144 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.041441020000000002, 2023-10-08T07:07:14.144 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.144 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.144 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.144 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.144 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.145 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72607 2023-10-08T07:07:14.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.145 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.145 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.145 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548926+0000", 2023-10-08T07:07:14.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.146 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548926+0000", 2023-10-08T07:07:14.146 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548926+0000", 2023-10-08T07:07:14.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3900000000000004e-07 2023-10-08T07:07:14.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548952+0000", 2023-10-08T07:07:14.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5888e-05 2023-10-08T07:07:14.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548962+0000", 2023-10-08T07:07:14.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.431e-06 2023-10-08T07:07:14.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548969+0000", 2023-10-08T07:07:14.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3440000000000003e-06 2023-10-08T07:07:14.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.149 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.149 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552528+0000", 2023-10-08T07:07:14.149 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0035591590000000001 2023-10-08T07:07:14.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.149 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.149 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552611+0000", 2023-10-08T07:07:14.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2358e-05 2023-10-08T07:07:14.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.150 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.150 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.150 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552709+0000", 2023-10-08T07:07:14.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8454000000000003e-05 2023-10-08T07:07:14.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.150 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.150 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.150 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560149+0000", 2023-10-08T07:07:14.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074399560000000002 2023-10-08T07:07:14.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.151 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.151 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590302+0000", 2023-10-08T07:07:14.151 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.030153197 2023-10-08T07:07:14.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.151 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.151 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590330+0000", 2023-10-08T07:07:14.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8136999999999998e-05 2023-10-08T07:07:14.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590367+0000", 2023-10-08T07:07:14.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6257000000000002e-05 2023-10-08T07:07:14.152 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.152 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.152 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.152 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72620 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 970752~4096,write 1105920~4096,write 1142784~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.153 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.552349+0000", 2023-10-08T07:07:14.153 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.5068892200000001, 2023-10-08T07:07:14.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.038099157000000002, 2023-10-08T07:07:14.153 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.153 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.153 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.153 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.153 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.153 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72620 2023-10-08T07:07:14.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.153 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.154 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.154 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552349+0000", 2023-10-08T07:07:14.154 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.154 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.154 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552349+0000", 2023-10-08T07:07:14.154 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552349+0000", 2023-10-08T07:07:14.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8199999999999999e-07 2023-10-08T07:07:14.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.156 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552361+0000", 2023-10-08T07:07:14.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1221e-05 2023-10-08T07:07:14.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.156 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.156 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552370+0000", 2023-10-08T07:07:14.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1700000000000003e-06 2023-10-08T07:07:14.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.157 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.157 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552378+0000", 2023-10-08T07:07:14.157 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8699999999999992e-06 2023-10-08T07:07:14.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.157 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.157 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554498+0000", 2023-10-08T07:07:14.157 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0021205659999999999 2023-10-08T07:07:14.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.158 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.158 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554584+0000", 2023-10-08T07:07:14.158 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5351000000000003e-05 2023-10-08T07:07:14.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.158 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.158 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554761+0000", 2023-10-08T07:07:14.158 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000177885 2023-10-08T07:07:14.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568987+0000", 2023-10-08T07:07:14.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014225804999999999 2023-10-08T07:07:14.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590392+0000", 2023-10-08T07:07:14.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021405158000000001 2023-10-08T07:07:14.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590427+0000", 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.417e-05 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590448+0000", 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1279000000000001e-05 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.161 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72627 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 352256~4096,write 483328~4096,write 651264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.161 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.554404+0000", 2023-10-08T07:07:14.161 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.504833544, 2023-10-08T07:07:14.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048777491999999999, 2023-10-08T07:07:14.161 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.161 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.161 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.161 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.161 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.161 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72627 2023-10-08T07:07:14.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.162 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.162 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554404+0000", 2023-10-08T07:07:14.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.162 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554404+0000", 2023-10-08T07:07:14.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.163 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.163 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.163 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554405+0000", 2023-10-08T07:07:14.163 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.001e-06 2023-10-08T07:07:14.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.163 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.163 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.163 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554432+0000", 2023-10-08T07:07:14.163 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6679e-05 2023-10-08T07:07:14.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.164 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554444+0000", 2023-10-08T07:07:14.164 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2167999999999999e-05 2023-10-08T07:07:14.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.164 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554453+0000", 2023-10-08T07:07:14.164 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2449999999999998e-06 2023-10-08T07:07:14.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556730+0000", 2023-10-08T07:07:14.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022777269999999998 2023-10-08T07:07:14.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556782+0000", 2023-10-08T07:07:14.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1756999999999999e-05 2023-10-08T07:07:14.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.166 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.166 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556901+0000", 2023-10-08T07:07:14.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000119132 2023-10-08T07:07:14.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.167 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.571593+0000", 2023-10-08T07:07:14.167 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014691638999999999 2023-10-08T07:07:14.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.167 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603125+0000", 2023-10-08T07:07:14.167 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.031531745999999999 2023-10-08T07:07:14.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603159+0000", 2023-10-08T07:07:14.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4382999999999999e-05 2023-10-08T07:07:14.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603182+0000", 2023-10-08T07:07:14.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3014999999999999e-05 2023-10-08T07:07:14.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.169 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.169 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72628 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 3993600~4096,write 4141056~4096,write 4157440~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.169 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.554894+0000", 2023-10-08T07:07:14.170 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.504344264, 2023-10-08T07:07:14.170 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049659593000000002, 2023-10-08T07:07:14.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.170 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.170 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.170 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.170 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.170 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72628 2023-10-08T07:07:14.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.170 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.171 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.171 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554894+0000", 2023-10-08T07:07:14.171 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.171 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.171 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554894+0000", 2023-10-08T07:07:14.171 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.171 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554895+0000", 2023-10-08T07:07:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2099999999999995e-07 2023-10-08T07:07:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554906+0000", 2023-10-08T07:07:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1782e-05 2023-10-08T07:07:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554923+0000", 2023-10-08T07:07:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.664e-05 2023-10-08T07:07:14.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554931+0000", 2023-10-08T07:07:14.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5989999999999996e-06 2023-10-08T07:07:14.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.558600+0000", 2023-10-08T07:07:14.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003669346 2023-10-08T07:07:14.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.558650+0000", 2023-10-08T07:07:14.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0385e-05 2023-10-08T07:07:14.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.558750+0000", 2023-10-08T07:07:14.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9500999999999995e-05 2023-10-08T07:07:14.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.576743+0000", 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017993680000000001 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604444+0000", 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027700446 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604507+0000", 2023-10-08T07:07:14.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3477000000000002e-05 2023-10-08T07:07:14.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604553+0000", 2023-10-08T07:07:14.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5915999999999999e-05 2023-10-08T07:07:14.176 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.177 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.177 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.177 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72630 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2695168~4096,write 2756608~4096,write 2813952~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.177 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.555436+0000", 2023-10-08T07:07:14.177 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.5038018, 2023-10-08T07:07:14.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049269518999999998, 2023-10-08T07:07:14.177 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.177 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.177 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.178 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.178 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.178 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72630 2023-10-08T07:07:14.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.178 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555436+0000", 2023-10-08T07:07:14.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555436+0000", 2023-10-08T07:07:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555437+0000", 2023-10-08T07:07:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3799999999999996e-07 2023-10-08T07:07:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555479+0000", 2023-10-08T07:07:14.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2475999999999998e-05 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555490+0000", 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0159999999999999e-05 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555495+0000", 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5169999999999999e-06 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560199+0000", 2023-10-08T07:07:14.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047036379999999996 2023-10-08T07:07:14.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560281+0000", 2023-10-08T07:07:14.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2452000000000003e-05 2023-10-08T07:07:14.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560437+0000", 2023-10-08T07:07:14.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000156324 2023-10-08T07:07:14.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578171+0000", 2023-10-08T07:07:14.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017733043 2023-10-08T07:07:14.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604605+0000", 2023-10-08T07:07:14.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026434546999999999 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604667+0000", 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1521999999999998e-05 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604706+0000", 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9101999999999999e-05 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.183 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.184 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72638 4.1a 4:5a59f83a:::10000000004.00000002:head [write 2641920~4096,write 2732032~4096,write 2838528~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.184 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.557959+0000", 2023-10-08T07:07:14.184 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.5012790950000001, 2023-10-08T07:07:14.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045318636000000002, 2023-10-08T07:07:14.184 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.184 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72638 2023-10-08T07:07:14.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.185 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.557959+0000", 2023-10-08T07:07:14.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.557959+0000", 2023-10-08T07:07:14.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.557960+0000", 2023-10-08T07:07:14.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.85e-07 2023-10-08T07:07:14.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.557972+0000", 2023-10-08T07:07:14.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2044e-05 2023-10-08T07:07:14.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.557981+0000", 2023-10-08T07:07:14.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8510000000000005e-06 2023-10-08T07:07:14.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.557989+0000", 2023-10-08T07:07:14.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6759999999999996e-06 2023-10-08T07:07:14.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560182+0000", 2023-10-08T07:07:14.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0021929290000000001 2023-10-08T07:07:14.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560263+0000", 2023-10-08T07:07:14.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0861999999999999e-05 2023-10-08T07:07:14.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560403+0000", 2023-10-08T07:07:14.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014031499999999999 2023-10-08T07:07:14.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.576753+0000", 2023-10-08T07:07:14.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016349743 2023-10-08T07:07:14.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603159+0000", 2023-10-08T07:07:14.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026405769999999999 2023-10-08T07:07:14.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.191 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.191 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603232+0000", 2023-10-08T07:07:14.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2809e-05 2023-10-08T07:07:14.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.192 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.192 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.192 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603278+0000", 2023-10-08T07:07:14.192 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5852000000000001e-05 2023-10-08T07:07:14.192 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.192 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.192 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.192 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.192 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72646 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2531328~4096,write 2629632~4096,write 2678784~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.192 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.560690+0000", 2023-10-08T07:07:14.192 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.4985480500000001, 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046105475999999999, 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72646 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560690+0000", 2023-10-08T07:07:14.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560690+0000", 2023-10-08T07:07:14.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560690+0000", 2023-10-08T07:07:14.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.75e-07 2023-10-08T07:07:14.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560705+0000", 2023-10-08T07:07:14.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4849e-05 2023-10-08T07:07:14.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560712+0000", 2023-10-08T07:07:14.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8920000000000003e-06 2023-10-08T07:07:14.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.197 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.197 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560716+0000", 2023-10-08T07:07:14.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.206e-06 2023-10-08T07:07:14.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.562298+0000", 2023-10-08T07:07:14.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001581785 2023-10-08T07:07:14.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.562422+0000", 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000123533 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.562608+0000", 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018668600000000001 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578180+0000", 2023-10-08T07:07:14.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015571694000000001 2023-10-08T07:07:14.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606730+0000", 2023-10-08T07:07:14.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.028550433 2023-10-08T07:07:14.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606774+0000", 2023-10-08T07:07:14.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3943999999999998e-05 2023-10-08T07:07:14.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.201 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.201 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606795+0000", 2023-10-08T07:07:14.201 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0979e-05 2023-10-08T07:07:14.201 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.201 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.201 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.202 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72647 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2301952~4096,write 2551808~4096,write 2572288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.202 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.560995+0000", 2023-10-08T07:07:14.202 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.498243298, 2023-10-08T07:07:14.202 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045873965000000003, 2023-10-08T07:07:14.202 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.202 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.202 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.202 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.203 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.203 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72647 2023-10-08T07:07:14.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.203 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560995+0000", 2023-10-08T07:07:14.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560995+0000", 2023-10-08T07:07:14.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560995+0000", 2023-10-08T07:07:14.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4399999999999999e-07 2023-10-08T07:07:14.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.561009+0000", 2023-10-08T07:07:14.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.34e-05 2023-10-08T07:07:14.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.205 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.205 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.561025+0000", 2023-10-08T07:07:14.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6149000000000001e-05 2023-10-08T07:07:14.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.205 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.561034+0000", 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5909999999999996e-06 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.569018+0000", 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0079840150000000006 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.569093+0000", 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5054000000000003e-05 2023-10-08T07:07:14.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.207 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.569254+0000", 2023-10-08T07:07:14.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016177699999999999 2023-10-08T07:07:14.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.207 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578288+0000", 2023-10-08T07:07:14.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0090331600000000001 2023-10-08T07:07:14.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606820+0000", 2023-10-08T07:07:14.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.028532557 2023-10-08T07:07:14.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606849+0000", 2023-10-08T07:07:14.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9377999999999999e-05 2023-10-08T07:07:14.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606869+0000", 2023-10-08T07:07:14.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.914e-05 2023-10-08T07:07:14.209 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.209 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.209 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.210 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72673 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 1806336~4096,write 2064384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.210 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.568597+0000", 2023-10-08T07:07:14.210 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.490640964, 2023-10-08T07:07:14.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.038340028999999998, 2023-10-08T07:07:14.210 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.210 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.210 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.210 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.210 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.210 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72673 2023-10-08T07:07:14.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.211 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568597+0000", 2023-10-08T07:07:14.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568597+0000", 2023-10-08T07:07:14.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568598+0000", 2023-10-08T07:07:14.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1399999999999996e-07 2023-10-08T07:07:14.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568612+0000", 2023-10-08T07:07:14.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4365999999999999e-05 2023-10-08T07:07:14.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568621+0000", 2023-10-08T07:07:14.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9439999999999994e-06 2023-10-08T07:07:14.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568627+0000", 2023-10-08T07:07:14.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5509999999999999e-06 2023-10-08T07:07:14.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.214 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.573271+0000", 2023-10-08T07:07:14.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0046439510000000003 2023-10-08T07:07:14.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.214 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.573318+0000", 2023-10-08T07:07:14.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7808e-05 2023-10-08T07:07:14.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.215 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.573401+0000", 2023-10-08T07:07:14.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2810000000000002e-05 2023-10-08T07:07:14.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.215 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578381+0000", 2023-10-08T07:07:14.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0049797160000000004 2023-10-08T07:07:14.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606890+0000", 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.028509329 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606919+0000", 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9e-05 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606937+0000", 2023-10-08T07:07:14.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.774e-05 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:73593 4.2b 4:d7a77d67:::10000000004.00000029:head [write 1531904~4096,write 1605632~4096,write 1712128~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.893342+0000", 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.165896214, 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037850460000000002, 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:14.217 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:14.218 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.218 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 73593 2023-10-08T07:07:14.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893342+0000", 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893342+0000", 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893343+0000", 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6499999999999998e-07 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893354+0000", 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1263999999999999e-05 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893365+0000", 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1161e-05 2023-10-08T07:07:14.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893373+0000", 2023-10-08T07:07:14.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9140000000000008e-06 2023-10-08T07:07:14.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:14.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893437+0000", 2023-10-08T07:07:14.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4239000000000006e-05 2023-10-08T07:07:14.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:14.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893540+0000", 2023-10-08T07:07:14.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000102765 2023-10-08T07:07:14.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:14.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893767+0000", 2023-10-08T07:07:14.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022713900000000001 2023-10-08T07:07:14.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:14.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.902501+0000", 2023-10-08T07:07:14.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0087343409999999996 2023-10-08T07:07:14.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.931075+0000", 2023-10-08T07:07:14.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.028573359999999999 2023-10-08T07:07:14.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:14.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.931145+0000", 2023-10-08T07:07:14.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0222000000000006e-05 2023-10-08T07:07:14.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:14.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:14.224 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:14.224 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.931192+0000", 2023-10-08T07:07:14.224 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7190000000000001e-05 2023-10-08T07:07:14.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.224 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:14.224 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:14.224 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:14.225 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:14.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:14.227 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:14.224+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:14.326 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:14.325+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:14.359 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T07:07:14.402 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:14.423 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:77775 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 3293184~4096 in=4096b,write 3391488~4096 in=4096b,write 3416064~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.417165+0000", 2023-10-08T07:07:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0047236320000000002, 2023-10-08T07:07:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0047443520000000003, 2023-10-08T07:07:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 77775 2023-10-08T07:07:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.417165+0000", 2023-10-08T07:07:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.417165+0000", 2023-10-08T07:07:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.417165+0000", 2023-10-08T07:07:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6000000000000003e-07 2023-10-08T07:07:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.417181+0000", 2023-10-08T07:07:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5420000000000001e-05 2023-10-08T07:07:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.417193+0000", 2023-10-08T07:07:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2055000000000001e-05 2023-10-08T07:07:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.417200+0000", 2023-10-08T07:07:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9469999999999997e-06 2023-10-08T07:07:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.417244+0000", 2023-10-08T07:07:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3797000000000001e-05 2023-10-08T07:07:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.417302+0000", 2023-10-08T07:07:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7980999999999999e-05 2023-10-08T07:07:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:77771 4.3a e53/17 4:5d52ad5e:::10000000004.00000026:head v 53'3548, mlcod=53'3546)", 2023-10-08T07:07:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.417980+0000", 2023-10-08T07:07:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003908229, 2023-10-08T07:07:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039729769999999999, 2023-10-08T07:07:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.417980+0000", 2023-10-08T07:07:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.417980+0000", 2023-10-08T07:07:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.417980+0000", 2023-10-08T07:07:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.34e-07 2023-10-08T07:07:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.417994+0000", 2023-10-08T07:07:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3536000000000001e-05 2023-10-08T07:07:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418002+0000", 2023-10-08T07:07:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7759999999999997e-06 2023-10-08T07:07:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418008+0000", 2023-10-08T07:07:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.801e-06 2023-10-08T07:07:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418054+0000", 2023-10-08T07:07:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6239999999999998e-05 2023-10-08T07:07:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418073+0000", 2023-10-08T07:07:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9392e-05 2023-10-08T07:07:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:77772 4.20 e53/17 4:07572838:::10000000004.00000010:head v 53'3669, mlcod=53'3667)", 2023-10-08T07:07:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.418020+0000", 2023-10-08T07:07:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038679629999999999, 2023-10-08T07:07:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039674699999999999, 2023-10-08T07:07:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418020+0000", 2023-10-08T07:07:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418020+0000", 2023-10-08T07:07:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418021+0000", 2023-10-08T07:07:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1e-07 2023-10-08T07:07:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418033+0000", 2023-10-08T07:07:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2012e-05 2023-10-08T07:07:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418041+0000", 2023-10-08T07:07:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4270000000000008e-06 2023-10-08T07:07:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418046+0000", 2023-10-08T07:07:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.288e-06 2023-10-08T07:07:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418105+0000", 2023-10-08T07:07:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8870999999999999e-05 2023-10-08T07:07:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418124+0000", 2023-10-08T07:07:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8641999999999999e-05 2023-10-08T07:07:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:77776 4.2b e53/17 4:d7a77d67:::10000000004.00000029:head v 53'2449, mlcod=53'2447)", 2023-10-08T07:07:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.418152+0000", 2023-10-08T07:07:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0037365020000000001, 2023-10-08T07:07:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038694749999999998, 2023-10-08T07:07:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418152+0000", 2023-10-08T07:07:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418152+0000", 2023-10-08T07:07:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418152+0000", 2023-10-08T07:07:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5000000000000002e-07 2023-10-08T07:07:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418167+0000", 2023-10-08T07:07:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4147e-05 2023-10-08T07:07:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418177+0000", 2023-10-08T07:07:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0366999999999999e-05 2023-10-08T07:07:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418184+0000", 2023-10-08T07:07:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9020000000000002e-06 2023-10-08T07:07:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418224+0000", 2023-10-08T07:07:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0092000000000002e-05 2023-10-08T07:07:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418243+0000", 2023-10-08T07:07:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8555000000000001e-05 2023-10-08T07:07:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:77777 4.16 4:69eefec8:::10000000004.0000003a:head [write 1814528~4096 in=4096b,write 1880064~4096 in=4096b,write 2117632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.418266+0000", 2023-10-08T07:07:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0036226660000000001, 2023-10-08T07:07:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037925530000000002, 2023-10-08T07:07:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 77777 2023-10-08T07:07:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418266+0000", 2023-10-08T07:07:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418266+0000", 2023-10-08T07:07:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418267+0000", 2023-10-08T07:07:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.47e-07 2023-10-08T07:07:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418278+0000", 2023-10-08T07:07:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1873e-05 2023-10-08T07:07:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418287+0000", 2023-10-08T07:07:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4460000000000001e-06 2023-10-08T07:07:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418300+0000", 2023-10-08T07:07:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3400999999999999e-05 2023-10-08T07:07:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.419331+0000", 2023-10-08T07:07:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001031096 2023-10-08T07:07:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.419402+0000", 2023-10-08T07:07:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0390999999999997e-05 2023-10-08T07:07:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.419535+0000", 2023-10-08T07:07:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000133659 2023-10-08T07:07:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:77778 4.15 4:aa4cb2c5:::10000000004.0000003c:head [write 3780608~4096 in=4096b,write 3866624~4096 in=4096b,write 3874816~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.418873+0000", 2023-10-08T07:07:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0030149669999999999, 2023-10-08T07:07:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032276639999999999, 2023-10-08T07:07:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 77778 2023-10-08T07:07:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418873+0000", 2023-10-08T07:07:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418873+0000", 2023-10-08T07:07:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418874+0000", 2023-10-08T07:07:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.75e-07 2023-10-08T07:07:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418883+0000", 2023-10-08T07:07:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3060000000000003e-06 2023-10-08T07:07:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418892+0000", 2023-10-08T07:07:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4509999999999992e-06 2023-10-08T07:07:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418897+0000", 2023-10-08T07:07:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9559999999999996e-06 2023-10-08T07:07:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.418950+0000", 2023-10-08T07:07:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3766e-05 2023-10-08T07:07:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.419053+0000", 2023-10-08T07:07:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102373 2023-10-08T07:07:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:77780 4.30 e53/17 4:0f322a22:::10000000004.00000014:head v 53'1220, mlcod=53'1218)", 2023-10-08T07:07:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.420096+0000", 2023-10-08T07:07:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0017921910000000001, 2023-10-08T07:07:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020435150000000001, 2023-10-08T07:07:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420096+0000", 2023-10-08T07:07:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420096+0000", 2023-10-08T07:07:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420097+0000", 2023-10-08T07:07:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6599999999999996e-07 2023-10-08T07:07:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420109+0000", 2023-10-08T07:07:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1901e-05 2023-10-08T07:07:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420117+0000", 2023-10-08T07:07:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8710000000000003e-06 2023-10-08T07:07:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420124+0000", 2023-10-08T07:07:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3899999999999998e-06 2023-10-08T07:07:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420168+0000", 2023-10-08T07:07:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4084e-05 2023-10-08T07:07:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420187+0000", 2023-10-08T07:07:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9414000000000001e-05 2023-10-08T07:07:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:77781 4.3b 4:df0e4bf8:::10000000004.00000018:head [write 679936~4096 in=4096b,write 950272~4096 in=4096b,write 987136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.420159+0000", 2023-10-08T07:07:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001729019, 2023-10-08T07:07:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020568209999999999, 2023-10-08T07:07:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 77781 2023-10-08T07:07:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420159+0000", 2023-10-08T07:07:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420159+0000", 2023-10-08T07:07:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420160+0000", 2023-10-08T07:07:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6199999999999997e-07 2023-10-08T07:07:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420170+0000", 2023-10-08T07:07:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0193999999999999e-05 2023-10-08T07:07:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420179+0000", 2023-10-08T07:07:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6070000000000008e-06 2023-10-08T07:07:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420186+0000", 2023-10-08T07:07:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8129999999999998e-06 2023-10-08T07:07:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420234+0000", 2023-10-08T07:07:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7926000000000002e-05 2023-10-08T07:07:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420285+0000", 2023-10-08T07:07:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1527999999999999e-05 2023-10-08T07:07:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:77782 4.c e53/17 4:3352c333:::10000000004.00000012:head v 53'2452, mlcod=53'2450)", 2023-10-08T07:07:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.420881+0000", 2023-10-08T07:07:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0010072379999999999, 2023-10-08T07:07:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014193910000000001, 2023-10-08T07:07:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420881+0000", 2023-10-08T07:07:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420881+0000", 2023-10-08T07:07:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420882+0000", 2023-10-08T07:07:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8100000000000003e-07 2023-10-08T07:07:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420894+0000", 2023-10-08T07:07:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2109e-05 2023-10-08T07:07:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420906+0000", 2023-10-08T07:07:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2330000000000001e-05 2023-10-08T07:07:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420912+0000", 2023-10-08T07:07:14.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2480000000000001e-06 2023-10-08T07:07:14.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420954+0000", 2023-10-08T07:07:14.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1952000000000001e-05 2023-10-08T07:07:14.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.420988+0000", 2023-10-08T07:07:14.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3998000000000002e-05 2023-10-08T07:07:14.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.490 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.490 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:77783 4.20 e53/17 4:04004f2c:::10000000004.0000000d:head v 53'3670, mlcod=53'3667)", 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.421184+0000", 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00070443100000000005, 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001175211, 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.421184+0000", 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.421184+0000", 2023-10-08T07:07:14.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.421184+0000", 2023-10-08T07:07:14.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8800000000000002e-07 2023-10-08T07:07:14.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.421197+0000", 2023-10-08T07:07:14.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.258e-05 2023-10-08T07:07:14.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.421205+0000", 2023-10-08T07:07:14.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8399999999999995e-06 2023-10-08T07:07:14.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.421212+0000", 2023-10-08T07:07:14.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.204e-06 2023-10-08T07:07:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.421360+0000", 2023-10-08T07:07:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000148116 2023-10-08T07:07:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.421380+0000", 2023-10-08T07:07:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9542e-05 2023-10-08T07:07:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.494 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.495 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:77785 4.a e53/17 4:524fba76:::10000000004.0000001b:head v 53'1204, mlcod=53'1202)", 2023-10-08T07:07:14.495 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.422102+0000", 2023-10-08T07:07:14.495 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9997859, 2023-10-08T07:07:14.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00031459199999999999, 2023-10-08T07:07:14.495 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.495 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:14.495 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422102+0000", 2023-10-08T07:07:14.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422102+0000", 2023-10-08T07:07:14.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422103+0000", 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422115+0000", 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2265e-05 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422126+0000", 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1178999999999999e-05 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422132+0000", 2023-10-08T07:07:14.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-06 2023-10-08T07:07:14.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422186+0000", 2023-10-08T07:07:14.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3860999999999998e-05 2023-10-08T07:07:14.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422207+0000", 2023-10-08T07:07:14.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1492999999999999e-05 2023-10-08T07:07:14.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.499 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.499 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:77786 4.31 4:8ec1b377:::10000000004.00000019:head [write 966656~4096 in=4096b,write 1015808~4096 in=4096b,write 1253376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.499 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.422275+0000", 2023-10-08T07:07:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9996128, 2023-10-08T07:07:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00020532999999999999, 2023-10-08T07:07:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 77786 2023-10-08T07:07:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422275+0000", 2023-10-08T07:07:14.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422275+0000", 2023-10-08T07:07:14.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422276+0000", 2023-10-08T07:07:14.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:07:14.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422287+0000", 2023-10-08T07:07:14.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0743e-05 2023-10-08T07:07:14.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422302+0000", 2023-10-08T07:07:14.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4842e-05 2023-10-08T07:07:14.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422307+0000", 2023-10-08T07:07:14.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.938e-06 2023-10-08T07:07:14.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422356+0000", 2023-10-08T07:07:14.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9503999999999999e-05 2023-10-08T07:07:14.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.422444+0000", 2023-10-08T07:07:14.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8282999999999995e-05 2023-10-08T07:07:14.504 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.504 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.504 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.504 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:77773 4.31 4:8de29a03:::10000000004.00000001:head [write 274432~4096 in=4096b,write 356352~4096 in=4096b,write 888832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:14.504 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:14.416330+0000", 2023-10-08T07:07:14.504 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00555793, 2023-10-08T07:07:14.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006230429, 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 77773 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.416330+0000", 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:14.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.416330+0000", 2023-10-08T07:07:14.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:14.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:14.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.416331+0000", 2023-10-08T07:07:14.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4200000000000005e-07 2023-10-08T07:07:14.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:14.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.416342+0000", 2023-10-08T07:07:14.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0621999999999999e-05 2023-10-08T07:07:14.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:14.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.416356+0000", 2023-10-08T07:07:14.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.381e-05 2023-10-08T07:07:14.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:14.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.416366+0000", 2023-10-08T07:07:14.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8600000000000005e-06 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.416413+0000", 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7769999999999998e-05 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.416503+0000", 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9744e-05 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.416670+0000", 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016652999999999999 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:14.421054+0000", 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043844790000000002 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:14.509 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 13 2023-10-08T07:07:14.510 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:14.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:14.512 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:14.510+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:14.512 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:14.513 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:14.514 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:14.611 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:14.611+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:14.698 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:14.699 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:14.713 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:14.713+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:14.714 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:14.814 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:14.813+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:14.915 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:14.914+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:14.951 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:14.952 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:14.969 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:15.016 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:15.016+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:15.117 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:15.116+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:15.169 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:15.170 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:15.186 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:15.219 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:15.219+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2023-10-08T07:07:15.319 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:15.318+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:15.420 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:15.421 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:15.421 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:15.420+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:15.436 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:15.523 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:15.523+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:15.624 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:15.623+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:15.673 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:15.674 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:15.688 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:15.724 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:15.723+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:15.825 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:15.824+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:15.886 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:15.886 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:15.902 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:15.949 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:15.948+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:16.027 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:16.026+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:16.111 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:16.111 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:16.127 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:16.128 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:16.127+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:16.229 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:16.228+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:16.329 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:16.329+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:16.384 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:16.384 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:16.400 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:16.446 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:16.445+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:16.514 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:07:16.532 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:16.531+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:16.592 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:16.592 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:16.608 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:16.632 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:16.632+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:16.688 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:16.713 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:16.714 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:07:16.714 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:16.714 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:07:16.716 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:16.717 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:16.733 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:16.733+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:16.834 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:16.834+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:16.837 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:16.837 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:16.837 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:16.837 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:16.838 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:16.854 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:16.936 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:16.935+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:17.036 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:17.035+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:17.047 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:17.048 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:17.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:17.048 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:17.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.048 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72413 4.20 4:07572838:::10000000004.00000010:head [write 3772416~8192,write 3903488~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.048 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.453084+0000", 2023-10-08T07:07:17.048 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.5909651739999999, 2023-10-08T07:07:17.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.038374026999999998, 2023-10-08T07:07:17.048 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.048 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.049 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.049 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.049 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.049 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72413 2023-10-08T07:07:17.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.049 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.453084+0000", 2023-10-08T07:07:17.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.453084+0000", 2023-10-08T07:07:17.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.453084+0000", 2023-10-08T07:07:17.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4399999999999999e-07 2023-10-08T07:07:17.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.453115+0000", 2023-10-08T07:07:17.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1010000000000003e-05 2023-10-08T07:07:17.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.453126+0000", 2023-10-08T07:07:17.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0249e-05 2023-10-08T07:07:17.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.453132+0000", 2023-10-08T07:07:17.053 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5989999999999998e-06 2023-10-08T07:07:17.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.455347+0000", 2023-10-08T07:07:17.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022149050000000001 2023-10-08T07:07:17.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.054 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.455399+0000", 2023-10-08T07:07:17.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1934000000000001e-05 2023-10-08T07:07:17.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.054 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.455490+0000", 2023-10-08T07:07:17.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0618000000000006e-05 2023-10-08T07:07:17.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.055 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.462161+0000", 2023-10-08T07:07:17.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0066711690000000002 2023-10-08T07:07:17.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.055 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.491361+0000", 2023-10-08T07:07:17.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.029199695000000001 2023-10-08T07:07:17.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.491420+0000", 2023-10-08T07:07:17.056 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9723999999999999e-05 2023-10-08T07:07:17.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.491458+0000", 2023-10-08T07:07:17.056 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7379999999999998e-05 2023-10-08T07:07:17.056 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.056 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.056 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.057 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.057 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72574 4.20 4:04004f2c:::10000000004.0000000d:head [write 3334144~4096,write 3764224~4096,write 3784704~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.057 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.537531+0000", 2023-10-08T07:07:17.057 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.5065181350000003, 2023-10-08T07:07:17.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.038668988000000001, 2023-10-08T07:07:17.057 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.057 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.057 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.057 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.057 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.057 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72574 2023-10-08T07:07:17.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.058 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.058 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.058 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537531+0000", 2023-10-08T07:07:17.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.058 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.058 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537531+0000", 2023-10-08T07:07:17.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537531+0000", 2023-10-08T07:07:17.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9500000000000001e-07 2023-10-08T07:07:17.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537542+0000", 2023-10-08T07:07:17.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0769e-05 2023-10-08T07:07:17.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.060 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.060 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537553+0000", 2023-10-08T07:07:17.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1192000000000001e-05 2023-10-08T07:07:17.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.060 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.060 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537561+0000", 2023-10-08T07:07:17.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9719999999999992e-06 2023-10-08T07:07:17.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.060 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537617+0000", 2023-10-08T07:07:17.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5757999999999997e-05 2023-10-08T07:07:17.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537715+0000", 2023-10-08T07:07:17.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8102000000000004e-05 2023-10-08T07:07:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.537907+0000", 2023-10-08T07:07:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019132700000000001 2023-10-08T07:07:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544033+0000", 2023-10-08T07:07:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0061259749999999996 2023-10-08T07:07:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.576135+0000", 2023-10-08T07:07:17.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032102670999999999 2023-10-08T07:07:17.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.576170+0000", 2023-10-08T07:07:17.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4974000000000001e-05 2023-10-08T07:07:17.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.576200+0000", 2023-10-08T07:07:17.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9453000000000001e-05 2023-10-08T07:07:17.064 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.064 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.064 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.064 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72576 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 2682880~4096,write 3039232~4096,write 3063808~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.064 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.538374+0000", 2023-10-08T07:07:17.064 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.505674892, 2023-10-08T07:07:17.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.040481140999999998, 2023-10-08T07:07:17.064 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72576 2023-10-08T07:07:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538374+0000", 2023-10-08T07:07:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538374+0000", 2023-10-08T07:07:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538375+0000", 2023-10-08T07:07:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3200000000000004e-07 2023-10-08T07:07:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538386+0000", 2023-10-08T07:07:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1491000000000001e-05 2023-10-08T07:07:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538395+0000", 2023-10-08T07:07:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8999999999999995e-06 2023-10-08T07:07:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538399+0000", 2023-10-08T07:07:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4460000000000003e-06 2023-10-08T07:07:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538445+0000", 2023-10-08T07:07:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5800000000000002e-05 2023-10-08T07:07:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538504+0000", 2023-10-08T07:07:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8369000000000003e-05 2023-10-08T07:07:17.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538631+0000", 2023-10-08T07:07:17.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012735700000000001 2023-10-08T07:07:17.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544010+0000", 2023-10-08T07:07:17.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0053793280000000001 2023-10-08T07:07:17.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578794+0000", 2023-10-08T07:07:17.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.034783364999999997 2023-10-08T07:07:17.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578830+0000", 2023-10-08T07:07:17.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6233999999999999e-05 2023-10-08T07:07:17.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578855+0000", 2023-10-08T07:07:17.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5119000000000001e-05 2023-10-08T07:07:17.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.071 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.071 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72577 4.20 4:07572838:::10000000004.00000010:head [write 577536~4096,write 659456~4096,write 823296~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.071 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.538752+0000", 2023-10-08T07:07:17.072 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.5052963950000002, 2023-10-08T07:07:17.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.043883168, 2023-10-08T07:07:17.072 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.072 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.072 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.072 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.072 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.072 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72577 2023-10-08T07:07:17.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.072 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.073 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.073 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538752+0000", 2023-10-08T07:07:17.073 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.073 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.073 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.073 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538752+0000", 2023-10-08T07:07:17.073 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.073 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.073 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.073 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538753+0000", 2023-10-08T07:07:17.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2799999999999995e-07 2023-10-08T07:07:17.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.074 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.074 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.074 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538764+0000", 2023-10-08T07:07:17.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1263e-05 2023-10-08T07:07:17.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.074 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.074 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.074 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538777+0000", 2023-10-08T07:07:17.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3042e-05 2023-10-08T07:07:17.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538785+0000", 2023-10-08T07:07:17.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7330000000000003e-06 2023-10-08T07:07:17.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.540416+0000", 2023-10-08T07:07:17.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00163061 2023-10-08T07:07:17.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.540484+0000", 2023-10-08T07:07:17.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8625000000000001e-05 2023-10-08T07:07:17.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.540586+0000", 2023-10-08T07:07:17.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000101372 2023-10-08T07:07:17.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547848+0000", 2023-10-08T07:07:17.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0072625370000000003 2023-10-08T07:07:17.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.077 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.582558+0000", 2023-10-08T07:07:17.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.034709679 2023-10-08T07:07:17.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.077 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.582593+0000", 2023-10-08T07:07:17.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4892999999999999e-05 2023-10-08T07:07:17.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.582636+0000", 2023-10-08T07:07:17.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2685999999999998e-05 2023-10-08T07:07:17.078 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.078 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.078 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.078 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72578 4.1a 4:5a59f83a:::10000000004.00000002:head [write 581632~4096,write 614400~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.078 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.538954+0000", 2023-10-08T07:07:17.078 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.5050948750000002, 2023-10-08T07:07:17.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045067301999999997, 2023-10-08T07:07:17.079 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.079 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.079 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.079 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.079 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.079 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72578 2023-10-08T07:07:17.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.079 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538954+0000", 2023-10-08T07:07:17.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.080 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538954+0000", 2023-10-08T07:07:17.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.080 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538955+0000", 2023-10-08T07:07:17.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7700000000000004e-07 2023-10-08T07:07:17.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.081 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.081 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538966+0000", 2023-10-08T07:07:17.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1403000000000001e-05 2023-10-08T07:07:17.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.081 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.081 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538976+0000", 2023-10-08T07:07:17.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9150000000000008e-06 2023-10-08T07:07:17.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.538984+0000", 2023-10-08T07:07:17.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4649999999999997e-06 2023-10-08T07:07:17.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.539039+0000", 2023-10-08T07:07:17.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5417999999999997e-05 2023-10-08T07:07:17.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.539139+0000", 2023-10-08T07:07:17.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100029 2023-10-08T07:07:17.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.083 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.539269+0000", 2023-10-08T07:07:17.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013011500000000001 2023-10-08T07:07:17.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.083 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546574+0000", 2023-10-08T07:07:17.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0073052120000000002 2023-10-08T07:07:17.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.583918+0000", 2023-10-08T07:07:17.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037344048999999997 2023-10-08T07:07:17.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.583981+0000", 2023-10-08T07:07:17.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2403999999999994e-05 2023-10-08T07:07:17.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.584021+0000", 2023-10-08T07:07:17.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0515000000000001e-05 2023-10-08T07:07:17.085 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.085 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.085 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.085 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72592 4.2b 4:d7a77d67:::10000000004.00000029:head [write 1245184~4096,write 2768896~4096,write 2813952~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.086 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.544339+0000", 2023-10-08T07:07:17.086 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4997097640000003, 2023-10-08T07:07:17.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.039804996000000002, 2023-10-08T07:07:17.086 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.086 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.086 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.086 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.086 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.086 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72592 2023-10-08T07:07:17.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.086 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.087 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.087 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.087 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544339+0000", 2023-10-08T07:07:17.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.087 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.087 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.087 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544339+0000", 2023-10-08T07:07:17.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.088 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.088 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544340+0000", 2023-10-08T07:07:17.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.24e-06 2023-10-08T07:07:17.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.088 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.088 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544355+0000", 2023-10-08T07:07:17.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4375999999999999e-05 2023-10-08T07:07:17.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.089 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.089 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544374+0000", 2023-10-08T07:07:17.089 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9553000000000001e-05 2023-10-08T07:07:17.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.089 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.089 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544385+0000", 2023-10-08T07:07:17.089 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0919e-05 2023-10-08T07:07:17.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544462+0000", 2023-10-08T07:07:17.090 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6981e-05 2023-10-08T07:07:17.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.090 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544523+0000", 2023-10-08T07:07:17.090 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1328000000000006e-05 2023-10-08T07:07:17.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.090 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.544622+0000", 2023-10-08T07:07:17.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8654999999999996e-05 2023-10-08T07:07:17.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.091 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.091 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.550605+0000", 2023-10-08T07:07:17.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0059832490000000004 2023-10-08T07:07:17.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.091 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.091 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.584042+0000", 2023-10-08T07:07:17.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033436968999999997 2023-10-08T07:07:17.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.584104+0000", 2023-10-08T07:07:17.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1768999999999998e-05 2023-10-08T07:07:17.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.584144+0000", 2023-10-08T07:07:17.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9956999999999997e-05 2023-10-08T07:07:17.092 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.092 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.093 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.093 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72598 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2424832~4096,write 2437120~4096,write 2531328~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.093 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.546345+0000", 2023-10-08T07:07:17.093 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4977039830000001, 2023-10-08T07:07:17.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.043758261999999999, 2023-10-08T07:07:17.093 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.093 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.093 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.093 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.093 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.094 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72598 2023-10-08T07:07:17.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.094 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546345+0000", 2023-10-08T07:07:17.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546345+0000", 2023-10-08T07:07:17.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546346+0000", 2023-10-08T07:07:17.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.37e-07 2023-10-08T07:07:17.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546359+0000", 2023-10-08T07:07:17.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3524e-05 2023-10-08T07:07:17.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546369+0000", 2023-10-08T07:07:17.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8579999999999995e-06 2023-10-08T07:07:17.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546376+0000", 2023-10-08T07:07:17.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4309999999999997e-06 2023-10-08T07:07:17.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546427+0000", 2023-10-08T07:07:17.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.062e-05 2023-10-08T07:07:17.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546474+0000", 2023-10-08T07:07:17.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7227e-05 2023-10-08T07:07:17.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.546573+0000", 2023-10-08T07:07:17.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8974999999999993e-05 2023-10-08T07:07:17.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.098 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556680+0000", 2023-10-08T07:07:17.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010106499999999999 2023-10-08T07:07:17.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.098 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590041+0000", 2023-10-08T07:07:17.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033361518999999999 2023-10-08T07:07:17.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590078+0000", 2023-10-08T07:07:17.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6346000000000001e-05 2023-10-08T07:07:17.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590103+0000", 2023-10-08T07:07:17.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5525e-05 2023-10-08T07:07:17.099 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.099 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.100 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.100 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72601 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2727936~4096,write 2826240~4096,write 2879488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.100 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.547272+0000", 2023-10-08T07:07:17.100 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4967764480000003, 2023-10-08T07:07:17.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.042932953000000003, 2023-10-08T07:07:17.100 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.100 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.100 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.100 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.100 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.101 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72601 2023-10-08T07:07:17.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.101 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547272+0000", 2023-10-08T07:07:17.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547272+0000", 2023-10-08T07:07:17.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547273+0000", 2023-10-08T07:07:17.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7100000000000001e-07 2023-10-08T07:07:17.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547283+0000", 2023-10-08T07:07:17.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6609999999999995e-06 2023-10-08T07:07:17.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547295+0000", 2023-10-08T07:07:17.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1857e-05 2023-10-08T07:07:17.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547306+0000", 2023-10-08T07:07:17.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1178999999999999e-05 2023-10-08T07:07:17.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548790+0000", 2023-10-08T07:07:17.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0014839020000000001 2023-10-08T07:07:17.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548847+0000", 2023-10-08T07:07:17.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7108999999999998e-05 2023-10-08T07:07:17.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548984+0000", 2023-10-08T07:07:17.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013750599999999999 2023-10-08T07:07:17.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556692+0000", 2023-10-08T07:07:17.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0077079519999999997 2023-10-08T07:07:17.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590140+0000", 2023-10-08T07:07:17.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033447986999999998 2023-10-08T07:07:17.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590175+0000", 2023-10-08T07:07:17.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4857000000000002e-05 2023-10-08T07:07:17.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590205+0000", 2023-10-08T07:07:17.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.0272000000000001e-05 2023-10-08T07:07:17.107 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.107 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.107 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.107 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72603 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1417216~4096,write 1564672~4096,write 1576960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.107 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.547830+0000", 2023-10-08T07:07:17.108 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4962186790000001, 2023-10-08T07:07:17.108 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.042451044, 2023-10-08T07:07:17.108 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.108 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.108 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.108 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.108 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.108 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72603 2023-10-08T07:07:17.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.108 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.108 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.108 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.109 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547830+0000", 2023-10-08T07:07:17.109 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.109 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547830+0000", 2023-10-08T07:07:17.109 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.109 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547831+0000", 2023-10-08T07:07:17.109 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8500000000000002e-07 2023-10-08T07:07:17.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547850+0000", 2023-10-08T07:07:17.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9638000000000001e-05 2023-10-08T07:07:17.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547874+0000", 2023-10-08T07:07:17.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.366e-05 2023-10-08T07:07:17.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.111 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.111 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.547892+0000", 2023-10-08T07:07:17.111 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8091999999999999e-05 2023-10-08T07:07:17.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.111 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.111 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.111 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.550708+0000", 2023-10-08T07:07:17.111 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0028162930000000001 2023-10-08T07:07:17.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.111 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.111 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.550778+0000", 2023-10-08T07:07:17.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9561999999999996e-05 2023-10-08T07:07:17.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.550916+0000", 2023-10-08T07:07:17.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000138446 2023-10-08T07:07:17.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556701+0000", 2023-10-08T07:07:17.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0057844910000000001 2023-10-08T07:07:17.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.113 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.113 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590230+0000", 2023-10-08T07:07:17.113 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033529033 2023-10-08T07:07:17.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.113 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.113 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590260+0000", 2023-10-08T07:07:17.113 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.0246000000000001e-05 2023-10-08T07:07:17.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.114 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.114 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590281+0000", 2023-10-08T07:07:17.114 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1098e-05 2023-10-08T07:07:17.114 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.114 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.114 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.114 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.114 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72607 4.3a 4:5f183e4b:::10000000004.00000023:head [write 1433600~4096,write 1736704~4096,write 1810432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.114 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.548926+0000", 2023-10-08T07:07:17.114 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4951233110000004, 2023-10-08T07:07:17.114 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.041441020000000002, 2023-10-08T07:07:17.115 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.115 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.115 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.115 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.115 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.115 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72607 2023-10-08T07:07:17.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.115 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.115 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.115 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.115 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548926+0000", 2023-10-08T07:07:17.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.116 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.116 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.116 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548926+0000", 2023-10-08T07:07:17.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.116 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.116 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.116 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548926+0000", 2023-10-08T07:07:17.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3900000000000004e-07 2023-10-08T07:07:17.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.117 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.117 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.117 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548952+0000", 2023-10-08T07:07:17.117 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5888e-05 2023-10-08T07:07:17.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.117 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.117 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.117 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548962+0000", 2023-10-08T07:07:17.117 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.431e-06 2023-10-08T07:07:17.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.117 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.117 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.118 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.548969+0000", 2023-10-08T07:07:17.118 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3440000000000003e-06 2023-10-08T07:07:17.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.118 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.118 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.118 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552528+0000", 2023-10-08T07:07:17.118 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0035591590000000001 2023-10-08T07:07:17.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.118 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.118 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.118 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552611+0000", 2023-10-08T07:07:17.119 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2358e-05 2023-10-08T07:07:17.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.119 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.119 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.119 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552709+0000", 2023-10-08T07:07:17.119 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8454000000000003e-05 2023-10-08T07:07:17.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.119 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.119 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.119 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560149+0000", 2023-10-08T07:07:17.119 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074399560000000002 2023-10-08T07:07:17.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.120 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590302+0000", 2023-10-08T07:07:17.120 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.030153197 2023-10-08T07:07:17.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.120 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590330+0000", 2023-10-08T07:07:17.120 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8136999999999998e-05 2023-10-08T07:07:17.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.120 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.121 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590367+0000", 2023-10-08T07:07:17.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6257000000000002e-05 2023-10-08T07:07:17.121 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.121 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.121 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.121 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.121 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72620 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 970752~4096,write 1105920~4096,write 1142784~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.121 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.552349+0000", 2023-10-08T07:07:17.121 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4917000739999997, 2023-10-08T07:07:17.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.038099157000000002, 2023-10-08T07:07:17.122 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.122 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.122 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.122 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.122 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.122 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72620 2023-10-08T07:07:17.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.122 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.122 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.122 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.123 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552349+0000", 2023-10-08T07:07:17.123 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.123 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.123 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.123 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552349+0000", 2023-10-08T07:07:17.123 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.123 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.123 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.123 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552349+0000", 2023-10-08T07:07:17.124 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8199999999999999e-07 2023-10-08T07:07:17.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.124 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.124 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.124 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552361+0000", 2023-10-08T07:07:17.124 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1221e-05 2023-10-08T07:07:17.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.124 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.124 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.124 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552370+0000", 2023-10-08T07:07:17.124 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1700000000000003e-06 2023-10-08T07:07:17.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.125 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.125 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.552378+0000", 2023-10-08T07:07:17.125 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8699999999999992e-06 2023-10-08T07:07:17.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.125 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.125 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554498+0000", 2023-10-08T07:07:17.125 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0021205659999999999 2023-10-08T07:07:17.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.126 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554584+0000", 2023-10-08T07:07:17.126 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5351000000000003e-05 2023-10-08T07:07:17.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.126 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554761+0000", 2023-10-08T07:07:17.126 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000177885 2023-10-08T07:07:17.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.127 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568987+0000", 2023-10-08T07:07:17.127 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014225804999999999 2023-10-08T07:07:17.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.127 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.127 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590392+0000", 2023-10-08T07:07:17.127 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021405158000000001 2023-10-08T07:07:17.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.127 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.127 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590427+0000", 2023-10-08T07:07:17.127 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.417e-05 2023-10-08T07:07:17.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.128 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.128 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.128 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.590448+0000", 2023-10-08T07:07:17.128 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1279000000000001e-05 2023-10-08T07:07:17.128 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.128 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.128 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.128 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.128 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72627 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 352256~4096,write 483328~4096,write 651264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.129 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.554404+0000", 2023-10-08T07:07:17.129 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4896443980000003, 2023-10-08T07:07:17.129 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048777491999999999, 2023-10-08T07:07:17.129 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.129 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.129 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.129 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.129 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.129 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72627 2023-10-08T07:07:17.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.129 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554404+0000", 2023-10-08T07:07:17.130 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554404+0000", 2023-10-08T07:07:17.130 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554405+0000", 2023-10-08T07:07:17.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.001e-06 2023-10-08T07:07:17.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.131 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.131 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554432+0000", 2023-10-08T07:07:17.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6679e-05 2023-10-08T07:07:17.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.131 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.131 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554444+0000", 2023-10-08T07:07:17.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2167999999999999e-05 2023-10-08T07:07:17.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.132 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.132 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554453+0000", 2023-10-08T07:07:17.132 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2449999999999998e-06 2023-10-08T07:07:17.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.132 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.132 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556730+0000", 2023-10-08T07:07:17.132 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022777269999999998 2023-10-08T07:07:17.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.132 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.133 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556782+0000", 2023-10-08T07:07:17.133 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1756999999999999e-05 2023-10-08T07:07:17.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.133 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.133 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556901+0000", 2023-10-08T07:07:17.133 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000119132 2023-10-08T07:07:17.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.133 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.133 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.571593+0000", 2023-10-08T07:07:17.134 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014691638999999999 2023-10-08T07:07:17.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.134 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.134 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603125+0000", 2023-10-08T07:07:17.134 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.031531745999999999 2023-10-08T07:07:17.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.134 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.134 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603159+0000", 2023-10-08T07:07:17.134 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4382999999999999e-05 2023-10-08T07:07:17.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.135 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.135 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603182+0000", 2023-10-08T07:07:17.135 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3014999999999999e-05 2023-10-08T07:07:17.135 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.135 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.135 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.135 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72628 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 3993600~4096,write 4141056~4096,write 4157440~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.135 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.554894+0000", 2023-10-08T07:07:17.136 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4891551180000002, 2023-10-08T07:07:17.136 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049659593000000002, 2023-10-08T07:07:17.136 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.136 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.136 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.136 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.136 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.136 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72628 2023-10-08T07:07:17.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.136 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.136 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.136 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.137 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554894+0000", 2023-10-08T07:07:17.137 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.137 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.137 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554894+0000", 2023-10-08T07:07:17.137 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.137 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.137 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554895+0000", 2023-10-08T07:07:17.137 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2099999999999995e-07 2023-10-08T07:07:17.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554906+0000", 2023-10-08T07:07:17.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1782e-05 2023-10-08T07:07:17.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554923+0000", 2023-10-08T07:07:17.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.664e-05 2023-10-08T07:07:17.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554931+0000", 2023-10-08T07:07:17.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5989999999999996e-06 2023-10-08T07:07:17.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.558600+0000", 2023-10-08T07:07:17.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003669346 2023-10-08T07:07:17.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.140 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.558650+0000", 2023-10-08T07:07:17.140 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0385e-05 2023-10-08T07:07:17.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.140 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.140 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.558750+0000", 2023-10-08T07:07:17.140 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9500999999999995e-05 2023-10-08T07:07:17.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.140 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.140 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.576743+0000", 2023-10-08T07:07:17.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017993680000000001 2023-10-08T07:07:17.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.141 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604444+0000", 2023-10-08T07:07:17.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027700446 2023-10-08T07:07:17.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.141 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604507+0000", 2023-10-08T07:07:17.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3477000000000002e-05 2023-10-08T07:07:17.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604553+0000", 2023-10-08T07:07:17.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5915999999999999e-05 2023-10-08T07:07:17.142 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.142 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.142 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.142 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72630 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2695168~4096,write 2756608~4096,write 2813952~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.142 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.555436+0000", 2023-10-08T07:07:17.142 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4886126539999998, 2023-10-08T07:07:17.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049269518999999998, 2023-10-08T07:07:17.143 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.143 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.143 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.143 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.143 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.143 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72630 2023-10-08T07:07:17.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.143 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.143 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.143 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555436+0000", 2023-10-08T07:07:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555436+0000", 2023-10-08T07:07:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555437+0000", 2023-10-08T07:07:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3799999999999996e-07 2023-10-08T07:07:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.145 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.145 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555479+0000", 2023-10-08T07:07:17.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2475999999999998e-05 2023-10-08T07:07:17.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.145 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.145 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555490+0000", 2023-10-08T07:07:17.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0159999999999999e-05 2023-10-08T07:07:17.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.145 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.146 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555495+0000", 2023-10-08T07:07:17.146 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5169999999999999e-06 2023-10-08T07:07:17.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.146 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560199+0000", 2023-10-08T07:07:17.146 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047036379999999996 2023-10-08T07:07:17.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.146 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560281+0000", 2023-10-08T07:07:17.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2452000000000003e-05 2023-10-08T07:07:17.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560437+0000", 2023-10-08T07:07:17.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000156324 2023-10-08T07:07:17.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578171+0000", 2023-10-08T07:07:17.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017733043 2023-10-08T07:07:17.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604605+0000", 2023-10-08T07:07:17.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026434546999999999 2023-10-08T07:07:17.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604667+0000", 2023-10-08T07:07:17.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1521999999999998e-05 2023-10-08T07:07:17.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.149 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604706+0000", 2023-10-08T07:07:17.149 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9101999999999999e-05 2023-10-08T07:07:17.149 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.149 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.149 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.149 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72638 4.1a 4:5a59f83a:::10000000004.00000002:head [write 2641920~4096,write 2732032~4096,write 2838528~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.149 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.557959+0000", 2023-10-08T07:07:17.149 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4860899490000001, 2023-10-08T07:07:17.149 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045318636000000002, 2023-10-08T07:07:17.150 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.150 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.150 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.150 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.150 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.150 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72638 2023-10-08T07:07:17.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.150 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.150 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.150 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.150 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.557959+0000", 2023-10-08T07:07:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.557959+0000", 2023-10-08T07:07:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.557960+0000", 2023-10-08T07:07:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.85e-07 2023-10-08T07:07:17.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.557972+0000", 2023-10-08T07:07:17.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2044e-05 2023-10-08T07:07:17.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.557981+0000", 2023-10-08T07:07:17.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8510000000000005e-06 2023-10-08T07:07:17.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.153 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.557989+0000", 2023-10-08T07:07:17.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6759999999999996e-06 2023-10-08T07:07:17.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.153 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.153 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560182+0000", 2023-10-08T07:07:17.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0021929290000000001 2023-10-08T07:07:17.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.153 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.153 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560263+0000", 2023-10-08T07:07:17.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0861999999999999e-05 2023-10-08T07:07:17.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.154 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.154 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560403+0000", 2023-10-08T07:07:17.154 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014031499999999999 2023-10-08T07:07:17.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.154 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.154 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.576753+0000", 2023-10-08T07:07:17.154 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016349743 2023-10-08T07:07:17.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603159+0000", 2023-10-08T07:07:17.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026405769999999999 2023-10-08T07:07:17.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603232+0000", 2023-10-08T07:07:17.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2809e-05 2023-10-08T07:07:17.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.156 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603278+0000", 2023-10-08T07:07:17.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5852000000000001e-05 2023-10-08T07:07:17.156 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.156 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.156 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.156 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72646 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2531328~4096,write 2629632~4096,write 2678784~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.156 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.560690+0000", 2023-10-08T07:07:17.156 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4833589040000001, 2023-10-08T07:07:17.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046105475999999999, 2023-10-08T07:07:17.156 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.157 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.157 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.157 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.157 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.157 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72646 2023-10-08T07:07:17.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.157 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.157 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.157 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560690+0000", 2023-10-08T07:07:17.157 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.158 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.158 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560690+0000", 2023-10-08T07:07:17.158 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.158 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.158 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560690+0000", 2023-10-08T07:07:17.158 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.75e-07 2023-10-08T07:07:17.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560705+0000", 2023-10-08T07:07:17.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4849e-05 2023-10-08T07:07:17.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560712+0000", 2023-10-08T07:07:17.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8920000000000003e-06 2023-10-08T07:07:17.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560716+0000", 2023-10-08T07:07:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.206e-06 2023-10-08T07:07:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.562298+0000", 2023-10-08T07:07:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001581785 2023-10-08T07:07:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.562422+0000", 2023-10-08T07:07:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000123533 2023-10-08T07:07:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.161 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.161 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.562608+0000", 2023-10-08T07:07:17.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018668600000000001 2023-10-08T07:07:17.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.161 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.161 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578180+0000", 2023-10-08T07:07:17.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015571694000000001 2023-10-08T07:07:17.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.161 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606730+0000", 2023-10-08T07:07:17.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.028550433 2023-10-08T07:07:17.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.162 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606774+0000", 2023-10-08T07:07:17.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3943999999999998e-05 2023-10-08T07:07:17.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.162 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606795+0000", 2023-10-08T07:07:17.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0979e-05 2023-10-08T07:07:17.163 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.163 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.163 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.163 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.163 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72647 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2301952~4096,write 2551808~4096,write 2572288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.163 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.560995+0000", 2023-10-08T07:07:17.163 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4830541520000002, 2023-10-08T07:07:17.163 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045873965000000003, 2023-10-08T07:07:17.163 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.163 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.164 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.164 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.164 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72647 2023-10-08T07:07:17.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.164 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.164 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560995+0000", 2023-10-08T07:07:17.164 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560995+0000", 2023-10-08T07:07:17.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560995+0000", 2023-10-08T07:07:17.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4399999999999999e-07 2023-10-08T07:07:17.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.561009+0000", 2023-10-08T07:07:17.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.34e-05 2023-10-08T07:07:17.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.166 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.166 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.166 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.561025+0000", 2023-10-08T07:07:17.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6149000000000001e-05 2023-10-08T07:07:17.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.166 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.166 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.166 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.561034+0000", 2023-10-08T07:07:17.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5909999999999996e-06 2023-10-08T07:07:17.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.167 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.569018+0000", 2023-10-08T07:07:17.167 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0079840150000000006 2023-10-08T07:07:17.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.167 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.569093+0000", 2023-10-08T07:07:17.167 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5054000000000003e-05 2023-10-08T07:07:17.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.569254+0000", 2023-10-08T07:07:17.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016177699999999999 2023-10-08T07:07:17.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578288+0000", 2023-10-08T07:07:17.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0090331600000000001 2023-10-08T07:07:17.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606820+0000", 2023-10-08T07:07:17.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.028532557 2023-10-08T07:07:17.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606849+0000", 2023-10-08T07:07:17.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9377999999999999e-05 2023-10-08T07:07:17.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606869+0000", 2023-10-08T07:07:17.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.914e-05 2023-10-08T07:07:17.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.170 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.170 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.170 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.170 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72673 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 1806336~4096,write 2064384~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.170 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.568597+0000", 2023-10-08T07:07:17.170 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4754518179999998, 2023-10-08T07:07:17.170 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.038340028999999998, 2023-10-08T07:07:17.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.170 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.170 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.170 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.171 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.171 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72673 2023-10-08T07:07:17.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.171 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.171 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.171 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568597+0000", 2023-10-08T07:07:17.171 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.171 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568597+0000", 2023-10-08T07:07:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568598+0000", 2023-10-08T07:07:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1399999999999996e-07 2023-10-08T07:07:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568612+0000", 2023-10-08T07:07:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4365999999999999e-05 2023-10-08T07:07:17.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568621+0000", 2023-10-08T07:07:17.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9439999999999994e-06 2023-10-08T07:07:17.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.568627+0000", 2023-10-08T07:07:17.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5509999999999999e-06 2023-10-08T07:07:17.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.573271+0000", 2023-10-08T07:07:17.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0046439510000000003 2023-10-08T07:07:17.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.573318+0000", 2023-10-08T07:07:17.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7808e-05 2023-10-08T07:07:17.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.573401+0000", 2023-10-08T07:07:17.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2810000000000002e-05 2023-10-08T07:07:17.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578381+0000", 2023-10-08T07:07:17.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0049797160000000004 2023-10-08T07:07:17.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606890+0000", 2023-10-08T07:07:17.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.028509329 2023-10-08T07:07:17.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606919+0000", 2023-10-08T07:07:17.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9e-05 2023-10-08T07:07:17.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.606937+0000", 2023-10-08T07:07:17.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.774e-05 2023-10-08T07:07:17.176 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.176 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.177 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.177 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:73593 4.2b 4:d7a77d67:::10000000004.00000029:head [write 1531904~4096,write 1605632~4096,write 1712128~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:17.177 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.893342+0000", 2023-10-08T07:07:17.177 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.150707068, 2023-10-08T07:07:17.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037850460000000002, 2023-10-08T07:07:17.177 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.177 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.177 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.177 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.177 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.178 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 73593 2023-10-08T07:07:17.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.178 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893342+0000", 2023-10-08T07:07:17.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893342+0000", 2023-10-08T07:07:17.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893343+0000", 2023-10-08T07:07:17.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6499999999999998e-07 2023-10-08T07:07:17.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893354+0000", 2023-10-08T07:07:17.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1263999999999999e-05 2023-10-08T07:07:17.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893365+0000", 2023-10-08T07:07:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1161e-05 2023-10-08T07:07:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893373+0000", 2023-10-08T07:07:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9140000000000008e-06 2023-10-08T07:07:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893437+0000", 2023-10-08T07:07:17.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4239000000000006e-05 2023-10-08T07:07:17.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893540+0000", 2023-10-08T07:07:17.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000102765 2023-10-08T07:07:17.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.893767+0000", 2023-10-08T07:07:17.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022713900000000001 2023-10-08T07:07:17.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.902501+0000", 2023-10-08T07:07:17.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0087343409999999996 2023-10-08T07:07:17.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.931075+0000", 2023-10-08T07:07:17.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.028573359999999999 2023-10-08T07:07:17.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.931145+0000", 2023-10-08T07:07:17.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0222000000000006e-05 2023-10-08T07:07:17.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.931192+0000", 2023-10-08T07:07:17.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7190000000000001e-05 2023-10-08T07:07:17.183 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.184 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.184 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.184 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:84518 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 495616~4096,write 503808~4096,write 708608~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:17.184 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:16.869059+0000", 2023-10-08T07:07:17.184 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.174990177, 2023-10-08T07:07:17.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.040248459, 2023-10-08T07:07:17.184 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:17.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:17.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:17.185 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.185 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 84518 2023-10-08T07:07:17.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.185 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:17.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:17.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.869059+0000", 2023-10-08T07:07:17.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:17.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.869059+0000", 2023-10-08T07:07:17.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:17.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:17.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.869059+0000", 2023-10-08T07:07:17.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.68e-07 2023-10-08T07:07:17.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:17.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.869074+0000", 2023-10-08T07:07:17.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5180999999999999e-05 2023-10-08T07:07:17.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.869084+0000", 2023-10-08T07:07:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.285e-06 2023-10-08T07:07:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.869091+0000", 2023-10-08T07:07:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.075e-06 2023-10-08T07:07:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:17.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.869594+0000", 2023-10-08T07:07:17.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00050310999999999997 2023-10-08T07:07:17.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:17.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.869655+0000", 2023-10-08T07:07:17.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1099999999999994e-05 2023-10-08T07:07:17.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:17.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.869754+0000", 2023-10-08T07:07:17.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8858999999999997e-05 2023-10-08T07:07:17.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:17.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.875446+0000", 2023-10-08T07:07:17.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0056916379999999997 2023-10-08T07:07:17.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.909206+0000", 2023-10-08T07:07:17.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033760195999999999 2023-10-08T07:07:17.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:17.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.909268+0000", 2023-10-08T07:07:17.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1823999999999996e-05 2023-10-08T07:07:17.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:17.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:17.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:17.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:16.909307+0000", 2023-10-08T07:07:17.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9523000000000001e-05 2023-10-08T07:07:17.190 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.190 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.190 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.190 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:17.191 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:17.191 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:17.192 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:17.193 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:17.191+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:17.279 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T07:07:17.292 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:17.292+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:17.394 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:17.394 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:17.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.394 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:85947 4.1b e54/17 4:dbb7dde6:::10000000004.0000002c:head v 54'2716, mlcod=54'2713)", 2023-10-08T07:07:17.394 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.386055+0000", 2023-10-08T07:07:17.394 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0065655490000000004, 2023-10-08T07:07:17.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065826130000000002, 2023-10-08T07:07:17.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386055+0000", 2023-10-08T07:07:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386055+0000", 2023-10-08T07:07:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386056+0000", 2023-10-08T07:07:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6000000000000003e-07 2023-10-08T07:07:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386072+0000", 2023-10-08T07:07:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6433e-05 2023-10-08T07:07:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386091+0000", 2023-10-08T07:07:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8621999999999999e-05 2023-10-08T07:07:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386099+0000", 2023-10-08T07:07:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3089999999999996e-06 2023-10-08T07:07:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386137+0000", 2023-10-08T07:07:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7898000000000002e-05 2023-10-08T07:07:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386150+0000", 2023-10-08T07:07:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2697999999999999e-05 2023-10-08T07:07:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:85948 4.30 e54/17 4:0f322a22:::10000000004.00000014:head v 54'1339, mlcod=54'1337)", 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.386405+0000", 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.006215852, 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062722170000000001, 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386405+0000", 2023-10-08T07:07:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386405+0000", 2023-10-08T07:07:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386405+0000", 2023-10-08T07:07:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699999999999995e-07 2023-10-08T07:07:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386420+0000", 2023-10-08T07:07:17.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4065e-05 2023-10-08T07:07:17.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386437+0000", 2023-10-08T07:07:17.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7946999999999999e-05 2023-10-08T07:07:17.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386447+0000", 2023-10-08T07:07:17.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0022e-05 2023-10-08T07:07:17.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386499+0000", 2023-10-08T07:07:17.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1835000000000001e-05 2023-10-08T07:07:17.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.386519+0000", 2023-10-08T07:07:17.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9403999999999999e-05 2023-10-08T07:07:17.403 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.403 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.403 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.403 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:85950 4.2b e54/17 4:d776c1c9:::10000000004.0000003d:head v 54'2704, mlcod=54'2701)", 2023-10-08T07:07:17.403 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.387064+0000", 2023-10-08T07:07:17.403 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0055566499999999998, 2023-10-08T07:07:17.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056560100000000004, 2023-10-08T07:07:17.403 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.403 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.404 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387064+0000", 2023-10-08T07:07:17.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387064+0000", 2023-10-08T07:07:17.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387065+0000", 2023-10-08T07:07:17.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6499999999999999e-07 2023-10-08T07:07:17.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387076+0000", 2023-10-08T07:07:17.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1572e-05 2023-10-08T07:07:17.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387083+0000", 2023-10-08T07:07:17.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0890000000000002e-06 2023-10-08T07:07:17.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387088+0000", 2023-10-08T07:07:17.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7500000000000003e-06 2023-10-08T07:07:17.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387491+0000", 2023-10-08T07:07:17.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00040296700000000001 2023-10-08T07:07:17.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387509+0000", 2023-10-08T07:07:17.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7904999999999999e-05 2023-10-08T07:07:17.407 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.407 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.407 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.407 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:85951 4.19 4:9a1dab10:::10000000004.0000001d:head [write 2445312~4096 in=4096b,write 2510848~4096 in=4096b,write 2994176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:17.407 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.387311+0000", 2023-10-08T07:07:17.408 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0053093050000000003, 2023-10-08T07:07:17.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054496370000000002, 2023-10-08T07:07:17.408 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.408 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.408 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.408 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.408 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.408 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 85951 2023-10-08T07:07:17.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.408 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387311+0000", 2023-10-08T07:07:17.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387311+0000", 2023-10-08T07:07:17.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387312+0000", 2023-10-08T07:07:17.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0160000000000001e-06 2023-10-08T07:07:17.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387324+0000", 2023-10-08T07:07:17.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1805e-05 2023-10-08T07:07:17.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387336+0000", 2023-10-08T07:07:17.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.186e-05 2023-10-08T07:07:17.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387344+0000", 2023-10-08T07:07:17.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7449999999999995e-06 2023-10-08T07:07:17.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387384+0000", 2023-10-08T07:07:17.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0089000000000002e-05 2023-10-08T07:07:17.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.387461+0000", 2023-10-08T07:07:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6581000000000004e-05 2023-10-08T07:07:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:85953 4.10 4:0b5763e1:::10000000004.00000015:head [write 1691648~4096 in=4096b,write 1871872~4096 in=4096b,write 2031616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.388150+0000", 2023-10-08T07:07:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0044708899999999999, 2023-10-08T07:07:17.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046547730000000001, 2023-10-08T07:07:17.413 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.413 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.413 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.413 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.413 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.413 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 85953 2023-10-08T07:07:17.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.413 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388150+0000", 2023-10-08T07:07:17.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388150+0000", 2023-10-08T07:07:17.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388150+0000", 2023-10-08T07:07:17.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.99e-07 2023-10-08T07:07:17.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388160+0000", 2023-10-08T07:07:17.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0064000000000001e-05 2023-10-08T07:07:17.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388169+0000", 2023-10-08T07:07:17.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0150000000000003e-06 2023-10-08T07:07:17.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388173+0000", 2023-10-08T07:07:17.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5040000000000004e-06 2023-10-08T07:07:17.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388207+0000", 2023-10-08T07:07:17.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4128999999999998e-05 2023-10-08T07:07:17.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388256+0000", 2023-10-08T07:07:17.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9181999999999998e-05 2023-10-08T07:07:17.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.417 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.417 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:85954 4.f 4:f2537947:::10000000004.00000017:head [write 258048~4096 in=4096b,write 307200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:17.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.388558+0000", 2023-10-08T07:07:17.418 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.004062637, 2023-10-08T07:07:17.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042921859999999999, 2023-10-08T07:07:17.418 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.418 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.418 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 85954 2023-10-08T07:07:17.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.418 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388558+0000", 2023-10-08T07:07:17.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388558+0000", 2023-10-08T07:07:17.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388559+0000", 2023-10-08T07:07:17.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9999999999999996e-07 2023-10-08T07:07:17.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388573+0000", 2023-10-08T07:07:17.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4234e-05 2023-10-08T07:07:17.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388585+0000", 2023-10-08T07:07:17.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1790000000000001e-05 2023-10-08T07:07:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388591+0000", 2023-10-08T07:07:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2539999999999998e-06 2023-10-08T07:07:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388644+0000", 2023-10-08T07:07:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.321e-05 2023-10-08T07:07:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388731+0000", 2023-10-08T07:07:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6359000000000004e-05 2023-10-08T07:07:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:85955 4.3b 4:df0e4bf8:::10000000004.00000018:head [write 4169728~4096 in=4096b,write 4177920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.388721+0000", 2023-10-08T07:07:17.422 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038999870000000002, 2023-10-08T07:07:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041836369999999996, 2023-10-08T07:07:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 85955 2023-10-08T07:07:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388721+0000", 2023-10-08T07:07:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388721+0000", 2023-10-08T07:07:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388721+0000", 2023-10-08T07:07:17.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2023-10-08T07:07:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388729+0000", 2023-10-08T07:07:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9710000000000004e-06 2023-10-08T07:07:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388737+0000", 2023-10-08T07:07:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2023-10-08T07:07:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388743+0000", 2023-10-08T07:07:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6699999999999997e-06 2023-10-08T07:07:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388787+0000", 2023-10-08T07:07:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4140000000000001e-05 2023-10-08T07:07:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.388863+0000", 2023-10-08T07:07:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5397999999999999e-05 2023-10-08T07:07:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:85956 4.2c e54/17 4:352c144c:::10000000004.00000003:head v 54'1343, mlcod=54'1341)", 2023-10-08T07:07:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.389220+0000", 2023-10-08T07:07:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0034006879999999998, 2023-10-08T07:07:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037565160000000001, 2023-10-08T07:07:17.427 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.389220+0000", 2023-10-08T07:07:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.389220+0000", 2023-10-08T07:07:17.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.389220+0000", 2023-10-08T07:07:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:07:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.389232+0000", 2023-10-08T07:07:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1243999999999999e-05 2023-10-08T07:07:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.389241+0000", 2023-10-08T07:07:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7030000000000001e-06 2023-10-08T07:07:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.389247+0000", 2023-10-08T07:07:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.446e-06 2023-10-08T07:07:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.389295+0000", 2023-10-08T07:07:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8068999999999997e-05 2023-10-08T07:07:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.389312+0000", 2023-10-08T07:07:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7312e-05 2023-10-08T07:07:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.431 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:85959 4.36 4:6d7df329:::10000000004.00000034:head [write 1200128~4096 in=4096b,write 1208320~4096 in=4096b,write 1265664~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.390978+0000", 2023-10-08T07:07:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001642892, 2023-10-08T07:07:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020718300000000002, 2023-10-08T07:07:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 85959 2023-10-08T07:07:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.432 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.390978+0000", 2023-10-08T07:07:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.390978+0000", 2023-10-08T07:07:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.390979+0000", 2023-10-08T07:07:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8800000000000002e-07 2023-10-08T07:07:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.390987+0000", 2023-10-08T07:07:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2730000000000002e-06 2023-10-08T07:07:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.390996+0000", 2023-10-08T07:07:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7609999999999996e-06 2023-10-08T07:07:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391000+0000", 2023-10-08T07:07:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6959999999999996e-06 2023-10-08T07:07:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391040+0000", 2023-10-08T07:07:17.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0043000000000003e-05 2023-10-08T07:07:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391092+0000", 2023-10-08T07:07:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1826000000000002e-05 2023-10-08T07:07:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.436 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:85960 4.2b e54/17 4:d776c1c9:::10000000004.0000003d:head v 54'2705, mlcod=54'2702)", 2023-10-08T07:07:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.391719+0000", 2023-10-08T07:07:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00090136100000000005, 2023-10-08T07:07:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001402279, 2023-10-08T07:07:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391719+0000", 2023-10-08T07:07:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391719+0000", 2023-10-08T07:07:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391720+0000", 2023-10-08T07:07:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:07:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391731+0000", 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0668e-05 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391763+0000", 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2567000000000002e-05 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391772+0000", 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7639999999999994e-06 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391816+0000", 2023-10-08T07:07:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3878000000000002e-05 2023-10-08T07:07:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391828+0000", 2023-10-08T07:07:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1929999999999999e-05 2023-10-08T07:07:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:85961 4.36 4:6d7df329:::10000000004.00000034:head [write 299008~4096 in=4096b,write 311296~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.391757+0000", 2023-10-08T07:07:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00086405599999999998, 2023-10-08T07:07:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001435289, 2023-10-08T07:07:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 85961 2023-10-08T07:07:17.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.442 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391757+0000", 2023-10-08T07:07:17.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391757+0000", 2023-10-08T07:07:17.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391757+0000", 2023-10-08T07:07:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1600000000000001e-07 2023-10-08T07:07:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391771+0000", 2023-10-08T07:07:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3813e-05 2023-10-08T07:07:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391780+0000", 2023-10-08T07:07:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7309999999999999e-06 2023-10-08T07:07:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.391786+0000", 2023-10-08T07:07:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6050000000000003e-06 2023-10-08T07:07:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392094+0000", 2023-10-08T07:07:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030738400000000001 2023-10-08T07:07:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392172+0000", 2023-10-08T07:07:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8438999999999999e-05 2023-10-08T07:07:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.445 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:85962 4.1b e54/17 4:d97fb168:::10000000004.00000008:head v 54'2717, mlcod=54'2714)", 2023-10-08T07:07:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.392416+0000", 2023-10-08T07:07:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000204742, 2023-10-08T07:07:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00085059899999999995, 2023-10-08T07:07:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392416+0000", 2023-10-08T07:07:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392416+0000", 2023-10-08T07:07:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392416+0000", 2023-10-08T07:07:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8500000000000002e-07 2023-10-08T07:07:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392427+0000", 2023-10-08T07:07:17.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.062e-05 2023-10-08T07:07:17.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392435+0000", 2023-10-08T07:07:17.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8350000000000004e-06 2023-10-08T07:07:17.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392439+0000", 2023-10-08T07:07:17.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8489999999999999e-06 2023-10-08T07:07:17.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392470+0000", 2023-10-08T07:07:17.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1300000000000002e-05 2023-10-08T07:07:17.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392488+0000", 2023-10-08T07:07:17.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7761000000000002e-05 2023-10-08T07:07:17.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.450 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.450 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:85963 4.f 4:f2537947:::10000000004.00000017:head [write 2428928~4096 in=4096b,write 2445312~4096 in=4096b,write 2732032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:17.450 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.392460+0000", 2023-10-08T07:07:17.450 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00016083699999999999, 2023-10-08T07:07:17.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00088065699999999997, 2023-10-08T07:07:17.450 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.450 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:17.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.451 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 85963 2023-10-08T07:07:17.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.451 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392460+0000", 2023-10-08T07:07:17.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392460+0000", 2023-10-08T07:07:17.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392460+0000", 2023-10-08T07:07:17.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2499999999999995e-07 2023-10-08T07:07:17.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392484+0000", 2023-10-08T07:07:17.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3221e-05 2023-10-08T07:07:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392490+0000", 2023-10-08T07:07:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2090000000000002e-06 2023-10-08T07:07:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392494+0000", 2023-10-08T07:07:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000002e-06 2023-10-08T07:07:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392538+0000", 2023-10-08T07:07:17.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4196000000000002e-05 2023-10-08T07:07:17.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.392618+0000", 2023-10-08T07:07:17.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0327000000000005e-05 2023-10-08T07:07:17.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.454 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.455 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:85964 4.a e54/17)", 2023-10-08T07:07:17.455 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:17.393323+0000", 2023-10-08T07:07:17.455 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9992976, 2023-10-08T07:07:17.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6860000000000005e-05, 2023-10-08T07:07:17.455 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.455 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:17.455 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.393323+0000", 2023-10-08T07:07:17.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.393323+0000", 2023-10-08T07:07:17.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.393323+0000", 2023-10-08T07:07:17.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2023-10-08T07:07:17.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.393335+0000", 2023-10-08T07:07:17.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1521e-05 2023-10-08T07:07:17.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.393348+0000", 2023-10-08T07:07:17.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2870999999999999e-05 2023-10-08T07:07:17.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:17.393355+0000", 2023-10-08T07:07:17.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9689999999999997e-06 2023-10-08T07:07:17.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.458 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.458 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:17.458 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 14 2023-10-08T07:07:17.458 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:17.459 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:17.393+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:17.460 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:17.501 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:17.501+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:17.595 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:17.594+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:17.695 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:17.695+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:17.698 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:17.698 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:17.698 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:17.698 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:17.698 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:17.713 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:17.798 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:17.798+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:17.898 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:17.898+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:17.955 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:17.955 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:17.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:17.955 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:17.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.956 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36811 4.31 4:8ec1b377:::10000000004.00000019:head [write 3362816~4096,write 3395584~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:17.956 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:17.956 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.676616781, 2023-10-08T07:07:17.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96838670299999996, 2023-10-08T07:07:17.956 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.956 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.956 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.956 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36811 2023-10-08T07:07:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:17.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:17.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:07:17.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275541+0000", 2023-10-08T07:07:17.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3360000000000001e-06 2023-10-08T07:07:17.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275551+0000", 2023-10-08T07:07:17.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.825e-06 2023-10-08T07:07:17.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275556+0000", 2023-10-08T07:07:17.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2023-10-08T07:07:17.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275592+0000", 2023-10-08T07:07:17.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6554000000000003e-05 2023-10-08T07:07:17.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:17.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275599+0000", 2023-10-08T07:07:17.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4640000000000003e-06 2023-10-08T07:07:17.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.238899+0000", 2023-10-08T07:07:17.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96330046999999996 2023-10-08T07:07:17.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239016+0000", 2023-10-08T07:07:17.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116919 2023-10-08T07:07:17.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:17.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239123+0000", 2023-10-08T07:07:17.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010675000000000001 2023-10-08T07:07:17.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:17.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243715+0000", 2023-10-08T07:07:17.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045922469999999998 2023-10-08T07:07:17.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243760+0000", 2023-10-08T07:07:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4666000000000002e-05 2023-10-08T07:07:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243820+0000", 2023-10-08T07:07:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9760999999999999e-05 2023-10-08T07:07:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243917+0000", 2023-10-08T07:07:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7822e-05 2023-10-08T07:07:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36831 4.31 4:8de29a03:::10000000004.00000001:head [write 806912~8192,write 847872~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.669596862999999, 2023-10-08T07:07:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96330879000000003, 2023-10-08T07:07:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.965 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36831 2023-10-08T07:07:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:17.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:17.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:17.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282564+0000", 2023-10-08T07:07:17.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2303999999999999e-05 2023-10-08T07:07:17.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282572+0000", 2023-10-08T07:07:17.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7849999999999992e-06 2023-10-08T07:07:17.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282579+0000", 2023-10-08T07:07:17.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4610000000000002e-06 2023-10-08T07:07:17.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282631+0000", 2023-10-08T07:07:17.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2404999999999997e-05 2023-10-08T07:07:17.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:17.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282640+0000", 2023-10-08T07:07:17.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2640000000000008e-06 2023-10-08T07:07:17.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239925+0000", 2023-10-08T07:07:17.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95728506499999999 2023-10-08T07:07:17.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240097+0000", 2023-10-08T07:07:17.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172497 2023-10-08T07:07:17.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:17.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240235+0000", 2023-10-08T07:07:17.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000137861 2023-10-08T07:07:17.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:17.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243935+0000", 2023-10-08T07:07:17.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037000819999999999 2023-10-08T07:07:17.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245706+0000", 2023-10-08T07:07:17.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001770972 2023-10-08T07:07:17.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:17.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245773+0000", 2023-10-08T07:07:17.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6840000000000004e-05 2023-10-08T07:07:17.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:17.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245859+0000", 2023-10-08T07:07:17.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6442999999999999e-05 2023-10-08T07:07:17.973 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.973 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.973 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.973 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36859 4.31 4:8de29a03:::10000000004.00000001:head [write 3850240~4096,write 3891200~4096,write 3919872~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:17.973 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:17.973 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.658853320999999, 2023-10-08T07:07:17.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95269757099999997, 2023-10-08T07:07:17.973 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.974 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.974 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.974 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.974 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.974 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36859 2023-10-08T07:07:17.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.974 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:17.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:17.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293295+0000", 2023-10-08T07:07:17.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9500000000000001e-07 2023-10-08T07:07:17.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293335+0000", 2023-10-08T07:07:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9867999999999998e-05 2023-10-08T07:07:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293346+0000", 2023-10-08T07:07:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1070000000000001e-05 2023-10-08T07:07:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293353+0000", 2023-10-08T07:07:17.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2640000000000002e-06 2023-10-08T07:07:17.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293409+0000", 2023-10-08T07:07:17.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5926e-05 2023-10-08T07:07:17.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:17.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293418+0000", 2023-10-08T07:07:17.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9940000000000006e-06 2023-10-08T07:07:17.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240889+0000", 2023-10-08T07:07:17.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94747106400000003 2023-10-08T07:07:17.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240963+0000", 2023-10-08T07:07:17.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3431999999999998e-05 2023-10-08T07:07:17.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:17.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241104+0000", 2023-10-08T07:07:17.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014119800000000001 2023-10-08T07:07:17.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:17.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243944+0000", 2023-10-08T07:07:17.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028404200000000002 2023-10-08T07:07:17.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245909+0000", 2023-10-08T07:07:17.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001964351 2023-10-08T07:07:17.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:17.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245942+0000", 2023-10-08T07:07:17.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3526999999999999e-05 2023-10-08T07:07:17.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:17.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245992+0000", 2023-10-08T07:07:17.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9561999999999997e-05 2023-10-08T07:07:17.980 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.980 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36861 4.31 4:8ec1b377:::10000000004.00000019:head [write 385024~4096,write 434176~4096,write 540672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.657944525000001, 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.955921154, 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.981 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36861 2023-10-08T07:07:17.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.982 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:17.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:17.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294204+0000", 2023-10-08T07:07:17.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:17.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294216+0000", 2023-10-08T07:07:17.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2323999999999999e-05 2023-10-08T07:07:17.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294226+0000", 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0217000000000001e-05 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294234+0000", 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6020000000000002e-06 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294300+0000", 2023-10-08T07:07:17.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6515999999999998e-05 2023-10-08T07:07:17.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:17.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294312+0000", 2023-10-08T07:07:17.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1379000000000001e-05 2023-10-08T07:07:17.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241814+0000", 2023-10-08T07:07:17.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.947501751 2023-10-08T07:07:17.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241863+0000", 2023-10-08T07:07:17.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9135999999999998e-05 2023-10-08T07:07:17.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:17.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241953+0000", 2023-10-08T07:07:17.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0124000000000007e-05 2023-10-08T07:07:17.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:17.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243952+0000", 2023-10-08T07:07:17.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019988749999999998 2023-10-08T07:07:17.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250028+0000", 2023-10-08T07:07:17.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060766350000000004 2023-10-08T07:07:17.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:17.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250069+0000", 2023-10-08T07:07:17.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0794000000000003e-05 2023-10-08T07:07:17.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:17.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250124+0000", 2023-10-08T07:07:17.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991000000000003e-05 2023-10-08T07:07:17.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.988 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.988 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36869 4.31 4:8ec1b377:::10000000004.00000019:head [write 917504~4096,write 983040~4096,write 1171456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:17.988 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:17.988 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.654628260999999, 2023-10-08T07:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95596831699999996, 2023-10-08T07:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36869 2023-10-08T07:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:17.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:17.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297520+0000", 2023-10-08T07:07:17.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.23e-07 2023-10-08T07:07:17.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297532+0000", 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1420000000000001e-05 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297548+0000", 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6711e-05 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297557+0000", 2023-10-08T07:07:17.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3250000000000008e-06 2023-10-08T07:07:17.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297606+0000", 2023-10-08T07:07:17.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9724e-05 2023-10-08T07:07:17.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:17.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297614+0000", 2023-10-08T07:07:17.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2023-10-08T07:07:17.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.242809+0000", 2023-10-08T07:07:17.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94519444900000005 2023-10-08T07:07:17.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:17.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.242885+0000", 2023-10-08T07:07:17.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6784000000000002e-05 2023-10-08T07:07:17.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:17.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243025+0000", 2023-10-08T07:07:17.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013984300000000001 2023-10-08T07:07:17.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:17.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246003+0000", 2023-10-08T07:07:17.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002978072 2023-10-08T07:07:17.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:17.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253322+0000", 2023-10-08T07:07:17.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073190779999999997 2023-10-08T07:07:17.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:17.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253391+0000", 2023-10-08T07:07:17.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8285000000000001e-05 2023-10-08T07:07:17.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:17.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253488+0000", 2023-10-08T07:07:17.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7014000000000003e-05 2023-10-08T07:07:17.995 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.995 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:17.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:17.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.996 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36881 4.31 4:8ec1b377:::10000000004.00000019:head [write 888832~4096,write 1191936~4096,write 1327104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:17.996 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:17.996 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.650560717000001, 2023-10-08T07:07:17.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95214402799999998, 2023-10-08T07:07:17.996 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:17.996 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:17.996 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:17.996 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:17.996 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36881 2023-10-08T07:07:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:17.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301588+0000", 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.02e-06 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301600+0000", 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2377e-05 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:17.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301611+0000", 2023-10-08T07:07:17.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0446e-05 2023-10-08T07:07:17.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:17.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301621+0000", 2023-10-08T07:07:17.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0338e-05 2023-10-08T07:07:17.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:17.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:17.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:17.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301668+0000", 2023-10-08T07:07:17.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7459000000000001e-05 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301674+0000", 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7910000000000001e-06 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244001+0000", 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94232701200000002 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244082+0000", 2023-10-08T07:07:18.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0615e-05 2023-10-08T07:07:18.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244202+0000", 2023-10-08T07:07:18.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120427 2023-10-08T07:07:18.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246009+0000", 2023-10-08T07:07:18.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018070899999999999 2023-10-08T07:07:18.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253544+0000", 2023-10-08T07:07:18.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075350729999999998 2023-10-08T07:07:18.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253607+0000", 2023-10-08T07:07:18.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2810000000000003e-05 2023-10-08T07:07:18.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253731+0000", 2023-10-08T07:07:18.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012357000000000001 2023-10-08T07:07:18.003 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.003 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.003 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.003 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36900 4.31 4:8de29a03:::10000000004.00000001:head [write 3239936~4096,write 3371008~4096,write 3878912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.003 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:18.003 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.644237410999999, 2023-10-08T07:07:18.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94607822699999999, 2023-10-08T07:07:18.004 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.004 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.004 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.004 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.004 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.004 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36900 2023-10-08T07:07:18.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.004 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:18.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:18.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307911+0000", 2023-10-08T07:07:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0210000000000001e-06 2023-10-08T07:07:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307926+0000", 2023-10-08T07:07:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4375e-05 2023-10-08T07:07:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307936+0000", 2023-10-08T07:07:18.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0124e-05 2023-10-08T07:07:18.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307950+0000", 2023-10-08T07:07:18.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4659e-05 2023-10-08T07:07:18.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307998+0000", 2023-10-08T07:07:18.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8170000000000001e-05 2023-10-08T07:07:18.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.308005+0000", 2023-10-08T07:07:18.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3339999999999998e-06 2023-10-08T07:07:18.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244911+0000", 2023-10-08T07:07:18.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93690596699999995 2023-10-08T07:07:18.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244972+0000", 2023-10-08T07:07:18.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0854999999999999e-05 2023-10-08T07:07:18.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245073+0000", 2023-10-08T07:07:18.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101406 2023-10-08T07:07:18.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250135+0000", 2023-10-08T07:07:18.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050614620000000001 2023-10-08T07:07:18.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253786+0000", 2023-10-08T07:07:18.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003651615 2023-10-08T07:07:18.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253860+0000", 2023-10-08T07:07:18.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3631e-05 2023-10-08T07:07:18.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253988+0000", 2023-10-08T07:07:18.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000128608 2023-10-08T07:07:18.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.011 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36907 4.31 4:8de29a03:::10000000004.00000001:head [write 53248~4096,write 192512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.011 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:18.011 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.640996305000002, 2023-10-08T07:07:18.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94298633799999998, 2023-10-08T07:07:18.012 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.012 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.012 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36907 2023-10-08T07:07:18.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:18.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311152+0000", 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3200000000000005e-07 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311158+0000", 2023-10-08T07:07:18.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2219999999999999e-06 2023-10-08T07:07:18.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311166+0000", 2023-10-08T07:07:18.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5209999999999997e-06 2023-10-08T07:07:18.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311169+0000", 2023-10-08T07:07:18.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.568e-06 2023-10-08T07:07:18.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311202+0000", 2023-10-08T07:07:18.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3346000000000002e-05 2023-10-08T07:07:18.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311208+0000", 2023-10-08T07:07:18.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.259e-06 2023-10-08T07:07:18.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246041+0000", 2023-10-08T07:07:18.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93483340400000003 2023-10-08T07:07:18.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246088+0000", 2023-10-08T07:07:18.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6653999999999998e-05 2023-10-08T07:07:18.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246173+0000", 2023-10-08T07:07:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5327999999999993e-05 2023-10-08T07:07:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253252+0000", 2023-10-08T07:07:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070788170000000003 2023-10-08T07:07:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254057+0000", 2023-10-08T07:07:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00080496300000000001 2023-10-08T07:07:18.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254090+0000", 2023-10-08T07:07:18.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3325999999999999e-05 2023-10-08T07:07:18.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254138+0000", 2023-10-08T07:07:18.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7398000000000003e-05 2023-10-08T07:07:18.018 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.018 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.018 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36955 4.31 4:8ec1b377:::10000000004.00000019:head [write 3538944~8192,write 3620864~4096,write 3641344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.623953361000002, 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92903069999999999, 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36955 2023-10-08T07:07:18.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.020 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:18.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:18.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328195+0000", 2023-10-08T07:07:18.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1600000000000001e-07 2023-10-08T07:07:18.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328208+0000", 2023-10-08T07:07:18.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3592e-05 2023-10-08T07:07:18.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328218+0000", 2023-10-08T07:07:18.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7270000000000002e-06 2023-10-08T07:07:18.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328226+0000", 2023-10-08T07:07:18.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.328e-06 2023-10-08T07:07:18.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328282+0000", 2023-10-08T07:07:18.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6156000000000002e-05 2023-10-08T07:07:18.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328300+0000", 2023-10-08T07:07:18.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7805e-05 2023-10-08T07:07:18.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246679+0000", 2023-10-08T07:07:18.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91837927200000002 2023-10-08T07:07:18.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246743+0000", 2023-10-08T07:07:18.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4599999999999998e-05 2023-10-08T07:07:18.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246838+0000", 2023-10-08T07:07:18.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5063999999999996e-05 2023-10-08T07:07:18.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253747+0000", 2023-10-08T07:07:18.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069086210000000002 2023-10-08T07:07:18.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257129+0000", 2023-10-08T07:07:18.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033818210000000001 2023-10-08T07:07:18.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257167+0000", 2023-10-08T07:07:18.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8318999999999997e-05 2023-10-08T07:07:18.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257225+0000", 2023-10-08T07:07:18.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7679000000000001e-05 2023-10-08T07:07:18.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.026 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.026 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36966 4.31 4:8de29a03:::10000000004.00000001:head [write 2809856~4096,write 3076096~4096,write 3096576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.620048637, 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92525588800000003, 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36966 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:18.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:18.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332100+0000", 2023-10-08T07:07:18.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:18.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332121+0000", 2023-10-08T07:07:18.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0914999999999999e-05 2023-10-08T07:07:18.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332128+0000", 2023-10-08T07:07:18.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8709999999999997e-06 2023-10-08T07:07:18.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332134+0000", 2023-10-08T07:07:18.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0839999999999999e-06 2023-10-08T07:07:18.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332182+0000", 2023-10-08T07:07:18.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8310000000000003e-05 2023-10-08T07:07:18.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332187+0000", 2023-10-08T07:07:18.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.242e-06 2023-10-08T07:07:18.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248280+0000", 2023-10-08T07:07:18.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91609321899999996 2023-10-08T07:07:18.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248369+0000", 2023-10-08T07:07:18.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8895999999999997e-05 2023-10-08T07:07:18.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248536+0000", 2023-10-08T07:07:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016709099999999999 2023-10-08T07:07:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257075+0000", 2023-10-08T07:07:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085385300000000008 2023-10-08T07:07:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257266+0000", 2023-10-08T07:07:18.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019079399999999999 2023-10-08T07:07:18.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257305+0000", 2023-10-08T07:07:18.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8996999999999999e-05 2023-10-08T07:07:18.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257355+0000", 2023-10-08T07:07:18.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0129000000000001e-05 2023-10-08T07:07:18.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.034 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.034 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36968 4.31 4:8ec1b377:::10000000004.00000019:head [write 835584~4096,write 1372160~4096,write 1646592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.034 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:18.034 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.618328566999999, 2023-10-08T07:07:18.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92599244700000005, 2023-10-08T07:07:18.034 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.034 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36968 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333820+0000", 2023-10-08T07:07:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1999999999999998e-07 2023-10-08T07:07:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333833+0000", 2023-10-08T07:07:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3574000000000001e-05 2023-10-08T07:07:18.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333848+0000", 2023-10-08T07:07:18.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4912999999999999e-05 2023-10-08T07:07:18.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333857+0000", 2023-10-08T07:07:18.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1270000000000003e-06 2023-10-08T07:07:18.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333903+0000", 2023-10-08T07:07:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6782e-05 2023-10-08T07:07:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333911+0000", 2023-10-08T07:07:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5020000000000003e-06 2023-10-08T07:07:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250170+0000", 2023-10-08T07:07:18.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91625966299999995 2023-10-08T07:07:18.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250263+0000", 2023-10-08T07:07:18.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2252999999999999e-05 2023-10-08T07:07:18.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250454+0000", 2023-10-08T07:07:18.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019164400000000001 2023-10-08T07:07:18.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258723+0000", 2023-10-08T07:07:18.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082687699999999999 2023-10-08T07:07:18.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259685+0000", 2023-10-08T07:07:18.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00096196599999999997 2023-10-08T07:07:18.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259739+0000", 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4147999999999997e-05 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259811+0000", 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2185000000000001e-05 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37036 4.31 4:8ec1b377:::10000000004.00000019:head [write 3309568~4096,write 3510272~4096,write 3620864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.041 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:18.042 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.592911716, 2023-10-08T07:07:18.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.90288029999999997, 2023-10-08T07:07:18.042 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.042 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.042 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37036 2023-10-08T07:07:18.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.042 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6899999999999997e-07 2023-10-08T07:07:18.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359246+0000", 2023-10-08T07:07:18.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2369999999999998e-06 2023-10-08T07:07:18.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359254+0000", 2023-10-08T07:07:18.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4989999999999994e-06 2023-10-08T07:07:18.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359260+0000", 2023-10-08T07:07:18.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0209999999999996e-06 2023-10-08T07:07:18.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359319+0000", 2023-10-08T07:07:18.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9042999999999997e-05 2023-10-08T07:07:18.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359330+0000", 2023-10-08T07:07:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0633e-05 2023-10-08T07:07:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.251788+0000", 2023-10-08T07:07:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89245758100000006 2023-10-08T07:07:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.251887+0000", 2023-10-08T07:07:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9223999999999997e-05 2023-10-08T07:07:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.252083+0000", 2023-10-08T07:07:18.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019611800000000001 2023-10-08T07:07:18.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258731+0000", 2023-10-08T07:07:18.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006648307 2023-10-08T07:07:18.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262036+0000", 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033046550000000001 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262069+0000", 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2753000000000003e-05 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262116+0000", 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7559999999999999e-05 2023-10-08T07:07:18.048 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37068 4.31 4:8de29a03:::10000000004.00000001:head [write 987136~4096,write 1011712~4096,write 1044480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.581232745000001, 2023-10-08T07:07:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89311213899999997, 2023-10-08T07:07:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.049 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37068 2023-10-08T07:07:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370916+0000", 2023-10-08T07:07:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5000000000000002e-07 2023-10-08T07:07:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370956+0000", 2023-10-08T07:07:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0898e-05 2023-10-08T07:07:18.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370966+0000", 2023-10-08T07:07:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6209999999999999e-06 2023-10-08T07:07:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370973+0000", 2023-10-08T07:07:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.601e-06 2023-10-08T07:07:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.371022+0000", 2023-10-08T07:07:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9811999999999997e-05 2023-10-08T07:07:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.371032+0000", 2023-10-08T07:07:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8120000000000002e-06 2023-10-08T07:07:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254175+0000", 2023-10-08T07:07:18.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88314265599999997 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254256+0000", 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0820000000000002e-05 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254436+0000", 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000180044 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261274+0000", 2023-10-08T07:07:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006838434 2023-10-08T07:07:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.263950+0000", 2023-10-08T07:07:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026753829999999999 2023-10-08T07:07:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.263981+0000", 2023-10-08T07:07:18.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1568e-05 2023-10-08T07:07:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.264027+0000", 2023-10-08T07:07:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5739999999999999e-05 2023-10-08T07:07:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37088 4.31 4:8de29a03:::10000000004.00000001:head [write 1466368~8192,write 1515520~4096,write 1523712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.056 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.573323867999999, 2023-10-08T07:07:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88701907199999996, 2023-10-08T07:07:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37088 2023-10-08T07:07:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378825+0000", 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7199999999999997e-07 2023-10-08T07:07:18.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378841+0000", 2023-10-08T07:07:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5999e-05 2023-10-08T07:07:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378851+0000", 2023-10-08T07:07:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0474e-05 2023-10-08T07:07:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378858+0000", 2023-10-08T07:07:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9840000000000004e-06 2023-10-08T07:07:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378904+0000", 2023-10-08T07:07:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5704999999999997e-05 2023-10-08T07:07:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378910+0000", 2023-10-08T07:07:18.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5039999999999999e-06 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255278+0000", 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.87636765000000005 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255385+0000", 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000106667 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255557+0000", 2023-10-08T07:07:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172957 2023-10-08T07:07:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261279+0000", 2023-10-08T07:07:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00572195 2023-10-08T07:07:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265761+0000", 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004481423 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265796+0000", 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4727000000000001e-05 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265843+0000", 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7160000000000002e-05 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.063 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37130 4.31 4:8ec1b377:::10000000004.00000019:head [write 1658880~4096,write 1736704~4096,write 1794048~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.556153984000002, 2023-10-08T07:07:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86998378399999998, 2023-10-08T07:07:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37130 2023-10-08T07:07:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:18.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395995+0000", 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600000000000008e-07 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396008+0000", 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3067999999999999e-05 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396019+0000", 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1561e-05 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396027+0000", 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9039999999999992e-06 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396075+0000", 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8165999999999999e-05 2023-10-08T07:07:18.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396081+0000", 2023-10-08T07:07:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8279999999999999e-06 2023-10-08T07:07:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256171+0000", 2023-10-08T07:07:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86008956199999997 2023-10-08T07:07:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256218+0000", 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7018000000000003e-05 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256315+0000", 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7285000000000001e-05 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262125+0000", 2023-10-08T07:07:18.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058099110000000001 2023-10-08T07:07:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265890+0000", 2023-10-08T07:07:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037655829999999999 2023-10-08T07:07:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265929+0000", 2023-10-08T07:07:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8068999999999998e-05 2023-10-08T07:07:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265977+0000", 2023-10-08T07:07:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8832999999999998e-05 2023-10-08T07:07:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37183 4.31 4:8ec1b377:::10000000004.00000019:head [write 16384~4096,write 364544~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.536972927000001, 2023-10-08T07:07:18.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.85095945399999995, 2023-10-08T07:07:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37183 2023-10-08T07:07:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:18.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6499999999999998e-07 2023-10-08T07:07:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415186+0000", 2023-10-08T07:07:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0404999999999999e-05 2023-10-08T07:07:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415198+0000", 2023-10-08T07:07:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.187e-05 2023-10-08T07:07:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415204+0000", 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5119999999999997e-06 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415259+0000", 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5269999999999998e-05 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415270+0000", 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0716e-05 2023-10-08T07:07:18.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257384+0000", 2023-10-08T07:07:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84211341500000003 2023-10-08T07:07:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257442+0000", 2023-10-08T07:07:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8780999999999998e-05 2023-10-08T07:07:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257538+0000", 2023-10-08T07:07:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5956000000000001e-05 2023-10-08T07:07:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265987+0000", 2023-10-08T07:07:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008449069 2023-10-08T07:07:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266053+0000", 2023-10-08T07:07:18.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5813000000000002e-05 2023-10-08T07:07:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266089+0000", 2023-10-08T07:07:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5827000000000001e-05 2023-10-08T07:07:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266134+0000", 2023-10-08T07:07:18.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5055000000000001e-05 2023-10-08T07:07:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37188 4.31 4:8de29a03:::10000000004.00000001:head [write 2031616~4096,write 2191360~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.534845606000001, 2023-10-08T07:07:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.850341613, 2023-10-08T07:07:18.079 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37188 2023-10-08T07:07:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417303+0000", 2023-10-08T07:07:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0599999999999999e-07 2023-10-08T07:07:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417315+0000", 2023-10-08T07:07:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2325e-05 2023-10-08T07:07:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417324+0000", 2023-10-08T07:07:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8489999999999995e-06 2023-10-08T07:07:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417331+0000", 2023-10-08T07:07:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4599999999999997e-06 2023-10-08T07:07:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417437+0000", 2023-10-08T07:07:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105305 2023-10-08T07:07:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417445+0000", 2023-10-08T07:07:18.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3040000000000005e-06 2023-10-08T07:07:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258113+0000", 2023-10-08T07:07:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84066830699999995 2023-10-08T07:07:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258168+0000", 2023-10-08T07:07:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4258999999999997e-05 2023-10-08T07:07:18.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258255+0000", 2023-10-08T07:07:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7235000000000001e-05 2023-10-08T07:07:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265993+0000", 2023-10-08T07:07:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077377599999999998 2023-10-08T07:07:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267565+0000", 2023-10-08T07:07:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001572314 2023-10-08T07:07:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267597+0000", 2023-10-08T07:07:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2361999999999999e-05 2023-10-08T07:07:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267644+0000", 2023-10-08T07:07:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6326999999999999e-05 2023-10-08T07:07:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37197 4.31 4:8de29a03:::10000000004.00000001:head [write 1859584~4096,write 2220032~4096,write 2322432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.531191626000002, 2023-10-08T07:07:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84767678599999996, 2023-10-08T07:07:18.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37197 2023-10-08T07:07:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420957+0000", 2023-10-08T07:07:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9199999999999999e-07 2023-10-08T07:07:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420969+0000", 2023-10-08T07:07:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1753000000000001e-05 2023-10-08T07:07:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420981+0000", 2023-10-08T07:07:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2479e-05 2023-10-08T07:07:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420989+0000", 2023-10-08T07:07:18.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0949999999999996e-06 2023-10-08T07:07:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.421053+0000", 2023-10-08T07:07:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4134999999999995e-05 2023-10-08T07:07:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.421062+0000", 2023-10-08T07:07:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8440000000000004e-06 2023-10-08T07:07:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258760+0000", 2023-10-08T07:07:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83769823499999996 2023-10-08T07:07:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258814+0000", 2023-10-08T07:07:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3876999999999999e-05 2023-10-08T07:07:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258913+0000", 2023-10-08T07:07:18.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8323e-05 2023-10-08T07:07:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265997+0000", 2023-10-08T07:07:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070839830000000003 2023-10-08T07:07:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268535+0000", 2023-10-08T07:07:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002538836 2023-10-08T07:07:18.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268574+0000", 2023-10-08T07:07:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8606000000000003e-05 2023-10-08T07:07:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268633+0000", 2023-10-08T07:07:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8727999999999997e-05 2023-10-08T07:07:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37227 4.31 4:8ec1b377:::10000000004.00000019:head [write 2760704~4096,write 2781184~4096,write 2850816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.520667655, 2023-10-08T07:07:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83736361400000003, 2023-10-08T07:07:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37227 2023-10-08T07:07:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431481+0000", 2023-10-08T07:07:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8400000000000003e-07 2023-10-08T07:07:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431512+0000", 2023-10-08T07:07:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0803999999999998e-05 2023-10-08T07:07:18.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431525+0000", 2023-10-08T07:07:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3704e-05 2023-10-08T07:07:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431535+0000", 2023-10-08T07:07:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2350000000000005e-06 2023-10-08T07:07:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431585+0000", 2023-10-08T07:07:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0531000000000001e-05 2023-10-08T07:07:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431594+0000", 2023-10-08T07:07:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7499999999999992e-06 2023-10-08T07:07:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259851+0000", 2023-10-08T07:07:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82825699399999997 2023-10-08T07:07:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259914+0000", 2023-10-08T07:07:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2928999999999993e-05 2023-10-08T07:07:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.260024+0000", 2023-10-08T07:07:18.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000110556 2023-10-08T07:07:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266001+0000", 2023-10-08T07:07:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059769910000000001 2023-10-08T07:07:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268694+0000", 2023-10-08T07:07:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026924119999999999 2023-10-08T07:07:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268754+0000", 2023-10-08T07:07:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0562000000000001e-05 2023-10-08T07:07:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268843+0000", 2023-10-08T07:07:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9262e-05 2023-10-08T07:07:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37233 4.31 4:8de29a03:::10000000004.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.518460695999998, 2023-10-08T07:07:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83766958000000002, 2023-10-08T07:07:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.105 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37233 2023-10-08T07:07:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:18.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433688+0000", 2023-10-08T07:07:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2023-10-08T07:07:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433701+0000", 2023-10-08T07:07:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3869000000000001e-05 2023-10-08T07:07:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433714+0000", 2023-10-08T07:07:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2173e-05 2023-10-08T07:07:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433720+0000", 2023-10-08T07:07:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7449999999999998e-06 2023-10-08T07:07:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433772+0000", 2023-10-08T07:07:18.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1242999999999997e-05 2023-10-08T07:07:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433781+0000", 2023-10-08T07:07:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1360000000000003e-06 2023-10-08T07:07:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261313+0000", 2023-10-08T07:07:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82753250300000003 2023-10-08T07:07:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261367+0000", 2023-10-08T07:07:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3664e-05 2023-10-08T07:07:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261467+0000", 2023-10-08T07:07:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9668999999999997e-05 2023-10-08T07:07:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266010+0000", 2023-10-08T07:07:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045437189999999999 2023-10-08T07:07:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271269+0000", 2023-10-08T07:07:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052584900000000002 2023-10-08T07:07:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271310+0000", 2023-10-08T07:07:18.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1057999999999999e-05 2023-10-08T07:07:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271356+0000", 2023-10-08T07:07:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6582999999999998e-05 2023-10-08T07:07:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:18.112 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:18.112 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:18.113 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:18.112+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:18.114 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:18.216 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:18.215+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:18.276 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2023-10-08T07:07:18.316 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:18.316 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:18.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.316 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:88479 4.2a 4:5404a18c:::10000000004.00000025:head [write 3289088~4096 in=4096b,write 3346432~4096 in=4096b,write 3416064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:18.316 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:18.308255+0000", 2023-10-08T07:07:18.316 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.006257678, 2023-10-08T07:07:18.317 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0062918080000000003, 2023-10-08T07:07:18.317 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.317 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:18.317 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.317 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.317 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.317 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 88479 2023-10-08T07:07:18.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.317 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.317 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.317 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.317 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308255+0000", 2023-10-08T07:07:18.318 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.318 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308255+0000", 2023-10-08T07:07:18.318 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.318 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308256+0000", 2023-10-08T07:07:18.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1800000000000005e-07 2023-10-08T07:07:18.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.319 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308277+0000", 2023-10-08T07:07:18.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0937999999999998e-05 2023-10-08T07:07:18.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.319 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308287+0000", 2023-10-08T07:07:18.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0108999999999999e-05 2023-10-08T07:07:18.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308295+0000", 2023-10-08T07:07:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2849999999999997e-06 2023-10-08T07:07:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308347+0000", 2023-10-08T07:07:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2979000000000002e-05 2023-10-08T07:07:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308441+0000", 2023-10-08T07:07:18.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3237000000000002e-05 2023-10-08T07:07:18.321 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.321 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.321 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.321 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:88476 4.16 e55/17 4:69eefec8:::10000000004.0000003a:head v 55'1394, mlcod=54'1392)", 2023-10-08T07:07:18.321 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:18.308499+0000", 2023-10-08T07:07:18.322 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.006013722, 2023-10-08T07:07:18.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0061307389999999996, 2023-10-08T07:07:18.322 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.322 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.322 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308499+0000", 2023-10-08T07:07:18.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308499+0000", 2023-10-08T07:07:18.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308500+0000", 2023-10-08T07:07:18.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1600000000000002e-07 2023-10-08T07:07:18.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308516+0000", 2023-10-08T07:07:18.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6524e-05 2023-10-08T07:07:18.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.324 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.324 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308524+0000", 2023-10-08T07:07:18.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9689999999999994e-06 2023-10-08T07:07:18.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.324 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.324 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308530+0000", 2023-10-08T07:07:18.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7289999999999997e-06 2023-10-08T07:07:18.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308786+0000", 2023-10-08T07:07:18.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00025599900000000003 2023-10-08T07:07:18.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.308808+0000", 2023-10-08T07:07:18.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.181e-05 2023-10-08T07:07:18.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.314590+0000", 2023-10-08T07:07:18.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.005782204 2023-10-08T07:07:18.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.314630+0000", 2023-10-08T07:07:18.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0188000000000002e-05 2023-10-08T07:07:18.326 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.326 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.326 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.327 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:88473 4.29 e55/17 4:94216392:::10000000004.0000002b:head v 55'1412, mlcod=54'1410)", 2023-10-08T07:07:18.327 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:18.309474+0000", 2023-10-08T07:07:18.327 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0050391300000000002, 2023-10-08T07:07:18.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052563080000000003, 2023-10-08T07:07:18.327 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.327 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:18.327 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309474+0000", 2023-10-08T07:07:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309474+0000", 2023-10-08T07:07:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309474+0000", 2023-10-08T07:07:18.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9400000000000001e-07 2023-10-08T07:07:18.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309491+0000", 2023-10-08T07:07:18.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6881e-05 2023-10-08T07:07:18.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309499+0000", 2023-10-08T07:07:18.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0360000000000006e-06 2023-10-08T07:07:18.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309506+0000", 2023-10-08T07:07:18.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:07:18.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309557+0000", 2023-10-08T07:07:18.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0108999999999997e-05 2023-10-08T07:07:18.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309577+0000", 2023-10-08T07:07:18.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0560999999999998e-05 2023-10-08T07:07:18.331 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.331 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.331 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.332 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:88483 4.2 4:40ea7945:::10000000004.0000003e:head [write 2297856~4096 in=4096b,write 2711552~4096 in=4096b,write 2985984~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:18.332 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:18.309893+0000", 2023-10-08T07:07:18.332 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0046199559999999997, 2023-10-08T07:07:18.332 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0049396780000000003, 2023-10-08T07:07:18.332 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.332 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:18.332 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.332 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.333 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.333 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 88483 2023-10-08T07:07:18.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.333 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.333 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309893+0000", 2023-10-08T07:07:18.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.334 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.334 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309893+0000", 2023-10-08T07:07:18.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.334 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.334 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309894+0000", 2023-10-08T07:07:18.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3099999999999997e-07 2023-10-08T07:07:18.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309906+0000", 2023-10-08T07:07:18.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2204e-05 2023-10-08T07:07:18.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309917+0000", 2023-10-08T07:07:18.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1109e-05 2023-10-08T07:07:18.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309923+0000", 2023-10-08T07:07:18.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3890000000000004e-06 2023-10-08T07:07:18.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.309980+0000", 2023-10-08T07:07:18.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7485000000000003e-05 2023-10-08T07:07:18.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.337 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.337 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.310086+0000", 2023-10-08T07:07:18.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000105592 2023-10-08T07:07:18.337 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.337 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.337 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.338 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:88484 4.13 4:c9f46be2:::10000000004.00000007:head [write 3870720~4096 in=4096b,write 3936256~4096 in=4096b,write 4022272~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:18.338 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:18.311264+0000", 2023-10-08T07:07:18.338 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0032493510000000001, 2023-10-08T07:07:18.338 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0036621679999999999, 2023-10-08T07:07:18.338 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.338 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:18.338 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.338 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.338 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.338 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 88484 2023-10-08T07:07:18.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.339 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311264+0000", 2023-10-08T07:07:18.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311264+0000", 2023-10-08T07:07:18.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311265+0000", 2023-10-08T07:07:18.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0699999999999996e-07 2023-10-08T07:07:18.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311278+0000", 2023-10-08T07:07:18.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3149000000000001e-05 2023-10-08T07:07:18.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311288+0000", 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0159e-05 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311301+0000", 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3247999999999999e-05 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311422+0000", 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012073 2023-10-08T07:07:18.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.342 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.342 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311506+0000", 2023-10-08T07:07:18.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3973000000000004e-05 2023-10-08T07:07:18.342 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.342 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.342 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.342 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:88485 4.20 4:04004f2c:::10000000004.0000000d:head [write 1695744~4096 in=4096b,write 1843200~12288 in=12288b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:18.342 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:18.311317+0000", 2023-10-08T07:07:18.343 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0031958239999999999, 2023-10-08T07:07:18.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0037022779999999998, 2023-10-08T07:07:18.343 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.343 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:18.343 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.343 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.343 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.343 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 88485 2023-10-08T07:07:18.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.343 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311317+0000", 2023-10-08T07:07:18.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311317+0000", 2023-10-08T07:07:18.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311318+0000", 2023-10-08T07:07:18.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1900000000000003e-07 2023-10-08T07:07:18.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311330+0000", 2023-10-08T07:07:18.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2041999999999999e-05 2023-10-08T07:07:18.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311338+0000", 2023-10-08T07:07:18.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2889999999999998e-06 2023-10-08T07:07:18.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311345+0000", 2023-10-08T07:07:18.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3470000000000004e-06 2023-10-08T07:07:18.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311402+0000", 2023-10-08T07:07:18.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7398000000000002e-05 2023-10-08T07:07:18.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311479+0000", 2023-10-08T07:07:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6791000000000004e-05 2023-10-08T07:07:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311616+0000", 2023-10-08T07:07:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013779999999999999 2023-10-08T07:07:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.347 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:88489 4.27 4:e7872a4f:::10000000004.00000037:head [write 3203072~4096 in=4096b,write 3309568~4096 in=4096b,write 3563520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:18.348 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:18.311873+0000", 2023-10-08T07:07:18.348 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0026404559999999998, 2023-10-08T07:07:18.348 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032563869999999999, 2023-10-08T07:07:18.348 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.348 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:18.348 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.348 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.348 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.348 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 88489 2023-10-08T07:07:18.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.348 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311873+0000", 2023-10-08T07:07:18.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311873+0000", 2023-10-08T07:07:18.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311874+0000", 2023-10-08T07:07:18.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3300000000000001e-07 2023-10-08T07:07:18.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311886+0000", 2023-10-08T07:07:18.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2269999999999999e-05 2023-10-08T07:07:18.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311896+0000", 2023-10-08T07:07:18.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0427e-05 2023-10-08T07:07:18.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.351 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.351 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311903+0000", 2023-10-08T07:07:18.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2910000000000002e-06 2023-10-08T07:07:18.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.351 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.351 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.311965+0000", 2023-10-08T07:07:18.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1253999999999993e-05 2023-10-08T07:07:18.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312072+0000", 2023-10-08T07:07:18.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000107254 2023-10-08T07:07:18.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.315104+0000", 2023-10-08T07:07:18.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0030324250000000001 2023-10-08T07:07:18.353 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.353 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.353 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.353 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:88491 4.2 4:40ea7945:::10000000004.0000003e:head [write 294912~8192 in=8192b,write 364544~4096 in=4096b,write 405504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:18.353 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:18.312387+0000", 2023-10-08T07:07:18.353 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0021259180000000001, 2023-10-08T07:07:18.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0028449700000000001, 2023-10-08T07:07:18.354 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.354 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:18.354 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.354 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.354 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.354 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 88491 2023-10-08T07:07:18.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.354 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.354 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.355 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312387+0000", 2023-10-08T07:07:18.355 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.355 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312387+0000", 2023-10-08T07:07:18.355 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.356 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312388+0000", 2023-10-08T07:07:18.356 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3600000000000002e-07 2023-10-08T07:07:18.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.356 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.356 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.356 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312405+0000", 2023-10-08T07:07:18.356 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7285000000000001e-05 2023-10-08T07:07:18.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.356 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.356 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.356 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312416+0000", 2023-10-08T07:07:18.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0727000000000001e-05 2023-10-08T07:07:18.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312427+0000", 2023-10-08T07:07:18.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1430999999999999e-05 2023-10-08T07:07:18.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312496+0000", 2023-10-08T07:07:18.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8396e-05 2023-10-08T07:07:18.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312601+0000", 2023-10-08T07:07:18.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000105068 2023-10-08T07:07:18.358 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.358 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.358 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.359 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:88490 4.29 e55/17 4:94216392:::10000000004.0000002b:head v 55'1413, mlcod=54'1410)", 2023-10-08T07:07:18.359 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:18.312513+0000", 2023-10-08T07:07:18.359 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0020004200000000001, 2023-10-08T07:07:18.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002790098, 2023-10-08T07:07:18.359 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.359 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:18.359 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.359 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.360 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312513+0000", 2023-10-08T07:07:18.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.360 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312513+0000", 2023-10-08T07:07:18.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.360 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312514+0000", 2023-10-08T07:07:18.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6000000000000002e-07 2023-10-08T07:07:18.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312530+0000", 2023-10-08T07:07:18.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6555999999999999e-05 2023-10-08T07:07:18.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312543+0000", 2023-10-08T07:07:18.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2425e-05 2023-10-08T07:07:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312550+0000", 2023-10-08T07:07:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5780000000000001e-06 2023-10-08T07:07:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312602+0000", 2023-10-08T07:07:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2315999999999999e-05 2023-10-08T07:07:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.312620+0000", 2023-10-08T07:07:18.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7762e-05 2023-10-08T07:07:18.363 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.363 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.363 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.363 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.363 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:88492 4.c 4:31e28161:::10000000004.00000011:head [write 2789376~4096 in=4096b,write 2871296~4096 in=4096b,write 3358720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:18.363 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:18.313203+0000", 2023-10-08T07:07:18.363 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.001310491, 2023-10-08T07:07:18.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002170127, 2023-10-08T07:07:18.364 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.364 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:18.364 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.364 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.364 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.364 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 88492 2023-10-08T07:07:18.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.364 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.364 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.364 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313203+0000", 2023-10-08T07:07:18.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313203+0000", 2023-10-08T07:07:18.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313204+0000", 2023-10-08T07:07:18.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6700000000000002e-07 2023-10-08T07:07:18.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313215+0000", 2023-10-08T07:07:18.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1724e-05 2023-10-08T07:07:18.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313227+0000", 2023-10-08T07:07:18.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1286e-05 2023-10-08T07:07:18.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313235+0000", 2023-10-08T07:07:18.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4800000000000001e-06 2023-10-08T07:07:18.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.367 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.367 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313292+0000", 2023-10-08T07:07:18.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6505000000000002e-05 2023-10-08T07:07:18.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.367 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.367 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313373+0000", 2023-10-08T07:07:18.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1126999999999998e-05 2023-10-08T07:07:18.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313537+0000", 2023-10-08T07:07:18.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000164024 2023-10-08T07:07:18.368 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.368 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.368 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.368 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:88494 4.c 4.ccc34acc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:18.368 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:18.313811+0000", 2023-10-08T07:07:18.369 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.000702183, 2023-10-08T07:07:18.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001634153, 2023-10-08T07:07:18.369 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.369 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:18.369 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.369 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.369 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.369 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 88494 2023-10-08T07:07:18.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.369 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313811+0000", 2023-10-08T07:07:18.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313811+0000", 2023-10-08T07:07:18.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313812+0000", 2023-10-08T07:07:18.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9500000000000002e-07 2023-10-08T07:07:18.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313821+0000", 2023-10-08T07:07:18.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2359999999999993e-06 2023-10-08T07:07:18.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313831+0000", 2023-10-08T07:07:18.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8519999999999999e-06 2023-10-08T07:07:18.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.372 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.313836+0000", 2023-10-08T07:07:18.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0329999999999999e-06 2023-10-08T07:07:18.372 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.372 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.372 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.372 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:88495 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2523136~4096 in=4096b,write 2555904~4096 in=4096b,write 2678784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:18.372 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:18.314202+0000", 2023-10-08T07:07:18.372 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.000310723, 2023-10-08T07:07:18.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0013082759999999999, 2023-10-08T07:07:18.373 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.373 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:18.373 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.373 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.373 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.373 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 88495 2023-10-08T07:07:18.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.373 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.314202+0000", 2023-10-08T07:07:18.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.314202+0000", 2023-10-08T07:07:18.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.314203+0000", 2023-10-08T07:07:18.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:07:18.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.314320+0000", 2023-10-08T07:07:18.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117241 2023-10-08T07:07:18.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.314332+0000", 2023-10-08T07:07:18.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1416999999999999e-05 2023-10-08T07:07:18.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.314339+0000", 2023-10-08T07:07:18.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9870000000000002e-06 2023-10-08T07:07:18.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.314397+0000", 2023-10-08T07:07:18.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8003e-05 2023-10-08T07:07:18.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.314460+0000", 2023-10-08T07:07:18.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3356999999999997e-05 2023-10-08T07:07:18.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.377 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:18.314559+0000", 2023-10-08T07:07:18.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8366e-05 2023-10-08T07:07:18.377 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.377 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.377 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.377 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.377 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:07:18.377 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 12 2023-10-08T07:07:18.377 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:18.378 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:18.315+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:18.379 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:18.417 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:18.417+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:18.518 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:18.517+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:18.608 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:18.609 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:18.609 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:18.618 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:18.617+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:18.623 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:18.718 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:18.719 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:18.718+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:18.820 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:18.820+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:18.859 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:18.860 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:18.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:18.860 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:18.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.860 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72627 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 352256~4096,write 483328~4096,write 651264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:18.860 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.554404+0000", 2023-10-08T07:07:18.860 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 6.3023778180000001, 2023-10-08T07:07:18.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048777491999999999, 2023-10-08T07:07:18.860 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.860 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.860 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.861 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.861 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.861 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72627 2023-10-08T07:07:18.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.861 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.861 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554404+0000", 2023-10-08T07:07:18.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.861 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.862 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554404+0000", 2023-10-08T07:07:18.862 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.862 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554405+0000", 2023-10-08T07:07:18.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.001e-06 2023-10-08T07:07:18.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554432+0000", 2023-10-08T07:07:18.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6679e-05 2023-10-08T07:07:18.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554444+0000", 2023-10-08T07:07:18.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2167999999999999e-05 2023-10-08T07:07:18.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.864 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.864 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554453+0000", 2023-10-08T07:07:18.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2449999999999998e-06 2023-10-08T07:07:18.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.864 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.864 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556730+0000", 2023-10-08T07:07:18.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022777269999999998 2023-10-08T07:07:18.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.865 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.865 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.865 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556782+0000", 2023-10-08T07:07:18.865 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1756999999999999e-05 2023-10-08T07:07:18.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.865 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.865 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.865 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556901+0000", 2023-10-08T07:07:18.865 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000119132 2023-10-08T07:07:18.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.866 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.866 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.571593+0000", 2023-10-08T07:07:18.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014691638999999999 2023-10-08T07:07:18.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.866 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603125+0000", 2023-10-08T07:07:18.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.031531745999999999 2023-10-08T07:07:18.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603159+0000", 2023-10-08T07:07:18.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4382999999999999e-05 2023-10-08T07:07:18.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.868 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.868 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.868 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603182+0000", 2023-10-08T07:07:18.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3014999999999999e-05 2023-10-08T07:07:18.868 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.868 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.869 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.869 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.869 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72628 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 3993600~4096,write 4141056~4096,write 4157440~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:18.869 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.554894+0000", 2023-10-08T07:07:18.869 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 6.301888538, 2023-10-08T07:07:18.870 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049659593000000002, 2023-10-08T07:07:18.870 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.870 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.870 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.870 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.871 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.871 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72628 2023-10-08T07:07:18.871 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.871 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.871 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.871 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.872 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554894+0000", 2023-10-08T07:07:18.872 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.872 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.872 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.872 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554894+0000", 2023-10-08T07:07:18.873 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.873 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.873 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.873 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554895+0000", 2023-10-08T07:07:18.873 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2099999999999995e-07 2023-10-08T07:07:18.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.873 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.874 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.874 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554906+0000", 2023-10-08T07:07:18.874 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1782e-05 2023-10-08T07:07:18.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.875 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.875 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.875 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554923+0000", 2023-10-08T07:07:18.875 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.664e-05 2023-10-08T07:07:18.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.876 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.876 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.876 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554931+0000", 2023-10-08T07:07:18.876 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5989999999999996e-06 2023-10-08T07:07:18.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.877 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.877 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.558600+0000", 2023-10-08T07:07:18.877 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003669346 2023-10-08T07:07:18.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.878 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.878 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.558650+0000", 2023-10-08T07:07:18.878 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0385e-05 2023-10-08T07:07:18.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.878 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.878 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.558750+0000", 2023-10-08T07:07:18.879 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9500999999999995e-05 2023-10-08T07:07:18.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.879 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.879 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.879 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.576743+0000", 2023-10-08T07:07:18.879 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017993680000000001 2023-10-08T07:07:18.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.880 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.880 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.880 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604444+0000", 2023-10-08T07:07:18.880 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027700446 2023-10-08T07:07:18.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.880 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.880 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.880 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604507+0000", 2023-10-08T07:07:18.881 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3477000000000002e-05 2023-10-08T07:07:18.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.881 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.881 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.881 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604553+0000", 2023-10-08T07:07:18.881 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5915999999999999e-05 2023-10-08T07:07:18.881 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.882 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.882 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.882 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.882 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72630 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2695168~4096,write 2756608~4096,write 2813952~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:18.882 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.555436+0000", 2023-10-08T07:07:18.882 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 6.3013460739999996, 2023-10-08T07:07:18.883 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049269518999999998, 2023-10-08T07:07:18.883 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.883 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.883 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.883 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.883 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.883 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72630 2023-10-08T07:07:18.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.883 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.883 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.884 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.884 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555436+0000", 2023-10-08T07:07:18.884 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.884 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.884 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.884 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555436+0000", 2023-10-08T07:07:18.884 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.884 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.884 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.885 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555437+0000", 2023-10-08T07:07:18.885 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3799999999999996e-07 2023-10-08T07:07:18.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.885 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.885 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.885 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555479+0000", 2023-10-08T07:07:18.885 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2475999999999998e-05 2023-10-08T07:07:18.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.886 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.886 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.886 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555490+0000", 2023-10-08T07:07:18.886 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0159999999999999e-05 2023-10-08T07:07:18.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.886 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.886 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.886 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555495+0000", 2023-10-08T07:07:18.886 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5169999999999999e-06 2023-10-08T07:07:18.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.887 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.887 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.887 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560199+0000", 2023-10-08T07:07:18.887 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047036379999999996 2023-10-08T07:07:18.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.887 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.887 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.887 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560281+0000", 2023-10-08T07:07:18.887 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2452000000000003e-05 2023-10-08T07:07:18.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.887 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.888 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.888 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560437+0000", 2023-10-08T07:07:18.888 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000156324 2023-10-08T07:07:18.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.888 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.888 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.888 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578171+0000", 2023-10-08T07:07:18.888 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017733043 2023-10-08T07:07:18.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.888 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.888 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.888 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604605+0000", 2023-10-08T07:07:18.889 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026434546999999999 2023-10-08T07:07:18.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.889 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.889 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.889 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604667+0000", 2023-10-08T07:07:18.889 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1521999999999998e-05 2023-10-08T07:07:18.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.890 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.890 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.890 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604706+0000", 2023-10-08T07:07:18.890 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9101999999999999e-05 2023-10-08T07:07:18.890 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.890 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.890 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.890 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.890 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85542 4.30 4:0f322a22:::10000000004.00000014:head [write 1478656~4096,write 1536000~4096,write 1748992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.891 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.227446+0000", 2023-10-08T07:07:18.891 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.6293359359999999, 2023-10-08T07:07:18.891 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.065063832000000002, 2023-10-08T07:07:18.891 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.891 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.891 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.891 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.891 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.891 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85542 2023-10-08T07:07:18.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.891 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.892 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.892 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.892 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227446+0000", 2023-10-08T07:07:18.892 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.892 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.892 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.892 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227446+0000", 2023-10-08T07:07:18.892 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.892 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.893 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.893 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227447+0000", 2023-10-08T07:07:18.893 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4399999999999999e-07 2023-10-08T07:07:18.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.893 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.893 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.893 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227456+0000", 2023-10-08T07:07:18.893 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0189999999999995e-06 2023-10-08T07:07:18.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.893 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.893 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.894 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227468+0000", 2023-10-08T07:07:18.894 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2156e-05 2023-10-08T07:07:18.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.894 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.894 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.894 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227474+0000", 2023-10-08T07:07:18.894 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8000000000000004e-06 2023-10-08T07:07:18.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.894 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.895 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.895 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227525+0000", 2023-10-08T07:07:18.895 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1359000000000001e-05 2023-10-08T07:07:18.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.895 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.895 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.895 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227585+0000", 2023-10-08T07:07:18.896 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9324000000000003e-05 2023-10-08T07:07:18.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.896 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.896 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.896 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227682+0000", 2023-10-08T07:07:18.896 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7171999999999997e-05 2023-10-08T07:07:18.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.897 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.897 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.897 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.229286+0000", 2023-10-08T07:07:18.897 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001604383 2023-10-08T07:07:18.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.898 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.898 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.898 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.292408+0000", 2023-10-08T07:07:18.898 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.063121770999999993 2023-10-08T07:07:18.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.899 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.899 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.899 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.292466+0000", 2023-10-08T07:07:18.899 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7964999999999998e-05 2023-10-08T07:07:18.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.899 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.900 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.900 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.292510+0000", 2023-10-08T07:07:18.900 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4138999999999999e-05 2023-10-08T07:07:18.900 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.900 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.900 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.901 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85551 4.20 4:04004f2c:::10000000004.0000000d:head [write 290816~4096,write 634880~4096,write 692224~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.901 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.230050+0000", 2023-10-08T07:07:18.901 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.6267317530000001, 2023-10-08T07:07:18.901 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.051188919999999999, 2023-10-08T07:07:18.901 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.902 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.902 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.902 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.902 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.902 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85551 2023-10-08T07:07:18.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.903 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.903 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.903 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.903 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230050+0000", 2023-10-08T07:07:18.903 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.904 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.904 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.904 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230050+0000", 2023-10-08T07:07:18.904 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.905 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230051+0000", 2023-10-08T07:07:18.905 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8299999999999996e-07 2023-10-08T07:07:18.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.905 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.906 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230063+0000", 2023-10-08T07:07:18.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1747e-05 2023-10-08T07:07:18.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.906 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.906 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.906 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230071+0000", 2023-10-08T07:07:18.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.841e-06 2023-10-08T07:07:18.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.906 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.909 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.909 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230075+0000", 2023-10-08T07:07:18.909 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6879999999999998e-06 2023-10-08T07:07:18.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.909 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.910 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.910 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230124+0000", 2023-10-08T07:07:18.910 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8367e-05 2023-10-08T07:07:18.910 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.910 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.911 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.911 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230214+0000", 2023-10-08T07:07:18.911 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0514999999999997e-05 2023-10-08T07:07:18.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.911 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.911 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.912 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230368+0000", 2023-10-08T07:07:18.912 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015336200000000001 2023-10-08T07:07:18.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.912 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.912 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.234266+0000", 2023-10-08T07:07:18.912 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003898599 2023-10-08T07:07:18.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.913 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.281157+0000", 2023-10-08T07:07:18.913 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046890319999999999 2023-10-08T07:07:18.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.913 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.913 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.281206+0000", 2023-10-08T07:07:18.913 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8984999999999999e-05 2023-10-08T07:07:18.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.913 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.914 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.281239+0000", 2023-10-08T07:07:18.914 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3813000000000003e-05 2023-10-08T07:07:18.914 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.914 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.914 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.914 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.914 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85554 4.1b 4:d97fb168:::10000000004.00000008:head [write 2973696~4096,write 2998272~4096,write 3080192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.914 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.230968+0000", 2023-10-08T07:07:18.914 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.625814638, 2023-10-08T07:07:18.915 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046730156000000002, 2023-10-08T07:07:18.915 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.915 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.915 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.915 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.915 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.915 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85554 2023-10-08T07:07:18.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.915 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.915 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.915 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230968+0000", 2023-10-08T07:07:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230968+0000", 2023-10-08T07:07:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230968+0000", 2023-10-08T07:07:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.54e-07 2023-10-08T07:07:18.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230981+0000", 2023-10-08T07:07:18.917 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2285e-05 2023-10-08T07:07:18.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230991+0000", 2023-10-08T07:07:18.917 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9320000000000008e-06 2023-10-08T07:07:18.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.918 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.918 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230998+0000", 2023-10-08T07:07:18.918 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.763e-06 2023-10-08T07:07:18.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.918 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.918 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.918 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.231049+0000", 2023-10-08T07:07:18.918 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1048000000000003e-05 2023-10-08T07:07:18.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.918 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.918 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.919 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.231125+0000", 2023-10-08T07:07:18.919 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6003999999999999e-05 2023-10-08T07:07:18.919 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.919 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.919 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.919 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.231278+0000", 2023-10-08T07:07:18.919 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015213100000000001 2023-10-08T07:07:18.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.920 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.920 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.920 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.234091+0000", 2023-10-08T07:07:18.920 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002813369 2023-10-08T07:07:18.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.921 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.921 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.277603+0000", 2023-10-08T07:07:18.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.043512543000000001 2023-10-08T07:07:18.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.922 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.922 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.277661+0000", 2023-10-08T07:07:18.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7394e-05 2023-10-08T07:07:18.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.922 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.922 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.277698+0000", 2023-10-08T07:07:18.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6933e-05 2023-10-08T07:07:18.922 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.923 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.923 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.923 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85559 4.38 4:1e0977c7:::10000000004.00000022:head [write 385024~4096,write 524288~4096,write 610304~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.923 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.232568+0000", 2023-10-08T07:07:18.923 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.624214381, 2023-10-08T07:07:18.923 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049973141999999998, 2023-10-08T07:07:18.923 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.923 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.923 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.924 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.924 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.924 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85559 2023-10-08T07:07:18.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.924 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232568+0000", 2023-10-08T07:07:18.924 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.925 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232568+0000", 2023-10-08T07:07:18.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.925 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.925 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.925 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232569+0000", 2023-10-08T07:07:18.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6099999999999999e-07 2023-10-08T07:07:18.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.925 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.925 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.925 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232580+0000", 2023-10-08T07:07:18.926 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1721e-05 2023-10-08T07:07:18.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.926 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.926 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.926 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232597+0000", 2023-10-08T07:07:18.926 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6957999999999999e-05 2023-10-08T07:07:18.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.926 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.926 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.926 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232605+0000", 2023-10-08T07:07:18.926 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7749999999999993e-06 2023-10-08T07:07:18.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.927 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.927 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232673+0000", 2023-10-08T07:07:18.927 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7879000000000005e-05 2023-10-08T07:07:18.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.927 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.927 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232812+0000", 2023-10-08T07:07:18.927 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013899299999999999 2023-10-08T07:07:18.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.928 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.233001+0000", 2023-10-08T07:07:18.928 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000189197 2023-10-08T07:07:18.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.928 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.234859+0000", 2023-10-08T07:07:18.928 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018577330000000001 2023-10-08T07:07:18.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.928 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.282442+0000", 2023-10-08T07:07:18.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047583054 2023-10-08T07:07:18.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.929 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.929 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.282478+0000", 2023-10-08T07:07:18.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:07:18.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.929 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.929 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.282541+0000", 2023-10-08T07:07:18.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2998999999999998e-05 2023-10-08T07:07:18.930 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.930 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.930 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.930 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.930 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85570 4.20 4:05b3915c:::10000000004.00000016:head [write 630784~4096,write 692224~4096,write 802816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.930 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.235867+0000", 2023-10-08T07:07:18.930 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.620915608, 2023-10-08T07:07:18.931 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.054480849999999997, 2023-10-08T07:07:18.931 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.931 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.931 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.931 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.931 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.931 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85570 2023-10-08T07:07:18.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.931 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.931 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.931 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.931 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235867+0000", 2023-10-08T07:07:18.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.932 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.932 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235867+0000", 2023-10-08T07:07:18.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.932 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.932 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235868+0000", 2023-10-08T07:07:18.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7300000000000005e-07 2023-10-08T07:07:18.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235878+0000", 2023-10-08T07:07:18.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0757999999999999e-05 2023-10-08T07:07:18.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235886+0000", 2023-10-08T07:07:18.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1189999999999997e-06 2023-10-08T07:07:18.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.934 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.934 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235892+0000", 2023-10-08T07:07:18.934 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3979999999999998e-06 2023-10-08T07:07:18.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.934 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.934 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.934 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235929+0000", 2023-10-08T07:07:18.934 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7660999999999997e-05 2023-10-08T07:07:18.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.934 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.935 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.935 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235977+0000", 2023-10-08T07:07:18.935 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8000000000000001e-05 2023-10-08T07:07:18.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.935 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.935 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.935 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236072+0000", 2023-10-08T07:07:18.935 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4703000000000005e-05 2023-10-08T07:07:18.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.935 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.935 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.935 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.240171+0000", 2023-10-08T07:07:18.936 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040992579999999997 2023-10-08T07:07:18.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.936 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.936 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.936 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.290256+0000", 2023-10-08T07:07:18.936 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050085058000000002 2023-10-08T07:07:18.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.936 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.936 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.936 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.290309+0000", 2023-10-08T07:07:18.936 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2373999999999997e-05 2023-10-08T07:07:18.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.937 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.937 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.937 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.290347+0000", 2023-10-08T07:07:18.937 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8648e-05 2023-10-08T07:07:18.937 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.937 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.937 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.937 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.937 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85573 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 258048~4096,write 630784~4096,write 647168~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.937 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.236720+0000", 2023-10-08T07:07:18.937 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.6200618659999999, 2023-10-08T07:07:18.938 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.052292526999999998, 2023-10-08T07:07:18.938 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.938 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.938 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.938 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.938 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.938 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85573 2023-10-08T07:07:18.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.938 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.938 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.938 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.939 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236720+0000", 2023-10-08T07:07:18.939 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.939 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.939 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.939 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236720+0000", 2023-10-08T07:07:18.939 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.939 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.939 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.939 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236721+0000", 2023-10-08T07:07:18.939 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3499999999999996e-07 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236742+0000", 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1314999999999998e-05 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236749+0000", 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5379999999999999e-06 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.940 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.941 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236753+0000", 2023-10-08T07:07:18.941 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2080000000000002e-06 2023-10-08T07:07:18.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.941 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.941 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.941 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.239116+0000", 2023-10-08T07:07:18.941 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0023627549999999998 2023-10-08T07:07:18.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.941 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.941 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.941 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.239181+0000", 2023-10-08T07:07:18.942 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4839999999999996e-05 2023-10-08T07:07:18.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.942 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.942 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.942 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.239315+0000", 2023-10-08T07:07:18.942 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000134635 2023-10-08T07:07:18.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.942 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.942 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.942 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.242261+0000", 2023-10-08T07:07:18.942 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029461209999999999 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.288944+0000", 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046682781999999999 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.288978+0000", 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3763999999999997e-05 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.943 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.944 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.289013+0000", 2023-10-08T07:07:18.944 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5033999999999997e-05 2023-10-08T07:07:18.944 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.944 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.944 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.944 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.944 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85574 4.20 4:07572838:::10000000004.00000010:head [write 3239936~4096,write 3457024~4096,write 3518464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.944 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.236985+0000", 2023-10-08T07:07:18.944 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.619797205, 2023-10-08T07:07:18.945 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.059496828000000002, 2023-10-08T07:07:18.945 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.945 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.945 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.945 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.945 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.945 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85574 2023-10-08T07:07:18.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.945 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.945 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.945 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.945 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236985+0000", 2023-10-08T07:07:18.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.946 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236985+0000", 2023-10-08T07:07:18.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.946 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236985+0000", 2023-10-08T07:07:18.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0999999999999999e-07 2023-10-08T07:07:18.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.947 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.237007+0000", 2023-10-08T07:07:18.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1529e-05 2023-10-08T07:07:18.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.947 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.237013+0000", 2023-10-08T07:07:18.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1800000000000001e-06 2023-10-08T07:07:18.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.948 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.948 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.237017+0000", 2023-10-08T07:07:18.948 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1640000000000003e-06 2023-10-08T07:07:18.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.948 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.948 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.948 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.238022+0000", 2023-10-08T07:07:18.948 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010047159999999999 2023-10-08T07:07:18.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.948 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.948 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.238128+0000", 2023-10-08T07:07:18.949 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010597700000000001 2023-10-08T07:07:18.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.949 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.238288+0000", 2023-10-08T07:07:18.949 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016046100000000001 2023-10-08T07:07:18.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.949 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.240591+0000", 2023-10-08T07:07:18.950 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0023025559999999999 2023-10-08T07:07:18.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.950 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.950 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.950 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296421+0000", 2023-10-08T07:07:18.950 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055829742000000002 2023-10-08T07:07:18.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.950 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.950 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.950 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296459+0000", 2023-10-08T07:07:18.950 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7765000000000002e-05 2023-10-08T07:07:18.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.951 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.951 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.951 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296482+0000", 2023-10-08T07:07:18.951 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3328000000000001e-05 2023-10-08T07:07:18.951 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.951 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.951 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.951 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.951 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85593 4.20 4:07572838:::10000000004.00000010:head [write 4096~4096,write 28672~4096,write 233472~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.951 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.243319+0000", 2023-10-08T07:07:18.951 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.613463315, 2023-10-08T07:07:18.952 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.053245457000000003, 2023-10-08T07:07:18.952 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.952 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.952 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.952 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.952 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.952 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85593 2023-10-08T07:07:18.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.952 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.952 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.952 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243319+0000", 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243319+0000", 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243320+0000", 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7899999999999998e-07 2023-10-08T07:07:18.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.954 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.954 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243345+0000", 2023-10-08T07:07:18.954 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5194e-05 2023-10-08T07:07:18.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.954 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.954 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243355+0000", 2023-10-08T07:07:18.954 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0261000000000001e-05 2023-10-08T07:07:18.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.955 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.955 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243362+0000", 2023-10-08T07:07:18.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3150000000000003e-06 2023-10-08T07:07:18.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.955 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.955 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.955 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243414+0000", 2023-10-08T07:07:18.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1912e-05 2023-10-08T07:07:18.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.955 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.955 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.956 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243484+0000", 2023-10-08T07:07:18.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9369999999999995e-05 2023-10-08T07:07:18.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.956 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.956 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243634+0000", 2023-10-08T07:07:18.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015079199999999999 2023-10-08T07:07:18.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.956 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.956 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251334+0000", 2023-10-08T07:07:18.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0076994849999999998 2023-10-08T07:07:18.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296511+0000", 2023-10-08T07:07:18.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045177279000000001 2023-10-08T07:07:18.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296543+0000", 2023-10-08T07:07:18.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1557999999999998e-05 2023-10-08T07:07:18.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.958 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296564+0000", 2023-10-08T07:07:18.958 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1611999999999999e-05 2023-10-08T07:07:18.958 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.958 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.958 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.959 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85599 4.38 4:1e0977c7:::10000000004.00000022:head [write 1757184~8192,write 1843200~4096,write 1970176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.959 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.245241+0000", 2023-10-08T07:07:18.959 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.611541272, 2023-10-08T07:07:18.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.051364343, 2023-10-08T07:07:18.959 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.959 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.959 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.959 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.959 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.959 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85599 2023-10-08T07:07:18.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.960 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.960 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.960 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245241+0000", 2023-10-08T07:07:18.960 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.960 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.960 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245241+0000", 2023-10-08T07:07:18.960 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245242+0000", 2023-10-08T07:07:18.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.128e-06 2023-10-08T07:07:18.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245265+0000", 2023-10-08T07:07:18.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2938999999999998e-05 2023-10-08T07:07:18.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245275+0000", 2023-10-08T07:07:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0212e-05 2023-10-08T07:07:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245283+0000", 2023-10-08T07:07:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6429999999999995e-06 2023-10-08T07:07:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245331+0000", 2023-10-08T07:07:18.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8421000000000003e-05 2023-10-08T07:07:18.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245421+0000", 2023-10-08T07:07:18.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9617999999999995e-05 2023-10-08T07:07:18.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245592+0000", 2023-10-08T07:07:18.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170853 2023-10-08T07:07:18.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.964 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251310+0000", 2023-10-08T07:07:18.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0057182730000000003 2023-10-08T07:07:18.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.964 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296459+0000", 2023-10-08T07:07:18.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045148829000000001 2023-10-08T07:07:18.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.965 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296518+0000", 2023-10-08T07:07:18.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9298e-05 2023-10-08T07:07:18.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.965 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296605+0000", 2023-10-08T07:07:18.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7128999999999999e-05 2023-10-08T07:07:18.965 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.965 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.965 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85600 4.20 4:07572838:::10000000004.00000010:head [write 3162112~4096,write 3579904~4096,write 3588096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.245590+0000", 2023-10-08T07:07:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.611191783, 2023-10-08T07:07:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.051051430000000002, 2023-10-08T07:07:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85600 2023-10-08T07:07:18.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.967 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.967 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.967 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.967 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245590+0000", 2023-10-08T07:07:18.967 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.967 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.967 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.967 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245590+0000", 2023-10-08T07:07:18.967 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.968 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.968 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245591+0000", 2023-10-08T07:07:18.968 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0299999999999998e-07 2023-10-08T07:07:18.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.968 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.968 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245612+0000", 2023-10-08T07:07:18.968 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.075e-05 2023-10-08T07:07:18.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245621+0000", 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.064e-06 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245627+0000", 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0769999999999996e-06 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.246241+0000", 2023-10-08T07:07:18.969 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00061415000000000005 2023-10-08T07:07:18.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.970 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.970 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.970 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.246315+0000", 2023-10-08T07:07:18.970 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4234999999999997e-05 2023-10-08T07:07:18.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.970 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.970 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.970 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.246499+0000", 2023-10-08T07:07:18.970 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018382199999999999 2023-10-08T07:07:18.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251400+0000", 2023-10-08T07:07:18.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0049005439999999997 2023-10-08T07:07:18.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296588+0000", 2023-10-08T07:07:18.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045188465999999997 2023-10-08T07:07:18.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296622+0000", 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3532999999999999e-05 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296642+0000", 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0086e-05 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.972 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85619 4.20 4:04004f2c:::10000000004.0000000d:head [write 2985984~4096,write 3178496~4096,write 3256320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.973 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.251663+0000", 2023-10-08T07:07:18.973 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.6051187850000002, 2023-10-08T07:07:18.973 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047680326000000002, 2023-10-08T07:07:18.973 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.973 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.973 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.973 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.973 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.973 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85619 2023-10-08T07:07:18.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.973 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.974 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.974 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251663+0000", 2023-10-08T07:07:18.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.974 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.974 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.974 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251663+0000", 2023-10-08T07:07:18.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.974 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.975 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.975 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251664+0000", 2023-10-08T07:07:18.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.92e-07 2023-10-08T07:07:18.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.975 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.975 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251675+0000", 2023-10-08T07:07:18.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0648999999999999e-05 2023-10-08T07:07:18.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.975 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251683+0000", 2023-10-08T07:07:18.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1880000000000002e-06 2023-10-08T07:07:18.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251688+0000", 2023-10-08T07:07:18.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2120000000000002e-06 2023-10-08T07:07:18.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251726+0000", 2023-10-08T07:07:18.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8136999999999998e-05 2023-10-08T07:07:18.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251776+0000", 2023-10-08T07:07:18.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9790000000000003e-05 2023-10-08T07:07:18.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251865+0000", 2023-10-08T07:07:18.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8858999999999997e-05 2023-10-08T07:07:18.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.257714+0000", 2023-10-08T07:07:18.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.005848809 2023-10-08T07:07:18.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.299242+0000", 2023-10-08T07:07:18.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.041527653999999997 2023-10-08T07:07:18.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.299305+0000", 2023-10-08T07:07:18.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3618e-05 2023-10-08T07:07:18.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.299344+0000", 2023-10-08T07:07:18.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8618000000000002e-05 2023-10-08T07:07:18.979 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.979 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.979 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.980 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.980 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85622 4.20 4:05b3915c:::10000000004.00000016:head [write 1323008~4096,write 1687552~4096,write 1728512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.980 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.252609+0000", 2023-10-08T07:07:18.980 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.6041734170000002, 2023-10-08T07:07:18.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046871448000000003, 2023-10-08T07:07:18.980 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.980 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.980 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.980 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.980 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.981 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85622 2023-10-08T07:07:18.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.981 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.981 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.981 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.981 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.252609+0000", 2023-10-08T07:07:18.981 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.981 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.981 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.981 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.252609+0000", 2023-10-08T07:07:18.982 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.982 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.982 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.982 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.252610+0000", 2023-10-08T07:07:18.982 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6700000000000003e-07 2023-10-08T07:07:18.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.982 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.982 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.982 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.252632+0000", 2023-10-08T07:07:18.982 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2211000000000001e-05 2023-10-08T07:07:18.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.983 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.983 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.252642+0000", 2023-10-08T07:07:18.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0572e-05 2023-10-08T07:07:18.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.983 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.983 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.252647+0000", 2023-10-08T07:07:18.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9819999999999999e-06 2023-10-08T07:07:18.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.984 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.984 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.254315+0000", 2023-10-08T07:07:18.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016671819999999999 2023-10-08T07:07:18.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.984 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.984 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.254400+0000", 2023-10-08T07:07:18.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5945999999999993e-05 2023-10-08T07:07:18.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.984 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.985 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.254566+0000", 2023-10-08T07:07:18.985 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016558100000000001 2023-10-08T07:07:18.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.985 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.985 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.259768+0000", 2023-10-08T07:07:18.985 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052015630000000002 2023-10-08T07:07:18.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.985 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.985 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.299388+0000", 2023-10-08T07:07:18.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.039620162 2023-10-08T07:07:18.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.299441+0000", 2023-10-08T07:07:18.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3091999999999999e-05 2023-10-08T07:07:18.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.299480+0000", 2023-10-08T07:07:18.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9390000000000001e-05 2023-10-08T07:07:18.987 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.987 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.987 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.987 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.987 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:86965 4.38 4:1e0977c7:::10000000004.00000022:head [write 208896~4096,write 294912~4096,write 307200~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.987 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.780829+0000", 2023-10-08T07:07:18.987 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.0759537079999999, 2023-10-08T07:07:18.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048817502999999998, 2023-10-08T07:07:18.987 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.988 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.988 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.988 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.988 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.988 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 86965 2023-10-08T07:07:18.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.988 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.780829+0000", 2023-10-08T07:07:18.988 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.780829+0000", 2023-10-08T07:07:18.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.780830+0000", 2023-10-08T07:07:18.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0699999999999999e-06 2023-10-08T07:07:18.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.990 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.990 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.780843+0000", 2023-10-08T07:07:18.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3154e-05 2023-10-08T07:07:18.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.990 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.990 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.780855+0000", 2023-10-08T07:07:18.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2714999999999999e-05 2023-10-08T07:07:18.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.990 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.990 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.780865+0000", 2023-10-08T07:07:18.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6670000000000008e-06 2023-10-08T07:07:18.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.781829+0000", 2023-10-08T07:07:18.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000963751 2023-10-08T07:07:18.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.781907+0000", 2023-10-08T07:07:18.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8219000000000004e-05 2023-10-08T07:07:18.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.992 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:18.992 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782017+0000", 2023-10-08T07:07:18.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011027300000000001 2023-10-08T07:07:18.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.992 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:18.992 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.788566+0000", 2023-10-08T07:07:18.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065484289999999997 2023-10-08T07:07:18.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:18.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.829515+0000", 2023-10-08T07:07:18.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.040949157999999999 2023-10-08T07:07:18.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:18.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.829570+0000", 2023-10-08T07:07:18.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5229000000000003e-05 2023-10-08T07:07:18.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.829646+0000", 2023-10-08T07:07:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5838000000000001e-05 2023-10-08T07:07:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:86968 4.20 4:04004f2c:::10000000004.0000000d:head [write 1101824~4096,write 1191936~4096,write 1445888~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.782022+0000", 2023-10-08T07:07:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.074760092, 2023-10-08T07:07:18.994 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047578305000000001, 2023-10-08T07:07:18.995 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:18.995 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:18.995 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:18.995 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:18.995 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:18.995 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 86968 2023-10-08T07:07:18.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.995 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:18.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:18.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782022+0000", 2023-10-08T07:07:18.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.996 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:18.996 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782022+0000", 2023-10-08T07:07:18.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:18.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.996 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:18.996 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782023+0000", 2023-10-08T07:07:18.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.78e-07 2023-10-08T07:07:18.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.997 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:18.997 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782034+0000", 2023-10-08T07:07:18.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.115e-05 2023-10-08T07:07:18.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.998 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:18.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782044+0000", 2023-10-08T07:07:18.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0185e-05 2023-10-08T07:07:18.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.998 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.998 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:18.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782052+0000", 2023-10-08T07:07:18.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5549999999999997e-06 2023-10-08T07:07:18.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.998 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.998 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:18.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.784555+0000", 2023-10-08T07:07:18.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0025027650000000001 2023-10-08T07:07:18.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:18.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.784608+0000", 2023-10-08T07:07:18.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3807999999999997e-05 2023-10-08T07:07:18.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:18.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:18.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:19.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.784740+0000", 2023-10-08T07:07:19.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000131168 2023-10-08T07:07:19.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:19.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.791565+0000", 2023-10-08T07:07:19.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0068256360000000004 2023-10-08T07:07:19.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:19.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.829500+0000", 2023-10-08T07:07:19.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037934334 2023-10-08T07:07:19.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:19.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.829561+0000", 2023-10-08T07:07:19.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1253999999999993e-05 2023-10-08T07:07:19.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:19.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.829600+0000", 2023-10-08T07:07:19.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9572e-05 2023-10-08T07:07:19.002 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:19.002 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:19.002 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:19.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.002 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:86981 4.c 4:3352c333:::10000000004.00000012:head [write 4100096~4096,write 4153344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:19.002 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.786697+0000", 2023-10-08T07:07:19.002 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.0700852489999999, 2023-10-08T07:07:19.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049572084000000002, 2023-10-08T07:07:19.002 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:19.003 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:19.003 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:19.003 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:19.003 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:19.003 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 86981 2023-10-08T07:07:19.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.003 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:19.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:19.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.786697+0000", 2023-10-08T07:07:19.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:19.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.004 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:19.004 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.786697+0000", 2023-10-08T07:07:19.004 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:19.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.004 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:19.004 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.786698+0000", 2023-10-08T07:07:19.004 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2200000000000003e-07 2023-10-08T07:07:19.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.005 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:19.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.786707+0000", 2023-10-08T07:07:19.005 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4259999999999992e-06 2023-10-08T07:07:19.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.005 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:19.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.786717+0000", 2023-10-08T07:07:19.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3309999999999993e-06 2023-10-08T07:07:19.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.006 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:19.006 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.786724+0000", 2023-10-08T07:07:19.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.311e-06 2023-10-08T07:07:19.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.006 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:19.006 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.789932+0000", 2023-10-08T07:07:19.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032078919999999999 2023-10-08T07:07:19.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.007 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.007 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:19.007 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.789996+0000", 2023-10-08T07:07:19.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4639000000000002e-05 2023-10-08T07:07:19.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.007 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.007 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:19.007 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.790121+0000", 2023-10-08T07:07:19.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012497699999999999 2023-10-08T07:07:19.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.008 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:19.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.792908+0000", 2023-10-08T07:07:19.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00278612 2023-10-08T07:07:19.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.008 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:19.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.836175+0000", 2023-10-08T07:07:19.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.043267982000000003 2023-10-08T07:07:19.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:19.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.836235+0000", 2023-10-08T07:07:19.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9753999999999997e-05 2023-10-08T07:07:19.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:19.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.836269+0000", 2023-10-08T07:07:19.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.383e-05 2023-10-08T07:07:19.009 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:19.009 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:19.009 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:19.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.010 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:87226 4.20 4:04004f2c:::10000000004.0000000d:head [write 3092480~4096,write 3354624~4096,write 3387392~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:19.010 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.872113+0000", 2023-10-08T07:07:19.010 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.98466944099999998, 2023-10-08T07:07:19.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047777183000000001, 2023-10-08T07:07:19.010 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:19.010 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:19.010 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:19.010 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:19.010 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:19.010 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 87226 2023-10-08T07:07:19.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.011 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:19.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:19.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.872113+0000", 2023-10-08T07:07:19.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:19.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:19.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.872113+0000", 2023-10-08T07:07:19.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:19.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.012 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:19.012 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.872114+0000", 2023-10-08T07:07:19.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4099999999999997e-07 2023-10-08T07:07:19.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.012 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:19.012 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.872125+0000", 2023-10-08T07:07:19.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.185e-05 2023-10-08T07:07:19.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.872136+0000", 2023-10-08T07:07:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0033e-05 2023-10-08T07:07:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.872144+0000", 2023-10-08T07:07:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0790000000000001e-06 2023-10-08T07:07:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:19.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.878297+0000", 2023-10-08T07:07:19.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.006153894 2023-10-08T07:07:19.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:19.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.878354+0000", 2023-10-08T07:07:19.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6844e-05 2023-10-08T07:07:19.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:19.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.878471+0000", 2023-10-08T07:07:19.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011704 2023-10-08T07:07:19.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.015 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:19.015 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.882051+0000", 2023-10-08T07:07:19.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0035792300000000001 2023-10-08T07:07:19.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.015 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:19.015 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.919786+0000", 2023-10-08T07:07:19.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037735563999999999 2023-10-08T07:07:19.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:19.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.919844+0000", 2023-10-08T07:07:19.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8161000000000001e-05 2023-10-08T07:07:19.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:19.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.919890+0000", 2023-10-08T07:07:19.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5646999999999999e-05 2023-10-08T07:07:19.016 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:19.016 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:19.017 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:19.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.017 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:87263 4.20 4:04004f2c:::10000000004.0000000d:head [write 2568192~4096,write 2695168~4096,write 2777088~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:19.017 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.884730+0000", 2023-10-08T07:07:19.017 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.97205206099999997, 2023-10-08T07:07:19.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048776342, 2023-10-08T07:07:19.017 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:19.017 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:19.017 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:19.017 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:19.018 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:19.018 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 87263 2023-10-08T07:07:19.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.018 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:19.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:19.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.884730+0000", 2023-10-08T07:07:19.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:19.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:19.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.884730+0000", 2023-10-08T07:07:19.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:19.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:19.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.884731+0000", 2023-10-08T07:07:19.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1500000000000003e-07 2023-10-08T07:07:19.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:19.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.884744+0000", 2023-10-08T07:07:19.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.277e-05 2023-10-08T07:07:19.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:19.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.884754+0000", 2023-10-08T07:07:19.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0703999999999999e-05 2023-10-08T07:07:19.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:19.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.884762+0000", 2023-10-08T07:07:19.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6040000000000004e-06 2023-10-08T07:07:19.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:19.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.886237+0000", 2023-10-08T07:07:19.021 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001475339 2023-10-08T07:07:19.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:19.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.886290+0000", 2023-10-08T07:07:19.021 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2636999999999998e-05 2023-10-08T07:07:19.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.022 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:19.022 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.886381+0000", 2023-10-08T07:07:19.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0808000000000002e-05 2023-10-08T07:07:19.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.022 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:19.022 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.888572+0000", 2023-10-08T07:07:19.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002191517 2023-10-08T07:07:19.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.933458+0000", 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.044885428999999998 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.933486+0000", 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8416e-05 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.933507+0000", 2023-10-08T07:07:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0302999999999999e-05 2023-10-08T07:07:19.024 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:19.024 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:19.024 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:19.024 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:19.024 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:19.024 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:19.025 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:19.026 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:19.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:19.027 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:19.024+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:19.027 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:19.027 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:19.028 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:19.126 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:19.125+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:19.227 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:19.226+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:19.231 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:19.231 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:19.246 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:19.328 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:19.327+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:19.429 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:19.428+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:19.458 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:19.458 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:19.472 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:19.533 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:19.533+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:19.634 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:19.632+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:19.681 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:19.681 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:19.698 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:19.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2023-10-08T07:07:19.741 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:19.740+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:19.835 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:19.834+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:19.890 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:19.891 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:19.905 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:19.938 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:19.936+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:20.038 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:20.037+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:20.138 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:20.138+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:20.145 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:20.145 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:20.160 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:20.240 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:20.239+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:20.289 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T07:07:20.340 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:20.340+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:20.356 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:20.356 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:20.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:20.442 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:20.441+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:20.539 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:20.539 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:20.542 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:20.542+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:20.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:20.643 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:20.642+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:20.744 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:20.743+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:20.792 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:20.793 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:20.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:20.845 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:20.844+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:20.952 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:20.952+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:21.021 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:21.021 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:21.029 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:07:21.035 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:21.078 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:21.078+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:21.147 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:21.147+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:21.211 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:21.233 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96597 4.2b 4:d776c1c9:::10000000004.0000003d:head [write 217088~4096 in=4096b,write 237568~4096 in=4096b,write 294912~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.222484+0000", 2023-10-08T07:07:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0077407700000000001, 2023-10-08T07:07:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00776358, 2023-10-08T07:07:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96597 2023-10-08T07:07:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222484+0000", 2023-10-08T07:07:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222484+0000", 2023-10-08T07:07:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222484+0000", 2023-10-08T07:07:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9199999999999999e-07 2023-10-08T07:07:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222497+0000", 2023-10-08T07:07:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2299e-05 2023-10-08T07:07:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222508+0000", 2023-10-08T07:07:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1014e-05 2023-10-08T07:07:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222516+0000", 2023-10-08T07:07:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1969999999999996e-06 2023-10-08T07:07:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222601+0000", 2023-10-08T07:07:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4895999999999995e-05 2023-10-08T07:07:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222688+0000", 2023-10-08T07:07:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6944e-05 2023-10-08T07:07:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222858+0000", 2023-10-08T07:07:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017018299999999999 2023-10-08T07:07:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96598 4.30 4:0f322a22:::10000000004.00000014:head [write 1093632~4096 in=4096b,write 1134592~4096 in=4096b,write 1146880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.224082+0000", 2023-10-08T07:07:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0061422600000000001, 2023-10-08T07:07:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0062177990000000004, 2023-10-08T07:07:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96598 2023-10-08T07:07:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224082+0000", 2023-10-08T07:07:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224082+0000", 2023-10-08T07:07:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224083+0000", 2023-10-08T07:07:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1800000000000005e-07 2023-10-08T07:07:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224096+0000", 2023-10-08T07:07:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3172e-05 2023-10-08T07:07:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224113+0000", 2023-10-08T07:07:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7346999999999998e-05 2023-10-08T07:07:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224121+0000", 2023-10-08T07:07:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9389999999999997e-06 2023-10-08T07:07:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228090+0000", 2023-10-08T07:07:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039682420000000003 2023-10-08T07:07:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228163+0000", 2023-10-08T07:07:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3732000000000005e-05 2023-10-08T07:07:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228311+0000", 2023-10-08T07:07:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014749000000000001 2023-10-08T07:07:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96599 4.30 4.44544cf0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.224135+0000", 2023-10-08T07:07:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0060890709999999997, 2023-10-08T07:07:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0062066480000000004, 2023-10-08T07:07:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96599 2023-10-08T07:07:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224135+0000", 2023-10-08T07:07:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224135+0000", 2023-10-08T07:07:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224136+0000", 2023-10-08T07:07:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0200000000000002e-07 2023-10-08T07:07:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224148+0000", 2023-10-08T07:07:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2058e-05 2023-10-08T07:07:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224330+0000", 2023-10-08T07:07:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000182573 2023-10-08T07:07:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224338+0000", 2023-10-08T07:07:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9109999999999993e-06 2023-10-08T07:07:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96603 4.24 4:25ba01c5:::10000000004.00000035:head [write 2363392~4096 in=4096b,write 2371584~4096 in=4096b,write 2588672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.224370+0000", 2023-10-08T07:07:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0058541560000000001, 2023-10-08T07:07:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0060073660000000001, 2023-10-08T07:07:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96603 2023-10-08T07:07:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224370+0000", 2023-10-08T07:07:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224370+0000", 2023-10-08T07:07:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224371+0000", 2023-10-08T07:07:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9999999999999997e-07 2023-10-08T07:07:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224383+0000", 2023-10-08T07:07:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.172e-05 2023-10-08T07:07:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224393+0000", 2023-10-08T07:07:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0414000000000001e-05 2023-10-08T07:07:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224412+0000", 2023-10-08T07:07:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8686999999999999e-05 2023-10-08T07:07:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.227329+0000", 2023-10-08T07:07:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029173300000000001 2023-10-08T07:07:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.227420+0000", 2023-10-08T07:07:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1012000000000002e-05 2023-10-08T07:07:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96604 4.38 4.e3ee9078 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.224553+0000", 2023-10-08T07:07:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0056711490000000003, 2023-10-08T07:07:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0058626570000000003, 2023-10-08T07:07:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96604 2023-10-08T07:07:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224553+0000", 2023-10-08T07:07:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224553+0000", 2023-10-08T07:07:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224554+0000", 2023-10-08T07:07:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2399999999999996e-07 2023-10-08T07:07:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224570+0000", 2023-10-08T07:07:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6218999999999998e-05 2023-10-08T07:07:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224582+0000", 2023-10-08T07:07:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1719000000000001e-05 2023-10-08T07:07:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.224593+0000", 2023-10-08T07:07:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0594999999999999e-05 2023-10-08T07:07:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96565 4.1a 4:5a59f83a:::10000000004.00000002:head [write 0~4096 in=4096b,write 98304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.211915+0000", 2023-10-08T07:07:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.018309354999999999, 2023-10-08T07:07:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018534041000000001, 2023-10-08T07:07:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96565 2023-10-08T07:07:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.211915+0000", 2023-10-08T07:07:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.211915+0000", 2023-10-08T07:07:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.211916+0000", 2023-10-08T07:07:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1500000000000003e-07 2023-10-08T07:07:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.211925+0000", 2023-10-08T07:07:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8109999999999992e-06 2023-10-08T07:07:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.211933+0000", 2023-10-08T07:07:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3750000000000003e-06 2023-10-08T07:07:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.211941+0000", 2023-10-08T07:07:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2449999999999998e-06 2023-10-08T07:07:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213911+0000", 2023-10-08T07:07:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001970023 2023-10-08T07:07:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213983+0000", 2023-10-08T07:07:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1332000000000001e-05 2023-10-08T07:07:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.214105+0000", 2023-10-08T07:07:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012255999999999999 2023-10-08T07:07:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96606 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2215936~4096 in=4096b,write 2240512~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.225216+0000", 2023-10-08T07:07:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0050084839999999997, 2023-10-08T07:07:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052753239999999996, 2023-10-08T07:07:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96606 2023-10-08T07:07:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225216+0000", 2023-10-08T07:07:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225216+0000", 2023-10-08T07:07:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225216+0000", 2023-10-08T07:07:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3300000000000002e-07 2023-10-08T07:07:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225244+0000", 2023-10-08T07:07:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7889999999999999e-05 2023-10-08T07:07:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225259+0000", 2023-10-08T07:07:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5046e-05 2023-10-08T07:07:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225265+0000", 2023-10-08T07:07:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3249999999999998e-06 2023-10-08T07:07:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228921+0000", 2023-10-08T07:07:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003656257 2023-10-08T07:07:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.229012+0000", 2023-10-08T07:07:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1472999999999996e-05 2023-10-08T07:07:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.229268+0000", 2023-10-08T07:07:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000255963 2023-10-08T07:07:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96608 4.1a 4:5a59f83a:::10000000004.00000002:head [write 2887680~4096 in=4096b,write 2994176~4096 in=4096b,write 3424256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.225877+0000", 2023-10-08T07:07:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0043473740000000002, 2023-10-08T07:07:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0046588519999999998, 2023-10-08T07:07:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96608 2023-10-08T07:07:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225877+0000", 2023-10-08T07:07:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225877+0000", 2023-10-08T07:07:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225878+0000", 2023-10-08T07:07:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8599999999999998e-07 2023-10-08T07:07:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225909+0000", 2023-10-08T07:07:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1061e-05 2023-10-08T07:07:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225917+0000", 2023-10-08T07:07:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7399999999999993e-06 2023-10-08T07:07:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225922+0000", 2023-10-08T07:07:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7679999999999999e-06 2023-10-08T07:07:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.227457+0000", 2023-10-08T07:07:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001535167 2023-10-08T07:07:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.227541+0000", 2023-10-08T07:07:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4209000000000006e-05 2023-10-08T07:07:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.227703+0000", 2023-10-08T07:07:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016176 2023-10-08T07:07:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96568 4.c 4:3352c333:::10000000004.00000012:head [write 1523712~4096 in=4096b,write 1667072~4096 in=4096b,write 1695744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.212974+0000", 2023-10-08T07:07:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.017250670999999999, 2023-10-08T07:07:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017605286000000001, 2023-10-08T07:07:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96568 2023-10-08T07:07:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.212974+0000", 2023-10-08T07:07:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.212974+0000", 2023-10-08T07:07:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.212975+0000", 2023-10-08T07:07:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7999999999999993e-07 2023-10-08T07:07:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213001+0000", 2023-10-08T07:07:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6095999999999999e-05 2023-10-08T07:07:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213015+0000", 2023-10-08T07:07:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3799e-05 2023-10-08T07:07:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213020+0000", 2023-10-08T07:07:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2120000000000002e-06 2023-10-08T07:07:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213069+0000", 2023-10-08T07:07:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9554e-05 2023-10-08T07:07:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213169+0000", 2023-10-08T07:07:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9227000000000004e-05 2023-10-08T07:07:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213357+0000", 2023-10-08T07:07:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018836800000000001 2023-10-08T07:07:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221767+0000", 2023-10-08T07:07:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084100830000000005 2023-10-08T07:07:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96611 4.e 4:70352312:::10000000004.0000001a:head [write 3293184~4096 in=4096b,write 3432448~4096 in=4096b,write 3502080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.226917+0000", 2023-10-08T07:07:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0033070949999999999, 2023-10-08T07:07:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0037077780000000001, 2023-10-08T07:07:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96611 2023-10-08T07:07:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226917+0000", 2023-10-08T07:07:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226917+0000", 2023-10-08T07:07:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226918+0000", 2023-10-08T07:07:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2900000000000003e-07 2023-10-08T07:07:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226932+0000", 2023-10-08T07:07:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3757000000000001e-05 2023-10-08T07:07:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226941+0000", 2023-10-08T07:07:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6299999999999993e-06 2023-10-08T07:07:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226946+0000", 2023-10-08T07:07:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9280000000000001e-06 2023-10-08T07:07:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226998+0000", 2023-10-08T07:07:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1221000000000003e-05 2023-10-08T07:07:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.227076+0000", 2023-10-08T07:07:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8994999999999998e-05 2023-10-08T07:07:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96570 4.e 4:70352312:::10000000004.0000001a:head [write 4071424~4096 in=4096b,write 4190208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.213634+0000", 2023-10-08T07:07:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.016590723000000002, 2023-10-08T07:07:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017029926000000001, 2023-10-08T07:07:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96570 2023-10-08T07:07:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213634+0000", 2023-10-08T07:07:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213634+0000", 2023-10-08T07:07:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213634+0000", 2023-10-08T07:07:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7400000000000002e-07 2023-10-08T07:07:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213644+0000", 2023-10-08T07:07:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8879999999999992e-06 2023-10-08T07:07:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213653+0000", 2023-10-08T07:07:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5180000000000004e-06 2023-10-08T07:07:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213658+0000", 2023-10-08T07:07:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4249999999999997e-06 2023-10-08T07:07:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213719+0000", 2023-10-08T07:07:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0324e-05 2023-10-08T07:07:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.213808+0000", 2023-10-08T07:07:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9809999999999996e-05 2023-10-08T07:07:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96613 4.2 4.a29e5702 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.227681+0000", 2023-10-08T07:07:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0025428600000000001, 2023-10-08T07:07:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0030180570000000002, 2023-10-08T07:07:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96613 2023-10-08T07:07:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.227681+0000", 2023-10-08T07:07:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.227681+0000", 2023-10-08T07:07:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.227682+0000", 2023-10-08T07:07:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9899999999999999e-07 2023-10-08T07:07:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.227695+0000", 2023-10-08T07:07:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2524000000000001e-05 2023-10-08T07:07:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.227753+0000", 2023-10-08T07:07:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7815999999999997e-05 2023-10-08T07:07:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.227762+0000", 2023-10-08T07:07:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3060000000000003e-06 2023-10-08T07:07:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96573 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 3244032~4096 in=4096b,write 3338240~4096 in=4096b,write 3448832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.214604+0000", 2023-10-08T07:07:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.015620596, 2023-10-08T07:07:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016129087, 2023-10-08T07:07:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96573 2023-10-08T07:07:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.214604+0000", 2023-10-08T07:07:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.214604+0000", 2023-10-08T07:07:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.214605+0000", 2023-10-08T07:07:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:07:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.214616+0000", 2023-10-08T07:07:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1806e-05 2023-10-08T07:07:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.214628+0000", 2023-10-08T07:07:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1912999999999999e-05 2023-10-08T07:07:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.214635+0000", 2023-10-08T07:07:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.221e-06 2023-10-08T07:07:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.219436+0000", 2023-10-08T07:07:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048007850000000001 2023-10-08T07:07:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.219487+0000", 2023-10-08T07:07:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0878999999999999e-05 2023-10-08T07:07:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.219582+0000", 2023-10-08T07:07:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4760999999999996e-05 2023-10-08T07:07:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96615 4.c 4:31e28161:::10000000004.00000011:head [write 294912~4096 in=4096b,write 352256~4096 in=4096b,write 544768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.228074+0000", 2023-10-08T07:07:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00215015, 2023-10-08T07:07:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027014420000000001, 2023-10-08T07:07:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96615 2023-10-08T07:07:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228074+0000", 2023-10-08T07:07:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228074+0000", 2023-10-08T07:07:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228075+0000", 2023-10-08T07:07:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8400000000000003e-07 2023-10-08T07:07:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228087+0000", 2023-10-08T07:07:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1844999999999999e-05 2023-10-08T07:07:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228097+0000", 2023-10-08T07:07:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0224000000000001e-05 2023-10-08T07:07:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228104+0000", 2023-10-08T07:07:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.311e-06 2023-10-08T07:07:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228157+0000", 2023-10-08T07:07:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2404000000000002e-05 2023-10-08T07:07:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228238+0000", 2023-10-08T07:07:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1604e-05 2023-10-08T07:07:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228387+0000", 2023-10-08T07:07:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000148438 2023-10-08T07:07:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96574 4.1 4:8277d31e:::10000000004.00000013:head [write 3264512~4096 in=4096b,write 3596288~4096 in=4096b,write 3608576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.214985+0000", 2023-10-08T07:07:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.015239071, 2023-10-08T07:07:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015839731999999999, 2023-10-08T07:07:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96574 2023-10-08T07:07:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.214985+0000", 2023-10-08T07:07:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.214985+0000", 2023-10-08T07:07:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.214986+0000", 2023-10-08T07:07:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8800000000000002e-07 2023-10-08T07:07:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.214999+0000", 2023-10-08T07:07:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3172e-05 2023-10-08T07:07:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215013+0000", 2023-10-08T07:07:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3698e-05 2023-10-08T07:07:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215021+0000", 2023-10-08T07:07:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2840000000000006e-06 2023-10-08T07:07:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215084+0000", 2023-10-08T07:07:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2423999999999997e-05 2023-10-08T07:07:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215187+0000", 2023-10-08T07:07:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010375 2023-10-08T07:07:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop_reply(client.4556.0:96549 4.30 e55/17)", 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.228634+0000", 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.001590307, 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002233695, 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228634+0000", 2023-10-08T07:07:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228634+0000", 2023-10-08T07:07:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228635+0000", 2023-10-08T07:07:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6899999999999997e-07 2023-10-08T07:07:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228642+0000", 2023-10-08T07:07:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:07:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228651+0000", 2023-10-08T07:07:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0739999999999999e-06 2023-10-08T07:07:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228658+0000", 2023-10-08T07:07:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3669999999999999e-06 2023-10-08T07:07:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96575 4.1f 4:f9156152:::10000000004.00000036:head [write 2547712~4096 in=4096b,write 2637824~4096 in=4096b,write 2736128~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.215338+0000", 2023-10-08T07:07:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.014886732999999999, 2023-10-08T07:07:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01557617, 2023-10-08T07:07:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96575 2023-10-08T07:07:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215338+0000", 2023-10-08T07:07:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215338+0000", 2023-10-08T07:07:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215338+0000", 2023-10-08T07:07:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1900000000000002e-07 2023-10-08T07:07:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215351+0000", 2023-10-08T07:07:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2850000000000001e-05 2023-10-08T07:07:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215359+0000", 2023-10-08T07:07:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8110000000000003e-06 2023-10-08T07:07:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215364+0000", 2023-10-08T07:07:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0270000000000003e-06 2023-10-08T07:07:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215410+0000", 2023-10-08T07:07:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6331000000000001e-05 2023-10-08T07:07:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215468+0000", 2023-10-08T07:07:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.791e-05 2023-10-08T07:07:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop_reply(client.4556.0:96552 4.30 e55/17)", 2023-10-08T07:07:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.228670+0000", 2023-10-08T07:07:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.001554366, 2023-10-08T07:07:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0023310929999999998, 2023-10-08T07:07:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228670+0000", 2023-10-08T07:07:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228670+0000", 2023-10-08T07:07:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228670+0000", 2023-10-08T07:07:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8700000000000002e-07 2023-10-08T07:07:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228672+0000", 2023-10-08T07:07:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9379999999999999e-06 2023-10-08T07:07:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228678+0000", 2023-10-08T07:07:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1539999999999999e-06 2023-10-08T07:07:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.228684+0000", 2023-10-08T07:07:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4659999999999998e-06 2023-10-08T07:07:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96577 4.20 4:04004f2c:::10000000004.0000000d:head [write 1843200~4096 in=4096b,write 1888256~4096 in=4096b,write 1929216~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.215955+0000", 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.014269148000000001, 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015102358, 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96577 2023-10-08T07:07:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215955+0000", 2023-10-08T07:07:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215955+0000", 2023-10-08T07:07:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215956+0000", 2023-10-08T07:07:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0699999999999996e-07 2023-10-08T07:07:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215977+0000", 2023-10-08T07:07:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1338000000000001e-05 2023-10-08T07:07:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215991+0000", 2023-10-08T07:07:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3406e-05 2023-10-08T07:07:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.215998+0000", 2023-10-08T07:07:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9739999999999996e-06 2023-10-08T07:07:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226608+0000", 2023-10-08T07:07:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010610414 2023-10-08T07:07:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226690+0000", 2023-10-08T07:07:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2074000000000001e-05 2023-10-08T07:07:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226865+0000", 2023-10-08T07:07:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000174434 2023-10-08T07:07:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96622 4.2 4.508f73c2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.230501+0000", 2023-10-08T07:07:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9997234, 2023-10-08T07:07:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00063531700000000004, 2023-10-08T07:07:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96622 2023-10-08T07:07:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230501+0000", 2023-10-08T07:07:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230501+0000", 2023-10-08T07:07:21.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230502+0000", 2023-10-08T07:07:21.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9400000000000005e-07 2023-10-08T07:07:21.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230513+0000", 2023-10-08T07:07:21.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1579999999999999e-05 2023-10-08T07:07:21.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230523+0000", 2023-10-08T07:07:21.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6579999999999997e-06 2023-10-08T07:07:21.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230528+0000", 2023-10-08T07:07:21.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3580000000000002e-06 2023-10-08T07:07:21.345 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.345 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.345 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.345 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96578 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 3678208~4096 in=4096b,write 3735552~4096 in=4096b,write 3956736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.345 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.216349+0000", 2023-10-08T07:07:21.345 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013875158, 2023-10-08T07:07:21.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014860162999999999, 2023-10-08T07:07:21.345 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.346 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.346 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.346 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.346 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.346 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96578 2023-10-08T07:07:21.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.346 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216349+0000", 2023-10-08T07:07:21.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.347 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.347 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216349+0000", 2023-10-08T07:07:21.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.347 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.347 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216350+0000", 2023-10-08T07:07:21.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0389999999999999e-06 2023-10-08T07:07:21.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.347 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.348 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216372+0000", 2023-10-08T07:07:21.348 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1746000000000002e-05 2023-10-08T07:07:21.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.348 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.348 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216384+0000", 2023-10-08T07:07:21.348 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2001000000000001e-05 2023-10-08T07:07:21.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.348 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.348 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216392+0000", 2023-10-08T07:07:21.348 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8299999999999996e-06 2023-10-08T07:07:21.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216662+0000", 2023-10-08T07:07:21.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00027027000000000003 2023-10-08T07:07:21.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216752+0000", 2023-10-08T07:07:21.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0400000000000002e-05 2023-10-08T07:07:21.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216935+0000", 2023-10-08T07:07:21.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018217600000000001 2023-10-08T07:07:21.350 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.350 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.350 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.350 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96623 4.1b 4:d97fb168:::10000000004.00000008:head [write 1798144~4096 in=4096b,write 1982464~4096 in=4096b,write 2023424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.350 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.230758+0000", 2023-10-08T07:07:21.351 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9994659, 2023-10-08T07:07:21.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00054319700000000004, 2023-10-08T07:07:21.351 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.351 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.351 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.351 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.351 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.351 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96623 2023-10-08T07:07:21.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.351 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.351 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230758+0000", 2023-10-08T07:07:21.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230758+0000", 2023-10-08T07:07:21.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230759+0000", 2023-10-08T07:07:21.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1399999999999997e-07 2023-10-08T07:07:21.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.353 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230767+0000", 2023-10-08T07:07:21.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6170000000000001e-06 2023-10-08T07:07:21.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.353 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230783+0000", 2023-10-08T07:07:21.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6832000000000001e-05 2023-10-08T07:07:21.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.354 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.354 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230792+0000", 2023-10-08T07:07:21.354 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.867e-06 2023-10-08T07:07:21.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.354 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.354 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230830+0000", 2023-10-08T07:07:21.354 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7342999999999998e-05 2023-10-08T07:07:21.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230879+0000", 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.956e-05 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230987+0000", 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000107471 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.356 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop_reply(client.4556.0:96535 4.3a e55/17)", 2023-10-08T07:07:21.356 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.230792+0000", 2023-10-08T07:07:21.356 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9994326, 2023-10-08T07:07:21.356 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00058876700000000002, 2023-10-08T07:07:21.356 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.356 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:21.356 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.356 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.356 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.356 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230792+0000", 2023-10-08T07:07:21.356 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230792+0000", 2023-10-08T07:07:21.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230792+0000", 2023-10-08T07:07:21.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8599999999999998e-07 2023-10-08T07:07:21.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230796+0000", 2023-10-08T07:07:21.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7790000000000002e-06 2023-10-08T07:07:21.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230806+0000", 2023-10-08T07:07:21.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7950000000000002e-06 2023-10-08T07:07:21.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.359 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230812+0000", 2023-10-08T07:07:21.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6290000000000004e-06 2023-10-08T07:07:21.359 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.359 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.359 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.359 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:95922 4.b e55/17 4:d0c991e0:::10000000004.0000002d:head v 55'1491, mlcod=55'1489)", 2023-10-08T07:07:21.359 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.216546+0000", 2023-10-08T07:07:21.359 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013678416000000001, 2023-10-08T07:07:21.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014888389, 2023-10-08T07:07:21.359 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.360 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.360 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.360 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216546+0000", 2023-10-08T07:07:21.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.360 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216546+0000", 2023-10-08T07:07:21.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216546+0000", 2023-10-08T07:07:21.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.41e-07 2023-10-08T07:07:21.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216561+0000", 2023-10-08T07:07:21.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4375e-05 2023-10-08T07:07:21.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216570+0000", 2023-10-08T07:07:21.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1060000000000006e-06 2023-10-08T07:07:21.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216576+0000", 2023-10-08T07:07:21.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0619999999999997e-06 2023-10-08T07:07:21.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216635+0000", 2023-10-08T07:07:21.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9154999999999999e-05 2023-10-08T07:07:21.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.363 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216658+0000", 2023-10-08T07:07:21.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2741000000000001e-05 2023-10-08T07:07:21.363 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.363 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.363 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.363 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.364 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:96466 4.11 e55/17 4:8963efe6:::10000000004.00000009:head v 55'1508, mlcod=55'1505)", 2023-10-08T07:07:21.364 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.230829+0000", 2023-10-08T07:07:21.364 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9993954, 2023-10-08T07:07:21.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067271599999999996, 2023-10-08T07:07:21.364 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.364 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.364 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.364 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.364 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230829+0000", 2023-10-08T07:07:21.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230829+0000", 2023-10-08T07:07:21.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230829+0000", 2023-10-08T07:07:21.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.84e-07 2023-10-08T07:07:21.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230842+0000", 2023-10-08T07:07:21.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3172e-05 2023-10-08T07:07:21.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230848+0000", 2023-10-08T07:07:21.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2730000000000002e-06 2023-10-08T07:07:21.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230851+0000", 2023-10-08T07:07:21.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.703e-06 2023-10-08T07:07:21.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230898+0000", 2023-10-08T07:07:21.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6721999999999998e-05 2023-10-08T07:07:21.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230918+0000", 2023-10-08T07:07:21.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9990999999999999e-05 2023-10-08T07:07:21.371 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.371 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.371 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.372 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:96346 4.31 e55/48 4:8de29a03:::10000000004.00000001:head v 55'2969, mlcod=55'2965)", 2023-10-08T07:07:21.372 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.216588+0000", 2023-10-08T07:07:21.372 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013636456, 2023-10-08T07:07:21.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014981154, 2023-10-08T07:07:21.372 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.373 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.373 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216588+0000", 2023-10-08T07:07:21.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216588+0000", 2023-10-08T07:07:21.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216588+0000", 2023-10-08T07:07:21.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5400000000000002e-07 2023-10-08T07:07:21.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216601+0000", 2023-10-08T07:07:21.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3037000000000001e-05 2023-10-08T07:07:21.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216610+0000", 2023-10-08T07:07:21.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3100000000000001e-06 2023-10-08T07:07:21.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216615+0000", 2023-10-08T07:07:21.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3979999999999998e-06 2023-10-08T07:07:21.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216655+0000", 2023-10-08T07:07:21.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9752999999999997e-05 2023-10-08T07:07:21.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.377 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216672+0000", 2023-10-08T07:07:21.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7323e-05 2023-10-08T07:07:21.377 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.377 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.377 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.377 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop_reply(client.4556.0:96540 4.3a e55/17)", 2023-10-08T07:07:21.377 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.230867+0000", 2023-10-08T07:07:21.378 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9993577, 2023-10-08T07:07:21.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00074474199999999995, 2023-10-08T07:07:21.378 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.378 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:21.378 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.378 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230867+0000", 2023-10-08T07:07:21.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230867+0000", 2023-10-08T07:07:21.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230867+0000", 2023-10-08T07:07:21.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9299999999999999e-07 2023-10-08T07:07:21.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230869+0000", 2023-10-08T07:07:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.39e-06 2023-10-08T07:07:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230876+0000", 2023-10-08T07:07:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5799999999999997e-06 2023-10-08T07:07:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.230882+0000", 2023-10-08T07:07:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8610000000000003e-06 2023-10-08T07:07:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:96383 4.11 e55/17 4:8963efe6:::10000000004.00000009:head v 55'1507, mlcod=55'1504)", 2023-10-08T07:07:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.216626+0000", 2023-10-08T07:07:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013597873999999999, 2023-10-08T07:07:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015013594, 2023-10-08T07:07:21.382 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.382 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.382 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216626+0000", 2023-10-08T07:07:21.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216626+0000", 2023-10-08T07:07:21.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216627+0000", 2023-10-08T07:07:21.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2000000000000001e-07 2023-10-08T07:07:21.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216638+0000", 2023-10-08T07:07:21.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1185999999999999e-05 2023-10-08T07:07:21.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.384 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216645+0000", 2023-10-08T07:07:21.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6139999999999997e-06 2023-10-08T07:07:21.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.384 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.216650+0000", 2023-10-08T07:07:21.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6389999999999997e-06 2023-10-08T07:07:21.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221815+0000", 2023-10-08T07:07:21.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0051644079999999997 2023-10-08T07:07:21.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221831+0000", 2023-10-08T07:07:21.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6589e-05 2023-10-08T07:07:21.385 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.386 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.386 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.386 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:96624 4.16 e55/17)", 2023-10-08T07:07:21.386 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.231481+0000", 2023-10-08T07:07:21.386 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9987435, 2023-10-08T07:07:21.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000192008, 2023-10-08T07:07:21.386 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.386 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:21.386 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.231481+0000", 2023-10-08T07:07:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.231481+0000", 2023-10-08T07:07:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.387 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.231481+0000", 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0399999999999996e-07 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.231499+0000", 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7595999999999999e-05 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.231508+0000", 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1390000000000001e-06 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.231514+0000", 2023-10-08T07:07:21.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.37e-06 2023-10-08T07:07:21.389 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.389 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.389 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.389 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop_reply(client.4556.0:96553 4.20 e55/17)", 2023-10-08T07:07:21.389 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.231525+0000", 2023-10-08T07:07:21.390 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9986992, 2023-10-08T07:07:21.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000181251, 2023-10-08T07:07:21.390 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.390 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:21.390 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.231525+0000", 2023-10-08T07:07:21.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.231525+0000", 2023-10-08T07:07:21.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.231526+0000", 2023-10-08T07:07:21.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1699999999999999e-07 2023-10-08T07:07:21.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.231528+0000", 2023-10-08T07:07:21.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.04e-06 2023-10-08T07:07:21.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.392 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.231538+0000", 2023-10-08T07:07:21.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0197000000000001e-05 2023-10-08T07:07:21.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.392 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.231543+0000", 2023-10-08T07:07:21.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6689999999999997e-06 2023-10-08T07:07:21.392 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.392 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.393 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.393 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96580 4.e 4:70352312:::10000000004.0000001a:head [write 217088~4096 in=4096b,write 299008~4096 in=4096b,write 327680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.393 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.217052+0000", 2023-10-08T07:07:21.393 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013172557999999999, 2023-10-08T07:07:21.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014686497, 2023-10-08T07:07:21.393 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.393 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.393 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.393 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.393 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.394 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96580 2023-10-08T07:07:21.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.394 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217052+0000", 2023-10-08T07:07:21.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217052+0000", 2023-10-08T07:07:21.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217053+0000", 2023-10-08T07:07:21.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:21.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217069+0000", 2023-10-08T07:07:21.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6549999999999999e-05 2023-10-08T07:07:21.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217081+0000", 2023-10-08T07:07:21.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1596e-05 2023-10-08T07:07:21.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217089+0000", 2023-10-08T07:07:21.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1980000000000001e-06 2023-10-08T07:07:21.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.218382+0000", 2023-10-08T07:07:21.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0012928849999999999 2023-10-08T07:07:21.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.218474+0000", 2023-10-08T07:07:21.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2089000000000005e-05 2023-10-08T07:07:21.397 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.397 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:96579 4.26 e55/17 4:672c55ca:::10000000004.00000006:head v 55'1505, mlcod=55'1503)", 2023-10-08T07:07:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.217131+0000", 2023-10-08T07:07:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.01309331, 2023-10-08T07:07:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014646925999999999, 2023-10-08T07:07:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217131+0000", 2023-10-08T07:07:21.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217131+0000", 2023-10-08T07:07:21.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217131+0000", 2023-10-08T07:07:21.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.58e-07 2023-10-08T07:07:21.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.400 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.400 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217142+0000", 2023-10-08T07:07:21.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0709e-05 2023-10-08T07:07:21.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.400 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.400 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217151+0000", 2023-10-08T07:07:21.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7600000000000008e-06 2023-10-08T07:07:21.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217156+0000", 2023-10-08T07:07:21.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6419999999999998e-06 2023-10-08T07:07:21.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.218360+0000", 2023-10-08T07:07:21.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001204049 2023-10-08T07:07:21.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.218379+0000", 2023-10-08T07:07:21.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9811999999999999e-05 2023-10-08T07:07:21.402 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.402 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.402 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.402 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96583 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1150976~4096 in=4096b,write 1384448~4096 in=4096b,write 1404928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.402 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.217816+0000", 2023-10-08T07:07:21.402 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.012408222, 2023-10-08T07:07:21.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013999688999999999, 2023-10-08T07:07:21.403 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.403 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.403 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.403 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.403 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.403 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96583 2023-10-08T07:07:21.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.403 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217816+0000", 2023-10-08T07:07:21.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217816+0000", 2023-10-08T07:07:21.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217817+0000", 2023-10-08T07:07:21.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3000000000000001e-07 2023-10-08T07:07:21.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217828+0000", 2023-10-08T07:07:21.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1058e-05 2023-10-08T07:07:21.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217840+0000", 2023-10-08T07:07:21.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2473999999999999e-05 2023-10-08T07:07:21.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.217847+0000", 2023-10-08T07:07:21.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8469999999999998e-06 2023-10-08T07:07:21.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222452+0000", 2023-10-08T07:07:21.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0046047479999999997 2023-10-08T07:07:21.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222533+0000", 2023-10-08T07:07:21.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1087000000000005e-05 2023-10-08T07:07:21.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222697+0000", 2023-10-08T07:07:21.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016435700000000001 2023-10-08T07:07:21.407 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.407 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.407 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:96389 4.31 e55/48 4:8de29a03:::10000000004.00000001:head v 55'2970, mlcod=55'2966)", 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.219125+0000", 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.011099110000000001, 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012737269000000001, 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.219125+0000", 2023-10-08T07:07:21.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.219125+0000", 2023-10-08T07:07:21.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.219126+0000", 2023-10-08T07:07:21.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0200000000000002e-07 2023-10-08T07:07:21.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.219140+0000", 2023-10-08T07:07:21.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4379000000000001e-05 2023-10-08T07:07:21.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.219151+0000", 2023-10-08T07:07:21.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0382e-05 2023-10-08T07:07:21.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.219157+0000", 2023-10-08T07:07:21.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.815e-06 2023-10-08T07:07:21.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225531+0000", 2023-10-08T07:07:21.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0063735809999999997 2023-10-08T07:07:21.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.225559+0000", 2023-10-08T07:07:21.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7849000000000001e-05 2023-10-08T07:07:21.412 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.412 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.412 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.412 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96591 4.1b 4:d97fb168:::10000000004.00000008:head [write 2285568~4096 in=4096b,write 2453504~4096 in=4096b,write 2465792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.412 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.220434+0000", 2023-10-08T07:07:21.413 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0097905470000000001, 2023-10-08T07:07:21.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011465650000000001, 2023-10-08T07:07:21.413 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.413 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.413 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.413 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.413 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.413 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96591 2023-10-08T07:07:21.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.413 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.220434+0000", 2023-10-08T07:07:21.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.220434+0000", 2023-10-08T07:07:21.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.220435+0000", 2023-10-08T07:07:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.02e-06 2023-10-08T07:07:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.220448+0000", 2023-10-08T07:07:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3677e-05 2023-10-08T07:07:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.220461+0000", 2023-10-08T07:07:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2860000000000001e-05 2023-10-08T07:07:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.220469+0000", 2023-10-08T07:07:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8390000000000007e-06 2023-10-08T07:07:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222547+0000", 2023-10-08T07:07:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020777220000000002 2023-10-08T07:07:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222620+0000", 2023-10-08T07:07:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2816000000000002e-05 2023-10-08T07:07:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.222774+0000", 2023-10-08T07:07:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000154351 2023-10-08T07:07:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96593 4.38 4:1e0977c7:::10000000004.00000022:head [write 1183744~4096 in=4096b,write 1323008~4096 in=4096b,write 1347584~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.221067+0000", 2023-10-08T07:07:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0091576309999999994, 2023-10-08T07:07:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010879343, 2023-10-08T07:07:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96593 2023-10-08T07:07:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221067+0000", 2023-10-08T07:07:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221067+0000", 2023-10-08T07:07:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221067+0000", 2023-10-08T07:07:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.13e-07 2023-10-08T07:07:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221080+0000", 2023-10-08T07:07:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3132000000000001e-05 2023-10-08T07:07:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221092+0000", 2023-10-08T07:07:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1620999999999999e-05 2023-10-08T07:07:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221098+0000", 2023-10-08T07:07:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5269999999999998e-06 2023-10-08T07:07:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226615+0000", 2023-10-08T07:07:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.005516969 2023-10-08T07:07:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226664+0000", 2023-10-08T07:07:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9437000000000001e-05 2023-10-08T07:07:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.226758+0000", 2023-10-08T07:07:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4015e-05 2023-10-08T07:07:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:96595 4.24 4:25ba01c5:::10000000004.00000035:head [write 1998848~4096 in=4096b,write 2117632~4096 in=4096b,write 2220032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-10-08T07:07:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.221724+0000", 2023-10-08T07:07:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0085001369999999996, 2023-10-08T07:07:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010266449, 2023-10-08T07:07:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 96595 2023-10-08T07:07:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221724+0000", 2023-10-08T07:07:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221724+0000", 2023-10-08T07:07:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221725+0000", 2023-10-08T07:07:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2200000000000003e-07 2023-10-08T07:07:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221737+0000", 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1545999999999999e-05 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221748+0000", 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1590000000000001e-05 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221755+0000", 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0979999999999996e-06 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221800+0000", 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4724000000000001e-05 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.221872+0000", 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.216e-05 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:07:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 37 2023-10-08T07:07:21.429 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:21.430 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:21.431 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:21.431 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:07:21.432 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:21.432 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:07:21.432 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:21.433 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2023-10-08T07:07:21.433 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:21.430+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:21.531 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:21.530+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:21.631 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:21.631+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:21.639 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:21.639 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:21.654 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:21.734 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:21.732+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:21.834 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:21.833+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:21.893 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72627 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 352256~4096,write 483328~4096,write 651264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.554404+0000", 2023-10-08T07:07:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.3358631859999992, 2023-10-08T07:07:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048777491999999999, 2023-10-08T07:07:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72627 2023-10-08T07:07:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554404+0000", 2023-10-08T07:07:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554404+0000", 2023-10-08T07:07:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554405+0000", 2023-10-08T07:07:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.001e-06 2023-10-08T07:07:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554432+0000", 2023-10-08T07:07:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6679e-05 2023-10-08T07:07:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554444+0000", 2023-10-08T07:07:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2167999999999999e-05 2023-10-08T07:07:21.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.898 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.898 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.898 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554453+0000", 2023-10-08T07:07:21.898 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2449999999999998e-06 2023-10-08T07:07:21.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.898 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.898 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.898 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556730+0000", 2023-10-08T07:07:21.898 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022777269999999998 2023-10-08T07:07:21.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.899 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.899 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.899 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556782+0000", 2023-10-08T07:07:21.899 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1756999999999999e-05 2023-10-08T07:07:21.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.899 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.899 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.899 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.556901+0000", 2023-10-08T07:07:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000119132 2023-10-08T07:07:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.571593+0000", 2023-10-08T07:07:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014691638999999999 2023-10-08T07:07:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603125+0000", 2023-10-08T07:07:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.031531745999999999 2023-10-08T07:07:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603159+0000", 2023-10-08T07:07:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4382999999999999e-05 2023-10-08T07:07:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.603182+0000", 2023-10-08T07:07:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3014999999999999e-05 2023-10-08T07:07:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72628 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 3993600~4096,write 4141056~4096,write 4157440~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.554894+0000", 2023-10-08T07:07:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.3353739059999992, 2023-10-08T07:07:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049659593000000002, 2023-10-08T07:07:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72628 2023-10-08T07:07:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554894+0000", 2023-10-08T07:07:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554894+0000", 2023-10-08T07:07:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554895+0000", 2023-10-08T07:07:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2099999999999995e-07 2023-10-08T07:07:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554906+0000", 2023-10-08T07:07:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1782e-05 2023-10-08T07:07:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554923+0000", 2023-10-08T07:07:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.664e-05 2023-10-08T07:07:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.554931+0000", 2023-10-08T07:07:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5989999999999996e-06 2023-10-08T07:07:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.558600+0000", 2023-10-08T07:07:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003669346 2023-10-08T07:07:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.558650+0000", 2023-10-08T07:07:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0385e-05 2023-10-08T07:07:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.558750+0000", 2023-10-08T07:07:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9500999999999995e-05 2023-10-08T07:07:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.576743+0000", 2023-10-08T07:07:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017993680000000001 2023-10-08T07:07:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604444+0000", 2023-10-08T07:07:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027700446 2023-10-08T07:07:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604507+0000", 2023-10-08T07:07:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3477000000000002e-05 2023-10-08T07:07:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604553+0000", 2023-10-08T07:07:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5915999999999999e-05 2023-10-08T07:07:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:72630 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2695168~4096,write 2756608~4096,write 2813952~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-10-08T07:07:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:12.555436+0000", 2023-10-08T07:07:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.3348314420000005, 2023-10-08T07:07:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049269518999999998, 2023-10-08T07:07:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 72630 2023-10-08T07:07:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555436+0000", 2023-10-08T07:07:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555436+0000", 2023-10-08T07:07:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555437+0000", 2023-10-08T07:07:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3799999999999996e-07 2023-10-08T07:07:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555479+0000", 2023-10-08T07:07:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2475999999999998e-05 2023-10-08T07:07:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555490+0000", 2023-10-08T07:07:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0159999999999999e-05 2023-10-08T07:07:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.555495+0000", 2023-10-08T07:07:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5169999999999999e-06 2023-10-08T07:07:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560199+0000", 2023-10-08T07:07:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047036379999999996 2023-10-08T07:07:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560281+0000", 2023-10-08T07:07:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2452000000000003e-05 2023-10-08T07:07:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.560437+0000", 2023-10-08T07:07:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000156324 2023-10-08T07:07:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.578171+0000", 2023-10-08T07:07:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017733043 2023-10-08T07:07:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604605+0000", 2023-10-08T07:07:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026434546999999999 2023-10-08T07:07:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604667+0000", 2023-10-08T07:07:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1521999999999998e-05 2023-10-08T07:07:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:12.604706+0000", 2023-10-08T07:07:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9101999999999999e-05 2023-10-08T07:07:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85542 4.30 4:0f322a22:::10000000004.00000014:head [write 1478656~4096,write 1536000~4096,write 1748992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.227446+0000", 2023-10-08T07:07:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.6628213039999995, 2023-10-08T07:07:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.065063832000000002, 2023-10-08T07:07:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85542 2023-10-08T07:07:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227446+0000", 2023-10-08T07:07:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227446+0000", 2023-10-08T07:07:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227447+0000", 2023-10-08T07:07:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4399999999999999e-07 2023-10-08T07:07:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227456+0000", 2023-10-08T07:07:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0189999999999995e-06 2023-10-08T07:07:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227468+0000", 2023-10-08T07:07:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2156e-05 2023-10-08T07:07:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227474+0000", 2023-10-08T07:07:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8000000000000004e-06 2023-10-08T07:07:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227525+0000", 2023-10-08T07:07:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1359000000000001e-05 2023-10-08T07:07:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227585+0000", 2023-10-08T07:07:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9324000000000003e-05 2023-10-08T07:07:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.227682+0000", 2023-10-08T07:07:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7171999999999997e-05 2023-10-08T07:07:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.229286+0000", 2023-10-08T07:07:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001604383 2023-10-08T07:07:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.292408+0000", 2023-10-08T07:07:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.063121770999999993 2023-10-08T07:07:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.292466+0000", 2023-10-08T07:07:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7964999999999998e-05 2023-10-08T07:07:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.292510+0000", 2023-10-08T07:07:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4138999999999999e-05 2023-10-08T07:07:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85551 4.20 4:04004f2c:::10000000004.0000000d:head [write 290816~4096,write 634880~4096,write 692224~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.230050+0000", 2023-10-08T07:07:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.6602171209999996, 2023-10-08T07:07:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.051188919999999999, 2023-10-08T07:07:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85551 2023-10-08T07:07:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230050+0000", 2023-10-08T07:07:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230050+0000", 2023-10-08T07:07:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230051+0000", 2023-10-08T07:07:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8299999999999996e-07 2023-10-08T07:07:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230063+0000", 2023-10-08T07:07:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1747e-05 2023-10-08T07:07:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230071+0000", 2023-10-08T07:07:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.841e-06 2023-10-08T07:07:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230075+0000", 2023-10-08T07:07:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6879999999999998e-06 2023-10-08T07:07:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230124+0000", 2023-10-08T07:07:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8367e-05 2023-10-08T07:07:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230214+0000", 2023-10-08T07:07:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0514999999999997e-05 2023-10-08T07:07:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.230368+0000", 2023-10-08T07:07:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015336200000000001 2023-10-08T07:07:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.234266+0000", 2023-10-08T07:07:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003898599 2023-10-08T07:07:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.281157+0000", 2023-10-08T07:07:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046890319999999999 2023-10-08T07:07:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.281206+0000", 2023-10-08T07:07:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8984999999999999e-05 2023-10-08T07:07:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.281239+0000", 2023-10-08T07:07:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3813000000000003e-05 2023-10-08T07:07:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85559 4.38 4:1e0977c7:::10000000004.00000022:head [write 385024~4096,write 524288~4096,write 610304~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.232568+0000", 2023-10-08T07:07:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.6576997489999998, 2023-10-08T07:07:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049973141999999998, 2023-10-08T07:07:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85559 2023-10-08T07:07:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232568+0000", 2023-10-08T07:07:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232568+0000", 2023-10-08T07:07:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232569+0000", 2023-10-08T07:07:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6099999999999999e-07 2023-10-08T07:07:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232580+0000", 2023-10-08T07:07:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1721e-05 2023-10-08T07:07:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232597+0000", 2023-10-08T07:07:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6957999999999999e-05 2023-10-08T07:07:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232605+0000", 2023-10-08T07:07:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7749999999999993e-06 2023-10-08T07:07:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232673+0000", 2023-10-08T07:07:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7879000000000005e-05 2023-10-08T07:07:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.232812+0000", 2023-10-08T07:07:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013899299999999999 2023-10-08T07:07:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.233001+0000", 2023-10-08T07:07:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000189197 2023-10-08T07:07:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.234859+0000", 2023-10-08T07:07:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0018577330000000001 2023-10-08T07:07:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.282442+0000", 2023-10-08T07:07:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047583054 2023-10-08T07:07:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.282478+0000", 2023-10-08T07:07:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5972000000000001e-05 2023-10-08T07:07:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.282541+0000", 2023-10-08T07:07:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2998999999999998e-05 2023-10-08T07:07:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85570 4.20 4:05b3915c:::10000000004.00000016:head [write 630784~4096,write 692224~4096,write 802816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.235867+0000", 2023-10-08T07:07:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.6544009759999998, 2023-10-08T07:07:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.054480849999999997, 2023-10-08T07:07:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85570 2023-10-08T07:07:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235867+0000", 2023-10-08T07:07:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235867+0000", 2023-10-08T07:07:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235868+0000", 2023-10-08T07:07:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7300000000000005e-07 2023-10-08T07:07:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235878+0000", 2023-10-08T07:07:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0757999999999999e-05 2023-10-08T07:07:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235886+0000", 2023-10-08T07:07:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1189999999999997e-06 2023-10-08T07:07:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235892+0000", 2023-10-08T07:07:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3979999999999998e-06 2023-10-08T07:07:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235929+0000", 2023-10-08T07:07:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7660999999999997e-05 2023-10-08T07:07:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.235977+0000", 2023-10-08T07:07:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8000000000000001e-05 2023-10-08T07:07:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236072+0000", 2023-10-08T07:07:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4703000000000005e-05 2023-10-08T07:07:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.240171+0000", 2023-10-08T07:07:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040992579999999997 2023-10-08T07:07:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.290256+0000", 2023-10-08T07:07:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050085058000000002 2023-10-08T07:07:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.290309+0000", 2023-10-08T07:07:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2373999999999997e-05 2023-10-08T07:07:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.290347+0000", 2023-10-08T07:07:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8648e-05 2023-10-08T07:07:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85573 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 258048~4096,write 630784~4096,write 647168~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.236720+0000", 2023-10-08T07:07:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.6535472340000004, 2023-10-08T07:07:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.052292526999999998, 2023-10-08T07:07:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85573 2023-10-08T07:07:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236720+0000", 2023-10-08T07:07:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236720+0000", 2023-10-08T07:07:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236721+0000", 2023-10-08T07:07:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3499999999999996e-07 2023-10-08T07:07:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236742+0000", 2023-10-08T07:07:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1314999999999998e-05 2023-10-08T07:07:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236749+0000", 2023-10-08T07:07:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5379999999999999e-06 2023-10-08T07:07:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236753+0000", 2023-10-08T07:07:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2080000000000002e-06 2023-10-08T07:07:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.239116+0000", 2023-10-08T07:07:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0023627549999999998 2023-10-08T07:07:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.239181+0000", 2023-10-08T07:07:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4839999999999996e-05 2023-10-08T07:07:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.239315+0000", 2023-10-08T07:07:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000134635 2023-10-08T07:07:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.242261+0000", 2023-10-08T07:07:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029461209999999999 2023-10-08T07:07:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.288944+0000", 2023-10-08T07:07:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046682781999999999 2023-10-08T07:07:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.288978+0000", 2023-10-08T07:07:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3763999999999997e-05 2023-10-08T07:07:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.289013+0000", 2023-10-08T07:07:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5033999999999997e-05 2023-10-08T07:07:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85574 4.20 4:07572838:::10000000004.00000010:head [write 3239936~4096,write 3457024~4096,write 3518464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.236985+0000", 2023-10-08T07:07:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.6532825730000003, 2023-10-08T07:07:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.059496828000000002, 2023-10-08T07:07:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85574 2023-10-08T07:07:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236985+0000", 2023-10-08T07:07:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236985+0000", 2023-10-08T07:07:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.236985+0000", 2023-10-08T07:07:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0999999999999999e-07 2023-10-08T07:07:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.237007+0000", 2023-10-08T07:07:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1529e-05 2023-10-08T07:07:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.237013+0000", 2023-10-08T07:07:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1800000000000001e-06 2023-10-08T07:07:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.237017+0000", 2023-10-08T07:07:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1640000000000003e-06 2023-10-08T07:07:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.238022+0000", 2023-10-08T07:07:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010047159999999999 2023-10-08T07:07:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.238128+0000", 2023-10-08T07:07:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010597700000000001 2023-10-08T07:07:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.238288+0000", 2023-10-08T07:07:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016046100000000001 2023-10-08T07:07:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.240591+0000", 2023-10-08T07:07:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0023025559999999999 2023-10-08T07:07:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296421+0000", 2023-10-08T07:07:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055829742000000002 2023-10-08T07:07:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296459+0000", 2023-10-08T07:07:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7765000000000002e-05 2023-10-08T07:07:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296482+0000", 2023-10-08T07:07:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3328000000000001e-05 2023-10-08T07:07:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85593 4.20 4:07572838:::10000000004.00000010:head [write 4096~4096,write 28672~4096,write 233472~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.243319+0000", 2023-10-08T07:07:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.6469486829999997, 2023-10-08T07:07:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.053245457000000003, 2023-10-08T07:07:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85593 2023-10-08T07:07:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243319+0000", 2023-10-08T07:07:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243319+0000", 2023-10-08T07:07:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243320+0000", 2023-10-08T07:07:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7899999999999998e-07 2023-10-08T07:07:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243345+0000", 2023-10-08T07:07:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5194e-05 2023-10-08T07:07:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243355+0000", 2023-10-08T07:07:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0261000000000001e-05 2023-10-08T07:07:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243362+0000", 2023-10-08T07:07:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3150000000000003e-06 2023-10-08T07:07:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243414+0000", 2023-10-08T07:07:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1912e-05 2023-10-08T07:07:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243484+0000", 2023-10-08T07:07:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9369999999999995e-05 2023-10-08T07:07:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.243634+0000", 2023-10-08T07:07:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015079199999999999 2023-10-08T07:07:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251334+0000", 2023-10-08T07:07:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0076994849999999998 2023-10-08T07:07:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296511+0000", 2023-10-08T07:07:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045177279000000001 2023-10-08T07:07:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296543+0000", 2023-10-08T07:07:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1557999999999998e-05 2023-10-08T07:07:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296564+0000", 2023-10-08T07:07:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1611999999999999e-05 2023-10-08T07:07:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85599 4.38 4:1e0977c7:::10000000004.00000022:head [write 1757184~8192,write 1843200~4096,write 1970176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.245241+0000", 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.6450266400000002, 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.051364343, 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85599 2023-10-08T07:07:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245241+0000", 2023-10-08T07:07:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245241+0000", 2023-10-08T07:07:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245242+0000", 2023-10-08T07:07:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.128e-06 2023-10-08T07:07:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245265+0000", 2023-10-08T07:07:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2938999999999998e-05 2023-10-08T07:07:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245275+0000", 2023-10-08T07:07:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0212e-05 2023-10-08T07:07:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245283+0000", 2023-10-08T07:07:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6429999999999995e-06 2023-10-08T07:07:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245331+0000", 2023-10-08T07:07:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8421000000000003e-05 2023-10-08T07:07:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245421+0000", 2023-10-08T07:07:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9617999999999995e-05 2023-10-08T07:07:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245592+0000", 2023-10-08T07:07:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000170853 2023-10-08T07:07:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251310+0000", 2023-10-08T07:07:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0057182730000000003 2023-10-08T07:07:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296459+0000", 2023-10-08T07:07:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045148829000000001 2023-10-08T07:07:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296518+0000", 2023-10-08T07:07:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9298e-05 2023-10-08T07:07:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296605+0000", 2023-10-08T07:07:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7128999999999999e-05 2023-10-08T07:07:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85600 4.20 4:07572838:::10000000004.00000010:head [write 3162112~4096,write 3579904~4096,write 3588096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.245590+0000", 2023-10-08T07:07:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.6446771509999998, 2023-10-08T07:07:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.051051430000000002, 2023-10-08T07:07:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85600 2023-10-08T07:07:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245590+0000", 2023-10-08T07:07:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245590+0000", 2023-10-08T07:07:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245591+0000", 2023-10-08T07:07:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0299999999999998e-07 2023-10-08T07:07:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245612+0000", 2023-10-08T07:07:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.075e-05 2023-10-08T07:07:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245621+0000", 2023-10-08T07:07:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.064e-06 2023-10-08T07:07:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.245627+0000", 2023-10-08T07:07:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0769999999999996e-06 2023-10-08T07:07:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.246241+0000", 2023-10-08T07:07:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00061415000000000005 2023-10-08T07:07:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.246315+0000", 2023-10-08T07:07:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4234999999999997e-05 2023-10-08T07:07:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.246499+0000", 2023-10-08T07:07:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018382199999999999 2023-10-08T07:07:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251400+0000", 2023-10-08T07:07:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0049005439999999997 2023-10-08T07:07:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296588+0000", 2023-10-08T07:07:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045188465999999997 2023-10-08T07:07:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296622+0000", 2023-10-08T07:07:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3532999999999999e-05 2023-10-08T07:07:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.296642+0000", 2023-10-08T07:07:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0086e-05 2023-10-08T07:07:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:85619 4.20 4:04004f2c:::10000000004.0000000d:head [write 2985984~4096,write 3178496~4096,write 3256320~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.251663+0000", 2023-10-08T07:07:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.6386041530000002, 2023-10-08T07:07:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047680326000000002, 2023-10-08T07:07:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 85619 2023-10-08T07:07:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251663+0000", 2023-10-08T07:07:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251663+0000", 2023-10-08T07:07:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251664+0000", 2023-10-08T07:07:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.92e-07 2023-10-08T07:07:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251675+0000", 2023-10-08T07:07:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0648999999999999e-05 2023-10-08T07:07:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251683+0000", 2023-10-08T07:07:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1880000000000002e-06 2023-10-08T07:07:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251688+0000", 2023-10-08T07:07:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2120000000000002e-06 2023-10-08T07:07:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251726+0000", 2023-10-08T07:07:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8136999999999998e-05 2023-10-08T07:07:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251776+0000", 2023-10-08T07:07:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9790000000000003e-05 2023-10-08T07:07:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.251865+0000", 2023-10-08T07:07:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8858999999999997e-05 2023-10-08T07:07:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:22.004 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.257714+0000", 2023-10-08T07:07:22.004 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.005848809 2023-10-08T07:07:22.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.299242+0000", 2023-10-08T07:07:22.005 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.041527653999999997 2023-10-08T07:07:22.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.005 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:22.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.299305+0000", 2023-10-08T07:07:22.005 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3618e-05 2023-10-08T07:07:22.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.006 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:22.006 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.299344+0000", 2023-10-08T07:07:22.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8618000000000002e-05 2023-10-08T07:07:22.006 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.006 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:22.006 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.007 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:86965 4.38 4:1e0977c7:::10000000004.00000022:head [write 208896~4096,write 294912~4096,write 307200~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:22.007 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.780829+0000", 2023-10-08T07:07:22.007 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1094390760000001, 2023-10-08T07:07:22.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048817502999999998, 2023-10-08T07:07:22.007 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:22.007 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:22.007 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:22.007 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:22.007 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.008 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 86965 2023-10-08T07:07:22.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.008 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:22.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.008 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:22.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.780829+0000", 2023-10-08T07:07:22.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.008 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:22.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.780829+0000", 2023-10-08T07:07:22.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:22.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.780830+0000", 2023-10-08T07:07:22.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0699999999999999e-06 2023-10-08T07:07:22.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:22.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.780843+0000", 2023-10-08T07:07:22.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3154e-05 2023-10-08T07:07:22.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:22.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.780855+0000", 2023-10-08T07:07:22.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2714999999999999e-05 2023-10-08T07:07:22.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.780865+0000", 2023-10-08T07:07:22.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6670000000000008e-06 2023-10-08T07:07:22.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:22.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.781829+0000", 2023-10-08T07:07:22.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000963751 2023-10-08T07:07:22.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:22.012 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.781907+0000", 2023-10-08T07:07:22.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8219000000000004e-05 2023-10-08T07:07:22.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.012 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:22.012 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782017+0000", 2023-10-08T07:07:22.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011027300000000001 2023-10-08T07:07:22.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.012 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:22.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.788566+0000", 2023-10-08T07:07:22.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065484289999999997 2023-10-08T07:07:22.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.829515+0000", 2023-10-08T07:07:22.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.040949157999999999 2023-10-08T07:07:22.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:22.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.829570+0000", 2023-10-08T07:07:22.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5229000000000003e-05 2023-10-08T07:07:22.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:22.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.829646+0000", 2023-10-08T07:07:22.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5838000000000001e-05 2023-10-08T07:07:22.014 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.014 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:22.015 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.015 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:86968 4.20 4:04004f2c:::10000000004.0000000d:head [write 1101824~4096,write 1191936~4096,write 1445888~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:22.015 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.782022+0000", 2023-10-08T07:07:22.015 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.10824546, 2023-10-08T07:07:22.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047578305000000001, 2023-10-08T07:07:22.015 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:22.015 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:22.016 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:22.016 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:22.016 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.016 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 86968 2023-10-08T07:07:22.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.016 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:22.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:22.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782022+0000", 2023-10-08T07:07:22.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:22.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782022+0000", 2023-10-08T07:07:22.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:22.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782023+0000", 2023-10-08T07:07:22.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.78e-07 2023-10-08T07:07:22.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:22.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782034+0000", 2023-10-08T07:07:22.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.115e-05 2023-10-08T07:07:22.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:22.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782044+0000", 2023-10-08T07:07:22.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0185e-05 2023-10-08T07:07:22.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.782052+0000", 2023-10-08T07:07:22.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5549999999999997e-06 2023-10-08T07:07:22.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:22.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.784555+0000", 2023-10-08T07:07:22.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0025027650000000001 2023-10-08T07:07:22.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:22.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.784608+0000", 2023-10-08T07:07:22.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3807999999999997e-05 2023-10-08T07:07:22.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:22.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.784740+0000", 2023-10-08T07:07:22.021 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000131168 2023-10-08T07:07:22.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:22.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.791565+0000", 2023-10-08T07:07:22.021 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0068256360000000004 2023-10-08T07:07:22.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.829500+0000", 2023-10-08T07:07:22.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037934334 2023-10-08T07:07:22.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.022 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:22.022 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.829561+0000", 2023-10-08T07:07:22.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1253999999999993e-05 2023-10-08T07:07:22.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.022 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:22.022 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.829600+0000", 2023-10-08T07:07:22.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9572e-05 2023-10-08T07:07:22.023 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.023 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:22.023 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.023 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:86981 4.c 4:3352c333:::10000000004.00000012:head [write 4100096~4096,write 4153344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:22.023 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.786697+0000", 2023-10-08T07:07:22.023 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1035706169999999, 2023-10-08T07:07:22.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049572084000000002, 2023-10-08T07:07:22.023 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:22.024 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:22.024 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:22.024 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:22.024 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.024 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 86981 2023-10-08T07:07:22.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.024 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:22.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:22.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.786697+0000", 2023-10-08T07:07:22.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:22.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.786697+0000", 2023-10-08T07:07:22.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:22.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.786698+0000", 2023-10-08T07:07:22.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2200000000000003e-07 2023-10-08T07:07:22.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.026 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:22.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.786707+0000", 2023-10-08T07:07:22.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4259999999999992e-06 2023-10-08T07:07:22.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.026 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:22.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.786717+0000", 2023-10-08T07:07:22.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3309999999999993e-06 2023-10-08T07:07:22.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.027 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.027 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.786724+0000", 2023-10-08T07:07:22.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.311e-06 2023-10-08T07:07:22.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.027 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:22.027 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.789932+0000", 2023-10-08T07:07:22.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032078919999999999 2023-10-08T07:07:22.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:22.028 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.789996+0000", 2023-10-08T07:07:22.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4639000000000002e-05 2023-10-08T07:07:22.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:22.028 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.790121+0000", 2023-10-08T07:07:22.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012497699999999999 2023-10-08T07:07:22.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:22.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.792908+0000", 2023-10-08T07:07:22.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00278612 2023-10-08T07:07:22.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.836175+0000", 2023-10-08T07:07:22.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.043267982000000003 2023-10-08T07:07:22.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.030 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:22.030 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.836235+0000", 2023-10-08T07:07:22.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9753999999999997e-05 2023-10-08T07:07:22.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.030 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:22.030 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.836269+0000", 2023-10-08T07:07:22.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.383e-05 2023-10-08T07:07:22.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.031 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:22.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.031 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:87226 4.20 4:04004f2c:::10000000004.0000000d:head [write 3092480~4096,write 3354624~4096,write 3387392~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:22.031 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.872113+0000", 2023-10-08T07:07:22.031 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.0181548090000003, 2023-10-08T07:07:22.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047777183000000001, 2023-10-08T07:07:22.031 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:22.032 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:22.032 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:22.032 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:22.032 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.032 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 87226 2023-10-08T07:07:22.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.032 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:22.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.032 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:22.032 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.872113+0000", 2023-10-08T07:07:22.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:22.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.872113+0000", 2023-10-08T07:07:22.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:22.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.872114+0000", 2023-10-08T07:07:22.034 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4099999999999997e-07 2023-10-08T07:07:22.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.034 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:22.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.872125+0000", 2023-10-08T07:07:22.034 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.185e-05 2023-10-08T07:07:22.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.034 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:22.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.872136+0000", 2023-10-08T07:07:22.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0033e-05 2023-10-08T07:07:22.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.872144+0000", 2023-10-08T07:07:22.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0790000000000001e-06 2023-10-08T07:07:22.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:22.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.878297+0000", 2023-10-08T07:07:22.036 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.006153894 2023-10-08T07:07:22.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.036 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:22.036 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.878354+0000", 2023-10-08T07:07:22.036 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6844e-05 2023-10-08T07:07:22.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.036 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:22.036 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.878471+0000", 2023-10-08T07:07:22.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011704 2023-10-08T07:07:22.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.037 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.037 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:22.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.882051+0000", 2023-10-08T07:07:22.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0035792300000000001 2023-10-08T07:07:22.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.037 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.037 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.919786+0000", 2023-10-08T07:07:22.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037735563999999999 2023-10-08T07:07:22.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.038 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:22.038 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.919844+0000", 2023-10-08T07:07:22.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8161000000000001e-05 2023-10-08T07:07:22.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.038 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:22.038 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.919890+0000", 2023-10-08T07:07:22.039 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5646999999999999e-05 2023-10-08T07:07:22.039 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.039 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:22.039 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.039 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:87263 4.20 4:04004f2c:::10000000004.0000000d:head [write 2568192~4096,write 2695168~4096,write 2777088~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-10-08T07:07:22.039 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:17.884730+0000", 2023-10-08T07:07:22.039 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.0055374290000003, 2023-10-08T07:07:22.039 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048776342, 2023-10-08T07:07:22.040 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:22.040 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:22.040 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:22.040 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:22.040 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.040 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 87263 2023-10-08T07:07:22.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.040 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:22.040 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.040 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:22.041 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.884730+0000", 2023-10-08T07:07:22.041 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.041 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.041 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:22.041 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.884730+0000", 2023-10-08T07:07:22.041 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.041 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.041 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:22.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.884731+0000", 2023-10-08T07:07:22.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1500000000000003e-07 2023-10-08T07:07:22.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:22.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.884744+0000", 2023-10-08T07:07:22.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.277e-05 2023-10-08T07:07:22.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:22.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.884754+0000", 2023-10-08T07:07:22.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0703999999999999e-05 2023-10-08T07:07:22.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.884762+0000", 2023-10-08T07:07:22.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6040000000000004e-06 2023-10-08T07:07:22.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:22.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.886237+0000", 2023-10-08T07:07:22.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001475339 2023-10-08T07:07:22.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:22.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.886290+0000", 2023-10-08T07:07:22.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2636999999999998e-05 2023-10-08T07:07:22.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:22.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.886381+0000", 2023-10-08T07:07:22.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0808000000000002e-05 2023-10-08T07:07:22.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.045 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:22.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.888572+0000", 2023-10-08T07:07:22.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002191517 2023-10-08T07:07:22.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.045 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.046 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.933458+0000", 2023-10-08T07:07:22.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.044885428999999998 2023-10-08T07:07:22.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.046 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.046 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:22.046 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.933486+0000", 2023-10-08T07:07:22.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8416e-05 2023-10-08T07:07:22.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.046 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.046 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:22.047 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:17.933507+0000", 2023-10-08T07:07:22.047 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0302999999999999e-05 2023-10-08T07:07:22.047 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.047 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:22.047 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.047 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.047 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:97141 4.3a 4:5f183e4b:::10000000004.00000023:head [write 1703936~4096,write 1732608~4096,write 1921024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.047 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.415191+0000", 2023-10-08T07:07:22.047 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.47507662699999997, 2023-10-08T07:07:22.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047407183999999998, 2023-10-08T07:07:22.048 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:22.048 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:22.048 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:22.048 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:22.048 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.048 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 97141 2023-10-08T07:07:22.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.048 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:22.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:22.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.415191+0000", 2023-10-08T07:07:22.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:22.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.415191+0000", 2023-10-08T07:07:22.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:22.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.415192+0000", 2023-10-08T07:07:22.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9699999999999995e-07 2023-10-08T07:07:22.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:22.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.415205+0000", 2023-10-08T07:07:22.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3803e-05 2023-10-08T07:07:22.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:22.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.415216+0000", 2023-10-08T07:07:22.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0404999999999999e-05 2023-10-08T07:07:22.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.415222+0000", 2023-10-08T07:07:22.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.173e-06 2023-10-08T07:07:22.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:22.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.415571+0000", 2023-10-08T07:07:22.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000349215 2023-10-08T07:07:22.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:22.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.415659+0000", 2023-10-08T07:07:22.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8096999999999994e-05 2023-10-08T07:07:22.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:22.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.415829+0000", 2023-10-08T07:07:22.053 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016923900000000001 2023-10-08T07:07:22.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:22.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.419409+0000", 2023-10-08T07:07:22.053 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0035805670000000002 2023-10-08T07:07:22.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.462494+0000", 2023-10-08T07:07:22.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.043084625000000001 2023-10-08T07:07:22.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:22.054 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.462556+0000", 2023-10-08T07:07:22.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1946000000000006e-05 2023-10-08T07:07:22.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:22.054 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.462598+0000", 2023-10-08T07:07:22.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2416999999999997e-05 2023-10-08T07:07:22.055 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.055 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:22.055 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.055 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:98285 4.20 4:07572838:::10000000004.00000010:head [write 688128~4096,write 770048~4096,write 892928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.055 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:21.837836+0000", 2023-10-08T07:07:22.055 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.052432078999999999, 2023-10-08T07:07:22.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049384522, 2023-10-08T07:07:22.056 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:22.056 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:22.056 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:22.056 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:22.056 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.056 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 98285 2023-10-08T07:07:22.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.056 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:22.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.837836+0000", 2023-10-08T07:07:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.837836+0000", 2023-10-08T07:07:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:22.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.837836+0000", 2023-10-08T07:07:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6499999999999998e-07 2023-10-08T07:07:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.837848+0000", 2023-10-08T07:07:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1336e-05 2023-10-08T07:07:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:22.058 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.837859+0000", 2023-10-08T07:07:22.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1739000000000001e-05 2023-10-08T07:07:22.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.837867+0000", 2023-10-08T07:07:22.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2239999999999998e-06 2023-10-08T07:07:22.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:22.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.838452+0000", 2023-10-08T07:07:22.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00058508799999999999 2023-10-08T07:07:22.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.060 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:22.060 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.838538+0000", 2023-10-08T07:07:22.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6385999999999996e-05 2023-10-08T07:07:22.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.060 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:22.060 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.838697+0000", 2023-10-08T07:07:22.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015877099999999999 2023-10-08T07:07:22.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:22.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.842196+0000", 2023-10-08T07:07:22.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0034986919999999999 2023-10-08T07:07:22.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.887106+0000", 2023-10-08T07:07:22.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.044910229000000003 2023-10-08T07:07:22.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:22.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.887170+0000", 2023-10-08T07:07:22.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4179999999999999e-05 2023-10-08T07:07:22.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:22.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:22.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:22.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:21.887220+0000", 2023-10-08T07:07:22.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0012000000000002e-05 2023-10-08T07:07:22.063 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.063 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:22.063 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.063 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:22.063 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:22.063 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:22.065 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:22.065 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:22.064+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:22.165 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:22.165+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:22.266 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:22.265+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:22.276 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99479 4.1b e56/17 4:d97fb168:::10000000004.00000008:head v 56'3157, mlcod=56'3151)", 2023-10-08T07:07:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.248357+0000", 2023-10-08T07:07:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.019129393000000001, 2023-10-08T07:07:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019158557, 2023-10-08T07:07:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.278 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248357+0000", 2023-10-08T07:07:22.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248357+0000", 2023-10-08T07:07:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248357+0000", 2023-10-08T07:07:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4999999999999998e-07 2023-10-08T07:07:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248377+0000", 2023-10-08T07:07:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9806e-05 2023-10-08T07:07:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248384+0000", 2023-10-08T07:07:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7519999999999999e-06 2023-10-08T07:07:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248389+0000", 2023-10-08T07:07:22.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5929999999999999e-06 2023-10-08T07:07:22.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250235+0000", 2023-10-08T07:07:22.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018465619999999999 2023-10-08T07:07:22.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250258+0000", 2023-10-08T07:07:22.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2699000000000001e-05 2023-10-08T07:07:22.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.282 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.282 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99511 4.1b e56/17 4:d97fb168:::10000000004.00000008:head v 56'3159, mlcod=56'3152)", 2023-10-08T07:07:22.282 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.261312+0000", 2023-10-08T07:07:22.283 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.006174634, 2023-10-08T07:07:22.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062825440000000001, 2023-10-08T07:07:22.283 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.283 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.283 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261312+0000", 2023-10-08T07:07:22.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261312+0000", 2023-10-08T07:07:22.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261312+0000", 2023-10-08T07:07:22.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-07 2023-10-08T07:07:22.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261326+0000", 2023-10-08T07:07:22.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3339999999999999e-05 2023-10-08T07:07:22.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261337+0000", 2023-10-08T07:07:22.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1072e-05 2023-10-08T07:07:22.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261345+0000", 2023-10-08T07:07:22.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2023-10-08T07:07:22.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261925+0000", 2023-10-08T07:07:22.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00058033 2023-10-08T07:07:22.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261942+0000", 2023-10-08T07:07:22.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6597000000000001e-05 2023-10-08T07:07:22.287 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.287 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.287 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.288 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99434 4.a e56/17 4:524fba76:::10000000004.0000001b:head v 56'1554, mlcod=56'1552)", 2023-10-08T07:07:22.288 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.234474+0000", 2023-10-08T07:07:22.288 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.033012860999999998, 2023-10-08T07:07:22.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033197600000000001, 2023-10-08T07:07:22.288 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.288 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.288 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.234474+0000", 2023-10-08T07:07:22.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.234474+0000", 2023-10-08T07:07:22.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.234474+0000", 2023-10-08T07:07:22.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6700000000000003e-07 2023-10-08T07:07:22.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.234488+0000", 2023-10-08T07:07:22.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3759e-05 2023-10-08T07:07:22.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.234497+0000", 2023-10-08T07:07:22.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8920000000000006e-06 2023-10-08T07:07:22.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.234503+0000", 2023-10-08T07:07:22.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2620000000000004e-06 2023-10-08T07:07:22.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236544+0000", 2023-10-08T07:07:22.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020407400000000001 2023-10-08T07:07:22.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236556+0000", 2023-10-08T07:07:22.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2327000000000001e-05 2023-10-08T07:07:22.292 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.292 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.293 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99481 4.f 4:f2537947:::10000000004.00000017:head [write 2277376~4096 in=4096b,write 2523136~4096 in=4096b,write 2588672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.293 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.248739+0000", 2023-10-08T07:07:22.293 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018747798999999999, 2023-10-08T07:07:22.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019023126000000001, 2023-10-08T07:07:22.293 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.293 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.294 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99481 2023-10-08T07:07:22.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.294 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248739+0000", 2023-10-08T07:07:22.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248739+0000", 2023-10-08T07:07:22.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248740+0000", 2023-10-08T07:07:22.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1179999999999999e-06 2023-10-08T07:07:22.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248751+0000", 2023-10-08T07:07:22.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0857e-05 2023-10-08T07:07:22.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248763+0000", 2023-10-08T07:07:22.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2445e-05 2023-10-08T07:07:22.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248770+0000", 2023-10-08T07:07:22.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1770000000000001e-06 2023-10-08T07:07:22.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250332+0000", 2023-10-08T07:07:22.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001562068 2023-10-08T07:07:22.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250414+0000", 2023-10-08T07:07:22.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1670999999999998e-05 2023-10-08T07:07:22.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.299 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.299 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99517 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.299 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.261977+0000", 2023-10-08T07:07:22.299 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0055098960000000002, 2023-10-08T07:07:22.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00585076, 2023-10-08T07:07:22.300 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.300 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.300 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99517 2023-10-08T07:07:22.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.300 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261977+0000", 2023-10-08T07:07:22.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261977+0000", 2023-10-08T07:07:22.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261977+0000", 2023-10-08T07:07:22.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.37e-07 2023-10-08T07:07:22.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261989+0000", 2023-10-08T07:07:22.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1758e-05 2023-10-08T07:07:22.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261999+0000", 2023-10-08T07:07:22.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0299000000000001e-05 2023-10-08T07:07:22.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262007+0000", 2023-10-08T07:07:22.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1890000000000001e-06 2023-10-08T07:07:22.304 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.304 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.304 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.304 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99398 4.20 e56/17 4:04004f2c:::10000000004.0000000d:head v 56'4667, mlcod=56'4663)", 2023-10-08T07:07:22.305 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.221319+0000", 2023-10-08T07:07:22.305 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.046167444000000002, 2023-10-08T07:07:22.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046575502999999997, 2023-10-08T07:07:22.305 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.305 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.305 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221319+0000", 2023-10-08T07:07:22.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221319+0000", 2023-10-08T07:07:22.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221319+0000", 2023-10-08T07:07:22.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0400000000000002e-07 2023-10-08T07:07:22.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221330+0000", 2023-10-08T07:07:22.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0151e-05 2023-10-08T07:07:22.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221339+0000", 2023-10-08T07:07:22.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.986e-06 2023-10-08T07:07:22.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221344+0000", 2023-10-08T07:07:22.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9989999999999999e-06 2023-10-08T07:07:22.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.223985+0000", 2023-10-08T07:07:22.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026417319999999999 2023-10-08T07:07:22.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.223998+0000", 2023-10-08T07:07:22.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3084e-05 2023-10-08T07:07:22.309 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.309 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.309 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99436 4.1a e56/17 4:5a59f83a:::10000000004.00000002:head v 56'1603, mlcod=56'1600)", 2023-10-08T07:07:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.234698+0000", 2023-10-08T07:07:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.032788006000000001, 2023-10-08T07:07:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033263431000000003, 2023-10-08T07:07:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.234698+0000", 2023-10-08T07:07:22.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.234698+0000", 2023-10-08T07:07:22.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.234699+0000", 2023-10-08T07:07:22.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.68e-07 2023-10-08T07:07:22.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.234714+0000", 2023-10-08T07:07:22.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4739999999999999e-05 2023-10-08T07:07:22.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.234720+0000", 2023-10-08T07:07:22.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5420000000000002e-06 2023-10-08T07:07:22.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.234726+0000", 2023-10-08T07:07:22.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9410000000000004e-06 2023-10-08T07:07:22.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.237680+0000", 2023-10-08T07:07:22.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002953804 2023-10-08T07:07:22.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.237699+0000", 2023-10-08T07:07:22.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9378999999999999e-05 2023-10-08T07:07:22.314 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.314 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.314 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.315 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99482 4.16 4:69eefec8:::10000000004.0000003a:head [write 4096~4096 in=4096b,write 20480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.315 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.249007+0000", 2023-10-08T07:07:22.315 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018479387999999999, 2023-10-08T07:07:22.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019025884, 2023-10-08T07:07:22.315 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.315 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:22.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.316 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99482 2023-10-08T07:07:22.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.316 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249007+0000", 2023-10-08T07:07:22.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249007+0000", 2023-10-08T07:07:22.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249008+0000", 2023-10-08T07:07:22.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2300000000000001e-07 2023-10-08T07:07:22.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249016+0000", 2023-10-08T07:07:22.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8800000000000008e-06 2023-10-08T07:07:22.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249025+0000", 2023-10-08T07:07:22.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9389999999999992e-06 2023-10-08T07:07:22.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249031+0000", 2023-10-08T07:07:22.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9089999999999997e-06 2023-10-08T07:07:22.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249069+0000", 2023-10-08T07:07:22.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8074000000000002e-05 2023-10-08T07:07:22.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249121+0000", 2023-10-08T07:07:22.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1235e-05 2023-10-08T07:07:22.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:22.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249204+0000", 2023-10-08T07:07:22.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3048999999999997e-05 2023-10-08T07:07:22.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256626+0000", 2023-10-08T07:07:22.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074226969999999998 2023-10-08T07:07:22.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.322 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.323 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99332 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.323 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.197495+0000", 2023-10-08T07:07:22.323 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.069991022999999999, 2023-10-08T07:07:22.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.070615483000000007, 2023-10-08T07:07:22.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.324 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99332 2023-10-08T07:07:22.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.324 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.197495+0000", 2023-10-08T07:07:22.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.197495+0000", 2023-10-08T07:07:22.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.197496+0000", 2023-10-08T07:07:22.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2799999999999995e-07 2023-10-08T07:07:22.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.197509+0000", 2023-10-08T07:07:22.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3046e-05 2023-10-08T07:07:22.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.197522+0000", 2023-10-08T07:07:22.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2672e-05 2023-10-08T07:07:22.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.197528+0000", 2023-10-08T07:07:22.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5720000000000002e-06 2023-10-08T07:07:22.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.327 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.327 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99384 4.1a e56/17 4:5a59f83a:::10000000004.00000002:head v 56'1602, mlcod=56'1600)", 2023-10-08T07:07:22.328 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.221354+0000", 2023-10-08T07:07:22.328 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.046132573000000003, 2023-10-08T07:07:22.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046814974000000002, 2023-10-08T07:07:22.328 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.328 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221354+0000", 2023-10-08T07:07:22.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221354+0000", 2023-10-08T07:07:22.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221354+0000", 2023-10-08T07:07:22.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.29e-07 2023-10-08T07:07:22.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221362+0000", 2023-10-08T07:07:22.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.926e-06 2023-10-08T07:07:22.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221367+0000", 2023-10-08T07:07:22.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.31e-06 2023-10-08T07:07:22.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221370+0000", 2023-10-08T07:07:22.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9000000000000002e-06 2023-10-08T07:07:22.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221411+0000", 2023-10-08T07:07:22.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1273999999999998e-05 2023-10-08T07:07:22.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.221438+0000", 2023-10-08T07:07:22.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6152e-05 2023-10-08T07:07:22.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.335 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.335 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99485 4.4 4:2158769a:::10000000004.0000002a:head [write 1056768~4096 in=4096b,write 1155072~4096 in=4096b,write 1241088~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.335 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.249794+0000", 2023-10-08T07:07:22.335 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.017692884999999998, 2023-10-08T07:07:22.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01843676, 2023-10-08T07:07:22.336 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.336 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.336 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99485 2023-10-08T07:07:22.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.336 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249794+0000", 2023-10-08T07:07:22.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249794+0000", 2023-10-08T07:07:22.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249794+0000", 2023-10-08T07:07:22.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2023-10-08T07:07:22.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249810+0000", 2023-10-08T07:07:22.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5359e-05 2023-10-08T07:07:22.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249818+0000", 2023-10-08T07:07:22.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7280000000000001e-06 2023-10-08T07:07:22.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.249823+0000", 2023-10-08T07:07:22.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1189999999999996e-06 2023-10-08T07:07:22.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255057+0000", 2023-10-08T07:07:22.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005234102 2023-10-08T07:07:22.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255146+0000", 2023-10-08T07:07:22.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8376999999999998e-05 2023-10-08T07:07:22.340 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.340 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.340 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.341 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99519 4.14 4:2b72a8af:::10000000004.0000000c:head [write 892928~4096 in=4096b,write 937984~4096 in=4096b,write 950272~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.341 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.262649+0000", 2023-10-08T07:07:22.341 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0048375450000000004, 2023-10-08T07:07:22.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056553860000000001, 2023-10-08T07:07:22.341 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.341 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.341 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.341 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.342 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99519 2023-10-08T07:07:22.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.342 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262649+0000", 2023-10-08T07:07:22.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262649+0000", 2023-10-08T07:07:22.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262650+0000", 2023-10-08T07:07:22.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9100000000000003e-07 2023-10-08T07:07:22.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262662+0000", 2023-10-08T07:07:22.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2064e-05 2023-10-08T07:07:22.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262671+0000", 2023-10-08T07:07:22.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1900000000000001e-06 2023-10-08T07:07:22.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262678+0000", 2023-10-08T07:07:22.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.973e-06 2023-10-08T07:07:22.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262956+0000", 2023-10-08T07:07:22.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00027762700000000002 2023-10-08T07:07:22.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263041+0000", 2023-10-08T07:07:22.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5123000000000005e-05 2023-10-08T07:07:22.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.346 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.346 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99440 4.29 4:94216392:::10000000004.0000002b:head [write 1019904~4096 in=4096b,write 1384448~4096 in=4096b,write 1478656~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.346 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.236056+0000", 2023-10-08T07:07:22.346 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.031430453999999997, 2023-10-08T07:07:22.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.032316433999999998, 2023-10-08T07:07:22.346 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.346 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:22.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.347 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99440 2023-10-08T07:07:22.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.347 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236056+0000", 2023-10-08T07:07:22.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236056+0000", 2023-10-08T07:07:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236057+0000", 2023-10-08T07:07:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.158e-06 2023-10-08T07:07:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236071+0000", 2023-10-08T07:07:22.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.381e-05 2023-10-08T07:07:22.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236083+0000", 2023-10-08T07:07:22.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2233e-05 2023-10-08T07:07:22.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236091+0000", 2023-10-08T07:07:22.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9750000000000007e-06 2023-10-08T07:07:22.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242008+0000", 2023-10-08T07:07:22.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059166219999999999 2023-10-08T07:07:22.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242092+0000", 2023-10-08T07:07:22.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3999999999999995e-05 2023-10-08T07:07:22.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:22.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242247+0000", 2023-10-08T07:07:22.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000155389 2023-10-08T07:07:22.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255755+0000", 2023-10-08T07:07:22.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013507729 2023-10-08T07:07:22.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.351 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.352 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99486 4.26 4:672c55ca:::10000000004.00000006:head [write 1294336~4096 in=4096b,write 1736704~4096 in=4096b,write 1957888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.352 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.250155+0000", 2023-10-08T07:07:22.352 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.017331261000000001, 2023-10-08T07:07:22.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018297587000000001, 2023-10-08T07:07:22.352 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.352 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:22.352 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.352 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.352 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.352 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99486 2023-10-08T07:07:22.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.353 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250155+0000", 2023-10-08T07:07:22.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250155+0000", 2023-10-08T07:07:22.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250156+0000", 2023-10-08T07:07:22.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1199999999999998e-07 2023-10-08T07:07:22.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250181+0000", 2023-10-08T07:07:22.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5279e-05 2023-10-08T07:07:22.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250188+0000", 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.08e-06 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250191+0000", 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5640000000000001e-06 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253916+0000", 2023-10-08T07:07:22.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037250059999999999 2023-10-08T07:07:22.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253993+0000", 2023-10-08T07:07:22.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6596999999999999e-05 2023-10-08T07:07:22.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:22.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254134+0000", 2023-10-08T07:07:22.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000141314 2023-10-08T07:07:22.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262168+0000", 2023-10-08T07:07:22.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080331619999999999 2023-10-08T07:07:22.357 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.357 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.357 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.357 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99520 4.15 4:aa4cb2c5:::10000000004.0000003c:head [write 1077248~4096 in=4096b,write 1114112~4096 in=4096b,write 1179648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.357 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.262989+0000", 2023-10-08T07:07:22.358 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0044978370000000002, 2023-10-08T07:07:22.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055439549999999997, 2023-10-08T07:07:22.358 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.358 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.358 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99520 2023-10-08T07:07:22.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.358 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262989+0000", 2023-10-08T07:07:22.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262989+0000", 2023-10-08T07:07:22.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262989+0000", 2023-10-08T07:07:22.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6899999999999996e-07 2023-10-08T07:07:22.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263003+0000", 2023-10-08T07:07:22.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3752e-05 2023-10-08T07:07:22.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263015+0000", 2023-10-08T07:07:22.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1413999999999999e-05 2023-10-08T07:07:22.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263022+0000", 2023-10-08T07:07:22.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.515e-06 2023-10-08T07:07:22.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263917+0000", 2023-10-08T07:07:22.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00089493600000000004 2023-10-08T07:07:22.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263988+0000", 2023-10-08T07:07:22.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0585000000000003e-05 2023-10-08T07:07:22.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.362 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.362 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99441 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.362 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.236105+0000", 2023-10-08T07:07:22.362 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.031381243000000003, 2023-10-08T07:07:22.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.032494359, 2023-10-08T07:07:22.363 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.363 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.363 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99441 2023-10-08T07:07:22.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.363 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236105+0000", 2023-10-08T07:07:22.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236105+0000", 2023-10-08T07:07:22.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236106+0000", 2023-10-08T07:07:22.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:07:22.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236116+0000", 2023-10-08T07:07:22.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0378e-05 2023-10-08T07:07:22.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236123+0000", 2023-10-08T07:07:22.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3329999999999999e-06 2023-10-08T07:07:22.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236130+0000", 2023-10-08T07:07:22.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4649999999999999e-06 2023-10-08T07:07:22.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.366 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.366 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99488 4.b 4:d0c991e0:::10000000004.0000002d:head [write 3399680~8192 in=8192b,write 3457024~4096 in=4096b,write 3534848~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.366 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.250792+0000", 2023-10-08T07:07:22.366 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016694074, 2023-10-08T07:07:22.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017865631999999999, 2023-10-08T07:07:22.367 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.367 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:22.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.367 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99488 2023-10-08T07:07:22.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250792+0000", 2023-10-08T07:07:22.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250792+0000", 2023-10-08T07:07:22.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250793+0000", 2023-10-08T07:07:22.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.61e-07 2023-10-08T07:07:22.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250821+0000", 2023-10-08T07:07:22.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7579000000000001e-05 2023-10-08T07:07:22.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250833+0000", 2023-10-08T07:07:22.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1875000000000001e-05 2023-10-08T07:07:22.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250840+0000", 2023-10-08T07:07:22.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0899999999999999e-06 2023-10-08T07:07:22.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.260150+0000", 2023-10-08T07:07:22.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0093102510000000003 2023-10-08T07:07:22.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.260228+0000", 2023-10-08T07:07:22.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7768999999999994e-05 2023-10-08T07:07:22.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:22.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.260374+0000", 2023-10-08T07:07:22.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014617100000000001 2023-10-08T07:07:22.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267558+0000", 2023-10-08T07:07:22.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071842130000000001 2023-10-08T07:07:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99514 4.1b e56/17 4:d97fb168:::10000000004.00000008:head v 56'3160, mlcod=56'3152)", 2023-10-08T07:07:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.263510+0000", 2023-10-08T07:07:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0039759829999999998, 2023-10-08T07:07:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052261240000000004, 2023-10-08T07:07:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263510+0000", 2023-10-08T07:07:22.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263510+0000", 2023-10-08T07:07:22.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263511+0000", 2023-10-08T07:07:22.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0900000000000001e-07 2023-10-08T07:07:22.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263524+0000", 2023-10-08T07:07:22.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2821e-05 2023-10-08T07:07:22.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263532+0000", 2023-10-08T07:07:22.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1370000000000002e-06 2023-10-08T07:07:22.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263540+0000", 2023-10-08T07:07:22.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7880000000000007e-06 2023-10-08T07:07:22.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265433+0000", 2023-10-08T07:07:22.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018935250000000001 2023-10-08T07:07:22.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265455+0000", 2023-10-08T07:07:22.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1189e-05 2023-10-08T07:07:22.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.376 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.377 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.377 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99483 4.20 e56/17 4:07572838:::10000000004.00000010:head v 56'4671, mlcod=56'4664)", 2023-10-08T07:07:22.377 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.250899+0000", 2023-10-08T07:07:22.377 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016587417, 2023-10-08T07:07:22.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017915238, 2023-10-08T07:07:22.377 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.377 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.377 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250899+0000", 2023-10-08T07:07:22.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250899+0000", 2023-10-08T07:07:22.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250900+0000", 2023-10-08T07:07:22.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2023-10-08T07:07:22.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250926+0000", 2023-10-08T07:07:22.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6341000000000001e-05 2023-10-08T07:07:22.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250938+0000", 2023-10-08T07:07:22.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2388999999999999e-05 2023-10-08T07:07:22.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250945+0000", 2023-10-08T07:07:22.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0949999999999998e-06 2023-10-08T07:07:22.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256791+0000", 2023-10-08T07:07:22.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058454179999999998 2023-10-08T07:07:22.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256808+0000", 2023-10-08T07:07:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6679000000000001e-05 2023-10-08T07:07:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99521 4.c e56/17 4:3352c333:::10000000004.00000012:head v 56'3150, mlcod=56'3147)", 2023-10-08T07:07:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.263795+0000", 2023-10-08T07:07:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0036917730000000002, 2023-10-08T07:07:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005081047, 2023-10-08T07:07:22.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.382 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.382 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263795+0000", 2023-10-08T07:07:22.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263795+0000", 2023-10-08T07:07:22.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263795+0000", 2023-10-08T07:07:22.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2023-10-08T07:07:22.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263821+0000", 2023-10-08T07:07:22.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6237999999999998e-05 2023-10-08T07:07:22.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263835+0000", 2023-10-08T07:07:22.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3475999999999999e-05 2023-10-08T07:07:22.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263841+0000", 2023-10-08T07:07:22.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3040000000000001e-06 2023-10-08T07:07:22.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263916+0000", 2023-10-08T07:07:22.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4734999999999995e-05 2023-10-08T07:07:22.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263928+0000", 2023-10-08T07:07:22.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1939999999999999e-05 2023-10-08T07:07:22.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.385 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.385 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99444 4.7 4:e2d089ed:::10000000004.00000033:head [write 3907584~4096 in=4096b,write 4128768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.386 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.236731+0000", 2023-10-08T07:07:22.386 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.030755375000000001, 2023-10-08T07:07:22.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.032185747000000001, 2023-10-08T07:07:22.386 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.386 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.386 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99444 2023-10-08T07:07:22.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.386 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236731+0000", 2023-10-08T07:07:22.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236731+0000", 2023-10-08T07:07:22.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236732+0000", 2023-10-08T07:07:22.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999999e-07 2023-10-08T07:07:22.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236741+0000", 2023-10-08T07:07:22.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6319999999999997e-06 2023-10-08T07:07:22.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236750+0000", 2023-10-08T07:07:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4520000000000003e-06 2023-10-08T07:07:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.236756+0000", 2023-10-08T07:07:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2790000000000004e-06 2023-10-08T07:07:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.240479+0000", 2023-10-08T07:07:22.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037231790000000001 2023-10-08T07:07:22.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.240554+0000", 2023-10-08T07:07:22.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4379000000000001e-05 2023-10-08T07:07:22.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.390 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.390 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99489 4.c e56/17 4:31e28161:::10000000004.00000011:head v 56'3149, mlcod=56'3145)", 2023-10-08T07:07:22.391 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.251565+0000", 2023-10-08T07:07:22.391 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.015920931999999999, 2023-10-08T07:07:22.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017435053999999998, 2023-10-08T07:07:22.391 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.391 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.391 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251565+0000", 2023-10-08T07:07:22.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251565+0000", 2023-10-08T07:07:22.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251566+0000", 2023-10-08T07:07:22.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0500000000000003e-07 2023-10-08T07:07:22.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251591+0000", 2023-10-08T07:07:22.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4510000000000001e-05 2023-10-08T07:07:22.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251602+0000", 2023-10-08T07:07:22.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1785e-05 2023-10-08T07:07:22.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251610+0000", 2023-10-08T07:07:22.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1369999999999996e-06 2023-10-08T07:07:22.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253392+0000", 2023-10-08T07:07:22.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017820609999999999 2023-10-08T07:07:22.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253412+0000", 2023-10-08T07:07:22.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0429e-05 2023-10-08T07:07:22.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.397 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.397 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99522 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.398 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.263852+0000", 2023-10-08T07:07:22.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003634488, 2023-10-08T07:07:22.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052117559999999997, 2023-10-08T07:07:22.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.398 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.399 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99522 2023-10-08T07:07:22.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.399 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263852+0000", 2023-10-08T07:07:22.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263852+0000", 2023-10-08T07:07:22.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263853+0000", 2023-10-08T07:07:22.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8800000000000001e-07 2023-10-08T07:07:22.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263864+0000", 2023-10-08T07:07:22.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1212e-05 2023-10-08T07:07:22.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263874+0000", 2023-10-08T07:07:22.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0345e-05 2023-10-08T07:07:22.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263882+0000", 2023-10-08T07:07:22.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6799999999999993e-06 2023-10-08T07:07:22.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.405 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.405 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99490 4.3a e56/17 4:5fb70c0f:::10000000004.0000002e:head v 56'4523, mlcod=56'4516)", 2023-10-08T07:07:22.405 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.251781+0000", 2023-10-08T07:07:22.406 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.015704976999999998, 2023-10-08T07:07:22.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017349222000000001, 2023-10-08T07:07:22.406 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.406 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.406 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251781+0000", 2023-10-08T07:07:22.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251781+0000", 2023-10-08T07:07:22.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251782+0000", 2023-10-08T07:07:22.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4700000000000001e-07 2023-10-08T07:07:22.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251795+0000", 2023-10-08T07:07:22.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2587e-05 2023-10-08T07:07:22.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251803+0000", 2023-10-08T07:07:22.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6389999999999998e-06 2023-10-08T07:07:22.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251809+0000", 2023-10-08T07:07:22.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7950000000000004e-06 2023-10-08T07:07:22.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257966+0000", 2023-10-08T07:07:22.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061570360000000003 2023-10-08T07:07:22.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257983+0000", 2023-10-08T07:07:22.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7402e-05 2023-10-08T07:07:22.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.412 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.413 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99523 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.413 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.264182+0000", 2023-10-08T07:07:22.413 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0033042670000000001, 2023-10-08T07:07:22.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050018019999999996, 2023-10-08T07:07:22.414 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.414 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.414 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99523 2023-10-08T07:07:22.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.415 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.264182+0000", 2023-10-08T07:07:22.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.264182+0000", 2023-10-08T07:07:22.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.264183+0000", 2023-10-08T07:07:22.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.44e-07 2023-10-08T07:07:22.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.264214+0000", 2023-10-08T07:07:22.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1523999999999998e-05 2023-10-08T07:07:22.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.264220+0000", 2023-10-08T07:07:22.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8150000000000002e-06 2023-10-08T07:07:22.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.264224+0000", 2023-10-08T07:07:22.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9450000000000003e-06 2023-10-08T07:07:22.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.418 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.418 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99407 4.20 e56/17 4:05b3915c:::10000000004.00000016:head v 56'4668, mlcod=56'4663)", 2023-10-08T07:07:22.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.224750+0000", 2023-10-08T07:07:22.418 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.042736629999999998, 2023-10-08T07:07:22.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.044467754999999998, 2023-10-08T07:07:22.418 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.418 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.419 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.224750+0000", 2023-10-08T07:07:22.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.224750+0000", 2023-10-08T07:07:22.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.224750+0000", 2023-10-08T07:07:22.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5499999999999999e-07 2023-10-08T07:07:22.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.224767+0000", 2023-10-08T07:07:22.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6784000000000001e-05 2023-10-08T07:07:22.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.224774+0000", 2023-10-08T07:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9439999999999999e-06 2023-10-08T07:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.224779+0000", 2023-10-08T07:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4650000000000002e-06 2023-10-08T07:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.237684+0000", 2023-10-08T07:07:22.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012905158 2023-10-08T07:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.237704+0000", 2023-10-08T07:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9899e-05 2023-10-08T07:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99492 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 3633152~4096 in=4096b,write 3682304~4096 in=4096b,write 3768320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.422 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.252182+0000", 2023-10-08T07:07:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.015304422999999999, 2023-10-08T07:07:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017073099000000001, 2023-10-08T07:07:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99492 2023-10-08T07:07:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252182+0000", 2023-10-08T07:07:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252182+0000", 2023-10-08T07:07:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252183+0000", 2023-10-08T07:07:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9000000000000005e-07 2023-10-08T07:07:22.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252195+0000", 2023-10-08T07:07:22.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2197e-05 2023-10-08T07:07:22.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252206+0000", 2023-10-08T07:07:22.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0404999999999999e-05 2023-10-08T07:07:22.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252213+0000", 2023-10-08T07:07:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7579999999999992e-06 2023-10-08T07:07:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252273+0000", 2023-10-08T07:07:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9250999999999999e-05 2023-10-08T07:07:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252398+0000", 2023-10-08T07:07:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000125217 2023-10-08T07:07:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99374 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.211188+0000", 2023-10-08T07:07:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.056298169000000002, 2023-10-08T07:07:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058109885999999999, 2023-10-08T07:07:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.428 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99374 2023-10-08T07:07:22.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.428 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211188+0000", 2023-10-08T07:07:22.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211188+0000", 2023-10-08T07:07:22.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211189+0000", 2023-10-08T07:07:22.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9399999999999993e-07 2023-10-08T07:07:22.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211222+0000", 2023-10-08T07:07:22.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2406000000000001e-05 2023-10-08T07:07:22.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211233+0000", 2023-10-08T07:07:22.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1786e-05 2023-10-08T07:07:22.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211242+0000", 2023-10-08T07:07:22.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4980000000000006e-06 2023-10-08T07:07:22.430 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.431 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.431 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99412 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.431 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.225028+0000", 2023-10-08T07:07:22.431 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.042458546, 2023-10-08T07:07:22.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.044300157, 2023-10-08T07:07:22.431 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.431 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.431 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99412 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.225028+0000", 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.225028+0000", 2023-10-08T07:07:22.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.225029+0000", 2023-10-08T07:07:22.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.47e-07 2023-10-08T07:07:22.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.225042+0000", 2023-10-08T07:07:22.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3292000000000001e-05 2023-10-08T07:07:22.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.225054+0000", 2023-10-08T07:07:22.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1479e-05 2023-10-08T07:07:22.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.225070+0000", 2023-10-08T07:07:22.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6307000000000002e-05 2023-10-08T07:07:22.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.434 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.435 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99493 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.435 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.252482+0000", 2023-10-08T07:07:22.435 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01500488, 2023-10-08T07:07:22.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016876072999999998, 2023-10-08T07:07:22.435 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.435 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.435 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99493 2023-10-08T07:07:22.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.436 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252482+0000", 2023-10-08T07:07:22.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252482+0000", 2023-10-08T07:07:22.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252482+0000", 2023-10-08T07:07:22.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8500000000000001e-07 2023-10-08T07:07:22.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252531+0000", 2023-10-08T07:07:22.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8746999999999999e-05 2023-10-08T07:07:22.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252542+0000", 2023-10-08T07:07:22.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1049999999999999e-05 2023-10-08T07:07:22.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.252549+0000", 2023-10-08T07:07:22.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7410000000000003e-06 2023-10-08T07:07:22.438 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.438 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.438 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.439 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99525 4.20 e56/17)", 2023-10-08T07:07:22.439 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.265185+0000", 2023-10-08T07:07:22.439 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0023012280000000002, 2023-10-08T07:07:22.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042074110000000003, 2023-10-08T07:07:22.439 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.439 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.439 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265185+0000", 2023-10-08T07:07:22.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265185+0000", 2023-10-08T07:07:22.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265186+0000", 2023-10-08T07:07:22.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4999999999999998e-07 2023-10-08T07:07:22.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265206+0000", 2023-10-08T07:07:22.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0313e-05 2023-10-08T07:07:22.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265213+0000", 2023-10-08T07:07:22.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2849999999999997e-06 2023-10-08T07:07:22.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265217+0000", 2023-10-08T07:07:22.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.895e-06 2023-10-08T07:07:22.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.442 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.442 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99375 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.442 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.211735+0000", 2023-10-08T07:07:22.442 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.055751800999999997, 2023-10-08T07:07:22.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057684243000000003, 2023-10-08T07:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99375 2023-10-08T07:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211735+0000", 2023-10-08T07:07:22.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211735+0000", 2023-10-08T07:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211735+0000", 2023-10-08T07:07:22.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6599999999999995e-07 2023-10-08T07:07:22.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211746+0000", 2023-10-08T07:07:22.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1100999999999999e-05 2023-10-08T07:07:22.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211756+0000", 2023-10-08T07:07:22.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5519999999999993e-06 2023-10-08T07:07:22.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211766+0000", 2023-10-08T07:07:22.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7690000000000008e-06 2023-10-08T07:07:22.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.446 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.446 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99376 4.4 4:2158769a:::10000000004.0000002a:head [write 3268608~4096 in=4096b,write 3661824~4096 in=4096b,write 3694592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.211890+0000", 2023-10-08T07:07:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.055596408999999999, 2023-10-08T07:07:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057561949000000001, 2023-10-08T07:07:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99376 2023-10-08T07:07:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211890+0000", 2023-10-08T07:07:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211890+0000", 2023-10-08T07:07:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211891+0000", 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9299999999999998e-07 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211899+0000", 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4009999999999997e-06 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211907+0000", 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1710000000000002e-06 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.211912+0000", 2023-10-08T07:07:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:07:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247070+0000", 2023-10-08T07:07:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.035157955999999997 2023-10-08T07:07:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247136+0000", 2023-10-08T07:07:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5372999999999999e-05 2023-10-08T07:07:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99411 4.30 e56/17 4:0f322a22:::10000000004.00000014:head v 56'1556, mlcod=56'1552)", 2023-10-08T07:07:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.225382+0000", 2023-10-08T07:07:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.042104075999999997, 2023-10-08T07:07:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.044108487000000002, 2023-10-08T07:07:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.225382+0000", 2023-10-08T07:07:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.225382+0000", 2023-10-08T07:07:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.225383+0000", 2023-10-08T07:07:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1300000000000001e-07 2023-10-08T07:07:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.225395+0000", 2023-10-08T07:07:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2218999999999999e-05 2023-10-08T07:07:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.225402+0000", 2023-10-08T07:07:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3640000000000001e-06 2023-10-08T07:07:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.225407+0000", 2023-10-08T07:07:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5040000000000004e-06 2023-10-08T07:07:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.235150+0000", 2023-10-08T07:07:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097428670000000005 2023-10-08T07:07:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.235167+0000", 2023-10-08T07:07:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6799999999999998e-05 2023-10-08T07:07:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99450 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.238930+0000", 2023-10-08T07:07:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.028556486999999998, 2023-10-08T07:07:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.030593236999999999, 2023-10-08T07:07:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99450 2023-10-08T07:07:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.238930+0000", 2023-10-08T07:07:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.238930+0000", 2023-10-08T07:07:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.238931+0000", 2023-10-08T07:07:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:07:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.238942+0000", 2023-10-08T07:07:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1437000000000001e-05 2023-10-08T07:07:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.238950+0000", 2023-10-08T07:07:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0630000000000006e-06 2023-10-08T07:07:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.238955+0000", 2023-10-08T07:07:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9860000000000002e-06 2023-10-08T07:07:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99528 4.11 4:8963efe6:::10000000004.00000009:head [write 1314816~4096 in=4096b,write 1449984~4096 in=4096b,write 1482752~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.265588+0000", 2023-10-08T07:07:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00189818, 2023-10-08T07:07:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039737540000000003, 2023-10-08T07:07:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99528 2023-10-08T07:07:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265588+0000", 2023-10-08T07:07:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265588+0000", 2023-10-08T07:07:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265589+0000", 2023-10-08T07:07:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0599999999999999e-07 2023-10-08T07:07:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265619+0000", 2023-10-08T07:07:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0193e-05 2023-10-08T07:07:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265629+0000", 2023-10-08T07:07:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4690000000000003e-06 2023-10-08T07:07:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265636+0000", 2023-10-08T07:07:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1439999999999997e-06 2023-10-08T07:07:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266233+0000", 2023-10-08T07:07:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00059696200000000004 2023-10-08T07:07:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266317+0000", 2023-10-08T07:07:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4456999999999995e-05 2023-10-08T07:07:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266494+0000", 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017666099999999999 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99416 4.3b 4:df82de1b:::10000000004.0000000f:head [write 2269184~4096 in=4096b,write 2375680~4096 in=4096b,write 2387968~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.226657+0000", 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.040829030000000002, 2023-10-08T07:07:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.042947671, 2023-10-08T07:07:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99416 2023-10-08T07:07:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.226657+0000", 2023-10-08T07:07:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.226657+0000", 2023-10-08T07:07:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.226658+0000", 2023-10-08T07:07:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1699999999999997e-07 2023-10-08T07:07:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.226670+0000", 2023-10-08T07:07:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2048000000000001e-05 2023-10-08T07:07:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.226686+0000", 2023-10-08T07:07:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5290000000000001e-05 2023-10-08T07:07:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.226694+0000", 2023-10-08T07:07:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9019999999999999e-06 2023-10-08T07:07:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.226742+0000", 2023-10-08T07:07:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8260000000000002e-05 2023-10-08T07:07:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.226837+0000", 2023-10-08T07:07:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5466999999999999e-05 2023-10-08T07:07:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99452 4.b 4:d0c991e0:::10000000004.0000002d:head [write 1429504~4096 in=4096b,write 1458176~4096 in=4096b,write 1503232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.239199+0000", 2023-10-08T07:07:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.028287802000000001, 2023-10-08T07:07:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.030445369, 2023-10-08T07:07:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99452 2023-10-08T07:07:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.239199+0000", 2023-10-08T07:07:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.239199+0000", 2023-10-08T07:07:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.239199+0000", 2023-10-08T07:07:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:07:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.239240+0000", 2023-10-08T07:07:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0604e-05 2023-10-08T07:07:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.239246+0000", 2023-10-08T07:07:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.477e-06 2023-10-08T07:07:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.239250+0000", 2023-10-08T07:07:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9949999999999999e-06 2023-10-08T07:07:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257668+0000", 2023-10-08T07:07:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018417874000000001 2023-10-08T07:07:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257745+0000", 2023-10-08T07:07:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6466999999999998e-05 2023-10-08T07:07:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257909+0000", 2023-10-08T07:07:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016447099999999999 2023-10-08T07:07:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267471+0000", 2023-10-08T07:07:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095616039999999996 2023-10-08T07:07:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99530 4.4 4:2158769a:::10000000004.0000002a:head [write 1916928~4096 in=4096b,write 1982464~4096 in=4096b,write 2048000~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.266406+0000", 2023-10-08T07:07:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001080164, 2023-10-08T07:07:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003283083, 2023-10-08T07:07:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99530 2023-10-08T07:07:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266406+0000", 2023-10-08T07:07:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266406+0000", 2023-10-08T07:07:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266407+0000", 2023-10-08T07:07:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6400000000000001e-07 2023-10-08T07:07:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266421+0000", 2023-10-08T07:07:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3532e-05 2023-10-08T07:07:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266434+0000", 2023-10-08T07:07:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3701e-05 2023-10-08T07:07:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266443+0000", 2023-10-08T07:07:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1890000000000007e-06 2023-10-08T07:07:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266492+0000", 2023-10-08T07:07:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9416999999999998e-05 2023-10-08T07:07:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266577+0000", 2023-10-08T07:07:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5086999999999994e-05 2023-10-08T07:07:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99345 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.202046+0000", 2023-10-08T07:07:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.065440654000000001, 2023-10-08T07:07:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067679212000000002, 2023-10-08T07:07:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99345 2023-10-08T07:07:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.202046+0000", 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.202046+0000", 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.202046+0000", 2023-10-08T07:07:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0500000000000003e-07 2023-10-08T07:07:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.202057+0000", 2023-10-08T07:07:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0713999999999999e-05 2023-10-08T07:07:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.202066+0000", 2023-10-08T07:07:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5820000000000002e-06 2023-10-08T07:07:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.202072+0000", 2023-10-08T07:07:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6610000000000003e-06 2023-10-08T07:07:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99456 4.37 4:efdd41ff:::10000000004.0000001c:head [write 2949120~4096 in=4096b,write 3051520~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.240399+0000", 2023-10-08T07:07:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.027087001999999999, 2023-10-08T07:07:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.029358232000000001, 2023-10-08T07:07:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99456 2023-10-08T07:07:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.240399+0000", 2023-10-08T07:07:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.240399+0000", 2023-10-08T07:07:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.240400+0000", 2023-10-08T07:07:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8700000000000004e-07 2023-10-08T07:07:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.240412+0000", 2023-10-08T07:07:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1472e-05 2023-10-08T07:07:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.240428+0000", 2023-10-08T07:07:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6052000000000001e-05 2023-10-08T07:07:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.240436+0000", 2023-10-08T07:07:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6449999999999994e-06 2023-10-08T07:07:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241912+0000", 2023-10-08T07:07:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001475999 2023-10-08T07:07:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241984+0000", 2023-10-08T07:07:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1663999999999997e-05 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99495 4.b 4:d0c991e0:::10000000004.0000002d:head [write 1691648~4096 in=4096b,write 1736704~4096 in=4096b,write 1826816~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.253125+0000", 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014361696, 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016672022000000002, 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99495 2023-10-08T07:07:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253125+0000", 2023-10-08T07:07:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253125+0000", 2023-10-08T07:07:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253125+0000", 2023-10-08T07:07:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:07:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253135+0000", 2023-10-08T07:07:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6190000000000006e-06 2023-10-08T07:07:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253145+0000", 2023-10-08T07:07:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0341e-05 2023-10-08T07:07:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253151+0000", 2023-10-08T07:07:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0079999999999999e-06 2023-10-08T07:07:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261921+0000", 2023-10-08T07:07:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087690919999999992 2023-10-08T07:07:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261999+0000", 2023-10-08T07:07:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8386000000000005e-05 2023-10-08T07:07:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.262175+0000", 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017593900000000001 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267579+0000", 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054038920000000004 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99529 4.2b e56/17 4:d7a77d67:::10000000004.00000029:head v 56'3130, mlcod=56'3126)", 2023-10-08T07:07:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.266592+0000", 2023-10-08T07:07:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00089443699999999999, 2023-10-08T07:07:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032519369999999999, 2023-10-08T07:07:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266592+0000", 2023-10-08T07:07:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266592+0000", 2023-10-08T07:07:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266593+0000", 2023-10-08T07:07:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4600000000000005e-07 2023-10-08T07:07:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266610+0000", 2023-10-08T07:07:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7348000000000001e-05 2023-10-08T07:07:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266619+0000", 2023-10-08T07:07:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6519999999999995e-06 2023-10-08T07:07:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266625+0000", 2023-10-08T07:07:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7259999999999996e-06 2023-10-08T07:07:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267680+0000", 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010548269999999999 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267698+0000", 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7467999999999999e-05 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99448 4.3a e56/17 4:5f183e4b:::10000000004.00000023:head v 56'4521, mlcod=56'4516)", 2023-10-08T07:07:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.241315+0000", 2023-10-08T07:07:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026171066999999999, 2023-10-08T07:07:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028561409999999999, 2023-10-08T07:07:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241315+0000", 2023-10-08T07:07:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241315+0000", 2023-10-08T07:07:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241316+0000", 2023-10-08T07:07:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9299999999999997e-07 2023-10-08T07:07:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241328+0000", 2023-10-08T07:07:22.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2135e-05 2023-10-08T07:07:22.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241336+0000", 2023-10-08T07:07:22.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6809999999999998e-06 2023-10-08T07:07:22.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241341+0000", 2023-10-08T07:07:22.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9849999999999997e-06 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.243175+0000", 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001834409 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.243194+0000", 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8689999999999999e-05 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99496 4.31 4:8de29a03:::10000000004.00000001:head [write 1916928~4096 in=4096b,write 1982464~4096 in=4096b,write 2105344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.253466+0000", 2023-10-08T07:07:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014020721999999999, 2023-10-08T07:07:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016447237, 2023-10-08T07:07:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99496 2023-10-08T07:07:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253466+0000", 2023-10-08T07:07:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253466+0000", 2023-10-08T07:07:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253467+0000", 2023-10-08T07:07:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4300000000000002e-07 2023-10-08T07:07:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253517+0000", 2023-10-08T07:07:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0767999999999999e-05 2023-10-08T07:07:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253528+0000", 2023-10-08T07:07:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0434999999999999e-05 2023-10-08T07:07:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253535+0000", 2023-10-08T07:07:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0520000000000004e-06 2023-10-08T07:07:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255809+0000", 2023-10-08T07:07:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022742040000000002 2023-10-08T07:07:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255855+0000", 2023-10-08T07:07:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6279000000000002e-05 2023-10-08T07:07:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255947+0000", 2023-10-08T07:07:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1303000000000003e-05 2023-10-08T07:07:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265567+0000", 2023-10-08T07:07:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0096205379999999997 2023-10-08T07:07:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99531 4.19 4:9a1dab10:::10000000004.0000001d:head [write 2813952~4096 in=4096b,write 2887680~4096 in=4096b,write 2912256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.266897+0000", 2023-10-08T07:07:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00058923999999999999, 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003061598, 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99531 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266897+0000", 2023-10-08T07:07:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266897+0000", 2023-10-08T07:07:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266898+0000", 2023-10-08T07:07:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7400000000000003e-07 2023-10-08T07:07:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266910+0000", 2023-10-08T07:07:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1936000000000001e-05 2023-10-08T07:07:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266919+0000", 2023-10-08T07:07:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3249999999999997e-06 2023-10-08T07:07:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266926+0000", 2023-10-08T07:07:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.703e-06 2023-10-08T07:07:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.266975+0000", 2023-10-08T07:07:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9356e-05 2023-10-08T07:07:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267065+0000", 2023-10-08T07:07:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9932999999999994e-05 2023-10-08T07:07:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99418 4.31 4:8de29a03:::10000000004.00000001:head [write 2400256~4096 in=4096b,write 2760704~4096 in=4096b,write 2801664~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.227570+0000", 2023-10-08T07:07:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.039916694000000003, 2023-10-08T07:07:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.042454611000000003, 2023-10-08T07:07:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99418 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.227570+0000", 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.227570+0000", 2023-10-08T07:07:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.227570+0000", 2023-10-08T07:07:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2023-10-08T07:07:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.227582+0000", 2023-10-08T07:07:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2068e-05 2023-10-08T07:07:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.227591+0000", 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8689999999999993e-06 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.227596+0000", 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.164e-06 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.237771+0000", 2023-10-08T07:07:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010174147999999999 2023-10-08T07:07:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.237844+0000", 2023-10-08T07:07:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3627999999999994e-05 2023-10-08T07:07:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.237986+0000", 2023-10-08T07:07:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000141729 2023-10-08T07:07:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248203+0000", 2023-10-08T07:07:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010216684 2023-10-08T07:07:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99459 4.9 4:90f7d93b:::10000000004.00000021:head [write 2125824~4096 in=4096b,write 2334720~4096 in=4096b,write 3051520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.241462+0000", 2023-10-08T07:07:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026024609000000001, 2023-10-08T07:07:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028632309000000002, 2023-10-08T07:07:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99459 2023-10-08T07:07:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241462+0000", 2023-10-08T07:07:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241462+0000", 2023-10-08T07:07:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241463+0000", 2023-10-08T07:07:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1999999999999998e-07 2023-10-08T07:07:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241471+0000", 2023-10-08T07:07:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4339999999999992e-06 2023-10-08T07:07:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241478+0000", 2023-10-08T07:07:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4540000000000004e-06 2023-10-08T07:07:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241481+0000", 2023-10-08T07:07:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9219999999999999e-06 2023-10-08T07:07:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248191+0000", 2023-10-08T07:07:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006709558 2023-10-08T07:07:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248276+0000", 2023-10-08T07:07:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4637999999999998e-05 2023-10-08T07:07:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99494 4.20 e56/17 4:07572838:::10000000004.00000010:head v 56'4672, mlcod=56'4664)", 2023-10-08T07:07:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.254336+0000", 2023-10-08T07:07:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013150887, 2023-10-08T07:07:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01579525, 2023-10-08T07:07:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254336+0000", 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254336+0000", 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254336+0000", 2023-10-08T07:07:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0999999999999999e-07 2023-10-08T07:07:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254347+0000", 2023-10-08T07:07:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1409e-05 2023-10-08T07:07:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254362+0000", 2023-10-08T07:07:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4134999999999999e-05 2023-10-08T07:07:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254368+0000", 2023-10-08T07:07:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8689999999999998e-06 2023-10-08T07:07:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259399+0000", 2023-10-08T07:07:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050309339999999999 2023-10-08T07:07:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259489+0000", 2023-10-08T07:07:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9338000000000004e-05 2023-10-08T07:07:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99460 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.241727+0000", 2023-10-08T07:07:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.025759433000000002, 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028436185999999999, 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99460 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241727+0000", 2023-10-08T07:07:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241727+0000", 2023-10-08T07:07:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241728+0000", 2023-10-08T07:07:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8700000000000005e-07 2023-10-08T07:07:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241738+0000", 2023-10-08T07:07:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0294e-05 2023-10-08T07:07:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241747+0000", 2023-10-08T07:07:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8060000000000001e-06 2023-10-08T07:07:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.241753+0000", 2023-10-08T07:07:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4150000000000004e-06 2023-10-08T07:07:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99497 4.30 e56/17 4:0f322a22:::10000000004.00000014:head v 56'1558, mlcod=56'1554)", 2023-10-08T07:07:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.254383+0000", 2023-10-08T07:07:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013103564, 2023-10-08T07:07:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015810175999999999, 2023-10-08T07:07:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254383+0000", 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254383+0000", 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254383+0000", 2023-10-08T07:07:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7000000000000001e-07 2023-10-08T07:07:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254391+0000", 2023-10-08T07:07:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5970000000000003e-06 2023-10-08T07:07:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254397+0000", 2023-10-08T07:07:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1129999999999997e-06 2023-10-08T07:07:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254400+0000", 2023-10-08T07:07:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0599999999999999e-06 2023-10-08T07:07:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258726+0000", 2023-10-08T07:07:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043256279999999998 2023-10-08T07:07:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258745+0000", 2023-10-08T07:07:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9340000000000001e-05 2023-10-08T07:07:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99420 4.3b 4:df0e4bf8:::10000000004.00000018:head [write 3248128~4096 in=4096b,write 3260416~4096 in=4096b,write 3530752~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.228312+0000", 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.039174358999999999, 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041916562999999997, 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99420 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.228312+0000", 2023-10-08T07:07:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.228312+0000", 2023-10-08T07:07:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.228313+0000", 2023-10-08T07:07:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2499999999999995e-07 2023-10-08T07:07:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.228326+0000", 2023-10-08T07:07:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2962999999999999e-05 2023-10-08T07:07:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.228331+0000", 2023-10-08T07:07:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3770000000000004e-06 2023-10-08T07:07:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.228334+0000", 2023-10-08T07:07:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4230000000000001e-06 2023-10-08T07:07:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251769+0000", 2023-10-08T07:07:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023434257999999999 2023-10-08T07:07:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251843+0000", 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4315999999999998e-05 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99461 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.242010+0000", 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.025476345000000001, 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028253666, 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99461 2023-10-08T07:07:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242010+0000", 2023-10-08T07:07:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242010+0000", 2023-10-08T07:07:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242011+0000", 2023-10-08T07:07:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3799999999999996e-07 2023-10-08T07:07:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242024+0000", 2023-10-08T07:07:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3461e-05 2023-10-08T07:07:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242035+0000", 2023-10-08T07:07:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0229e-05 2023-10-08T07:07:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242042+0000", 2023-10-08T07:07:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2590000000000003e-06 2023-10-08T07:07:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99500 4.19 4:9b26afe3:::10000000004.00000005:head [write 770048~4096 in=4096b,write 1150976~4096 in=4096b,write 1167360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.255139+0000", 2023-10-08T07:07:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012347235, 2023-10-08T07:07:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015161358, 2023-10-08T07:07:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99500 2023-10-08T07:07:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255139+0000", 2023-10-08T07:07:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255139+0000", 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255140+0000", 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4e-07 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255152+0000", 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1657999999999999e-05 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255163+0000", 2023-10-08T07:07:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0817e-05 2023-10-08T07:07:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255170+0000", 2023-10-08T07:07:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5310000000000004e-06 2023-10-08T07:07:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257543+0000", 2023-10-08T07:07:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023727869999999999 2023-10-08T07:07:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257623+0000", 2023-10-08T07:07:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0536000000000003e-05 2023-10-08T07:07:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99532 4.b 4.789930b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.267200+0000", 2023-10-08T07:07:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00028651600000000001, 2023-10-08T07:07:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003136074, 2023-10-08T07:07:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99532 2023-10-08T07:07:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267200+0000", 2023-10-08T07:07:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267200+0000", 2023-10-08T07:07:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267201+0000", 2023-10-08T07:07:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.71e-07 2023-10-08T07:07:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267214+0000", 2023-10-08T07:07:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3594999999999999e-05 2023-10-08T07:07:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267225+0000", 2023-10-08T07:07:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0173999999999999e-05 2023-10-08T07:07:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267231+0000", 2023-10-08T07:07:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8730000000000001e-06 2023-10-08T07:07:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99414 4.20 e56/17 4:07572838:::10000000004.00000010:head v 56'4669, mlcod=56'4663)", 2023-10-08T07:07:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.228327+0000", 2023-10-08T07:07:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.039159715999999997, 2023-10-08T07:07:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.042039273000000002, 2023-10-08T07:07:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.228327+0000", 2023-10-08T07:07:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.228327+0000", 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.228327+0000", 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.228342+0000", 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4669e-05 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.228356+0000", 2023-10-08T07:07:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4153e-05 2023-10-08T07:07:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.228365+0000", 2023-10-08T07:07:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9139999999999997e-06 2023-10-08T07:07:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.245406+0000", 2023-10-08T07:07:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017040784999999999 2023-10-08T07:07:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.245420+0000", 2023-10-08T07:07:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3584000000000001e-05 2023-10-08T07:07:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99455 4.2b e56/17 4:d7a77d67:::10000000004.00000029:head v 56'3129, mlcod=56'3125)", 2023-10-08T07:07:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.242130+0000", 2023-10-08T07:07:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.025356200999999998, 2023-10-08T07:07:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028268390000000001, 2023-10-08T07:07:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242130+0000", 2023-10-08T07:07:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242130+0000", 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242131+0000", 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242146+0000", 2023-10-08T07:07:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5379e-05 2023-10-08T07:07:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242153+0000", 2023-10-08T07:07:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3379999999999999e-06 2023-10-08T07:07:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242159+0000", 2023-10-08T07:07:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3600000000000004e-06 2023-10-08T07:07:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.243873+0000", 2023-10-08T07:07:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00171408 2023-10-08T07:07:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.243891+0000", 2023-10-08T07:07:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7995e-05 2023-10-08T07:07:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99533 4.3b 4.1fd270fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.267663+0000", 2023-10-08T07:07:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999824, 2023-10-08T07:07:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027693790000000002, 2023-10-08T07:07:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99533 2023-10-08T07:07:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267663+0000", 2023-10-08T07:07:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267663+0000", 2023-10-08T07:07:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267663+0000", 2023-10-08T07:07:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7100000000000001e-07 2023-10-08T07:07:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267674+0000", 2023-10-08T07:07:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1133e-05 2023-10-08T07:07:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267685+0000", 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0740000000000001e-05 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267693+0000", 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7230000000000004e-06 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99457 4.1b e56/17 4:d97fb168:::10000000004.00000008:head v 56'3156, mlcod=56'3151)", 2023-10-08T07:07:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.242175+0000", 2023-10-08T07:07:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.025311368000000001, 2023-10-08T07:07:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028306805000000001, 2023-10-08T07:07:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242175+0000", 2023-10-08T07:07:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242175+0000", 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242175+0000", 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5800000000000001e-07 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242185+0000", 2023-10-08T07:07:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9240000000000002e-06 2023-10-08T07:07:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242191+0000", 2023-10-08T07:07:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8950000000000003e-06 2023-10-08T07:07:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242196+0000", 2023-10-08T07:07:22.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6700000000000002e-06 2023-10-08T07:07:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244818+0000", 2023-10-08T07:07:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026225789999999999 2023-10-08T07:07:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244835+0000", 2023-10-08T07:07:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6952e-05 2023-10-08T07:07:22.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99501 4.3a e56/17 4:5fb70c0f:::10000000004.0000002e:head v 56'4524, mlcod=56'4516)", 2023-10-08T07:07:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.256095+0000", 2023-10-08T07:07:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011391411000000001, 2023-10-08T07:07:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014466740000000001, 2023-10-08T07:07:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256095+0000", 2023-10-08T07:07:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256095+0000", 2023-10-08T07:07:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256096+0000", 2023-10-08T07:07:22.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9100000000000004e-07 2023-10-08T07:07:22.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256109+0000", 2023-10-08T07:07:22.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3764000000000001e-05 2023-10-08T07:07:22.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256118+0000", 2023-10-08T07:07:22.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5339999999999999e-06 2023-10-08T07:07:22.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256124+0000", 2023-10-08T07:07:22.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2219999999999999e-06 2023-10-08T07:07:22.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265771+0000", 2023-10-08T07:07:22.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0096464519999999998 2023-10-08T07:07:22.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265789+0000", 2023-10-08T07:07:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8059000000000001e-05 2023-10-08T07:07:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99534 4.7 4:e2479c46:::10000000004.00000024:head [write 2093056~4096 in=4096b,write 2146304~4096 in=4096b,write 2256896~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.267847+0000", 2023-10-08T07:07:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.99964, 2023-10-08T07:07:22.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002758431, 2023-10-08T07:07:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99534 2023-10-08T07:07:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267847+0000", 2023-10-08T07:07:22.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267847+0000", 2023-10-08T07:07:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267847+0000", 2023-10-08T07:07:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267859+0000", 2023-10-08T07:07:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1579e-05 2023-10-08T07:07:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267870+0000", 2023-10-08T07:07:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1093e-05 2023-10-08T07:07:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267877+0000", 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3459999999999996e-06 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268834+0000", 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095622899999999995 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268895+0000", 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0946000000000002e-05 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.576 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99463 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.242892+0000", 2023-10-08T07:07:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.024594063999999999, 2023-10-08T07:07:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.027762411000000001, 2023-10-08T07:07:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99463 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242892+0000", 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242892+0000", 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242893+0000", 2023-10-08T07:07:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3399999999999997e-07 2023-10-08T07:07:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242905+0000", 2023-10-08T07:07:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2167999999999999e-05 2023-10-08T07:07:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242917+0000", 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1724e-05 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.242925+0000", 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9100000000000005e-06 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.580 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99502 4.b 4:d0c991e0:::10000000004.0000002d:head [write 598016~4096 in=4096b,write 708608~4096 in=4096b,write 782336~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.256192+0000", 2023-10-08T07:07:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011294502, 2023-10-08T07:07:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014526288, 2023-10-08T07:07:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99502 2023-10-08T07:07:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256192+0000", 2023-10-08T07:07:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256192+0000", 2023-10-08T07:07:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256193+0000", 2023-10-08T07:07:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0500000000000003e-07 2023-10-08T07:07:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256204+0000", 2023-10-08T07:07:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1073999999999999e-05 2023-10-08T07:07:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256215+0000", 2023-10-08T07:07:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1248e-05 2023-10-08T07:07:22.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256221+0000", 2023-10-08T07:07:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9920000000000004e-06 2023-10-08T07:07:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267597+0000", 2023-10-08T07:07:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011376511000000001 2023-10-08T07:07:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267672+0000", 2023-10-08T07:07:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4394000000000006e-05 2023-10-08T07:07:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.267824+0000", 2023-10-08T07:07:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015248400000000001 2023-10-08T07:07:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4556.0:99505 4.31 e56/48)", 2023-10-08T07:07:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.268096+0000", 2023-10-08T07:07:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9993906, 2023-10-08T07:07:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002694087, 2023-10-08T07:07:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268096+0000", 2023-10-08T07:07:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268096+0000", 2023-10-08T07:07:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268096+0000", 2023-10-08T07:07:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0999999999999999e-07 2023-10-08T07:07:22.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268099+0000", 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.932e-06 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268111+0000", 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1559000000000001e-05 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268117+0000", 2023-10-08T07:07:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4080000000000003e-06 2023-10-08T07:07:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99421 4.3a e56/17 4:5fb70c0f:::10000000004.0000002e:head v 56'4519, mlcod=56'4516)", 2023-10-08T07:07:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.229056+0000", 2023-10-08T07:07:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.038430644999999999, 2023-10-08T07:07:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041784250000000002, 2023-10-08T07:07:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229056+0000", 2023-10-08T07:07:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229056+0000", 2023-10-08T07:07:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229056+0000", 2023-10-08T07:07:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9999999999999997e-07 2023-10-08T07:07:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229070+0000", 2023-10-08T07:07:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3166999999999999e-05 2023-10-08T07:07:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229082+0000", 2023-10-08T07:07:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2761e-05 2023-10-08T07:07:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229090+0000", 2023-10-08T07:07:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2899999999999997e-06 2023-10-08T07:07:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229137+0000", 2023-10-08T07:07:22.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7055999999999998e-05 2023-10-08T07:07:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229152+0000", 2023-10-08T07:07:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5797000000000001e-05 2023-10-08T07:07:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99464 4.37 4:efdd41ff:::10000000004.0000001c:head [write 20480~4096 in=4096b,write 86016~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.593 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.243006+0000", 2023-10-08T07:07:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.024480294999999999, 2023-10-08T07:07:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.027884498000000001, 2023-10-08T07:07:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99464 2023-10-08T07:07:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.594 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.243006+0000", 2023-10-08T07:07:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.243006+0000", 2023-10-08T07:07:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.243007+0000", 2023-10-08T07:07:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3200000000000004e-07 2023-10-08T07:07:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.243018+0000", 2023-10-08T07:07:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0652000000000001e-05 2023-10-08T07:07:22.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.243029+0000", 2023-10-08T07:07:22.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1749999999999999e-05 2023-10-08T07:07:22.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.243037+0000", 2023-10-08T07:07:22.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2359999999999998e-06 2023-10-08T07:07:22.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250335+0000", 2023-10-08T07:07:22.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0072981640000000002 2023-10-08T07:07:22.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.250383+0000", 2023-10-08T07:07:22.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8331999999999997e-05 2023-10-08T07:07:22.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.600 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.601 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99535 4.21 4.5d9f5e61 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.601 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.268782+0000", 2023-10-08T07:07:22.601 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9987049, 2023-10-08T07:07:22.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021486880000000002, 2023-10-08T07:07:22.601 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.601 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.601 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.601 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.601 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.601 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99535 2023-10-08T07:07:22.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.602 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268782+0000", 2023-10-08T07:07:22.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268782+0000", 2023-10-08T07:07:22.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268782+0000", 2023-10-08T07:07:22.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8199999999999999e-07 2023-10-08T07:07:22.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268793+0000", 2023-10-08T07:07:22.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0828e-05 2023-10-08T07:07:22.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268802+0000", 2023-10-08T07:07:22.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1640000000000007e-06 2023-10-08T07:07:22.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268809+0000", 2023-10-08T07:07:22.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9500000000000004e-06 2023-10-08T07:07:22.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.604 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.605 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99422 4.15 4:a88808fa:::10000000004.0000001f:head [write 1048576~4096 in=4096b,write 1077248~4096 in=4096b,write 1101824~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.605 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.229096+0000", 2023-10-08T07:07:22.605 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.038390483000000003, 2023-10-08T07:07:22.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041898659999999997, 2023-10-08T07:07:22.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.605 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.606 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99422 2023-10-08T07:07:22.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.606 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229096+0000", 2023-10-08T07:07:22.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229096+0000", 2023-10-08T07:07:22.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229096+0000", 2023-10-08T07:07:22.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6699999999999999e-07 2023-10-08T07:07:22.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229103+0000", 2023-10-08T07:07:22.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9240000000000001e-06 2023-10-08T07:07:22.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229114+0000", 2023-10-08T07:07:22.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0679000000000001e-05 2023-10-08T07:07:22.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.229118+0000", 2023-10-08T07:07:22.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1829999999999996e-06 2023-10-08T07:07:22.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.237335+0000", 2023-10-08T07:07:22.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082165039999999995 2023-10-08T07:07:22.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.237424+0000", 2023-10-08T07:07:22.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9685999999999995e-05 2023-10-08T07:07:22.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.609 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.610 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99466 4.30 e56/17 4:0f322a22:::10000000004.00000014:head v 56'1557, mlcod=56'1552)", 2023-10-08T07:07:22.610 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.244051+0000", 2023-10-08T07:07:22.610 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.023435099000000001, 2023-10-08T07:07:22.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.027018275000000001, 2023-10-08T07:07:22.610 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.610 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.610 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244051+0000", 2023-10-08T07:07:22.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244051+0000", 2023-10-08T07:07:22.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244052+0000", 2023-10-08T07:07:22.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7899999999999998e-07 2023-10-08T07:07:22.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244065+0000", 2023-10-08T07:07:22.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2842e-05 2023-10-08T07:07:22.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244074+0000", 2023-10-08T07:07:22.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.918e-06 2023-10-08T07:07:22.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244080+0000", 2023-10-08T07:07:22.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5849999999999996e-06 2023-10-08T07:07:22.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251438+0000", 2023-10-08T07:07:22.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073579700000000001 2023-10-08T07:07:22.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251453+0000", 2023-10-08T07:07:22.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4701e-05 2023-10-08T07:07:22.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.614 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.614 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99499 4.20 e56/17 4:04004f2c:::10000000004.0000000d:head v 56'4673, mlcod=56'4664)", 2023-10-08T07:07:22.614 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.256756+0000", 2023-10-08T07:07:22.614 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.010730316, 2023-10-08T07:07:22.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014383320999999999, 2023-10-08T07:07:22.614 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.614 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.614 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256756+0000", 2023-10-08T07:07:22.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256756+0000", 2023-10-08T07:07:22.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256757+0000", 2023-10-08T07:07:22.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0200000000000003e-07 2023-10-08T07:07:22.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256770+0000", 2023-10-08T07:07:22.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.378e-05 2023-10-08T07:07:22.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256779+0000", 2023-10-08T07:07:22.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3939999999999996e-06 2023-10-08T07:07:22.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256784+0000", 2023-10-08T07:07:22.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0440000000000003e-06 2023-10-08T07:07:22.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.269087+0000", 2023-10-08T07:07:22.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012303677000000001 2023-10-08T07:07:22.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.269104+0000", 2023-10-08T07:07:22.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6116e-05 2023-10-08T07:07:22.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.618 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.618 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99536 4.7 4.6239e247 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.618 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.268820+0000", 2023-10-08T07:07:22.619 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9986658, 2023-10-08T07:07:22.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024122660000000001, 2023-10-08T07:07:22.619 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.619 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.619 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99536 2023-10-08T07:07:22.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.619 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268820+0000", 2023-10-08T07:07:22.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268820+0000", 2023-10-08T07:07:22.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268821+0000", 2023-10-08T07:07:22.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8599999999999998e-07 2023-10-08T07:07:22.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268831+0000", 2023-10-08T07:07:22.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7359999999999996e-06 2023-10-08T07:07:22.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268838+0000", 2023-10-08T07:07:22.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2559999999999996e-06 2023-10-08T07:07:22.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268844+0000", 2023-10-08T07:07:22.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7250000000000002e-06 2023-10-08T07:07:22.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.622 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.622 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99505 4.31 4:8de29a03:::10000000004.00000001:head [write 512000~8192 in=8192b,write 876544~4096 in=4096b,write 962560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.623 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.257339+0000", 2023-10-08T07:07:22.623 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.010146984, 2023-10-08T07:07:22.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013971536999999999, 2023-10-08T07:07:22.623 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.623 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:22.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.623 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99505 2023-10-08T07:07:22.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.623 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257339+0000", 2023-10-08T07:07:22.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257339+0000", 2023-10-08T07:07:22.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257340+0000", 2023-10-08T07:07:22.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012e-06 2023-10-08T07:07:22.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257355+0000", 2023-10-08T07:07:22.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4517e-05 2023-10-08T07:07:22.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257368+0000", 2023-10-08T07:07:22.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3351e-05 2023-10-08T07:07:22.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.257376+0000", 2023-10-08T07:07:22.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5429999999999996e-06 2023-10-08T07:07:22.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261392+0000", 2023-10-08T07:07:22.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040164839999999999 2023-10-08T07:07:22.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261477+0000", 2023-10-08T07:07:22.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5148999999999994e-05 2023-10-08T07:07:22.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:22.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261639+0000", 2023-10-08T07:07:22.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000161058 2023-10-08T07:07:22.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270848+0000", 2023-10-08T07:07:22.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092090680000000008 2023-10-08T07:07:22.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.628 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.628 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99537 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.628 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.268984+0000", 2023-10-08T07:07:22.628 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9985027, 2023-10-08T07:07:22.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024348619999999999, 2023-10-08T07:07:22.629 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.629 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.629 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99537 2023-10-08T07:07:22.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.629 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268984+0000", 2023-10-08T07:07:22.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268984+0000", 2023-10-08T07:07:22.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268985+0000", 2023-10-08T07:07:22.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9100000000000003e-07 2023-10-08T07:07:22.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.268997+0000", 2023-10-08T07:07:22.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2838e-05 2023-10-08T07:07:22.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.269007+0000", 2023-10-08T07:07:22.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7219999999999994e-06 2023-10-08T07:07:22.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.269014+0000", 2023-10-08T07:07:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.742e-06 2023-10-08T07:07:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99425 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.230084+0000", 2023-10-08T07:07:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.037402311000000001, 2023-10-08T07:07:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041400131999999999, 2023-10-08T07:07:22.632 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99425 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.230084+0000", 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.230084+0000", 2023-10-08T07:07:22.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.230085+0000", 2023-10-08T07:07:22.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4900000000000005e-07 2023-10-08T07:07:22.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.230095+0000", 2023-10-08T07:07:22.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9369999999999999e-06 2023-10-08T07:07:22.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.230107+0000", 2023-10-08T07:07:22.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.219e-05 2023-10-08T07:07:22.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.230113+0000", 2023-10-08T07:07:22.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.083e-06 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99467 4.3a e56/17 4:5fb70c0f:::10000000004.0000002e:head v 56'4522, mlcod=56'4516)", 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.244304+0000", 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.023182115, 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.027241887999999999, 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244304+0000", 2023-10-08T07:07:22.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244304+0000", 2023-10-08T07:07:22.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244305+0000", 2023-10-08T07:07:22.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4499999999999997e-07 2023-10-08T07:07:22.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244315+0000", 2023-10-08T07:07:22.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0244999999999999e-05 2023-10-08T07:07:22.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244323+0000", 2023-10-08T07:07:22.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0930000000000003e-06 2023-10-08T07:07:22.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244329+0000", 2023-10-08T07:07:22.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7459999999999997e-06 2023-10-08T07:07:22.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251858+0000", 2023-10-08T07:07:22.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075290499999999998 2023-10-08T07:07:22.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251884+0000", 2023-10-08T07:07:22.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6013999999999999e-05 2023-10-08T07:07:22.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.640 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.640 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99506 4.1b e56/17 4:d97fb168:::10000000004.00000008:head v 56'3158, mlcod=56'3151)", 2023-10-08T07:07:22.640 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.258168+0000", 2023-10-08T07:07:22.640 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.009318916, 2023-10-08T07:07:22.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013447417999999999, 2023-10-08T07:07:22.640 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.641 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.641 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258168+0000", 2023-10-08T07:07:22.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258168+0000", 2023-10-08T07:07:22.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258168+0000", 2023-10-08T07:07:22.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:07:22.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258198+0000", 2023-10-08T07:07:22.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9906000000000001e-05 2023-10-08T07:07:22.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258208+0000", 2023-10-08T07:07:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0074e-05 2023-10-08T07:07:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258214+0000", 2023-10-08T07:07:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1789999999999996e-06 2023-10-08T07:07:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.260131+0000", 2023-10-08T07:07:22.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019164200000000001 2023-10-08T07:07:22.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.260143+0000", 2023-10-08T07:07:22.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2191999999999999e-05 2023-10-08T07:07:22.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.644 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.644 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99469 4.38 e56/46 4:1e0977c7:::10000000004.00000022:head v 56'1572, mlcod=56'1569)", 2023-10-08T07:07:22.644 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.244968+0000", 2023-10-08T07:07:22.645 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.022518486000000001, 2023-10-08T07:07:22.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026715205999999998, 2023-10-08T07:07:22.645 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.645 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.645 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244968+0000", 2023-10-08T07:07:22.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244968+0000", 2023-10-08T07:07:22.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244969+0000", 2023-10-08T07:07:22.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0399999999999996e-07 2023-10-08T07:07:22.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244982+0000", 2023-10-08T07:07:22.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3489000000000001e-05 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244991+0000", 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.38e-06 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.244998+0000", 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7789999999999998e-06 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251829+0000", 2023-10-08T07:07:22.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068312169999999997 2023-10-08T07:07:22.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.251847+0000", 2023-10-08T07:07:22.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7737999999999999e-05 2023-10-08T07:07:22.648 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.648 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.648 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.649 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99508 4.3f 4:fc9a2d79:::10000000004.0000002f:head [write 483328~4096 in=4096b,write 733184~4096 in=4096b,write 823296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.649 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.258334+0000", 2023-10-08T07:07:22.649 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0091520239999999999, 2023-10-08T07:07:22.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0134261, 2023-10-08T07:07:22.649 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.649 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.649 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.649 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.649 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.649 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99508 2023-10-08T07:07:22.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.650 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258334+0000", 2023-10-08T07:07:22.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258334+0000", 2023-10-08T07:07:22.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258335+0000", 2023-10-08T07:07:22.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9500000000000001e-07 2023-10-08T07:07:22.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258346+0000", 2023-10-08T07:07:22.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1189000000000001e-05 2023-10-08T07:07:22.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258359+0000", 2023-10-08T07:07:22.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2439000000000001e-05 2023-10-08T07:07:22.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258365+0000", 2023-10-08T07:07:22.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.426e-06 2023-10-08T07:07:22.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258444+0000", 2023-10-08T07:07:22.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8724e-05 2023-10-08T07:07:22.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.258525+0000", 2023-10-08T07:07:22.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1471999999999995e-05 2023-10-08T07:07:22.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.653 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.654 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99538 4.20 e56/17)", 2023-10-08T07:07:22.654 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.269796+0000", 2023-10-08T07:07:22.654 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9976902, 2023-10-08T07:07:22.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002034292, 2023-10-08T07:07:22.654 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.654 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.654 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.269796+0000", 2023-10-08T07:07:22.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.269796+0000", 2023-10-08T07:07:22.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.269796+0000", 2023-10-08T07:07:22.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6600000000000002e-07 2023-10-08T07:07:22.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.269808+0000", 2023-10-08T07:07:22.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1171e-05 2023-10-08T07:07:22.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.269814+0000", 2023-10-08T07:07:22.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8369999999999999e-06 2023-10-08T07:07:22.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.269818+0000", 2023-10-08T07:07:22.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6059999999999999e-06 2023-10-08T07:07:22.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.657 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.657 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99424 4.38 e56/46 4:1e0977c7:::10000000004.00000022:head v 56'1571, mlcod=56'1569)", 2023-10-08T07:07:22.658 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.230833+0000", 2023-10-08T07:07:22.658 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.036653487999999998, 2023-10-08T07:07:22.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041050590999999997, 2023-10-08T07:07:22.658 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.658 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.658 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.230833+0000", 2023-10-08T07:07:22.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.230833+0000", 2023-10-08T07:07:22.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.230834+0000", 2023-10-08T07:07:22.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6599999999999995e-07 2023-10-08T07:07:22.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.230850+0000", 2023-10-08T07:07:22.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6223e-05 2023-10-08T07:07:22.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.230864+0000", 2023-10-08T07:07:22.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4209000000000001e-05 2023-10-08T07:07:22.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.230874+0000", 2023-10-08T07:07:22.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7729999999999994e-06 2023-10-08T07:07:22.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.245660+0000", 2023-10-08T07:07:22.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014785613 2023-10-08T07:07:22.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.245680+0000", 2023-10-08T07:07:22.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0363000000000001e-05 2023-10-08T07:07:22.662 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.662 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.662 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.662 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99510 4.a e56/17 4:524fba76:::10000000004.0000001b:head v 56'1555, mlcod=56'1552)", 2023-10-08T07:07:22.662 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.259406+0000", 2023-10-08T07:07:22.662 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0080805830000000006, 2023-10-08T07:07:22.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012541251, 2023-10-08T07:07:22.662 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.663 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.663 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259406+0000", 2023-10-08T07:07:22.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259406+0000", 2023-10-08T07:07:22.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259406+0000", 2023-10-08T07:07:22.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1999999999999999e-07 2023-10-08T07:07:22.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259457+0000", 2023-10-08T07:07:22.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0427999999999999e-05 2023-10-08T07:07:22.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259465+0000", 2023-10-08T07:07:22.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2023-10-08T07:07:22.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259471+0000", 2023-10-08T07:07:22.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2299999999999996e-06 2023-10-08T07:07:22.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265682+0000", 2023-10-08T07:07:22.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062105219999999996 2023-10-08T07:07:22.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.265701+0000", 2023-10-08T07:07:22.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8782000000000001e-05 2023-10-08T07:07:22.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.666 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99539 4.3f 4.9eb4593f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.270011+0000", 2023-10-08T07:07:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9974756, 2023-10-08T07:07:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020016830000000002, 2023-10-08T07:07:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99539 2023-10-08T07:07:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270011+0000", 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270011+0000", 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270012+0000", 2023-10-08T07:07:22.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1999999999999998e-07 2023-10-08T07:07:22.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270025+0000", 2023-10-08T07:07:22.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3081999999999999e-05 2023-10-08T07:07:22.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270036+0000", 2023-10-08T07:07:22.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1633e-05 2023-10-08T07:07:22.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270044+0000", 2023-10-08T07:07:22.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.323e-06 2023-10-08T07:07:22.670 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.670 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.670 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.670 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99365 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.671 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.207831+0000", 2023-10-08T07:07:22.671 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.059655490999999998, 2023-10-08T07:07:22.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.064247583999999996, 2023-10-08T07:07:22.671 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.671 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.671 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.671 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.671 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.671 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99365 2023-10-08T07:07:22.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.671 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.207831+0000", 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.207831+0000", 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.207832+0000", 2023-10-08T07:07:22.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6700000000000003e-07 2023-10-08T07:07:22.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.207842+0000", 2023-10-08T07:07:22.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.078e-05 2023-10-08T07:07:22.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.207853+0000", 2023-10-08T07:07:22.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0531e-05 2023-10-08T07:07:22.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.207860+0000", 2023-10-08T07:07:22.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4499999999999998e-06 2023-10-08T07:07:22.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.674 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.674 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99474 4.31 4:8de29a03:::10000000004.00000001:head [write 2256896~4096 in=4096b,write 2809856~4096 in=4096b,write 2990080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.674 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.245978+0000", 2023-10-08T07:07:22.674 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.021508034999999998, 2023-10-08T07:07:22.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026168455, 2023-10-08T07:07:22.675 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.675 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:22.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.675 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99474 2023-10-08T07:07:22.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.675 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.245978+0000", 2023-10-08T07:07:22.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.245978+0000", 2023-10-08T07:07:22.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.245979+0000", 2023-10-08T07:07:22.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6799999999999999e-07 2023-10-08T07:07:22.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.245992+0000", 2023-10-08T07:07:22.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2599000000000001e-05 2023-10-08T07:07:22.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.246002+0000", 2023-10-08T07:07:22.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0582e-05 2023-10-08T07:07:22.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.246010+0000", 2023-10-08T07:07:22.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7300000000000005e-06 2023-10-08T07:07:22.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248225+0000", 2023-10-08T07:07:22.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002214822 2023-10-08T07:07:22.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248273+0000", 2023-10-08T07:07:22.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8313999999999999e-05 2023-10-08T07:07:22.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:22.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.248372+0000", 2023-10-08T07:07:22.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8418000000000005e-05 2023-10-08T07:07:22.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:22.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.255792+0000", 2023-10-08T07:07:22.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074201559999999998 2023-10-08T07:07:22.679 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.680 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.680 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.680 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99504 4.38 e56/46 4:1e0977c7:::10000000004.00000022:head v 56'1574, mlcod=56'1569)", 2023-10-08T07:07:22.680 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.259638+0000", 2023-10-08T07:07:22.680 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0078479340000000009, 2023-10-08T07:07:22.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012587235, 2023-10-08T07:07:22.680 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.680 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.680 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259638+0000", 2023-10-08T07:07:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259638+0000", 2023-10-08T07:07:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259639+0000", 2023-10-08T07:07:22.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2e-07 2023-10-08T07:07:22.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259650+0000", 2023-10-08T07:07:22.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1297999999999999e-05 2023-10-08T07:07:22.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259658+0000", 2023-10-08T07:07:22.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9570000000000002e-06 2023-10-08T07:07:22.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259664+0000", 2023-10-08T07:07:22.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9020000000000004e-06 2023-10-08T07:07:22.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.271147+0000", 2023-10-08T07:07:22.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011483086 2023-10-08T07:07:22.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.271171+0000", 2023-10-08T07:07:22.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3496999999999999e-05 2023-10-08T07:07:22.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.684 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.684 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99540 4.7 4.6239e247 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.684 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.270474+0000", 2023-10-08T07:07:22.684 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9970121, 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018281090000000001, 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99540 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270474+0000", 2023-10-08T07:07:22.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270474+0000", 2023-10-08T07:07:22.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270475+0000", 2023-10-08T07:07:22.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1800000000000005e-07 2023-10-08T07:07:22.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270488+0000", 2023-10-08T07:07:22.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2874000000000001e-05 2023-10-08T07:07:22.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270498+0000", 2023-10-08T07:07:22.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0454e-05 2023-10-08T07:07:22.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.270505+0000", 2023-10-08T07:07:22.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3940000000000001e-06 2023-10-08T07:07:22.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.688 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.688 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99475 4.36 4:6d7df329:::10000000004.00000034:head [write 2551808~4096 in=4096b,write 2564096~4096 in=4096b,write 2809856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.688 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.246279+0000", 2023-10-08T07:07:22.688 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.021207508999999999, 2023-10-08T07:07:22.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026080857999999998, 2023-10-08T07:07:22.688 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99475 2023-10-08T07:07:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.246279+0000", 2023-10-08T07:07:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.246279+0000", 2023-10-08T07:07:22.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.246279+0000", 2023-10-08T07:07:22.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:07:22.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.246296+0000", 2023-10-08T07:07:22.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6056999999999999e-05 2023-10-08T07:07:22.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.246308+0000", 2023-10-08T07:07:22.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2699e-05 2023-10-08T07:07:22.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.246315+0000", 2023-10-08T07:07:22.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3099999999999997e-06 2023-10-08T07:07:22.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.246512+0000", 2023-10-08T07:07:22.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019717199999999999 2023-10-08T07:07:22.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.246614+0000", 2023-10-08T07:07:22.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102737 2023-10-08T07:07:22.692 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.693 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.693 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.693 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99507 4.30 e56/17)", 2023-10-08T07:07:22.693 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.259776+0000", 2023-10-08T07:07:22.693 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0077107019999999998, 2023-10-08T07:07:22.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012642468, 2023-10-08T07:07:22.693 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.693 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.693 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259776+0000", 2023-10-08T07:07:22.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259776+0000", 2023-10-08T07:07:22.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259776+0000", 2023-10-08T07:07:22.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2300000000000002e-07 2023-10-08T07:07:22.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259788+0000", 2023-10-08T07:07:22.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2238999999999999e-05 2023-10-08T07:07:22.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259796+0000", 2023-10-08T07:07:22.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4420000000000001e-06 2023-10-08T07:07:22.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.259801+0000", 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2510000000000002e-06 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99471 4.20 e56/17 4:05b3915c:::10000000004.00000016:head v 56'4670, mlcod=56'4664)", 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.247441+0000", 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.020045497999999998, 2023-10-08T07:07:22.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025021486999999999, 2023-10-08T07:07:22.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.697 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247441+0000", 2023-10-08T07:07:22.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247441+0000", 2023-10-08T07:07:22.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247442+0000", 2023-10-08T07:07:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2399999999999998e-07 2023-10-08T07:07:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247455+0000", 2023-10-08T07:07:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3414999999999999e-05 2023-10-08T07:07:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247468+0000", 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2985e-05 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247474+0000", 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4540000000000004e-06 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254692+0000", 2023-10-08T07:07:22.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0072178909999999997 2023-10-08T07:07:22.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.254710+0000", 2023-10-08T07:07:22.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8020999999999999e-05 2023-10-08T07:07:22.700 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.700 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.700 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.700 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99515 4.9 4:90f7d93b:::10000000004.00000021:head [write 1830912~4096 in=4096b,write 2064384~4096 in=4096b,write 2097152~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.700 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.260862+0000", 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0066244889999999999, 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011657047, 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99515 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.260862+0000", 2023-10-08T07:07:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.260862+0000", 2023-10-08T07:07:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.260863+0000", 2023-10-08T07:07:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2020000000000001e-06 2023-10-08T07:07:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.260877+0000", 2023-10-08T07:07:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4199000000000001e-05 2023-10-08T07:07:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.260894+0000", 2023-10-08T07:07:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6208000000000001e-05 2023-10-08T07:07:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.260903+0000", 2023-10-08T07:07:22.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9429999999999995e-06 2023-10-08T07:07:22.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263134+0000", 2023-10-08T07:07:22.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022302630000000001 2023-10-08T07:07:22.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.263405+0000", 2023-10-08T07:07:22.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00027104000000000001 2023-10-08T07:07:22.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.705 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.705 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99542 4.14 4.f5154ed4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.705 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.271337+0000", 2023-10-08T07:07:22.705 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9961495, 2023-10-08T07:07:22.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001240887, 2023-10-08T07:07:22.705 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.706 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.706 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99542 2023-10-08T07:07:22.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.706 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.271337+0000", 2023-10-08T07:07:22.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.271337+0000", 2023-10-08T07:07:22.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.271338+0000", 2023-10-08T07:07:22.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6700000000000002e-07 2023-10-08T07:07:22.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.271350+0000", 2023-10-08T07:07:22.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2221e-05 2023-10-08T07:07:22.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.271359+0000", 2023-10-08T07:07:22.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8920000000000006e-06 2023-10-08T07:07:22.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.271366+0000", 2023-10-08T07:07:22.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99433 4.4 4:2158769a:::10000000004.0000002a:head [write 3719168~4096 in=4096b,write 3751936~4096 in=4096b,write 3784704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.232867+0000", 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.034619305000000003, 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039763581999999999, 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.709 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.710 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.710 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99433 2023-10-08T07:07:22.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.710 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.232867+0000", 2023-10-08T07:07:22.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.232867+0000", 2023-10-08T07:07:22.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.232868+0000", 2023-10-08T07:07:22.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3399999999999998e-07 2023-10-08T07:07:22.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.232894+0000", 2023-10-08T07:07:22.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6645e-05 2023-10-08T07:07:22.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.232907+0000", 2023-10-08T07:07:22.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2332e-05 2023-10-08T07:07:22.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.232913+0000", 2023-10-08T07:07:22.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1959999999999996e-06 2023-10-08T07:07:22.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253405+0000", 2023-10-08T07:07:22.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020492329 2023-10-08T07:07:22.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.253490+0000", 2023-10-08T07:07:22.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4818e-05 2023-10-08T07:07:22.713 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.713 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.713 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.714 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:99472 4.38 e56/46 4:1e0977c7:::10000000004.00000022:head v 56'1573, mlcod=56'1569)", 2023-10-08T07:07:22.714 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.247701+0000", 2023-10-08T07:07:22.714 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.019785286999999999, 2023-10-08T07:07:22.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024988680999999999, 2023-10-08T07:07:22.714 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.714 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.714 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247701+0000", 2023-10-08T07:07:22.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247701+0000", 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247702+0000", 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4999999999999998e-07 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247715+0000", 2023-10-08T07:07:22.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2991e-05 2023-10-08T07:07:22.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247722+0000", 2023-10-08T07:07:22.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.52e-06 2023-10-08T07:07:22.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.247728+0000", 2023-10-08T07:07:22.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5090000000000001e-06 2023-10-08T07:07:22.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256758+0000", 2023-10-08T07:07:22.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0090308739999999995 2023-10-08T07:07:22.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.256779+0000", 2023-10-08T07:07:22.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0259999999999999e-05 2023-10-08T07:07:22.717 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.717 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.717 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.718 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99516 4.15 4:aaa619cf:::10000000004.00000004:head [write 1769472~4096 in=4096b,write 1945600~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.718 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.261183+0000", 2023-10-08T07:07:22.718 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0063033509999999996, 2023-10-08T07:07:22.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011585373, 2023-10-08T07:07:22.718 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.718 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:22.718 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.718 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.718 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.719 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99516 2023-10-08T07:07:22.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.719 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261183+0000", 2023-10-08T07:07:22.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261183+0000", 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261184+0000", 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2399999999999997e-07 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261199+0000", 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5075999999999999e-05 2023-10-08T07:07:22.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261217+0000", 2023-10-08T07:07:22.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7679000000000001e-05 2023-10-08T07:07:22.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261230+0000", 2023-10-08T07:07:22.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3883000000000001e-05 2023-10-08T07:07:22.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:22.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261294+0000", 2023-10-08T07:07:22.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3615999999999995e-05 2023-10-08T07:07:22.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:22.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.261378+0000", 2023-10-08T07:07:22.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3926999999999998e-05 2023-10-08T07:07:22.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.722 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.723 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:99544 4.3f 4.9eb4593f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:22.723 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:22.272295+0000", 2023-10-08T07:07:22.723 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9951911, 2023-10-08T07:07:22.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000541797, 2023-10-08T07:07:22.723 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:22.723 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:22.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:22.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:22.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:22.723 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 99544 2023-10-08T07:07:22.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.724 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:22.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:22.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.272295+0000", 2023-10-08T07:07:22.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:22.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.272295+0000", 2023-10-08T07:07:22.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:22.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:22.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.272296+0000", 2023-10-08T07:07:22.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0299999999999998e-07 2023-10-08T07:07:22.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:22.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.272308+0000", 2023-10-08T07:07:22.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2128e-05 2023-10-08T07:07:22.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:22.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.272320+0000", 2023-10-08T07:07:22.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2058e-05 2023-10-08T07:07:22.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:22.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:22.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:22.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:22.272328+0000", 2023-10-08T07:07:22.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6149999999999999e-06 2023-10-08T07:07:22.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.726 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:22.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:22.726 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:22.727 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 95 2023-10-08T07:07:22.727 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:22.728 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:22.729 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:22.728+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:22.828 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:22.828+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:22.930 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:22.929+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:22.964 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:22.965 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:22.965 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:22.965 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:22.965 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:22.981 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:23.065 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:23.065+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:23.133 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:23.132+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:23.230 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:23.230 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:23.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:23.230 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:23.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.231 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36811 4.31 4:8ec1b377:::10000000004.00000019:head [write 3362816~4096,write 3395584~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.231 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:23.231 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.950917694000001, 2023-10-08T07:07:23.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96838670299999996, 2023-10-08T07:07:23.231 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.231 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.232 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.232 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.232 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.232 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36811 2023-10-08T07:07:23.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.232 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:23.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:23.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:23.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:07:23.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275541+0000", 2023-10-08T07:07:23.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3360000000000001e-06 2023-10-08T07:07:23.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275551+0000", 2023-10-08T07:07:23.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.825e-06 2023-10-08T07:07:23.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275556+0000", 2023-10-08T07:07:23.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2023-10-08T07:07:23.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275592+0000", 2023-10-08T07:07:23.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6554000000000003e-05 2023-10-08T07:07:23.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275599+0000", 2023-10-08T07:07:23.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4640000000000003e-06 2023-10-08T07:07:23.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.238899+0000", 2023-10-08T07:07:23.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96330046999999996 2023-10-08T07:07:23.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239016+0000", 2023-10-08T07:07:23.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116919 2023-10-08T07:07:23.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239123+0000", 2023-10-08T07:07:23.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010675000000000001 2023-10-08T07:07:23.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243715+0000", 2023-10-08T07:07:23.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045922469999999998 2023-10-08T07:07:23.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243760+0000", 2023-10-08T07:07:23.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4666000000000002e-05 2023-10-08T07:07:23.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243820+0000", 2023-10-08T07:07:23.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9760999999999999e-05 2023-10-08T07:07:23.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243917+0000", 2023-10-08T07:07:23.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7822e-05 2023-10-08T07:07:23.242 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.243 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.243 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36831 4.31 4:8de29a03:::10000000004.00000001:head [write 806912~8192,write 847872~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.243 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:23.244 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.943897776, 2023-10-08T07:07:23.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96330879000000003, 2023-10-08T07:07:23.244 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.244 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.245 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36831 2023-10-08T07:07:23.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.245 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:23.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:23.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:23.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:23.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282564+0000", 2023-10-08T07:07:23.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2303999999999999e-05 2023-10-08T07:07:23.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282572+0000", 2023-10-08T07:07:23.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7849999999999992e-06 2023-10-08T07:07:23.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282579+0000", 2023-10-08T07:07:23.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4610000000000002e-06 2023-10-08T07:07:23.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282631+0000", 2023-10-08T07:07:23.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2404999999999997e-05 2023-10-08T07:07:23.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282640+0000", 2023-10-08T07:07:23.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2640000000000008e-06 2023-10-08T07:07:23.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239925+0000", 2023-10-08T07:07:23.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95728506499999999 2023-10-08T07:07:23.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240097+0000", 2023-10-08T07:07:23.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172497 2023-10-08T07:07:23.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240235+0000", 2023-10-08T07:07:23.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000137861 2023-10-08T07:07:23.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243935+0000", 2023-10-08T07:07:23.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037000819999999999 2023-10-08T07:07:23.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245706+0000", 2023-10-08T07:07:23.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001770972 2023-10-08T07:07:23.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245773+0000", 2023-10-08T07:07:23.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6840000000000004e-05 2023-10-08T07:07:23.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245859+0000", 2023-10-08T07:07:23.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6442999999999999e-05 2023-10-08T07:07:23.254 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.254 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.254 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.255 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36859 4.31 4:8de29a03:::10000000004.00000001:head [write 3850240~4096,write 3891200~4096,write 3919872~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.255 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:23.255 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.933154234, 2023-10-08T07:07:23.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95269757099999997, 2023-10-08T07:07:23.255 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.255 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.256 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36859 2023-10-08T07:07:23.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.256 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:23.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:23.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293295+0000", 2023-10-08T07:07:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9500000000000001e-07 2023-10-08T07:07:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293335+0000", 2023-10-08T07:07:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9867999999999998e-05 2023-10-08T07:07:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293346+0000", 2023-10-08T07:07:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1070000000000001e-05 2023-10-08T07:07:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293353+0000", 2023-10-08T07:07:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2640000000000002e-06 2023-10-08T07:07:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293409+0000", 2023-10-08T07:07:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5926e-05 2023-10-08T07:07:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293418+0000", 2023-10-08T07:07:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9940000000000006e-06 2023-10-08T07:07:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240889+0000", 2023-10-08T07:07:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94747106400000003 2023-10-08T07:07:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240963+0000", 2023-10-08T07:07:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3431999999999998e-05 2023-10-08T07:07:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241104+0000", 2023-10-08T07:07:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014119800000000001 2023-10-08T07:07:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243944+0000", 2023-10-08T07:07:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028404200000000002 2023-10-08T07:07:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245909+0000", 2023-10-08T07:07:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001964351 2023-10-08T07:07:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245942+0000", 2023-10-08T07:07:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3526999999999999e-05 2023-10-08T07:07:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245992+0000", 2023-10-08T07:07:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9561999999999997e-05 2023-10-08T07:07:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36861 4.31 4:8ec1b377:::10000000004.00000019:head [write 385024~4096,write 434176~4096,write 540672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.932245437999999, 2023-10-08T07:07:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.955921154, 2023-10-08T07:07:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36861 2023-10-08T07:07:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294204+0000", 2023-10-08T07:07:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294216+0000", 2023-10-08T07:07:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2323999999999999e-05 2023-10-08T07:07:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294226+0000", 2023-10-08T07:07:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0217000000000001e-05 2023-10-08T07:07:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294234+0000", 2023-10-08T07:07:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6020000000000002e-06 2023-10-08T07:07:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294300+0000", 2023-10-08T07:07:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6515999999999998e-05 2023-10-08T07:07:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294312+0000", 2023-10-08T07:07:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1379000000000001e-05 2023-10-08T07:07:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241814+0000", 2023-10-08T07:07:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.947501751 2023-10-08T07:07:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241863+0000", 2023-10-08T07:07:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9135999999999998e-05 2023-10-08T07:07:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241953+0000", 2023-10-08T07:07:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0124000000000007e-05 2023-10-08T07:07:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243952+0000", 2023-10-08T07:07:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019988749999999998 2023-10-08T07:07:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250028+0000", 2023-10-08T07:07:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060766350000000004 2023-10-08T07:07:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250069+0000", 2023-10-08T07:07:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0794000000000003e-05 2023-10-08T07:07:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250124+0000", 2023-10-08T07:07:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991000000000003e-05 2023-10-08T07:07:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36869 4.31 4:8ec1b377:::10000000004.00000019:head [write 917504~4096,write 983040~4096,write 1171456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.928929174, 2023-10-08T07:07:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95596831699999996, 2023-10-08T07:07:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36869 2023-10-08T07:07:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297520+0000", 2023-10-08T07:07:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.23e-07 2023-10-08T07:07:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297532+0000", 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1420000000000001e-05 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297548+0000", 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6711e-05 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297557+0000", 2023-10-08T07:07:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3250000000000008e-06 2023-10-08T07:07:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297606+0000", 2023-10-08T07:07:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9724e-05 2023-10-08T07:07:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297614+0000", 2023-10-08T07:07:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2023-10-08T07:07:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.242809+0000", 2023-10-08T07:07:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94519444900000005 2023-10-08T07:07:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.242885+0000", 2023-10-08T07:07:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6784000000000002e-05 2023-10-08T07:07:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243025+0000", 2023-10-08T07:07:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013984300000000001 2023-10-08T07:07:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246003+0000", 2023-10-08T07:07:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002978072 2023-10-08T07:07:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253322+0000", 2023-10-08T07:07:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073190779999999997 2023-10-08T07:07:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253391+0000", 2023-10-08T07:07:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8285000000000001e-05 2023-10-08T07:07:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253488+0000", 2023-10-08T07:07:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7014000000000003e-05 2023-10-08T07:07:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36881 4.31 4:8ec1b377:::10000000004.00000019:head [write 888832~4096,write 1191936~4096,write 1327104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.924861629999999, 2023-10-08T07:07:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95214402799999998, 2023-10-08T07:07:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36881 2023-10-08T07:07:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:23.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301588+0000", 2023-10-08T07:07:23.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.02e-06 2023-10-08T07:07:23.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301600+0000", 2023-10-08T07:07:23.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2377e-05 2023-10-08T07:07:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301611+0000", 2023-10-08T07:07:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0446e-05 2023-10-08T07:07:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301621+0000", 2023-10-08T07:07:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0338e-05 2023-10-08T07:07:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301668+0000", 2023-10-08T07:07:23.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7459000000000001e-05 2023-10-08T07:07:23.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301674+0000", 2023-10-08T07:07:23.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7910000000000001e-06 2023-10-08T07:07:23.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244001+0000", 2023-10-08T07:07:23.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94232701200000002 2023-10-08T07:07:23.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244082+0000", 2023-10-08T07:07:23.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0615e-05 2023-10-08T07:07:23.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244202+0000", 2023-10-08T07:07:23.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120427 2023-10-08T07:07:23.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246009+0000", 2023-10-08T07:07:23.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018070899999999999 2023-10-08T07:07:23.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253544+0000", 2023-10-08T07:07:23.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075350729999999998 2023-10-08T07:07:23.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253607+0000", 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2810000000000003e-05 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253731+0000", 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012357000000000001 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.298 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36900 4.31 4:8de29a03:::10000000004.00000001:head [write 3239936~4096,write 3371008~4096,write 3878912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.298 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:23.298 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.918538324, 2023-10-08T07:07:23.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94607822699999999, 2023-10-08T07:07:23.298 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.298 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36900 2023-10-08T07:07:23.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.299 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:23.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:23.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307911+0000", 2023-10-08T07:07:23.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0210000000000001e-06 2023-10-08T07:07:23.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307926+0000", 2023-10-08T07:07:23.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4375e-05 2023-10-08T07:07:23.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307936+0000", 2023-10-08T07:07:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0124e-05 2023-10-08T07:07:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307950+0000", 2023-10-08T07:07:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4659e-05 2023-10-08T07:07:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307998+0000", 2023-10-08T07:07:23.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8170000000000001e-05 2023-10-08T07:07:23.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.308005+0000", 2023-10-08T07:07:23.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3339999999999998e-06 2023-10-08T07:07:23.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244911+0000", 2023-10-08T07:07:23.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93690596699999995 2023-10-08T07:07:23.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244972+0000", 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0854999999999999e-05 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245073+0000", 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101406 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250135+0000", 2023-10-08T07:07:23.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050614620000000001 2023-10-08T07:07:23.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253786+0000", 2023-10-08T07:07:23.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003651615 2023-10-08T07:07:23.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253860+0000", 2023-10-08T07:07:23.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3631e-05 2023-10-08T07:07:23.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253988+0000", 2023-10-08T07:07:23.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000128608 2023-10-08T07:07:23.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.305 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.305 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36907 4.31 4:8de29a03:::10000000004.00000001:head [write 53248~4096,write 192512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.305 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:23.305 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.915297217999999, 2023-10-08T07:07:23.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94298633799999998, 2023-10-08T07:07:23.306 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.306 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.306 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.306 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.306 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.306 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36907 2023-10-08T07:07:23.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.306 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311152+0000", 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3200000000000005e-07 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311158+0000", 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2219999999999999e-06 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311166+0000", 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5209999999999997e-06 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311169+0000", 2023-10-08T07:07:23.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.568e-06 2023-10-08T07:07:23.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311202+0000", 2023-10-08T07:07:23.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3346000000000002e-05 2023-10-08T07:07:23.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311208+0000", 2023-10-08T07:07:23.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.259e-06 2023-10-08T07:07:23.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246041+0000", 2023-10-08T07:07:23.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93483340400000003 2023-10-08T07:07:23.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246088+0000", 2023-10-08T07:07:23.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6653999999999998e-05 2023-10-08T07:07:23.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246173+0000", 2023-10-08T07:07:23.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5327999999999993e-05 2023-10-08T07:07:23.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253252+0000", 2023-10-08T07:07:23.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070788170000000003 2023-10-08T07:07:23.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254057+0000", 2023-10-08T07:07:23.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00080496300000000001 2023-10-08T07:07:23.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254090+0000", 2023-10-08T07:07:23.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3325999999999999e-05 2023-10-08T07:07:23.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254138+0000", 2023-10-08T07:07:23.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7398000000000003e-05 2023-10-08T07:07:23.313 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.313 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.313 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.313 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36955 4.31 4:8ec1b377:::10000000004.00000019:head [write 3538944~8192,write 3620864~4096,write 3641344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.313 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:23.313 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.898254273999999, 2023-10-08T07:07:23.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92903069999999999, 2023-10-08T07:07:23.313 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.314 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.314 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.314 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.314 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.314 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36955 2023-10-08T07:07:23.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.314 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:23.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:23.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328195+0000", 2023-10-08T07:07:23.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1600000000000001e-07 2023-10-08T07:07:23.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328208+0000", 2023-10-08T07:07:23.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3592e-05 2023-10-08T07:07:23.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328218+0000", 2023-10-08T07:07:23.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7270000000000002e-06 2023-10-08T07:07:23.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328226+0000", 2023-10-08T07:07:23.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.328e-06 2023-10-08T07:07:23.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328282+0000", 2023-10-08T07:07:23.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6156000000000002e-05 2023-10-08T07:07:23.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328300+0000", 2023-10-08T07:07:23.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7805e-05 2023-10-08T07:07:23.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246679+0000", 2023-10-08T07:07:23.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91837927200000002 2023-10-08T07:07:23.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246743+0000", 2023-10-08T07:07:23.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4599999999999998e-05 2023-10-08T07:07:23.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246838+0000", 2023-10-08T07:07:23.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5063999999999996e-05 2023-10-08T07:07:23.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253747+0000", 2023-10-08T07:07:23.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069086210000000002 2023-10-08T07:07:23.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257129+0000", 2023-10-08T07:07:23.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033818210000000001 2023-10-08T07:07:23.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257167+0000", 2023-10-08T07:07:23.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8318999999999997e-05 2023-10-08T07:07:23.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257225+0000", 2023-10-08T07:07:23.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7679000000000001e-05 2023-10-08T07:07:23.321 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.321 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.321 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.321 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36966 4.31 4:8de29a03:::10000000004.00000001:head [write 2809856~4096,write 3076096~4096,write 3096576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.321 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:23.321 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.894349550000001, 2023-10-08T07:07:23.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92525588800000003, 2023-10-08T07:07:23.322 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.322 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.322 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36966 2023-10-08T07:07:23.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.322 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:23.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:23.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332100+0000", 2023-10-08T07:07:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332121+0000", 2023-10-08T07:07:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0914999999999999e-05 2023-10-08T07:07:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332128+0000", 2023-10-08T07:07:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8709999999999997e-06 2023-10-08T07:07:23.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332134+0000", 2023-10-08T07:07:23.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0839999999999999e-06 2023-10-08T07:07:23.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332182+0000", 2023-10-08T07:07:23.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8310000000000003e-05 2023-10-08T07:07:23.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332187+0000", 2023-10-08T07:07:23.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.242e-06 2023-10-08T07:07:23.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248280+0000", 2023-10-08T07:07:23.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91609321899999996 2023-10-08T07:07:23.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248369+0000", 2023-10-08T07:07:23.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8895999999999997e-05 2023-10-08T07:07:23.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248536+0000", 2023-10-08T07:07:23.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016709099999999999 2023-10-08T07:07:23.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257075+0000", 2023-10-08T07:07:23.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085385300000000008 2023-10-08T07:07:23.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257266+0000", 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019079399999999999 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257305+0000", 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8996999999999999e-05 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257355+0000", 2023-10-08T07:07:23.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0129000000000001e-05 2023-10-08T07:07:23.329 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.329 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.329 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.329 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36968 4.31 4:8ec1b377:::10000000004.00000019:head [write 835584~4096,write 1372160~4096,write 1646592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.329 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:23.329 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.89262948, 2023-10-08T07:07:23.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92599244700000005, 2023-10-08T07:07:23.329 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.329 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36968 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:23.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333820+0000", 2023-10-08T07:07:23.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1999999999999998e-07 2023-10-08T07:07:23.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333833+0000", 2023-10-08T07:07:23.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3574000000000001e-05 2023-10-08T07:07:23.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333848+0000", 2023-10-08T07:07:23.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4912999999999999e-05 2023-10-08T07:07:23.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333857+0000", 2023-10-08T07:07:23.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1270000000000003e-06 2023-10-08T07:07:23.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333903+0000", 2023-10-08T07:07:23.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6782e-05 2023-10-08T07:07:23.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333911+0000", 2023-10-08T07:07:23.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5020000000000003e-06 2023-10-08T07:07:23.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250170+0000", 2023-10-08T07:07:23.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91625966299999995 2023-10-08T07:07:23.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250263+0000", 2023-10-08T07:07:23.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2252999999999999e-05 2023-10-08T07:07:23.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250454+0000", 2023-10-08T07:07:23.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019164400000000001 2023-10-08T07:07:23.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258723+0000", 2023-10-08T07:07:23.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082687699999999999 2023-10-08T07:07:23.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259685+0000", 2023-10-08T07:07:23.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00096196599999999997 2023-10-08T07:07:23.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259739+0000", 2023-10-08T07:07:23.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4147999999999997e-05 2023-10-08T07:07:23.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259811+0000", 2023-10-08T07:07:23.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2185000000000001e-05 2023-10-08T07:07:23.336 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.336 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.336 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.336 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37036 4.31 4:8ec1b377:::10000000004.00000019:head [write 3309568~4096,write 3510272~4096,write 3620864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.337 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:23.337 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.867212629000001, 2023-10-08T07:07:23.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.90288029999999997, 2023-10-08T07:07:23.337 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.337 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.337 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.337 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.337 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.337 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37036 2023-10-08T07:07:23.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.337 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:23.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:23.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:23.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6899999999999997e-07 2023-10-08T07:07:23.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359246+0000", 2023-10-08T07:07:23.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2369999999999998e-06 2023-10-08T07:07:23.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359254+0000", 2023-10-08T07:07:23.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4989999999999994e-06 2023-10-08T07:07:23.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359260+0000", 2023-10-08T07:07:23.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0209999999999996e-06 2023-10-08T07:07:23.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359319+0000", 2023-10-08T07:07:23.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9042999999999997e-05 2023-10-08T07:07:23.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359330+0000", 2023-10-08T07:07:23.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0633e-05 2023-10-08T07:07:23.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.251788+0000", 2023-10-08T07:07:23.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89245758100000006 2023-10-08T07:07:23.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.251887+0000", 2023-10-08T07:07:23.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9223999999999997e-05 2023-10-08T07:07:23.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.252083+0000", 2023-10-08T07:07:23.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019611800000000001 2023-10-08T07:07:23.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258731+0000", 2023-10-08T07:07:23.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006648307 2023-10-08T07:07:23.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262036+0000", 2023-10-08T07:07:23.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033046550000000001 2023-10-08T07:07:23.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262069+0000", 2023-10-08T07:07:23.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2753000000000003e-05 2023-10-08T07:07:23.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262116+0000", 2023-10-08T07:07:23.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7559999999999999e-05 2023-10-08T07:07:23.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.344 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.344 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37068 4.31 4:8de29a03:::10000000004.00000001:head [write 987136~4096,write 1011712~4096,write 1044480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.344 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:23.344 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.855533657999999, 2023-10-08T07:07:23.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89311213899999997, 2023-10-08T07:07:23.345 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.345 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.345 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37068 2023-10-08T07:07:23.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.345 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:23.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:23.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370916+0000", 2023-10-08T07:07:23.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5000000000000002e-07 2023-10-08T07:07:23.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370956+0000", 2023-10-08T07:07:23.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0898e-05 2023-10-08T07:07:23.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370966+0000", 2023-10-08T07:07:23.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6209999999999999e-06 2023-10-08T07:07:23.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370973+0000", 2023-10-08T07:07:23.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.601e-06 2023-10-08T07:07:23.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.371022+0000", 2023-10-08T07:07:23.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9811999999999997e-05 2023-10-08T07:07:23.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.371032+0000", 2023-10-08T07:07:23.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8120000000000002e-06 2023-10-08T07:07:23.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254175+0000", 2023-10-08T07:07:23.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88314265599999997 2023-10-08T07:07:23.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254256+0000", 2023-10-08T07:07:23.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0820000000000002e-05 2023-10-08T07:07:23.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254436+0000", 2023-10-08T07:07:23.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000180044 2023-10-08T07:07:23.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261274+0000", 2023-10-08T07:07:23.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006838434 2023-10-08T07:07:23.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.263950+0000", 2023-10-08T07:07:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026753829999999999 2023-10-08T07:07:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.263981+0000", 2023-10-08T07:07:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1568e-05 2023-10-08T07:07:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.264027+0000", 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5739999999999999e-05 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37088 4.31 4:8de29a03:::10000000004.00000001:head [write 1466368~8192,write 1515520~4096,write 1523712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.847624781, 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88701907199999996, 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.352 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.353 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37088 2023-10-08T07:07:23.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.353 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:23.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:23.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378825+0000", 2023-10-08T07:07:23.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7199999999999997e-07 2023-10-08T07:07:23.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378841+0000", 2023-10-08T07:07:23.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5999e-05 2023-10-08T07:07:23.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378851+0000", 2023-10-08T07:07:23.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0474e-05 2023-10-08T07:07:23.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378858+0000", 2023-10-08T07:07:23.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9840000000000004e-06 2023-10-08T07:07:23.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378904+0000", 2023-10-08T07:07:23.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5704999999999997e-05 2023-10-08T07:07:23.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378910+0000", 2023-10-08T07:07:23.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5039999999999999e-06 2023-10-08T07:07:23.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255278+0000", 2023-10-08T07:07:23.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.87636765000000005 2023-10-08T07:07:23.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255385+0000", 2023-10-08T07:07:23.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000106667 2023-10-08T07:07:23.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255557+0000", 2023-10-08T07:07:23.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172957 2023-10-08T07:07:23.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261279+0000", 2023-10-08T07:07:23.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00572195 2023-10-08T07:07:23.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265761+0000", 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004481423 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265796+0000", 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4727000000000001e-05 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265843+0000", 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7160000000000002e-05 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.359 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.360 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37130 4.31 4:8ec1b377:::10000000004.00000019:head [write 1658880~4096,write 1736704~4096,write 1794048~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.360 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:23.360 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.830454896999999, 2023-10-08T07:07:23.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86998378399999998, 2023-10-08T07:07:23.360 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.360 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.361 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37130 2023-10-08T07:07:23.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.361 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:23.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:23.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395995+0000", 2023-10-08T07:07:23.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600000000000008e-07 2023-10-08T07:07:23.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396008+0000", 2023-10-08T07:07:23.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3067999999999999e-05 2023-10-08T07:07:23.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396019+0000", 2023-10-08T07:07:23.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1561e-05 2023-10-08T07:07:23.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396027+0000", 2023-10-08T07:07:23.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9039999999999992e-06 2023-10-08T07:07:23.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396075+0000", 2023-10-08T07:07:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8165999999999999e-05 2023-10-08T07:07:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396081+0000", 2023-10-08T07:07:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8279999999999999e-06 2023-10-08T07:07:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256171+0000", 2023-10-08T07:07:23.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86008956199999997 2023-10-08T07:07:23.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256218+0000", 2023-10-08T07:07:23.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7018000000000003e-05 2023-10-08T07:07:23.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256315+0000", 2023-10-08T07:07:23.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7285000000000001e-05 2023-10-08T07:07:23.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262125+0000", 2023-10-08T07:07:23.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058099110000000001 2023-10-08T07:07:23.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265890+0000", 2023-10-08T07:07:23.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037655829999999999 2023-10-08T07:07:23.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265929+0000", 2023-10-08T07:07:23.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8068999999999998e-05 2023-10-08T07:07:23.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265977+0000", 2023-10-08T07:07:23.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8832999999999998e-05 2023-10-08T07:07:23.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.367 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.368 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37183 4.31 4:8ec1b377:::10000000004.00000019:head [write 16384~4096,write 364544~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.368 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:23.368 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.811273839999998, 2023-10-08T07:07:23.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.85095945399999995, 2023-10-08T07:07:23.368 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.368 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.368 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.368 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.368 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.368 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37183 2023-10-08T07:07:23.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.369 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:23.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:23.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:23.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6499999999999998e-07 2023-10-08T07:07:23.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415186+0000", 2023-10-08T07:07:23.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0404999999999999e-05 2023-10-08T07:07:23.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415198+0000", 2023-10-08T07:07:23.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.187e-05 2023-10-08T07:07:23.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415204+0000", 2023-10-08T07:07:23.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5119999999999997e-06 2023-10-08T07:07:23.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415259+0000", 2023-10-08T07:07:23.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5269999999999998e-05 2023-10-08T07:07:23.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415270+0000", 2023-10-08T07:07:23.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0716e-05 2023-10-08T07:07:23.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257384+0000", 2023-10-08T07:07:23.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84211341500000003 2023-10-08T07:07:23.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257442+0000", 2023-10-08T07:07:23.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8780999999999998e-05 2023-10-08T07:07:23.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257538+0000", 2023-10-08T07:07:23.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5956000000000001e-05 2023-10-08T07:07:23.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265987+0000", 2023-10-08T07:07:23.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008449069 2023-10-08T07:07:23.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266053+0000", 2023-10-08T07:07:23.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5813000000000002e-05 2023-10-08T07:07:23.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266089+0000", 2023-10-08T07:07:23.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5827000000000001e-05 2023-10-08T07:07:23.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266134+0000", 2023-10-08T07:07:23.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5055000000000001e-05 2023-10-08T07:07:23.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.375 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.376 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37188 4.31 4:8de29a03:::10000000004.00000001:head [write 2031616~4096,write 2191360~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.376 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:23.376 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.809146518999999, 2023-10-08T07:07:23.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.850341613, 2023-10-08T07:07:23.376 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.376 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.377 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37188 2023-10-08T07:07:23.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.377 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:23.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:23.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417303+0000", 2023-10-08T07:07:23.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0599999999999999e-07 2023-10-08T07:07:23.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417315+0000", 2023-10-08T07:07:23.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2325e-05 2023-10-08T07:07:23.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417324+0000", 2023-10-08T07:07:23.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8489999999999995e-06 2023-10-08T07:07:23.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417331+0000", 2023-10-08T07:07:23.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4599999999999997e-06 2023-10-08T07:07:23.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417437+0000", 2023-10-08T07:07:23.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105305 2023-10-08T07:07:23.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417445+0000", 2023-10-08T07:07:23.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3040000000000005e-06 2023-10-08T07:07:23.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258113+0000", 2023-10-08T07:07:23.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84066830699999995 2023-10-08T07:07:23.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258168+0000", 2023-10-08T07:07:23.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4258999999999997e-05 2023-10-08T07:07:23.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258255+0000", 2023-10-08T07:07:23.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7235000000000001e-05 2023-10-08T07:07:23.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265993+0000", 2023-10-08T07:07:23.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077377599999999998 2023-10-08T07:07:23.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267565+0000", 2023-10-08T07:07:23.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001572314 2023-10-08T07:07:23.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267597+0000", 2023-10-08T07:07:23.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2361999999999999e-05 2023-10-08T07:07:23.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267644+0000", 2023-10-08T07:07:23.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6326999999999999e-05 2023-10-08T07:07:23.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.383 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.384 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37197 4.31 4:8de29a03:::10000000004.00000001:head [write 1859584~4096,write 2220032~4096,write 2322432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.384 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:23.384 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.805492538999999, 2023-10-08T07:07:23.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84767678599999996, 2023-10-08T07:07:23.384 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.384 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.384 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37197 2023-10-08T07:07:23.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.385 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:23.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:23.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420957+0000", 2023-10-08T07:07:23.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9199999999999999e-07 2023-10-08T07:07:23.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420969+0000", 2023-10-08T07:07:23.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1753000000000001e-05 2023-10-08T07:07:23.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420981+0000", 2023-10-08T07:07:23.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2479e-05 2023-10-08T07:07:23.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420989+0000", 2023-10-08T07:07:23.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0949999999999996e-06 2023-10-08T07:07:23.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.421053+0000", 2023-10-08T07:07:23.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4134999999999995e-05 2023-10-08T07:07:23.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.421062+0000", 2023-10-08T07:07:23.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8440000000000004e-06 2023-10-08T07:07:23.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258760+0000", 2023-10-08T07:07:23.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83769823499999996 2023-10-08T07:07:23.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258814+0000", 2023-10-08T07:07:23.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3876999999999999e-05 2023-10-08T07:07:23.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258913+0000", 2023-10-08T07:07:23.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8323e-05 2023-10-08T07:07:23.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265997+0000", 2023-10-08T07:07:23.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070839830000000003 2023-10-08T07:07:23.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268535+0000", 2023-10-08T07:07:23.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002538836 2023-10-08T07:07:23.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268574+0000", 2023-10-08T07:07:23.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8606000000000003e-05 2023-10-08T07:07:23.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268633+0000", 2023-10-08T07:07:23.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8727999999999997e-05 2023-10-08T07:07:23.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.392 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.392 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37227 4.31 4:8ec1b377:::10000000004.00000019:head [write 2760704~4096,write 2781184~4096,write 2850816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.392 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:23.392 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.794968568000002, 2023-10-08T07:07:23.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83736361400000003, 2023-10-08T07:07:23.393 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.393 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.393 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37227 2023-10-08T07:07:23.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.393 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:23.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:23.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431481+0000", 2023-10-08T07:07:23.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8400000000000003e-07 2023-10-08T07:07:23.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431512+0000", 2023-10-08T07:07:23.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0803999999999998e-05 2023-10-08T07:07:23.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431525+0000", 2023-10-08T07:07:23.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3704e-05 2023-10-08T07:07:23.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431535+0000", 2023-10-08T07:07:23.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2350000000000005e-06 2023-10-08T07:07:23.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431585+0000", 2023-10-08T07:07:23.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0531000000000001e-05 2023-10-08T07:07:23.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431594+0000", 2023-10-08T07:07:23.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7499999999999992e-06 2023-10-08T07:07:23.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259851+0000", 2023-10-08T07:07:23.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82825699399999997 2023-10-08T07:07:23.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259914+0000", 2023-10-08T07:07:23.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2928999999999993e-05 2023-10-08T07:07:23.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.260024+0000", 2023-10-08T07:07:23.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000110556 2023-10-08T07:07:23.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266001+0000", 2023-10-08T07:07:23.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059769910000000001 2023-10-08T07:07:23.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268694+0000", 2023-10-08T07:07:23.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026924119999999999 2023-10-08T07:07:23.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268754+0000", 2023-10-08T07:07:23.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0562000000000001e-05 2023-10-08T07:07:23.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268843+0000", 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9262e-05 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37233 4.31 4:8de29a03:::10000000004.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.792761608999999, 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83766958000000002, 2023-10-08T07:07:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:23.402 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:23.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:23.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:23.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.402 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37233 2023-10-08T07:07:23.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.402 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:23.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:23.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:23.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:23.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:23.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:23.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:23.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433688+0000", 2023-10-08T07:07:23.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2023-10-08T07:07:23.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433701+0000", 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3869000000000001e-05 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433714+0000", 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2173e-05 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433720+0000", 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7449999999999998e-06 2023-10-08T07:07:23.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433772+0000", 2023-10-08T07:07:23.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1242999999999997e-05 2023-10-08T07:07:23.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:23.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433781+0000", 2023-10-08T07:07:23.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1360000000000003e-06 2023-10-08T07:07:23.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:23.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261313+0000", 2023-10-08T07:07:23.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82753250300000003 2023-10-08T07:07:23.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:23.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261367+0000", 2023-10-08T07:07:23.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3664e-05 2023-10-08T07:07:23.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:23.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261467+0000", 2023-10-08T07:07:23.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9668999999999997e-05 2023-10-08T07:07:23.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:23.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266010+0000", 2023-10-08T07:07:23.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045437189999999999 2023-10-08T07:07:23.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:23.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271269+0000", 2023-10-08T07:07:23.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052584900000000002 2023-10-08T07:07:23.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:23.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271310+0000", 2023-10-08T07:07:23.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1057999999999999e-05 2023-10-08T07:07:23.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:23.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:23.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:23.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271356+0000", 2023-10-08T07:07:23.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6582999999999998e-05 2023-10-08T07:07:23.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.408 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.409 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.409 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:23.409 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:23.409 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:23.410 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:23.409+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:23.410 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:23.433 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:23.433 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T07:07:23.512 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:23.512+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:23.600 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:103248 4.34 4:2dadb699:::10000000004.00000031:head [write 1073152~4096 in=4096b,write 1101824~4096 in=4096b,write 1118208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:23.599051+0000", 2023-10-08T07:07:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00067136300000000002, 2023-10-08T07:07:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00069269100000000005, 2023-10-08T07:07:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:23.601 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 103248 2023-10-08T07:07:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.599051+0000", 2023-10-08T07:07:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:23.602 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.599051+0000", 2023-10-08T07:07:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.599052+0000", 2023-10-08T07:07:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4e-07 2023-10-08T07:07:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.599067+0000", 2023-10-08T07:07:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4912000000000001e-05 2023-10-08T07:07:23.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.599079+0000", 2023-10-08T07:07:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2320000000000001e-05 2023-10-08T07:07:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.599088+0000", 2023-10-08T07:07:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4710000000000007e-06 2023-10-08T07:07:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.604 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.599142+0000", 2023-10-08T07:07:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4330999999999999e-05 2023-10-08T07:07:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.599241+0000", 2023-10-08T07:07:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9535000000000002e-05 2023-10-08T07:07:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:23.605 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:103240 4.2 4:43cef10a:::10000000004.00000030:head [write 389120~4096 in=4096b,write 589824~4096 in=4096b,write 626688~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:23.595042+0000", 2023-10-08T07:07:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0046799160000000001, 2023-10-08T07:07:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047492250000000001, 2023-10-08T07:07:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.606 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 103240 2023-10-08T07:07:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595042+0000", 2023-10-08T07:07:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595042+0000", 2023-10-08T07:07:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595043+0000", 2023-10-08T07:07:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4099999999999997e-07 2023-10-08T07:07:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595059+0000", 2023-10-08T07:07:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6164999999999999e-05 2023-10-08T07:07:23.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595073+0000", 2023-10-08T07:07:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3348e-05 2023-10-08T07:07:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595080+0000", 2023-10-08T07:07:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6179999999999997e-06 2023-10-08T07:07:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596318+0000", 2023-10-08T07:07:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001237553 2023-10-08T07:07:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596423+0000", 2023-10-08T07:07:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000105167 2023-10-08T07:07:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.610 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:103241 4.29 e56/17 4:94216392:::10000000004.0000002b:head v 56'1655, mlcod=56'1653)", 2023-10-08T07:07:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:23.595927+0000", 2023-10-08T07:07:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0037954170000000001, 2023-10-08T07:07:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039039830000000002, 2023-10-08T07:07:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595927+0000", 2023-10-08T07:07:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595927+0000", 2023-10-08T07:07:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595928+0000", 2023-10-08T07:07:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.44e-07 2023-10-08T07:07:23.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595940+0000", 2023-10-08T07:07:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2247e-05 2023-10-08T07:07:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595952+0000", 2023-10-08T07:07:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1816e-05 2023-10-08T07:07:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.613 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595956+0000", 2023-10-08T07:07:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.702e-06 2023-10-08T07:07:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596008+0000", 2023-10-08T07:07:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1187999999999998e-05 2023-10-08T07:07:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:23.614 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596027+0000", 2023-10-08T07:07:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9820999999999999e-05 2023-10-08T07:07:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:103242 4.2 4:43cef10a:::10000000004.00000030:head [write 2400256~8192 in=8192b,write 2437120~4096 in=4096b,write 2457600~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:23.595944+0000", 2023-10-08T07:07:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.003778474, 2023-10-08T07:07:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039258440000000004, 2023-10-08T07:07:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:23.615 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 103242 2023-10-08T07:07:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595944+0000", 2023-10-08T07:07:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595944+0000", 2023-10-08T07:07:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595945+0000", 2023-10-08T07:07:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6599999999999994e-07 2023-10-08T07:07:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.617 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595960+0000", 2023-10-08T07:07:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5048999999999999e-05 2023-10-08T07:07:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595972+0000", 2023-10-08T07:07:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2142e-05 2023-10-08T07:07:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.595981+0000", 2023-10-08T07:07:23.618 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5169999999999999e-06 2023-10-08T07:07:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.599105+0000", 2023-10-08T07:07:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003124258 2023-10-08T07:07:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.599182+0000", 2023-10-08T07:07:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7076000000000005e-05 2023-10-08T07:07:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.619 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:103243 4.20 4:07572838:::10000000004.00000010:head [write 196608~4096 in=4096b,write 286720~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:23.596511+0000", 2023-10-08T07:07:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.003211031, 2023-10-08T07:07:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0034272500000000002, 2023-10-08T07:07:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:23.620 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 103243 2023-10-08T07:07:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596511+0000", 2023-10-08T07:07:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:23.621 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596511+0000", 2023-10-08T07:07:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596512+0000", 2023-10-08T07:07:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6000000000000003e-07 2023-10-08T07:07:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596531+0000", 2023-10-08T07:07:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8918000000000001e-05 2023-10-08T07:07:23.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:23.623 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596542+0000", 2023-10-08T07:07:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.062e-05 2023-10-08T07:07:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596549+0000", 2023-10-08T07:07:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3390000000000004e-06 2023-10-08T07:07:23.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596596+0000", 2023-10-08T07:07:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6650999999999998e-05 2023-10-08T07:07:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596672+0000", 2023-10-08T07:07:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5914999999999994e-05 2023-10-08T07:07:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.626 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.596821+0000", 2023-10-08T07:07:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014988800000000001 2023-10-08T07:07:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:103244 4.5 4:a2ff1403:::10000000004.00000039:head [write 3424256~4096 in=4096b,write 3469312~4096 in=4096b,write 3518464~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:23.597056+0000", 2023-10-08T07:07:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0026665289999999999, 2023-10-08T07:07:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029812929999999999, 2023-10-08T07:07:23.627 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 103244 2023-10-08T07:07:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597056+0000", 2023-10-08T07:07:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597056+0000", 2023-10-08T07:07:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597057+0000", 2023-10-08T07:07:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2699999999999998e-07 2023-10-08T07:07:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.629 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597071+0000", 2023-10-08T07:07:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3767999999999999e-05 2023-10-08T07:07:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597080+0000", 2023-10-08T07:07:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9629999999999993e-06 2023-10-08T07:07:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.630 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597090+0000", 2023-10-08T07:07:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3360000000000001e-06 2023-10-08T07:07:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597139+0000", 2023-10-08T07:07:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8952000000000002e-05 2023-10-08T07:07:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597213+0000", 2023-10-08T07:07:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4278999999999998e-05 2023-10-08T07:07:23.631 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:103245 4.24 4:25ba01c5:::10000000004.00000035:head [write 1253376~4096 in=4096b,write 1261568~4096 in=4096b,write 1282048~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:23.597695+0000", 2023-10-08T07:07:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0020276420000000001, 2023-10-08T07:07:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0024201779999999998, 2023-10-08T07:07:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:23.632 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 103245 2023-10-08T07:07:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597695+0000", 2023-10-08T07:07:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.633 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597695+0000", 2023-10-08T07:07:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597696+0000", 2023-10-08T07:07:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2399999999999997e-07 2023-10-08T07:07:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:23.634 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597712+0000", 2023-10-08T07:07:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6098000000000001e-05 2023-10-08T07:07:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597723+0000", 2023-10-08T07:07:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1644999999999999e-05 2023-10-08T07:07:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.597732+0000", 2023-10-08T07:07:23.635 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6009999999999995e-06 2023-10-08T07:07:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.598244+0000", 2023-10-08T07:07:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00051211099999999999 2023-10-08T07:07:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.598331+0000", 2023-10-08T07:07:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6522999999999998e-05 2023-10-08T07:07:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.636 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:103247 4.5 4:a367a3e8:::10000000004.00000000:head [write 2154496~4096 in=4096b,write 2281472~4096 in=4096b,write 2580480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-10-08T07:07:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:23.598622+0000", 2023-10-08T07:07:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0011001069999999999, 2023-10-08T07:07:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0015499820000000001, 2023-10-08T07:07:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:23.637 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 103247 2023-10-08T07:07:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.598622+0000", 2023-10-08T07:07:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:23.638 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.598622+0000", 2023-10-08T07:07:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.598623+0000", 2023-10-08T07:07:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1620000000000001e-06 2023-10-08T07:07:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.598637+0000", 2023-10-08T07:07:23.639 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3541e-05 2023-10-08T07:07:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.598659+0000", 2023-10-08T07:07:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2455000000000001e-05 2023-10-08T07:07:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.598668+0000", 2023-10-08T07:07:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3669999999999997e-06 2023-10-08T07:07:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.640 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.599153+0000", 2023-10-08T07:07:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00048561999999999998 2023-10-08T07:07:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:23.599245+0000", 2023-10-08T07:07:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1902000000000002e-05 2023-10-08T07:07:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:07:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 8 2023-10-08T07:07:23.642 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:23.643 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:23.643 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:23.644 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:23.645 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:23.642+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:23.645 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:23.645 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:23.645 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:23.645 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:23.646 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:23.744 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:23.744+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:23.844 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:23.844+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:23.879 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:23.879 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:23.895 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:23.945 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:23.944+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:24.046 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:24.046+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:24.107 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:24.108 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:24.124 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:24.169 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:24.169+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:24.248 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:24.246+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:24.279 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2023-10-08T07:07:24.332 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:24.332 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:24.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:24.349 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:24.348+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:24.450 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:24.450+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:24.550 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:24.549+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:24.596 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:24.597 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:24.613 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:24.654 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:24.654+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:24.752 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:24.751+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:24.854 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:24.853+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:24.858 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:24.858 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:24.876 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:24.954 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:24.954+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:25.056 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:25.056+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:25.085 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:25.085 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:25.103 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:25.158 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:25.156+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:25.258 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:25.258+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:25.313 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:25.313 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:25.330 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:25.359 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:25.359+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:25.462 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:25.460+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:25.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2023-10-08T07:07:25.562 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:25.562+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:25.579 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:25.580 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:25.595 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:25.646 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:07:25.662 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:25.661+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:25.763 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:25.763+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:25.792 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:25.792 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:25.808 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:25.817 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:25.842 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:25.842 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:07:25.842 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:25.842 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:07:25.845 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:25.845 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:25.894 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:25.894+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:25.965 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:25.965+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:26.046 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:26.046 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:26.063 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:26.065 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:26.064+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:26.166 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:26.164+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:26.268 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:26.268+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:26.295 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T07:07:26.303 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:26.303 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:26.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:26.304 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:26.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.304 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36811 4.31 4:8ec1b377:::10000000004.00000019:head [write 3362816~4096,write 3395584~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.304 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:26.304 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.023666874, 2023-10-08T07:07:26.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96838670299999996, 2023-10-08T07:07:26.305 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.305 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.305 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.305 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.305 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.305 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36811 2023-10-08T07:07:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275531+0000", 2023-10-08T07:07:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:07:26.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275541+0000", 2023-10-08T07:07:26.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3360000000000001e-06 2023-10-08T07:07:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275551+0000", 2023-10-08T07:07:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.825e-06 2023-10-08T07:07:26.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275556+0000", 2023-10-08T07:07:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2089999999999996e-06 2023-10-08T07:07:26.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275592+0000", 2023-10-08T07:07:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6554000000000003e-05 2023-10-08T07:07:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.275599+0000", 2023-10-08T07:07:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4640000000000003e-06 2023-10-08T07:07:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.238899+0000", 2023-10-08T07:07:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96330046999999996 2023-10-08T07:07:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239016+0000", 2023-10-08T07:07:26.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116919 2023-10-08T07:07:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239123+0000", 2023-10-08T07:07:26.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010675000000000001 2023-10-08T07:07:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243715+0000", 2023-10-08T07:07:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045922469999999998 2023-10-08T07:07:26.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243760+0000", 2023-10-08T07:07:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4666000000000002e-05 2023-10-08T07:07:26.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243820+0000", 2023-10-08T07:07:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9760999999999999e-05 2023-10-08T07:07:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243917+0000", 2023-10-08T07:07:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7822e-05 2023-10-08T07:07:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.321 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36831 4.31 4:8de29a03:::10000000004.00000001:head [write 806912~8192,write 847872~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.016646955999999, 2023-10-08T07:07:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96330879000000003, 2023-10-08T07:07:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36831 2023-10-08T07:07:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282551+0000", 2023-10-08T07:07:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282564+0000", 2023-10-08T07:07:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2303999999999999e-05 2023-10-08T07:07:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282572+0000", 2023-10-08T07:07:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7849999999999992e-06 2023-10-08T07:07:26.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282579+0000", 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4610000000000002e-06 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282631+0000", 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2404999999999997e-05 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.282640+0000", 2023-10-08T07:07:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2640000000000008e-06 2023-10-08T07:07:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.239925+0000", 2023-10-08T07:07:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95728506499999999 2023-10-08T07:07:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240097+0000", 2023-10-08T07:07:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172497 2023-10-08T07:07:26.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240235+0000", 2023-10-08T07:07:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000137861 2023-10-08T07:07:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243935+0000", 2023-10-08T07:07:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037000819999999999 2023-10-08T07:07:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245706+0000", 2023-10-08T07:07:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001770972 2023-10-08T07:07:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245773+0000", 2023-10-08T07:07:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6840000000000004e-05 2023-10-08T07:07:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245859+0000", 2023-10-08T07:07:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6442999999999999e-05 2023-10-08T07:07:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36859 4.31 4:8de29a03:::10000000004.00000001:head [write 3850240~4096,write 3891200~4096,write 3919872~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.005903413999999, 2023-10-08T07:07:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95269757099999997, 2023-10-08T07:07:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.330 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36859 2023-10-08T07:07:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293294+0000", 2023-10-08T07:07:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293295+0000", 2023-10-08T07:07:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9500000000000001e-07 2023-10-08T07:07:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293335+0000", 2023-10-08T07:07:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9867999999999998e-05 2023-10-08T07:07:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293346+0000", 2023-10-08T07:07:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1070000000000001e-05 2023-10-08T07:07:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293353+0000", 2023-10-08T07:07:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2640000000000002e-06 2023-10-08T07:07:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293409+0000", 2023-10-08T07:07:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5926e-05 2023-10-08T07:07:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.293418+0000", 2023-10-08T07:07:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9940000000000006e-06 2023-10-08T07:07:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240889+0000", 2023-10-08T07:07:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94747106400000003 2023-10-08T07:07:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.240963+0000", 2023-10-08T07:07:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3431999999999998e-05 2023-10-08T07:07:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241104+0000", 2023-10-08T07:07:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014119800000000001 2023-10-08T07:07:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243944+0000", 2023-10-08T07:07:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028404200000000002 2023-10-08T07:07:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245909+0000", 2023-10-08T07:07:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001964351 2023-10-08T07:07:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245942+0000", 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3526999999999999e-05 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245992+0000", 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9561999999999997e-05 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36861 4.31 4:8ec1b377:::10000000004.00000019:head [write 385024~4096,write 434176~4096,write 540672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.337 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.004994618000001, 2023-10-08T07:07:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.955921154, 2023-10-08T07:07:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36861 2023-10-08T07:07:26.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294203+0000", 2023-10-08T07:07:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294204+0000", 2023-10-08T07:07:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294216+0000", 2023-10-08T07:07:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2323999999999999e-05 2023-10-08T07:07:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294226+0000", 2023-10-08T07:07:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0217000000000001e-05 2023-10-08T07:07:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294234+0000", 2023-10-08T07:07:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6020000000000002e-06 2023-10-08T07:07:26.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294300+0000", 2023-10-08T07:07:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6515999999999998e-05 2023-10-08T07:07:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.294312+0000", 2023-10-08T07:07:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1379000000000001e-05 2023-10-08T07:07:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241814+0000", 2023-10-08T07:07:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.947501751 2023-10-08T07:07:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241863+0000", 2023-10-08T07:07:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9135999999999998e-05 2023-10-08T07:07:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.241953+0000", 2023-10-08T07:07:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0124000000000007e-05 2023-10-08T07:07:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243952+0000", 2023-10-08T07:07:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019988749999999998 2023-10-08T07:07:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250028+0000", 2023-10-08T07:07:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060766350000000004 2023-10-08T07:07:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250069+0000", 2023-10-08T07:07:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0794000000000003e-05 2023-10-08T07:07:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250124+0000", 2023-10-08T07:07:26.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4991000000000003e-05 2023-10-08T07:07:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.346 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36869 4.31 4:8ec1b377:::10000000004.00000019:head [write 917504~4096,write 983040~4096,write 1171456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.001678353999999, 2023-10-08T07:07:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95596831699999996, 2023-10-08T07:07:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36869 2023-10-08T07:07:26.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297519+0000", 2023-10-08T07:07:26.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297520+0000", 2023-10-08T07:07:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.23e-07 2023-10-08T07:07:26.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297532+0000", 2023-10-08T07:07:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1420000000000001e-05 2023-10-08T07:07:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297548+0000", 2023-10-08T07:07:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6711e-05 2023-10-08T07:07:26.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297557+0000", 2023-10-08T07:07:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3250000000000008e-06 2023-10-08T07:07:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297606+0000", 2023-10-08T07:07:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9724e-05 2023-10-08T07:07:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.297614+0000", 2023-10-08T07:07:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7889999999999995e-06 2023-10-08T07:07:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.242809+0000", 2023-10-08T07:07:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94519444900000005 2023-10-08T07:07:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.242885+0000", 2023-10-08T07:07:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6784000000000002e-05 2023-10-08T07:07:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.243025+0000", 2023-10-08T07:07:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013984300000000001 2023-10-08T07:07:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246003+0000", 2023-10-08T07:07:26.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002978072 2023-10-08T07:07:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253322+0000", 2023-10-08T07:07:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073190779999999997 2023-10-08T07:07:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253391+0000", 2023-10-08T07:07:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8285000000000001e-05 2023-10-08T07:07:26.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253488+0000", 2023-10-08T07:07:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7014000000000003e-05 2023-10-08T07:07:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36881 4.31 4:8ec1b377:::10000000004.00000019:head [write 888832~4096,write 1191936~4096,write 1327104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:26.355 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.997610810000001, 2023-10-08T07:07:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95214402799999998, 2023-10-08T07:07:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36881 2023-10-08T07:07:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301587+0000", 2023-10-08T07:07:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301588+0000", 2023-10-08T07:07:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.02e-06 2023-10-08T07:07:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301600+0000", 2023-10-08T07:07:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2377e-05 2023-10-08T07:07:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301611+0000", 2023-10-08T07:07:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0446e-05 2023-10-08T07:07:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301621+0000", 2023-10-08T07:07:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0338e-05 2023-10-08T07:07:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301668+0000", 2023-10-08T07:07:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7459000000000001e-05 2023-10-08T07:07:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.301674+0000", 2023-10-08T07:07:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7910000000000001e-06 2023-10-08T07:07:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244001+0000", 2023-10-08T07:07:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94232701200000002 2023-10-08T07:07:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244082+0000", 2023-10-08T07:07:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0615e-05 2023-10-08T07:07:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244202+0000", 2023-10-08T07:07:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120427 2023-10-08T07:07:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246009+0000", 2023-10-08T07:07:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018070899999999999 2023-10-08T07:07:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253544+0000", 2023-10-08T07:07:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075350729999999998 2023-10-08T07:07:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253607+0000", 2023-10-08T07:07:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2810000000000003e-05 2023-10-08T07:07:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253731+0000", 2023-10-08T07:07:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012357000000000001 2023-10-08T07:07:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36900 4.31 4:8de29a03:::10000000004.00000001:head [write 3239936~4096,write 3371008~4096,write 3878912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.991287503999999, 2023-10-08T07:07:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94607822699999999, 2023-10-08T07:07:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36900 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307910+0000", 2023-10-08T07:07:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307911+0000", 2023-10-08T07:07:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0210000000000001e-06 2023-10-08T07:07:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307926+0000", 2023-10-08T07:07:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4375e-05 2023-10-08T07:07:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307936+0000", 2023-10-08T07:07:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0124e-05 2023-10-08T07:07:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307950+0000", 2023-10-08T07:07:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4659e-05 2023-10-08T07:07:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.307998+0000", 2023-10-08T07:07:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8170000000000001e-05 2023-10-08T07:07:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.308005+0000", 2023-10-08T07:07:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3339999999999998e-06 2023-10-08T07:07:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244911+0000", 2023-10-08T07:07:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93690596699999995 2023-10-08T07:07:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.244972+0000", 2023-10-08T07:07:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0854999999999999e-05 2023-10-08T07:07:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.245073+0000", 2023-10-08T07:07:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101406 2023-10-08T07:07:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250135+0000", 2023-10-08T07:07:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050614620000000001 2023-10-08T07:07:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253786+0000", 2023-10-08T07:07:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003651615 2023-10-08T07:07:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253860+0000", 2023-10-08T07:07:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3631e-05 2023-10-08T07:07:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253988+0000", 2023-10-08T07:07:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000128608 2023-10-08T07:07:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36907 4.31 4:8de29a03:::10000000004.00000001:head [write 53248~4096,write 192512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.988046398000002, 2023-10-08T07:07:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94298633799999998, 2023-10-08T07:07:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36907 2023-10-08T07:07:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311151+0000", 2023-10-08T07:07:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311152+0000", 2023-10-08T07:07:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3200000000000005e-07 2023-10-08T07:07:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311158+0000", 2023-10-08T07:07:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2219999999999999e-06 2023-10-08T07:07:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311166+0000", 2023-10-08T07:07:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5209999999999997e-06 2023-10-08T07:07:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311169+0000", 2023-10-08T07:07:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.568e-06 2023-10-08T07:07:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311202+0000", 2023-10-08T07:07:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3346000000000002e-05 2023-10-08T07:07:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.311208+0000", 2023-10-08T07:07:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.259e-06 2023-10-08T07:07:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246041+0000", 2023-10-08T07:07:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93483340400000003 2023-10-08T07:07:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246088+0000", 2023-10-08T07:07:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6653999999999998e-05 2023-10-08T07:07:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246173+0000", 2023-10-08T07:07:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5327999999999993e-05 2023-10-08T07:07:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253252+0000", 2023-10-08T07:07:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070788170000000003 2023-10-08T07:07:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254057+0000", 2023-10-08T07:07:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00080496300000000001 2023-10-08T07:07:26.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254090+0000", 2023-10-08T07:07:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3325999999999999e-05 2023-10-08T07:07:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254138+0000", 2023-10-08T07:07:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7398000000000003e-05 2023-10-08T07:07:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.379 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36955 4.31 4:8ec1b377:::10000000004.00000019:head [write 3538944~8192,write 3620864~4096,write 3641344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.971003454000002, 2023-10-08T07:07:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92903069999999999, 2023-10-08T07:07:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.380 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36955 2023-10-08T07:07:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328194+0000", 2023-10-08T07:07:26.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328195+0000", 2023-10-08T07:07:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1600000000000001e-07 2023-10-08T07:07:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328208+0000", 2023-10-08T07:07:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3592e-05 2023-10-08T07:07:26.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328218+0000", 2023-10-08T07:07:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7270000000000002e-06 2023-10-08T07:07:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328226+0000", 2023-10-08T07:07:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.328e-06 2023-10-08T07:07:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328282+0000", 2023-10-08T07:07:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6156000000000002e-05 2023-10-08T07:07:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.328300+0000", 2023-10-08T07:07:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7805e-05 2023-10-08T07:07:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246679+0000", 2023-10-08T07:07:26.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91837927200000002 2023-10-08T07:07:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246743+0000", 2023-10-08T07:07:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4599999999999998e-05 2023-10-08T07:07:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.246838+0000", 2023-10-08T07:07:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5063999999999996e-05 2023-10-08T07:07:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.253747+0000", 2023-10-08T07:07:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069086210000000002 2023-10-08T07:07:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257129+0000", 2023-10-08T07:07:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033818210000000001 2023-10-08T07:07:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257167+0000", 2023-10-08T07:07:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8318999999999997e-05 2023-10-08T07:07:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257225+0000", 2023-10-08T07:07:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7679000000000001e-05 2023-10-08T07:07:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.387 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36966 4.31 4:8de29a03:::10000000004.00000001:head [write 2809856~4096,write 3076096~4096,write 3096576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.96709873, 2023-10-08T07:07:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92525588800000003, 2023-10-08T07:07:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36966 2023-10-08T07:07:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.388 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332099+0000", 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332100+0000", 2023-10-08T07:07:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0999999999999997e-07 2023-10-08T07:07:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332121+0000", 2023-10-08T07:07:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0914999999999999e-05 2023-10-08T07:07:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332128+0000", 2023-10-08T07:07:26.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8709999999999997e-06 2023-10-08T07:07:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332134+0000", 2023-10-08T07:07:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0839999999999999e-06 2023-10-08T07:07:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332182+0000", 2023-10-08T07:07:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8310000000000003e-05 2023-10-08T07:07:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.332187+0000", 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.242e-06 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248280+0000", 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91609321899999996 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248369+0000", 2023-10-08T07:07:26.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8895999999999997e-05 2023-10-08T07:07:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.248536+0000", 2023-10-08T07:07:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016709099999999999 2023-10-08T07:07:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257075+0000", 2023-10-08T07:07:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085385300000000008 2023-10-08T07:07:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257266+0000", 2023-10-08T07:07:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019079399999999999 2023-10-08T07:07:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257305+0000", 2023-10-08T07:07:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8996999999999999e-05 2023-10-08T07:07:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257355+0000", 2023-10-08T07:07:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0129000000000001e-05 2023-10-08T07:07:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:36968 4.31 4:8ec1b377:::10000000004.00000019:head [write 835584~4096,write 1372160~4096,write 1646592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.965378659999999, 2023-10-08T07:07:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92599244700000005, 2023-10-08T07:07:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.395 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 36968 2023-10-08T07:07:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333819+0000", 2023-10-08T07:07:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333820+0000", 2023-10-08T07:07:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1999999999999998e-07 2023-10-08T07:07:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333833+0000", 2023-10-08T07:07:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3574000000000001e-05 2023-10-08T07:07:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333848+0000", 2023-10-08T07:07:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4912999999999999e-05 2023-10-08T07:07:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333857+0000", 2023-10-08T07:07:26.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1270000000000003e-06 2023-10-08T07:07:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333903+0000", 2023-10-08T07:07:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6782e-05 2023-10-08T07:07:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.333911+0000", 2023-10-08T07:07:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5020000000000003e-06 2023-10-08T07:07:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250170+0000", 2023-10-08T07:07:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91625966299999995 2023-10-08T07:07:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250263+0000", 2023-10-08T07:07:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2252999999999999e-05 2023-10-08T07:07:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.250454+0000", 2023-10-08T07:07:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019164400000000001 2023-10-08T07:07:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258723+0000", 2023-10-08T07:07:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082687699999999999 2023-10-08T07:07:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259685+0000", 2023-10-08T07:07:26.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00096196599999999997 2023-10-08T07:07:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259739+0000", 2023-10-08T07:07:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4147999999999997e-05 2023-10-08T07:07:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259811+0000", 2023-10-08T07:07:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2185000000000001e-05 2023-10-08T07:07:26.402 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37036 4.31 4:8ec1b377:::10000000004.00000019:head [write 3309568~4096,write 3510272~4096,write 3620864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.939961809, 2023-10-08T07:07:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.90288029999999997, 2023-10-08T07:07:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37036 2023-10-08T07:07:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359236+0000", 2023-10-08T07:07:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6899999999999997e-07 2023-10-08T07:07:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359246+0000", 2023-10-08T07:07:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2369999999999998e-06 2023-10-08T07:07:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359254+0000", 2023-10-08T07:07:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4989999999999994e-06 2023-10-08T07:07:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359260+0000", 2023-10-08T07:07:26.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0209999999999996e-06 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359319+0000", 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9042999999999997e-05 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.359330+0000", 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0633e-05 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.251788+0000", 2023-10-08T07:07:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89245758100000006 2023-10-08T07:07:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.251887+0000", 2023-10-08T07:07:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9223999999999997e-05 2023-10-08T07:07:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.252083+0000", 2023-10-08T07:07:26.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019611800000000001 2023-10-08T07:07:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258731+0000", 2023-10-08T07:07:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006648307 2023-10-08T07:07:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262036+0000", 2023-10-08T07:07:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033046550000000001 2023-10-08T07:07:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262069+0000", 2023-10-08T07:07:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2753000000000003e-05 2023-10-08T07:07:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262116+0000", 2023-10-08T07:07:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7559999999999999e-05 2023-10-08T07:07:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.410 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37068 4.31 4:8de29a03:::10000000004.00000001:head [write 987136~4096,write 1011712~4096,write 1044480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.928282838000001, 2023-10-08T07:07:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89311213899999997, 2023-10-08T07:07:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37068 2023-10-08T07:07:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370915+0000", 2023-10-08T07:07:26.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370916+0000", 2023-10-08T07:07:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5000000000000002e-07 2023-10-08T07:07:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370956+0000", 2023-10-08T07:07:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0898e-05 2023-10-08T07:07:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370966+0000", 2023-10-08T07:07:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6209999999999999e-06 2023-10-08T07:07:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.370973+0000", 2023-10-08T07:07:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.601e-06 2023-10-08T07:07:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.371022+0000", 2023-10-08T07:07:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9811999999999997e-05 2023-10-08T07:07:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.371032+0000", 2023-10-08T07:07:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8120000000000002e-06 2023-10-08T07:07:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254175+0000", 2023-10-08T07:07:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88314265599999997 2023-10-08T07:07:26.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254256+0000", 2023-10-08T07:07:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0820000000000002e-05 2023-10-08T07:07:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.254436+0000", 2023-10-08T07:07:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000180044 2023-10-08T07:07:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261274+0000", 2023-10-08T07:07:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006838434 2023-10-08T07:07:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.263950+0000", 2023-10-08T07:07:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026753829999999999 2023-10-08T07:07:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.263981+0000", 2023-10-08T07:07:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1568e-05 2023-10-08T07:07:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.264027+0000", 2023-10-08T07:07:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5739999999999999e-05 2023-10-08T07:07:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37088 4.31 4:8de29a03:::10000000004.00000001:head [write 1466368~8192,write 1515520~4096,write 1523712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:26.419 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.920373960999999, 2023-10-08T07:07:26.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88701907199999996, 2023-10-08T07:07:26.419 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.419 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.419 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37088 2023-10-08T07:07:26.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.419 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378824+0000", 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378825+0000", 2023-10-08T07:07:26.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7199999999999997e-07 2023-10-08T07:07:26.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378841+0000", 2023-10-08T07:07:26.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5999e-05 2023-10-08T07:07:26.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378851+0000", 2023-10-08T07:07:26.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0474e-05 2023-10-08T07:07:26.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378858+0000", 2023-10-08T07:07:26.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9840000000000004e-06 2023-10-08T07:07:26.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378904+0000", 2023-10-08T07:07:26.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5704999999999997e-05 2023-10-08T07:07:26.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.378910+0000", 2023-10-08T07:07:26.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5039999999999999e-06 2023-10-08T07:07:26.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255278+0000", 2023-10-08T07:07:26.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.87636765000000005 2023-10-08T07:07:26.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255385+0000", 2023-10-08T07:07:26.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000106667 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.255557+0000", 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172957 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261279+0000", 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00572195 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265761+0000", 2023-10-08T07:07:26.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004481423 2023-10-08T07:07:26.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265796+0000", 2023-10-08T07:07:26.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4727000000000001e-05 2023-10-08T07:07:26.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265843+0000", 2023-10-08T07:07:26.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7160000000000002e-05 2023-10-08T07:07:26.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.426 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.426 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37130 4.31 4:8ec1b377:::10000000004.00000019:head [write 1658880~4096,write 1736704~4096,write 1794048~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.426 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:26.426 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.903204077000002, 2023-10-08T07:07:26.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86998378399999998, 2023-10-08T07:07:26.426 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.426 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.427 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.427 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.427 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37130 2023-10-08T07:07:26.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.427 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:26.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395994+0000", 2023-10-08T07:07:26.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.395995+0000", 2023-10-08T07:07:26.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9600000000000008e-07 2023-10-08T07:07:26.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396008+0000", 2023-10-08T07:07:26.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3067999999999999e-05 2023-10-08T07:07:26.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396019+0000", 2023-10-08T07:07:26.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1561e-05 2023-10-08T07:07:26.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396027+0000", 2023-10-08T07:07:26.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9039999999999992e-06 2023-10-08T07:07:26.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396075+0000", 2023-10-08T07:07:26.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8165999999999999e-05 2023-10-08T07:07:26.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.396081+0000", 2023-10-08T07:07:26.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8279999999999999e-06 2023-10-08T07:07:26.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256171+0000", 2023-10-08T07:07:26.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86008956199999997 2023-10-08T07:07:26.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256218+0000", 2023-10-08T07:07:26.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7018000000000003e-05 2023-10-08T07:07:26.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.256315+0000", 2023-10-08T07:07:26.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7285000000000001e-05 2023-10-08T07:07:26.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.262125+0000", 2023-10-08T07:07:26.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058099110000000001 2023-10-08T07:07:26.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265890+0000", 2023-10-08T07:07:26.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037655829999999999 2023-10-08T07:07:26.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265929+0000", 2023-10-08T07:07:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8068999999999998e-05 2023-10-08T07:07:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265977+0000", 2023-10-08T07:07:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8832999999999998e-05 2023-10-08T07:07:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.434 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37183 4.31 4:8ec1b377:::10000000004.00000019:head [write 16384~4096,write 364544~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.434 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:26.434 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.884023020000001, 2023-10-08T07:07:26.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.85095945399999995, 2023-10-08T07:07:26.434 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.434 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.434 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37183 2023-10-08T07:07:26.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.435 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:26.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:26.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415175+0000", 2023-10-08T07:07:26.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6499999999999998e-07 2023-10-08T07:07:26.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415186+0000", 2023-10-08T07:07:26.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0404999999999999e-05 2023-10-08T07:07:26.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415198+0000", 2023-10-08T07:07:26.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.187e-05 2023-10-08T07:07:26.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415204+0000", 2023-10-08T07:07:26.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5119999999999997e-06 2023-10-08T07:07:26.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415259+0000", 2023-10-08T07:07:26.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5269999999999998e-05 2023-10-08T07:07:26.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.415270+0000", 2023-10-08T07:07:26.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0716e-05 2023-10-08T07:07:26.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257384+0000", 2023-10-08T07:07:26.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84211341500000003 2023-10-08T07:07:26.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257442+0000", 2023-10-08T07:07:26.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8780999999999998e-05 2023-10-08T07:07:26.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.257538+0000", 2023-10-08T07:07:26.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5956000000000001e-05 2023-10-08T07:07:26.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265987+0000", 2023-10-08T07:07:26.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008449069 2023-10-08T07:07:26.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266053+0000", 2023-10-08T07:07:26.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5813000000000002e-05 2023-10-08T07:07:26.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266089+0000", 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5827000000000001e-05 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266134+0000", 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5055000000000001e-05 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.442 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37188 4.31 4:8de29a03:::10000000004.00000001:head [write 2031616~4096,write 2191360~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.442 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:26.442 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.881895699000001, 2023-10-08T07:07:26.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.850341613, 2023-10-08T07:07:26.442 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.442 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.442 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37188 2023-10-08T07:07:26.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.443 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:26.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417302+0000", 2023-10-08T07:07:26.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417303+0000", 2023-10-08T07:07:26.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0599999999999999e-07 2023-10-08T07:07:26.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417315+0000", 2023-10-08T07:07:26.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2325e-05 2023-10-08T07:07:26.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417324+0000", 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8489999999999995e-06 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417331+0000", 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4599999999999997e-06 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417437+0000", 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105305 2023-10-08T07:07:26.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.417445+0000", 2023-10-08T07:07:26.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3040000000000005e-06 2023-10-08T07:07:26.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258113+0000", 2023-10-08T07:07:26.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84066830699999995 2023-10-08T07:07:26.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258168+0000", 2023-10-08T07:07:26.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4258999999999997e-05 2023-10-08T07:07:26.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258255+0000", 2023-10-08T07:07:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7235000000000001e-05 2023-10-08T07:07:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265993+0000", 2023-10-08T07:07:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077377599999999998 2023-10-08T07:07:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267565+0000", 2023-10-08T07:07:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001572314 2023-10-08T07:07:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267597+0000", 2023-10-08T07:07:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2361999999999999e-05 2023-10-08T07:07:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.267644+0000", 2023-10-08T07:07:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6326999999999999e-05 2023-10-08T07:07:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37197 4.31 4:8de29a03:::10000000004.00000001:head [write 1859584~4096,write 2220032~4096,write 2322432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.878241719000002, 2023-10-08T07:07:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84767678599999996, 2023-10-08T07:07:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37197 2023-10-08T07:07:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420956+0000", 2023-10-08T07:07:26.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420957+0000", 2023-10-08T07:07:26.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9199999999999999e-07 2023-10-08T07:07:26.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420969+0000", 2023-10-08T07:07:26.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1753000000000001e-05 2023-10-08T07:07:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420981+0000", 2023-10-08T07:07:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2479e-05 2023-10-08T07:07:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.420989+0000", 2023-10-08T07:07:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0949999999999996e-06 2023-10-08T07:07:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.421053+0000", 2023-10-08T07:07:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4134999999999995e-05 2023-10-08T07:07:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.421062+0000", 2023-10-08T07:07:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8440000000000004e-06 2023-10-08T07:07:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258760+0000", 2023-10-08T07:07:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83769823499999996 2023-10-08T07:07:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258814+0000", 2023-10-08T07:07:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3876999999999999e-05 2023-10-08T07:07:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.258913+0000", 2023-10-08T07:07:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8323e-05 2023-10-08T07:07:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.265997+0000", 2023-10-08T07:07:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070839830000000003 2023-10-08T07:07:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268535+0000", 2023-10-08T07:07:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002538836 2023-10-08T07:07:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268574+0000", 2023-10-08T07:07:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8606000000000003e-05 2023-10-08T07:07:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268633+0000", 2023-10-08T07:07:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8727999999999997e-05 2023-10-08T07:07:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37227 4.31 4:8ec1b377:::10000000004.00000019:head [write 2760704~4096,write 2781184~4096,write 2850816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.867717748, 2023-10-08T07:07:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83736361400000003, 2023-10-08T07:07:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37227 2023-10-08T07:07:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431480+0000", 2023-10-08T07:07:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431481+0000", 2023-10-08T07:07:26.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8400000000000003e-07 2023-10-08T07:07:26.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431512+0000", 2023-10-08T07:07:26.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0803999999999998e-05 2023-10-08T07:07:26.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431525+0000", 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3704e-05 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431535+0000", 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2350000000000005e-06 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431585+0000", 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0531000000000001e-05 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.431594+0000", 2023-10-08T07:07:26.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7499999999999992e-06 2023-10-08T07:07:26.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259851+0000", 2023-10-08T07:07:26.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82825699399999997 2023-10-08T07:07:26.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.259914+0000", 2023-10-08T07:07:26.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2928999999999993e-05 2023-10-08T07:07:26.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.260024+0000", 2023-10-08T07:07:26.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000110556 2023-10-08T07:07:26.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266001+0000", 2023-10-08T07:07:26.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059769910000000001 2023-10-08T07:07:26.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268694+0000", 2023-10-08T07:07:26.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026924119999999999 2023-10-08T07:07:26.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268754+0000", 2023-10-08T07:07:26.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0562000000000001e-05 2023-10-08T07:07:26.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.268843+0000", 2023-10-08T07:07:26.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9262e-05 2023-10-08T07:07:26.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.466 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.466 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:37233 4.31 4:8de29a03:::10000000004.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-10-08T07:07:26.466 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:26.466 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.865510788999998, 2023-10-08T07:07:26.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83766958000000002, 2023-10-08T07:07:26.466 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:26.466 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:26.466 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:26.467 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:26.467 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.467 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 37233 2023-10-08T07:07:26.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.467 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:26.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:26.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:26.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:26.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433687+0000", 2023-10-08T07:07:26.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:26.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:26.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433688+0000", 2023-10-08T07:07:26.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999995e-07 2023-10-08T07:07:26.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:26.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433701+0000", 2023-10-08T07:07:26.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3869000000000001e-05 2023-10-08T07:07:26.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:26.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433714+0000", 2023-10-08T07:07:26.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2173e-05 2023-10-08T07:07:26.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433720+0000", 2023-10-08T07:07:26.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7449999999999998e-06 2023-10-08T07:07:26.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433772+0000", 2023-10-08T07:07:26.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1242999999999997e-05 2023-10-08T07:07:26.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2023-10-08T07:07:26.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:06:59.433781+0000", 2023-10-08T07:07:26.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1360000000000003e-06 2023-10-08T07:07:26.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:26.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261313+0000", 2023-10-08T07:07:26.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82753250300000003 2023-10-08T07:07:26.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:26.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261367+0000", 2023-10-08T07:07:26.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3664e-05 2023-10-08T07:07:26.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:26.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.261467+0000", 2023-10-08T07:07:26.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9668999999999997e-05 2023-10-08T07:07:26.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.266010+0000", 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045437189999999999 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271269+0000", 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052584900000000002 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:26.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271310+0000", 2023-10-08T07:07:26.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1057999999999999e-05 2023-10-08T07:07:26.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:26.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:26.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:26.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:00.271356+0000", 2023-10-08T07:07:26.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6582999999999998e-05 2023-10-08T07:07:26.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.473 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:26.473 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:26.473 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:26.475 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:26.474+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:26.475 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:26.576 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:26.575+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:26.676 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:26.675+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:26.683 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:26.683 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:26.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.683 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111843 4.38 4:1e0977c7:::10000000004.00000022:head [write 3608576~4096 in=4096b,write 3624960~4096 in=4096b,write 3739648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.683 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.665209+0000", 2023-10-08T07:07:26.684 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013943057999999999, 2023-10-08T07:07:26.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013978532, 2023-10-08T07:07:26.684 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.684 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.684 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.684 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.684 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.684 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111843 2023-10-08T07:07:26.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.684 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.665209+0000", 2023-10-08T07:07:26.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.665209+0000", 2023-10-08T07:07:26.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.665210+0000", 2023-10-08T07:07:26.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3500000000000005e-07 2023-10-08T07:07:26.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.665222+0000", 2023-10-08T07:07:26.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1578e-05 2023-10-08T07:07:26.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.665238+0000", 2023-10-08T07:07:26.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6120000000000002e-05 2023-10-08T07:07:26.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.687 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.665245+0000", 2023-10-08T07:07:26.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1199999999999996e-06 2023-10-08T07:07:26.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.687 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.665304+0000", 2023-10-08T07:07:26.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9304e-05 2023-10-08T07:07:26.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.665420+0000", 2023-10-08T07:07:26.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000115729 2023-10-08T07:07:26.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.665608+0000", 2023-10-08T07:07:26.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018835499999999999 2023-10-08T07:07:26.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667756+0000", 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0021474480000000002 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111868 4.38 4:1e0977c7:::10000000004.00000022:head [write 724992~4096 in=4096b,write 753664~4096 in=4096b,write 782336~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.675002+0000", 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0041498439999999998, 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042878380000000004, 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.689 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.690 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.690 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.690 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111868 2023-10-08T07:07:26.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.690 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675002+0000", 2023-10-08T07:07:26.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675002+0000", 2023-10-08T07:07:26.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675003+0000", 2023-10-08T07:07:26.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4499999999999996e-07 2023-10-08T07:07:26.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675019+0000", 2023-10-08T07:07:26.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6169999999999999e-05 2023-10-08T07:07:26.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675029+0000", 2023-10-08T07:07:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0008e-05 2023-10-08T07:07:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675037+0000", 2023-10-08T07:07:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5310000000000004e-06 2023-10-08T07:07:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675082+0000", 2023-10-08T07:07:26.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5209e-05 2023-10-08T07:07:26.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675167+0000", 2023-10-08T07:07:26.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5323999999999998e-05 2023-10-08T07:07:26.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675344+0000", 2023-10-08T07:07:26.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000176689 2023-10-08T07:07:26.697 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.697 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.697 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.697 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111870 4.1 4:8277d31e:::10000000004.00000013:head [write 1609728~4096 in=4096b,write 1699840~4096 in=4096b,write 1732608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.697 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.675052+0000", 2023-10-08T07:07:26.697 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0040999859999999999, 2023-10-08T07:07:26.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0043220589999999996, 2023-10-08T07:07:26.698 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.698 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:26.698 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.698 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.698 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.698 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111870 2023-10-08T07:07:26.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.699 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675052+0000", 2023-10-08T07:07:26.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675052+0000", 2023-10-08T07:07:26.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675053+0000", 2023-10-08T07:07:26.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.82e-07 2023-10-08T07:07:26.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675064+0000", 2023-10-08T07:07:26.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1523e-05 2023-10-08T07:07:26.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675071+0000", 2023-10-08T07:07:26.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0400000000000004e-06 2023-10-08T07:07:26.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675077+0000", 2023-10-08T07:07:26.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6550000000000001e-06 2023-10-08T07:07:26.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676392+0000", 2023-10-08T07:07:26.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001315264 2023-10-08T07:07:26.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676472+0000", 2023-10-08T07:07:26.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0141000000000004e-05 2023-10-08T07:07:26.702 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.702 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.702 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.702 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111872 4.2 4.a29e5702 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.703 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.675085+0000", 2023-10-08T07:07:26.703 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0040675449999999997, 2023-10-08T07:07:26.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0043610769999999997, 2023-10-08T07:07:26.703 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.703 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:26.703 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.703 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.703 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.703 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111872 2023-10-08T07:07:26.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.703 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675085+0000", 2023-10-08T07:07:26.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675085+0000", 2023-10-08T07:07:26.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675085+0000", 2023-10-08T07:07:26.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2899999999999999e-07 2023-10-08T07:07:26.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675094+0000", 2023-10-08T07:07:26.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9150000000000002e-06 2023-10-08T07:07:26.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675100+0000", 2023-10-08T07:07:26.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0270000000000001e-06 2023-10-08T07:07:26.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675105+0000", 2023-10-08T07:07:26.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8620000000000002e-06 2023-10-08T07:07:26.706 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.706 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.706 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.706 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111873 4.3a 4.d27c18fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.706 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.675149+0000", 2023-10-08T07:07:26.707 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.004003113, 2023-10-08T07:07:26.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0043552490000000003, 2023-10-08T07:07:26.707 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.707 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:26.707 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.707 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.707 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.707 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111873 2023-10-08T07:07:26.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.707 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675149+0000", 2023-10-08T07:07:26.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675149+0000", 2023-10-08T07:07:26.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675150+0000", 2023-10-08T07:07:26.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.61e-07 2023-10-08T07:07:26.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676300+0000", 2023-10-08T07:07:26.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011502789999999999 2023-10-08T07:07:26.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676310+0000", 2023-10-08T07:07:26.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8989999999999996e-06 2023-10-08T07:07:26.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676318+0000", 2023-10-08T07:07:26.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2400000000000007e-06 2023-10-08T07:07:26.710 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.711 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.711 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.711 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111849 4.c 4:3352c333:::10000000004.00000012:head [write 3362816~4096 in=4096b,write 3432448~4096 in=4096b,write 3543040~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.712 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.667631+0000", 2023-10-08T07:07:26.712 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.011520815, 2023-10-08T07:07:26.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011978224000000001, 2023-10-08T07:07:26.712 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.712 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.712 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.712 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.712 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.713 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111849 2023-10-08T07:07:26.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.713 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667631+0000", 2023-10-08T07:07:26.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667631+0000", 2023-10-08T07:07:26.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667632+0000", 2023-10-08T07:07:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4199999999999995e-07 2023-10-08T07:07:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667642+0000", 2023-10-08T07:07:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8349999999999999e-06 2023-10-08T07:07:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667651+0000", 2023-10-08T07:07:26.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9190000000000005e-06 2023-10-08T07:07:26.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667656+0000", 2023-10-08T07:07:26.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4539999999999998e-06 2023-10-08T07:07:26.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667709+0000", 2023-10-08T07:07:26.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2874000000000002e-05 2023-10-08T07:07:26.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667803+0000", 2023-10-08T07:07:26.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4030000000000006e-05 2023-10-08T07:07:26.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667923+0000", 2023-10-08T07:07:26.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011972300000000001 2023-10-08T07:07:26.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675639+0000", 2023-10-08T07:07:26.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0077160889999999998 2023-10-08T07:07:26.717 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.717 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.717 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.717 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111850 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2781184~4096 in=4096b,write 2797568~4096 in=4096b,write 2805760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.717 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.667951+0000", 2023-10-08T07:07:26.717 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.011201262999999999, 2023-10-08T07:07:26.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011770511000000001, 2023-10-08T07:07:26.718 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.718 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.718 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.718 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.718 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.718 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111850 2023-10-08T07:07:26.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.718 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667951+0000", 2023-10-08T07:07:26.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667951+0000", 2023-10-08T07:07:26.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667952+0000", 2023-10-08T07:07:26.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7400000000000003e-07 2023-10-08T07:07:26.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667960+0000", 2023-10-08T07:07:26.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2949999999999994e-06 2023-10-08T07:07:26.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667967+0000", 2023-10-08T07:07:26.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2130000000000002e-06 2023-10-08T07:07:26.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667972+0000", 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9359999999999998e-06 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.668012+0000", 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9551999999999997e-05 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.668062+0000", 2023-10-08T07:07:26.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0658000000000002e-05 2023-10-08T07:07:26.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.668169+0000", 2023-10-08T07:07:26.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000106418 2023-10-08T07:07:26.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679700+0000", 2023-10-08T07:07:26.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011531575000000001 2023-10-08T07:07:26.722 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.723 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.723 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.723 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111813 4.30 4:0f322a22:::10000000004.00000014:head [write 3325952~4096 in=4096b,write 3354624~4096 in=4096b,write 3403776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.723 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.654456+0000", 2023-10-08T07:07:26.723 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.024696065, 2023-10-08T07:07:26.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.025375936000000002, 2023-10-08T07:07:26.723 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.723 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.723 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.723 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111813 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.654456+0000", 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.654456+0000", 2023-10-08T07:07:26.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.654457+0000", 2023-10-08T07:07:26.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7100000000000001e-07 2023-10-08T07:07:26.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.654469+0000", 2023-10-08T07:07:26.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1669e-05 2023-10-08T07:07:26.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.654480+0000", 2023-10-08T07:07:26.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.173e-05 2023-10-08T07:07:26.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.654490+0000", 2023-10-08T07:07:26.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8889999999999997e-06 2023-10-08T07:07:26.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.657187+0000", 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0026969300000000002 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.657267+0000", 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9671000000000003e-05 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.657406+0000", 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013881500000000001 2023-10-08T07:07:26.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.659665+0000", 2023-10-08T07:07:26.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022595570000000001 2023-10-08T07:07:26.728 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.728 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.728 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.728 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:111703 4.b e57/17 4:d0c991e0:::10000000004.0000002d:head v 57'1752, mlcod=57'1748)", 2023-10-08T07:07:26.728 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.676908+0000", 2023-10-08T07:07:26.728 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.002243793, 2023-10-08T07:07:26.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003033591, 2023-10-08T07:07:26.729 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.729 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:26.729 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676908+0000", 2023-10-08T07:07:26.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676908+0000", 2023-10-08T07:07:26.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676909+0000", 2023-10-08T07:07:26.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8999999999999998e-07 2023-10-08T07:07:26.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676923+0000", 2023-10-08T07:07:26.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3925e-05 2023-10-08T07:07:26.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676932+0000", 2023-10-08T07:07:26.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9800000000000004e-06 2023-10-08T07:07:26.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676937+0000", 2023-10-08T07:07:26.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6180000000000003e-06 2023-10-08T07:07:26.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676982+0000", 2023-10-08T07:07:26.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4536999999999997e-05 2023-10-08T07:07:26.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676999+0000", 2023-10-08T07:07:26.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7554000000000002e-05 2023-10-08T07:07:26.732 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.732 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.732 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111852 4.1a 4:5a59f83a:::10000000004.00000002:head [write 3145728~4096 in=4096b,write 3190784~4096 in=4096b,write 3366912~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.668797+0000", 2023-10-08T07:07:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.010354739999999999, 2023-10-08T07:07:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011226471999999999, 2023-10-08T07:07:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111852 2023-10-08T07:07:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.733 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.668797+0000", 2023-10-08T07:07:26.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.668797+0000", 2023-10-08T07:07:26.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.668798+0000", 2023-10-08T07:07:26.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1299999999999999e-07 2023-10-08T07:07:26.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.668809+0000", 2023-10-08T07:07:26.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1024e-05 2023-10-08T07:07:26.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.668823+0000", 2023-10-08T07:07:26.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3397000000000001e-05 2023-10-08T07:07:26.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.668830+0000", 2023-10-08T07:07:26.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0310000000000001e-06 2023-10-08T07:07:26.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.668879+0000", 2023-10-08T07:07:26.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9332999999999997e-05 2023-10-08T07:07:26.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.668961+0000", 2023-10-08T07:07:26.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1786000000000006e-05 2023-10-08T07:07:26.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.669131+0000", 2023-10-08T07:07:26.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016974399999999999 2023-10-08T07:07:26.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679686+0000", 2023-10-08T07:07:26.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010555421000000001 2023-10-08T07:07:26.738 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.739 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.739 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.739 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111878 4.2 4.508f73c2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.739 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.677509+0000", 2023-10-08T07:07:26.739 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0016432179999999999, 2023-10-08T07:07:26.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002610064, 2023-10-08T07:07:26.739 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.739 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:26.740 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.740 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.740 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.740 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111878 2023-10-08T07:07:26.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.740 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677509+0000", 2023-10-08T07:07:26.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677509+0000", 2023-10-08T07:07:26.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677510+0000", 2023-10-08T07:07:26.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6299999999999993e-07 2023-10-08T07:07:26.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677526+0000", 2023-10-08T07:07:26.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5897e-05 2023-10-08T07:07:26.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677540+0000", 2023-10-08T07:07:26.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4260000000000001e-05 2023-10-08T07:07:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677549+0000", 2023-10-08T07:07:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.251e-06 2023-10-08T07:07:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111853 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 3661824~4096 in=4096b,write 3854336~4096 in=4096b,write 3887104~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.669086+0000", 2023-10-08T07:07:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.01006635, 2023-10-08T07:07:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011101276, 2023-10-08T07:07:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111853 2023-10-08T07:07:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.744 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.669086+0000", 2023-10-08T07:07:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.669086+0000", 2023-10-08T07:07:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.669086+0000", 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.82e-07 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.669108+0000", 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1797000000000002e-05 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.669118+0000", 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4730000000000006e-06 2023-10-08T07:07:26.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.669124+0000", 2023-10-08T07:07:26.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.297e-06 2023-10-08T07:07:26.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670788+0000", 2023-10-08T07:07:26.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0016641659999999999 2023-10-08T07:07:26.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670872+0000", 2023-10-08T07:07:26.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3790999999999998e-05 2023-10-08T07:07:26.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671004+0000", 2023-10-08T07:07:26.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013223900000000001 2023-10-08T07:07:26.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679715+0000", 2023-10-08T07:07:26.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0087112769999999999 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111879 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.677562+0000", 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0015906, 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027091020000000001, 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.749 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.750 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.750 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111879 2023-10-08T07:07:26.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.750 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677562+0000", 2023-10-08T07:07:26.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677562+0000", 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677562+0000", 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4199999999999996e-07 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677573+0000", 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0458e-05 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677579+0000", 2023-10-08T07:07:26.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8369999999999999e-06 2023-10-08T07:07:26.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677585+0000", 2023-10-08T07:07:26.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3120000000000001e-06 2023-10-08T07:07:26.752 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.752 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.752 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.753 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111880 4.c 4:3352c333:::10000000004.00000012:head [write 1970176~4096 in=4096b,write 1982464~4096 in=4096b,write 2187264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.753 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.677699+0000", 2023-10-08T07:07:26.753 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.001453651, 2023-10-08T07:07:26.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002643655, 2023-10-08T07:07:26.753 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.753 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.753 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.753 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.753 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.753 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111880 2023-10-08T07:07:26.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.754 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677699+0000", 2023-10-08T07:07:26.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677699+0000", 2023-10-08T07:07:26.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677699+0000", 2023-10-08T07:07:26.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1999999999999999e-07 2023-10-08T07:07:26.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677715+0000", 2023-10-08T07:07:26.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6042999999999999e-05 2023-10-08T07:07:26.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677727+0000", 2023-10-08T07:07:26.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.171e-05 2023-10-08T07:07:26.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677733+0000", 2023-10-08T07:07:26.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0440000000000001e-06 2023-10-08T07:07:26.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677783+0000", 2023-10-08T07:07:26.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0040999999999997e-05 2023-10-08T07:07:26.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677879+0000", 2023-10-08T07:07:26.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6086000000000001e-05 2023-10-08T07:07:26.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678016+0000", 2023-10-08T07:07:26.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013636 2023-10-08T07:07:26.758 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.758 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.758 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.758 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111854 4.3a 4:5f183e4b:::10000000004.00000023:head [write 3170304~4096 in=4096b,write 3203072~4096 in=4096b,write 3264512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.759 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.670120+0000", 2023-10-08T07:07:26.759 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0090318350000000002, 2023-10-08T07:07:26.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010309005, 2023-10-08T07:07:26.759 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.759 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.759 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.759 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.759 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.759 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111854 2023-10-08T07:07:26.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.759 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670120+0000", 2023-10-08T07:07:26.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670120+0000", 2023-10-08T07:07:26.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670121+0000", 2023-10-08T07:07:26.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5499999999999998e-07 2023-10-08T07:07:26.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670130+0000", 2023-10-08T07:07:26.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8710000000000003e-06 2023-10-08T07:07:26.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670140+0000", 2023-10-08T07:07:26.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0023999999999999e-05 2023-10-08T07:07:26.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670145+0000", 2023-10-08T07:07:26.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5230000000000003e-06 2023-10-08T07:07:26.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673700+0000", 2023-10-08T07:07:26.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0035546319999999998 2023-10-08T07:07:26.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673790+0000", 2023-10-08T07:07:26.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9760999999999997e-05 2023-10-08T07:07:26.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673938+0000", 2023-10-08T07:07:26.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000147885 2023-10-08T07:07:26.763 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.763 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.763 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.764 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:111839 4.31 e57/48 4:8ec1b377:::10000000004.00000019:head v 57'3446, mlcod=57'3440)", 2023-10-08T07:07:26.764 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.678387+0000", 2023-10-08T07:07:26.765 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00076544199999999997, 2023-10-08T07:07:26.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0021163010000000001, 2023-10-08T07:07:26.765 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.765 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:26.765 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678387+0000", 2023-10-08T07:07:26.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678387+0000", 2023-10-08T07:07:26.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678387+0000", 2023-10-08T07:07:26.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2000000000000001e-07 2023-10-08T07:07:26.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678404+0000", 2023-10-08T07:07:26.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.679e-05 2023-10-08T07:07:26.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678411+0000", 2023-10-08T07:07:26.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5410000000000003e-06 2023-10-08T07:07:26.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678417+0000", 2023-10-08T07:07:26.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2009999999999998e-06 2023-10-08T07:07:26.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678461+0000", 2023-10-08T07:07:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4447999999999999e-05 2023-10-08T07:07:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678484+0000", 2023-10-08T07:07:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2821000000000001e-05 2023-10-08T07:07:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.768 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111857 4.c 4:31e28161:::10000000004.00000011:head [write 2633728~4096 in=4096b,write 2711552~4096 in=4096b,write 2727936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.670380+0000", 2023-10-08T07:07:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0087721350000000003, 2023-10-08T07:07:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010187289, 2023-10-08T07:07:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.769 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111857 2023-10-08T07:07:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670380+0000", 2023-10-08T07:07:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670380+0000", 2023-10-08T07:07:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670381+0000", 2023-10-08T07:07:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3799999999999996e-07 2023-10-08T07:07:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670393+0000", 2023-10-08T07:07:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1724e-05 2023-10-08T07:07:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670404+0000", 2023-10-08T07:07:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1857e-05 2023-10-08T07:07:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670412+0000", 2023-10-08T07:07:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8930000000000005e-06 2023-10-08T07:07:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670468+0000", 2023-10-08T07:07:26.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5392000000000001e-05 2023-10-08T07:07:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670564+0000", 2023-10-08T07:07:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5898999999999998e-05 2023-10-08T07:07:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.670776+0000", 2023-10-08T07:07:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000212289 2023-10-08T07:07:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675646+0000", 2023-10-08T07:07:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048705129999999999 2023-10-08T07:07:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111881 4.c 4.ccc34acc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.678389+0000", 2023-10-08T07:07:26.774 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00076302499999999997, 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0022553389999999999, 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111881 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678389+0000", 2023-10-08T07:07:26.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678389+0000", 2023-10-08T07:07:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678390+0000", 2023-10-08T07:07:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.54e-07 2023-10-08T07:07:26.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678404+0000", 2023-10-08T07:07:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3837e-05 2023-10-08T07:07:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678413+0000", 2023-10-08T07:07:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5689999999999994e-06 2023-10-08T07:07:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678421+0000", 2023-10-08T07:07:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7849999999999992e-06 2023-10-08T07:07:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111859 4.2 4:43cef10a:::10000000004.00000030:head [write 266240~4096 in=4096b,write 290816~4096 in=4096b,write 323584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.671138+0000", 2023-10-08T07:07:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0080137439999999997, 2023-10-08T07:07:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0095641779999999996, 2023-10-08T07:07:26.778 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111859 2023-10-08T07:07:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671138+0000", 2023-10-08T07:07:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671138+0000", 2023-10-08T07:07:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671139+0000", 2023-10-08T07:07:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6700000000000003e-07 2023-10-08T07:07:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671178+0000", 2023-10-08T07:07:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9103000000000002e-05 2023-10-08T07:07:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671196+0000", 2023-10-08T07:07:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7782999999999999e-05 2023-10-08T07:07:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671204+0000", 2023-10-08T07:07:26.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9200000000000004e-06 2023-10-08T07:07:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676530+0000", 2023-10-08T07:07:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0053255630000000002 2023-10-08T07:07:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.676618+0000", 2023-10-08T07:07:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8759999999999997e-05 2023-10-08T07:07:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.782 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:109871 4.0 e57/17 4:02bf98b6:::10000000004.0000000e:head v 57'1707, mlcod=57'1704)", 2023-10-08T07:07:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.678433+0000", 2023-10-08T07:07:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00071953900000000005, 2023-10-08T07:07:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0023359750000000001, 2023-10-08T07:07:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678433+0000", 2023-10-08T07:07:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678433+0000", 2023-10-08T07:07:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678433+0000", 2023-10-08T07:07:26.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6899999999999999e-07 2023-10-08T07:07:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678444+0000", 2023-10-08T07:07:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1008e-05 2023-10-08T07:07:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678450+0000", 2023-10-08T07:07:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.178e-06 2023-10-08T07:07:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678455+0000", 2023-10-08T07:07:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4780000000000002e-06 2023-10-08T07:07:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678491+0000", 2023-10-08T07:07:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6183000000000002e-05 2023-10-08T07:07:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.678510+0000", 2023-10-08T07:07:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9522e-05 2023-10-08T07:07:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111883 4.a 4.6e5df24a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.679368+0000", 2023-10-08T07:07:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.999784, 2023-10-08T07:07:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0014594090000000001, 2023-10-08T07:07:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.787 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:26.788 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.788 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.788 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.788 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111883 2023-10-08T07:07:26.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.788 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679368+0000", 2023-10-08T07:07:26.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679368+0000", 2023-10-08T07:07:26.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679369+0000", 2023-10-08T07:07:26.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7199999999999999e-07 2023-10-08T07:07:26.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679377+0000", 2023-10-08T07:07:26.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2320000000000001e-06 2023-10-08T07:07:26.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679400+0000", 2023-10-08T07:07:26.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3090000000000001e-05 2023-10-08T07:07:26.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679411+0000", 2023-10-08T07:07:26.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1249e-05 2023-10-08T07:07:26.790 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.791 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.791 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.791 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111884 4.2b 4:d776c1c9:::10000000004.0000003d:head [write 2822144~4096 in=4096b,write 2965504~4096 in=4096b,write 3133440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.791 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.679432+0000", 2023-10-08T07:07:26.791 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9997206, 2023-10-08T07:07:26.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0014561489999999999, 2023-10-08T07:07:26.791 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.791 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.791 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.791 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.792 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.792 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111884 2023-10-08T07:07:26.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.792 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679432+0000", 2023-10-08T07:07:26.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679432+0000", 2023-10-08T07:07:26.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679432+0000", 2023-10-08T07:07:26.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0500000000000003e-07 2023-10-08T07:07:26.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679447+0000", 2023-10-08T07:07:26.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4246999999999999e-05 2023-10-08T07:07:26.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679458+0000", 2023-10-08T07:07:26.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1615e-05 2023-10-08T07:07:26.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679465+0000", 2023-10-08T07:07:26.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9240000000000001e-06 2023-10-08T07:07:26.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679521+0000", 2023-10-08T07:07:26.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6084e-05 2023-10-08T07:07:26.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679636+0000", 2023-10-08T07:07:26.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000114466 2023-10-08T07:07:26.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.679811+0000", 2023-10-08T07:07:26.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017474100000000001 2023-10-08T07:07:26.796 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.796 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.796 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.796 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111826 4.1b 4:d97fb168:::10000000004.00000008:head [write 573440~4096 in=4096b,write 634880~4096 in=4096b,write 1179648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.796 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.659579+0000", 2023-10-08T07:07:26.796 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.019573568999999999, 2023-10-08T07:07:26.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021385853, 2023-10-08T07:07:26.796 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.797 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.797 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.797 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.797 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.797 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111826 2023-10-08T07:07:26.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.797 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.659579+0000", 2023-10-08T07:07:26.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.659579+0000", 2023-10-08T07:07:26.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.659579+0000", 2023-10-08T07:07:26.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3200000000000004e-07 2023-10-08T07:07:26.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.659591+0000", 2023-10-08T07:07:26.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1223000000000001e-05 2023-10-08T07:07:26.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.659602+0000", 2023-10-08T07:07:26.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1664999999999999e-05 2023-10-08T07:07:26.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.659610+0000", 2023-10-08T07:07:26.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9570000000000002e-06 2023-10-08T07:07:26.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.659747+0000", 2023-10-08T07:07:26.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000136637 2023-10-08T07:07:26.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.659848+0000", 2023-10-08T07:07:26.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000101403 2023-10-08T07:07:26.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660021+0000", 2023-10-08T07:07:26.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017237200000000001 2023-10-08T07:07:26.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.665806+0000", 2023-10-08T07:07:26.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0057855700000000003 2023-10-08T07:07:26.801 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.801 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.801 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.802 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111886 4.e 4:7242a848:::10000000004.00000020:head [write 4018176~4096 in=4096b,write 4112384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.802 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.680055+0000", 2023-10-08T07:07:26.802 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9990973, 2023-10-08T07:07:26.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00099076000000000003, 2023-10-08T07:07:26.802 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.802 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:26.802 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.802 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.802 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.803 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111886 2023-10-08T07:07:26.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.803 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680055+0000", 2023-10-08T07:07:26.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680055+0000", 2023-10-08T07:07:26.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680056+0000", 2023-10-08T07:07:26.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0139999999999999e-06 2023-10-08T07:07:26.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680069+0000", 2023-10-08T07:07:26.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3281e-05 2023-10-08T07:07:26.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680079+0000", 2023-10-08T07:07:26.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.013e-05 2023-10-08T07:07:26.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680087+0000", 2023-10-08T07:07:26.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6109999999999996e-06 2023-10-08T07:07:26.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680139+0000", 2023-10-08T07:07:26.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2240000000000001e-05 2023-10-08T07:07:26.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680220+0000", 2023-10-08T07:07:26.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0852000000000004e-05 2023-10-08T07:07:26.806 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.806 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.806 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.807 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111862 4.30 4:0f322a22:::10000000004.00000014:head [write 3002368~4096 in=4096b,write 3067904~4096 in=4096b,write 3080192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.807 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.671907+0000", 2023-10-08T07:07:26.807 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0072450489999999999, 2023-10-08T07:07:26.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0092096560000000001, 2023-10-08T07:07:26.807 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.807 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.807 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.807 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.807 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.807 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111862 2023-10-08T07:07:26.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.808 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671907+0000", 2023-10-08T07:07:26.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671907+0000", 2023-10-08T07:07:26.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671908+0000", 2023-10-08T07:07:26.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7400000000000003e-07 2023-10-08T07:07:26.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671919+0000", 2023-10-08T07:07:26.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1027e-05 2023-10-08T07:07:26.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671927+0000", 2023-10-08T07:07:26.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2470000000000008e-06 2023-10-08T07:07:26.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671933+0000", 2023-10-08T07:07:26.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2550000000000003e-06 2023-10-08T07:07:26.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.671988+0000", 2023-10-08T07:07:26.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4647e-05 2023-10-08T07:07:26.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.672064+0000", 2023-10-08T07:07:26.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5906000000000001e-05 2023-10-08T07:07:26.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.672237+0000", 2023-10-08T07:07:26.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017271699999999999 2023-10-08T07:07:26.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.677066+0000", 2023-10-08T07:07:26.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048290149999999999 2023-10-08T07:07:26.812 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.812 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.812 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.812 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111887 4.32 4.49293f72 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.812 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.680210+0000", 2023-10-08T07:07:26.813 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9989419, 2023-10-08T07:07:26.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00098905, 2023-10-08T07:07:26.813 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.813 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:26.813 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.813 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.813 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.813 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111887 2023-10-08T07:07:26.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.813 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.813 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680210+0000", 2023-10-08T07:07:26.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680210+0000", 2023-10-08T07:07:26.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680211+0000", 2023-10-08T07:07:26.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8800000000000002e-07 2023-10-08T07:07:26.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680235+0000", 2023-10-08T07:07:26.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3887999999999999e-05 2023-10-08T07:07:26.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680246+0000", 2023-10-08T07:07:26.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0637e-05 2023-10-08T07:07:26.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680256+0000", 2023-10-08T07:07:26.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0086e-05 2023-10-08T07:07:26.816 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.816 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.816 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.816 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111889 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.816 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.680822+0000", 2023-10-08T07:07:26.816 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9983296, 2023-10-08T07:07:26.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00043106399999999999, 2023-10-08T07:07:26.817 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.817 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:26.817 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.817 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.817 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.817 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111889 2023-10-08T07:07:26.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.817 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680822+0000", 2023-10-08T07:07:26.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680822+0000", 2023-10-08T07:07:26.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680823+0000", 2023-10-08T07:07:26.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9299999999999997e-07 2023-10-08T07:07:26.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680833+0000", 2023-10-08T07:07:26.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0193e-05 2023-10-08T07:07:26.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680843+0000", 2023-10-08T07:07:26.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8670000000000006e-06 2023-10-08T07:07:26.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.820 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.680851+0000", 2023-10-08T07:07:26.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7030000000000006e-06 2023-10-08T07:07:26.820 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.820 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.820 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.820 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111828 4.c 4:31e28161:::10000000004.00000011:head [write 3526656~4096 in=4096b,write 3604480~4096 in=4096b,write 4083712~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.820 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.660080+0000", 2023-10-08T07:07:26.820 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.019072510000000001, 2023-10-08T07:07:26.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021239905999999999, 2023-10-08T07:07:26.820 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.821 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.821 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.821 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.821 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.821 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111828 2023-10-08T07:07:26.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.821 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660080+0000", 2023-10-08T07:07:26.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660080+0000", 2023-10-08T07:07:26.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660080+0000", 2023-10-08T07:07:26.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0100000000000004e-07 2023-10-08T07:07:26.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660091+0000", 2023-10-08T07:07:26.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0603e-05 2023-10-08T07:07:26.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660101+0000", 2023-10-08T07:07:26.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7459999999999995e-06 2023-10-08T07:07:26.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660108+0000", 2023-10-08T07:07:26.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2590000000000003e-06 2023-10-08T07:07:26.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660158+0000", 2023-10-08T07:07:26.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0454999999999997e-05 2023-10-08T07:07:26.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660255+0000", 2023-10-08T07:07:26.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6747000000000001e-05 2023-10-08T07:07:26.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660437+0000", 2023-10-08T07:07:26.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018152700000000001 2023-10-08T07:07:26.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.666833+0000", 2023-10-08T07:07:26.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0063965200000000002 2023-10-08T07:07:26.825 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.825 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.826 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.826 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.826 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111829 4.20 4:07572838:::10000000004.00000010:head [write 24576~4096 in=4096b,write 294912~4096 in=4096b,write 344064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.826 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.660130+0000", 2023-10-08T07:07:26.826 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.019022331999999999, 2023-10-08T07:07:26.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021273576999999998, 2023-10-08T07:07:26.826 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.826 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.826 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.826 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.827 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.827 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111829 2023-10-08T07:07:26.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.827 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660130+0000", 2023-10-08T07:07:26.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.828 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660130+0000", 2023-10-08T07:07:26.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.828 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.828 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660130+0000", 2023-10-08T07:07:26.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1500000000000005e-07 2023-10-08T07:07:26.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.828 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.828 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660140+0000", 2023-10-08T07:07:26.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7389999999999994e-06 2023-10-08T07:07:26.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660148+0000", 2023-10-08T07:07:26.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.926e-06 2023-10-08T07:07:26.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.660154+0000", 2023-10-08T07:07:26.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7350000000000001e-06 2023-10-08T07:07:26.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.661546+0000", 2023-10-08T07:07:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0013917809999999999 2023-10-08T07:07:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.661601+0000", 2023-10-08T07:07:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5043999999999997e-05 2023-10-08T07:07:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.661696+0000", 2023-10-08T07:07:26.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5360999999999997e-05 2023-10-08T07:07:26.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667104+0000", 2023-10-08T07:07:26.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054085100000000001 2023-10-08T07:07:26.831 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.831 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.831 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.832 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:111634 4.b e57/17 4:d0c991e0:::10000000004.0000002d:head v 57'1751, mlcod=57'1748)", 2023-10-08T07:07:26.832 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.672327+0000", 2023-10-08T07:07:26.832 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0068253330000000003, 2023-10-08T07:07:26.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0091550250000000007, 2023-10-08T07:07:26.832 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.832 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:26.832 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.672327+0000", 2023-10-08T07:07:26.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.833 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.672327+0000", 2023-10-08T07:07:26.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.833 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.672327+0000", 2023-10-08T07:07:26.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3799999999999998e-07 2023-10-08T07:07:26.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.833 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.672352+0000", 2023-10-08T07:07:26.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.427e-05 2023-10-08T07:07:26.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.672360+0000", 2023-10-08T07:07:26.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1110000000000008e-06 2023-10-08T07:07:26.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.672365+0000", 2023-10-08T07:07:26.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5470000000000004e-06 2023-10-08T07:07:26.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.835 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.835 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673533+0000", 2023-10-08T07:07:26.835 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0011673790000000001 2023-10-08T07:07:26.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.835 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.835 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673552+0000", 2023-10-08T07:07:26.835 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9627999999999999e-05 2023-10-08T07:07:26.835 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.836 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.836 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.836 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111835 4.1b 4:d97fb168:::10000000004.00000008:head [write 4001792~4096 in=4096b,write 4018176~4096 in=4096b,write 4050944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.836 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.662276+0000", 2023-10-08T07:07:26.836 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.016876025999999999, 2023-10-08T07:07:26.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019283102999999999, 2023-10-08T07:07:26.836 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.836 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.836 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.836 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.837 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.837 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111835 2023-10-08T07:07:26.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.837 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.662276+0000", 2023-10-08T07:07:26.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.662276+0000", 2023-10-08T07:07:26.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.662277+0000", 2023-10-08T07:07:26.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6400000000000002e-07 2023-10-08T07:07:26.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.662293+0000", 2023-10-08T07:07:26.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6455000000000001e-05 2023-10-08T07:07:26.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.662311+0000", 2023-10-08T07:07:26.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7387000000000001e-05 2023-10-08T07:07:26.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.662319+0000", 2023-10-08T07:07:26.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3620000000000006e-06 2023-10-08T07:07:26.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.663378+0000", 2023-10-08T07:07:26.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0010589589999999999 2023-10-08T07:07:26.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.663469+0000", 2023-10-08T07:07:26.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1028999999999999e-05 2023-10-08T07:07:26.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.841 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.663644+0000", 2023-10-08T07:07:26.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017509399999999999 2023-10-08T07:07:26.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.841 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.841 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667368+0000", 2023-10-08T07:07:26.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0037235530000000001 2023-10-08T07:07:26.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.841 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.842 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111864 4.c 4:31e28161:::10000000004.00000011:head [write 1130496~4096 in=4096b,write 1286144~4096 in=4096b,write 1683456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.842 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.673257+0000", 2023-10-08T07:07:26.842 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0058955040000000002, 2023-10-08T07:07:26.842 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084029129999999997, 2023-10-08T07:07:26.842 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.842 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.842 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.842 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.842 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.842 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111864 2023-10-08T07:07:26.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.842 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673257+0000", 2023-10-08T07:07:26.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673257+0000", 2023-10-08T07:07:26.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673257+0000", 2023-10-08T07:07:26.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:07:26.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673268+0000", 2023-10-08T07:07:26.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0433e-05 2023-10-08T07:07:26.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673276+0000", 2023-10-08T07:07:26.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4649999999999994e-06 2023-10-08T07:07:26.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673282+0000", 2023-10-08T07:07:26.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3820000000000003e-06 2023-10-08T07:07:26.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673330+0000", 2023-10-08T07:07:26.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8690000000000003e-05 2023-10-08T07:07:26.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673405+0000", 2023-10-08T07:07:26.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4308999999999996e-05 2023-10-08T07:07:26.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673559+0000", 2023-10-08T07:07:26.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015444999999999999 2023-10-08T07:07:26.846 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.846 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.846 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111836 4.2c 4:352c144c:::10000000004.00000003:head [write 2646016~4096 in=4096b,write 2686976~4096 in=4096b,write 2707456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.662810+0000", 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.016342163999999999, 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018951275, 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111836 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.847 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.848 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.662810+0000", 2023-10-08T07:07:26.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.848 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.662810+0000", 2023-10-08T07:07:26.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.848 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.662811+0000", 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.662831+0000", 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0611999999999998e-05 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.662841+0000", 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9080000000000007e-06 2023-10-08T07:07:26.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.662847+0000", 2023-10-08T07:07:26.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7239999999999997e-06 2023-10-08T07:07:26.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.663421+0000", 2023-10-08T07:07:26.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000573968 2023-10-08T07:07:26.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.663520+0000", 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9199999999999999e-05 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.663668+0000", 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000148422 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.667508+0000", 2023-10-08T07:07:26.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038392999999999999 2023-10-08T07:07:26.852 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.852 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.852 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.852 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:111867 4.30 4:0f322a22:::10000000004.00000014:head [write 2383872~4096 in=4096b,write 2424832~4096 in=4096b,write 2686976~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:26.852 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.673380+0000", 2023-10-08T07:07:26.852 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0057726410000000002, 2023-10-08T07:07:26.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0084821970000000003, 2023-10-08T07:07:26.852 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.852 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:26.853 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:26.853 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:26.853 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:26.853 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 111867 2023-10-08T07:07:26.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.853 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673380+0000", 2023-10-08T07:07:26.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.854 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673380+0000", 2023-10-08T07:07:26.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.854 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673380+0000", 2023-10-08T07:07:26.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.92e-07 2023-10-08T07:07:26.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.854 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673392+0000", 2023-10-08T07:07:26.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1201e-05 2023-10-08T07:07:26.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673401+0000", 2023-10-08T07:07:26.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4900000000000006e-06 2023-10-08T07:07:26.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.673408+0000", 2023-10-08T07:07:26.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.199e-06 2023-10-08T07:07:26.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675182+0000", 2023-10-08T07:07:26.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001773534 2023-10-08T07:07:26.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675265+0000", 2023-10-08T07:07:26.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3678999999999996e-05 2023-10-08T07:07:26.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.675418+0000", 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015231700000000001 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:111832 4.31 e57/48 4:8de29a03:::10000000004.00000001:head v 57'3445, mlcod=57'3440)", 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.674486+0000", 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0046665630000000003, 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074626229999999998, 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:26.857 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:26.858 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:26.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.858 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:26.858 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.674486+0000", 2023-10-08T07:07:26.858 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.858 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:26.858 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.674486+0000", 2023-10-08T07:07:26.858 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:26.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.674486+0000", 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.0400000000000002e-07 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.674498+0000", 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.237e-05 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.674506+0000", 2023-10-08T07:07:26.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3710000000000002e-06 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.674511+0000", 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7010000000000001e-06 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.674577+0000", 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5463999999999995e-05 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:26.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:26.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.674601+0000", 2023-10-08T07:07:26.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3750000000000001e-05 2023-10-08T07:07:26.861 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.861 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:26.861 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.861 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:26.861 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:07:26.861 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 35 2023-10-08T07:07:26.861 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:26.863 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:26.863 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:26.861+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:26.964 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:26.963+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:27.066 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:27.064+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:27.092 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:27.093 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:27.093 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:27.093 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:27.093 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:27.109 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:27.193 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:27.192+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:27.269 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:27.265+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:27.284 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2023-10-08T07:07:27.351 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:27.351 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:27.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:27.351 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:27.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.352 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:109757 4.20 4:05b3915c:::10000000004.00000016:head [write 1871872~4096,write 1912832~4096,write 1957888~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.352 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:25.931082+0000", 2023-10-08T07:07:27.352 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.4161132300000001, 2023-10-08T07:07:27.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.111877037, 2023-10-08T07:07:27.352 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.352 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.352 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.352 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.353 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.353 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 109757 2023-10-08T07:07:27.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.353 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.354 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.354 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931082+0000", 2023-10-08T07:07:27.354 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.356 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931082+0000", 2023-10-08T07:07:27.356 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.356 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.356 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.356 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931083+0000", 2023-10-08T07:07:27.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4700000000000001e-07 2023-10-08T07:07:27.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931096+0000", 2023-10-08T07:07:27.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3352e-05 2023-10-08T07:07:27.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.360 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931104+0000", 2023-10-08T07:07:27.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9440000000000005e-06 2023-10-08T07:07:27.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.360 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931111+0000", 2023-10-08T07:07:27.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2319999999999998e-06 2023-10-08T07:07:27.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.977984+0000", 2023-10-08T07:07:27.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046873785000000001 2023-10-08T07:07:27.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.978037+0000", 2023-10-08T07:07:27.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2984e-05 2023-10-08T07:07:27.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.978133+0000", 2023-10-08T07:07:27.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5446999999999996e-05 2023-10-08T07:07:27.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.006001+0000", 2023-10-08T07:07:27.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027867861000000001 2023-10-08T07:07:27.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.042882+0000", 2023-10-08T07:07:27.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.036881377 2023-10-08T07:07:27.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.042920+0000", 2023-10-08T07:07:27.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8155999999999999e-05 2023-10-08T07:07:27.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.363 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.042960+0000", 2023-10-08T07:07:27.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9351999999999999e-05 2023-10-08T07:07:27.363 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.363 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.363 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.364 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:109768 4.20 4:04004f2c:::10000000004.0000000d:head [write 598016~4096,write 618496~4096,write 983040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.364 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:25.931321+0000", 2023-10-08T07:07:27.364 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.4158745770000001, 2023-10-08T07:07:27.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.111790031, 2023-10-08T07:07:27.364 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.364 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.364 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.364 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.364 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.364 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 109768 2023-10-08T07:07:27.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.365 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931321+0000", 2023-10-08T07:07:27.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931321+0000", 2023-10-08T07:07:27.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931322+0000", 2023-10-08T07:07:27.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8200000000000001e-07 2023-10-08T07:07:27.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931335+0000", 2023-10-08T07:07:27.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.309e-05 2023-10-08T07:07:27.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.367 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.367 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931342+0000", 2023-10-08T07:07:27.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9800000000000001e-06 2023-10-08T07:07:27.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931347+0000", 2023-10-08T07:07:27.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8889999999999999e-06 2023-10-08T07:07:27.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.980798+0000", 2023-10-08T07:07:27.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049450539000000002 2023-10-08T07:07:27.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.369 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.369 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.980872+0000", 2023-10-08T07:07:27.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4203999999999996e-05 2023-10-08T07:07:27.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.369 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.369 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.981017+0000", 2023-10-08T07:07:27.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014521299999999999 2023-10-08T07:07:27.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.369 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.006008+0000", 2023-10-08T07:07:27.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024990104999999999 2023-10-08T07:07:27.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.043053+0000", 2023-10-08T07:07:27.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037045217999999998 2023-10-08T07:07:27.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.043089+0000", 2023-10-08T07:07:27.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6405000000000001e-05 2023-10-08T07:07:27.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.043111+0000", 2023-10-08T07:07:27.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2005999999999999e-05 2023-10-08T07:07:27.371 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.371 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.371 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.372 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:109791 4.20 4:04004f2c:::10000000004.0000000d:head [write 208896~8192,write 348160~4096,write 544768~4096,write 569344~4096,write 1052672~4096,write 1122304~4096,write 1261568~8192,write 1351680~4096,write 1540096~4096,write 1585152~4096,write 1736704~4096,write 1880064~4096,write 1916928~4096,write 2625536~4096,write 2662400~8192,write 2736128~4096,write 2904064~4096,write 2994176~4096,write 3121152~4096,write 3194880~4096,write 3203072~4096,write 3211264~4096,write 3473408~4096,write 3493888~4096,write 3670016~4096,write 3751936~4096,write 3842048~4096,write 3895296~4096,write 4034560~4096,write 4042752~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.372 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:25.931619+0000", 2023-10-08T07:07:27.372 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.415576543, 2023-10-08T07:07:27.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.121958767, 2023-10-08T07:07:27.372 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.372 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.372 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.372 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.372 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.372 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 109791 2023-10-08T07:07:27.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.373 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931619+0000", 2023-10-08T07:07:27.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931619+0000", 2023-10-08T07:07:27.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931620+0000", 2023-10-08T07:07:27.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9399999999999995e-07 2023-10-08T07:07:27.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931711+0000", 2023-10-08T07:07:27.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0838e-05 2023-10-08T07:07:27.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931720+0000", 2023-10-08T07:07:27.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.397e-06 2023-10-08T07:07:27.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931727+0000", 2023-10-08T07:07:27.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9530000000000002e-06 2023-10-08T07:07:27.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.990307+0000", 2023-10-08T07:07:27.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058580225 2023-10-08T07:07:27.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.377 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.990420+0000", 2023-10-08T07:07:27.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000113338 2023-10-08T07:07:27.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.377 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.990988+0000", 2023-10-08T07:07:27.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00056734999999999999 2023-10-08T07:07:27.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.378 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.006171+0000", 2023-10-08T07:07:27.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015183202 2023-10-08T07:07:27.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.378 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.053454+0000", 2023-10-08T07:07:27.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047282892999999999 2023-10-08T07:07:27.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.053539+0000", 2023-10-08T07:07:27.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5048000000000003e-05 2023-10-08T07:07:27.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.053578+0000", 2023-10-08T07:07:27.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9029000000000002e-05 2023-10-08T07:07:27.379 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.379 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.379 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110410 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 557056~4096,write 634880~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.151249+0000", 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.195947058, 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12446716100000001, 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110410 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.380 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.381 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151249+0000", 2023-10-08T07:07:27.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.381 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151249+0000", 2023-10-08T07:07:27.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.381 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151250+0000", 2023-10-08T07:07:27.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4e-07 2023-10-08T07:07:27.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151276+0000", 2023-10-08T07:07:27.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6818999999999999e-05 2023-10-08T07:07:27.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151287+0000", 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0835e-05 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151295+0000", 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3529999999999997e-06 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.164846+0000", 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013551917 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.384 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.164902+0000", 2023-10-08T07:07:27.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5736999999999998e-05 2023-10-08T07:07:27.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.384 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.164995+0000", 2023-10-08T07:07:27.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2942000000000006e-05 2023-10-08T07:07:27.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.384 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.173868+0000", 2023-10-08T07:07:27.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0088733379999999997 2023-10-08T07:07:27.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275615+0000", 2023-10-08T07:07:27.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.101746446 2023-10-08T07:07:27.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275677+0000", 2023-10-08T07:07:27.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1739e-05 2023-10-08T07:07:27.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.386 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.386 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275716+0000", 2023-10-08T07:07:27.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9195e-05 2023-10-08T07:07:27.386 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.386 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.386 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.386 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110411 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2457600~4096,write 3194880~4096,write 3284992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.386 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.151498+0000", 2023-10-08T07:07:27.386 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.1956976530000001, 2023-10-08T07:07:27.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.124347257, 2023-10-08T07:07:27.387 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.387 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.387 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.387 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.387 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.387 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110411 2023-10-08T07:07:27.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.387 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.387 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151498+0000", 2023-10-08T07:07:27.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151498+0000", 2023-10-08T07:07:27.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151499+0000", 2023-10-08T07:07:27.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7000000000000004e-07 2023-10-08T07:07:27.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151530+0000", 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1637999999999998e-05 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151539+0000", 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.952e-06 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151546+0000", 2023-10-08T07:07:27.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2480000000000001e-06 2023-10-08T07:07:27.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.166753+0000", 2023-10-08T07:07:27.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015207165 2023-10-08T07:07:27.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.166804+0000", 2023-10-08T07:07:27.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0936999999999997e-05 2023-10-08T07:07:27.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.166901+0000", 2023-10-08T07:07:27.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7418999999999997e-05 2023-10-08T07:07:27.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178556+0000", 2023-10-08T07:07:27.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011654464 2023-10-08T07:07:27.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275764+0000", 2023-10-08T07:07:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.097208469000000006 2023-10-08T07:07:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275801+0000", 2023-10-08T07:07:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6715999999999999e-05 2023-10-08T07:07:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275845+0000", 2023-10-08T07:07:27.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4579000000000001e-05 2023-10-08T07:07:27.393 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.393 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.393 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.393 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110422 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 774144~4096,write 880640~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.393 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:27.393 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.192208215, 2023-10-08T07:07:27.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12745208799999999, 2023-10-08T07:07:27.393 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.394 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.394 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.394 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.394 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.394 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110422 2023-10-08T07:07:27.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.394 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:27.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:27.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:27.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7399999999999998e-07 2023-10-08T07:07:27.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.155045+0000", 2023-10-08T07:07:27.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6687000000000001e-05 2023-10-08T07:07:27.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.155053+0000", 2023-10-08T07:07:27.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5569999999999996e-06 2023-10-08T07:07:27.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.155060+0000", 2023-10-08T07:07:27.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9090000000000003e-06 2023-10-08T07:07:27.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.168971+0000", 2023-10-08T07:07:27.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013910782999999999 2023-10-08T07:07:27.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169054+0000", 2023-10-08T07:07:27.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3051000000000002e-05 2023-10-08T07:07:27.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169194+0000", 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013997799999999999 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178725+0000", 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0095310480000000003 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282382+0000", 2023-10-08T07:07:27.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10365708 2023-10-08T07:07:27.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282416+0000", 2023-10-08T07:07:27.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4258999999999998e-05 2023-10-08T07:07:27.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282440+0000", 2023-10-08T07:07:27.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3261999999999999e-05 2023-10-08T07:07:27.399 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.399 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.400 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.400 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110428 4.a 4:524fba76:::10000000004.0000001b:head [write 1576960~4096,write 1830912~4096,write 1847296~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.400 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.156743+0000", 2023-10-08T07:07:27.400 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.190452632, 2023-10-08T07:07:27.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.1191084, 2023-10-08T07:07:27.400 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.400 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.401 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.401 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.401 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.401 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110428 2023-10-08T07:07:27.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.401 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156743+0000", 2023-10-08T07:07:27.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156743+0000", 2023-10-08T07:07:27.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156744+0000", 2023-10-08T07:07:27.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5499999999999997e-07 2023-10-08T07:07:27.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156818+0000", 2023-10-08T07:07:27.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3955999999999995e-05 2023-10-08T07:07:27.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156829+0000", 2023-10-08T07:07:27.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1482e-05 2023-10-08T07:07:27.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156837+0000", 2023-10-08T07:07:27.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8159999999999994e-06 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.168957+0000", 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012120077 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169037+0000", 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9730999999999999e-05 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169172+0000", 2023-10-08T07:07:27.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013486999999999999 2023-10-08T07:07:27.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178565+0000", 2023-10-08T07:07:27.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0093934910000000003 2023-10-08T07:07:27.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275762+0000", 2023-10-08T07:07:27.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.097196649999999996 2023-10-08T07:07:27.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275811+0000", 2023-10-08T07:07:27.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9351999999999998e-05 2023-10-08T07:07:27.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275851+0000", 2023-10-08T07:07:27.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0120000000000002e-05 2023-10-08T07:07:27.406 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.407 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.407 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.407 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110434 4.a 4:524fba76:::10000000004.0000001b:head [write 3473408~4096,write 3694592~4096,write 3710976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.407 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.159018+0000", 2023-10-08T07:07:27.407 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.1881775830000001, 2023-10-08T07:07:27.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11695425800000001, 2023-10-08T07:07:27.407 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.407 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.407 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.407 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.408 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.408 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110434 2023-10-08T07:07:27.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.408 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159018+0000", 2023-10-08T07:07:27.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159018+0000", 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159019+0000", 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159032+0000", 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2672e-05 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159042+0000", 2023-10-08T07:07:27.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0882e-05 2023-10-08T07:07:27.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159050+0000", 2023-10-08T07:07:27.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9889999999999992e-06 2023-10-08T07:07:27.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170445+0000", 2023-10-08T07:07:27.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011394826 2023-10-08T07:07:27.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170503+0000", 2023-10-08T07:07:27.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7574999999999997e-05 2023-10-08T07:07:27.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170619+0000", 2023-10-08T07:07:27.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011575599999999999 2023-10-08T07:07:27.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178729+0000", 2023-10-08T07:07:27.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0081105169999999994 2023-10-08T07:07:27.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275886+0000", 2023-10-08T07:07:27.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.097157073999999996 2023-10-08T07:07:27.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275936+0000", 2023-10-08T07:07:27.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9651000000000003e-05 2023-10-08T07:07:27.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275972+0000", 2023-10-08T07:07:27.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6507999999999997e-05 2023-10-08T07:07:27.413 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.413 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.413 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.414 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110441 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2404352~8192,write 2510848~4096,write 2584576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.414 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.161045+0000", 2023-10-08T07:07:27.414 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.186150703, 2023-10-08T07:07:27.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12159005000000001, 2023-10-08T07:07:27.414 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.414 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.414 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.414 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.414 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.415 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110441 2023-10-08T07:07:27.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.415 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161045+0000", 2023-10-08T07:07:27.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161045+0000", 2023-10-08T07:07:27.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161046+0000", 2023-10-08T07:07:27.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.139e-06 2023-10-08T07:07:27.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161059+0000", 2023-10-08T07:07:27.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2616000000000001e-05 2023-10-08T07:07:27.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161069+0000", 2023-10-08T07:07:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9680000000000001e-06 2023-10-08T07:07:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161077+0000", 2023-10-08T07:07:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8310000000000001e-06 2023-10-08T07:07:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.171413+0000", 2023-10-08T07:07:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010336675 2023-10-08T07:07:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.171509+0000", 2023-10-08T07:07:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5352000000000005e-05 2023-10-08T07:07:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.171664+0000", 2023-10-08T07:07:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015575699999999999 2023-10-08T07:07:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179024+0000", 2023-10-08T07:07:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.007359768 2023-10-08T07:07:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282494+0000", 2023-10-08T07:07:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10346983899999999 2023-10-08T07:07:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282582+0000", 2023-10-08T07:07:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7650000000000003e-05 2023-10-08T07:07:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282635+0000", 2023-10-08T07:07:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3455000000000002e-05 2023-10-08T07:07:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110460 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 385024~4096,write 438272~4096,write 446464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.167805+0000", 2023-10-08T07:07:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.1793904669999999, 2023-10-08T07:07:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.114918704, 2023-10-08T07:07:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110460 2023-10-08T07:07:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167805+0000", 2023-10-08T07:07:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167805+0000", 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167806+0000", 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6799999999999999e-07 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167819+0000", 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.277e-05 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167831+0000", 2023-10-08T07:07:27.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2009e-05 2023-10-08T07:07:27.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167839+0000", 2023-10-08T07:07:27.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1790000000000008e-06 2023-10-08T07:07:27.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.173901+0000", 2023-10-08T07:07:27.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.006061533 2023-10-08T07:07:27.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.173999+0000", 2023-10-08T07:07:27.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8651000000000001e-05 2023-10-08T07:07:27.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.174160+0000", 2023-10-08T07:07:27.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000161211 2023-10-08T07:07:27.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191238+0000", 2023-10-08T07:07:27.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017077877000000002 2023-10-08T07:07:27.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282672+0000", 2023-10-08T07:07:27.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.091434122000000007 2023-10-08T07:07:27.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282704+0000", 2023-10-08T07:07:27.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1863000000000003e-05 2023-10-08T07:07:27.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282724+0000", 2023-10-08T07:07:27.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9621000000000001e-05 2023-10-08T07:07:27.427 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.427 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.427 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.428 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110467 4.1a 4:5a59f83a:::10000000004.00000002:head [write 1171456~4096,write 1269760~4096,write 1388544~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.428 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.170266+0000", 2023-10-08T07:07:27.428 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.176929554, 2023-10-08T07:07:27.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.124576939, 2023-10-08T07:07:27.428 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.428 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.428 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.428 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.428 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.428 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110467 2023-10-08T07:07:27.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.428 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170266+0000", 2023-10-08T07:07:27.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170266+0000", 2023-10-08T07:07:27.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170267+0000", 2023-10-08T07:07:27.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2799999999999996e-07 2023-10-08T07:07:27.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170277+0000", 2023-10-08T07:07:27.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0705e-05 2023-10-08T07:07:27.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170286+0000", 2023-10-08T07:07:27.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3459999999999994e-06 2023-10-08T07:07:27.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170291+0000", 2023-10-08T07:07:27.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4720000000000003e-06 2023-10-08T07:07:27.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179164+0000", 2023-10-08T07:07:27.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0088732729999999992 2023-10-08T07:07:27.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179250+0000", 2023-10-08T07:07:27.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5264000000000002e-05 2023-10-08T07:07:27.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179396+0000", 2023-10-08T07:07:27.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014668 2023-10-08T07:07:27.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191628+0000", 2023-10-08T07:07:27.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012231483 2023-10-08T07:07:27.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.294751+0000", 2023-10-08T07:07:27.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10312267999999999 2023-10-08T07:07:27.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.294794+0000", 2023-10-08T07:07:27.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3467999999999998e-05 2023-10-08T07:07:27.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.294843+0000", 2023-10-08T07:07:27.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9039999999999998e-05 2023-10-08T07:07:27.434 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.434 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.434 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.434 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110489 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2711552~4096,write 2859008~4096,write 2887680~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.434 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.178082+0000", 2023-10-08T07:07:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.169113329, 2023-10-08T07:07:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.13133874200000001, 2023-10-08T07:07:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110489 2023-10-08T07:07:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178082+0000", 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178082+0000", 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178083+0000", 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4000000000000001e-07 2023-10-08T07:07:27.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178094+0000", 2023-10-08T07:07:27.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1144e-05 2023-10-08T07:07:27.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178101+0000", 2023-10-08T07:07:27.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1509999999999998e-06 2023-10-08T07:07:27.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178106+0000", 2023-10-08T07:07:27.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8470000000000003e-06 2023-10-08T07:07:27.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.180867+0000", 2023-10-08T07:07:27.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027610529999999999 2023-10-08T07:07:27.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.180923+0000", 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5770000000000003e-05 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181024+0000", 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100806 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191634+0000", 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010609809 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309361+0000", 2023-10-08T07:07:27.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.117727095 2023-10-08T07:07:27.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309397+0000", 2023-10-08T07:07:27.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6465999999999999e-05 2023-10-08T07:07:27.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309421+0000", 2023-10-08T07:07:27.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3961e-05 2023-10-08T07:07:27.441 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.441 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.441 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.441 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110495 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 528384~4096,write 663552~4096,write 974848~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.441 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.181379+0000", 2023-10-08T07:07:27.441 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.1658165739999999, 2023-10-08T07:07:27.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.128198539, 2023-10-08T07:07:27.441 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.441 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.442 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.442 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.442 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.442 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110495 2023-10-08T07:07:27.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.442 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.442 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181379+0000", 2023-10-08T07:07:27.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181379+0000", 2023-10-08T07:07:27.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181380+0000", 2023-10-08T07:07:27.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2e-07 2023-10-08T07:07:27.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181397+0000", 2023-10-08T07:07:27.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7750000000000001e-05 2023-10-08T07:07:27.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181405+0000", 2023-10-08T07:07:27.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8210000000000002e-06 2023-10-08T07:07:27.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181411+0000", 2023-10-08T07:07:27.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9479999999999996e-06 2023-10-08T07:07:27.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.183521+0000", 2023-10-08T07:07:27.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0021102629999999998 2023-10-08T07:07:27.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.183600+0000", 2023-10-08T07:07:27.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8524999999999998e-05 2023-10-08T07:07:27.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.183748+0000", 2023-10-08T07:07:27.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014801300000000001 2023-10-08T07:07:27.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.194292+0000", 2023-10-08T07:07:27.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010544421999999999 2023-10-08T07:07:27.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309480+0000", 2023-10-08T07:07:27.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11518740800000001 2023-10-08T07:07:27.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309538+0000", 2023-10-08T07:07:27.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8128999999999999e-05 2023-10-08T07:07:27.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309578+0000", 2023-10-08T07:07:27.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9740000000000002e-05 2023-10-08T07:07:27.448 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.448 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.448 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.448 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110498 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 892928~4096,write 1101824~4096,write 1118208~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.448 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.181421+0000", 2023-10-08T07:07:27.448 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.165774313, 2023-10-08T07:07:27.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12831536399999999, 2023-10-08T07:07:27.449 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.449 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.449 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.449 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.449 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.449 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110498 2023-10-08T07:07:27.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.449 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181421+0000", 2023-10-08T07:07:27.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181421+0000", 2023-10-08T07:07:27.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181422+0000", 2023-10-08T07:07:27.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6899999999999997e-07 2023-10-08T07:07:27.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181435+0000", 2023-10-08T07:07:27.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3217999999999999e-05 2023-10-08T07:07:27.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181443+0000", 2023-10-08T07:07:27.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5719999999999997e-06 2023-10-08T07:07:27.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181449+0000", 2023-10-08T07:07:27.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8930000000000002e-06 2023-10-08T07:07:27.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.186316+0000", 2023-10-08T07:07:27.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048669539999999997 2023-10-08T07:07:27.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.186386+0000", 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0698000000000006e-05 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.186499+0000", 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000112408 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.194298+0000", 2023-10-08T07:07:27.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.007799243 2023-10-08T07:07:27.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309638+0000", 2023-10-08T07:07:27.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.115339652 2023-10-08T07:07:27.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309697+0000", 2023-10-08T07:07:27.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9635000000000001e-05 2023-10-08T07:07:27.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309737+0000", 2023-10-08T07:07:27.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9521999999999999e-05 2023-10-08T07:07:27.455 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.455 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.455 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.455 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110500 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 53248~4096,write 278528~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.182173+0000", 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.1650224680000001, 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12767258300000001, 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110500 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182173+0000", 2023-10-08T07:07:27.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182173+0000", 2023-10-08T07:07:27.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182174+0000", 2023-10-08T07:07:27.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:27.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182191+0000", 2023-10-08T07:07:27.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6511000000000002e-05 2023-10-08T07:07:27.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182213+0000", 2023-10-08T07:07:27.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1948999999999999e-05 2023-10-08T07:07:27.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182220+0000", 2023-10-08T07:07:27.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7710000000000006e-06 2023-10-08T07:07:27.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.188654+0000", 2023-10-08T07:07:27.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0064335299999999998 2023-10-08T07:07:27.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.188748+0000", 2023-10-08T07:07:27.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.433e-05 2023-10-08T07:07:27.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.188969+0000", 2023-10-08T07:07:27.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022088500000000001 2023-10-08T07:07:27.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197663+0000", 2023-10-08T07:07:27.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0086943860000000001 2023-10-08T07:07:27.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309781+0000", 2023-10-08T07:07:27.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11211758199999999 2023-10-08T07:07:27.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309825+0000", 2023-10-08T07:07:27.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3955000000000002e-05 2023-10-08T07:07:27.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.462 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309846+0000", 2023-10-08T07:07:27.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0873000000000002e-05 2023-10-08T07:07:27.462 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.462 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.462 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.462 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110508 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3907584~12288,write 3948544~4096,write 4030464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.462 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.184597+0000", 2023-10-08T07:07:27.462 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.1625988999999999, 2023-10-08T07:07:27.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12538458, 2023-10-08T07:07:27.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.463 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.463 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.463 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.463 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.463 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110508 2023-10-08T07:07:27.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.463 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184597+0000", 2023-10-08T07:07:27.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184597+0000", 2023-10-08T07:07:27.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184598+0000", 2023-10-08T07:07:27.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9299999999999997e-07 2023-10-08T07:07:27.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184609+0000", 2023-10-08T07:07:27.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1525999999999999e-05 2023-10-08T07:07:27.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184618+0000", 2023-10-08T07:07:27.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.037e-06 2023-10-08T07:07:27.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184623+0000", 2023-10-08T07:07:27.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6199999999999998e-06 2023-10-08T07:07:27.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191662+0000", 2023-10-08T07:07:27.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070390849999999996 2023-10-08T07:07:27.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191743+0000", 2023-10-08T07:07:27.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0982999999999994e-05 2023-10-08T07:07:27.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191901+0000", 2023-10-08T07:07:27.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000158379 2023-10-08T07:07:27.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.200125+0000", 2023-10-08T07:07:27.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0082239050000000001 2023-10-08T07:07:27.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309894+0000", 2023-10-08T07:07:27.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10976902099999999 2023-10-08T07:07:27.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309947+0000", 2023-10-08T07:07:27.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3295999999999999e-05 2023-10-08T07:07:27.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309981+0000", 2023-10-08T07:07:27.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4035000000000002e-05 2023-10-08T07:07:27.469 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.469 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.469 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.469 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110511 4.1a 4:5a59f83a:::10000000004.00000002:head [write 942080~4096,write 1011712~4096,write 1163264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.469 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.185809+0000", 2023-10-08T07:07:27.469 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.161387068, 2023-10-08T07:07:27.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.123881088, 2023-10-08T07:07:27.470 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.470 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.470 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.470 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.470 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.470 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110511 2023-10-08T07:07:27.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.470 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185809+0000", 2023-10-08T07:07:27.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185809+0000", 2023-10-08T07:07:27.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185809+0000", 2023-10-08T07:07:27.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.61e-07 2023-10-08T07:07:27.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185824+0000", 2023-10-08T07:07:27.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4487999999999999e-05 2023-10-08T07:07:27.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185835+0000", 2023-10-08T07:07:27.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1245e-05 2023-10-08T07:07:27.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185842+0000", 2023-10-08T07:07:27.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2439999999999996e-06 2023-10-08T07:07:27.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.193541+0000", 2023-10-08T07:07:27.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0076988450000000002 2023-10-08T07:07:27.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.193632+0000", 2023-10-08T07:07:27.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0859000000000005e-05 2023-10-08T07:07:27.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.193800+0000", 2023-10-08T07:07:27.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016752100000000001 2023-10-08T07:07:27.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.200130+0000", 2023-10-08T07:07:27.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0063304379999999999 2023-10-08T07:07:27.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309629+0000", 2023-10-08T07:07:27.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.109498716 2023-10-08T07:07:27.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309669+0000", 2023-10-08T07:07:27.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0280000000000001e-05 2023-10-08T07:07:27.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309690+0000", 2023-10-08T07:07:27.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0690999999999999e-05 2023-10-08T07:07:27.476 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.476 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.476 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.476 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110528 4.3a 4:5f183e4b:::10000000004.00000023:head [write 0~4096,write 270336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.476 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.191132+0000", 2023-10-08T07:07:27.476 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.156063463, 2023-10-08T07:07:27.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11896013499999999, 2023-10-08T07:07:27.476 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110528 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191132+0000", 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191132+0000", 2023-10-08T07:07:27.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191133+0000", 2023-10-08T07:07:27.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1299999999999999e-07 2023-10-08T07:07:27.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191143+0000", 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0328e-05 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191154+0000", 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0556e-05 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191162+0000", 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0930000000000003e-06 2023-10-08T07:07:27.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.195252+0000", 2023-10-08T07:07:27.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040898719999999996 2023-10-08T07:07:27.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.195331+0000", 2023-10-08T07:07:27.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9093999999999999e-05 2023-10-08T07:07:27.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.195484+0000", 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015313699999999999 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.200515+0000", 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0050304950000000003 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310023+0000", 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10950808400000001 2023-10-08T07:07:27.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310063+0000", 2023-10-08T07:07:27.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0309999999999999e-05 2023-10-08T07:07:27.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310092+0000", 2023-10-08T07:07:27.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9453000000000001e-05 2023-10-08T07:07:27.482 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.482 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.483 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.483 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110532 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3649536~4096,write 4071424~4096,write 4169728~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.483 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.192360+0000", 2023-10-08T07:07:27.483 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.154835268, 2023-10-08T07:07:27.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.117879547, 2023-10-08T07:07:27.483 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.483 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110532 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192360+0000", 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192360+0000", 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192361+0000", 2023-10-08T07:07:27.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5899999999999995e-07 2023-10-08T07:07:27.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192373+0000", 2023-10-08T07:07:27.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2099000000000001e-05 2023-10-08T07:07:27.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192402+0000", 2023-10-08T07:07:27.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8928000000000002e-05 2023-10-08T07:07:27.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192413+0000", 2023-10-08T07:07:27.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1177e-05 2023-10-08T07:07:27.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197684+0000", 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052704850000000001 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197770+0000", 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6493e-05 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197935+0000", 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016471500000000001 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.201435+0000", 2023-10-08T07:07:27.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0035002359999999999 2023-10-08T07:07:27.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310136+0000", 2023-10-08T07:07:27.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.108701038 2023-10-08T07:07:27.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310194+0000", 2023-10-08T07:07:27.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8109999999999998e-05 2023-10-08T07:07:27.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310240+0000", 2023-10-08T07:07:27.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5507000000000003e-05 2023-10-08T07:07:27.489 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.489 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.489 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.489 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110687 4.3a 4:5f183e4b:::10000000004.00000023:head [write 303104~4096,write 720896~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.490 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.244728+0000", 2023-10-08T07:07:27.490 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 1.102468096, 2023-10-08T07:07:27.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.113819712, 2023-10-08T07:07:27.490 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:27.490 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:27.490 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:27.490 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:27.490 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.490 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110687 2023-10-08T07:07:27.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.490 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:27.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:27.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244728+0000", 2023-10-08T07:07:27.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:27.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244728+0000", 2023-10-08T07:07:27.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:27.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:27.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244729+0000", 2023-10-08T07:07:27.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8800000000000001e-07 2023-10-08T07:07:27.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:27.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244739+0000", 2023-10-08T07:07:27.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0370000000000001e-05 2023-10-08T07:07:27.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:27.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244749+0000", 2023-10-08T07:07:27.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0135999999999999e-05 2023-10-08T07:07:27.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244756+0000", 2023-10-08T07:07:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3969999999999997e-06 2023-10-08T07:07:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.247549+0000", 2023-10-08T07:07:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027921030000000002 2023-10-08T07:07:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:27.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.247630+0000", 2023-10-08T07:07:27.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1296000000000002e-05 2023-10-08T07:07:27.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:27.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.247777+0000", 2023-10-08T07:07:27.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014733899999999999 2023-10-08T07:07:27.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:27.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.258321+0000", 2023-10-08T07:07:27.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010543423 2023-10-08T07:07:27.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:27.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.358450+0000", 2023-10-08T07:07:27.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.100129684 2023-10-08T07:07:27.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:27.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.358505+0000", 2023-10-08T07:07:27.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4719999999999998e-05 2023-10-08T07:07:27.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:27.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:27.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:27.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.358547+0000", 2023-10-08T07:07:27.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2355999999999999e-05 2023-10-08T07:07:27.496 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.496 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.496 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.496 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:27.496 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:27.496 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:27.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:27.498 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:27.497+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:27.601 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:27.599+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:27.699 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:27.698+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:27.727 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:27.727 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:27.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.728 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112621 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.728 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:26.922997+0000", 2023-10-08T07:07:27.728 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.78095593299999999, 2023-10-08T07:07:27.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.78097897199999999, 2023-10-08T07:07:27.728 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.728 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.729 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112621 2023-10-08T07:07:27.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.729 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.922997+0000", 2023-10-08T07:07:27.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.922997+0000", 2023-10-08T07:07:27.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.922998+0000", 2023-10-08T07:07:27.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6300000000000004e-07 2023-10-08T07:07:27.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.923007+0000", 2023-10-08T07:07:27.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3980000000000005e-06 2023-10-08T07:07:27.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.923018+0000", 2023-10-08T07:07:27.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0209e-05 2023-10-08T07:07:27.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.923025+0000", 2023-10-08T07:07:27.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9349999999999997e-06 2023-10-08T07:07:27.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.731 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.732 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.732 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112702 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.732 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:26.951101+0000", 2023-10-08T07:07:27.732 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.752852309, 2023-10-08T07:07:27.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.752919177, 2023-10-08T07:07:27.732 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.732 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.732 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.732 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.732 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.733 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112702 2023-10-08T07:07:27.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.733 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.951101+0000", 2023-10-08T07:07:27.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.951101+0000", 2023-10-08T07:07:27.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.951102+0000", 2023-10-08T07:07:27.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3200000000000004e-07 2023-10-08T07:07:27.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.951113+0000", 2023-10-08T07:07:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1396999999999999e-05 2023-10-08T07:07:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.951123+0000", 2023-10-08T07:07:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0327e-05 2023-10-08T07:07:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.951131+0000", 2023-10-08T07:07:27.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4730000000000003e-06 2023-10-08T07:07:27.736 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.736 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.736 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.736 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113137 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.736 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.121535+0000", 2023-10-08T07:07:27.736 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.58241799299999997, 2023-10-08T07:07:27.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.58251796099999997, 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113137 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.121535+0000", 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.121535+0000", 2023-10-08T07:07:27.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.121536+0000", 2023-10-08T07:07:27.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5300000000000003e-07 2023-10-08T07:07:27.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.121548+0000", 2023-10-08T07:07:27.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1904e-05 2023-10-08T07:07:27.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.121558+0000", 2023-10-08T07:07:27.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7489999999999993e-06 2023-10-08T07:07:27.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.121567+0000", 2023-10-08T07:07:27.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9549999999999998e-06 2023-10-08T07:07:27.744 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.744 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.744 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.744 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113432 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.744 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.220560+0000", 2023-10-08T07:07:27.744 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48339271299999997, 2023-10-08T07:07:27.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48352466799999999, 2023-10-08T07:07:27.744 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.745 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.745 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.745 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.745 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.745 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113432 2023-10-08T07:07:27.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.745 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.220560+0000", 2023-10-08T07:07:27.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.220560+0000", 2023-10-08T07:07:27.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.220561+0000", 2023-10-08T07:07:27.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6600000000000002e-07 2023-10-08T07:07:27.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.220571+0000", 2023-10-08T07:07:27.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9830000000000008e-06 2023-10-08T07:07:27.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.220577+0000", 2023-10-08T07:07:27.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5899999999999996e-06 2023-10-08T07:07:27.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.220584+0000", 2023-10-08T07:07:27.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999999e-06 2023-10-08T07:07:27.748 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.748 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.748 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.748 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113586 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.748 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.270277+0000", 2023-10-08T07:07:27.748 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.433676436, 2023-10-08T07:07:27.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43386755100000002, 2023-10-08T07:07:27.748 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.748 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.748 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.749 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.749 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.749 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113586 2023-10-08T07:07:27.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.749 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.270277+0000", 2023-10-08T07:07:27.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.270277+0000", 2023-10-08T07:07:27.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.270278+0000", 2023-10-08T07:07:27.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7700000000000003e-07 2023-10-08T07:07:27.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.270297+0000", 2023-10-08T07:07:27.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9641999999999999e-05 2023-10-08T07:07:27.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.270309+0000", 2023-10-08T07:07:27.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1569000000000001e-05 2023-10-08T07:07:27.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.270318+0000", 2023-10-08T07:07:27.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7639999999999994e-06 2023-10-08T07:07:27.752 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.752 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.752 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.752 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113658 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.752 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.303831+0000", 2023-10-08T07:07:27.752 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.40012229599999999, 2023-10-08T07:07:27.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.400373376, 2023-10-08T07:07:27.752 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.752 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.753 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113658 2023-10-08T07:07:27.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.753 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.303831+0000", 2023-10-08T07:07:27.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.303831+0000", 2023-10-08T07:07:27.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.303832+0000", 2023-10-08T07:07:27.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2399999999999997e-07 2023-10-08T07:07:27.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.303843+0000", 2023-10-08T07:07:27.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1693e-05 2023-10-08T07:07:27.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.303852+0000", 2023-10-08T07:07:27.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3580000000000003e-06 2023-10-08T07:07:27.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.303858+0000", 2023-10-08T07:07:27.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7689999999999999e-06 2023-10-08T07:07:27.755 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.755 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.756 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114180 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.756 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.482505+0000", 2023-10-08T07:07:27.756 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.22144840099999999, 2023-10-08T07:07:27.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22176093299999999, 2023-10-08T07:07:27.756 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.756 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114180 2023-10-08T07:07:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.482505+0000", 2023-10-08T07:07:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.482505+0000", 2023-10-08T07:07:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.482505+0000", 2023-10-08T07:07:27.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.68e-07 2023-10-08T07:07:27.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.482559+0000", 2023-10-08T07:07:27.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3729e-05 2023-10-08T07:07:27.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.482570+0000", 2023-10-08T07:07:27.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0797e-05 2023-10-08T07:07:27.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.482578+0000", 2023-10-08T07:07:27.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5110000000000003e-06 2023-10-08T07:07:27.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.759 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.760 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114540 4.3b 4:df82de1b:::10000000004.0000000f:head [write 3227648~4096 in=4096b,write 3289088~4096 in=4096b,write 3407872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.760 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.606456+0000", 2023-10-08T07:07:27.760 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.097497604000000002, 2023-10-08T07:07:27.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.097990532000000005, 2023-10-08T07:07:27.760 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.760 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:27.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.760 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114540 2023-10-08T07:07:27.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.761 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.606456+0000", 2023-10-08T07:07:27.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.606456+0000", 2023-10-08T07:07:27.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.606456+0000", 2023-10-08T07:07:27.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.06e-07 2023-10-08T07:07:27.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.606467+0000", 2023-10-08T07:07:27.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.137e-05 2023-10-08T07:07:27.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.606475+0000", 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7249999999999997e-06 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.606481+0000", 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9449999999999998e-06 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:27.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.681494+0000", 2023-10-08T07:07:27.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.075013191000000007 2023-10-08T07:07:27.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:27.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.681568+0000", 2023-10-08T07:07:27.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3554999999999996e-05 2023-10-08T07:07:27.764 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.764 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.764 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.764 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114590 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.624980+0000", 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.078973505999999999, 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.079547222000000001, 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114590 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.624980+0000", 2023-10-08T07:07:27.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.624980+0000", 2023-10-08T07:07:27.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.624980+0000", 2023-10-08T07:07:27.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:27.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.625001+0000", 2023-10-08T07:07:27.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0741e-05 2023-10-08T07:07:27.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.625012+0000", 2023-10-08T07:07:27.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0525e-05 2023-10-08T07:07:27.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.625019+0000", 2023-10-08T07:07:27.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6510000000000001e-06 2023-10-08T07:07:27.768 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.768 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.768 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.768 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114692 4.37 4:efdd41ff:::10000000004.0000001c:head [write 507904~4096 in=4096b,write 614400~4096 in=4096b,write 634880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.768 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.656897+0000", 2023-10-08T07:07:27.769 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.047056136999999998, 2023-10-08T07:07:27.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047702805000000001, 2023-10-08T07:07:27.769 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.769 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:27.769 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.769 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.769 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.769 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114692 2023-10-08T07:07:27.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.769 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.656897+0000", 2023-10-08T07:07:27.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.656897+0000", 2023-10-08T07:07:27.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.656898+0000", 2023-10-08T07:07:27.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5199999999999996e-07 2023-10-08T07:07:27.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.656909+0000", 2023-10-08T07:07:27.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.165e-05 2023-10-08T07:07:27.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.656918+0000", 2023-10-08T07:07:27.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2023-10-08T07:07:27.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.656926+0000", 2023-10-08T07:07:27.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2910000000000002e-06 2023-10-08T07:07:27.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:27.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.680833+0000", 2023-10-08T07:07:27.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023907261999999999 2023-10-08T07:07:27.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:27.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.680906+0000", 2023-10-08T07:07:27.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3430000000000007e-05 2023-10-08T07:07:27.773 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.773 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.773 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.773 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114765 4.2b e58/17 4:d776c1c9:::10000000004.0000003d:head v 58'3622, mlcod=58'3616)", 2023-10-08T07:07:27.773 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.682529+0000", 2023-10-08T07:07:27.773 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.021424256999999999, 2023-10-08T07:07:27.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022156345000000001, 2023-10-08T07:07:27.774 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.774 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:27.774 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682529+0000", 2023-10-08T07:07:27.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682529+0000", 2023-10-08T07:07:27.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682529+0000", 2023-10-08T07:07:27.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1799999999999995e-07 2023-10-08T07:07:27.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682541+0000", 2023-10-08T07:07:27.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.187e-05 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682551+0000", 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682558+0000", 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.973e-06 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.688778+0000", 2023-10-08T07:07:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062199430000000003 2023-10-08T07:07:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.688797+0000", 2023-10-08T07:07:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.95e-05 2023-10-08T07:07:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.778 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114799 4.15 4:aaa619cf:::10000000004.00000004:head [write 929792~4096 in=4096b,write 958464~12288 in=12288b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.778 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.694553+0000", 2023-10-08T07:07:27.778 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.009400561, 2023-10-08T07:07:27.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010202328, 2023-10-08T07:07:27.778 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.778 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:27.778 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.778 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.778 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.778 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114799 2023-10-08T07:07:27.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694553+0000", 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694553+0000", 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694553+0000", 2023-10-08T07:07:27.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.58e-07 2023-10-08T07:07:27.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694562+0000", 2023-10-08T07:07:27.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4669999999999993e-06 2023-10-08T07:07:27.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694568+0000", 2023-10-08T07:07:27.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7239999999999997e-06 2023-10-08T07:07:27.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694573+0000", 2023-10-08T07:07:27.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9150000000000004e-06 2023-10-08T07:07:27.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:27.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700157+0000", 2023-10-08T07:07:27.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055841550000000004 2023-10-08T07:07:27.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:27.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700209+0000", 2023-10-08T07:07:27.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1657999999999999e-05 2023-10-08T07:07:27.782 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.782 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.783 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.783 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112870 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.783 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.034523+0000", 2023-10-08T07:07:27.783 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.66942963700000002, 2023-10-08T07:07:27.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.67030408699999999, 2023-10-08T07:07:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112870 2023-10-08T07:07:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.034523+0000", 2023-10-08T07:07:27.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.034523+0000", 2023-10-08T07:07:27.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.034524+0000", 2023-10-08T07:07:27.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7000000000000003e-07 2023-10-08T07:07:27.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.034543+0000", 2023-10-08T07:07:27.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8790000000000001e-05 2023-10-08T07:07:27.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.034554+0000", 2023-10-08T07:07:27.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.028e-05 2023-10-08T07:07:27.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.034561+0000", 2023-10-08T07:07:27.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8059999999999995e-06 2023-10-08T07:07:27.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.787 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.788 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113620 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.788 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.285792+0000", 2023-10-08T07:07:27.788 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.41816070500000002, 2023-10-08T07:07:27.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41908997599999998, 2023-10-08T07:07:27.788 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.788 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.789 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.789 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.789 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113620 2023-10-08T07:07:27.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.789 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.285792+0000", 2023-10-08T07:07:27.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.285792+0000", 2023-10-08T07:07:27.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.285793+0000", 2023-10-08T07:07:27.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:07:27.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.285817+0000", 2023-10-08T07:07:27.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4431e-05 2023-10-08T07:07:27.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.285823+0000", 2023-10-08T07:07:27.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1519999999999997e-06 2023-10-08T07:07:27.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.285827+0000", 2023-10-08T07:07:27.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.63e-06 2023-10-08T07:07:27.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.793 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.793 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113793 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.794 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.350157+0000", 2023-10-08T07:07:27.794 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.35379591799999999, 2023-10-08T07:07:27.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.354776341, 2023-10-08T07:07:27.794 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.794 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.795 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113793 2023-10-08T07:07:27.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.795 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.350157+0000", 2023-10-08T07:07:27.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.350157+0000", 2023-10-08T07:07:27.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.350158+0000", 2023-10-08T07:07:27.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:07:27.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.350169+0000", 2023-10-08T07:07:27.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1102e-05 2023-10-08T07:07:27.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.350180+0000", 2023-10-08T07:07:27.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1266e-05 2023-10-08T07:07:27.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.350189+0000", 2023-10-08T07:07:27.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.422e-06 2023-10-08T07:07:27.798 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.798 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.799 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.799 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114542 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.799 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.606490+0000", 2023-10-08T07:07:27.799 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.097462754999999998, 2023-10-08T07:07:27.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.098494841999999999, 2023-10-08T07:07:27.799 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.800 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.800 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.800 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.800 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.800 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114542 2023-10-08T07:07:27.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.800 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.606490+0000", 2023-10-08T07:07:27.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.606490+0000", 2023-10-08T07:07:27.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.606491+0000", 2023-10-08T07:07:27.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:07:27.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.606502+0000", 2023-10-08T07:07:27.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0621999999999999e-05 2023-10-08T07:07:27.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.606509+0000", 2023-10-08T07:07:27.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9189999999999999e-06 2023-10-08T07:07:27.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.606515+0000", 2023-10-08T07:07:27.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4489999999999998e-06 2023-10-08T07:07:27.804 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.804 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.804 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.804 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114725 4.3b 4.d87b41fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.805 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.667875+0000", 2023-10-08T07:07:27.805 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.036078081999999997, 2023-10-08T07:07:27.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037162094999999999, 2023-10-08T07:07:27.805 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.805 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.806 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114725 2023-10-08T07:07:27.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.806 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.667875+0000", 2023-10-08T07:07:27.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.667875+0000", 2023-10-08T07:07:27.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.667876+0000", 2023-10-08T07:07:27.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999999e-07 2023-10-08T07:07:27.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.667887+0000", 2023-10-08T07:07:27.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1521e-05 2023-10-08T07:07:27.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.667898+0000", 2023-10-08T07:07:27.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0715e-05 2023-10-08T07:07:27.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.667906+0000", 2023-10-08T07:07:27.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4370000000000001e-06 2023-10-08T07:07:27.810 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.810 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.810 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.810 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114767 4.1b e58/17 4:d97fb168:::10000000004.00000008:head v 58'3631, mlcod=58'3628)", 2023-10-08T07:07:27.811 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.682708+0000", 2023-10-08T07:07:27.811 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.021245337, 2023-10-08T07:07:27.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022388815999999999, 2023-10-08T07:07:27.811 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.811 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:27.811 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682708+0000", 2023-10-08T07:07:27.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682708+0000", 2023-10-08T07:07:27.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682708+0000", 2023-10-08T07:07:27.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-07 2023-10-08T07:07:27.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682720+0000", 2023-10-08T07:07:27.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1891e-05 2023-10-08T07:07:27.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682729+0000", 2023-10-08T07:07:27.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0769999999999997e-06 2023-10-08T07:07:27.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682736+0000", 2023-10-08T07:07:27.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5509999999999996e-06 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.690909+0000", 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081732469999999998 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.690928+0000", 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8958999999999999e-05 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.814 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.815 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114800 4.2b e58/17)", 2023-10-08T07:07:27.815 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.695251+0000", 2023-10-08T07:07:27.815 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0087019829999999999, 2023-10-08T07:07:27.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00990335, 2023-10-08T07:07:27.815 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.815 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.815 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695251+0000", 2023-10-08T07:07:27.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695251+0000", 2023-10-08T07:07:27.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695252+0000", 2023-10-08T07:07:27.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.75e-07 2023-10-08T07:07:27.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695267+0000", 2023-10-08T07:07:27.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5176e-05 2023-10-08T07:07:27.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695274+0000", 2023-10-08T07:07:27.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.934e-06 2023-10-08T07:07:27.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695279+0000", 2023-10-08T07:07:27.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5480000000000001e-06 2023-10-08T07:07:27.818 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.818 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.819 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113690 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.819 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.314997+0000", 2023-10-08T07:07:27.819 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38895649700000001, 2023-10-08T07:07:27.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39020690499999999, 2023-10-08T07:07:27.819 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.819 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.819 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.820 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113690 2023-10-08T07:07:27.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.820 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.314997+0000", 2023-10-08T07:07:27.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.314997+0000", 2023-10-08T07:07:27.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.314998+0000", 2023-10-08T07:07:27.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3399999999999997e-07 2023-10-08T07:07:27.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.315019+0000", 2023-10-08T07:07:27.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1471000000000002e-05 2023-10-08T07:07:27.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.315032+0000", 2023-10-08T07:07:27.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2459999999999999e-05 2023-10-08T07:07:27.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.315040+0000", 2023-10-08T07:07:27.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0209999999999999e-06 2023-10-08T07:07:27.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.823 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.823 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114624 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.824 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.635772+0000", 2023-10-08T07:07:27.824 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.068180645999999998, 2023-10-08T07:07:27.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069485876000000002, 2023-10-08T07:07:27.824 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.824 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.824 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114624 2023-10-08T07:07:27.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.825 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.635772+0000", 2023-10-08T07:07:27.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.635772+0000", 2023-10-08T07:07:27.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.635773+0000", 2023-10-08T07:07:27.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4799999999999999e-07 2023-10-08T07:07:27.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.635783+0000", 2023-10-08T07:07:27.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0067e-05 2023-10-08T07:07:27.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.635790+0000", 2023-10-08T07:07:27.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4969999999999998e-06 2023-10-08T07:07:27.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.635795+0000", 2023-10-08T07:07:27.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0839999999999999e-06 2023-10-08T07:07:27.828 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.828 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.828 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.828 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114763 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.828 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.682836+0000", 2023-10-08T07:07:27.829 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.021117619000000001, 2023-10-08T07:07:27.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022486145999999999, 2023-10-08T07:07:27.829 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.829 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.829 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.829 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.829 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.829 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114763 2023-10-08T07:07:27.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.829 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682836+0000", 2023-10-08T07:07:27.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682836+0000", 2023-10-08T07:07:27.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682837+0000", 2023-10-08T07:07:27.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9099999999999991e-07 2023-10-08T07:07:27.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682850+0000", 2023-10-08T07:07:27.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3509999999999999e-05 2023-10-08T07:07:27.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682859+0000", 2023-10-08T07:07:27.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7809999999999994e-06 2023-10-08T07:07:27.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682866+0000", 2023-10-08T07:07:27.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.063e-06 2023-10-08T07:07:27.832 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.832 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.832 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.833 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114801 4.29 4:94216392:::10000000004.0000002b:head [write 2711552~4096 in=4096b,write 2838528~4096 in=4096b,write 3219456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.833 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.695834+0000", 2023-10-08T07:07:27.833 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0081195720000000002, 2023-10-08T07:07:27.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095484349999999992, 2023-10-08T07:07:27.833 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.833 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:27.833 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.833 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.833 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.833 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114801 2023-10-08T07:07:27.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.834 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695834+0000", 2023-10-08T07:07:27.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695834+0000", 2023-10-08T07:07:27.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695834+0000", 2023-10-08T07:07:27.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2099999999999995e-07 2023-10-08T07:07:27.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695849+0000", 2023-10-08T07:07:27.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4121000000000001e-05 2023-10-08T07:07:27.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695860+0000", 2023-10-08T07:07:27.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0957e-05 2023-10-08T07:07:27.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695876+0000", 2023-10-08T07:07:27.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5994e-05 2023-10-08T07:07:27.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:27.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.698556+0000", 2023-10-08T07:07:27.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026803479999999999 2023-10-08T07:07:27.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:27.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.698641+0000", 2023-10-08T07:07:27.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4887000000000002e-05 2023-10-08T07:07:27.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:27.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.698824+0000", 2023-10-08T07:07:27.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000183427 2023-10-08T07:07:27.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.838 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.838 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112797 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.839 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.010688+0000", 2023-10-08T07:07:27.839 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.69326529100000001, 2023-10-08T07:07:27.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.69476538600000004, 2023-10-08T07:07:27.839 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.839 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.839 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112797 2023-10-08T07:07:27.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.840 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.010688+0000", 2023-10-08T07:07:27.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.010688+0000", 2023-10-08T07:07:27.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.010689+0000", 2023-10-08T07:07:27.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6199999999999997e-07 2023-10-08T07:07:27.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.010700+0000", 2023-10-08T07:07:27.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1498000000000001e-05 2023-10-08T07:07:27.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.010710+0000", 2023-10-08T07:07:27.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0088999999999999e-05 2023-10-08T07:07:27.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.010717+0000", 2023-10-08T07:07:27.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2849999999999997e-06 2023-10-08T07:07:27.842 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.842 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.842 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.842 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112872 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.843 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.035133+0000", 2023-10-08T07:07:27.843 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.66882032300000005, 2023-10-08T07:07:27.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.67037522900000002, 2023-10-08T07:07:27.843 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.843 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.843 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112872 2023-10-08T07:07:27.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.843 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.035133+0000", 2023-10-08T07:07:27.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.035133+0000", 2023-10-08T07:07:27.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.035133+0000", 2023-10-08T07:07:27.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2699999999999999e-07 2023-10-08T07:07:27.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.035140+0000", 2023-10-08T07:07:27.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0269999999999998e-06 2023-10-08T07:07:27.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.035149+0000", 2023-10-08T07:07:27.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4519999999999997e-06 2023-10-08T07:07:27.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.035152+0000", 2023-10-08T07:07:27.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6660000000000001e-06 2023-10-08T07:07:27.846 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.846 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.847 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113061 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.847 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.096371+0000", 2023-10-08T07:07:27.847 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.60758197199999997, 2023-10-08T07:07:27.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.60919557700000004, 2023-10-08T07:07:27.847 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.847 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.847 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.847 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113061 2023-10-08T07:07:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.096371+0000", 2023-10-08T07:07:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.096371+0000", 2023-10-08T07:07:27.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.096372+0000", 2023-10-08T07:07:27.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9100000000000003e-07 2023-10-08T07:07:27.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.096389+0000", 2023-10-08T07:07:27.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6838e-05 2023-10-08T07:07:27.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.096398+0000", 2023-10-08T07:07:27.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2023-10-08T07:07:27.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.096406+0000", 2023-10-08T07:07:27.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.311e-06 2023-10-08T07:07:27.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.851 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.851 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113340 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.851 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.190183+0000", 2023-10-08T07:07:27.851 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51377012300000002, 2023-10-08T07:07:27.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.51544540100000003, 2023-10-08T07:07:27.852 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.852 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.852 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.852 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.852 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.852 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113340 2023-10-08T07:07:27.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.852 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.190183+0000", 2023-10-08T07:07:27.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.190183+0000", 2023-10-08T07:07:27.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.190184+0000", 2023-10-08T07:07:27.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0299999999999997e-07 2023-10-08T07:07:27.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.190196+0000", 2023-10-08T07:07:27.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2343e-05 2023-10-08T07:07:27.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.190207+0000", 2023-10-08T07:07:27.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0465999999999999e-05 2023-10-08T07:07:27.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.190214+0000", 2023-10-08T07:07:27.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.951e-06 2023-10-08T07:07:27.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.855 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.855 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114183 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.855 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.483689+0000", 2023-10-08T07:07:27.855 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.22026401100000001, 2023-10-08T07:07:27.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22200059899999999, 2023-10-08T07:07:27.856 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.856 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.856 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114183 2023-10-08T07:07:27.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.856 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.483689+0000", 2023-10-08T07:07:27.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.483689+0000", 2023-10-08T07:07:27.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.483690+0000", 2023-10-08T07:07:27.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3600000000000003e-07 2023-10-08T07:07:27.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.483700+0000", 2023-10-08T07:07:27.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0433e-05 2023-10-08T07:07:27.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.483709+0000", 2023-10-08T07:07:27.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7919999999999998e-06 2023-10-08T07:07:27.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.483716+0000", 2023-10-08T07:07:27.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4840000000000001e-06 2023-10-08T07:07:27.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.859 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.859 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114766 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.859 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.682877+0000", 2023-10-08T07:07:27.859 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.02107614, 2023-10-08T07:07:27.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022875151, 2023-10-08T07:07:27.860 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.860 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.860 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.860 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.860 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.860 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114766 2023-10-08T07:07:27.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.860 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682877+0000", 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682877+0000", 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682878+0000", 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3099999999999997e-07 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682888+0000", 2023-10-08T07:07:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0185e-05 2023-10-08T07:07:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682895+0000", 2023-10-08T07:07:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7150000000000001e-06 2023-10-08T07:07:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.682900+0000", 2023-10-08T07:07:27.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4879999999999998e-06 2023-10-08T07:07:27.863 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.863 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.863 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.863 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114802 4.4 4:2158769a:::10000000004.0000002a:head [write 974848~4096 in=4096b,write 1093632~4096 in=4096b,write 1347584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.863 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.695891+0000", 2023-10-08T07:07:27.863 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0080625209999999996, 2023-10-08T07:07:27.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0099281790000000005, 2023-10-08T07:07:27.864 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.864 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:27.864 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.864 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.864 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.864 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114802 2023-10-08T07:07:27.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.864 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695891+0000", 2023-10-08T07:07:27.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695891+0000", 2023-10-08T07:07:27.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695891+0000", 2023-10-08T07:07:27.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6199999999999997e-07 2023-10-08T07:07:27.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695902+0000", 2023-10-08T07:07:27.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1209000000000001e-05 2023-10-08T07:07:27.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695919+0000", 2023-10-08T07:07:27.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6367000000000001e-05 2023-10-08T07:07:27.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695929+0000", 2023-10-08T07:07:27.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0202e-05 2023-10-08T07:07:27.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:27.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696347+0000", 2023-10-08T07:07:27.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00041838599999999997 2023-10-08T07:07:27.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:27.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696423+0000", 2023-10-08T07:07:27.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5877999999999994e-05 2023-10-08T07:07:27.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.868 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.868 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.868 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112660 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.868 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:26.936310+0000", 2023-10-08T07:07:27.868 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.76764332400000002, 2023-10-08T07:07:27.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.76957520400000001, 2023-10-08T07:07:27.868 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.868 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.869 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.869 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.869 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.869 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112660 2023-10-08T07:07:27.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.869 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.936310+0000", 2023-10-08T07:07:27.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.936310+0000", 2023-10-08T07:07:27.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.936311+0000", 2023-10-08T07:07:27.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6599999999999995e-07 2023-10-08T07:07:27.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.936321+0000", 2023-10-08T07:07:27.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0913e-05 2023-10-08T07:07:27.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.936333+0000", 2023-10-08T07:07:27.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1678999999999999e-05 2023-10-08T07:07:27.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.936341+0000", 2023-10-08T07:07:27.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4050000000000003e-06 2023-10-08T07:07:27.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.872 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.872 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.872 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112944 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.872 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.057960+0000", 2023-10-08T07:07:27.872 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64599318699999997, 2023-10-08T07:07:27.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.64798599199999996, 2023-10-08T07:07:27.872 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.872 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.873 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.873 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112944 2023-10-08T07:07:27.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.873 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.057960+0000", 2023-10-08T07:07:27.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.057960+0000", 2023-10-08T07:07:27.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.057961+0000", 2023-10-08T07:07:27.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6700000000000003e-07 2023-10-08T07:07:27.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.057973+0000", 2023-10-08T07:07:27.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1800000000000001e-05 2023-10-08T07:07:27.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.057982+0000", 2023-10-08T07:07:27.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3810000000000005e-06 2023-10-08T07:07:27.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.057989+0000", 2023-10-08T07:07:27.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7290000000000003e-06 2023-10-08T07:07:27.876 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.876 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.876 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.877 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113032 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.877 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.087507+0000", 2023-10-08T07:07:27.877 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61644587100000003, 2023-10-08T07:07:27.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61849936299999997, 2023-10-08T07:07:27.877 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.877 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.877 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113032 2023-10-08T07:07:27.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.878 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.087507+0000", 2023-10-08T07:07:27.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.087507+0000", 2023-10-08T07:07:27.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.087508+0000", 2023-10-08T07:07:27.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1399999999999995e-07 2023-10-08T07:07:27.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.087521+0000", 2023-10-08T07:07:27.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2901999999999999e-05 2023-10-08T07:07:27.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.087531+0000", 2023-10-08T07:07:27.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7839999999999998e-06 2023-10-08T07:07:27.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.087538+0000", 2023-10-08T07:07:27.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9550000000000003e-06 2023-10-08T07:07:27.880 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.880 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.880 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.881 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113227 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.881 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.152480+0000", 2023-10-08T07:07:27.881 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55147319900000003, 2023-10-08T07:07:27.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.55358298500000003, 2023-10-08T07:07:27.881 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.881 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.881 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.881 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.881 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.882 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113227 2023-10-08T07:07:27.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.882 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.152480+0000", 2023-10-08T07:07:27.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.152480+0000", 2023-10-08T07:07:27.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.152481+0000", 2023-10-08T07:07:27.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2699999999999999e-07 2023-10-08T07:07:27.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.152490+0000", 2023-10-08T07:07:27.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6260000000000007e-06 2023-10-08T07:07:27.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.152497+0000", 2023-10-08T07:07:27.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6200000000000001e-06 2023-10-08T07:07:27.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.152503+0000", 2023-10-08T07:07:27.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7610000000000004e-06 2023-10-08T07:07:27.885 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.885 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.885 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.885 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113663 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.885 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.306135+0000", 2023-10-08T07:07:27.885 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39781847399999998, 2023-10-08T07:07:27.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39996016000000001, 2023-10-08T07:07:27.886 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.886 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.886 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.886 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.886 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.886 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113663 2023-10-08T07:07:27.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.886 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.306135+0000", 2023-10-08T07:07:27.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.306135+0000", 2023-10-08T07:07:27.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.306135+0000", 2023-10-08T07:07:27.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3999999999999997e-07 2023-10-08T07:07:27.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.306143+0000", 2023-10-08T07:07:27.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5390000000000002e-06 2023-10-08T07:07:27.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.306149+0000", 2023-10-08T07:07:27.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2689999999999996e-06 2023-10-08T07:07:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.306154+0000", 2023-10-08T07:07:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0030000000000002e-06 2023-10-08T07:07:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113758 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.339938+0000", 2023-10-08T07:07:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.36401550799999999, 2023-10-08T07:07:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.36619009200000002, 2023-10-08T07:07:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113758 2023-10-08T07:07:27.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.891 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.339938+0000", 2023-10-08T07:07:27.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.339938+0000", 2023-10-08T07:07:27.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.339939+0000", 2023-10-08T07:07:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.049e-06 2023-10-08T07:07:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.339952+0000", 2023-10-08T07:07:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3655000000000001e-05 2023-10-08T07:07:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.339964+0000", 2023-10-08T07:07:27.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1299e-05 2023-10-08T07:07:27.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.339972+0000", 2023-10-08T07:07:27.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2023-10-08T07:07:27.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.893 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.894 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.894 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114511 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.894 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.593866+0000", 2023-10-08T07:07:27.894 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.110087588, 2023-10-08T07:07:27.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.11229210000000001, 2023-10-08T07:07:27.894 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.894 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.895 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114511 2023-10-08T07:07:27.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.895 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.593866+0000", 2023-10-08T07:07:27.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.593866+0000", 2023-10-08T07:07:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.593866+0000", 2023-10-08T07:07:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3799999999999996e-07 2023-10-08T07:07:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.593882+0000", 2023-10-08T07:07:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5741000000000001e-05 2023-10-08T07:07:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.593894+0000", 2023-10-08T07:07:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1839e-05 2023-10-08T07:07:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.593902+0000", 2023-10-08T07:07:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7139999999999993e-06 2023-10-08T07:07:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114632 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.637298+0000", 2023-10-08T07:07:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.066655137000000003, 2023-10-08T07:07:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068889499000000007, 2023-10-08T07:07:27.898 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114632 2023-10-08T07:07:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.637298+0000", 2023-10-08T07:07:27.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.637298+0000", 2023-10-08T07:07:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.637299+0000", 2023-10-08T07:07:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.124e-06 2023-10-08T07:07:27.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.637312+0000", 2023-10-08T07:07:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2847000000000001e-05 2023-10-08T07:07:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.637330+0000", 2023-10-08T07:07:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8289000000000001e-05 2023-10-08T07:07:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.637339+0000", 2023-10-08T07:07:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5909999999999996e-06 2023-10-08T07:07:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114769 4.30 e58/17 4:0f322a22:::10000000004.00000014:head v 58'1801, mlcod=58'1797)", 2023-10-08T07:07:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.683860+0000", 2023-10-08T07:07:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.020092934, 2023-10-08T07:07:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022357973999999999, 2023-10-08T07:07:27.902 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.683860+0000", 2023-10-08T07:07:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.683860+0000", 2023-10-08T07:07:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.683861+0000", 2023-10-08T07:07:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.68e-07 2023-10-08T07:07:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.683878+0000", 2023-10-08T07:07:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7623000000000001e-05 2023-10-08T07:07:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.683898+0000", 2023-10-08T07:07:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9389e-05 2023-10-08T07:07:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.683905+0000", 2023-10-08T07:07:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2060000000000001e-06 2023-10-08T07:07:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697045+0000", 2023-10-08T07:07:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013140384 2023-10-08T07:07:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697063+0000", 2023-10-08T07:07:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7469000000000002e-05 2023-10-08T07:07:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114803 4.3e 4:7cb83261:::10000000004.0000003b:head [write 2916352~4096 in=4096b,write 2932736~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.695944+0000", 2023-10-08T07:07:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0080093939999999995, 2023-10-08T07:07:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010310269, 2023-10-08T07:07:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.907 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114803 2023-10-08T07:07:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695944+0000", 2023-10-08T07:07:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695944+0000", 2023-10-08T07:07:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695944+0000", 2023-10-08T07:07:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2600000000000002e-07 2023-10-08T07:07:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695959+0000", 2023-10-08T07:07:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4178999999999999e-05 2023-10-08T07:07:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695968+0000", 2023-10-08T07:07:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9609999999999994e-06 2023-10-08T07:07:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.695974+0000", 2023-10-08T07:07:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1550000000000004e-06 2023-10-08T07:07:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702673+0000", 2023-10-08T07:07:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066989520000000002 2023-10-08T07:07:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:27.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702751+0000", 2023-10-08T07:07:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8597999999999995e-05 2023-10-08T07:07:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112664 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:26.938462+0000", 2023-10-08T07:07:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.76549141499999995, 2023-10-08T07:07:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.76783550899999997, 2023-10-08T07:07:27.912 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112664 2023-10-08T07:07:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.938462+0000", 2023-10-08T07:07:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.938462+0000", 2023-10-08T07:07:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.938463+0000", 2023-10-08T07:07:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0160000000000001e-06 2023-10-08T07:07:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.938475+0000", 2023-10-08T07:07:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.203e-05 2023-10-08T07:07:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.938485+0000", 2023-10-08T07:07:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0587999999999999e-05 2023-10-08T07:07:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.938493+0000", 2023-10-08T07:07:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4730000000000003e-06 2023-10-08T07:07:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.916 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113306 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.178104+0000", 2023-10-08T07:07:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.525849542, 2023-10-08T07:07:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.52824600399999999, 2023-10-08T07:07:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.917 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113306 2023-10-08T07:07:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.178104+0000", 2023-10-08T07:07:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.178104+0000", 2023-10-08T07:07:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.178104+0000", 2023-10-08T07:07:27.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:07:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.178143+0000", 2023-10-08T07:07:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9261999999999998e-05 2023-10-08T07:07:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.178151+0000", 2023-10-08T07:07:27.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2320000000000004e-06 2023-10-08T07:07:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.178156+0000", 2023-10-08T07:07:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0499999999999999e-06 2023-10-08T07:07:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113511 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.245174+0000", 2023-10-08T07:07:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.45877865899999998, 2023-10-08T07:07:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46124137999999998, 2023-10-08T07:07:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.922 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113511 2023-10-08T07:07:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.245174+0000", 2023-10-08T07:07:27.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.245174+0000", 2023-10-08T07:07:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.245175+0000", 2023-10-08T07:07:27.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.44e-07 2023-10-08T07:07:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.245219+0000", 2023-10-08T07:07:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3874e-05 2023-10-08T07:07:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.245229+0000", 2023-10-08T07:07:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7890000000000006e-06 2023-10-08T07:07:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.245236+0000", 2023-10-08T07:07:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1960000000000002e-06 2023-10-08T07:07:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.928 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114357 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.541325+0000", 2023-10-08T07:07:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.162627986, 2023-10-08T07:07:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.165157252, 2023-10-08T07:07:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114357 2023-10-08T07:07:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.929 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.541325+0000", 2023-10-08T07:07:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.541325+0000", 2023-10-08T07:07:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.541326+0000", 2023-10-08T07:07:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6400000000000002e-07 2023-10-08T07:07:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.541377+0000", 2023-10-08T07:07:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1085000000000003e-05 2023-10-08T07:07:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.541388+0000", 2023-10-08T07:07:27.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1452e-05 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.541395+0000", 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8870000000000003e-06 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114430 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.565029+0000", 2023-10-08T07:07:27.932 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.13892370700000001, 2023-10-08T07:07:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.14149093099999999, 2023-10-08T07:07:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114430 2023-10-08T07:07:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.565029+0000", 2023-10-08T07:07:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.565029+0000", 2023-10-08T07:07:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.565030+0000", 2023-10-08T07:07:27.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9000000000000005e-07 2023-10-08T07:07:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.565042+0000", 2023-10-08T07:07:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1365999999999999e-05 2023-10-08T07:07:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.565052+0000", 2023-10-08T07:07:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0424e-05 2023-10-08T07:07:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.565067+0000", 2023-10-08T07:07:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5007999999999999e-05 2023-10-08T07:07:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114770 4.c e58/17 4:31e28161:::10000000004.00000011:head v 58'3644, mlcod=58'3642)", 2023-10-08T07:07:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.684317+0000", 2023-10-08T07:07:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01963612, 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022235408000000002, 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.684317+0000", 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.684317+0000", 2023-10-08T07:07:27.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.684318+0000", 2023-10-08T07:07:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5400000000000001e-07 2023-10-08T07:07:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.684360+0000", 2023-10-08T07:07:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1968999999999997e-05 2023-10-08T07:07:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.684369+0000", 2023-10-08T07:07:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4970000000000007e-06 2023-10-08T07:07:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.684376+0000", 2023-10-08T07:07:27.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6630000000000004e-06 2023-10-08T07:07:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.684425+0000", 2023-10-08T07:07:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8843e-05 2023-10-08T07:07:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.684446+0000", 2023-10-08T07:07:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1566999999999999e-05 2023-10-08T07:07:27.940 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114804 4.19 4:9b26afe3:::10000000004.00000005:head [write 3719168~4096 in=4096b,write 3784704~4096 in=4096b,write 3813376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.696089+0000", 2023-10-08T07:07:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0078641130000000007, 2023-10-08T07:07:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010500453, 2023-10-08T07:07:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.941 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114804 2023-10-08T07:07:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696089+0000", 2023-10-08T07:07:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696089+0000", 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696090+0000", 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8899999999999998e-07 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696131+0000", 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1480000000000003e-05 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696140+0000", 2023-10-08T07:07:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0240000000000003e-06 2023-10-08T07:07:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696147+0000", 2023-10-08T07:07:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.985e-06 2023-10-08T07:07:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702387+0000", 2023-10-08T07:07:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062399070000000003 2023-10-08T07:07:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702484+0000", 2023-10-08T07:07:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7250999999999994e-05 2023-10-08T07:07:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112914 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.048512+0000", 2023-10-08T07:07:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.65544115999999997, 2023-10-08T07:07:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65811515899999995, 2023-10-08T07:07:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112914 2023-10-08T07:07:27.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.048512+0000", 2023-10-08T07:07:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.048512+0000", 2023-10-08T07:07:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.048513+0000", 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8700000000000005e-07 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.048564+0000", 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1357000000000003e-05 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.048576+0000", 2023-10-08T07:07:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1435e-05 2023-10-08T07:07:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.048582+0000", 2023-10-08T07:07:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2659999999999998e-06 2023-10-08T07:07:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112994 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.075598+0000", 2023-10-08T07:07:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.62835510999999999, 2023-10-08T07:07:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.63105902800000002, 2023-10-08T07:07:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.950 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112994 2023-10-08T07:07:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.075598+0000", 2023-10-08T07:07:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.075598+0000", 2023-10-08T07:07:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.075599+0000", 2023-10-08T07:07:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8100000000000002e-07 2023-10-08T07:07:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.075614+0000", 2023-10-08T07:07:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5664000000000001e-05 2023-10-08T07:07:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.075624+0000", 2023-10-08T07:07:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1060000000000006e-06 2023-10-08T07:07:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.075632+0000", 2023-10-08T07:07:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1419999999999993e-06 2023-10-08T07:07:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113202 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.144433+0000", 2023-10-08T07:07:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55951964099999996, 2023-10-08T07:07:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56225284600000003, 2023-10-08T07:07:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113202 2023-10-08T07:07:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144433+0000", 2023-10-08T07:07:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144433+0000", 2023-10-08T07:07:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144434+0000", 2023-10-08T07:07:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2023-10-08T07:07:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144442+0000", 2023-10-08T07:07:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.481e-06 2023-10-08T07:07:27.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144448+0000", 2023-10-08T07:07:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5139999999999998e-06 2023-10-08T07:07:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144452+0000", 2023-10-08T07:07:27.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3170000000000003e-06 2023-10-08T07:07:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113513 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.245981+0000", 2023-10-08T07:07:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.45797190700000001, 2023-10-08T07:07:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46073442399999998, 2023-10-08T07:07:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.959 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113513 2023-10-08T07:07:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.245981+0000", 2023-10-08T07:07:27.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.245981+0000", 2023-10-08T07:07:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.245982+0000", 2023-10-08T07:07:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5099999999999999e-07 2023-10-08T07:07:27.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.245991+0000", 2023-10-08T07:07:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2779999999999999e-06 2023-10-08T07:07:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.245999+0000", 2023-10-08T07:07:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2940000000000006e-06 2023-10-08T07:07:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.246004+0000", 2023-10-08T07:07:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4510000000000002e-06 2023-10-08T07:07:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113595 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.963 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.273465+0000", 2023-10-08T07:07:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43048795099999998, 2023-10-08T07:07:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43327974200000002, 2023-10-08T07:07:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113595 2023-10-08T07:07:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.273465+0000", 2023-10-08T07:07:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.273465+0000", 2023-10-08T07:07:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.273466+0000", 2023-10-08T07:07:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2999999999999999e-07 2023-10-08T07:07:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.273480+0000", 2023-10-08T07:07:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3947999999999999e-05 2023-10-08T07:07:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.273490+0000", 2023-10-08T07:07:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0329000000000001e-05 2023-10-08T07:07:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.273499+0000", 2023-10-08T07:07:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8799999999999997e-06 2023-10-08T07:07:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.967 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114324 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.533651+0000", 2023-10-08T07:07:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.170302073, 2023-10-08T07:07:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.173123623, 2023-10-08T07:07:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.968 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114324 2023-10-08T07:07:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.533651+0000", 2023-10-08T07:07:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.533651+0000", 2023-10-08T07:07:27.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.533652+0000", 2023-10-08T07:07:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.114e-06 2023-10-08T07:07:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.533666+0000", 2023-10-08T07:07:27.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3964e-05 2023-10-08T07:07:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.533676+0000", 2023-10-08T07:07:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.55e-06 2023-10-08T07:07:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.533682+0000", 2023-10-08T07:07:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6200000000000001e-06 2023-10-08T07:07:27.971 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114660 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.647557+0000", 2023-10-08T07:07:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.056395898999999999, 2023-10-08T07:07:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059247813000000003, 2023-10-08T07:07:27.972 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114660 2023-10-08T07:07:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647557+0000", 2023-10-08T07:07:27.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647557+0000", 2023-10-08T07:07:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647558+0000", 2023-10-08T07:07:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9100000000000004e-07 2023-10-08T07:07:27.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647573+0000", 2023-10-08T07:07:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5696999999999999e-05 2023-10-08T07:07:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647582+0000", 2023-10-08T07:07:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9809999999999992e-06 2023-10-08T07:07:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647588+0000", 2023-10-08T07:07:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0859999999999998e-06 2023-10-08T07:07:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.976 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114806 4.26 4:672c55ca:::10000000004.00000006:head [write 2797568~4096 in=4096b,write 2879488~4096 in=4096b,write 2973696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.696805+0000", 2023-10-08T07:07:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0071479910000000002, 2023-10-08T07:07:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010033261999999999, 2023-10-08T07:07:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114806 2023-10-08T07:07:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.977 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696805+0000", 2023-10-08T07:07:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696805+0000", 2023-10-08T07:07:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696806+0000", 2023-10-08T07:07:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4799999999999997e-07 2023-10-08T07:07:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696817+0000", 2023-10-08T07:07:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0981e-05 2023-10-08T07:07:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696829+0000", 2023-10-08T07:07:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1909999999999999e-05 2023-10-08T07:07:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696841+0000", 2023-10-08T07:07:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2346e-05 2023-10-08T07:07:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702654+0000", 2023-10-08T07:07:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058124919999999998 2023-10-08T07:07:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702721+0000", 2023-10-08T07:07:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7322000000000004e-05 2023-10-08T07:07:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702851+0000", 2023-10-08T07:07:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013013400000000001 2023-10-08T07:07:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112744 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:26.963582+0000", 2023-10-08T07:07:27.982 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74037114299999995, 2023-10-08T07:07:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.74329673600000001, 2023-10-08T07:07:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112744 2023-10-08T07:07:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.963582+0000", 2023-10-08T07:07:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.963582+0000", 2023-10-08T07:07:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.963582+0000", 2023-10-08T07:07:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2023-10-08T07:07:27.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.963597+0000", 2023-10-08T07:07:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4151999999999999e-05 2023-10-08T07:07:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.963604+0000", 2023-10-08T07:07:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3969999999999997e-06 2023-10-08T07:07:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.963609+0000", 2023-10-08T07:07:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8729999999999998e-06 2023-10-08T07:07:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113203 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.144475+0000", 2023-10-08T07:07:27.986 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55947784099999998, 2023-10-08T07:07:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56243305099999996, 2023-10-08T07:07:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113203 2023-10-08T07:07:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144475+0000", 2023-10-08T07:07:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144475+0000", 2023-10-08T07:07:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144476+0000", 2023-10-08T07:07:27.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:07:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144483+0000", 2023-10-08T07:07:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3849999999999996e-06 2023-10-08T07:07:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144491+0000", 2023-10-08T07:07:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3119999999999994e-06 2023-10-08T07:07:27.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144495+0000", 2023-10-08T07:07:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6880000000000001e-06 2023-10-08T07:07:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113629 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:27.990 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.289192+0000", 2023-10-08T07:07:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.41476069399999999, 2023-10-08T07:07:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.417755125, 2023-10-08T07:07:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113629 2023-10-08T07:07:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.289192+0000", 2023-10-08T07:07:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.289192+0000", 2023-10-08T07:07:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.289193+0000", 2023-10-08T07:07:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6199999999999997e-07 2023-10-08T07:07:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.289209+0000", 2023-10-08T07:07:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5376999999999999e-05 2023-10-08T07:07:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.289221+0000", 2023-10-08T07:07:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2432999999999999e-05 2023-10-08T07:07:27.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.289229+0000", 2023-10-08T07:07:27.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8930000000000005e-06 2023-10-08T07:07:27.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.994 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.994 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114662 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.994 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.647622+0000", 2023-10-08T07:07:27.995 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.056331559000000003, 2023-10-08T07:07:27.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059358236000000002, 2023-10-08T07:07:27.995 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.995 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.995 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114662 2023-10-08T07:07:27.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.995 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647622+0000", 2023-10-08T07:07:27.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:27.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647622+0000", 2023-10-08T07:07:27.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:27.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:27.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647622+0000", 2023-10-08T07:07:27.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4899999999999995e-07 2023-10-08T07:07:27.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:27.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647634+0000", 2023-10-08T07:07:27.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1817999999999999e-05 2023-10-08T07:07:27.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:27.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647656+0000", 2023-10-08T07:07:27.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1814000000000002e-05 2023-10-08T07:07:27.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:27.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647664+0000", 2023-10-08T07:07:27.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4479999999999994e-06 2023-10-08T07:07:27.998 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.998 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:27.998 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:27.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.998 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114773 4.3b 4.d87b41fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:27.998 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.685016+0000", 2023-10-08T07:07:27.998 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018936861999999999, 2023-10-08T07:07:27.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021995458999999998, 2023-10-08T07:07:27.999 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:27.999 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:27.999 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:27.999 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:27.999 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:27.999 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114773 2023-10-08T07:07:27.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:27.999 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:27.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:27.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:27.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685016+0000", 2023-10-08T07:07:28.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685016+0000", 2023-10-08T07:07:28.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685017+0000", 2023-10-08T07:07:28.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4899999999999995e-07 2023-10-08T07:07:28.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685027+0000", 2023-10-08T07:07:28.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6690000000000001e-06 2023-10-08T07:07:28.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685036+0000", 2023-10-08T07:07:28.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0410000000000003e-06 2023-10-08T07:07:28.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685041+0000", 2023-10-08T07:07:28.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0309999999999998e-06 2023-10-08T07:07:28.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.002 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.003 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114805 4.38 e58/46)", 2023-10-08T07:07:28.003 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.696992+0000", 2023-10-08T07:07:28.003 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0069610990000000001, 2023-10-08T07:07:28.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010050458, 2023-10-08T07:07:28.003 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.003 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.003 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696992+0000", 2023-10-08T07:07:28.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696992+0000", 2023-10-08T07:07:28.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696993+0000", 2023-10-08T07:07:28.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:07:28.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697008+0000", 2023-10-08T07:07:28.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5378000000000001e-05 2023-10-08T07:07:28.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697018+0000", 2023-10-08T07:07:28.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5429999999999999e-06 2023-10-08T07:07:28.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697024+0000", 2023-10-08T07:07:28.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9280000000000004e-06 2023-10-08T07:07:28.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.007 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.007 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112708 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.007 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:26.953834+0000", 2023-10-08T07:07:28.007 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.75011962099999996, 2023-10-08T07:07:28.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.75323707699999998, 2023-10-08T07:07:28.008 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.008 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.008 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112708 2023-10-08T07:07:28.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.008 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.953834+0000", 2023-10-08T07:07:28.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.953834+0000", 2023-10-08T07:07:28.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.953834+0000", 2023-10-08T07:07:28.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0100000000000003e-07 2023-10-08T07:07:28.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.953850+0000", 2023-10-08T07:07:28.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5764999999999999e-05 2023-10-08T07:07:28.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.953863+0000", 2023-10-08T07:07:28.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2445e-05 2023-10-08T07:07:28.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.953871+0000", 2023-10-08T07:07:28.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2979999999999992e-06 2023-10-08T07:07:28.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.012 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.012 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113204 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.012 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.144682+0000", 2023-10-08T07:07:28.012 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.559270767, 2023-10-08T07:07:28.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56241980800000002, 2023-10-08T07:07:28.012 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.013 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.013 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.013 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.013 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.013 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113204 2023-10-08T07:07:28.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.013 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144682+0000", 2023-10-08T07:07:28.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144682+0000", 2023-10-08T07:07:28.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144683+0000", 2023-10-08T07:07:28.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.37e-07 2023-10-08T07:07:28.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144733+0000", 2023-10-08T07:07:28.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0158000000000003e-05 2023-10-08T07:07:28.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144742+0000", 2023-10-08T07:07:28.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5909999999999996e-06 2023-10-08T07:07:28.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.144746+0000", 2023-10-08T07:07:28.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7530000000000001e-06 2023-10-08T07:07:28.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.017 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.017 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.017 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113271 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.017 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.166140+0000", 2023-10-08T07:07:28.017 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.53781328799999994, 2023-10-08T07:07:28.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.54099528399999997, 2023-10-08T07:07:28.017 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.018 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.018 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.018 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.018 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.018 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113271 2023-10-08T07:07:28.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.018 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.166140+0000", 2023-10-08T07:07:28.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.166140+0000", 2023-10-08T07:07:28.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.166140+0000", 2023-10-08T07:07:28.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0900000000000001e-07 2023-10-08T07:07:28.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.166160+0000", 2023-10-08T07:07:28.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9553999999999999e-05 2023-10-08T07:07:28.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.166168+0000", 2023-10-08T07:07:28.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3119999999999994e-06 2023-10-08T07:07:28.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.166175+0000", 2023-10-08T07:07:28.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3679999999999998e-06 2023-10-08T07:07:28.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.021 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.022 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113448 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.022 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.224380+0000", 2023-10-08T07:07:28.022 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47957357299999998, 2023-10-08T07:07:28.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48280171900000002, 2023-10-08T07:07:28.022 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.022 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.022 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.022 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.022 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.023 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113448 2023-10-08T07:07:28.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.023 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.224380+0000", 2023-10-08T07:07:28.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.224380+0000", 2023-10-08T07:07:28.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.224380+0000", 2023-10-08T07:07:28.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.58e-07 2023-10-08T07:07:28.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.224416+0000", 2023-10-08T07:07:28.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5824000000000001e-05 2023-10-08T07:07:28.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.224423+0000", 2023-10-08T07:07:28.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2459999999999997e-06 2023-10-08T07:07:28.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.224427+0000", 2023-10-08T07:07:28.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5980000000000001e-06 2023-10-08T07:07:28.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.026 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.026 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113597 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.026 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.274103+0000", 2023-10-08T07:07:28.026 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42984999600000001, 2023-10-08T07:07:28.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43311005499999999, 2023-10-08T07:07:28.027 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.027 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.027 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113597 2023-10-08T07:07:28.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.027 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.274103+0000", 2023-10-08T07:07:28.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.274103+0000", 2023-10-08T07:07:28.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.274104+0000", 2023-10-08T07:07:28.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2799999999999995e-07 2023-10-08T07:07:28.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.274115+0000", 2023-10-08T07:07:28.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1506e-05 2023-10-08T07:07:28.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.274125+0000", 2023-10-08T07:07:28.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6690000000000001e-06 2023-10-08T07:07:28.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.274132+0000", 2023-10-08T07:07:28.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9670000000000004e-06 2023-10-08T07:07:28.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.030 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.030 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113796 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.030 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.351197+0000", 2023-10-08T07:07:28.031 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.35275658100000001, 2023-10-08T07:07:28.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.35604765799999999, 2023-10-08T07:07:28.031 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.031 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.031 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.031 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.031 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.031 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113796 2023-10-08T07:07:28.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.032 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.351197+0000", 2023-10-08T07:07:28.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.351197+0000", 2023-10-08T07:07:28.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.351197+0000", 2023-10-08T07:07:28.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1500000000000004e-07 2023-10-08T07:07:28.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.351210+0000", 2023-10-08T07:07:28.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2303999999999999e-05 2023-10-08T07:07:28.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.351219+0000", 2023-10-08T07:07:28.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1989999999999995e-06 2023-10-08T07:07:28.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.351225+0000", 2023-10-08T07:07:28.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2779999999999999e-06 2023-10-08T07:07:28.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.035 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.035 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.035 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114006 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.035 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.425355+0000", 2023-10-08T07:07:28.035 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.27859784900000001, 2023-10-08T07:07:28.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.28201079499999998, 2023-10-08T07:07:28.035 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.035 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.036 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114006 2023-10-08T07:07:28.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.036 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.425355+0000", 2023-10-08T07:07:28.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.425355+0000", 2023-10-08T07:07:28.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.425356+0000", 2023-10-08T07:07:28.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6100000000000001e-07 2023-10-08T07:07:28.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.425368+0000", 2023-10-08T07:07:28.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2201999999999999e-05 2023-10-08T07:07:28.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.425375+0000", 2023-10-08T07:07:28.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3479999999999998e-06 2023-10-08T07:07:28.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.425381+0000", 2023-10-08T07:07:28.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5090000000000001e-06 2023-10-08T07:07:28.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.039 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.039 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114079 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.039 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.449210+0000", 2023-10-08T07:07:28.039 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.25474303500000001, 2023-10-08T07:07:28.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.258214728, 2023-10-08T07:07:28.039 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.039 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.040 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114079 2023-10-08T07:07:28.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.040 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.449210+0000", 2023-10-08T07:07:28.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.449210+0000", 2023-10-08T07:07:28.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.449211+0000", 2023-10-08T07:07:28.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:07:28.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.449223+0000", 2023-10-08T07:07:28.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1911e-05 2023-10-08T07:07:28.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.449234+0000", 2023-10-08T07:07:28.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0642000000000001e-05 2023-10-08T07:07:28.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.449241+0000", 2023-10-08T07:07:28.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.554e-06 2023-10-08T07:07:28.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.043 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.043 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114116 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.043 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.463324+0000", 2023-10-08T07:07:28.043 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.24062884100000001, 2023-10-08T07:07:28.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.24415669500000001, 2023-10-08T07:07:28.043 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.043 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.044 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114116 2023-10-08T07:07:28.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.044 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.463324+0000", 2023-10-08T07:07:28.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.463324+0000", 2023-10-08T07:07:28.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.463325+0000", 2023-10-08T07:07:28.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7700000000000004e-07 2023-10-08T07:07:28.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.463337+0000", 2023-10-08T07:07:28.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2135e-05 2023-10-08T07:07:28.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.463346+0000", 2023-10-08T07:07:28.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0559999999999994e-06 2023-10-08T07:07:28.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.463354+0000", 2023-10-08T07:07:28.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1119999999999996e-06 2023-10-08T07:07:28.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.047 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.047 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114480 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.047 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.582862+0000", 2023-10-08T07:07:28.047 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.121091239, 2023-10-08T07:07:28.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12467099800000001, 2023-10-08T07:07:28.047 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.047 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.048 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114480 2023-10-08T07:07:28.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.048 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.582862+0000", 2023-10-08T07:07:28.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.582862+0000", 2023-10-08T07:07:28.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.582863+0000", 2023-10-08T07:07:28.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0300000000000001e-06 2023-10-08T07:07:28.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.582877+0000", 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.42e-05 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.582887+0000", 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.582893+0000", 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.917e-06 2023-10-08T07:07:28.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.051 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.051 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114552 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.051 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.609619+0000", 2023-10-08T07:07:28.051 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.094333882999999993, 2023-10-08T07:07:28.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.097967126000000002, 2023-10-08T07:07:28.051 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.051 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.052 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114552 2023-10-08T07:07:28.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.052 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.609619+0000", 2023-10-08T07:07:28.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.609619+0000", 2023-10-08T07:07:28.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.609620+0000", 2023-10-08T07:07:28.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3500000000000005e-07 2023-10-08T07:07:28.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.609639+0000", 2023-10-08T07:07:28.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8644999999999999e-05 2023-10-08T07:07:28.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.609648+0000", 2023-10-08T07:07:28.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2410000000000001e-06 2023-10-08T07:07:28.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.609656+0000", 2023-10-08T07:07:28.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1019999999999997e-06 2023-10-08T07:07:28.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.055 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.055 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114663 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.055 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.647675+0000", 2023-10-08T07:07:28.055 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.056278241999999999, 2023-10-08T07:07:28.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059964302999999997, 2023-10-08T07:07:28.055 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.055 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.056 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114663 2023-10-08T07:07:28.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.056 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647675+0000", 2023-10-08T07:07:28.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647675+0000", 2023-10-08T07:07:28.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647675+0000", 2023-10-08T07:07:28.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7800000000000001e-07 2023-10-08T07:07:28.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647697+0000", 2023-10-08T07:07:28.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1739999999999999e-05 2023-10-08T07:07:28.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647708+0000", 2023-10-08T07:07:28.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1012999999999999e-05 2023-10-08T07:07:28.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.647715+0000", 2023-10-08T07:07:28.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4570000000000002e-06 2023-10-08T07:07:28.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.059 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.059 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114774 4.3b 4.1fd270fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.059 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.685367+0000", 2023-10-08T07:07:28.059 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018586617, 2023-10-08T07:07:28.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022325073000000001, 2023-10-08T07:07:28.059 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.059 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.059 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.060 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114774 2023-10-08T07:07:28.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.060 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685367+0000", 2023-10-08T07:07:28.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685367+0000", 2023-10-08T07:07:28.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685367+0000", 2023-10-08T07:07:28.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:07:28.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685385+0000", 2023-10-08T07:07:28.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7716000000000001e-05 2023-10-08T07:07:28.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685392+0000", 2023-10-08T07:07:28.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5909999999999998e-06 2023-10-08T07:07:28.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685397+0000", 2023-10-08T07:07:28.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2200000000000003e-06 2023-10-08T07:07:28.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.063 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.063 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114807 4.15 4:aaa619cf:::10000000004.00000004:head [write 2093056~4096 in=4096b,write 2252800~4096 in=4096b,write 2277376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.063 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.697298+0000", 2023-10-08T07:07:28.063 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0066548939999999997, 2023-10-08T07:07:28.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010478642, 2023-10-08T07:07:28.063 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.064 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.064 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114807 2023-10-08T07:07:28.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.064 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697298+0000", 2023-10-08T07:07:28.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697298+0000", 2023-10-08T07:07:28.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697299+0000", 2023-10-08T07:07:28.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:28.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697661+0000", 2023-10-08T07:07:28.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000362254 2023-10-08T07:07:28.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697703+0000", 2023-10-08T07:07:28.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1394999999999999e-05 2023-10-08T07:07:28.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697713+0000", 2023-10-08T07:07:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0383999999999999e-05 2023-10-08T07:07:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702887+0000", 2023-10-08T07:07:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051742799999999999 2023-10-08T07:07:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702965+0000", 2023-10-08T07:07:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7423999999999996e-05 2023-10-08T07:07:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.068 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.068 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112877 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.068 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.037537+0000", 2023-10-08T07:07:28.068 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.66641572500000001, 2023-10-08T07:07:28.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.67030780400000001, 2023-10-08T07:07:28.068 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.068 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.069 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.069 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.069 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112877 2023-10-08T07:07:28.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.069 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.037537+0000", 2023-10-08T07:07:28.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.037537+0000", 2023-10-08T07:07:28.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.037538+0000", 2023-10-08T07:07:28.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4099999999999997e-07 2023-10-08T07:07:28.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.037551+0000", 2023-10-08T07:07:28.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2743e-05 2023-10-08T07:07:28.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.037562+0000", 2023-10-08T07:07:28.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1235e-05 2023-10-08T07:07:28.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.037571+0000", 2023-10-08T07:07:28.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8240000000000006e-06 2023-10-08T07:07:28.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.072 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.072 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112916 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.072 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.049036+0000", 2023-10-08T07:07:28.072 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.65491675299999996, 2023-10-08T07:07:28.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65886487199999999, 2023-10-08T07:07:28.072 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.072 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.073 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112916 2023-10-08T07:07:28.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.073 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.049036+0000", 2023-10-08T07:07:28.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.049036+0000", 2023-10-08T07:07:28.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.049037+0000", 2023-10-08T07:07:28.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8599999999999997e-07 2023-10-08T07:07:28.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.049105+0000", 2023-10-08T07:07:28.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7663000000000006e-05 2023-10-08T07:07:28.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.049116+0000", 2023-10-08T07:07:28.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1260999999999999e-05 2023-10-08T07:07:28.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.049127+0000", 2023-10-08T07:07:28.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0675e-05 2023-10-08T07:07:28.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.076 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.076 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.076 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113037 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.076 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.088906+0000", 2023-10-08T07:07:28.076 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61504701900000003, 2023-10-08T07:07:28.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61904825399999996, 2023-10-08T07:07:28.076 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.076 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.077 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.077 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.077 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113037 2023-10-08T07:07:28.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.077 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.088906+0000", 2023-10-08T07:07:28.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.088906+0000", 2023-10-08T07:07:28.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.088907+0000", 2023-10-08T07:07:28.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0699999999999996e-07 2023-10-08T07:07:28.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.088918+0000", 2023-10-08T07:07:28.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0835e-05 2023-10-08T07:07:28.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.088928+0000", 2023-10-08T07:07:28.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0098999999999999e-05 2023-10-08T07:07:28.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.088936+0000", 2023-10-08T07:07:28.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6799999999999993e-06 2023-10-08T07:07:28.080 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.080 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.080 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.080 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114735 4.3f 4:fc9a2d79:::10000000004.0000002f:head [write 4059136~4096 in=4096b,write 4067328~4096 in=4096b,write 4153344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.080 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.671002+0000", 2023-10-08T07:07:28.080 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.032951477999999999, 2023-10-08T07:07:28.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037032748999999997, 2023-10-08T07:07:28.080 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.080 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.081 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.081 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.081 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114735 2023-10-08T07:07:28.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.081 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.671002+0000", 2023-10-08T07:07:28.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.671002+0000", 2023-10-08T07:07:28.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.671002+0000", 2023-10-08T07:07:28.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7899999999999997e-07 2023-10-08T07:07:28.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.671032+0000", 2023-10-08T07:07:28.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9289999999999999e-05 2023-10-08T07:07:28.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.671041+0000", 2023-10-08T07:07:28.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1570000000000006e-06 2023-10-08T07:07:28.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.671047+0000", 2023-10-08T07:07:28.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5130000000000002e-06 2023-10-08T07:07:28.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691832+0000", 2023-10-08T07:07:28.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020784493000000001 2023-10-08T07:07:28.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691909+0000", 2023-10-08T07:07:28.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6773999999999994e-05 2023-10-08T07:07:28.084 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.085 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.085 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.085 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114775 4.9 4:90f7d93b:::10000000004.00000021:head [write 77824~4096 in=4096b,write 106496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.085 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.685651+0000", 2023-10-08T07:07:28.085 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018302573999999999, 2023-10-08T07:07:28.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022462593999999999, 2023-10-08T07:07:28.085 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.085 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.085 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.086 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.086 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.086 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114775 2023-10-08T07:07:28.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.086 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685651+0000", 2023-10-08T07:07:28.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685651+0000", 2023-10-08T07:07:28.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685651+0000", 2023-10-08T07:07:28.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1199999999999998e-07 2023-10-08T07:07:28.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685657+0000", 2023-10-08T07:07:28.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8119999999999996e-06 2023-10-08T07:07:28.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685666+0000", 2023-10-08T07:07:28.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7369999999999995e-06 2023-10-08T07:07:28.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685669+0000", 2023-10-08T07:07:28.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7120000000000002e-06 2023-10-08T07:07:28.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.689069+0000", 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033996550000000001 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.689157+0000", 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8552000000000002e-05 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.090 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114808 4.f 4:f2537947:::10000000004.00000017:head [write 339968~4096 in=4096b,write 393216~4096 in=4096b,write 401408~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.090 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.697728+0000", 2023-10-08T07:07:28.090 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0062255080000000003, 2023-10-08T07:07:28.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010475141, 2023-10-08T07:07:28.090 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.090 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:07:28.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.090 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114808 2023-10-08T07:07:28.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.090 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697728+0000", 2023-10-08T07:07:28.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697728+0000", 2023-10-08T07:07:28.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697728+0000", 2023-10-08T07:07:28.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0100000000000004e-07 2023-10-08T07:07:28.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697742+0000", 2023-10-08T07:07:28.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3519e-05 2023-10-08T07:07:28.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697752+0000", 2023-10-08T07:07:28.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0213e-05 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697758+0000", 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1260000000000003e-06 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705454+0000", 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00769536 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.094 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112810 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.094 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.015384+0000", 2023-10-08T07:07:28.094 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.68856942600000004, 2023-10-08T07:07:28.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.69289321000000004, 2023-10-08T07:07:28.094 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.094 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.095 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.095 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112810 2023-10-08T07:07:28.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.095 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.015384+0000", 2023-10-08T07:07:28.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.015384+0000", 2023-10-08T07:07:28.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.015385+0000", 2023-10-08T07:07:28.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4399999999999999e-07 2023-10-08T07:07:28.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.015395+0000", 2023-10-08T07:07:28.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0461e-05 2023-10-08T07:07:28.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.015404+0000", 2023-10-08T07:07:28.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2550000000000003e-06 2023-10-08T07:07:28.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.015411+0000", 2023-10-08T07:07:28.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7050000000000002e-06 2023-10-08T07:07:28.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.098 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.098 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112917 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.098 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.049636+0000", 2023-10-08T07:07:28.098 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.65431708600000005, 2023-10-08T07:07:28.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65871347899999999, 2023-10-08T07:07:28.098 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.098 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.098 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.099 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112917 2023-10-08T07:07:28.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.099 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.049636+0000", 2023-10-08T07:07:28.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.049636+0000", 2023-10-08T07:07:28.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.049637+0000", 2023-10-08T07:07:28.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2099999999999995e-07 2023-10-08T07:07:28.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.049703+0000", 2023-10-08T07:07:28.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5894000000000003e-05 2023-10-08T07:07:28.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.049721+0000", 2023-10-08T07:07:28.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8374000000000001e-05 2023-10-08T07:07:28.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.049732+0000", 2023-10-08T07:07:28.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0764000000000001e-05 2023-10-08T07:07:28.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.102 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.102 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.102 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113311 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.102 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.179546+0000", 2023-10-08T07:07:28.102 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.52440742699999998, 2023-10-08T07:07:28.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.52887235700000002, 2023-10-08T07:07:28.102 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.102 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.102 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.102 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.103 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113311 2023-10-08T07:07:28.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.103 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.179546+0000", 2023-10-08T07:07:28.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.179546+0000", 2023-10-08T07:07:28.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.179547+0000", 2023-10-08T07:07:28.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.23e-07 2023-10-08T07:07:28.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.179558+0000", 2023-10-08T07:07:28.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0998999999999999e-05 2023-10-08T07:07:28.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.179569+0000", 2023-10-08T07:07:28.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1918e-05 2023-10-08T07:07:28.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.179577+0000", 2023-10-08T07:07:28.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2479999999999999e-06 2023-10-08T07:07:28.105 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.105 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.106 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114084 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.106 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.450630+0000", 2023-10-08T07:07:28.106 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.25332306900000001, 2023-10-08T07:07:28.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.25785257700000003, 2023-10-08T07:07:28.106 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.106 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114084 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.450630+0000", 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.450630+0000", 2023-10-08T07:07:28.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.450631+0000", 2023-10-08T07:07:28.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9599999999999999e-07 2023-10-08T07:07:28.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.450646+0000", 2023-10-08T07:07:28.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5287000000000001e-05 2023-10-08T07:07:28.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.450661+0000", 2023-10-08T07:07:28.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4809e-05 2023-10-08T07:07:28.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.450669+0000", 2023-10-08T07:07:28.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0069999999999997e-06 2023-10-08T07:07:28.109 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.109 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114598 4.3b 4.d87b41fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.626112+0000", 2023-10-08T07:07:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.077841368999999994, 2023-10-08T07:07:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.082432027000000005, 2023-10-08T07:07:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114598 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.626112+0000", 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.626112+0000", 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.626113+0000", 2023-10-08T07:07:28.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1900000000000001e-07 2023-10-08T07:07:28.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.626126+0000", 2023-10-08T07:07:28.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3101e-05 2023-10-08T07:07:28.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.626136+0000", 2023-10-08T07:07:28.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0477e-05 2023-10-08T07:07:28.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.626144+0000", 2023-10-08T07:07:28.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4270000000000002e-06 2023-10-08T07:07:28.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.113 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.114 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114699 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.114 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.659348+0000", 2023-10-08T07:07:28.114 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.044604761999999999, 2023-10-08T07:07:28.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049263363999999997, 2023-10-08T07:07:28.114 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.114 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.114 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114699 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.659348+0000", 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.659348+0000", 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.659349+0000", 2023-10-08T07:07:28.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1800000000000004e-07 2023-10-08T07:07:28.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.659361+0000", 2023-10-08T07:07:28.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.217e-05 2023-10-08T07:07:28.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.659372+0000", 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0135999999999999e-05 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.659379+0000", 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4780000000000002e-06 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.117 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114776 4.f 4:f2537947:::10000000004.00000017:head [write 28672~4096 in=4096b,write 110592~4096 in=4096b,write 126976~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.118 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.685849+0000", 2023-10-08T07:07:28.118 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018103833, 2023-10-08T07:07:28.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022839100000000001, 2023-10-08T07:07:28.118 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.118 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.118 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.118 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.118 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.118 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114776 2023-10-08T07:07:28.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.118 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685849+0000", 2023-10-08T07:07:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685849+0000", 2023-10-08T07:07:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685850+0000", 2023-10-08T07:07:28.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0400000000000005e-07 2023-10-08T07:07:28.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685890+0000", 2023-10-08T07:07:28.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9854999999999997e-05 2023-10-08T07:07:28.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685900+0000", 2023-10-08T07:07:28.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.73e-06 2023-10-08T07:07:28.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.685907+0000", 2023-10-08T07:07:28.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5549999999999997e-06 2023-10-08T07:07:28.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.693646+0000", 2023-10-08T07:07:28.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077388730000000003 2023-10-08T07:07:28.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.693742+0000", 2023-10-08T07:07:28.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5866000000000007e-05 2023-10-08T07:07:28.122 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.122 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.122 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.122 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114810 4.3a e58/17 4:5f183e4b:::10000000004.00000023:head v 58'5233, mlcod=58'5230)", 2023-10-08T07:07:28.123 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.698715+0000", 2023-10-08T07:07:28.123 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0052384349999999996, 2023-10-08T07:07:28.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010061693999999999, 2023-10-08T07:07:28.123 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.123 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.123 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.698715+0000", 2023-10-08T07:07:28.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.698715+0000", 2023-10-08T07:07:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.698715+0000", 2023-10-08T07:07:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0200000000000002e-07 2023-10-08T07:07:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.698728+0000", 2023-10-08T07:07:28.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2608e-05 2023-10-08T07:07:28.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.698742+0000", 2023-10-08T07:07:28.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4075e-05 2023-10-08T07:07:28.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.698753+0000", 2023-10-08T07:07:28.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1499e-05 2023-10-08T07:07:28.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699624+0000", 2023-10-08T07:07:28.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000870151 2023-10-08T07:07:28.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699642+0000", 2023-10-08T07:07:28.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8096000000000001e-05 2023-10-08T07:07:28.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.127 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.127 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112710 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.127 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:26.954623+0000", 2023-10-08T07:07:28.127 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74933019499999998, 2023-10-08T07:07:28.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.754234615, 2023-10-08T07:07:28.128 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.128 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.128 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112710 2023-10-08T07:07:28.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.128 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.954623+0000", 2023-10-08T07:07:28.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.954623+0000", 2023-10-08T07:07:28.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.954624+0000", 2023-10-08T07:07:28.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8100000000000002e-07 2023-10-08T07:07:28.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.954642+0000", 2023-10-08T07:07:28.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7907999999999999e-05 2023-10-08T07:07:28.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.954655+0000", 2023-10-08T07:07:28.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3071000000000001e-05 2023-10-08T07:07:28.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.954662+0000", 2023-10-08T07:07:28.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.182e-06 2023-10-08T07:07:28.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.133 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.134 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112879 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.134 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.037639+0000", 2023-10-08T07:07:28.134 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.66631378299999999, 2023-10-08T07:07:28.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.67128210399999999, 2023-10-08T07:07:28.134 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.134 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.134 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.134 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.135 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112879 2023-10-08T07:07:28.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.135 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.037639+0000", 2023-10-08T07:07:28.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.037639+0000", 2023-10-08T07:07:28.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.037640+0000", 2023-10-08T07:07:28.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4099999999999998e-07 2023-10-08T07:07:28.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.037651+0000", 2023-10-08T07:07:28.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1488000000000001e-05 2023-10-08T07:07:28.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.037658+0000", 2023-10-08T07:07:28.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.567e-06 2023-10-08T07:07:28.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.037661+0000", 2023-10-08T07:07:28.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2799999999999999e-06 2023-10-08T07:07:28.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.138 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.138 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113040 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.138 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.089553+0000", 2023-10-08T07:07:28.138 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61440022100000002, 2023-10-08T07:07:28.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61942940800000001, 2023-10-08T07:07:28.138 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.138 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.139 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113040 2023-10-08T07:07:28.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.139 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.089553+0000", 2023-10-08T07:07:28.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.089553+0000", 2023-10-08T07:07:28.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.089554+0000", 2023-10-08T07:07:28.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7100000000000001e-07 2023-10-08T07:07:28.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.089570+0000", 2023-10-08T07:07:28.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6713000000000001e-05 2023-10-08T07:07:28.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.089579+0000", 2023-10-08T07:07:28.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9800000000000004e-06 2023-10-08T07:07:28.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.089586+0000", 2023-10-08T07:07:28.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8940000000000004e-06 2023-10-08T07:07:28.142 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.142 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.142 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.142 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113313 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.142 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.180101+0000", 2023-10-08T07:07:28.142 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.52385254800000003, 2023-10-08T07:07:28.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.52893800700000004, 2023-10-08T07:07:28.143 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.143 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.143 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113313 2023-10-08T07:07:28.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.143 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.180101+0000", 2023-10-08T07:07:28.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.180101+0000", 2023-10-08T07:07:28.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.180101+0000", 2023-10-08T07:07:28.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9999999999999997e-07 2023-10-08T07:07:28.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.180145+0000", 2023-10-08T07:07:28.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3924000000000002e-05 2023-10-08T07:07:28.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.180155+0000", 2023-10-08T07:07:28.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0305999999999999e-05 2023-10-08T07:07:28.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.180161+0000", 2023-10-08T07:07:28.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.942e-06 2023-10-08T07:07:28.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.146 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.147 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113405 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.147 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.210273+0000", 2023-10-08T07:07:28.147 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.49368057799999998, 2023-10-08T07:07:28.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.49881911000000001, 2023-10-08T07:07:28.147 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.147 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.148 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113405 2023-10-08T07:07:28.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.148 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.210273+0000", 2023-10-08T07:07:28.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.210273+0000", 2023-10-08T07:07:28.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.210273+0000", 2023-10-08T07:07:28.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7199999999999999e-07 2023-10-08T07:07:28.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.210294+0000", 2023-10-08T07:07:28.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1027999999999999e-05 2023-10-08T07:07:28.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.210305+0000", 2023-10-08T07:07:28.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0570999999999999e-05 2023-10-08T07:07:28.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.210311+0000", 2023-10-08T07:07:28.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2859999999999996e-06 2023-10-08T07:07:28.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.151 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.151 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113560 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.151 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.262403+0000", 2023-10-08T07:07:28.151 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.44155018800000001, 2023-10-08T07:07:28.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44676424799999997, 2023-10-08T07:07:28.152 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.152 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.152 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113560 2023-10-08T07:07:28.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.152 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.262403+0000", 2023-10-08T07:07:28.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.262403+0000", 2023-10-08T07:07:28.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.262404+0000", 2023-10-08T07:07:28.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0400000000000005e-07 2023-10-08T07:07:28.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.262416+0000", 2023-10-08T07:07:28.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2047e-05 2023-10-08T07:07:28.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.262426+0000", 2023-10-08T07:07:28.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0121e-05 2023-10-08T07:07:28.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.262434+0000", 2023-10-08T07:07:28.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6599999999999995e-06 2023-10-08T07:07:28.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.155 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.156 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114559 4.b 4.789930b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.156 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.612375+0000", 2023-10-08T07:07:28.156 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.091577864999999994, 2023-10-08T07:07:28.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.096844949, 2023-10-08T07:07:28.156 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.156 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.156 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.156 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.156 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.157 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114559 2023-10-08T07:07:28.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.157 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.612375+0000", 2023-10-08T07:07:28.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.612375+0000", 2023-10-08T07:07:28.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.612376+0000", 2023-10-08T07:07:28.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8299999999999995e-07 2023-10-08T07:07:28.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.612403+0000", 2023-10-08T07:07:28.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6922000000000001e-05 2023-10-08T07:07:28.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.612413+0000", 2023-10-08T07:07:28.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0057999999999999e-05 2023-10-08T07:07:28.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.612421+0000", 2023-10-08T07:07:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1200000000000002e-06 2023-10-08T07:07:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114639 4.b 4.789930b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.639092+0000", 2023-10-08T07:07:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.064861442000000005, 2023-10-08T07:07:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.070185066000000004, 2023-10-08T07:07:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114639 2023-10-08T07:07:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.639092+0000", 2023-10-08T07:07:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.639092+0000", 2023-10-08T07:07:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.639093+0000", 2023-10-08T07:07:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0219999999999999e-06 2023-10-08T07:07:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.639104+0000", 2023-10-08T07:07:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1321999999999999e-05 2023-10-08T07:07:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.639116+0000", 2023-10-08T07:07:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.187e-05 2023-10-08T07:07:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.639123+0000", 2023-10-08T07:07:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2949999999999996e-06 2023-10-08T07:07:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114777 4.38 e58/46 4:1e0977c7:::10000000004.00000022:head v 58'1816, mlcod=58'1814)", 2023-10-08T07:07:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.686473+0000", 2023-10-08T07:07:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.017480366000000001, 2023-10-08T07:07:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022865112, 2023-10-08T07:07:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.686473+0000", 2023-10-08T07:07:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.686473+0000", 2023-10-08T07:07:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.686473+0000", 2023-10-08T07:07:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0200000000000002e-07 2023-10-08T07:07:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.686525+0000", 2023-10-08T07:07:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2049999999999998e-05 2023-10-08T07:07:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.686533+0000", 2023-10-08T07:07:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7370000000000006e-06 2023-10-08T07:07:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.686537+0000", 2023-10-08T07:07:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2490000000000003e-06 2023-10-08T07:07:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704236+0000", 2023-10-08T07:07:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017699090000000001 2023-10-08T07:07:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704257+0000", 2023-10-08T07:07:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0661000000000001e-05 2023-10-08T07:07:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114812 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.699008+0000", 2023-10-08T07:07:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.004944871, 2023-10-08T07:07:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010391053000000001, 2023-10-08T07:07:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114812 2023-10-08T07:07:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699008+0000", 2023-10-08T07:07:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699008+0000", 2023-10-08T07:07:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699009+0000", 2023-10-08T07:07:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.06e-07 2023-10-08T07:07:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699023+0000", 2023-10-08T07:07:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4354e-05 2023-10-08T07:07:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699032+0000", 2023-10-08T07:07:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8529999999999998e-06 2023-10-08T07:07:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699039+0000", 2023-10-08T07:07:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0770000000000002e-06 2023-10-08T07:07:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112711 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:26.954958+0000", 2023-10-08T07:07:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74899495800000004, 2023-10-08T07:07:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.75449566199999996, 2023-10-08T07:07:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112711 2023-10-08T07:07:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.954958+0000", 2023-10-08T07:07:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.954958+0000", 2023-10-08T07:07:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.954959+0000", 2023-10-08T07:07:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2023-10-08T07:07:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.954967+0000", 2023-10-08T07:07:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6109999999999994e-06 2023-10-08T07:07:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.954975+0000", 2023-10-08T07:07:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0639999999999994e-06 2023-10-08T07:07:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.954981+0000", 2023-10-08T07:07:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.835e-06 2023-10-08T07:07:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113207 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.145604+0000", 2023-10-08T07:07:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55834887499999997, 2023-10-08T07:07:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56390531799999999, 2023-10-08T07:07:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113207 2023-10-08T07:07:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.145604+0000", 2023-10-08T07:07:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.145604+0000", 2023-10-08T07:07:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.145605+0000", 2023-10-08T07:07:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1399999999999997e-07 2023-10-08T07:07:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.145623+0000", 2023-10-08T07:07:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7980000000000001e-05 2023-10-08T07:07:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.145637+0000", 2023-10-08T07:07:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3963e-05 2023-10-08T07:07:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.145641+0000", 2023-10-08T07:07:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7979999999999999e-06 2023-10-08T07:07:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114263 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.511409+0000", 2023-10-08T07:07:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.19254379399999999, 2023-10-08T07:07:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19815338499999999, 2023-10-08T07:07:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114263 2023-10-08T07:07:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.511409+0000", 2023-10-08T07:07:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.511409+0000", 2023-10-08T07:07:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.511410+0000", 2023-10-08T07:07:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4799999999999997e-07 2023-10-08T07:07:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.511427+0000", 2023-10-08T07:07:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6487999999999999e-05 2023-10-08T07:07:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.511436+0000", 2023-10-08T07:07:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7079999999999992e-06 2023-10-08T07:07:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.511442+0000", 2023-10-08T07:07:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9000000000000003e-06 2023-10-08T07:07:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114401 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.555236+0000", 2023-10-08T07:07:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14871722100000001, 2023-10-08T07:07:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.15438302200000001, 2023-10-08T07:07:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114401 2023-10-08T07:07:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.555236+0000", 2023-10-08T07:07:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.555236+0000", 2023-10-08T07:07:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.555237+0000", 2023-10-08T07:07:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5600000000000005e-07 2023-10-08T07:07:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.555246+0000", 2023-10-08T07:07:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6299999999999993e-06 2023-10-08T07:07:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.555257+0000", 2023-10-08T07:07:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0597e-05 2023-10-08T07:07:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.555263+0000", 2023-10-08T07:07:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0170000000000002e-06 2023-10-08T07:07:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114640 4.3b 4.d87b41fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.639472+0000", 2023-10-08T07:07:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.064481047999999999, 2023-10-08T07:07:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.07020121, 2023-10-08T07:07:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114640 2023-10-08T07:07:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.639472+0000", 2023-10-08T07:07:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.639472+0000", 2023-10-08T07:07:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.639473+0000", 2023-10-08T07:07:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3900000000000004e-07 2023-10-08T07:07:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.639483+0000", 2023-10-08T07:07:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0012e-05 2023-10-08T07:07:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.639495+0000", 2023-10-08T07:07:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1838000000000001e-05 2023-10-08T07:07:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.639502+0000", 2023-10-08T07:07:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1760000000000004e-06 2023-10-08T07:07:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114702 4.3b 4.1fd270fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.660298+0000", 2023-10-08T07:07:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.043655518999999997, 2023-10-08T07:07:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049427779999999998, 2023-10-08T07:07:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114702 2023-10-08T07:07:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.660298+0000", 2023-10-08T07:07:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.660298+0000", 2023-10-08T07:07:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.660298+0000", 2023-10-08T07:07:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8700000000000005e-07 2023-10-08T07:07:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.660310+0000", 2023-10-08T07:07:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1857e-05 2023-10-08T07:07:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.660318+0000", 2023-10-08T07:07:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1079999999999993e-06 2023-10-08T07:07:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.660326+0000", 2023-10-08T07:07:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5000000000000002e-06 2023-10-08T07:07:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114726 4.20 e58/17 4:04004f2c:::10000000004.0000000d:head v 58'5394, mlcod=58'5383)", 2023-10-08T07:07:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.671708+0000", 2023-10-08T07:07:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.032245246999999998, 2023-10-08T07:07:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038092872999999999, 2023-10-08T07:07:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.671708+0000", 2023-10-08T07:07:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.671708+0000", 2023-10-08T07:07:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.671708+0000", 2023-10-08T07:07:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2499999999999995e-07 2023-10-08T07:07:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.671720+0000", 2023-10-08T07:07:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1148999999999999e-05 2023-10-08T07:07:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.671728+0000", 2023-10-08T07:07:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2819999999999996e-06 2023-10-08T07:07:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.671734+0000", 2023-10-08T07:07:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2090000000000002e-06 2023-10-08T07:07:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.681585+0000", 2023-10-08T07:07:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0098506540000000004 2023-10-08T07:07:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.681605+0000", 2023-10-08T07:07:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0324999999999999e-05 2023-10-08T07:07:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114780 4.7 4:e2d089ed:::10000000004.00000033:head [write 1851392~4096 in=4096b,write 1888256~4096 in=4096b,write 2170880~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.687387+0000", 2023-10-08T07:07:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016565950999999999, 2023-10-08T07:07:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022491007, 2023-10-08T07:07:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114780 2023-10-08T07:07:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.687387+0000", 2023-10-08T07:07:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.687387+0000", 2023-10-08T07:07:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.687388+0000", 2023-10-08T07:07:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2023-10-08T07:07:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.687416+0000", 2023-10-08T07:07:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8288000000000001e-05 2023-10-08T07:07:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.687423+0000", 2023-10-08T07:07:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.328e-06 2023-10-08T07:07:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.687427+0000", 2023-10-08T07:07:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9310000000000001e-06 2023-10-08T07:07:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702142+0000", 2023-10-08T07:07:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014714837999999999 2023-10-08T07:07:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702254+0000", 2023-10-08T07:07:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011232 2023-10-08T07:07:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114814 4.3f 4:fc9a2d79:::10000000004.0000002f:head [write 430080~4096 in=4096b,write 548864~4096 in=4096b,write 573440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.699842+0000", 2023-10-08T07:07:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.004111501, 2023-10-08T07:07:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010128198, 2023-10-08T07:07:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114814 2023-10-08T07:07:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699842+0000", 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699842+0000", 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699842+0000", 2023-10-08T07:07:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2023-10-08T07:07:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699861+0000", 2023-10-08T07:07:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.855e-05 2023-10-08T07:07:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699869+0000", 2023-10-08T07:07:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1100000000000003e-06 2023-10-08T07:07:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699874+0000", 2023-10-08T07:07:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.074e-06 2023-10-08T07:07:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.708552+0000", 2023-10-08T07:07:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086780020000000006 2023-10-08T07:07:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.708642+0000", 2023-10-08T07:07:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9976999999999996e-05 2023-10-08T07:07:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112954 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.062009+0000", 2023-10-08T07:07:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64194427799999998, 2023-10-08T07:07:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.64804174800000003, 2023-10-08T07:07:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112954 2023-10-08T07:07:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.062009+0000", 2023-10-08T07:07:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.062009+0000", 2023-10-08T07:07:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.062010+0000", 2023-10-08T07:07:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6799999999999999e-07 2023-10-08T07:07:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.062022+0000", 2023-10-08T07:07:28.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2384999999999999e-05 2023-10-08T07:07:28.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.062032+0000", 2023-10-08T07:07:28.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0156999999999999e-05 2023-10-08T07:07:28.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.062040+0000", 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6070000000000002e-06 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114048 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.437883+0000", 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26606975799999999, 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27222944700000001, 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.219 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.219 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.219 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114048 2023-10-08T07:07:28.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.219 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.437883+0000", 2023-10-08T07:07:28.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.437883+0000", 2023-10-08T07:07:28.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.437884+0000", 2023-10-08T07:07:28.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.09e-07 2023-10-08T07:07:28.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.437897+0000", 2023-10-08T07:07:28.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2870999999999999e-05 2023-10-08T07:07:28.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.437908+0000", 2023-10-08T07:07:28.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0508e-05 2023-10-08T07:07:28.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.437915+0000", 2023-10-08T07:07:28.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0169999999999999e-06 2023-10-08T07:07:28.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.222 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.222 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.222 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114443 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.222 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.569726+0000", 2023-10-08T07:07:28.222 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.13422756, 2023-10-08T07:07:28.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.14044432100000001, 2023-10-08T07:07:28.222 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.222 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.223 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.223 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.223 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.223 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114443 2023-10-08T07:07:28.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.223 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.569726+0000", 2023-10-08T07:07:28.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.569726+0000", 2023-10-08T07:07:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.569726+0000", 2023-10-08T07:07:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-07 2023-10-08T07:07:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.569756+0000", 2023-10-08T07:07:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9473000000000001e-05 2023-10-08T07:07:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.569764+0000", 2023-10-08T07:07:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3280000000000006e-06 2023-10-08T07:07:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.569771+0000", 2023-10-08T07:07:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5509999999999996e-06 2023-10-08T07:07:28.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114563 4.3b 4.d87b41fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.613711+0000", 2023-10-08T07:07:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.090242001000000002, 2023-10-08T07:07:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.096512461999999993, 2023-10-08T07:07:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.226 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114563 2023-10-08T07:07:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.613711+0000", 2023-10-08T07:07:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.613711+0000", 2023-10-08T07:07:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.613712+0000", 2023-10-08T07:07:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3699999999999999e-07 2023-10-08T07:07:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.613726+0000", 2023-10-08T07:07:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4280999999999999e-05 2023-10-08T07:07:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.613739+0000", 2023-10-08T07:07:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2797e-05 2023-10-08T07:07:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.613747+0000", 2023-10-08T07:07:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.503e-06 2023-10-08T07:07:28.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114778 4.2b e58/17 4:d7a77d67:::10000000004.00000029:head v 58'3623, mlcod=58'3616)", 2023-10-08T07:07:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.687637+0000", 2023-10-08T07:07:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016316270000000001, 2023-10-08T07:07:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.02264039, 2023-10-08T07:07:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.230 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.687637+0000", 2023-10-08T07:07:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.687637+0000", 2023-10-08T07:07:28.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.687637+0000", 2023-10-08T07:07:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7300000000000002e-07 2023-10-08T07:07:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.687702+0000", 2023-10-08T07:07:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4820999999999995e-05 2023-10-08T07:07:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.687708+0000", 2023-10-08T07:07:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6180000000000003e-06 2023-10-08T07:07:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.687711+0000", 2023-10-08T07:07:28.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.016e-06 2023-10-08T07:07:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.693430+0000", 2023-10-08T07:07:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057195969999999999 2023-10-08T07:07:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.693450+0000", 2023-10-08T07:07:28.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9771000000000001e-05 2023-10-08T07:07:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114813 4.2b e58/17 4:d7a77d67:::10000000004.00000029:head v 58'3627, mlcod=58'3619)", 2023-10-08T07:07:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.699975+0000", 2023-10-08T07:07:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0039786329999999996, 2023-10-08T07:07:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010368860000000001, 2023-10-08T07:07:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.235 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.236 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699975+0000", 2023-10-08T07:07:28.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699975+0000", 2023-10-08T07:07:28.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699975+0000", 2023-10-08T07:07:28.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5199999999999996e-07 2023-10-08T07:07:28.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699988+0000", 2023-10-08T07:07:28.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3071000000000001e-05 2023-10-08T07:07:28.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.699997+0000", 2023-10-08T07:07:28.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2050000000000008e-06 2023-10-08T07:07:28.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700004+0000", 2023-10-08T07:07:28.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4790000000000001e-06 2023-10-08T07:07:28.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.707634+0000", 2023-10-08T07:07:28.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076296330000000002 2023-10-08T07:07:28.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.707651+0000", 2023-10-08T07:07:28.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7742999999999999e-05 2023-10-08T07:07:28.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.240 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.240 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113317 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.240 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.181558+0000", 2023-10-08T07:07:28.240 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.52239502800000004, 2023-10-08T07:07:28.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.52884523800000005, 2023-10-08T07:07:28.240 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.240 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.241 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113317 2023-10-08T07:07:28.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.241 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.181558+0000", 2023-10-08T07:07:28.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.181558+0000", 2023-10-08T07:07:28.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.181559+0000", 2023-10-08T07:07:28.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4799999999999997e-07 2023-10-08T07:07:28.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.181573+0000", 2023-10-08T07:07:28.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3689000000000001e-05 2023-10-08T07:07:28.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.181582+0000", 2023-10-08T07:07:28.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0459999999999994e-06 2023-10-08T07:07:28.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.181589+0000", 2023-10-08T07:07:28.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1570000000000003e-06 2023-10-08T07:07:28.244 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.244 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.244 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.244 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113670 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.244 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.309573+0000", 2023-10-08T07:07:28.244 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39438055, 2023-10-08T07:07:28.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40088179800000001, 2023-10-08T07:07:28.245 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.245 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.245 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113670 2023-10-08T07:07:28.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.245 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.309573+0000", 2023-10-08T07:07:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.309573+0000", 2023-10-08T07:07:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.309574+0000", 2023-10-08T07:07:28.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.066e-06 2023-10-08T07:07:28.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.309588+0000", 2023-10-08T07:07:28.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4039999999999999e-05 2023-10-08T07:07:28.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.309598+0000", 2023-10-08T07:07:28.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0397999999999999e-05 2023-10-08T07:07:28.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.309606+0000", 2023-10-08T07:07:28.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9400000000000002e-06 2023-10-08T07:07:28.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.248 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.249 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113879 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.249 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.381368+0000", 2023-10-08T07:07:28.249 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.32258522899999997, 2023-10-08T07:07:28.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32913778399999999, 2023-10-08T07:07:28.249 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.249 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.250 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113879 2023-10-08T07:07:28.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.250 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.381368+0000", 2023-10-08T07:07:28.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.381368+0000", 2023-10-08T07:07:28.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.381369+0000", 2023-10-08T07:07:28.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8400000000000003e-07 2023-10-08T07:07:28.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.381380+0000", 2023-10-08T07:07:28.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:07:28.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.381389+0000", 2023-10-08T07:07:28.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2059999999999996e-06 2023-10-08T07:07:28.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.381396+0000", 2023-10-08T07:07:28.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.686e-06 2023-10-08T07:07:28.252 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.253 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.253 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114019 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.253 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.427492+0000", 2023-10-08T07:07:28.253 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.27646122299999998, 2023-10-08T07:07:28.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.28306692900000002, 2023-10-08T07:07:28.254 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.254 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.254 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114019 2023-10-08T07:07:28.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.254 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.427492+0000", 2023-10-08T07:07:28.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.427492+0000", 2023-10-08T07:07:28.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.427493+0000", 2023-10-08T07:07:28.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5300000000000003e-07 2023-10-08T07:07:28.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.427512+0000", 2023-10-08T07:07:28.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9541000000000001e-05 2023-10-08T07:07:28.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.427525+0000", 2023-10-08T07:07:28.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2475e-05 2023-10-08T07:07:28.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.427533+0000", 2023-10-08T07:07:28.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1009999999999992e-06 2023-10-08T07:07:28.257 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.257 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.257 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.258 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114668 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.258 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.648717+0000", 2023-10-08T07:07:28.258 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.055236615000000003, 2023-10-08T07:07:28.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.061894039999999997, 2023-10-08T07:07:28.258 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.258 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.258 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114668 2023-10-08T07:07:28.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.259 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.648717+0000", 2023-10-08T07:07:28.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.648717+0000", 2023-10-08T07:07:28.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.648717+0000", 2023-10-08T07:07:28.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1900000000000001e-07 2023-10-08T07:07:28.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.648728+0000", 2023-10-08T07:07:28.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0737000000000001e-05 2023-10-08T07:07:28.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.648738+0000", 2023-10-08T07:07:28.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0008e-05 2023-10-08T07:07:28.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.648745+0000", 2023-10-08T07:07:28.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.002e-06 2023-10-08T07:07:28.262 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.262 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.262 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.262 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114816 4.19 4:9b26afe3:::10000000004.00000005:head [write 3600384~4096 in=4096b,write 3645440~4096 in=4096b,write 3837952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.262 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.700409+0000", 2023-10-08T07:07:28.262 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0035440979999999999, 2023-10-08T07:07:28.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010262855, 2023-10-08T07:07:28.263 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.263 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.263 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114816 2023-10-08T07:07:28.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.263 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700409+0000", 2023-10-08T07:07:28.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700409+0000", 2023-10-08T07:07:28.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700410+0000", 2023-10-08T07:07:28.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:07:28.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700417+0000", 2023-10-08T07:07:28.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6939999999999995e-06 2023-10-08T07:07:28.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700425+0000", 2023-10-08T07:07:28.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7330000000000003e-06 2023-10-08T07:07:28.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700429+0000", 2023-10-08T07:07:28.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1659999999999996e-06 2023-10-08T07:07:28.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705122+0000", 2023-10-08T07:07:28.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046923950000000002 2023-10-08T07:07:28.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705196+0000", 2023-10-08T07:07:28.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4011999999999995e-05 2023-10-08T07:07:28.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.267 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.268 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112886 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.268 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.039574+0000", 2023-10-08T07:07:28.268 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.66437960600000001, 2023-10-08T07:07:28.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.67118124800000001, 2023-10-08T07:07:28.268 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.268 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.269 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112886 2023-10-08T07:07:28.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.269 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.039574+0000", 2023-10-08T07:07:28.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.039574+0000", 2023-10-08T07:07:28.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.039575+0000", 2023-10-08T07:07:28.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9199999999999999e-07 2023-10-08T07:07:28.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.039587+0000", 2023-10-08T07:07:28.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2788e-05 2023-10-08T07:07:28.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.039599+0000", 2023-10-08T07:07:28.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1277999999999999e-05 2023-10-08T07:07:28.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.039606+0000", 2023-10-08T07:07:28.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3359999999999997e-06 2023-10-08T07:07:28.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.272 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.272 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113208 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.272 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.145966+0000", 2023-10-08T07:07:28.273 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55798729300000005, 2023-10-08T07:07:28.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56484342600000004, 2023-10-08T07:07:28.273 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.273 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.273 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113208 2023-10-08T07:07:28.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.273 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.145966+0000", 2023-10-08T07:07:28.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.145966+0000", 2023-10-08T07:07:28.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.145966+0000", 2023-10-08T07:07:28.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3099999999999997e-07 2023-10-08T07:07:28.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.145988+0000", 2023-10-08T07:07:28.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1084999999999999e-05 2023-10-08T07:07:28.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.145994+0000", 2023-10-08T07:07:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6540000000000002e-06 2023-10-08T07:07:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.145998+0000", 2023-10-08T07:07:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3280000000000002e-06 2023-10-08T07:07:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113275 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.169024+0000", 2023-10-08T07:07:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.53492920300000002, 2023-10-08T07:07:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.541836863, 2023-10-08T07:07:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113275 2023-10-08T07:07:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.278 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.169024+0000", 2023-10-08T07:07:28.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.169024+0000", 2023-10-08T07:07:28.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.169024+0000", 2023-10-08T07:07:28.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4899999999999995e-07 2023-10-08T07:07:28.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.169037+0000", 2023-10-08T07:07:28.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2379e-05 2023-10-08T07:07:28.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.169052+0000", 2023-10-08T07:07:28.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5135e-05 2023-10-08T07:07:28.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.169059+0000", 2023-10-08T07:07:28.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.956e-06 2023-10-08T07:07:28.280 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114303 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.524080+0000", 2023-10-08T07:07:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.179873584, 2023-10-08T07:07:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.186837951, 2023-10-08T07:07:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.282 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114303 2023-10-08T07:07:28.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.282 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.524080+0000", 2023-10-08T07:07:28.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.524080+0000", 2023-10-08T07:07:28.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.524080+0000", 2023-10-08T07:07:28.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4200000000000005e-07 2023-10-08T07:07:28.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.524096+0000", 2023-10-08T07:07:28.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5639000000000001e-05 2023-10-08T07:07:28.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.524106+0000", 2023-10-08T07:07:28.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0380999999999999e-05 2023-10-08T07:07:28.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.524114+0000", 2023-10-08T07:07:28.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5179999999999998e-06 2023-10-08T07:07:28.285 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.285 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.285 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.285 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114669 4.b 4.789930b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.285 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.649026+0000", 2023-10-08T07:07:28.285 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.054927628999999999, 2023-10-08T07:07:28.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.061948606000000003, 2023-10-08T07:07:28.285 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.285 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114669 2023-10-08T07:07:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.649026+0000", 2023-10-08T07:07:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.649026+0000", 2023-10-08T07:07:28.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.649026+0000", 2023-10-08T07:07:28.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8299999999999995e-07 2023-10-08T07:07:28.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.649039+0000", 2023-10-08T07:07:28.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2991e-05 2023-10-08T07:07:28.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.649051+0000", 2023-10-08T07:07:28.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1452e-05 2023-10-08T07:07:28.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.649059+0000", 2023-10-08T07:07:28.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4819999999999994e-06 2023-10-08T07:07:28.289 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.289 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.289 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.289 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114739 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.289 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.672650+0000", 2023-10-08T07:07:28.289 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.031302981000000001, 2023-10-08T07:07:28.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038381237999999998, 2023-10-08T07:07:28.290 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.290 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.290 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114739 2023-10-08T07:07:28.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.290 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.672650+0000", 2023-10-08T07:07:28.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.672650+0000", 2023-10-08T07:07:28.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.672651+0000", 2023-10-08T07:07:28.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2279999999999999e-06 2023-10-08T07:07:28.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.672662+0000", 2023-10-08T07:07:28.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0458999999999999e-05 2023-10-08T07:07:28.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.672671+0000", 2023-10-08T07:07:28.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.098e-06 2023-10-08T07:07:28.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.672677+0000", 2023-10-08T07:07:28.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4389999999999997e-06 2023-10-08T07:07:28.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.293 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.293 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114784 4.15 4:aaa619cf:::10000000004.00000004:head [write 2949120~4096 in=4096b,write 2961408~4096 in=4096b,write 3133440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.293 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.688716+0000", 2023-10-08T07:07:28.294 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.015236734, 2023-10-08T07:07:28.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022304312, 2023-10-08T07:07:28.294 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.294 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:28.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.294 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114784 2023-10-08T07:07:28.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.294 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.688716+0000", 2023-10-08T07:07:28.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.688716+0000", 2023-10-08T07:07:28.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.688717+0000", 2023-10-08T07:07:28.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4099999999999997e-07 2023-10-08T07:07:28.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.688730+0000", 2023-10-08T07:07:28.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2493e-05 2023-10-08T07:07:28.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.688739+0000", 2023-10-08T07:07:28.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2799999999999992e-06 2023-10-08T07:07:28.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.688746+0000", 2023-10-08T07:07:28.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7710000000000001e-06 2023-10-08T07:07:28.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697357+0000", 2023-10-08T07:07:28.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086113370000000002 2023-10-08T07:07:28.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697436+0000", 2023-10-08T07:07:28.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8967999999999993e-05 2023-10-08T07:07:28.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:28.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.710890+0000", 2023-10-08T07:07:28.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013454397 2023-10-08T07:07:28.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:28.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.710945+0000", 2023-10-08T07:07:28.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4793000000000002e-05 2023-10-08T07:07:28.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:28.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.711021+0000", 2023-10-08T07:07:28.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5432000000000006e-05 2023-10-08T07:07:28.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.299 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.299 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114815 4.1b e58/17)", 2023-10-08T07:07:28.300 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.700529+0000", 2023-10-08T07:07:28.300 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003424608, 2023-10-08T07:07:28.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010656334, 2023-10-08T07:07:28.300 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.300 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.300 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700529+0000", 2023-10-08T07:07:28.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700529+0000", 2023-10-08T07:07:28.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700529+0000", 2023-10-08T07:07:28.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5600000000000001e-07 2023-10-08T07:07:28.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700558+0000", 2023-10-08T07:07:28.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8787000000000001e-05 2023-10-08T07:07:28.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700565+0000", 2023-10-08T07:07:28.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0859999999999996e-06 2023-10-08T07:07:28.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700568+0000", 2023-10-08T07:07:28.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5810000000000001e-06 2023-10-08T07:07:28.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.303 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.303 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.303 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112958 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.303 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.063423+0000", 2023-10-08T07:07:28.303 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64053047100000005, 2023-10-08T07:07:28.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.64782179500000003, 2023-10-08T07:07:28.303 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.303 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.304 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.304 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.304 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112958 2023-10-08T07:07:28.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.304 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.063423+0000", 2023-10-08T07:07:28.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.063423+0000", 2023-10-08T07:07:28.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.063424+0000", 2023-10-08T07:07:28.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:07:28.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.063439+0000", 2023-10-08T07:07:28.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5124e-05 2023-10-08T07:07:28.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.063449+0000", 2023-10-08T07:07:28.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0468e-05 2023-10-08T07:07:28.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.063457+0000", 2023-10-08T07:07:28.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4449999999999999e-06 2023-10-08T07:07:28.307 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.307 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.307 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.307 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114126 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.307 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.465554+0000", 2023-10-08T07:07:28.307 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.23839949099999999, 2023-10-08T07:07:28.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.24575318800000001, 2023-10-08T07:07:28.307 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.307 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.308 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114126 2023-10-08T07:07:28.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.308 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.465554+0000", 2023-10-08T07:07:28.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.465554+0000", 2023-10-08T07:07:28.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.465554+0000", 2023-10-08T07:07:28.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8800000000000002e-07 2023-10-08T07:07:28.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.465565+0000", 2023-10-08T07:07:28.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0878e-05 2023-10-08T07:07:28.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.465575+0000", 2023-10-08T07:07:28.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0114e-05 2023-10-08T07:07:28.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.465584+0000", 2023-10-08T07:07:28.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1850000000000004e-06 2023-10-08T07:07:28.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.311 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.311 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114529 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.311 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.600564+0000", 2023-10-08T07:07:28.311 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.103389144, 2023-10-08T07:07:28.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.11080007, 2023-10-08T07:07:28.311 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.311 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.312 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114529 2023-10-08T07:07:28.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.312 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.600564+0000", 2023-10-08T07:07:28.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.600564+0000", 2023-10-08T07:07:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.600565+0000", 2023-10-08T07:07:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5499999999999997e-07 2023-10-08T07:07:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.600579+0000", 2023-10-08T07:07:28.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4318000000000001e-05 2023-10-08T07:07:28.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.600588+0000", 2023-10-08T07:07:28.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9360000000000005e-06 2023-10-08T07:07:28.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.600595+0000", 2023-10-08T07:07:28.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3050000000000004e-06 2023-10-08T07:07:28.315 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.315 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.315 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.315 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114606 4.b 4.789930b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.315 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.628760+0000", 2023-10-08T07:07:28.315 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.075193364999999998, 2023-10-08T07:07:28.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.082661124000000002, 2023-10-08T07:07:28.315 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.315 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.316 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114606 2023-10-08T07:07:28.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.316 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.628760+0000", 2023-10-08T07:07:28.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.628760+0000", 2023-10-08T07:07:28.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.628761+0000", 2023-10-08T07:07:28.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6899999999999996e-07 2023-10-08T07:07:28.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.628773+0000", 2023-10-08T07:07:28.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2162e-05 2023-10-08T07:07:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.628782+0000", 2023-10-08T07:07:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1430000000000004e-06 2023-10-08T07:07:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.628789+0000", 2023-10-08T07:07:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1749999999999999e-06 2023-10-08T07:07:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.318 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.319 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.319 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114740 4.3b 4.d87b41fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.319 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.672778+0000", 2023-10-08T07:07:28.319 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.03117524, 2023-10-08T07:07:28.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038696310999999997, 2023-10-08T07:07:28.319 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.319 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114740 2023-10-08T07:07:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.672778+0000", 2023-10-08T07:07:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.672778+0000", 2023-10-08T07:07:28.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.672779+0000", 2023-10-08T07:07:28.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1200000000000003e-07 2023-10-08T07:07:28.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.672793+0000", 2023-10-08T07:07:28.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4100000000000001e-05 2023-10-08T07:07:28.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.672801+0000", 2023-10-08T07:07:28.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8109999999999992e-06 2023-10-08T07:07:28.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.672807+0000", 2023-10-08T07:07:28.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4940000000000003e-06 2023-10-08T07:07:28.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114817 4.f 4.e29eca4f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.700701+0000", 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003252624, 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010977781000000001, 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.324 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114817 2023-10-08T07:07:28.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.324 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700701+0000", 2023-10-08T07:07:28.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700701+0000", 2023-10-08T07:07:28.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700701+0000", 2023-10-08T07:07:28.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0399999999999995e-07 2023-10-08T07:07:28.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700710+0000", 2023-10-08T07:07:28.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3250000000000008e-06 2023-10-08T07:07:28.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700716+0000", 2023-10-08T07:07:28.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6340000000000003e-06 2023-10-08T07:07:28.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.700720+0000", 2023-10-08T07:07:28.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.529e-06 2023-10-08T07:07:28.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.326 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.327 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113278 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.327 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.169106+0000", 2023-10-08T07:07:28.327 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.53484668999999996, 2023-10-08T07:07:28.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.54262722500000005, 2023-10-08T07:07:28.327 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.327 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.327 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113278 2023-10-08T07:07:28.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.328 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.169106+0000", 2023-10-08T07:07:28.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.169106+0000", 2023-10-08T07:07:28.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.169107+0000", 2023-10-08T07:07:28.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0399999999999996e-07 2023-10-08T07:07:28.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.169117+0000", 2023-10-08T07:07:28.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8949999999999993e-06 2023-10-08T07:07:28.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.169124+0000", 2023-10-08T07:07:28.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7449999999999998e-06 2023-10-08T07:07:28.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.169129+0000", 2023-10-08T07:07:28.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0669999999999999e-06 2023-10-08T07:07:28.330 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.330 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.330 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.330 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113376 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.331 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.200633+0000", 2023-10-08T07:07:28.331 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.50331993100000005, 2023-10-08T07:07:28.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.51116838099999995, 2023-10-08T07:07:28.331 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.331 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.331 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113376 2023-10-08T07:07:28.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.331 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.200633+0000", 2023-10-08T07:07:28.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.200633+0000", 2023-10-08T07:07:28.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.200634+0000", 2023-10-08T07:07:28.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7800000000000001e-07 2023-10-08T07:07:28.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.200645+0000", 2023-10-08T07:07:28.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1124999999999999e-05 2023-10-08T07:07:28.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.200654+0000", 2023-10-08T07:07:28.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1840000000000005e-06 2023-10-08T07:07:28.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.200661+0000", 2023-10-08T07:07:28.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.905e-06 2023-10-08T07:07:28.334 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.334 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.334 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.335 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113527 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.335 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.250923+0000", 2023-10-08T07:07:28.335 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.45302990300000001, 2023-10-08T07:07:28.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46091656600000003, 2023-10-08T07:07:28.335 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.335 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.335 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113527 2023-10-08T07:07:28.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.335 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.250923+0000", 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.250923+0000", 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.250924+0000", 2023-10-08T07:07:28.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9299999999999996e-07 2023-10-08T07:07:28.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.250936+0000", 2023-10-08T07:07:28.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.184e-05 2023-10-08T07:07:28.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.250947+0000", 2023-10-08T07:07:28.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0682999999999999e-05 2023-10-08T07:07:28.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.250954+0000", 2023-10-08T07:07:28.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9639999999999997e-06 2023-10-08T07:07:28.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.338 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.339 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113567 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.339 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.264487+0000", 2023-10-08T07:07:28.339 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43946585399999999, 2023-10-08T07:07:28.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44738363199999998, 2023-10-08T07:07:28.339 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.339 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.339 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113567 2023-10-08T07:07:28.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.264487+0000", 2023-10-08T07:07:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.264487+0000", 2023-10-08T07:07:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.264488+0000", 2023-10-08T07:07:28.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.37e-07 2023-10-08T07:07:28.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.264499+0000", 2023-10-08T07:07:28.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1209000000000001e-05 2023-10-08T07:07:28.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.264508+0000", 2023-10-08T07:07:28.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.619e-06 2023-10-08T07:07:28.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.264513+0000", 2023-10-08T07:07:28.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6200000000000004e-06 2023-10-08T07:07:28.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.342 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.342 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113906 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.343 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.390811+0000", 2023-10-08T07:07:28.343 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.31314163900000003, 2023-10-08T07:07:28.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32111519100000002, 2023-10-08T07:07:28.343 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.343 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.343 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113906 2023-10-08T07:07:28.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.343 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.390811+0000", 2023-10-08T07:07:28.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.390811+0000", 2023-10-08T07:07:28.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.390812+0000", 2023-10-08T07:07:28.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2699999999999999e-07 2023-10-08T07:07:28.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.390824+0000", 2023-10-08T07:07:28.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1755e-05 2023-10-08T07:07:28.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.390835+0000", 2023-10-08T07:07:28.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0526999999999999e-05 2023-10-08T07:07:28.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.390841+0000", 2023-10-08T07:07:28.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6320000000000002e-06 2023-10-08T07:07:28.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.346 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.346 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114127 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.346 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.466018+0000", 2023-10-08T07:07:28.346 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.23793472500000001, 2023-10-08T07:07:28.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.245973945, 2023-10-08T07:07:28.347 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.347 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.347 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114127 2023-10-08T07:07:28.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.347 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.466018+0000", 2023-10-08T07:07:28.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.466018+0000", 2023-10-08T07:07:28.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.466023+0000", 2023-10-08T07:07:28.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.194e-06 2023-10-08T07:07:28.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.466031+0000", 2023-10-08T07:07:28.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6580000000000008e-06 2023-10-08T07:07:28.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.466039+0000", 2023-10-08T07:07:28.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.038e-06 2023-10-08T07:07:28.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.466046+0000", 2023-10-08T07:07:28.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0299999999999996e-06 2023-10-08T07:07:28.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.350 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.351 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114608 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.351 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.629327+0000", 2023-10-08T07:07:28.351 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.074625639999999993, 2023-10-08T07:07:28.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.082744634999999997, 2023-10-08T07:07:28.351 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.351 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.352 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.352 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114608 2023-10-08T07:07:28.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.352 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.629327+0000", 2023-10-08T07:07:28.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.629327+0000", 2023-10-08T07:07:28.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.629328+0000", 2023-10-08T07:07:28.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2023-10-08T07:07:28.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.629343+0000", 2023-10-08T07:07:28.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4843e-05 2023-10-08T07:07:28.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.629353+0000", 2023-10-08T07:07:28.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5850000000000006e-06 2023-10-08T07:07:28.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.629368+0000", 2023-10-08T07:07:28.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4848000000000001e-05 2023-10-08T07:07:28.354 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.355 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.355 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114645 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.355 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.640864+0000", 2023-10-08T07:07:28.355 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.063088864999999994, 2023-10-08T07:07:28.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.071274536999999999, 2023-10-08T07:07:28.355 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.355 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.356 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114645 2023-10-08T07:07:28.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.356 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.640864+0000", 2023-10-08T07:07:28.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.640864+0000", 2023-10-08T07:07:28.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.640865+0000", 2023-10-08T07:07:28.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999997e-07 2023-10-08T07:07:28.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.640873+0000", 2023-10-08T07:07:28.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1070000000000005e-06 2023-10-08T07:07:28.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.640882+0000", 2023-10-08T07:07:28.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9730000000000003e-06 2023-10-08T07:07:28.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.640887+0000", 2023-10-08T07:07:28.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7469999999999996e-06 2023-10-08T07:07:28.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.359 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.359 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114747 4.b 4.789930b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.359 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.674843+0000", 2023-10-08T07:07:28.359 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.029110370999999999, 2023-10-08T07:07:28.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037359343000000003, 2023-10-08T07:07:28.359 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.359 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.360 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114747 2023-10-08T07:07:28.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.360 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.674843+0000", 2023-10-08T07:07:28.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.674843+0000", 2023-10-08T07:07:28.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.674844+0000", 2023-10-08T07:07:28.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.187e-06 2023-10-08T07:07:28.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.674858+0000", 2023-10-08T07:07:28.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3706000000000001e-05 2023-10-08T07:07:28.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.674867+0000", 2023-10-08T07:07:28.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6080000000000002e-06 2023-10-08T07:07:28.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.674875+0000", 2023-10-08T07:07:28.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8050000000000007e-06 2023-10-08T07:07:28.363 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.363 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.363 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.363 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114788 4.19 4:9b26afe3:::10000000004.00000005:head [write 1908736~8192 in=8192b,write 1961984~4096 in=4096b,write 2072576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.363 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.690113+0000", 2023-10-08T07:07:28.363 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013839977999999999, 2023-10-08T07:07:28.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022154495999999999, 2023-10-08T07:07:28.363 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.363 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.364 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114788 2023-10-08T07:07:28.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.364 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.690113+0000", 2023-10-08T07:07:28.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.690113+0000", 2023-10-08T07:07:28.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.690114+0000", 2023-10-08T07:07:28.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0640000000000001e-06 2023-10-08T07:07:28.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.690128+0000", 2023-10-08T07:07:28.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3740000000000001e-05 2023-10-08T07:07:28.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.690138+0000", 2023-10-08T07:07:28.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0441e-05 2023-10-08T07:07:28.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.690146+0000", 2023-10-08T07:07:28.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.34e-06 2023-10-08T07:07:28.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.690763+0000", 2023-10-08T07:07:28.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00061716199999999998 2023-10-08T07:07:28.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.690836+0000", 2023-10-08T07:07:28.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2632000000000005e-05 2023-10-08T07:07:28.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.367 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.368 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112822 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.368 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.018954+0000", 2023-10-08T07:07:28.368 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.68499871700000003, 2023-10-08T07:07:28.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.69339725600000002, 2023-10-08T07:07:28.368 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.368 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.368 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.369 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112822 2023-10-08T07:07:28.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.369 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.018954+0000", 2023-10-08T07:07:28.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.018954+0000", 2023-10-08T07:07:28.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.018955+0000", 2023-10-08T07:07:28.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:07:28.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.018983+0000", 2023-10-08T07:07:28.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8109000000000001e-05 2023-10-08T07:07:28.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.018990+0000", 2023-10-08T07:07:28.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2830000000000004e-06 2023-10-08T07:07:28.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.018994+0000", 2023-10-08T07:07:28.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8970000000000001e-06 2023-10-08T07:07:28.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.372 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.372 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113178 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.372 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.136374+0000", 2023-10-08T07:07:28.372 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.56757888499999998, 2023-10-08T07:07:28.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.576036306, 2023-10-08T07:07:28.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113178 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.136374+0000", 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.136374+0000", 2023-10-08T07:07:28.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.136375+0000", 2023-10-08T07:07:28.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2900000000000003e-07 2023-10-08T07:07:28.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.136392+0000", 2023-10-08T07:07:28.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6750000000000001e-05 2023-10-08T07:07:28.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.136400+0000", 2023-10-08T07:07:28.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.072e-06 2023-10-08T07:07:28.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.136405+0000", 2023-10-08T07:07:28.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1309999999999997e-06 2023-10-08T07:07:28.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.376 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.376 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113705 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.376 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.320820+0000", 2023-10-08T07:07:28.376 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38313348800000002, 2023-10-08T07:07:28.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39165132800000002, 2023-10-08T07:07:28.377 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.377 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.377 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113705 2023-10-08T07:07:28.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.377 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.320820+0000", 2023-10-08T07:07:28.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.320820+0000", 2023-10-08T07:07:28.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.320820+0000", 2023-10-08T07:07:28.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5499999999999998e-07 2023-10-08T07:07:28.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.320831+0000", 2023-10-08T07:07:28.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0454e-05 2023-10-08T07:07:28.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.320837+0000", 2023-10-08T07:07:28.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3489999999999997e-06 2023-10-08T07:07:28.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.320842+0000", 2023-10-08T07:07:28.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2440000000000001e-06 2023-10-08T07:07:28.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.380 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.381 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113908 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.381 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.391390+0000", 2023-10-08T07:07:28.381 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.31256350300000002, 2023-10-08T07:07:28.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32114810100000002, 2023-10-08T07:07:28.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.381 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.382 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113908 2023-10-08T07:07:28.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.382 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.391390+0000", 2023-10-08T07:07:28.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.391390+0000", 2023-10-08T07:07:28.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.391390+0000", 2023-10-08T07:07:28.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6400000000000002e-07 2023-10-08T07:07:28.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.391398+0000", 2023-10-08T07:07:28.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9359999999999999e-06 2023-10-08T07:07:28.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.391420+0000", 2023-10-08T07:07:28.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1736999999999999e-05 2023-10-08T07:07:28.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.391429+0000", 2023-10-08T07:07:28.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0180000000000007e-06 2023-10-08T07:07:28.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.385 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.385 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113949 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.385 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.406234+0000", 2023-10-08T07:07:28.385 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29771953699999998, 2023-10-08T07:07:28.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.30636743399999999, 2023-10-08T07:07:28.385 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.386 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.386 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113949 2023-10-08T07:07:28.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.386 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.406234+0000", 2023-10-08T07:07:28.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.406234+0000", 2023-10-08T07:07:28.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.406234+0000", 2023-10-08T07:07:28.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6099999999999999e-07 2023-10-08T07:07:28.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.406247+0000", 2023-10-08T07:07:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2797e-05 2023-10-08T07:07:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.406257+0000", 2023-10-08T07:07:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4960000000000002e-06 2023-10-08T07:07:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.406264+0000", 2023-10-08T07:07:28.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5789999999999998e-06 2023-10-08T07:07:28.389 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.389 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.389 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.389 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113979 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.389 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.417525+0000", 2023-10-08T07:07:28.389 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28642789200000002, 2023-10-08T07:07:28.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29513351799999998, 2023-10-08T07:07:28.389 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.390 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.390 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.390 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.390 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.390 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113979 2023-10-08T07:07:28.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.390 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.417525+0000", 2023-10-08T07:07:28.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.417525+0000", 2023-10-08T07:07:28.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.417526+0000", 2023-10-08T07:07:28.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2023-10-08T07:07:28.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.417535+0000", 2023-10-08T07:07:28.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9530000000000005e-06 2023-10-08T07:07:28.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.417540+0000", 2023-10-08T07:07:28.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8409999999999996e-06 2023-10-08T07:07:28.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.417543+0000", 2023-10-08T07:07:28.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0010000000000002e-06 2023-10-08T07:07:28.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.393 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.393 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114307 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.393 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.525342+0000", 2023-10-08T07:07:28.393 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.17861159600000001, 2023-10-08T07:07:28.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.187371336, 2023-10-08T07:07:28.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.394 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.394 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114307 2023-10-08T07:07:28.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.394 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.525342+0000", 2023-10-08T07:07:28.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.525342+0000", 2023-10-08T07:07:28.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.525342+0000", 2023-10-08T07:07:28.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0400000000000005e-07 2023-10-08T07:07:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.525356+0000", 2023-10-08T07:07:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3095000000000001e-05 2023-10-08T07:07:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.525366+0000", 2023-10-08T07:07:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0688e-05 2023-10-08T07:07:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.525374+0000", 2023-10-08T07:07:28.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9209999999999992e-06 2023-10-08T07:07:28.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.397 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.397 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114453 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.397 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.573089+0000", 2023-10-08T07:07:28.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.13086388800000001, 2023-10-08T07:07:28.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13967413300000001, 2023-10-08T07:07:28.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.398 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.398 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114453 2023-10-08T07:07:28.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.398 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.573089+0000", 2023-10-08T07:07:28.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.573089+0000", 2023-10-08T07:07:28.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.573090+0000", 2023-10-08T07:07:28.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4e-07 2023-10-08T07:07:28.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.573103+0000", 2023-10-08T07:07:28.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2557e-05 2023-10-08T07:07:28.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.573115+0000", 2023-10-08T07:07:28.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2398000000000001e-05 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.573125+0000", 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0319000000000001e-05 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114707 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.662018+0000", 2023-10-08T07:07:28.401 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.041935522000000003, 2023-10-08T07:07:28.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050798806000000002, 2023-10-08T07:07:28.402 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.402 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.402 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114707 2023-10-08T07:07:28.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.402 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.662018+0000", 2023-10-08T07:07:28.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.662018+0000", 2023-10-08T07:07:28.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.662018+0000", 2023-10-08T07:07:28.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7300000000000005e-07 2023-10-08T07:07:28.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.662049+0000", 2023-10-08T07:07:28.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1075999999999999e-05 2023-10-08T07:07:28.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.662058+0000", 2023-10-08T07:07:28.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0779999999999996e-06 2023-10-08T07:07:28.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.662062+0000", 2023-10-08T07:07:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0690000000000003e-06 2023-10-08T07:07:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114730 4.20 e58/17 4:04004f2c:::10000000004.0000000d:head v 58'5395, mlcod=58'5383)", 2023-10-08T07:07:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.675307+0000", 2023-10-08T07:07:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.028645995, 2023-10-08T07:07:28.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037562694000000001, 2023-10-08T07:07:28.406 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.406 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.406 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.675307+0000", 2023-10-08T07:07:28.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.675307+0000", 2023-10-08T07:07:28.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.675308+0000", 2023-10-08T07:07:28.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6800000000000001e-07 2023-10-08T07:07:28.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.675318+0000", 2023-10-08T07:07:28.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0124e-05 2023-10-08T07:07:28.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.675324+0000", 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6989999999999997e-06 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.675329+0000", 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6879999999999998e-06 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.688711+0000", 2023-10-08T07:07:28.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013381697 2023-10-08T07:07:28.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.688731+0000", 2023-10-08T07:07:28.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9862000000000001e-05 2023-10-08T07:07:28.409 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.409 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.409 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.410 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114786 4.1b e58/17 4:dbb7dde6:::10000000004.0000002c:head v 58'3632, mlcod=58'3628)", 2023-10-08T07:07:28.410 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.691088+0000", 2023-10-08T07:07:28.410 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012865217999999999, 2023-10-08T07:07:28.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021843398, 2023-10-08T07:07:28.410 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.410 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.410 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691088+0000", 2023-10-08T07:07:28.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691088+0000", 2023-10-08T07:07:28.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691088+0000", 2023-10-08T07:07:28.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:07:28.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691100+0000", 2023-10-08T07:07:28.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1076e-05 2023-10-08T07:07:28.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691108+0000", 2023-10-08T07:07:28.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8149999999999995e-06 2023-10-08T07:07:28.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691115+0000", 2023-10-08T07:07:28.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7209999999999997e-06 2023-10-08T07:07:28.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.693154+0000", 2023-10-08T07:07:28.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002038518 2023-10-08T07:07:28.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.693193+0000", 2023-10-08T07:07:28.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9246000000000003e-05 2023-10-08T07:07:28.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.414 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.414 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114819 4.3f 4.9eb4593f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.414 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.701259+0000", 2023-10-08T07:07:28.414 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00269425, 2023-10-08T07:07:28.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011729105, 2023-10-08T07:07:28.414 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.414 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.415 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114819 2023-10-08T07:07:28.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.415 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701259+0000", 2023-10-08T07:07:28.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701259+0000", 2023-10-08T07:07:28.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701260+0000", 2023-10-08T07:07:28.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.85e-07 2023-10-08T07:07:28.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701269+0000", 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4539999999999996e-06 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701281+0000", 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1882000000000001e-05 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701287+0000", 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5790000000000003e-06 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.417 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.418 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112780 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.004528+0000", 2023-10-08T07:07:28.418 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.69942563099999999, 2023-10-08T07:07:28.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.70851339700000004, 2023-10-08T07:07:28.418 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.418 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.419 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112780 2023-10-08T07:07:28.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.419 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.004528+0000", 2023-10-08T07:07:28.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.004528+0000", 2023-10-08T07:07:28.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.004528+0000", 2023-10-08T07:07:28.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7300000000000004e-07 2023-10-08T07:07:28.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.004541+0000", 2023-10-08T07:07:28.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2235999999999999e-05 2023-10-08T07:07:28.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.004551+0000", 2023-10-08T07:07:28.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0462000000000001e-05 2023-10-08T07:07:28.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.004561+0000", 2023-10-08T07:07:28.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3349999999999996e-06 2023-10-08T07:07:28.421 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.421 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.422 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112892 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.422 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.041690+0000", 2023-10-08T07:07:28.422 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.66226304999999996, 2023-10-08T07:07:28.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.67140562999999998, 2023-10-08T07:07:28.422 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.422 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.423 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112892 2023-10-08T07:07:28.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.423 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.041690+0000", 2023-10-08T07:07:28.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.041690+0000", 2023-10-08T07:07:28.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.041691+0000", 2023-10-08T07:07:28.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9100000000000004e-07 2023-10-08T07:07:28.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.041704+0000", 2023-10-08T07:07:28.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.384e-05 2023-10-08T07:07:28.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.041709+0000", 2023-10-08T07:07:28.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6650000000000002e-06 2023-10-08T07:07:28.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.041712+0000", 2023-10-08T07:07:28.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.298e-06 2023-10-08T07:07:28.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.426 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.426 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113044 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.426 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.091544+0000", 2023-10-08T07:07:28.426 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61240865200000005, 2023-10-08T07:07:28.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.62160657500000005, 2023-10-08T07:07:28.426 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.426 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.427 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.427 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113044 2023-10-08T07:07:28.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.427 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.091544+0000", 2023-10-08T07:07:28.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.091544+0000", 2023-10-08T07:07:28.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.091545+0000", 2023-10-08T07:07:28.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6499999999999998e-07 2023-10-08T07:07:28.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.091558+0000", 2023-10-08T07:07:28.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2413e-05 2023-10-08T07:07:28.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.091567+0000", 2023-10-08T07:07:28.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8039999999999996e-06 2023-10-08T07:07:28.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.091574+0000", 2023-10-08T07:07:28.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0110000000000003e-06 2023-10-08T07:07:28.429 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.429 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.430 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.430 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113421 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.430 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.216188+0000", 2023-10-08T07:07:28.430 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48776482599999998, 2023-10-08T07:07:28.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.49701725800000002, 2023-10-08T07:07:28.430 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.430 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.431 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113421 2023-10-08T07:07:28.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.431 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.216188+0000", 2023-10-08T07:07:28.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.216188+0000", 2023-10-08T07:07:28.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.216189+0000", 2023-10-08T07:07:28.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7199999999999998e-07 2023-10-08T07:07:28.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.216205+0000", 2023-10-08T07:07:28.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5469e-05 2023-10-08T07:07:28.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.216214+0000", 2023-10-08T07:07:28.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9389999999999992e-06 2023-10-08T07:07:28.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.216222+0000", 2023-10-08T07:07:28.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3010000000000001e-06 2023-10-08T07:07:28.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.433 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114785 4.2b e58/17 4:d776c1c9:::10000000004.0000003d:head v 58'3624, mlcod=58'3616)", 2023-10-08T07:07:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.691127+0000", 2023-10-08T07:07:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012826096, 2023-10-08T07:07:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022132872000000001, 2023-10-08T07:07:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691127+0000", 2023-10-08T07:07:28.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691127+0000", 2023-10-08T07:07:28.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691127+0000", 2023-10-08T07:07:28.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.96e-07 2023-10-08T07:07:28.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691138+0000", 2023-10-08T07:07:28.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1158999999999999e-05 2023-10-08T07:07:28.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691147+0000", 2023-10-08T07:07:28.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.551e-06 2023-10-08T07:07:28.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691152+0000", 2023-10-08T07:07:28.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0209999999999999e-06 2023-10-08T07:07:28.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696006+0000", 2023-10-08T07:07:28.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048541950000000004 2023-10-08T07:07:28.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696027+0000", 2023-10-08T07:07:28.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0403000000000001e-05 2023-10-08T07:07:28.438 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.438 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.438 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.438 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114818 4.20 e58/17 4:07572838:::10000000004.00000010:head v 58'5397, mlcod=58'5388)", 2023-10-08T07:07:28.438 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.701544+0000", 2023-10-08T07:07:28.438 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024091730000000001, 2023-10-08T07:07:28.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011782814000000001, 2023-10-08T07:07:28.439 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.439 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.439 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701544+0000", 2023-10-08T07:07:28.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701544+0000", 2023-10-08T07:07:28.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701544+0000", 2023-10-08T07:07:28.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.15e-07 2023-10-08T07:07:28.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701554+0000", 2023-10-08T07:07:28.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3999999999999998e-06 2023-10-08T07:07:28.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701560+0000", 2023-10-08T07:07:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4400000000000002e-06 2023-10-08T07:07:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701564+0000", 2023-10-08T07:07:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8800000000000001e-06 2023-10-08T07:07:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.707296+0000", 2023-10-08T07:07:28.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00573172 2023-10-08T07:07:28.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.707315+0000", 2023-10-08T07:07:28.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9306000000000001e-05 2023-10-08T07:07:28.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.442 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.443 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113678 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.443 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.310618+0000", 2023-10-08T07:07:28.443 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39333557000000002, 2023-10-08T07:07:28.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40276852099999999, 2023-10-08T07:07:28.443 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.443 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.443 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113678 2023-10-08T07:07:28.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.444 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.310618+0000", 2023-10-08T07:07:28.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.310618+0000", 2023-10-08T07:07:28.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.310618+0000", 2023-10-08T07:07:28.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7400000000000003e-07 2023-10-08T07:07:28.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.310639+0000", 2023-10-08T07:07:28.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1134000000000001e-05 2023-10-08T07:07:28.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.310649+0000", 2023-10-08T07:07:28.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8060000000000006e-06 2023-10-08T07:07:28.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.310655+0000", 2023-10-08T07:07:28.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0789999999999997e-06 2023-10-08T07:07:28.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.446 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.447 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114026 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.447 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.429681+0000", 2023-10-08T07:07:28.447 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.27427207199999998, 2023-10-08T07:07:28.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.28376284499999999, 2023-10-08T07:07:28.447 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.447 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.447 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114026 2023-10-08T07:07:28.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.448 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.429681+0000", 2023-10-08T07:07:28.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.429681+0000", 2023-10-08T07:07:28.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.429682+0000", 2023-10-08T07:07:28.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9299999999999997e-07 2023-10-08T07:07:28.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.429697+0000", 2023-10-08T07:07:28.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4936999999999999e-05 2023-10-08T07:07:28.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.429708+0000", 2023-10-08T07:07:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1189000000000001e-05 2023-10-08T07:07:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.429715+0000", 2023-10-08T07:07:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2660000000000004e-06 2023-10-08T07:07:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.451 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114376 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.451 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.546967+0000", 2023-10-08T07:07:28.451 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15698620199999999, 2023-10-08T07:07:28.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.16653100300000001, 2023-10-08T07:07:28.451 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.451 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.451 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114376 2023-10-08T07:07:28.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.451 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.546967+0000", 2023-10-08T07:07:28.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.546967+0000", 2023-10-08T07:07:28.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.546968+0000", 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8899999999999998e-07 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.546983+0000", 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4975e-05 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.546994+0000", 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1649e-05 2023-10-08T07:07:28.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.547001+0000", 2023-10-08T07:07:28.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9539999999999998e-06 2023-10-08T07:07:28.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.454 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.454 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114678 4.f 4:f2537947:::10000000004.00000017:head [write 3170304~4096 in=4096b,write 3207168~4096 in=4096b,write 3407872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.454 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.651925+0000", 2023-10-08T07:07:28.454 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.052028244000000001, 2023-10-08T07:07:28.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.061637650000000002, 2023-10-08T07:07:28.455 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.455 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.455 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.455 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.455 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.455 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114678 2023-10-08T07:07:28.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.455 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.651925+0000", 2023-10-08T07:07:28.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.651925+0000", 2023-10-08T07:07:28.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.651926+0000", 2023-10-08T07:07:28.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7400000000000002e-07 2023-10-08T07:07:28.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.651938+0000", 2023-10-08T07:07:28.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2203e-05 2023-10-08T07:07:28.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.651948+0000", 2023-10-08T07:07:28.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0539e-05 2023-10-08T07:07:28.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.651956+0000", 2023-10-08T07:07:28.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.52e-06 2023-10-08T07:07:28.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.680847+0000", 2023-10-08T07:07:28.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028891219999999999 2023-10-08T07:07:28.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.680931+0000", 2023-10-08T07:07:28.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3770000000000006e-05 2023-10-08T07:07:28.459 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.459 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.459 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.459 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114749 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.459 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.675592+0000", 2023-10-08T07:07:28.459 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.028361461000000001, 2023-10-08T07:07:28.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038038140999999998, 2023-10-08T07:07:28.459 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.459 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.460 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.460 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.460 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114749 2023-10-08T07:07:28.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.460 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.675592+0000", 2023-10-08T07:07:28.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.675592+0000", 2023-10-08T07:07:28.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.675593+0000", 2023-10-08T07:07:28.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.062e-06 2023-10-08T07:07:28.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.675610+0000", 2023-10-08T07:07:28.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7399999999999999e-05 2023-10-08T07:07:28.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.675623+0000", 2023-10-08T07:07:28.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.269e-05 2023-10-08T07:07:28.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.675631+0000", 2023-10-08T07:07:28.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5269999999999998e-06 2023-10-08T07:07:28.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.462 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.463 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114792 4.9 4:90f7d93b:::10000000004.00000021:head [write 3321856~8192 in=8192b,write 3461120~4096 in=4096b,write 3506176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.463 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.691537+0000", 2023-10-08T07:07:28.463 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012416132999999999, 2023-10-08T07:07:28.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022155238000000001, 2023-10-08T07:07:28.463 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.463 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.464 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114792 2023-10-08T07:07:28.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.464 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691537+0000", 2023-10-08T07:07:28.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691537+0000", 2023-10-08T07:07:28.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691538+0000", 2023-10-08T07:07:28.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6599999999999994e-07 2023-10-08T07:07:28.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691552+0000", 2023-10-08T07:07:28.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3677e-05 2023-10-08T07:07:28.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691567+0000", 2023-10-08T07:07:28.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5506e-05 2023-10-08T07:07:28.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691575+0000", 2023-10-08T07:07:28.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2023-10-08T07:07:28.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691640+0000", 2023-10-08T07:07:28.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4392000000000003e-05 2023-10-08T07:07:28.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.691746+0000", 2023-10-08T07:07:28.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010605 2023-10-08T07:07:28.467 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.467 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.467 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.468 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114821 4.19 4:9b26afe3:::10000000004.00000005:head [write 1409024~4096 in=4096b,write 1445888~4096 in=4096b,write 1552384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.468 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.701814+0000", 2023-10-08T07:07:28.468 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0021388000000000002, 2023-10-08T07:07:28.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011947077, 2023-10-08T07:07:28.468 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.468 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.468 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.468 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.468 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.468 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114821 2023-10-08T07:07:28.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.468 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701814+0000", 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701814+0000", 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701815+0000", 2023-10-08T07:07:28.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:07:28.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701827+0000", 2023-10-08T07:07:28.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1882000000000001e-05 2023-10-08T07:07:28.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701838+0000", 2023-10-08T07:07:28.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.096e-05 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701845+0000", 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2590000000000003e-06 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.712024+0000", 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010178698999999999 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.712115+0000", 2023-10-08T07:07:28.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0864000000000003e-05 2023-10-08T07:07:28.472 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.472 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.472 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.472 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112824 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.472 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.019498+0000", 2023-10-08T07:07:28.472 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.68445529500000002, 2023-10-08T07:07:28.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.69432897999999998, 2023-10-08T07:07:28.472 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.473 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.473 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.473 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.473 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.473 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112824 2023-10-08T07:07:28.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.473 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.019498+0000", 2023-10-08T07:07:28.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.019498+0000", 2023-10-08T07:07:28.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.019499+0000", 2023-10-08T07:07:28.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1999999999999999e-07 2023-10-08T07:07:28.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.019509+0000", 2023-10-08T07:07:28.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0149999999999999e-05 2023-10-08T07:07:28.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.019517+0000", 2023-10-08T07:07:28.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1070000000000005e-06 2023-10-08T07:07:28.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.019523+0000", 2023-10-08T07:07:28.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9499999999999998e-06 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113469 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.230892+0000", 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47306161600000002, 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48298814200000001, 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.477 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113469 2023-10-08T07:07:28.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.477 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.230892+0000", 2023-10-08T07:07:28.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.230892+0000", 2023-10-08T07:07:28.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.230892+0000", 2023-10-08T07:07:28.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2399999999999997e-07 2023-10-08T07:07:28.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.230904+0000", 2023-10-08T07:07:28.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1688000000000001e-05 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.230915+0000", 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1122e-05 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.230922+0000", 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6749999999999996e-06 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113776 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.344810+0000", 2023-10-08T07:07:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.35914310999999999, 2023-10-08T07:07:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.369123384, 2023-10-08T07:07:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113776 2023-10-08T07:07:28.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.481 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.344810+0000", 2023-10-08T07:07:28.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.344810+0000", 2023-10-08T07:07:28.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.344811+0000", 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9400000000000004e-07 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.344824+0000", 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3101999999999999e-05 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.344837+0000", 2023-10-08T07:07:28.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2805e-05 2023-10-08T07:07:28.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.344844+0000", 2023-10-08T07:07:28.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3420000000000002e-06 2023-10-08T07:07:28.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.483 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.483 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114793 4.7 4:e2d089ed:::10000000004.00000033:head [write 839680~4096 in=4096b,write 933888~4096 in=4096b,write 1122304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.484 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.692130+0000", 2023-10-08T07:07:28.484 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011823403999999999, 2023-10-08T07:07:28.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021862398000000002, 2023-10-08T07:07:28.484 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.484 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.484 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114793 2023-10-08T07:07:28.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.484 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.692130+0000", 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.692130+0000", 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.692131+0000", 2023-10-08T07:07:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.09e-07 2023-10-08T07:07:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.692143+0000", 2023-10-08T07:07:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2812e-05 2023-10-08T07:07:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.692156+0000", 2023-10-08T07:07:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2291e-05 2023-10-08T07:07:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.692164+0000", 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1359999999999997e-06 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705553+0000", 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013389547 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705628+0000", 2023-10-08T07:07:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4682000000000001e-05 2023-10-08T07:07:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114820 4.38 e58/46 4:1e0977c7:::10000000004.00000022:head v 58'1819, mlcod=58'1814)", 2023-10-08T07:07:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.701966+0000", 2023-10-08T07:07:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0019866599999999999, 2023-10-08T07:07:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012099667999999999, 2023-10-08T07:07:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701966+0000", 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701966+0000", 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701967+0000", 2023-10-08T07:07:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2023-10-08T07:07:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701976+0000", 2023-10-08T07:07:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2620000000000004e-06 2023-10-08T07:07:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701988+0000", 2023-10-08T07:07:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1867e-05 2023-10-08T07:07:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.701993+0000", 2023-10-08T07:07:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.729e-06 2023-10-08T07:07:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.710052+0000", 2023-10-08T07:07:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080588829999999993 2023-10-08T07:07:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.710073+0000", 2023-10-08T07:07:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1115999999999999e-05 2023-10-08T07:07:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112897 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.043044+0000", 2023-10-08T07:07:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.66090897400000004, 2023-10-08T07:07:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.67108741400000005, 2023-10-08T07:07:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112897 2023-10-08T07:07:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.043044+0000", 2023-10-08T07:07:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.043044+0000", 2023-10-08T07:07:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.043045+0000", 2023-10-08T07:07:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7899999999999997e-07 2023-10-08T07:07:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.043057+0000", 2023-10-08T07:07:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1888999999999999e-05 2023-10-08T07:07:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.043066+0000", 2023-10-08T07:07:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1479999999999995e-06 2023-10-08T07:07:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.043073+0000", 2023-10-08T07:07:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.007e-06 2023-10-08T07:07:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113470 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.231589+0000", 2023-10-08T07:07:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47236441400000001, 2023-10-08T07:07:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48260584400000001, 2023-10-08T07:07:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113470 2023-10-08T07:07:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.231589+0000", 2023-10-08T07:07:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.231589+0000", 2023-10-08T07:07:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.231590+0000", 2023-10-08T07:07:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6300000000000004e-07 2023-10-08T07:07:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.231601+0000", 2023-10-08T07:07:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1819e-05 2023-10-08T07:07:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.231610+0000", 2023-10-08T07:07:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1680000000000004e-06 2023-10-08T07:07:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.231616+0000", 2023-10-08T07:07:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7020000000000004e-06 2023-10-08T07:07:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113535 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.254130+0000", 2023-10-08T07:07:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.449823476, 2023-10-08T07:07:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46013917700000001, 2023-10-08T07:07:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113535 2023-10-08T07:07:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.254130+0000", 2023-10-08T07:07:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.254130+0000", 2023-10-08T07:07:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.254130+0000", 2023-10-08T07:07:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9999999999999996e-07 2023-10-08T07:07:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.254149+0000", 2023-10-08T07:07:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8219999999999998e-05 2023-10-08T07:07:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.254158+0000", 2023-10-08T07:07:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6800000000000005e-06 2023-10-08T07:07:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.254165+0000", 2023-10-08T07:07:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8889999999999996e-06 2023-10-08T07:07:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113573 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.266174+0000", 2023-10-08T07:07:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43777863900000002, 2023-10-08T07:07:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44817405300000002, 2023-10-08T07:07:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113573 2023-10-08T07:07:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.266174+0000", 2023-10-08T07:07:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.266174+0000", 2023-10-08T07:07:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.266175+0000", 2023-10-08T07:07:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4700000000000002e-07 2023-10-08T07:07:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.266181+0000", 2023-10-08T07:07:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5189999999999998e-06 2023-10-08T07:07:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.266188+0000", 2023-10-08T07:07:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.331e-06 2023-10-08T07:07:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.266191+0000", 2023-10-08T07:07:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.501e-06 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113681 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.311517+0000", 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39243644, 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.402891259, 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.508 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.509 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.509 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113681 2023-10-08T07:07:28.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.509 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.311517+0000", 2023-10-08T07:07:28.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.311517+0000", 2023-10-08T07:07:28.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.311517+0000", 2023-10-08T07:07:28.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:07:28.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.311542+0000", 2023-10-08T07:07:28.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4674000000000001e-05 2023-10-08T07:07:28.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.311549+0000", 2023-10-08T07:07:28.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-06 2023-10-08T07:07:28.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.311553+0000", 2023-10-08T07:07:28.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5750000000000002e-06 2023-10-08T07:07:28.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.511 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.512 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.512 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114795 4.29 4:94216392:::10000000004.0000002b:head [write 2859008~4096 in=4096b,write 3121152~4096 in=4096b,write 3149824~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.512 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.692972+0000", 2023-10-08T07:07:28.512 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.010981594000000001, 2023-10-08T07:07:28.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021508205999999998, 2023-10-08T07:07:28.512 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.512 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:28.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.513 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114795 2023-10-08T07:07:28.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.513 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.692972+0000", 2023-10-08T07:07:28.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.692972+0000", 2023-10-08T07:07:28.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.692972+0000", 2023-10-08T07:07:28.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8700000000000004e-07 2023-10-08T07:07:28.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.692984+0000", 2023-10-08T07:07:28.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1223000000000001e-05 2023-10-08T07:07:28.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.692995+0000", 2023-10-08T07:07:28.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0876000000000001e-05 2023-10-08T07:07:28.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.693003+0000", 2023-10-08T07:07:28.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0020000000000006e-06 2023-10-08T07:07:28.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694490+0000", 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001487021 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694558+0000", 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8932999999999999e-05 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694691+0000", 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132044 2023-10-08T07:07:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702350+0000", 2023-10-08T07:07:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076594469999999998 2023-10-08T07:07:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114824 4.7 4.db317c87 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.702804+0000", 2023-10-08T07:07:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001149303, 2023-10-08T07:07:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011720594000000001, 2023-10-08T07:07:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114824 2023-10-08T07:07:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702804+0000", 2023-10-08T07:07:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702804+0000", 2023-10-08T07:07:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702805+0000", 2023-10-08T07:07:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4600000000000004e-07 2023-10-08T07:07:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702817+0000", 2023-10-08T07:07:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2034e-05 2023-10-08T07:07:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702825+0000", 2023-10-08T07:07:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9370000000000004e-06 2023-10-08T07:07:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702832+0000", 2023-10-08T07:07:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1019999999999999e-06 2023-10-08T07:07:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112785 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.006294+0000", 2023-10-08T07:07:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.69765912500000005, 2023-10-08T07:07:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.70826310199999998, 2023-10-08T07:07:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112785 2023-10-08T07:07:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.006294+0000", 2023-10-08T07:07:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.006294+0000", 2023-10-08T07:07:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.006295+0000", 2023-10-08T07:07:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3799999999999996e-07 2023-10-08T07:07:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.006307+0000", 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2159e-05 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.006317+0000", 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8730000000000002e-06 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.006324+0000", 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3579999999999997e-06 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112860 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.031373+0000", 2023-10-08T07:07:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67257974700000001, 2023-10-08T07:07:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.68321882899999997, 2023-10-08T07:07:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112860 2023-10-08T07:07:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031373+0000", 2023-10-08T07:07:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031373+0000", 2023-10-08T07:07:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031374+0000", 2023-10-08T07:07:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6000000000000003e-07 2023-10-08T07:07:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031387+0000", 2023-10-08T07:07:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2547e-05 2023-10-08T07:07:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031397+0000", 2023-10-08T07:07:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0282000000000001e-05 2023-10-08T07:07:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031406+0000", 2023-10-08T07:07:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7120000000000006e-06 2023-10-08T07:07:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113423 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.216798+0000", 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48715466800000001, 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.497835378, 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113423 2023-10-08T07:07:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.216798+0000", 2023-10-08T07:07:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.216798+0000", 2023-10-08T07:07:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.216799+0000", 2023-10-08T07:07:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0200000000000001e-07 2023-10-08T07:07:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.216814+0000", 2023-10-08T07:07:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5328999999999998e-05 2023-10-08T07:07:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.216823+0000", 2023-10-08T07:07:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3820000000000004e-06 2023-10-08T07:07:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.216828+0000", 2023-10-08T07:07:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9370000000000003e-06 2023-10-08T07:07:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113780 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.346157+0000", 2023-10-08T07:07:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.357796269, 2023-10-08T07:07:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.36850687399999998, 2023-10-08T07:07:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113780 2023-10-08T07:07:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.346157+0000", 2023-10-08T07:07:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.346157+0000", 2023-10-08T07:07:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.346158+0000", 2023-10-08T07:07:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5199999999999995e-07 2023-10-08T07:07:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.346169+0000", 2023-10-08T07:07:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1018e-05 2023-10-08T07:07:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.346179+0000", 2023-10-08T07:07:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0139999999999999e-05 2023-10-08T07:07:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.346185+0000", 2023-10-08T07:07:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8599999999999998e-06 2023-10-08T07:07:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113846 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.369174+0000", 2023-10-08T07:07:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.33477908099999998, 2023-10-08T07:07:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.34552668600000003, 2023-10-08T07:07:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113846 2023-10-08T07:07:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.369174+0000", 2023-10-08T07:07:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.369174+0000", 2023-10-08T07:07:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.369175+0000", 2023-10-08T07:07:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7100000000000001e-07 2023-10-08T07:07:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.369187+0000", 2023-10-08T07:07:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2279000000000001e-05 2023-10-08T07:07:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.369200+0000", 2023-10-08T07:07:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2714000000000001e-05 2023-10-08T07:07:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.369206+0000", 2023-10-08T07:07:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.64e-06 2023-10-08T07:07:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114615 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.632350+0000", 2023-10-08T07:07:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.071603063999999994, 2023-10-08T07:07:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.082380175999999999, 2023-10-08T07:07:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114615 2023-10-08T07:07:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.632350+0000", 2023-10-08T07:07:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.632350+0000", 2023-10-08T07:07:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.632351+0000", 2023-10-08T07:07:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7899999999999998e-07 2023-10-08T07:07:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.632360+0000", 2023-10-08T07:07:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7750000000000004e-06 2023-10-08T07:07:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.632367+0000", 2023-10-08T07:07:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9600000000000003e-06 2023-10-08T07:07:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.632372+0000", 2023-10-08T07:07:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6330000000000004e-06 2023-10-08T07:07:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114827 4.3b 4.d87b41fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.703657+0000", 2023-10-08T07:07:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00029633099999999999, 2023-10-08T07:07:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011104075999999999, 2023-10-08T07:07:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114827 2023-10-08T07:07:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.703657+0000", 2023-10-08T07:07:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.703657+0000", 2023-10-08T07:07:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.703658+0000", 2023-10-08T07:07:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7400000000000002e-07 2023-10-08T07:07:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.703689+0000", 2023-10-08T07:07:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1174999999999999e-05 2023-10-08T07:07:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.703699+0000", 2023-10-08T07:07:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0616e-05 2023-10-08T07:07:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.703708+0000", 2023-10-08T07:07:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2770000000000005e-06 2023-10-08T07:07:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112861 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.031656+0000", 2023-10-08T07:07:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.672297225, 2023-10-08T07:07:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.68313823399999996, 2023-10-08T07:07:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112861 2023-10-08T07:07:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031656+0000", 2023-10-08T07:07:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031656+0000", 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031657+0000", 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3500000000000005e-07 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031669+0000", 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2676e-05 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031681+0000", 2023-10-08T07:07:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1212999999999999e-05 2023-10-08T07:07:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031689+0000", 2023-10-08T07:07:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3080000000000008e-06 2023-10-08T07:07:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113988 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.418847+0000", 2023-10-08T07:07:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28510640999999998, 2023-10-08T07:07:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29597910300000002, 2023-10-08T07:07:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113988 2023-10-08T07:07:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.418847+0000", 2023-10-08T07:07:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.418847+0000", 2023-10-08T07:07:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.418848+0000", 2023-10-08T07:07:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6799999999999999e-07 2023-10-08T07:07:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.418880+0000", 2023-10-08T07:07:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-05 2023-10-08T07:07:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.418889+0000", 2023-10-08T07:07:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9220000000000003e-06 2023-10-08T07:07:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.418896+0000", 2023-10-08T07:07:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7880000000000001e-06 2023-10-08T07:07:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114578 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.619446+0000", 2023-10-08T07:07:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.084507027999999998, 2023-10-08T07:07:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.095408935, 2023-10-08T07:07:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114578 2023-10-08T07:07:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.619446+0000", 2023-10-08T07:07:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.619446+0000", 2023-10-08T07:07:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.619447+0000", 2023-10-08T07:07:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2023-10-08T07:07:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.619456+0000", 2023-10-08T07:07:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8060000000000006e-06 2023-10-08T07:07:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.619464+0000", 2023-10-08T07:07:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5329999999999997e-06 2023-10-08T07:07:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.619470+0000", 2023-10-08T07:07:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3879999999999997e-06 2023-10-08T07:07:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114715 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.664437+0000", 2023-10-08T07:07:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.039516009999999997, 2023-10-08T07:07:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050475196, 2023-10-08T07:07:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114715 2023-10-08T07:07:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.664437+0000", 2023-10-08T07:07:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.664437+0000", 2023-10-08T07:07:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.664438+0000", 2023-10-08T07:07:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1900000000000001e-07 2023-10-08T07:07:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.664448+0000", 2023-10-08T07:07:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0404000000000001e-05 2023-10-08T07:07:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.664458+0000", 2023-10-08T07:07:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6849999999999996e-06 2023-10-08T07:07:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.664465+0000", 2023-10-08T07:07:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9199999999999998e-06 2023-10-08T07:07:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114823 4.a e58/17 4:524fba76:::10000000004.0000001b:head v 58'1778, mlcod=58'1776)", 2023-10-08T07:07:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.703984+0000", 2023-10-08T07:07:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999969, 2023-10-08T07:07:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010989932000000001, 2023-10-08T07:07:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.703984+0000", 2023-10-08T07:07:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.703984+0000", 2023-10-08T07:07:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.703985+0000", 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5099999999999999e-07 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.703999+0000", 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3803e-05 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704010+0000", 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1007e-05 2023-10-08T07:07:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704016+0000", 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8369999999999999e-06 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704118+0000", 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010143 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704138+0000", 2023-10-08T07:07:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.018e-05 2023-10-08T07:07:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112936 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.055745+0000", 2023-10-08T07:07:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64820862999999995, 2023-10-08T07:07:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65926665699999998, 2023-10-08T07:07:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112936 2023-10-08T07:07:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.055745+0000", 2023-10-08T07:07:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.055745+0000", 2023-10-08T07:07:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.055745+0000", 2023-10-08T07:07:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:07:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.055762+0000", 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7024000000000002e-05 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.055773+0000", 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0624e-05 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.055780+0000", 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7150000000000001e-06 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112977 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.069925+0000", 2023-10-08T07:07:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63402821600000003, 2023-10-08T07:07:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.64511856199999995, 2023-10-08T07:07:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112977 2023-10-08T07:07:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.069925+0000", 2023-10-08T07:07:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.069925+0000", 2023-10-08T07:07:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.069926+0000", 2023-10-08T07:07:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7499999999999999e-07 2023-10-08T07:07:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.069939+0000", 2023-10-08T07:07:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3241000000000001e-05 2023-10-08T07:07:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.069950+0000", 2023-10-08T07:07:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1364e-05 2023-10-08T07:07:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.069957+0000", 2023-10-08T07:07:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1740000000000003e-06 2023-10-08T07:07:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113472 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.231996+0000", 2023-10-08T07:07:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47195758799999998, 2023-10-08T07:07:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48307934400000002, 2023-10-08T07:07:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113472 2023-10-08T07:07:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.231996+0000", 2023-10-08T07:07:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.231996+0000", 2023-10-08T07:07:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.231996+0000", 2023-10-08T07:07:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5499999999999997e-07 2023-10-08T07:07:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.232006+0000", 2023-10-08T07:07:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0013999999999999e-05 2023-10-08T07:07:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.232019+0000", 2023-10-08T07:07:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2498e-05 2023-10-08T07:07:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.232025+0000", 2023-10-08T07:07:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6879999999999996e-06 2023-10-08T07:07:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113849 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.370544+0000", 2023-10-08T07:07:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.33340911000000001, 2023-10-08T07:07:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.34456273799999998, 2023-10-08T07:07:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113849 2023-10-08T07:07:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.370544+0000", 2023-10-08T07:07:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.370544+0000", 2023-10-08T07:07:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.370545+0000", 2023-10-08T07:07:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1099999999999995e-07 2023-10-08T07:07:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.370560+0000", 2023-10-08T07:07:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5605999999999999e-05 2023-10-08T07:07:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.370570+0000", 2023-10-08T07:07:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6129999999999993e-06 2023-10-08T07:07:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.370577+0000", 2023-10-08T07:07:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.827e-06 2023-10-08T07:07:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113990 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.419304+0000", 2023-10-08T07:07:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28464949899999997, 2023-10-08T07:07:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29583387500000002, 2023-10-08T07:07:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113990 2023-10-08T07:07:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.419304+0000", 2023-10-08T07:07:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.419304+0000", 2023-10-08T07:07:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.419304+0000", 2023-10-08T07:07:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.75e-07 2023-10-08T07:07:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.419341+0000", 2023-10-08T07:07:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6640000000000002e-05 2023-10-08T07:07:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.419349+0000", 2023-10-08T07:07:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1300000000000001e-06 2023-10-08T07:07:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.419355+0000", 2023-10-08T07:07:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9370000000000001e-06 2023-10-08T07:07:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114211 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.492817+0000", 2023-10-08T07:07:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.21113573899999999, 2023-10-08T07:07:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.222365652, 2023-10-08T07:07:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114211 2023-10-08T07:07:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.492817+0000", 2023-10-08T07:07:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.492817+0000", 2023-10-08T07:07:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.492818+0000", 2023-10-08T07:07:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5099999999999999e-07 2023-10-08T07:07:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.492844+0000", 2023-10-08T07:07:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5596e-05 2023-10-08T07:07:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.492854+0000", 2023-10-08T07:07:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0200999999999999e-05 2023-10-08T07:07:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.492859+0000", 2023-10-08T07:07:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.648e-06 2023-10-08T07:07:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114825 4.3a e58/17 4:5f183e4b:::10000000004.00000023:head v 58'5234, mlcod=58'5230)", 2023-10-08T07:07:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.704034+0000", 2023-10-08T07:07:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9999194, 2023-10-08T07:07:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011193488999999999, 2023-10-08T07:07:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704034+0000", 2023-10-08T07:07:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704034+0000", 2023-10-08T07:07:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704034+0000", 2023-10-08T07:07:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0100000000000001e-07 2023-10-08T07:07:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704047+0000", 2023-10-08T07:07:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2889e-05 2023-10-08T07:07:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704059+0000", 2023-10-08T07:07:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1902999999999999e-05 2023-10-08T07:07:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704066+0000", 2023-10-08T07:07:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7390000000000002e-06 2023-10-08T07:07:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704374+0000", 2023-10-08T07:07:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000307962 2023-10-08T07:07:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704390+0000", 2023-10-08T07:07:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6461999999999999e-05 2023-10-08T07:07:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113129 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.118255+0000", 2023-10-08T07:07:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.58569781499999995, 2023-10-08T07:07:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.59700576900000002, 2023-10-08T07:07:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113129 2023-10-08T07:07:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.118255+0000", 2023-10-08T07:07:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.118255+0000", 2023-10-08T07:07:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.118256+0000", 2023-10-08T07:07:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3300000000000001e-07 2023-10-08T07:07:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.118270+0000", 2023-10-08T07:07:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3352e-05 2023-10-08T07:07:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.118279+0000", 2023-10-08T07:07:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1619999999999997e-06 2023-10-08T07:07:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.118285+0000", 2023-10-08T07:07:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.781e-06 2023-10-08T07:07:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113190 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.140362+0000", 2023-10-08T07:07:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.56359090499999998, 2023-10-08T07:07:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.57493598599999995, 2023-10-08T07:07:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113190 2023-10-08T07:07:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.140362+0000", 2023-10-08T07:07:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.140362+0000", 2023-10-08T07:07:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.140363+0000", 2023-10-08T07:07:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0500000000000002e-07 2023-10-08T07:07:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.140375+0000", 2023-10-08T07:07:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1744e-05 2023-10-08T07:07:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.140386+0000", 2023-10-08T07:07:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0868e-05 2023-10-08T07:07:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.140394+0000", 2023-10-08T07:07:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8299999999999996e-06 2023-10-08T07:07:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113956 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.409990+0000", 2023-10-08T07:07:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29396352100000001, 2023-10-08T07:07:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.305374386, 2023-10-08T07:07:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113956 2023-10-08T07:07:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.409990+0000", 2023-10-08T07:07:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.409990+0000", 2023-10-08T07:07:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.409991+0000", 2023-10-08T07:07:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9999999999999995e-07 2023-10-08T07:07:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.410000+0000", 2023-10-08T07:07:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7149999999999993e-06 2023-10-08T07:07:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.410010+0000", 2023-10-08T07:07:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8230000000000006e-06 2023-10-08T07:07:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.410018+0000", 2023-10-08T07:07:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4580000000000004e-06 2023-10-08T07:07:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114134 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.469246+0000", 2023-10-08T07:07:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.234706991, 2023-10-08T07:07:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.24617969000000001, 2023-10-08T07:07:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114134 2023-10-08T07:07:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.469246+0000", 2023-10-08T07:07:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.469246+0000", 2023-10-08T07:07:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.469247+0000", 2023-10-08T07:07:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0800000000000005e-07 2023-10-08T07:07:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.469257+0000", 2023-10-08T07:07:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8900000000000002e-06 2023-10-08T07:07:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.469263+0000", 2023-10-08T07:07:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7229999999999998e-06 2023-10-08T07:07:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.469269+0000", 2023-10-08T07:07:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5260000000000001e-06 2023-10-08T07:07:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114755 4.20 e58/17 4:04004f2c:::10000000004.0000000d:head v 58'5396, mlcod=58'5386)", 2023-10-08T07:07:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.678440+0000", 2023-10-08T07:07:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.025513534000000001, 2023-10-08T07:07:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037051045999999997, 2023-10-08T07:07:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.678440+0000", 2023-10-08T07:07:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.678440+0000", 2023-10-08T07:07:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.678440+0000", 2023-10-08T07:07:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4300000000000003e-07 2023-10-08T07:07:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.678455+0000", 2023-10-08T07:07:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5065000000000001e-05 2023-10-08T07:07:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.678466+0000", 2023-10-08T07:07:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0784e-05 2023-10-08T07:07:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.678473+0000", 2023-10-08T07:07:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0709999999999997e-06 2023-10-08T07:07:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697981+0000", 2023-10-08T07:07:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019507566 2023-10-08T07:07:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.698005+0000", 2023-10-08T07:07:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4159999999999999e-05 2023-10-08T07:07:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114787 4.2b e58/17 4:d7a77d67:::10000000004.00000029:head v 58'3625, mlcod=58'3616)", 2023-10-08T07:07:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.694321+0000", 2023-10-08T07:07:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0096324740000000002, 2023-10-08T07:07:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021239490999999999, 2023-10-08T07:07:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694321+0000", 2023-10-08T07:07:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694321+0000", 2023-10-08T07:07:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694321+0000", 2023-10-08T07:07:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7599999999999998e-07 2023-10-08T07:07:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694333+0000", 2023-10-08T07:07:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.198e-05 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694339+0000", 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8939999999999998e-06 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694343+0000", 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1699999999999999e-06 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702042+0000", 2023-10-08T07:07:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076991799999999999 2023-10-08T07:07:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.702061+0000", 2023-10-08T07:07:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9057999999999999e-05 2023-10-08T07:07:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114826 4.1b e58/17)", 2023-10-08T07:07:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.704073+0000", 2023-10-08T07:07:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9998803, 2023-10-08T07:07:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011577646, 2023-10-08T07:07:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704073+0000", 2023-10-08T07:07:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704073+0000", 2023-10-08T07:07:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704073+0000", 2023-10-08T07:07:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4299999999999999e-07 2023-10-08T07:07:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704083+0000", 2023-10-08T07:07:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0086e-05 2023-10-08T07:07:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704090+0000", 2023-10-08T07:07:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1570000000000003e-06 2023-10-08T07:07:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704095+0000", 2023-10-08T07:07:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2540000000000003e-06 2023-10-08T07:07:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112652 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:26.933190+0000", 2023-10-08T07:07:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.77076294499999998, 2023-10-08T07:07:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.782526265, 2023-10-08T07:07:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112652 2023-10-08T07:07:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.933190+0000", 2023-10-08T07:07:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.933190+0000", 2023-10-08T07:07:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.933191+0000", 2023-10-08T07:07:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-07 2023-10-08T07:07:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.933198+0000", 2023-10-08T07:07:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.622e-06 2023-10-08T07:07:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.933204+0000", 2023-10-08T07:07:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4360000000000001e-06 2023-10-08T07:07:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.933208+0000", 2023-10-08T07:07:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3290000000000004e-06 2023-10-08T07:07:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112938 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.056311+0000", 2023-10-08T07:07:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64764261400000001, 2023-10-08T07:07:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65947402600000005, 2023-10-08T07:07:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112938 2023-10-08T07:07:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.056311+0000", 2023-10-08T07:07:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.056311+0000", 2023-10-08T07:07:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.056311+0000", 2023-10-08T07:07:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.61e-07 2023-10-08T07:07:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.056321+0000", 2023-10-08T07:07:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8719999999999997e-06 2023-10-08T07:07:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.056329+0000", 2023-10-08T07:07:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.276e-06 2023-10-08T07:07:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.056335+0000", 2023-10-08T07:07:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1539999999999999e-06 2023-10-08T07:07:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113131 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.119427+0000", 2023-10-08T07:07:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.58452651, 2023-10-08T07:07:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.59642508299999997, 2023-10-08T07:07:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113131 2023-10-08T07:07:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.119427+0000", 2023-10-08T07:07:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.119427+0000", 2023-10-08T07:07:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.119427+0000", 2023-10-08T07:07:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7000000000000003e-07 2023-10-08T07:07:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.119441+0000", 2023-10-08T07:07:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3743999999999999e-05 2023-10-08T07:07:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.119450+0000", 2023-10-08T07:07:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7660000000000004e-06 2023-10-08T07:07:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.119457+0000", 2023-10-08T07:07:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2699999999999999e-06 2023-10-08T07:07:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113220 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.149737+0000", 2023-10-08T07:07:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55421565699999997, 2023-10-08T07:07:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56617717099999998, 2023-10-08T07:07:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113220 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.149737+0000", 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.149737+0000", 2023-10-08T07:07:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.149738+0000", 2023-10-08T07:07:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4499999999999997e-07 2023-10-08T07:07:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.149765+0000", 2023-10-08T07:07:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6737000000000002e-05 2023-10-08T07:07:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.149775+0000", 2023-10-08T07:07:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0276e-05 2023-10-08T07:07:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.149781+0000", 2023-10-08T07:07:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7610000000000004e-06 2023-10-08T07:07:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.646 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113386 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.646 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.204536+0000", 2023-10-08T07:07:28.646 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.49941718000000002, 2023-10-08T07:07:28.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.51144405100000001, 2023-10-08T07:07:28.646 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.646 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.646 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113386 2023-10-08T07:07:28.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.647 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.204536+0000", 2023-10-08T07:07:28.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.204536+0000", 2023-10-08T07:07:28.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.204537+0000", 2023-10-08T07:07:28.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:07:28.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.204550+0000", 2023-10-08T07:07:28.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3648e-05 2023-10-08T07:07:28.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.204568+0000", 2023-10-08T07:07:28.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7323999999999999e-05 2023-10-08T07:07:28.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.204577+0000", 2023-10-08T07:07:28.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8149999999999995e-06 2023-10-08T07:07:28.649 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.649 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.650 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113655 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.650 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.302373+0000", 2023-10-08T07:07:28.650 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.40158060000000001, 2023-10-08T07:07:28.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41368414799999997, 2023-10-08T07:07:28.650 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.650 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.651 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113655 2023-10-08T07:07:28.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.651 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.302373+0000", 2023-10-08T07:07:28.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.302373+0000", 2023-10-08T07:07:28.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.302373+0000", 2023-10-08T07:07:28.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9299999999999997e-07 2023-10-08T07:07:28.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.302384+0000", 2023-10-08T07:07:28.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0451999999999999e-05 2023-10-08T07:07:28.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.302395+0000", 2023-10-08T07:07:28.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1005999999999999e-05 2023-10-08T07:07:28.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.302402+0000", 2023-10-08T07:07:28.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5000000000000002e-06 2023-10-08T07:07:28.654 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.654 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.654 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.654 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114621 4.3b 4.d87b41fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.654 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.633597+0000", 2023-10-08T07:07:28.654 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.070356145999999994, 2023-10-08T07:07:28.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.082535373999999995, 2023-10-08T07:07:28.655 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.655 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.655 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.655 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.655 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.655 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114621 2023-10-08T07:07:28.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.655 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.633597+0000", 2023-10-08T07:07:28.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.633597+0000", 2023-10-08T07:07:28.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.633598+0000", 2023-10-08T07:07:28.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9999999999999996e-07 2023-10-08T07:07:28.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.633609+0000", 2023-10-08T07:07:28.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1416999999999999e-05 2023-10-08T07:07:28.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.633618+0000", 2023-10-08T07:07:28.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0149999999999992e-06 2023-10-08T07:07:28.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.633626+0000", 2023-10-08T07:07:28.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3989999999999998e-06 2023-10-08T07:07:28.658 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.658 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.659 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114758 4.3b 4.1fd270fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.659 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.679929+0000", 2023-10-08T07:07:28.659 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.024024084000000001, 2023-10-08T07:07:28.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.036268934000000003, 2023-10-08T07:07:28.659 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.659 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.659 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.659 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.660 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.660 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114758 2023-10-08T07:07:28.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.660 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.679929+0000", 2023-10-08T07:07:28.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.679929+0000", 2023-10-08T07:07:28.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.679930+0000", 2023-10-08T07:07:28.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7600000000000006e-07 2023-10-08T07:07:28.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.679945+0000", 2023-10-08T07:07:28.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5285999999999999e-05 2023-10-08T07:07:28.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.679955+0000", 2023-10-08T07:07:28.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6730000000000004e-06 2023-10-08T07:07:28.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.679962+0000", 2023-10-08T07:07:28.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4730000000000003e-06 2023-10-08T07:07:28.662 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.663 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.663 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.663 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:114794 4.38 e58/46 4:1e0977c7:::10000000004.00000022:head v 58'1817, mlcod=58'1814)", 2023-10-08T07:07:28.663 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.694350+0000", 2023-10-08T07:07:28.663 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0096034650000000003, 2023-10-08T07:07:28.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021914702000000001, 2023-10-08T07:07:28.663 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.663 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.663 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694350+0000", 2023-10-08T07:07:28.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694350+0000", 2023-10-08T07:07:28.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694350+0000", 2023-10-08T07:07:28.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6800000000000002e-07 2023-10-08T07:07:28.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694362+0000", 2023-10-08T07:07:28.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2201999999999999e-05 2023-10-08T07:07:28.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694368+0000", 2023-10-08T07:07:28.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5509999999999999e-06 2023-10-08T07:07:28.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694372+0000", 2023-10-08T07:07:28.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.296e-06 2023-10-08T07:07:28.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.706052+0000", 2023-10-08T07:07:28.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011679882000000001 2023-10-08T07:07:28.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.706071+0000", 2023-10-08T07:07:28.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9419000000000002e-05 2023-10-08T07:07:28.667 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.667 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.667 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.667 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114829 4.4 4:2158769a:::10000000004.0000002a:head [write 311296~4096 in=4096b,write 327680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.667 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.704329+0000", 2023-10-08T07:07:28.668 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9996243, 2023-10-08T07:07:28.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012018404, 2023-10-08T07:07:28.668 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.668 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.668 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.668 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.668 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.668 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114829 2023-10-08T07:07:28.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.668 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704329+0000", 2023-10-08T07:07:28.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704329+0000", 2023-10-08T07:07:28.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704329+0000", 2023-10-08T07:07:28.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7199999999999998e-07 2023-10-08T07:07:28.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704340+0000", 2023-10-08T07:07:28.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0528e-05 2023-10-08T07:07:28.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704347+0000", 2023-10-08T07:07:28.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8299999999999998e-06 2023-10-08T07:07:28.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704354+0000", 2023-10-08T07:07:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9709999999999998e-06 2023-10-08T07:07:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704396+0000", 2023-10-08T07:07:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1993999999999998e-05 2023-10-08T07:07:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704481+0000", 2023-10-08T07:07:28.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5333000000000004e-05 2023-10-08T07:07:28.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.672 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.672 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112613 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.672 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:26.920784+0000", 2023-10-08T07:07:28.672 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.78316880700000002, 2023-10-08T07:07:28.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.79564402599999995, 2023-10-08T07:07:28.673 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.673 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.673 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112613 2023-10-08T07:07:28.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.673 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.920784+0000", 2023-10-08T07:07:28.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.920784+0000", 2023-10-08T07:07:28.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.920785+0000", 2023-10-08T07:07:28.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7e-07 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.920790+0000", 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4909999999999996e-06 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.920795+0000", 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8520000000000003e-06 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.920798+0000", 2023-10-08T07:07:28.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3699999999999999e-06 2023-10-08T07:07:28.676 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.676 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.676 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.676 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112862 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.676 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.031962+0000", 2023-10-08T07:07:28.676 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67199138599999997, 2023-10-08T07:07:28.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.68452416800000004, 2023-10-08T07:07:28.676 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.677 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.677 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112862 2023-10-08T07:07:28.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.677 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031962+0000", 2023-10-08T07:07:28.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031962+0000", 2023-10-08T07:07:28.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031962+0000", 2023-10-08T07:07:28.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8500000000000001e-07 2023-10-08T07:07:28.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031975+0000", 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2204999999999999e-05 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031985+0000", 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0560999999999999e-05 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.031991+0000", 2023-10-08T07:07:28.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2023-10-08T07:07:28.680 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.680 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.680 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.680 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112901 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.680 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.044486+0000", 2023-10-08T07:07:28.680 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.65946731800000002, 2023-10-08T07:07:28.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.67205989799999999, 2023-10-08T07:07:28.680 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.680 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.680 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.681 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.681 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.681 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112901 2023-10-08T07:07:28.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.681 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.044486+0000", 2023-10-08T07:07:28.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.044486+0000", 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.044486+0000", 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.044503+0000", 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6997999999999999e-05 2023-10-08T07:07:28.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.044512+0000", 2023-10-08T07:07:28.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7600000000000008e-06 2023-10-08T07:07:28.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.044518+0000", 2023-10-08T07:07:28.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1009999999999997e-06 2023-10-08T07:07:28.683 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.683 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.683 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.684 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113475 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.684 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.233109+0000", 2023-10-08T07:07:28.684 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47084450500000002, 2023-10-08T07:07:28.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48349491500000003, 2023-10-08T07:07:28.684 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.684 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.684 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.684 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.684 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.684 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113475 2023-10-08T07:07:28.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.685 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.233109+0000", 2023-10-08T07:07:28.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.233109+0000", 2023-10-08T07:07:28.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.233109+0000", 2023-10-08T07:07:28.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4899999999999995e-07 2023-10-08T07:07:28.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.233127+0000", 2023-10-08T07:07:28.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7246999999999999e-05 2023-10-08T07:07:28.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.233134+0000", 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8350000000000004e-06 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.233138+0000", 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1289999999999998e-06 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.688 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113885 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.688 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.385369+0000", 2023-10-08T07:07:28.688 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.31858455000000002, 2023-10-08T07:07:28.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.33129463999999997, 2023-10-08T07:07:28.688 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.688 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.688 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.688 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.688 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.688 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113885 2023-10-08T07:07:28.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.689 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.385369+0000", 2023-10-08T07:07:28.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.385369+0000", 2023-10-08T07:07:28.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.385369+0000", 2023-10-08T07:07:28.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4300000000000003e-07 2023-10-08T07:07:28.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.385379+0000", 2023-10-08T07:07:28.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0139000000000001e-05 2023-10-08T07:07:28.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.385387+0000", 2023-10-08T07:07:28.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4429999999999997e-06 2023-10-08T07:07:28.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.385393+0000", 2023-10-08T07:07:28.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2023-10-08T07:07:28.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.691 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.692 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114284 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.692 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.517553+0000", 2023-10-08T07:07:28.692 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18640061699999999, 2023-10-08T07:07:28.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19917006600000001, 2023-10-08T07:07:28.692 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.692 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.692 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114284 2023-10-08T07:07:28.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.693 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.517553+0000", 2023-10-08T07:07:28.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.517553+0000", 2023-10-08T07:07:28.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.517553+0000", 2023-10-08T07:07:28.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2999999999999999e-07 2023-10-08T07:07:28.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.517567+0000", 2023-10-08T07:07:28.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.327e-05 2023-10-08T07:07:28.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.517579+0000", 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2546e-05 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.517586+0000", 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.844e-06 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114719 4.f 4:f2537947:::10000000004.00000017:head [write 2424832~4096 in=4096b,write 2449408~4096 in=4096b,write 2695168~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.695 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.667181+0000", 2023-10-08T07:07:28.696 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.036771922999999998, 2023-10-08T07:07:28.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049607760000000001, 2023-10-08T07:07:28.696 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.696 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.696 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.696 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.696 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.696 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114719 2023-10-08T07:07:28.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.696 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.667181+0000", 2023-10-08T07:07:28.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.667181+0000", 2023-10-08T07:07:28.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.667182+0000", 2023-10-08T07:07:28.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7199999999999999e-07 2023-10-08T07:07:28.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.667193+0000", 2023-10-08T07:07:28.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1268e-05 2023-10-08T07:07:28.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.667201+0000", 2023-10-08T07:07:28.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9119999999999998e-06 2023-10-08T07:07:28.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.667208+0000", 2023-10-08T07:07:28.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0770000000000002e-06 2023-10-08T07:07:28.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.689794+0000", 2023-10-08T07:07:28.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022586337000000001 2023-10-08T07:07:28.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.689885+0000", 2023-10-08T07:07:28.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0752000000000001e-05 2023-10-08T07:07:28.700 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.700 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.700 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.700 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114759 4.2f 4:f790ef75:::10000000004.00000038:head [write 1830912~4096 in=4096b,write 1851392~4096 in=4096b,write 1867776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.700 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.679977+0000", 2023-10-08T07:07:28.700 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.023976007000000001, 2023-10-08T07:07:28.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.036888043000000002, 2023-10-08T07:07:28.701 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.701 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.701 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114759 2023-10-08T07:07:28.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.701 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.679977+0000", 2023-10-08T07:07:28.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.679977+0000", 2023-10-08T07:07:28.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.679978+0000", 2023-10-08T07:07:28.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8100000000000003e-07 2023-10-08T07:07:28.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.679988+0000", 2023-10-08T07:07:28.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0618000000000001e-05 2023-10-08T07:07:28.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.679994+0000", 2023-10-08T07:07:28.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.105e-06 2023-10-08T07:07:28.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.680000+0000", 2023-10-08T07:07:28.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5389999999999998e-06 2023-10-08T07:07:28.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.693050+0000", 2023-10-08T07:07:28.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013050315999999999 2023-10-08T07:07:28.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.693136+0000", 2023-10-08T07:07:28.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5513000000000006e-05 2023-10-08T07:07:28.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.705 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.705 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114830 4.31 4:8de29a03:::10000000004.00000001:head [write 212992~8192 in=8192b,write 262144~4096 in=4096b,write 364544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.705 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.704369+0000", 2023-10-08T07:07:28.705 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9995837, 2023-10-08T07:07:28.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012575599999999999, 2023-10-08T07:07:28.706 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.706 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:28.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.706 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114830 2023-10-08T07:07:28.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.706 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704369+0000", 2023-10-08T07:07:28.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704369+0000", 2023-10-08T07:07:28.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704370+0000", 2023-10-08T07:07:28.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0699999999999997e-07 2023-10-08T07:07:28.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704382+0000", 2023-10-08T07:07:28.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2330999999999999e-05 2023-10-08T07:07:28.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704391+0000", 2023-10-08T07:07:28.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9029999999999993e-06 2023-10-08T07:07:28.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.704397+0000", 2023-10-08T07:07:28.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6890000000000001e-06 2023-10-08T07:07:28.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.715681+0000", 2023-10-08T07:07:28.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011284551 2023-10-08T07:07:28.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.715759+0000", 2023-10-08T07:07:28.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7936999999999996e-05 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.715910+0000", 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150276 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113357 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.194530+0000", 2023-10-08T07:07:28.710 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.50942263600000004, 2023-10-08T07:07:28.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.52249460299999995, 2023-10-08T07:07:28.711 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.711 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.711 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113357 2023-10-08T07:07:28.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.711 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.194530+0000", 2023-10-08T07:07:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.194530+0000", 2023-10-08T07:07:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.194531+0000", 2023-10-08T07:07:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.16e-07 2023-10-08T07:07:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.196560+0000", 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020289829999999998 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.196571+0000", 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0513000000000001e-05 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.196579+0000", 2023-10-08T07:07:28.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.627e-06 2023-10-08T07:07:28.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.714 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.714 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114349 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.714 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.539920+0000", 2023-10-08T07:07:28.714 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.164033029, 2023-10-08T07:07:28.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17716781400000001, 2023-10-08T07:07:28.714 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.714 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.715 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114349 2023-10-08T07:07:28.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.715 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.539920+0000", 2023-10-08T07:07:28.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.539920+0000", 2023-10-08T07:07:28.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.539920+0000", 2023-10-08T07:07:28.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2499999999999999e-07 2023-10-08T07:07:28.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.539928+0000", 2023-10-08T07:07:28.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.374e-06 2023-10-08T07:07:28.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.539931+0000", 2023-10-08T07:07:28.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.676e-06 2023-10-08T07:07:28.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.539934+0000", 2023-10-08T07:07:28.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.841e-06 2023-10-08T07:07:28.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.718 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.718 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114760 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.718 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.680034+0000", 2023-10-08T07:07:28.718 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.023919227000000001, 2023-10-08T07:07:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037105713999999998, 2023-10-08T07:07:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114760 2023-10-08T07:07:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.680034+0000", 2023-10-08T07:07:28.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.680034+0000", 2023-10-08T07:07:28.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.680034+0000", 2023-10-08T07:07:28.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7599999999999997e-07 2023-10-08T07:07:28.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.680043+0000", 2023-10-08T07:07:28.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2430000000000005e-06 2023-10-08T07:07:28.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.680050+0000", 2023-10-08T07:07:28.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9439999999999999e-06 2023-10-08T07:07:28.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.680056+0000", 2023-10-08T07:07:28.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5660000000000003e-06 2023-10-08T07:07:28.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.722 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.722 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114796 4.19 4:9a1dab10:::10000000004.0000001d:head [write 1359872~4096 in=4096b,write 1609728~4096 in=4096b,write 1798144~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.722 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.694453+0000", 2023-10-08T07:07:28.722 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0094997889999999998, 2023-10-08T07:07:28.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022746885000000001, 2023-10-08T07:07:28.722 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.723 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.723 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114796 2023-10-08T07:07:28.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.723 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694453+0000", 2023-10-08T07:07:28.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694453+0000", 2023-10-08T07:07:28.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694454+0000", 2023-10-08T07:07:28.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3099999999999996e-07 2023-10-08T07:07:28.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694465+0000", 2023-10-08T07:07:28.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1311999999999999e-05 2023-10-08T07:07:28.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694474+0000", 2023-10-08T07:07:28.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4379999999999995e-06 2023-10-08T07:07:28.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694481+0000", 2023-10-08T07:07:28.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5869999999999998e-06 2023-10-08T07:07:28.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697110+0000", 2023-10-08T07:07:28.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026291610000000001 2023-10-08T07:07:28.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.697194+0000", 2023-10-08T07:07:28.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4666999999999994e-05 2023-10-08T07:07:28.727 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.727 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.727 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.727 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114832 4.15 4:aaa619cf:::10000000004.00000004:head [write 4071424~4096 in=4096b,write 4100096~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.727 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.705006+0000", 2023-10-08T07:07:28.727 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9989476, 2023-10-08T07:07:28.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012256529, 2023-10-08T07:07:28.727 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.728 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.728 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114832 2023-10-08T07:07:28.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.728 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705006+0000", 2023-10-08T07:07:28.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705006+0000", 2023-10-08T07:07:28.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705006+0000", 2023-10-08T07:07:28.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6899999999999996e-07 2023-10-08T07:07:28.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705016+0000", 2023-10-08T07:07:28.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5389999999999996e-06 2023-10-08T07:07:28.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705026+0000", 2023-10-08T07:07:28.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9480000000000003e-06 2023-10-08T07:07:28.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705034+0000", 2023-10-08T07:07:28.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2989999999999997e-06 2023-10-08T07:07:28.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705729+0000", 2023-10-08T07:07:28.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00069477899999999997 2023-10-08T07:07:28.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.705811+0000", 2023-10-08T07:07:28.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1967999999999999e-05 2023-10-08T07:07:28.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.731 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.732 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.732 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:112697 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.732 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:26.949258+0000", 2023-10-08T07:07:28.732 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.75469480200000005, 2023-10-08T07:07:28.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.76806696600000002, 2023-10-08T07:07:28.732 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.732 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.732 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.732 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.732 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.733 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112697 2023-10-08T07:07:28.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.733 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.949258+0000", 2023-10-08T07:07:28.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.949258+0000", 2023-10-08T07:07:28.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.949259+0000", 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9599999999999998e-07 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.949273+0000", 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3841e-05 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.949282+0000", 2023-10-08T07:07:28.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6109999999999994e-06 2023-10-08T07:07:28.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:26.949294+0000", 2023-10-08T07:07:28.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2763e-05 2023-10-08T07:07:28.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.735 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.736 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113192 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.736 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.141080+0000", 2023-10-08T07:07:28.736 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.56287363000000001, 2023-10-08T07:07:28.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.57628977000000003, 2023-10-08T07:07:28.736 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.736 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.736 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.736 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.736 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.736 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113192 2023-10-08T07:07:28.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.736 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.141080+0000", 2023-10-08T07:07:28.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.141080+0000", 2023-10-08T07:07:28.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.141080+0000", 2023-10-08T07:07:28.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4799999999999997e-07 2023-10-08T07:07:28.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.141089+0000", 2023-10-08T07:07:28.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6039999999999993e-06 2023-10-08T07:07:28.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.141101+0000", 2023-10-08T07:07:28.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1691999999999999e-05 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.141111+0000", 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0658e-05 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113337 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.187766+0000", 2023-10-08T07:07:28.739 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51618741199999996, 2023-10-08T07:07:28.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.52965000900000003, 2023-10-08T07:07:28.740 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.740 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.740 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.740 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.740 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.740 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113337 2023-10-08T07:07:28.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.740 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.187766+0000", 2023-10-08T07:07:28.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.187766+0000", 2023-10-08T07:07:28.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.187766+0000", 2023-10-08T07:07:28.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1299999999999999e-07 2023-10-08T07:07:28.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.187779+0000", 2023-10-08T07:07:28.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2177999999999999e-05 2023-10-08T07:07:28.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.187788+0000", 2023-10-08T07:07:28.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0159999999999997e-06 2023-10-08T07:07:28.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.187793+0000", 2023-10-08T07:07:28.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4949999999999999e-06 2023-10-08T07:07:28.745 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.745 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.746 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.746 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113856 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.746 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.373638+0000", 2023-10-08T07:07:28.746 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.33031488399999998, 2023-10-08T07:07:28.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.34382591099999998, 2023-10-08T07:07:28.746 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.746 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.746 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.746 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.747 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.747 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113856 2023-10-08T07:07:28.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.747 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.373638+0000", 2023-10-08T07:07:28.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.373638+0000", 2023-10-08T07:07:28.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.373639+0000", 2023-10-08T07:07:28.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0589999999999999e-06 2023-10-08T07:07:28.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.373652+0000", 2023-10-08T07:07:28.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2959000000000001e-05 2023-10-08T07:07:28.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.373663+0000", 2023-10-08T07:07:28.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0325e-05 2023-10-08T07:07:28.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.373670+0000", 2023-10-08T07:07:28.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2309999999999999e-06 2023-10-08T07:07:28.749 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.750 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.750 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.750 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113888 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.750 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.385434+0000", 2023-10-08T07:07:28.750 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.318519161, 2023-10-08T07:07:28.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.33208931699999999, 2023-10-08T07:07:28.750 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.750 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.750 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.750 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.751 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.751 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113888 2023-10-08T07:07:28.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.751 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.385434+0000", 2023-10-08T07:07:28.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.385434+0000", 2023-10-08T07:07:28.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.385434+0000", 2023-10-08T07:07:28.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2023-10-08T07:07:28.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.385444+0000", 2023-10-08T07:07:28.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2019999999999993e-06 2023-10-08T07:07:28.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.385450+0000", 2023-10-08T07:07:28.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3980000000000004e-06 2023-10-08T07:07:28.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.385456+0000", 2023-10-08T07:07:28.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7649999999999999e-06 2023-10-08T07:07:28.753 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.753 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.753 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.754 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114068 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.754 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.445000+0000", 2023-10-08T07:07:28.754 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.258953341, 2023-10-08T07:07:28.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27258175800000001, 2023-10-08T07:07:28.754 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.754 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.754 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.754 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.754 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.755 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114068 2023-10-08T07:07:28.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.755 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.445000+0000", 2023-10-08T07:07:28.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.445000+0000", 2023-10-08T07:07:28.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.445001+0000", 2023-10-08T07:07:28.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0419999999999999e-06 2023-10-08T07:07:28.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.445014+0000", 2023-10-08T07:07:28.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2727e-05 2023-10-08T07:07:28.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.445024+0000", 2023-10-08T07:07:28.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0744000000000001e-05 2023-10-08T07:07:28.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.445031+0000", 2023-10-08T07:07:28.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1160000000000001e-06 2023-10-08T07:07:28.757 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.757 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.758 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.758 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114110 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.758 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.459630+0000", 2023-10-08T07:07:28.758 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.24432300700000001, 2023-10-08T07:07:28.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.25801094600000002, 2023-10-08T07:07:28.758 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.758 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.758 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.758 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.758 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.759 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114110 2023-10-08T07:07:28.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.759 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.459630+0000", 2023-10-08T07:07:28.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.459630+0000", 2023-10-08T07:07:28.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.459631+0000", 2023-10-08T07:07:28.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8000000000000005e-07 2023-10-08T07:07:28.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.459642+0000", 2023-10-08T07:07:28.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0661e-05 2023-10-08T07:07:28.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.459652+0000", 2023-10-08T07:07:28.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0597999999999999e-05 2023-10-08T07:07:28.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.459659+0000", 2023-10-08T07:07:28.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.063e-06 2023-10-08T07:07:28.762 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.762 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.762 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.762 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114797 4.14 4:2b72a8af:::10000000004.0000000c:head [write 962560~4096 in=4096b,write 1142784~4096 in=4096b,write 1216512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.762 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.694492+0000", 2023-10-08T07:07:28.762 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0094614079999999993, 2023-10-08T07:07:28.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023228661000000001, 2023-10-08T07:07:28.762 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.762 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.763 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.763 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.763 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.763 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114797 2023-10-08T07:07:28.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.763 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694492+0000", 2023-10-08T07:07:28.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694492+0000", 2023-10-08T07:07:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694492+0000", 2023-10-08T07:07:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8299999999999997e-07 2023-10-08T07:07:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694502+0000", 2023-10-08T07:07:28.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0158e-05 2023-10-08T07:07:28.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694509+0000", 2023-10-08T07:07:28.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6769999999999998e-06 2023-10-08T07:07:28.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694514+0000", 2023-10-08T07:07:28.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7520000000000004e-06 2023-10-08T07:07:28.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694643+0000", 2023-10-08T07:07:28.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012891700000000001 2023-10-08T07:07:28.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694715+0000", 2023-10-08T07:07:28.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2176999999999997e-05 2023-10-08T07:07:28.766 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.766 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.767 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.767 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113023 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.767 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.084599+0000", 2023-10-08T07:07:28.767 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61935382699999997, 2023-10-08T07:07:28.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.63319892099999997, 2023-10-08T07:07:28.767 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.767 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.768 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113023 2023-10-08T07:07:28.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.768 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.084599+0000", 2023-10-08T07:07:28.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.084599+0000", 2023-10-08T07:07:28.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.084600+0000", 2023-10-08T07:07:28.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3600000000000002e-07 2023-10-08T07:07:28.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.084612+0000", 2023-10-08T07:07:28.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1703e-05 2023-10-08T07:07:28.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.084663+0000", 2023-10-08T07:07:28.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0742999999999999e-05 2023-10-08T07:07:28.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.084670+0000", 2023-10-08T07:07:28.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3900000000000004e-06 2023-10-08T07:07:28.770 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.771 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.771 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.771 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:113431 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:28.771 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.220514+0000", 2023-10-08T07:07:28.771 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48343908099999999, 2023-10-08T07:07:28.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.497350034, 2023-10-08T07:07:28.771 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.771 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.771 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.771 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.772 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.772 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 113431 2023-10-08T07:07:28.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.772 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.220514+0000", 2023-10-08T07:07:28.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.220514+0000", 2023-10-08T07:07:28.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.220515+0000", 2023-10-08T07:07:28.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.158e-06 2023-10-08T07:07:28.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.220528+0000", 2023-10-08T07:07:28.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3009e-05 2023-10-08T07:07:28.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.220539+0000", 2023-10-08T07:07:28.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0866999999999999e-05 2023-10-08T07:07:28.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.220547+0000", 2023-10-08T07:07:28.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2509999999999994e-06 2023-10-08T07:07:28.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.775 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.775 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114288 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.775 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.518978+0000", 2023-10-08T07:07:28.775 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.184975369, 2023-10-08T07:07:28.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.198960212, 2023-10-08T07:07:28.775 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.776 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:28.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.776 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114288 2023-10-08T07:07:28.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.776 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.518978+0000", 2023-10-08T07:07:28.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.518978+0000", 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.518979+0000", 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6499999999999998e-07 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.518999+0000", 2023-10-08T07:07:28.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.012e-05 2023-10-08T07:07:28.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.519008+0000", 2023-10-08T07:07:28.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.815e-06 2023-10-08T07:07:28.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.519024+0000", 2023-10-08T07:07:28.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5150000000000001e-05 2023-10-08T07:07:28.779 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.779 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.779 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.779 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:114798 4.3e 4:7cb83261:::10000000004.0000003b:head [write 2531328~4096 in=4096b,write 2662400~4096 in=4096b,write 2871296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2023-10-08T07:07:28.779 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:27.694526+0000", 2023-10-08T07:07:28.779 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0094274460000000008, 2023-10-08T07:07:28.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023482221000000001, 2023-10-08T07:07:28.779 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:28.779 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:28.779 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 114798 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694526+0000", 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:28.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694526+0000", 2023-10-08T07:07:28.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:28.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:28.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694526+0000", 2023-10-08T07:07:28.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2499999999999995e-07 2023-10-08T07:07:28.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:28.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694535+0000", 2023-10-08T07:07:28.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2839999999999995e-06 2023-10-08T07:07:28.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:28.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694542+0000", 2023-10-08T07:07:28.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2759999999999997e-06 2023-10-08T07:07:28.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:28.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.694546+0000", 2023-10-08T07:07:28.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4100000000000001e-06 2023-10-08T07:07:28.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:28.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696059+0000", 2023-10-08T07:07:28.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00151307 2023-10-08T07:07:28.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:28.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.696162+0000", 2023-10-08T07:07:28.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102829 2023-10-08T07:07:28.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:28.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:28.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:28.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:27.718002+0000", 2023-10-08T07:07:28.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021840396000000002 2023-10-08T07:07:28.784 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.784 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:28.784 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.784 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:28.784 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:28.784 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 243 2023-10-08T07:07:28.784 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:28.785 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:28.787 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:28.788 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:28.785+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:28.887 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:28.887+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:28.961 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:28.989 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:28.991 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:28.992 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:28.992 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:28.992 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:28.992 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:28.992 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:28.991+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:28.993 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:28.994 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:28.999 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:29.091 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:29.089+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:29.190 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:29.189+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:29.240 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:29.240 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:29.255 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:29.299 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T07:07:29.301 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:29.300+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:29.393 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:29.392+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:29.455 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:29.455 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:29.469 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:29.511 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:29.510+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:29.595 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:29.594+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:29.697 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:29.696+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:29.717 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:29.717 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:29.733 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:29.797 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:29.796+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:29.899 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:29.898+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:29.944 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:29.944 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:29.958 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:30.005 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:30.004+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:30.100 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:30.099+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:30.181 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:30.182 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:30.188 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:30.229 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:30.229+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2023-10-08T07:07:30.301 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:30.301+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:30.402 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:30.401+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:30.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:30.421 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:30.435 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:30.504 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:30.503+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:30.609 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:30.608+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:30.647 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:30.647 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:30.661 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:30.706 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:30.705+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:30.807 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:30.806+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:30.883 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:30.883 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:30.889 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:30.908 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:30.907+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:30.995 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:07:31.009 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:31.008+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:31.111 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:31.110+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:31.131 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:31.131 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:31.146 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:31.179 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:31.206 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:31.206 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:07:31.206 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:31.206 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:07:31.209 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:31.209 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:31.211 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:31.210+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:31.313 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:31.311+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:31.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2023-10-08T07:07:31.387 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:31.387 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:31.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:31.387 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:31.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.388 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:109757 4.20 4:05b3915c:::10000000004.00000016:head [write 1871872~4096,write 1912832~4096,write 1957888~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.388 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:25.931082+0000", 2023-10-08T07:07:31.388 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.453187894, 2023-10-08T07:07:31.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.111877037, 2023-10-08T07:07:31.388 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.388 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.388 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.388 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.388 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.388 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 109757 2023-10-08T07:07:31.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.388 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931082+0000", 2023-10-08T07:07:31.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931082+0000", 2023-10-08T07:07:31.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931083+0000", 2023-10-08T07:07:31.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4700000000000001e-07 2023-10-08T07:07:31.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931096+0000", 2023-10-08T07:07:31.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3352e-05 2023-10-08T07:07:31.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931104+0000", 2023-10-08T07:07:31.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9440000000000005e-06 2023-10-08T07:07:31.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931111+0000", 2023-10-08T07:07:31.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2319999999999998e-06 2023-10-08T07:07:31.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.977984+0000", 2023-10-08T07:07:31.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046873785000000001 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.978037+0000", 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2984e-05 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.978133+0000", 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5446999999999996e-05 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.006001+0000", 2023-10-08T07:07:31.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027867861000000001 2023-10-08T07:07:31.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.042882+0000", 2023-10-08T07:07:31.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.036881377 2023-10-08T07:07:31.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.042920+0000", 2023-10-08T07:07:31.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8155999999999999e-05 2023-10-08T07:07:31.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.042960+0000", 2023-10-08T07:07:31.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9351999999999999e-05 2023-10-08T07:07:31.394 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.394 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.394 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.394 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:109768 4.20 4:04004f2c:::10000000004.0000000d:head [write 598016~4096,write 618496~4096,write 983040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.395 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:25.931321+0000", 2023-10-08T07:07:31.395 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.4529492409999998, 2023-10-08T07:07:31.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.111790031, 2023-10-08T07:07:31.395 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.395 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.395 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.395 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.395 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.395 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 109768 2023-10-08T07:07:31.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.395 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931321+0000", 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931321+0000", 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931322+0000", 2023-10-08T07:07:31.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8200000000000001e-07 2023-10-08T07:07:31.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931335+0000", 2023-10-08T07:07:31.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.309e-05 2023-10-08T07:07:31.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931342+0000", 2023-10-08T07:07:31.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9800000000000001e-06 2023-10-08T07:07:31.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931347+0000", 2023-10-08T07:07:31.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8889999999999999e-06 2023-10-08T07:07:31.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.980798+0000", 2023-10-08T07:07:31.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049450539000000002 2023-10-08T07:07:31.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.980872+0000", 2023-10-08T07:07:31.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4203999999999996e-05 2023-10-08T07:07:31.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.981017+0000", 2023-10-08T07:07:31.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014521299999999999 2023-10-08T07:07:31.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.006008+0000", 2023-10-08T07:07:31.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024990104999999999 2023-10-08T07:07:31.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.400 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.400 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.043053+0000", 2023-10-08T07:07:31.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037045217999999998 2023-10-08T07:07:31.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.400 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.400 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.043089+0000", 2023-10-08T07:07:31.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6405000000000001e-05 2023-10-08T07:07:31.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.043111+0000", 2023-10-08T07:07:31.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2005999999999999e-05 2023-10-08T07:07:31.401 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.401 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.401 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.401 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:109791 4.20 4:04004f2c:::10000000004.0000000d:head [write 208896~8192,write 348160~4096,write 544768~4096,write 569344~4096,write 1052672~4096,write 1122304~4096,write 1261568~8192,write 1351680~4096,write 1540096~4096,write 1585152~4096,write 1736704~4096,write 1880064~4096,write 1916928~4096,write 2625536~4096,write 2662400~8192,write 2736128~4096,write 2904064~4096,write 2994176~4096,write 3121152~4096,write 3194880~4096,write 3203072~4096,write 3211264~4096,write 3473408~4096,write 3493888~4096,write 3670016~4096,write 3751936~4096,write 3842048~4096,write 3895296~4096,write 4034560~4096,write 4042752~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.401 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:25.931619+0000", 2023-10-08T07:07:31.401 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.4526512069999997, 2023-10-08T07:07:31.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.121958767, 2023-10-08T07:07:31.402 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.402 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.402 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.402 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.402 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.402 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 109791 2023-10-08T07:07:31.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.402 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931619+0000", 2023-10-08T07:07:31.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931619+0000", 2023-10-08T07:07:31.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931620+0000", 2023-10-08T07:07:31.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9399999999999995e-07 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931711+0000", 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0838e-05 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931720+0000", 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.397e-06 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931727+0000", 2023-10-08T07:07:31.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9530000000000002e-06 2023-10-08T07:07:31.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.990307+0000", 2023-10-08T07:07:31.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058580225 2023-10-08T07:07:31.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.990420+0000", 2023-10-08T07:07:31.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000113338 2023-10-08T07:07:31.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.990988+0000", 2023-10-08T07:07:31.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00056734999999999999 2023-10-08T07:07:31.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.006171+0000", 2023-10-08T07:07:31.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015183202 2023-10-08T07:07:31.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.053454+0000", 2023-10-08T07:07:31.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047282892999999999 2023-10-08T07:07:31.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.053539+0000", 2023-10-08T07:07:31.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5048000000000003e-05 2023-10-08T07:07:31.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.053578+0000", 2023-10-08T07:07:31.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9029000000000002e-05 2023-10-08T07:07:31.408 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.408 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.408 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.408 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110410 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 557056~4096,write 634880~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.408 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.151249+0000", 2023-10-08T07:07:31.409 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2330217220000002, 2023-10-08T07:07:31.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12446716100000001, 2023-10-08T07:07:31.409 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.409 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.409 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.409 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.409 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.409 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110410 2023-10-08T07:07:31.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.409 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151249+0000", 2023-10-08T07:07:31.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151249+0000", 2023-10-08T07:07:31.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151250+0000", 2023-10-08T07:07:31.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4e-07 2023-10-08T07:07:31.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151276+0000", 2023-10-08T07:07:31.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6818999999999999e-05 2023-10-08T07:07:31.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151287+0000", 2023-10-08T07:07:31.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0835e-05 2023-10-08T07:07:31.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151295+0000", 2023-10-08T07:07:31.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3529999999999997e-06 2023-10-08T07:07:31.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.164846+0000", 2023-10-08T07:07:31.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013551917 2023-10-08T07:07:31.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.164902+0000", 2023-10-08T07:07:31.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5736999999999998e-05 2023-10-08T07:07:31.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.164995+0000", 2023-10-08T07:07:31.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2942000000000006e-05 2023-10-08T07:07:31.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.173868+0000", 2023-10-08T07:07:31.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0088733379999999997 2023-10-08T07:07:31.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275615+0000", 2023-10-08T07:07:31.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.101746446 2023-10-08T07:07:31.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275677+0000", 2023-10-08T07:07:31.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1739e-05 2023-10-08T07:07:31.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275716+0000", 2023-10-08T07:07:31.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9195e-05 2023-10-08T07:07:31.415 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.415 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.415 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.416 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110411 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2457600~4096,write 3194880~4096,write 3284992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.416 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.151498+0000", 2023-10-08T07:07:31.416 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2327723170000002, 2023-10-08T07:07:31.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.124347257, 2023-10-08T07:07:31.416 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.416 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.416 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.416 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.416 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.416 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110411 2023-10-08T07:07:31.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.416 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151498+0000", 2023-10-08T07:07:31.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151498+0000", 2023-10-08T07:07:31.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151499+0000", 2023-10-08T07:07:31.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7000000000000004e-07 2023-10-08T07:07:31.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151530+0000", 2023-10-08T07:07:31.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1637999999999998e-05 2023-10-08T07:07:31.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151539+0000", 2023-10-08T07:07:31.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.952e-06 2023-10-08T07:07:31.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151546+0000", 2023-10-08T07:07:31.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2480000000000001e-06 2023-10-08T07:07:31.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.166753+0000", 2023-10-08T07:07:31.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015207165 2023-10-08T07:07:31.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.166804+0000", 2023-10-08T07:07:31.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0936999999999997e-05 2023-10-08T07:07:31.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.166901+0000", 2023-10-08T07:07:31.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7418999999999997e-05 2023-10-08T07:07:31.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178556+0000", 2023-10-08T07:07:31.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011654464 2023-10-08T07:07:31.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275764+0000", 2023-10-08T07:07:31.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.097208469000000006 2023-10-08T07:07:31.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275801+0000", 2023-10-08T07:07:31.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6715999999999999e-05 2023-10-08T07:07:31.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275845+0000", 2023-10-08T07:07:31.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4579000000000001e-05 2023-10-08T07:07:31.425 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.425 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.425 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.425 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110422 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 774144~4096,write 880640~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.425 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:31.425 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2292828790000003, 2023-10-08T07:07:31.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12745208799999999, 2023-10-08T07:07:31.426 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.426 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.426 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.426 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.426 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.426 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110422 2023-10-08T07:07:31.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.426 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:31.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:31.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:31.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7399999999999998e-07 2023-10-08T07:07:31.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.155045+0000", 2023-10-08T07:07:31.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6687000000000001e-05 2023-10-08T07:07:31.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.155053+0000", 2023-10-08T07:07:31.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5569999999999996e-06 2023-10-08T07:07:31.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.155060+0000", 2023-10-08T07:07:31.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9090000000000003e-06 2023-10-08T07:07:31.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.168971+0000", 2023-10-08T07:07:31.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013910782999999999 2023-10-08T07:07:31.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169054+0000", 2023-10-08T07:07:31.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3051000000000002e-05 2023-10-08T07:07:31.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169194+0000", 2023-10-08T07:07:31.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013997799999999999 2023-10-08T07:07:31.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178725+0000", 2023-10-08T07:07:31.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0095310480000000003 2023-10-08T07:07:31.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282382+0000", 2023-10-08T07:07:31.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10365708 2023-10-08T07:07:31.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282416+0000", 2023-10-08T07:07:31.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4258999999999998e-05 2023-10-08T07:07:31.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282440+0000", 2023-10-08T07:07:31.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3261999999999999e-05 2023-10-08T07:07:31.432 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.432 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.432 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.432 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110428 4.a 4:524fba76:::10000000004.0000001b:head [write 1576960~4096,write 1830912~4096,write 1847296~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.432 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.156743+0000", 2023-10-08T07:07:31.433 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2275272959999999, 2023-10-08T07:07:31.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.1191084, 2023-10-08T07:07:31.433 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.433 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.433 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.433 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.433 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.433 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110428 2023-10-08T07:07:31.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.433 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156743+0000", 2023-10-08T07:07:31.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156743+0000", 2023-10-08T07:07:31.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156744+0000", 2023-10-08T07:07:31.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5499999999999997e-07 2023-10-08T07:07:31.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156818+0000", 2023-10-08T07:07:31.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3955999999999995e-05 2023-10-08T07:07:31.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156829+0000", 2023-10-08T07:07:31.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1482e-05 2023-10-08T07:07:31.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156837+0000", 2023-10-08T07:07:31.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8159999999999994e-06 2023-10-08T07:07:31.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.168957+0000", 2023-10-08T07:07:31.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012120077 2023-10-08T07:07:31.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169037+0000", 2023-10-08T07:07:31.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9730999999999999e-05 2023-10-08T07:07:31.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169172+0000", 2023-10-08T07:07:31.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013486999999999999 2023-10-08T07:07:31.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178565+0000", 2023-10-08T07:07:31.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0093934910000000003 2023-10-08T07:07:31.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275762+0000", 2023-10-08T07:07:31.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.097196649999999996 2023-10-08T07:07:31.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275811+0000", 2023-10-08T07:07:31.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9351999999999998e-05 2023-10-08T07:07:31.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275851+0000", 2023-10-08T07:07:31.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0120000000000002e-05 2023-10-08T07:07:31.439 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.439 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.439 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.439 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110434 4.a 4:524fba76:::10000000004.0000001b:head [write 3473408~4096,write 3694592~4096,write 3710976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.439 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.159018+0000", 2023-10-08T07:07:31.440 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2252522470000002, 2023-10-08T07:07:31.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11695425800000001, 2023-10-08T07:07:31.440 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.440 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.440 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.440 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.440 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.440 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110434 2023-10-08T07:07:31.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.440 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159018+0000", 2023-10-08T07:07:31.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159018+0000", 2023-10-08T07:07:31.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159019+0000", 2023-10-08T07:07:31.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:07:31.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.442 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159032+0000", 2023-10-08T07:07:31.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2672e-05 2023-10-08T07:07:31.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159042+0000", 2023-10-08T07:07:31.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0882e-05 2023-10-08T07:07:31.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159050+0000", 2023-10-08T07:07:31.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9889999999999992e-06 2023-10-08T07:07:31.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170445+0000", 2023-10-08T07:07:31.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011394826 2023-10-08T07:07:31.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170503+0000", 2023-10-08T07:07:31.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7574999999999997e-05 2023-10-08T07:07:31.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170619+0000", 2023-10-08T07:07:31.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011575599999999999 2023-10-08T07:07:31.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178729+0000", 2023-10-08T07:07:31.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0081105169999999994 2023-10-08T07:07:31.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275886+0000", 2023-10-08T07:07:31.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.097157073999999996 2023-10-08T07:07:31.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275936+0000", 2023-10-08T07:07:31.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9651000000000003e-05 2023-10-08T07:07:31.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275972+0000", 2023-10-08T07:07:31.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6507999999999997e-05 2023-10-08T07:07:31.446 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.446 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.446 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.447 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110441 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2404352~8192,write 2510848~4096,write 2584576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.447 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.161045+0000", 2023-10-08T07:07:31.447 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2232253670000004, 2023-10-08T07:07:31.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12159005000000001, 2023-10-08T07:07:31.447 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.447 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.447 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.447 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.447 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.447 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110441 2023-10-08T07:07:31.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.448 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161045+0000", 2023-10-08T07:07:31.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161045+0000", 2023-10-08T07:07:31.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161046+0000", 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.139e-06 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161059+0000", 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2616000000000001e-05 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161069+0000", 2023-10-08T07:07:31.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9680000000000001e-06 2023-10-08T07:07:31.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161077+0000", 2023-10-08T07:07:31.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8310000000000001e-06 2023-10-08T07:07:31.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.171413+0000", 2023-10-08T07:07:31.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010336675 2023-10-08T07:07:31.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.171509+0000", 2023-10-08T07:07:31.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5352000000000005e-05 2023-10-08T07:07:31.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.171664+0000", 2023-10-08T07:07:31.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015575699999999999 2023-10-08T07:07:31.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179024+0000", 2023-10-08T07:07:31.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.007359768 2023-10-08T07:07:31.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282494+0000", 2023-10-08T07:07:31.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10346983899999999 2023-10-08T07:07:31.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282582+0000", 2023-10-08T07:07:31.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7650000000000003e-05 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282635+0000", 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3455000000000002e-05 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110460 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 385024~4096,write 438272~4096,write 446464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.167805+0000", 2023-10-08T07:07:31.453 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2164651309999996, 2023-10-08T07:07:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.114918704, 2023-10-08T07:07:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110460 2023-10-08T07:07:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167805+0000", 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167805+0000", 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167806+0000", 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6799999999999999e-07 2023-10-08T07:07:31.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167819+0000", 2023-10-08T07:07:31.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.277e-05 2023-10-08T07:07:31.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167831+0000", 2023-10-08T07:07:31.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2009e-05 2023-10-08T07:07:31.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167839+0000", 2023-10-08T07:07:31.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1790000000000008e-06 2023-10-08T07:07:31.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.173901+0000", 2023-10-08T07:07:31.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.006061533 2023-10-08T07:07:31.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.173999+0000", 2023-10-08T07:07:31.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8651000000000001e-05 2023-10-08T07:07:31.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.174160+0000", 2023-10-08T07:07:31.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000161211 2023-10-08T07:07:31.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191238+0000", 2023-10-08T07:07:31.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017077877000000002 2023-10-08T07:07:31.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282672+0000", 2023-10-08T07:07:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.091434122000000007 2023-10-08T07:07:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282704+0000", 2023-10-08T07:07:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1863000000000003e-05 2023-10-08T07:07:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282724+0000", 2023-10-08T07:07:31.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9621000000000001e-05 2023-10-08T07:07:31.460 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.460 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.460 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.460 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110467 4.1a 4:5a59f83a:::10000000004.00000002:head [write 1171456~4096,write 1269760~4096,write 1388544~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.460 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.170266+0000", 2023-10-08T07:07:31.460 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2140042180000004, 2023-10-08T07:07:31.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.124576939, 2023-10-08T07:07:31.460 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.461 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.461 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.461 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.461 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.461 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110467 2023-10-08T07:07:31.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.461 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170266+0000", 2023-10-08T07:07:31.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.462 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170266+0000", 2023-10-08T07:07:31.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.462 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170267+0000", 2023-10-08T07:07:31.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2799999999999996e-07 2023-10-08T07:07:31.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170277+0000", 2023-10-08T07:07:31.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0705e-05 2023-10-08T07:07:31.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170286+0000", 2023-10-08T07:07:31.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3459999999999994e-06 2023-10-08T07:07:31.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170291+0000", 2023-10-08T07:07:31.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4720000000000003e-06 2023-10-08T07:07:31.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179164+0000", 2023-10-08T07:07:31.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0088732729999999992 2023-10-08T07:07:31.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179250+0000", 2023-10-08T07:07:31.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5264000000000002e-05 2023-10-08T07:07:31.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179396+0000", 2023-10-08T07:07:31.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014668 2023-10-08T07:07:31.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191628+0000", 2023-10-08T07:07:31.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012231483 2023-10-08T07:07:31.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.294751+0000", 2023-10-08T07:07:31.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10312267999999999 2023-10-08T07:07:31.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.294794+0000", 2023-10-08T07:07:31.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3467999999999998e-05 2023-10-08T07:07:31.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.294843+0000", 2023-10-08T07:07:31.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9039999999999998e-05 2023-10-08T07:07:31.467 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.467 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.467 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.467 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110489 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2711552~4096,write 2859008~4096,write 2887680~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.467 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.178082+0000", 2023-10-08T07:07:31.467 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2061879930000003, 2023-10-08T07:07:31.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.13133874200000001, 2023-10-08T07:07:31.468 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.468 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.468 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.468 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.468 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.468 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110489 2023-10-08T07:07:31.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.468 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178082+0000", 2023-10-08T07:07:31.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178082+0000", 2023-10-08T07:07:31.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178083+0000", 2023-10-08T07:07:31.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4000000000000001e-07 2023-10-08T07:07:31.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178094+0000", 2023-10-08T07:07:31.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1144e-05 2023-10-08T07:07:31.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178101+0000", 2023-10-08T07:07:31.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1509999999999998e-06 2023-10-08T07:07:31.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178106+0000", 2023-10-08T07:07:31.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8470000000000003e-06 2023-10-08T07:07:31.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.180867+0000", 2023-10-08T07:07:31.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027610529999999999 2023-10-08T07:07:31.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.180923+0000", 2023-10-08T07:07:31.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5770000000000003e-05 2023-10-08T07:07:31.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181024+0000", 2023-10-08T07:07:31.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100806 2023-10-08T07:07:31.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191634+0000", 2023-10-08T07:07:31.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010609809 2023-10-08T07:07:31.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309361+0000", 2023-10-08T07:07:31.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.117727095 2023-10-08T07:07:31.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309397+0000", 2023-10-08T07:07:31.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6465999999999999e-05 2023-10-08T07:07:31.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309421+0000", 2023-10-08T07:07:31.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3961e-05 2023-10-08T07:07:31.475 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.475 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.475 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.475 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110495 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 528384~4096,write 663552~4096,write 974848~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.475 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.181379+0000", 2023-10-08T07:07:31.475 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2028912380000003, 2023-10-08T07:07:31.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.128198539, 2023-10-08T07:07:31.475 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.475 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.476 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.476 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.476 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.476 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110495 2023-10-08T07:07:31.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.476 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181379+0000", 2023-10-08T07:07:31.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181379+0000", 2023-10-08T07:07:31.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181380+0000", 2023-10-08T07:07:31.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2e-07 2023-10-08T07:07:31.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181397+0000", 2023-10-08T07:07:31.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7750000000000001e-05 2023-10-08T07:07:31.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181405+0000", 2023-10-08T07:07:31.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8210000000000002e-06 2023-10-08T07:07:31.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181411+0000", 2023-10-08T07:07:31.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9479999999999996e-06 2023-10-08T07:07:31.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.183521+0000", 2023-10-08T07:07:31.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0021102629999999998 2023-10-08T07:07:31.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.183600+0000", 2023-10-08T07:07:31.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8524999999999998e-05 2023-10-08T07:07:31.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.183748+0000", 2023-10-08T07:07:31.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014801300000000001 2023-10-08T07:07:31.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.194292+0000", 2023-10-08T07:07:31.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010544421999999999 2023-10-08T07:07:31.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309480+0000", 2023-10-08T07:07:31.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11518740800000001 2023-10-08T07:07:31.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309538+0000", 2023-10-08T07:07:31.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8128999999999999e-05 2023-10-08T07:07:31.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309578+0000", 2023-10-08T07:07:31.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9740000000000002e-05 2023-10-08T07:07:31.482 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.482 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.482 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.482 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110498 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 892928~4096,write 1101824~4096,write 1118208~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.483 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.181421+0000", 2023-10-08T07:07:31.483 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2028489770000004, 2023-10-08T07:07:31.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12831536399999999, 2023-10-08T07:07:31.483 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.483 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.483 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110498 2023-10-08T07:07:31.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.483 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181421+0000", 2023-10-08T07:07:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181421+0000", 2023-10-08T07:07:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181422+0000", 2023-10-08T07:07:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6899999999999997e-07 2023-10-08T07:07:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181435+0000", 2023-10-08T07:07:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3217999999999999e-05 2023-10-08T07:07:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181443+0000", 2023-10-08T07:07:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5719999999999997e-06 2023-10-08T07:07:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181449+0000", 2023-10-08T07:07:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8930000000000002e-06 2023-10-08T07:07:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.186316+0000", 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048669539999999997 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.186386+0000", 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0698000000000006e-05 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.186499+0000", 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000112408 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.194298+0000", 2023-10-08T07:07:31.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.007799243 2023-10-08T07:07:31.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309638+0000", 2023-10-08T07:07:31.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.115339652 2023-10-08T07:07:31.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309697+0000", 2023-10-08T07:07:31.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9635000000000001e-05 2023-10-08T07:07:31.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309737+0000", 2023-10-08T07:07:31.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9521999999999999e-05 2023-10-08T07:07:31.489 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.489 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.489 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.490 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110500 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 53248~4096,write 278528~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.490 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.182173+0000", 2023-10-08T07:07:31.490 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.2020971320000005, 2023-10-08T07:07:31.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12767258300000001, 2023-10-08T07:07:31.490 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.490 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.490 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.490 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.490 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.490 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110500 2023-10-08T07:07:31.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.491 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182173+0000", 2023-10-08T07:07:31.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182173+0000", 2023-10-08T07:07:31.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182174+0000", 2023-10-08T07:07:31.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:31.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182191+0000", 2023-10-08T07:07:31.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6511000000000002e-05 2023-10-08T07:07:31.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182213+0000", 2023-10-08T07:07:31.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1948999999999999e-05 2023-10-08T07:07:31.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182220+0000", 2023-10-08T07:07:31.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7710000000000006e-06 2023-10-08T07:07:31.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.188654+0000", 2023-10-08T07:07:31.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0064335299999999998 2023-10-08T07:07:31.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.188748+0000", 2023-10-08T07:07:31.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.433e-05 2023-10-08T07:07:31.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.188969+0000", 2023-10-08T07:07:31.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022088500000000001 2023-10-08T07:07:31.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197663+0000", 2023-10-08T07:07:31.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0086943860000000001 2023-10-08T07:07:31.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309781+0000", 2023-10-08T07:07:31.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11211758199999999 2023-10-08T07:07:31.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309825+0000", 2023-10-08T07:07:31.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3955000000000002e-05 2023-10-08T07:07:31.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309846+0000", 2023-10-08T07:07:31.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0873000000000002e-05 2023-10-08T07:07:31.496 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.496 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.496 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110508 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3907584~12288,write 3948544~4096,write 4030464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.184597+0000", 2023-10-08T07:07:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.1996735640000002, 2023-10-08T07:07:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12538458, 2023-10-08T07:07:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110508 2023-10-08T07:07:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184597+0000", 2023-10-08T07:07:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184597+0000", 2023-10-08T07:07:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184598+0000", 2023-10-08T07:07:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9299999999999997e-07 2023-10-08T07:07:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184609+0000", 2023-10-08T07:07:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1525999999999999e-05 2023-10-08T07:07:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184618+0000", 2023-10-08T07:07:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.037e-06 2023-10-08T07:07:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184623+0000", 2023-10-08T07:07:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6199999999999998e-06 2023-10-08T07:07:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191662+0000", 2023-10-08T07:07:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070390849999999996 2023-10-08T07:07:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191743+0000", 2023-10-08T07:07:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0982999999999994e-05 2023-10-08T07:07:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191901+0000", 2023-10-08T07:07:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000158379 2023-10-08T07:07:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.200125+0000", 2023-10-08T07:07:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0082239050000000001 2023-10-08T07:07:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309894+0000", 2023-10-08T07:07:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10976902099999999 2023-10-08T07:07:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309947+0000", 2023-10-08T07:07:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3295999999999999e-05 2023-10-08T07:07:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309981+0000", 2023-10-08T07:07:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4035000000000002e-05 2023-10-08T07:07:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110511 4.1a 4:5a59f83a:::10000000004.00000002:head [write 942080~4096,write 1011712~4096,write 1163264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.185809+0000", 2023-10-08T07:07:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.1984617320000002, 2023-10-08T07:07:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.123881088, 2023-10-08T07:07:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110511 2023-10-08T07:07:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185809+0000", 2023-10-08T07:07:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185809+0000", 2023-10-08T07:07:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185809+0000", 2023-10-08T07:07:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.61e-07 2023-10-08T07:07:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185824+0000", 2023-10-08T07:07:31.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4487999999999999e-05 2023-10-08T07:07:31.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185835+0000", 2023-10-08T07:07:31.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1245e-05 2023-10-08T07:07:31.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185842+0000", 2023-10-08T07:07:31.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2439999999999996e-06 2023-10-08T07:07:31.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.193541+0000", 2023-10-08T07:07:31.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0076988450000000002 2023-10-08T07:07:31.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.193632+0000", 2023-10-08T07:07:31.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0859000000000005e-05 2023-10-08T07:07:31.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.193800+0000", 2023-10-08T07:07:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016752100000000001 2023-10-08T07:07:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.200130+0000", 2023-10-08T07:07:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0063304379999999999 2023-10-08T07:07:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309629+0000", 2023-10-08T07:07:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.109498716 2023-10-08T07:07:31.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.510 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309669+0000", 2023-10-08T07:07:31.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0280000000000001e-05 2023-10-08T07:07:31.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.510 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309690+0000", 2023-10-08T07:07:31.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0690999999999999e-05 2023-10-08T07:07:31.510 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.510 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.511 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.511 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.511 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110528 4.3a 4:5f183e4b:::10000000004.00000023:head [write 0~4096,write 270336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.511 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.191132+0000", 2023-10-08T07:07:31.511 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.1931381270000001, 2023-10-08T07:07:31.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11896013499999999, 2023-10-08T07:07:31.511 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.511 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.511 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.511 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.511 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.512 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110528 2023-10-08T07:07:31.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.512 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191132+0000", 2023-10-08T07:07:31.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191132+0000", 2023-10-08T07:07:31.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191133+0000", 2023-10-08T07:07:31.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1299999999999999e-07 2023-10-08T07:07:31.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191143+0000", 2023-10-08T07:07:31.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0328e-05 2023-10-08T07:07:31.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191154+0000", 2023-10-08T07:07:31.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0556e-05 2023-10-08T07:07:31.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191162+0000", 2023-10-08T07:07:31.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0930000000000003e-06 2023-10-08T07:07:31.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.195252+0000", 2023-10-08T07:07:31.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040898719999999996 2023-10-08T07:07:31.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.195331+0000", 2023-10-08T07:07:31.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9093999999999999e-05 2023-10-08T07:07:31.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.195484+0000", 2023-10-08T07:07:31.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015313699999999999 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.200515+0000", 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0050304950000000003 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310023+0000", 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10950808400000001 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.516 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310063+0000", 2023-10-08T07:07:31.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0309999999999999e-05 2023-10-08T07:07:31.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.517 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310092+0000", 2023-10-08T07:07:31.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9453000000000001e-05 2023-10-08T07:07:31.517 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.517 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.517 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.518 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110532 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3649536~4096,write 4071424~4096,write 4169728~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.518 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.192360+0000", 2023-10-08T07:07:31.518 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.1919099319999997, 2023-10-08T07:07:31.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.117879547, 2023-10-08T07:07:31.518 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.518 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.518 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.518 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.518 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.518 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110532 2023-10-08T07:07:31.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.518 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192360+0000", 2023-10-08T07:07:31.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192360+0000", 2023-10-08T07:07:31.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192361+0000", 2023-10-08T07:07:31.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5899999999999995e-07 2023-10-08T07:07:31.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192373+0000", 2023-10-08T07:07:31.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2099000000000001e-05 2023-10-08T07:07:31.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192402+0000", 2023-10-08T07:07:31.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8928000000000002e-05 2023-10-08T07:07:31.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192413+0000", 2023-10-08T07:07:31.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1177e-05 2023-10-08T07:07:31.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.521 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.521 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197684+0000", 2023-10-08T07:07:31.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052704850000000001 2023-10-08T07:07:31.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197770+0000", 2023-10-08T07:07:31.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6493e-05 2023-10-08T07:07:31.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197935+0000", 2023-10-08T07:07:31.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016471500000000001 2023-10-08T07:07:31.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.201435+0000", 2023-10-08T07:07:31.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0035002359999999999 2023-10-08T07:07:31.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310136+0000", 2023-10-08T07:07:31.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.108701038 2023-10-08T07:07:31.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310194+0000", 2023-10-08T07:07:31.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8109999999999998e-05 2023-10-08T07:07:31.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310240+0000", 2023-10-08T07:07:31.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5507000000000003e-05 2023-10-08T07:07:31.524 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.524 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.524 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.524 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110687 4.3a 4:5f183e4b:::10000000004.00000023:head [write 303104~4096,write 720896~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:31.524 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.244728+0000", 2023-10-08T07:07:31.525 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 5.1395427600000003, 2023-10-08T07:07:31.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.113819712, 2023-10-08T07:07:31.525 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:31.525 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:31.525 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:31.525 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:31.525 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.525 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110687 2023-10-08T07:07:31.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.525 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:31.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:31.526 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244728+0000", 2023-10-08T07:07:31.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.526 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:31.526 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244728+0000", 2023-10-08T07:07:31.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:31.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.526 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:31.526 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244729+0000", 2023-10-08T07:07:31.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8800000000000001e-07 2023-10-08T07:07:31.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:31.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244739+0000", 2023-10-08T07:07:31.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0370000000000001e-05 2023-10-08T07:07:31.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.527 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.527 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:31.527 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244749+0000", 2023-10-08T07:07:31.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0135999999999999e-05 2023-10-08T07:07:31.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244756+0000", 2023-10-08T07:07:31.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3969999999999997e-06 2023-10-08T07:07:31.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:31.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.247549+0000", 2023-10-08T07:07:31.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027921030000000002 2023-10-08T07:07:31.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:31.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.247630+0000", 2023-10-08T07:07:31.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1296000000000002e-05 2023-10-08T07:07:31.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:31.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.247777+0000", 2023-10-08T07:07:31.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014733899999999999 2023-10-08T07:07:31.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:31.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.258321+0000", 2023-10-08T07:07:31.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010543423 2023-10-08T07:07:31.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.530 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.530 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.358450+0000", 2023-10-08T07:07:31.530 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.100129684 2023-10-08T07:07:31.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.530 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:31.530 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.358505+0000", 2023-10-08T07:07:31.530 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4719999999999998e-05 2023-10-08T07:07:31.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:31.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:31.531 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:31.531 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.358547+0000", 2023-10-08T07:07:31.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2355999999999999e-05 2023-10-08T07:07:31.531 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.531 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.531 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.531 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:31.531 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:31.531 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:31.533 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:31.534 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:31.531+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:31.634 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:31.634+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:31.734 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:31.733+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:31.760 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:31.760 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:31.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.761 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124241 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.761 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.335440+0000", 2023-10-08T07:07:31.761 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.411941434, 2023-10-08T07:07:31.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41196428800000001, 2023-10-08T07:07:31.761 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.761 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.761 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.761 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.761 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.761 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124241 2023-10-08T07:07:31.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.761 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335440+0000", 2023-10-08T07:07:31.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335440+0000", 2023-10-08T07:07:31.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335440+0000", 2023-10-08T07:07:31.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5900000000000003e-07 2023-10-08T07:07:31.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335451+0000", 2023-10-08T07:07:31.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0824e-05 2023-10-08T07:07:31.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335458+0000", 2023-10-08T07:07:31.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5899999999999996e-06 2023-10-08T07:07:31.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335462+0000", 2023-10-08T07:07:31.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7180000000000004e-06 2023-10-08T07:07:31.764 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.764 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.765 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.765 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124416 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.765 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.420944+0000", 2023-10-08T07:07:31.765 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.32643777499999999, 2023-10-08T07:07:31.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32651460300000001, 2023-10-08T07:07:31.765 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.765 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.766 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.766 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.766 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.766 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124416 2023-10-08T07:07:31.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.766 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420944+0000", 2023-10-08T07:07:31.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420944+0000", 2023-10-08T07:07:31.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420944+0000", 2023-10-08T07:07:31.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3000000000000002e-07 2023-10-08T07:07:31.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420954+0000", 2023-10-08T07:07:31.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7839999999999998e-06 2023-10-08T07:07:31.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420960+0000", 2023-10-08T07:07:31.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2023-10-08T07:07:31.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420964+0000", 2023-10-08T07:07:31.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5190000000000003e-06 2023-10-08T07:07:31.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.769 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.769 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124527 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.770 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.474451+0000", 2023-10-08T07:07:31.770 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.272930548, 2023-10-08T07:07:31.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27303872000000001, 2023-10-08T07:07:31.770 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.770 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.770 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124527 2023-10-08T07:07:31.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.770 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.474451+0000", 2023-10-08T07:07:31.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.474451+0000", 2023-10-08T07:07:31.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.474451+0000", 2023-10-08T07:07:31.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0699999999999997e-07 2023-10-08T07:07:31.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.474467+0000", 2023-10-08T07:07:31.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5719e-05 2023-10-08T07:07:31.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.474474+0000", 2023-10-08T07:07:31.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8800000000000002e-06 2023-10-08T07:07:31.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.474480+0000", 2023-10-08T07:07:31.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5189999999999998e-06 2023-10-08T07:07:31.774 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.774 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.774 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.774 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124704 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.774 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.537453+0000", 2023-10-08T07:07:31.774 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.209928634, 2023-10-08T07:07:31.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.21006750699999999, 2023-10-08T07:07:31.775 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.775 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.775 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.775 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.775 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.775 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124704 2023-10-08T07:07:31.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.775 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.537453+0000", 2023-10-08T07:07:31.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.537453+0000", 2023-10-08T07:07:31.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.537453+0000", 2023-10-08T07:07:31.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1600000000000001e-07 2023-10-08T07:07:31.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.537469+0000", 2023-10-08T07:07:31.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6033999999999999e-05 2023-10-08T07:07:31.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.537476+0000", 2023-10-08T07:07:31.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4919999999999998e-06 2023-10-08T07:07:31.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.537481+0000", 2023-10-08T07:07:31.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2530000000000004e-06 2023-10-08T07:07:31.778 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.778 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.778 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.778 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124742 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.778 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.550344+0000", 2023-10-08T07:07:31.779 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.19703694499999999, 2023-10-08T07:07:31.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19720560500000001, 2023-10-08T07:07:31.779 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.779 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.779 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.779 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.779 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.779 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124742 2023-10-08T07:07:31.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.779 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.550344+0000", 2023-10-08T07:07:31.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.550344+0000", 2023-10-08T07:07:31.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.552296+0000", 2023-10-08T07:07:31.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001951606 2023-10-08T07:07:31.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.552324+0000", 2023-10-08T07:07:31.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7619000000000001e-05 2023-10-08T07:07:31.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.552336+0000", 2023-10-08T07:07:31.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2609000000000001e-05 2023-10-08T07:07:31.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.552346+0000", 2023-10-08T07:07:31.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4010000000000003e-06 2023-10-08T07:07:31.782 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.782 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.782 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.783 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124840 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.783 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.596355+0000", 2023-10-08T07:07:31.783 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.151026248, 2023-10-08T07:07:31.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.151225475, 2023-10-08T07:07:31.783 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.783 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.783 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.783 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.783 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.783 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124840 2023-10-08T07:07:31.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.596355+0000", 2023-10-08T07:07:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.596355+0000", 2023-10-08T07:07:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.596356+0000", 2023-10-08T07:07:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8800000000000002e-07 2023-10-08T07:07:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.596368+0000", 2023-10-08T07:07:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2561999999999999e-05 2023-10-08T07:07:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.596376+0000", 2023-10-08T07:07:31.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7200000000000006e-06 2023-10-08T07:07:31.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.596382+0000", 2023-10-08T07:07:31.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1210000000000003e-06 2023-10-08T07:07:31.786 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.786 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.786 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.786 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124956 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.787 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.668622+0000", 2023-10-08T07:07:31.787 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.078759448999999995, 2023-10-08T07:07:31.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.078987934999999995, 2023-10-08T07:07:31.787 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.787 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.787 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.787 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.787 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.787 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124956 2023-10-08T07:07:31.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.787 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668622+0000", 2023-10-08T07:07:31.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668622+0000", 2023-10-08T07:07:31.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668623+0000", 2023-10-08T07:07:31.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8800000000000001e-07 2023-10-08T07:07:31.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668637+0000", 2023-10-08T07:07:31.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4175999999999999e-05 2023-10-08T07:07:31.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668647+0000", 2023-10-08T07:07:31.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.044e-05 2023-10-08T07:07:31.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668655+0000", 2023-10-08T07:07:31.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3830000000000003e-06 2023-10-08T07:07:31.790 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.790 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.790 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.791 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125164 4.26 4:672c55ca:::10000000004.00000006:head [write 90112~4096 in=4096b,write 98304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.791 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.739776+0000", 2023-10-08T07:07:31.791 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0076057720000000002, 2023-10-08T07:07:31.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078681789999999995, 2023-10-08T07:07:31.791 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.791 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:31.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.791 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125164 2023-10-08T07:07:31.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.791 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739776+0000", 2023-10-08T07:07:31.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739776+0000", 2023-10-08T07:07:31.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739776+0000", 2023-10-08T07:07:31.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:07:31.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739787+0000", 2023-10-08T07:07:31.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1255e-05 2023-10-08T07:07:31.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739806+0000", 2023-10-08T07:07:31.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8291000000000002e-05 2023-10-08T07:07:31.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739816+0000", 2023-10-08T07:07:31.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0088000000000001e-05 2023-10-08T07:07:31.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:31.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.740144+0000", 2023-10-08T07:07:31.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00032811199999999998 2023-10-08T07:07:31.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:31.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.740194+0000", 2023-10-08T07:07:31.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0099000000000003e-05 2023-10-08T07:07:31.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:31.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.740328+0000", 2023-10-08T07:07:31.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013384000000000001 2023-10-08T07:07:31.796 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.796 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.796 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.797 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124706 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.797 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.537522+0000", 2023-10-08T07:07:31.797 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.209859037, 2023-10-08T07:07:31.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.21016140799999999, 2023-10-08T07:07:31.797 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.797 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.797 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.797 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.797 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.797 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124706 2023-10-08T07:07:31.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.798 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.537522+0000", 2023-10-08T07:07:31.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.537522+0000", 2023-10-08T07:07:31.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.539295+0000", 2023-10-08T07:07:31.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001773052 2023-10-08T07:07:31.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.539316+0000", 2023-10-08T07:07:31.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0149999999999999e-05 2023-10-08T07:07:31.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.539327+0000", 2023-10-08T07:07:31.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1559999999999999e-05 2023-10-08T07:07:31.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.539335+0000", 2023-10-08T07:07:31.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.452e-06 2023-10-08T07:07:31.800 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.800 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.800 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.801 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124869 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.801 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.611358+0000", 2023-10-08T07:07:31.801 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.136023268, 2023-10-08T07:07:31.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.136356853, 2023-10-08T07:07:31.801 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.801 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.801 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124869 2023-10-08T07:07:31.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.802 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.611358+0000", 2023-10-08T07:07:31.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.611358+0000", 2023-10-08T07:07:31.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.611359+0000", 2023-10-08T07:07:31.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4899999999999995e-07 2023-10-08T07:07:31.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.611372+0000", 2023-10-08T07:07:31.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3692999999999999e-05 2023-10-08T07:07:31.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.611379+0000", 2023-10-08T07:07:31.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.063e-06 2023-10-08T07:07:31.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.611385+0000", 2023-10-08T07:07:31.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9959999999999999e-06 2023-10-08T07:07:31.804 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.804 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.804 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.805 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124891 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.805 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.629358+0000", 2023-10-08T07:07:31.805 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.118023425, 2023-10-08T07:07:31.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.118386169, 2023-10-08T07:07:31.805 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.805 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.806 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.806 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.806 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124891 2023-10-08T07:07:31.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.807 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.629358+0000", 2023-10-08T07:07:31.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.629358+0000", 2023-10-08T07:07:31.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.629359+0000", 2023-10-08T07:07:31.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4700000000000001e-07 2023-10-08T07:07:31.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.629371+0000", 2023-10-08T07:07:31.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2666999999999999e-05 2023-10-08T07:07:31.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.629380+0000", 2023-10-08T07:07:31.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5900000000000008e-06 2023-10-08T07:07:31.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.629385+0000", 2023-10-08T07:07:31.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7169999999999996e-06 2023-10-08T07:07:31.809 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.809 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.809 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.810 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125165 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.810 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.739835+0000", 2023-10-08T07:07:31.810 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0075464809999999998, 2023-10-08T07:07:31.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079382159999999997, 2023-10-08T07:07:31.813 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.813 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.813 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125165 2023-10-08T07:07:31.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.813 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739835+0000", 2023-10-08T07:07:31.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739835+0000", 2023-10-08T07:07:31.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739836+0000", 2023-10-08T07:07:31.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.06e-07 2023-10-08T07:07:31.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739856+0000", 2023-10-08T07:07:31.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0432e-05 2023-10-08T07:07:31.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739865+0000", 2023-10-08T07:07:31.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9020000000000005e-06 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739872+0000", 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:123975 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.233440+0000", 2023-10-08T07:07:31.816 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51394111399999998, 2023-10-08T07:07:31.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.514368029, 2023-10-08T07:07:31.817 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.817 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.817 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 123975 2023-10-08T07:07:31.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.817 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.233440+0000", 2023-10-08T07:07:31.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.233440+0000", 2023-10-08T07:07:31.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.233441+0000", 2023-10-08T07:07:31.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2023-10-08T07:07:31.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.233454+0000", 2023-10-08T07:07:31.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2746e-05 2023-10-08T07:07:31.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.233460+0000", 2023-10-08T07:07:31.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4590000000000003e-06 2023-10-08T07:07:31.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.233467+0000", 2023-10-08T07:07:31.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7050000000000002e-06 2023-10-08T07:07:31.820 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.820 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.820 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.820 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124174 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.312383+0000", 2023-10-08T07:07:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43499870000000002, 2023-10-08T07:07:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43545588200000002, 2023-10-08T07:07:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124174 2023-10-08T07:07:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.312383+0000", 2023-10-08T07:07:31.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.312383+0000", 2023-10-08T07:07:31.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.312383+0000", 2023-10-08T07:07:31.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7800000000000002e-07 2023-10-08T07:07:31.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.312396+0000", 2023-10-08T07:07:31.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3298e-05 2023-10-08T07:07:31.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.312403+0000", 2023-10-08T07:07:31.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8959999999999997e-06 2023-10-08T07:07:31.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.312408+0000", 2023-10-08T07:07:31.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7299999999999996e-06 2023-10-08T07:07:31.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.824 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.824 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124959 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.824 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.668705+0000", 2023-10-08T07:07:31.825 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.078675982000000005, 2023-10-08T07:07:31.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.079162644000000004, 2023-10-08T07:07:31.825 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.825 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.825 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.825 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.825 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.825 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124959 2023-10-08T07:07:31.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.826 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668705+0000", 2023-10-08T07:07:31.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668705+0000", 2023-10-08T07:07:31.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668706+0000", 2023-10-08T07:07:31.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:07:31.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668719+0000", 2023-10-08T07:07:31.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2774e-05 2023-10-08T07:07:31.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668726+0000", 2023-10-08T07:07:31.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2023-10-08T07:07:31.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668732+0000", 2023-10-08T07:07:31.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0639999999999999e-06 2023-10-08T07:07:31.828 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126465 4.2b e59/17 4:d7a77d67:::10000000004.00000029:head v 59'3997, mlcod=59'3989)", 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.727992+0000", 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.019389762000000001, 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019908615000000001, 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.727992+0000", 2023-10-08T07:07:31.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.727992+0000", 2023-10-08T07:07:31.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.727992+0000", 2023-10-08T07:07:31.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4299999999999999e-07 2023-10-08T07:07:31.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728005+0000", 2023-10-08T07:07:31.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2768e-05 2023-10-08T07:07:31.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728012+0000", 2023-10-08T07:07:31.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1770000000000001e-06 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728017+0000", 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.164e-06 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.732058+0000", 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040414680000000003 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:31.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.732076+0000", 2023-10-08T07:07:31.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7892000000000001e-05 2023-10-08T07:07:31.833 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.833 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.833 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.833 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125166 4.26 4:672c55ca:::10000000004.00000006:head [write 1282048~4096 in=4096b,write 1495040~4096 in=4096b,write 1929216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.833 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.739881+0000", 2023-10-08T07:07:31.833 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.007500179, 2023-10-08T07:07:31.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080569999999999999, 2023-10-08T07:07:31.833 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.834 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:31.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.834 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125166 2023-10-08T07:07:31.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739881+0000", 2023-10-08T07:07:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739881+0000", 2023-10-08T07:07:31.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739882+0000", 2023-10-08T07:07:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7000000000000005e-07 2023-10-08T07:07:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739895+0000", 2023-10-08T07:07:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3417999999999999e-05 2023-10-08T07:07:31.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739902+0000", 2023-10-08T07:07:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1169999999999998e-06 2023-10-08T07:07:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739908+0000", 2023-10-08T07:07:31.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3430000000000003e-06 2023-10-08T07:07:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.741794+0000", 2023-10-08T07:07:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001885877 2023-10-08T07:07:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.741871+0000", 2023-10-08T07:07:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7269999999999997e-05 2023-10-08T07:07:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.742007+0000", 2023-10-08T07:07:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013604200000000001 2023-10-08T07:07:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124040 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.843 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.260641+0000", 2023-10-08T07:07:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48674019899999998, 2023-10-08T07:07:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48734158500000002, 2023-10-08T07:07:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124040 2023-10-08T07:07:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.260641+0000", 2023-10-08T07:07:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.260641+0000", 2023-10-08T07:07:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.260642+0000", 2023-10-08T07:07:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2023-10-08T07:07:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.260654+0000", 2023-10-08T07:07:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1950000000000001e-05 2023-10-08T07:07:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.260660+0000", 2023-10-08T07:07:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6789999999999999e-06 2023-10-08T07:07:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.260666+0000", 2023-10-08T07:07:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2739999999999998e-06 2023-10-08T07:07:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.848 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124175 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.848 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.312415+0000", 2023-10-08T07:07:31.848 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43496685699999998, 2023-10-08T07:07:31.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.435599509, 2023-10-08T07:07:31.848 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.848 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.848 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124175 2023-10-08T07:07:31.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.848 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.312415+0000", 2023-10-08T07:07:31.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.312415+0000", 2023-10-08T07:07:31.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.312415+0000", 2023-10-08T07:07:31.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2023-10-08T07:07:31.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.312431+0000", 2023-10-08T07:07:31.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5769000000000001e-05 2023-10-08T07:07:31.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.312437+0000", 2023-10-08T07:07:31.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2840000000000003e-06 2023-10-08T07:07:31.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.312442+0000", 2023-10-08T07:07:31.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7350000000000004e-06 2023-10-08T07:07:31.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.851 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.851 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124708 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.539381+0000", 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.20800083799999999, 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.20866452899999999, 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124708 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.539381+0000", 2023-10-08T07:07:31.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.539381+0000", 2023-10-08T07:07:31.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.539381+0000", 2023-10-08T07:07:31.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7599999999999998e-07 2023-10-08T07:07:31.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.539392+0000", 2023-10-08T07:07:31.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1008e-05 2023-10-08T07:07:31.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.539398+0000", 2023-10-08T07:07:31.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2230000000000004e-06 2023-10-08T07:07:31.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.539403+0000", 2023-10-08T07:07:31.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6059999999999996e-06 2023-10-08T07:07:31.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.856 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.856 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124749 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.856 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.552463+0000", 2023-10-08T07:07:31.856 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.194918286, 2023-10-08T07:07:31.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.195613434, 2023-10-08T07:07:31.857 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.857 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.857 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.857 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.857 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.857 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124749 2023-10-08T07:07:31.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.857 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.552463+0000", 2023-10-08T07:07:31.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.552463+0000", 2023-10-08T07:07:31.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.552464+0000", 2023-10-08T07:07:31.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8100000000000003e-07 2023-10-08T07:07:31.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.552485+0000", 2023-10-08T07:07:31.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1529999999999999e-05 2023-10-08T07:07:31.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.552492+0000", 2023-10-08T07:07:31.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.34e-06 2023-10-08T07:07:31.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.552498+0000", 2023-10-08T07:07:31.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7629999999999997e-06 2023-10-08T07:07:31.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.860 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.860 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124870 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.860 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.611394+0000", 2023-10-08T07:07:31.860 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.13598706399999999, 2023-10-08T07:07:31.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13671198800000001, 2023-10-08T07:07:31.861 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.861 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.861 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124870 2023-10-08T07:07:31.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.861 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.611394+0000", 2023-10-08T07:07:31.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.611394+0000", 2023-10-08T07:07:31.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.613299+0000", 2023-10-08T07:07:31.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001904878 2023-10-08T07:07:31.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.613316+0000", 2023-10-08T07:07:31.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7289999999999999e-05 2023-10-08T07:07:31.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.613326+0000", 2023-10-08T07:07:31.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1810000000000007e-06 2023-10-08T07:07:31.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.613331+0000", 2023-10-08T07:07:31.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.412e-06 2023-10-08T07:07:31.864 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.864 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.864 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.865 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124961 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.865 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.668740+0000", 2023-10-08T07:07:31.865 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.078641606000000003, 2023-10-08T07:07:31.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.079395535000000003, 2023-10-08T07:07:31.865 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.865 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.865 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.865 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.865 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.865 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124961 2023-10-08T07:07:31.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.866 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668740+0000", 2023-10-08T07:07:31.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668740+0000", 2023-10-08T07:07:31.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668740+0000", 2023-10-08T07:07:31.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0800000000000005e-07 2023-10-08T07:07:31.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668751+0000", 2023-10-08T07:07:31.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0801999999999999e-05 2023-10-08T07:07:31.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668758+0000", 2023-10-08T07:07:31.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6209999999999998e-06 2023-10-08T07:07:31.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.668763+0000", 2023-10-08T07:07:31.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1800000000000004e-06 2023-10-08T07:07:31.868 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.868 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.869 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.869 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125137 4.29 4:94216392:::10000000004.0000002b:head [write 1929216~4096 in=4096b,write 1970176~4096 in=4096b,write 2064384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.869 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.726584+0000", 2023-10-08T07:07:31.869 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.020797729000000001, 2023-10-08T07:07:31.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021584605999999999, 2023-10-08T07:07:31.869 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.869 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:31.869 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.869 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125137 2023-10-08T07:07:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.726584+0000", 2023-10-08T07:07:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.726584+0000", 2023-10-08T07:07:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728442+0000", 2023-10-08T07:07:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001858639 2023-10-08T07:07:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728460+0000", 2023-10-08T07:07:31.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8093000000000001e-05 2023-10-08T07:07:31.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728470+0000", 2023-10-08T07:07:31.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1449999999999997e-06 2023-10-08T07:07:31.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728476+0000", 2023-10-08T07:07:31.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8140000000000003e-06 2023-10-08T07:07:31.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:31.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.736060+0000", 2023-10-08T07:07:31.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075838640000000001 2023-10-08T07:07:31.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:31.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.736141+0000", 2023-10-08T07:07:31.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0357000000000003e-05 2023-10-08T07:07:31.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:31.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.736295+0000", 2023-10-08T07:07:31.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015466199999999999 2023-10-08T07:07:31.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:31.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.740828+0000", 2023-10-08T07:07:31.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045327680000000004 2023-10-08T07:07:31.875 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.875 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.875 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.875 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125169 4.b 4:d0c991e0:::10000000004.0000002d:head [write 1372160~4096 in=4096b,write 1458176~4096 in=4096b,write 1654784~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.875 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.739916+0000", 2023-10-08T07:07:31.875 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0074656430000000001, 2023-10-08T07:07:31.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082986520000000001, 2023-10-08T07:07:31.875 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.875 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:31.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.876 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.876 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.876 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125169 2023-10-08T07:07:31.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.876 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739916+0000", 2023-10-08T07:07:31.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739916+0000", 2023-10-08T07:07:31.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739916+0000", 2023-10-08T07:07:31.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0800000000000005e-07 2023-10-08T07:07:31.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739935+0000", 2023-10-08T07:07:31.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8649999999999999e-05 2023-10-08T07:07:31.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739942+0000", 2023-10-08T07:07:31.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6189999999999996e-06 2023-10-08T07:07:31.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739947+0000", 2023-10-08T07:07:31.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.896e-06 2023-10-08T07:07:31.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:31.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746605+0000", 2023-10-08T07:07:31.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066577980000000004 2023-10-08T07:07:31.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:31.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746686+0000", 2023-10-08T07:07:31.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0498000000000001e-05 2023-10-08T07:07:31.880 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.880 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.880 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.880 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:123896 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.880 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.208350+0000", 2023-10-08T07:07:31.880 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.53903116500000003, 2023-10-08T07:07:31.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.53991717500000003, 2023-10-08T07:07:31.880 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.880 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.881 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.881 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.881 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.881 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 123896 2023-10-08T07:07:31.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.881 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.208350+0000", 2023-10-08T07:07:31.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.208350+0000", 2023-10-08T07:07:31.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.208351+0000", 2023-10-08T07:07:31.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2900000000000004e-07 2023-10-08T07:07:31.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.208362+0000", 2023-10-08T07:07:31.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1671999999999999e-05 2023-10-08T07:07:31.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.208369+0000", 2023-10-08T07:07:31.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7490000000000001e-06 2023-10-08T07:07:31.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.208374+0000", 2023-10-08T07:07:31.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2023-10-08T07:07:31.884 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.884 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.884 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.884 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124110 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.884 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.284486+0000", 2023-10-08T07:07:31.884 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.46289500099999997, 2023-10-08T07:07:31.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46382274200000001, 2023-10-08T07:07:31.885 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.885 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.885 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.885 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.885 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.885 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124110 2023-10-08T07:07:31.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.885 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.284486+0000", 2023-10-08T07:07:31.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.284486+0000", 2023-10-08T07:07:31.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.284487+0000", 2023-10-08T07:07:31.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8500000000000002e-07 2023-10-08T07:07:31.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.284501+0000", 2023-10-08T07:07:31.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3781000000000001e-05 2023-10-08T07:07:31.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.284506+0000", 2023-10-08T07:07:31.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8710000000000002e-06 2023-10-08T07:07:31.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.284512+0000", 2023-10-08T07:07:31.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2023-10-08T07:07:31.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.888 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.888 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124334 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.889 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.376534+0000", 2023-10-08T07:07:31.889 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.370847592, 2023-10-08T07:07:31.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.371838116, 2023-10-08T07:07:31.889 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.889 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.889 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.889 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.889 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.889 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124334 2023-10-08T07:07:31.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.889 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.376534+0000", 2023-10-08T07:07:31.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.376534+0000", 2023-10-08T07:07:31.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.376534+0000", 2023-10-08T07:07:31.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2023-10-08T07:07:31.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.376554+0000", 2023-10-08T07:07:31.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9845000000000001e-05 2023-10-08T07:07:31.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.376561+0000", 2023-10-08T07:07:31.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9469999999999997e-06 2023-10-08T07:07:31.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.376566+0000", 2023-10-08T07:07:31.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3170000000000001e-06 2023-10-08T07:07:31.892 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.892 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.892 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.893 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124500 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.893 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.460352+0000", 2023-10-08T07:07:31.893 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28702967400000001, 2023-10-08T07:07:31.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.28808229000000002, 2023-10-08T07:07:31.893 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.893 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.893 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.893 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.893 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.893 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124500 2023-10-08T07:07:31.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.894 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.460352+0000", 2023-10-08T07:07:31.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.460352+0000", 2023-10-08T07:07:31.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.460354+0000", 2023-10-08T07:07:31.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4260000000000002e-06 2023-10-08T07:07:31.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.460366+0000", 2023-10-08T07:07:31.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.217e-05 2023-10-08T07:07:31.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.460373+0000", 2023-10-08T07:07:31.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3149999999999997e-06 2023-10-08T07:07:31.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.460378+0000", 2023-10-08T07:07:31.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.169e-06 2023-10-08T07:07:31.897 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.897 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.897 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.897 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125170 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.897 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.739955+0000", 2023-10-08T07:07:31.897 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0074259929999999997, 2023-10-08T07:07:31.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085412990000000005, 2023-10-08T07:07:31.897 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.897 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.898 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.898 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.898 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.898 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125170 2023-10-08T07:07:31.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.898 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739955+0000", 2023-10-08T07:07:31.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739955+0000", 2023-10-08T07:07:31.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739956+0000", 2023-10-08T07:07:31.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6600000000000002e-07 2023-10-08T07:07:31.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739969+0000", 2023-10-08T07:07:31.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3244000000000001e-05 2023-10-08T07:07:31.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739976+0000", 2023-10-08T07:07:31.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5749999999999997e-06 2023-10-08T07:07:31.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.739982+0000", 2023-10-08T07:07:31.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1530000000000002e-06 2023-10-08T07:07:31.900 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.901 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.901 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:123939 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.901 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.221349+0000", 2023-10-08T07:07:31.901 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.52603287499999996, 2023-10-08T07:07:31.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.52721179699999998, 2023-10-08T07:07:31.901 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.901 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.901 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.902 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 123939 2023-10-08T07:07:31.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.902 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.221349+0000", 2023-10-08T07:07:31.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.221349+0000", 2023-10-08T07:07:31.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.223293+0000", 2023-10-08T07:07:31.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019448060000000001 2023-10-08T07:07:31.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.223311+0000", 2023-10-08T07:07:31.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7740999999999998e-05 2023-10-08T07:07:31.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.223321+0000", 2023-10-08T07:07:31.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0268000000000001e-05 2023-10-08T07:07:31.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.223328+0000", 2023-10-08T07:07:31.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0199999999999997e-06 2023-10-08T07:07:31.905 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.905 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.905 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.905 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124275 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.905 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.354404+0000", 2023-10-08T07:07:31.905 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39297748399999999, 2023-10-08T07:07:31.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39421287900000002, 2023-10-08T07:07:31.905 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.906 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.906 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.906 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.906 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.906 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124275 2023-10-08T07:07:31.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.906 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.354404+0000", 2023-10-08T07:07:31.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.354404+0000", 2023-10-08T07:07:31.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.356300+0000", 2023-10-08T07:07:31.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018961519999999999 2023-10-08T07:07:31.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.356316+0000", 2023-10-08T07:07:31.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5726000000000002e-05 2023-10-08T07:07:31.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.356326+0000", 2023-10-08T07:07:31.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7450000000000007e-06 2023-10-08T07:07:31.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.356333+0000", 2023-10-08T07:07:31.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7610000000000007e-06 2023-10-08T07:07:31.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.909 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.909 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124503 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.909 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.460387+0000", 2023-10-08T07:07:31.910 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28699460900000001, 2023-10-08T07:07:31.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.28829186499999998, 2023-10-08T07:07:31.910 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.910 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.910 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.910 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.910 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.910 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124503 2023-10-08T07:07:31.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.910 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.460387+0000", 2023-10-08T07:07:31.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.460387+0000", 2023-10-08T07:07:31.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.462296+0000", 2023-10-08T07:07:31.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019088460000000001 2023-10-08T07:07:31.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.462314+0000", 2023-10-08T07:07:31.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8572000000000001e-05 2023-10-08T07:07:31.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.462326+0000", 2023-10-08T07:07:31.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1574e-05 2023-10-08T07:07:31.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.462333+0000", 2023-10-08T07:07:31.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2089999999999999e-06 2023-10-08T07:07:31.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.913 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.914 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125009 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.914 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.680449+0000", 2023-10-08T07:07:31.914 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.066932072999999995, 2023-10-08T07:07:31.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068301213, 2023-10-08T07:07:31.914 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.914 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.915 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125009 2023-10-08T07:07:31.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.915 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.680449+0000", 2023-10-08T07:07:31.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.680449+0000", 2023-10-08T07:07:31.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.680450+0000", 2023-10-08T07:07:31.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3200000000000005e-07 2023-10-08T07:07:31.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.680460+0000", 2023-10-08T07:07:31.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.04e-05 2023-10-08T07:07:31.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.680466+0000", 2023-10-08T07:07:31.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9200000000000001e-06 2023-10-08T07:07:31.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.680471+0000", 2023-10-08T07:07:31.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6099999999999999e-06 2023-10-08T07:07:31.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.918 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.918 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.918 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125143 4.31 4:8de29a03:::10000000004.00000001:head [write 3731456~4096 in=4096b,write 3751936~4096 in=4096b,write 3821568~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.918 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.728530+0000", 2023-10-08T07:07:31.918 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018851763000000001, 2023-10-08T07:07:31.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020292424999999999, 2023-10-08T07:07:31.918 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.918 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:31.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.919 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.919 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125143 2023-10-08T07:07:31.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.919 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728530+0000", 2023-10-08T07:07:31.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728530+0000", 2023-10-08T07:07:31.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728530+0000", 2023-10-08T07:07:31.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3300000000000003e-07 2023-10-08T07:07:31.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728542+0000", 2023-10-08T07:07:31.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1883e-05 2023-10-08T07:07:31.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728549+0000", 2023-10-08T07:07:31.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9840000000000004e-06 2023-10-08T07:07:31.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728554+0000", 2023-10-08T07:07:31.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0019999999999997e-06 2023-10-08T07:07:31.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.737950+0000", 2023-10-08T07:07:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0093958310000000003 2023-10-08T07:07:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.738034+0000", 2023-10-08T07:07:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4085999999999994e-05 2023-10-08T07:07:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:31.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.738511+0000", 2023-10-08T07:07:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047702500000000001 2023-10-08T07:07:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124967 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.670343+0000", 2023-10-08T07:07:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.077038510000000004, 2023-10-08T07:07:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.078562718000000004, 2023-10-08T07:07:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.923 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.924 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124967 2023-10-08T07:07:31.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.924 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.670343+0000", 2023-10-08T07:07:31.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.670343+0000", 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.670343+0000", 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.670360+0000", 2023-10-08T07:07:31.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6453e-05 2023-10-08T07:07:31.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.670369+0000", 2023-10-08T07:07:31.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7739999999999993e-06 2023-10-08T07:07:31.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.670374+0000", 2023-10-08T07:07:31.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0849999999999996e-06 2023-10-08T07:07:31.926 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.926 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125010 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.680477+0000", 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.066904833999999996, 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068492015000000003, 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.927 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125010 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.680477+0000", 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.680477+0000", 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.680477+0000", 2023-10-08T07:07:31.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3799999999999998e-07 2023-10-08T07:07:31.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.680491+0000", 2023-10-08T07:07:31.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.419e-05 2023-10-08T07:07:31.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.680497+0000", 2023-10-08T07:07:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6740000000000002e-06 2023-10-08T07:07:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.680501+0000", 2023-10-08T07:07:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5689999999999998e-06 2023-10-08T07:07:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.930 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125144 4.31 4:8de29a03:::10000000004.00000001:head [write 1769472~4096 in=4096b,write 2220032~4096 in=4096b,write 2244608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.931 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.728562+0000", 2023-10-08T07:07:31.931 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018819703, 2023-10-08T07:07:31.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020463252000000001, 2023-10-08T07:07:31.931 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.931 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:31.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.931 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125144 2023-10-08T07:07:31.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.931 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728562+0000", 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728562+0000", 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728562+0000", 2023-10-08T07:07:31.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4999999999999998e-07 2023-10-08T07:07:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728573+0000", 2023-10-08T07:07:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0903e-05 2023-10-08T07:07:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728579+0000", 2023-10-08T07:07:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7379999999999999e-06 2023-10-08T07:07:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728583+0000", 2023-10-08T07:07:31.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5419999999999999e-06 2023-10-08T07:07:31.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:31.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.740798+0000", 2023-10-08T07:07:31.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012215169999999999 2023-10-08T07:07:31.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:31.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.740884+0000", 2023-10-08T07:07:31.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5962000000000001e-05 2023-10-08T07:07:31.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:31.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.741045+0000", 2023-10-08T07:07:31.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016065799999999999 2023-10-08T07:07:31.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.935 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.935 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:123901 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.210335+0000", 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.53704612699999998, 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.53875426699999995, 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 123901 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.210335+0000", 2023-10-08T07:07:31.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.210335+0000", 2023-10-08T07:07:31.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.210336+0000", 2023-10-08T07:07:31.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.210347+0000", 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.117e-05 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.210353+0000", 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3999999999999997e-06 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.210357+0000", 2023-10-08T07:07:31.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3249999999999999e-06 2023-10-08T07:07:31.939 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.939 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.939 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.939 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124420 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.939 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.422332+0000", 2023-10-08T07:07:31.939 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.32504982999999998, 2023-10-08T07:07:31.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32682036399999997, 2023-10-08T07:07:31.939 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124420 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.422332+0000", 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.422332+0000", 2023-10-08T07:07:31.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.426293+0000", 2023-10-08T07:07:31.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039616979999999996 2023-10-08T07:07:31.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.426309+0000", 2023-10-08T07:07:31.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6184999999999998e-05 2023-10-08T07:07:31.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.426320+0000", 2023-10-08T07:07:31.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242e-05 2023-10-08T07:07:31.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.426328+0000", 2023-10-08T07:07:31.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8199999999999997e-06 2023-10-08T07:07:31.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124751 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.554357+0000", 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.19302471399999999, 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19483671999999999, 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.943 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.944 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124751 2023-10-08T07:07:31.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.944 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.554357+0000", 2023-10-08T07:07:31.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.554357+0000", 2023-10-08T07:07:31.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.554357+0000", 2023-10-08T07:07:31.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9299999999999998e-07 2023-10-08T07:07:31.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.554370+0000", 2023-10-08T07:07:31.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.289e-05 2023-10-08T07:07:31.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.554377+0000", 2023-10-08T07:07:31.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9140000000000002e-06 2023-10-08T07:07:31.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.554382+0000", 2023-10-08T07:07:31.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3920000000000002e-06 2023-10-08T07:07:31.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.946 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.947 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125065 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.947 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.708409+0000", 2023-10-08T07:07:31.947 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.038972880000000001, 2023-10-08T07:07:31.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040832503999999999, 2023-10-08T07:07:31.947 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.947 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.947 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125065 2023-10-08T07:07:31.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.948 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.708409+0000", 2023-10-08T07:07:31.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.708409+0000", 2023-10-08T07:07:31.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.708409+0000", 2023-10-08T07:07:31.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4000000000000002e-07 2023-10-08T07:07:31.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.708424+0000", 2023-10-08T07:07:31.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4664999999999999e-05 2023-10-08T07:07:31.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.708431+0000", 2023-10-08T07:07:31.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1620000000000002e-06 2023-10-08T07:07:31.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.708436+0000", 2023-10-08T07:07:31.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3480000000000003e-06 2023-10-08T07:07:31.950 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.950 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.950 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.950 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125104 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.951 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.718421+0000", 2023-10-08T07:07:31.951 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.028960712, 2023-10-08T07:07:31.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.030874216999999999, 2023-10-08T07:07:31.951 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.951 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.951 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.951 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.951 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.951 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125104 2023-10-08T07:07:31.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.951 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.718421+0000", 2023-10-08T07:07:31.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.718421+0000", 2023-10-08T07:07:31.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.718421+0000", 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1799999999999995e-07 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.718433+0000", 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1430000000000001e-05 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.718440+0000", 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5599999999999996e-06 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.718446+0000", 2023-10-08T07:07:31.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9519999999999999e-06 2023-10-08T07:07:31.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.954 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.954 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125146 4.21 4:867af9ba:::10000000004.0000000a:head [write 4132864~4096 in=4096b,write 4149248~4096 in=4096b,write 4186112~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.954 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.728589+0000", 2023-10-08T07:07:31.954 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018792441, 2023-10-08T07:07:31.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020762065999999999, 2023-10-08T07:07:31.955 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.955 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:31.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.955 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125146 2023-10-08T07:07:31.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.955 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728589+0000", 2023-10-08T07:07:31.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728589+0000", 2023-10-08T07:07:31.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728589+0000", 2023-10-08T07:07:31.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4000000000000002e-07 2023-10-08T07:07:31.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728610+0000", 2023-10-08T07:07:31.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0452999999999999e-05 2023-10-08T07:07:31.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728616+0000", 2023-10-08T07:07:31.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2600000000000002e-06 2023-10-08T07:07:31.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728621+0000", 2023-10-08T07:07:31.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8579999999999999e-06 2023-10-08T07:07:31.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:31.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.740857+0000", 2023-10-08T07:07:31.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012236429 2023-10-08T07:07:31.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:31.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.740927+0000", 2023-10-08T07:07:31.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9740000000000007e-05 2023-10-08T07:07:31.958 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126512 4.20 e59/17 4:05b3915c:::10000000004.00000016:head v 59'5952, mlcod=59'5945)", 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.741571+0000", 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0058104080000000004, 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078263429999999995, 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.741571+0000", 2023-10-08T07:07:31.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.741571+0000", 2023-10-08T07:07:31.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.741571+0000", 2023-10-08T07:07:31.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8599999999999999e-07 2023-10-08T07:07:31.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.741583+0000", 2023-10-08T07:07:31.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1732e-05 2023-10-08T07:07:31.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.741589+0000", 2023-10-08T07:07:31.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2600000000000002e-06 2023-10-08T07:07:31.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.741595+0000", 2023-10-08T07:07:31.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5720000000000002e-06 2023-10-08T07:07:31.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:31.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.743209+0000", 2023-10-08T07:07:31.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001613894 2023-10-08T07:07:31.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:31.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.743222+0000", 2023-10-08T07:07:31.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3069e-05 2023-10-08T07:07:31.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.963 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.963 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124339 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.963 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.376659+0000", 2023-10-08T07:07:31.963 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37072269099999999, 2023-10-08T07:07:31.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.37277125799999999, 2023-10-08T07:07:31.963 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.963 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.964 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.964 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.964 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.964 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124339 2023-10-08T07:07:31.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.964 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.376659+0000", 2023-10-08T07:07:31.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.376659+0000", 2023-10-08T07:07:31.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.378294+0000", 2023-10-08T07:07:31.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016357730000000001 2023-10-08T07:07:31.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.378319+0000", 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4698e-05 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.378331+0000", 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.155e-05 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.378338+0000", 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3810000000000001e-06 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.966 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.967 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.967 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124752 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.967 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.554390+0000", 2023-10-08T07:07:31.967 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.192991157, 2023-10-08T07:07:31.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.195069558, 2023-10-08T07:07:31.967 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.967 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124752 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.554390+0000", 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.554390+0000", 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.554391+0000", 2023-10-08T07:07:31.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2023-10-08T07:07:31.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.554403+0000", 2023-10-08T07:07:31.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2455e-05 2023-10-08T07:07:31.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.554412+0000", 2023-10-08T07:07:31.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8720000000000008e-06 2023-10-08T07:07:31.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.554417+0000", 2023-10-08T07:07:31.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1599999999999997e-06 2023-10-08T07:07:31.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.970 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:123944 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.223449+0000", 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.52393224800000004, 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.52604217099999995, 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 123944 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.223449+0000", 2023-10-08T07:07:31.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.223449+0000", 2023-10-08T07:07:31.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.223449+0000", 2023-10-08T07:07:31.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2899999999999999e-07 2023-10-08T07:07:31.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.223462+0000", 2023-10-08T07:07:31.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2958e-05 2023-10-08T07:07:31.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.223468+0000", 2023-10-08T07:07:31.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9050000000000002e-06 2023-10-08T07:07:31.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.223473+0000", 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0640000000000001e-06 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124052 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.260854+0000", 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48652761500000002, 2023-10-08T07:07:31.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48869748699999999, 2023-10-08T07:07:31.975 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.975 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.975 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124052 2023-10-08T07:07:31.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.975 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.260854+0000", 2023-10-08T07:07:31.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.260854+0000", 2023-10-08T07:07:31.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.260854+0000", 2023-10-08T07:07:31.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0399999999999996e-07 2023-10-08T07:07:31.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.260866+0000", 2023-10-08T07:07:31.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1430999999999999e-05 2023-10-08T07:07:31.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.260874+0000", 2023-10-08T07:07:31.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0360000000000006e-06 2023-10-08T07:07:31.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.260879+0000", 2023-10-08T07:07:31.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5559999999999998e-06 2023-10-08T07:07:31.978 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.978 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.978 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.978 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124528 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.978 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.474488+0000", 2023-10-08T07:07:31.978 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.27289319899999998, 2023-10-08T07:07:31.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27512392000000002, 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124528 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.474488+0000", 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.474488+0000", 2023-10-08T07:07:31.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480295+0000", 2023-10-08T07:07:31.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058067409999999998 2023-10-08T07:07:31.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480311+0000", 2023-10-08T07:07:31.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5829999999999999e-05 2023-10-08T07:07:31.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480318+0000", 2023-10-08T07:07:31.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.345e-06 2023-10-08T07:07:31.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480324+0000", 2023-10-08T07:07:31.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6529999999999999e-06 2023-10-08T07:07:31.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.982 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.982 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124782 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.982 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.568474+0000", 2023-10-08T07:07:31.982 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.178907868, 2023-10-08T07:07:31.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.181200428, 2023-10-08T07:07:31.982 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.983 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124782 2023-10-08T07:07:31.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.983 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.568474+0000", 2023-10-08T07:07:31.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.568474+0000", 2023-10-08T07:07:31.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.568474+0000", 2023-10-08T07:07:31.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7e-07 2023-10-08T07:07:31.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.568495+0000", 2023-10-08T07:07:31.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1449000000000001e-05 2023-10-08T07:07:31.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.568507+0000", 2023-10-08T07:07:31.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1426999999999999e-05 2023-10-08T07:07:31.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.568512+0000", 2023-10-08T07:07:31.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.541e-06 2023-10-08T07:07:31.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.986 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.986 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125106 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.986 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.718516+0000", 2023-10-08T07:07:31.986 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.028865286, 2023-10-08T07:07:31.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.031216375000000001, 2023-10-08T07:07:31.986 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.986 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.987 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125106 2023-10-08T07:07:31.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.987 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.718516+0000", 2023-10-08T07:07:31.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.718516+0000", 2023-10-08T07:07:31.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.720293+0000", 2023-10-08T07:07:31.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001777254 2023-10-08T07:07:31.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.720311+0000", 2023-10-08T07:07:31.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7578999999999999e-05 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.720321+0000", 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0249e-05 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.720329+0000", 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7819999999999994e-06 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124183 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.316343+0000", 2023-10-08T07:07:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43103873100000001, 2023-10-08T07:07:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43345266300000002, 2023-10-08T07:07:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.990 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124183 2023-10-08T07:07:31.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.991 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.316343+0000", 2023-10-08T07:07:31.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.316343+0000", 2023-10-08T07:07:31.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.316343+0000", 2023-10-08T07:07:31.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2800000000000003e-07 2023-10-08T07:07:31.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.316353+0000", 2023-10-08T07:07:31.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8819999999999996e-06 2023-10-08T07:07:31.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.316357+0000", 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4410000000000003e-06 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.316361+0000", 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3459999999999998e-06 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.993 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124978 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.672378+0000", 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.075003641999999995, 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077476487999999996, 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124978 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.672378+0000", 2023-10-08T07:07:31.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.672378+0000", 2023-10-08T07:07:31.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.672378+0000", 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5499999999999999e-07 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.672388+0000", 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0226e-05 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.672396+0000", 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4989999999999997e-06 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:31.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.672400+0000", 2023-10-08T07:07:31.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6240000000000001e-06 2023-10-08T07:07:31.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.997 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:31.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:31.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.997 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125037 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:31.997 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.694473+0000", 2023-10-08T07:07:31.997 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.052908665000000001, 2023-10-08T07:07:31.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055439296999999998, 2023-10-08T07:07:31.998 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:31.998 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:31.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:31.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:31.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:31.998 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125037 2023-10-08T07:07:31.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.998 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:31.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:31.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.694473+0000", 2023-10-08T07:07:31.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:31.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.694473+0000", 2023-10-08T07:07:31.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:31.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:31.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:31.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.694473+0000", 2023-10-08T07:07:31.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1399999999999998e-07 2023-10-08T07:07:31.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:31.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.694482+0000", 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9709999999999993e-06 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.694486+0000", 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5250000000000001e-06 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.694488+0000", 2023-10-08T07:07:32.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8090000000000001e-06 2023-10-08T07:07:32.001 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.001 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.001 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.001 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125152 4.b 4:d0c991e0:::10000000004.0000002d:head [write 2621440~4096 in=4096b,write 2633728~4096 in=4096b,write 2691072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.001 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.728774+0000", 2023-10-08T07:07:32.001 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018607531, 2023-10-08T07:07:32.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021205295999999998, 2023-10-08T07:07:32.001 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.001 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:32.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.002 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.002 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.002 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125152 2023-10-08T07:07:32.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.002 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728774+0000", 2023-10-08T07:07:32.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728774+0000", 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728774+0000", 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6899999999999997e-07 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728799+0000", 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4742000000000001e-05 2023-10-08T07:07:32.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728806+0000", 2023-10-08T07:07:32.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9360000000000002e-06 2023-10-08T07:07:32.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728822+0000", 2023-10-08T07:07:32.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5738000000000001e-05 2023-10-08T07:07:32.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.743162+0000", 2023-10-08T07:07:32.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014339905999999999 2023-10-08T07:07:32.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.743244+0000", 2023-10-08T07:07:32.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2045000000000005e-05 2023-10-08T07:07:32.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:32.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.743384+0000", 2023-10-08T07:07:32.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013997 2023-10-08T07:07:32.006 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.006 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.006 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.006 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126514 4.20 e59/17 4:05b3915c:::10000000004.00000016:head v 59'5953, mlcod=59'5945)", 2023-10-08T07:07:32.006 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.743917+0000", 2023-10-08T07:07:32.006 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0034642140000000002, 2023-10-08T07:07:32.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061484690000000002, 2023-10-08T07:07:32.006 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.006 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.006 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.743917+0000", 2023-10-08T07:07:32.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.743917+0000", 2023-10-08T07:07:32.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.743918+0000", 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9100000000000004e-07 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.743931+0000", 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3570999999999999e-05 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.743941+0000", 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.876e-06 2023-10-08T07:07:32.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.743947+0000", 2023-10-08T07:07:32.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5369999999999997e-06 2023-10-08T07:07:32.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746561+0000", 2023-10-08T07:07:32.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026144649999999998 2023-10-08T07:07:32.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746580+0000", 2023-10-08T07:07:32.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8457e-05 2023-10-08T07:07:32.010 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.010 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.010 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.010 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:123985 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.010 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.235428+0000", 2023-10-08T07:07:32.010 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51195347000000002, 2023-10-08T07:07:32.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.51470860299999999, 2023-10-08T07:07:32.011 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.011 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.011 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.011 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.011 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.011 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 123985 2023-10-08T07:07:32.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.011 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.235428+0000", 2023-10-08T07:07:32.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.235428+0000", 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.239295+0000", 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038672789999999999 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.239318+0000", 2023-10-08T07:07:32.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2478999999999999e-05 2023-10-08T07:07:32.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.239329+0000", 2023-10-08T07:07:32.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1558e-05 2023-10-08T07:07:32.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.239337+0000", 2023-10-08T07:07:32.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7710000000000006e-06 2023-10-08T07:07:32.014 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.014 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.014 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.014 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124508 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.014 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.464377+0000", 2023-10-08T07:07:32.014 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.283004164, 2023-10-08T07:07:32.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.28582549299999999, 2023-10-08T07:07:32.014 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.014 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.015 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.015 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.015 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.015 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124508 2023-10-08T07:07:32.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.015 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.464377+0000", 2023-10-08T07:07:32.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.464377+0000", 2023-10-08T07:07:32.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.464378+0000", 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.06e-07 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.464389+0000", 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0975000000000001e-05 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.464395+0000", 2023-10-08T07:07:32.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9240000000000004e-06 2023-10-08T07:07:32.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.464400+0000", 2023-10-08T07:07:32.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1789999999999999e-06 2023-10-08T07:07:32.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.019 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.019 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124533 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.020 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.480362+0000", 2023-10-08T07:07:32.020 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26701910299999998, 2023-10-08T07:07:32.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.26991243999999998, 2023-10-08T07:07:32.020 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.020 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.020 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124533 2023-10-08T07:07:32.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.020 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480362+0000", 2023-10-08T07:07:32.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480362+0000", 2023-10-08T07:07:32.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480363+0000", 2023-10-08T07:07:32.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7000000000000001e-07 2023-10-08T07:07:32.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480372+0000", 2023-10-08T07:07:32.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7739999999999999e-06 2023-10-08T07:07:32.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480376+0000", 2023-10-08T07:07:32.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0300000000000004e-06 2023-10-08T07:07:32.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480379+0000", 2023-10-08T07:07:32.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9170000000000002e-06 2023-10-08T07:07:32.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.023 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.023 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124855 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.023 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.598538+0000", 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.148843062, 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.15180745900000001, 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124855 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.598538+0000", 2023-10-08T07:07:32.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.598538+0000", 2023-10-08T07:07:32.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.598539+0000", 2023-10-08T07:07:32.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2023-10-08T07:07:32.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.598550+0000", 2023-10-08T07:07:32.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1382e-05 2023-10-08T07:07:32.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.598557+0000", 2023-10-08T07:07:32.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3770000000000001e-06 2023-10-08T07:07:32.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.598562+0000", 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9049999999999996e-06 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124980 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.672407+0000", 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.07497471, 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.078002127000000004, 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.027 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.028 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124980 2023-10-08T07:07:32.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.028 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.672407+0000", 2023-10-08T07:07:32.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.672407+0000", 2023-10-08T07:07:32.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.672407+0000", 2023-10-08T07:07:32.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.58e-07 2023-10-08T07:07:32.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.672422+0000", 2023-10-08T07:07:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5231999999999999e-05 2023-10-08T07:07:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.672430+0000", 2023-10-08T07:07:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5209999999999997e-06 2023-10-08T07:07:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.672435+0000", 2023-10-08T07:07:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7389999999999999e-06 2023-10-08T07:07:32.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125154 4.b 4:d0c991e0:::10000000004.0000002d:head [write 1323008~4096 in=4096b,write 1335296~4096 in=4096b,write 1372160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.728829+0000", 2023-10-08T07:07:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018552132999999998, 2023-10-08T07:07:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021644779999999999, 2023-10-08T07:07:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.032 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125154 2023-10-08T07:07:32.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.032 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728829+0000", 2023-10-08T07:07:32.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728829+0000", 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728893+0000", 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4029000000000006e-05 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728909+0000", 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5310000000000001e-05 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728916+0000", 2023-10-08T07:07:32.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6410000000000002e-06 2023-10-08T07:07:32.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.728922+0000", 2023-10-08T07:07:32.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8490000000000002e-06 2023-10-08T07:07:32.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.744799+0000", 2023-10-08T07:07:32.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015877367999999999 2023-10-08T07:07:32.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.744844+0000", 2023-10-08T07:07:32.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4857000000000001e-05 2023-10-08T07:07:32.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:32.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.744930+0000", 2023-10-08T07:07:32.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5937000000000001e-05 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125172 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.740026+0000", 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0073555260000000003, 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010525006999999999, 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125172 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.740026+0000", 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.740026+0000", 2023-10-08T07:07:32.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.744296+0000", 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042703239999999998 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.744314+0000", 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7320999999999999e-05 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.744330+0000", 2023-10-08T07:07:32.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6192e-05 2023-10-08T07:07:32.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.744337+0000", 2023-10-08T07:07:32.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5850000000000002e-06 2023-10-08T07:07:32.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.039 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.040 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124342 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.040 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.380394+0000", 2023-10-08T07:07:32.040 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.36698761299999999, 2023-10-08T07:07:32.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.370211974, 2023-10-08T07:07:32.040 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.040 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.040 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124342 2023-10-08T07:07:32.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.040 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.380394+0000", 2023-10-08T07:07:32.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.380394+0000", 2023-10-08T07:07:32.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.380394+0000", 2023-10-08T07:07:32.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2500000000000001e-07 2023-10-08T07:07:32.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.380404+0000", 2023-10-08T07:07:32.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8430000000000005e-06 2023-10-08T07:07:32.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.380410+0000", 2023-10-08T07:07:32.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9359999999999996e-06 2023-10-08T07:07:32.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.380415+0000", 2023-10-08T07:07:32.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6369999999999998e-06 2023-10-08T07:07:32.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.043 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.043 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125110 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.720424+0000", 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026957874999999999, 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.030239496000000001, 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125110 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.720424+0000", 2023-10-08T07:07:32.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.720424+0000", 2023-10-08T07:07:32.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.720424+0000", 2023-10-08T07:07:32.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.37e-07 2023-10-08T07:07:32.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.720435+0000", 2023-10-08T07:07:32.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1241e-05 2023-10-08T07:07:32.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.720442+0000", 2023-10-08T07:07:32.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7710000000000001e-06 2023-10-08T07:07:32.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.720450+0000", 2023-10-08T07:07:32.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7409999999999992e-06 2023-10-08T07:07:32.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.047 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.048 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126522 4.30 e59/17 4:0f322a22:::10000000004.00000014:head v 59'1997, mlcod=59'1993)", 2023-10-08T07:07:32.048 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.745374+0000", 2023-10-08T07:07:32.048 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00200695, 2023-10-08T07:07:32.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0053822840000000002, 2023-10-08T07:07:32.048 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.048 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.048 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.745374+0000", 2023-10-08T07:07:32.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.745374+0000", 2023-10-08T07:07:32.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.745375+0000", 2023-10-08T07:07:32.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5099999999999999e-07 2023-10-08T07:07:32.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.745389+0000", 2023-10-08T07:07:32.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3811e-05 2023-10-08T07:07:32.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.745402+0000", 2023-10-08T07:07:32.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2887999999999999e-05 2023-10-08T07:07:32.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.745409+0000", 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3889999999999999e-06 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.748766+0000", 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033569120000000001 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.748784+0000", 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8380999999999999e-05 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.051 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.052 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124080 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.052 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.276359+0000", 2023-10-08T07:07:32.052 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47102240099999998, 2023-10-08T07:07:32.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47446487799999998, 2023-10-08T07:07:32.052 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.052 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124080 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.276359+0000", 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.276359+0000", 2023-10-08T07:07:32.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.276360+0000", 2023-10-08T07:07:32.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2023-10-08T07:07:32.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.276372+0000", 2023-10-08T07:07:32.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2972e-05 2023-10-08T07:07:32.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.276379+0000", 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6660000000000002e-06 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.276384+0000", 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8810000000000004e-06 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124343 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.380421+0000", 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.36696036900000001, 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.37046676099999998, 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124343 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.056 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.380421+0000", 2023-10-08T07:07:32.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.380421+0000", 2023-10-08T07:07:32.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.380421+0000", 2023-10-08T07:07:32.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.58e-07 2023-10-08T07:07:32.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.380437+0000", 2023-10-08T07:07:32.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5167000000000001e-05 2023-10-08T07:07:32.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.380442+0000", 2023-10-08T07:07:32.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8810000000000001e-06 2023-10-08T07:07:32.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.380447+0000", 2023-10-08T07:07:32.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4880000000000001e-06 2023-10-08T07:07:32.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.059 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.059 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124536 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.059 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.480411+0000", 2023-10-08T07:07:32.060 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26697053100000001, 2023-10-08T07:07:32.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27050947199999997, 2023-10-08T07:07:32.060 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.060 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.060 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124536 2023-10-08T07:07:32.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.060 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480411+0000", 2023-10-08T07:07:32.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480411+0000", 2023-10-08T07:07:32.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480411+0000", 2023-10-08T07:07:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1600000000000002e-07 2023-10-08T07:07:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480428+0000", 2023-10-08T07:07:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7e-05 2023-10-08T07:07:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480435+0000", 2023-10-08T07:07:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2310000000000001e-06 2023-10-08T07:07:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480440+0000", 2023-10-08T07:07:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0719999999999999e-06 2023-10-08T07:07:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124656 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.517396+0000", 2023-10-08T07:07:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.22998559099999999, 2023-10-08T07:07:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23355693899999999, 2023-10-08T07:07:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124656 2023-10-08T07:07:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517396+0000", 2023-10-08T07:07:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517396+0000", 2023-10-08T07:07:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517396+0000", 2023-10-08T07:07:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3300000000000003e-07 2023-10-08T07:07:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517408+0000", 2023-10-08T07:07:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1503e-05 2023-10-08T07:07:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517414+0000", 2023-10-08T07:07:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3400000000000003e-06 2023-10-08T07:07:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517420+0000", 2023-10-08T07:07:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2759999999999997e-06 2023-10-08T07:07:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124684 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.531363+0000", 2023-10-08T07:07:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.21601822500000001, 2023-10-08T07:07:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.21962077599999999, 2023-10-08T07:07:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124684 2023-10-08T07:07:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.531363+0000", 2023-10-08T07:07:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.531363+0000", 2023-10-08T07:07:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.531363+0000", 2023-10-08T07:07:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1e-07 2023-10-08T07:07:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.531379+0000", 2023-10-08T07:07:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5577e-05 2023-10-08T07:07:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.531383+0000", 2023-10-08T07:07:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0550000000000001e-06 2023-10-08T07:07:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.531386+0000", 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9000000000000002e-06 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124878 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.617435+0000", 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.129946266, 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13358235600000001, 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124878 2023-10-08T07:07:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.617435+0000", 2023-10-08T07:07:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.617435+0000", 2023-10-08T07:07:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.619296+0000", 2023-10-08T07:07:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018609810000000001 2023-10-08T07:07:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.619315+0000", 2023-10-08T07:07:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8933999999999999e-05 2023-10-08T07:07:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.619325+0000", 2023-10-08T07:07:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0073e-05 2023-10-08T07:07:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.619333+0000", 2023-10-08T07:07:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6920000000000002e-06 2023-10-08T07:07:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124903 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.634002+0000", 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.113379391, 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.117046968, 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124903 2023-10-08T07:07:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.634002+0000", 2023-10-08T07:07:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.634002+0000", 2023-10-08T07:07:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.637294+0000", 2023-10-08T07:07:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032921589999999998 2023-10-08T07:07:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.637310+0000", 2023-10-08T07:07:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5798999999999999e-05 2023-10-08T07:07:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.637322+0000", 2023-10-08T07:07:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2463000000000001e-05 2023-10-08T07:07:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.637330+0000", 2023-10-08T07:07:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3499999999999999e-06 2023-10-08T07:07:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126457 4.20 e59/17 4:04004f2c:::10000000004.0000000d:head v 59'5950, mlcod=59'5941)", 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.729171+0000", 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018210857, 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021921030000000001, 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.729171+0000", 2023-10-08T07:07:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.729171+0000", 2023-10-08T07:07:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.729171+0000", 2023-10-08T07:07:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3500000000000002e-07 2023-10-08T07:07:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.729191+0000", 2023-10-08T07:07:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9813000000000002e-05 2023-10-08T07:07:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.729200+0000", 2023-10-08T07:07:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7299999999999994e-06 2023-10-08T07:07:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.729206+0000", 2023-10-08T07:07:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8260000000000004e-06 2023-10-08T07:07:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.735412+0000", 2023-10-08T07:07:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062054049999999998 2023-10-08T07:07:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.735429+0000", 2023-10-08T07:07:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7351e-05 2023-10-08T07:07:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125174 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.744352+0000", 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0030291879999999999, 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067857259999999997, 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125174 2023-10-08T07:07:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.744352+0000", 2023-10-08T07:07:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.744352+0000", 2023-10-08T07:07:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746294+0000", 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019415529999999999 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746314+0000", 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9981000000000001e-05 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746325+0000", 2023-10-08T07:07:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1328999999999999e-05 2023-10-08T07:07:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746333+0000", 2023-10-08T07:07:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9610000000000005e-06 2023-10-08T07:07:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124373 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.397628+0000", 2023-10-08T07:07:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.34975349300000003, 2023-10-08T07:07:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.35354655400000001, 2023-10-08T07:07:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124373 2023-10-08T07:07:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.397628+0000", 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.397628+0000", 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.397629+0000", 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9999999999999997e-07 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.397640+0000", 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1266e-05 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.397648+0000", 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7589999999999997e-06 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.397652+0000", 2023-10-08T07:07:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8400000000000002e-06 2023-10-08T07:07:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125175 4.15 4:aaa619cf:::10000000004.00000004:head [write 3919872~4096 in=4096b,write 4091904~4096 in=4096b,write 4124672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.746346+0000", 2023-10-08T07:07:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001035235, 2023-10-08T07:07:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048726480000000003, 2023-10-08T07:07:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125175 2023-10-08T07:07:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746346+0000", 2023-10-08T07:07:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746346+0000", 2023-10-08T07:07:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746347+0000", 2023-10-08T07:07:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2023-10-08T07:07:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746359+0000", 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2235999999999999e-05 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746388+0000", 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8673000000000001e-05 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746393+0000", 2023-10-08T07:07:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1100000000000002e-06 2023-10-08T07:07:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746436+0000", 2023-10-08T07:07:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3359999999999998e-05 2023-10-08T07:07:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746865+0000", 2023-10-08T07:07:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000429219 2023-10-08T07:07:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:123954 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.227347+0000", 2023-10-08T07:07:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.52003462899999997, 2023-10-08T07:07:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.523926793, 2023-10-08T07:07:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.095 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 123954 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227347+0000", 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227347+0000", 2023-10-08T07:07:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227347+0000", 2023-10-08T07:07:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2023-10-08T07:07:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227372+0000", 2023-10-08T07:07:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4162e-05 2023-10-08T07:07:32.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227379+0000", 2023-10-08T07:07:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2023-10-08T07:07:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227384+0000", 2023-10-08T07:07:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5249999999999996e-06 2023-10-08T07:07:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.098 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124450 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.438343+0000", 2023-10-08T07:07:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.30903829900000002, 2023-10-08T07:07:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.31297486000000002, 2023-10-08T07:07:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124450 2023-10-08T07:07:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.438343+0000", 2023-10-08T07:07:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.438343+0000", 2023-10-08T07:07:32.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.438343+0000", 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9499999999999998e-07 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.438355+0000", 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1919000000000001e-05 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.438361+0000", 2023-10-08T07:07:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0980000000000001e-06 2023-10-08T07:07:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.438364+0000", 2023-10-08T07:07:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1879999999999998e-06 2023-10-08T07:07:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124657 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.517427+0000", 2023-10-08T07:07:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.2299544, 2023-10-08T07:07:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23393650099999999, 2023-10-08T07:07:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.103 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124657 2023-10-08T07:07:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517427+0000", 2023-10-08T07:07:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517427+0000", 2023-10-08T07:07:32.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.519295+0000", 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001868211 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.519313+0000", 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7411999999999999e-05 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.519325+0000", 2023-10-08T07:07:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2437e-05 2023-10-08T07:07:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.519332+0000", 2023-10-08T07:07:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4059999999999999e-06 2023-10-08T07:07:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124943 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.651676+0000", 2023-10-08T07:07:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.095705839000000001, 2023-10-08T07:07:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.099743188999999996, 2023-10-08T07:07:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.107 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124943 2023-10-08T07:07:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.651676+0000", 2023-10-08T07:07:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.651676+0000", 2023-10-08T07:07:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.653297+0000", 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016219190000000001 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.653322+0000", 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4800999999999999e-05 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.653334+0000", 2023-10-08T07:07:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1293e-05 2023-10-08T07:07:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.653340+0000", 2023-10-08T07:07:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7240000000000003e-06 2023-10-08T07:07:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.110 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125176 4.b 4.789930b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.746403+0000", 2023-10-08T07:07:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00097813599999999989, 2023-10-08T07:07:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005079648, 2023-10-08T07:07:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125176 2023-10-08T07:07:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746403+0000", 2023-10-08T07:07:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746403+0000", 2023-10-08T07:07:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746404+0000", 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746423+0000", 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9517999999999998e-05 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746430+0000", 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.109e-06 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746436+0000", 2023-10-08T07:07:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4609999999999999e-06 2023-10-08T07:07:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:123957 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.227394+0000", 2023-10-08T07:07:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51998741199999998, 2023-10-08T07:07:32.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.52415562900000001, 2023-10-08T07:07:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 123957 2023-10-08T07:07:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227394+0000", 2023-10-08T07:07:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227394+0000", 2023-10-08T07:07:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227395+0000", 2023-10-08T07:07:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3000000000000001e-07 2023-10-08T07:07:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227407+0000", 2023-10-08T07:07:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833999999999999e-05 2023-10-08T07:07:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227414+0000", 2023-10-08T07:07:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6969999999999996e-06 2023-10-08T07:07:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227419+0000", 2023-10-08T07:07:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0950000000000003e-06 2023-10-08T07:07:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.118 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125117 4.b 4:d0c991e0:::10000000004.0000002d:head [write 1761280~4096 in=4096b,write 2146304~4096 in=4096b,write 2244608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.720841+0000", 2023-10-08T07:07:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026540613000000001, 2023-10-08T07:07:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.030770914, 2023-10-08T07:07:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.119 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125117 2023-10-08T07:07:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.720841+0000", 2023-10-08T07:07:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.720841+0000", 2023-10-08T07:07:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722297+0000", 2023-10-08T07:07:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014559670000000001 2023-10-08T07:07:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722315+0000", 2023-10-08T07:07:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7771e-05 2023-10-08T07:07:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722324+0000", 2023-10-08T07:07:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8090000000000004e-06 2023-10-08T07:07:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722332+0000", 2023-10-08T07:07:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5700000000000004e-06 2023-10-08T07:07:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.733047+0000", 2023-10-08T07:07:32.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010714787999999999 2023-10-08T07:07:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.733127+0000", 2023-10-08T07:07:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0774999999999998e-05 2023-10-08T07:07:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.733271+0000", 2023-10-08T07:07:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014336399999999999 2023-10-08T07:07:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.743044+0000", 2023-10-08T07:07:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097728079999999991 2023-10-08T07:07:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125179 4.26 4:672c55ca:::10000000004.00000006:head [write 2732032~4096 in=4096b,write 2826240~4096 in=4096b,write 2838528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.746446+0000", 2023-10-08T07:07:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00093546099999999995, 2023-10-08T07:07:32.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052138849999999997, 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125179 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746446+0000", 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746446+0000", 2023-10-08T07:07:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746446+0000", 2023-10-08T07:07:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000005e-07 2023-10-08T07:07:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746464+0000", 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7340999999999999e-05 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746470+0000", 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3500000000000002e-06 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746476+0000", 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7860000000000002e-06 2023-10-08T07:07:32.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746560+0000", 2023-10-08T07:07:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3714999999999994e-05 2023-10-08T07:07:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746629+0000", 2023-10-08T07:07:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9692999999999998e-05 2023-10-08T07:07:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746793+0000", 2023-10-08T07:07:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000163852 2023-10-08T07:07:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:123960 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.227426+0000", 2023-10-08T07:07:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.519954951, 2023-10-08T07:07:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.52427358499999999, 2023-10-08T07:07:32.129 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 123960 2023-10-08T07:07:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227426+0000", 2023-10-08T07:07:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227426+0000", 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227427+0000", 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2399999999999998e-07 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227447+0000", 2023-10-08T07:07:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0449e-05 2023-10-08T07:07:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227458+0000", 2023-10-08T07:07:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0876999999999999e-05 2023-10-08T07:07:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.227464+0000", 2023-10-08T07:07:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6099999999999997e-06 2023-10-08T07:07:32.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124261 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.346463+0000", 2023-10-08T07:07:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.400918622, 2023-10-08T07:07:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40526622000000001, 2023-10-08T07:07:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124261 2023-10-08T07:07:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.346463+0000", 2023-10-08T07:07:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.346463+0000", 2023-10-08T07:07:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.346463+0000", 2023-10-08T07:07:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:07:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.346473+0000", 2023-10-08T07:07:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0005e-05 2023-10-08T07:07:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.346479+0000", 2023-10-08T07:07:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8130000000000001e-06 2023-10-08T07:07:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.346483+0000", 2023-10-08T07:07:32.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5260000000000004e-06 2023-10-08T07:07:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124834 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.586342+0000", 2023-10-08T07:07:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.161039301, 2023-10-08T07:07:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.165417229, 2023-10-08T07:07:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124834 2023-10-08T07:07:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.586342+0000", 2023-10-08T07:07:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.586342+0000", 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.586343+0000", 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9100000000000004e-07 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.586357+0000", 2023-10-08T07:07:32.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4099e-05 2023-10-08T07:07:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.586363+0000", 2023-10-08T07:07:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5810000000000002e-06 2023-10-08T07:07:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.586369+0000", 2023-10-08T07:07:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7350000000000001e-06 2023-10-08T07:07:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125118 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.722346+0000", 2023-10-08T07:07:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.025035575000000001, 2023-10-08T07:07:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.029442627999999998, 2023-10-08T07:07:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125118 2023-10-08T07:07:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722346+0000", 2023-10-08T07:07:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722346+0000", 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722346+0000", 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722360+0000", 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4079e-05 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722367+0000", 2023-10-08T07:07:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.781e-06 2023-10-08T07:07:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722373+0000", 2023-10-08T07:07:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7450000000000001e-06 2023-10-08T07:07:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126482 4.20 e59/17 4:07572838:::10000000004.00000010:head v 59'5951, mlcod=59'5941)", 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.733702+0000", 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013679037, 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01811747, 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.733702+0000", 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.733702+0000", 2023-10-08T07:07:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.733703+0000", 2023-10-08T07:07:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0800000000000001e-07 2023-10-08T07:07:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.733717+0000", 2023-10-08T07:07:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4119e-05 2023-10-08T07:07:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.733723+0000", 2023-10-08T07:07:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6409999999999996e-06 2023-10-08T07:07:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.733730+0000", 2023-10-08T07:07:32.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4679999999999997e-06 2023-10-08T07:07:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.740127+0000", 2023-10-08T07:07:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063973729999999996 2023-10-08T07:07:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.740145+0000", 2023-10-08T07:07:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7621e-05 2023-10-08T07:07:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.148 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126526 4.3a e59/17 4:5f183e4b:::10000000004.00000023:head v 59'5766, mlcod=59'5763)", 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.746626+0000", 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00075517800000000001, 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052264110000000003, 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746626+0000", 2023-10-08T07:07:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746626+0000", 2023-10-08T07:07:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746627+0000", 2023-10-08T07:07:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3399999999999999e-07 2023-10-08T07:07:32.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746642+0000", 2023-10-08T07:07:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4759999999999999e-05 2023-10-08T07:07:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746649+0000", 2023-10-08T07:07:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5989999999999996e-06 2023-10-08T07:07:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746655+0000", 2023-10-08T07:07:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2310000000000001e-06 2023-10-08T07:07:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746776+0000", 2023-10-08T07:07:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120825 2023-10-08T07:07:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746793+0000", 2023-10-08T07:07:32.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6699000000000001e-05 2023-10-08T07:07:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124055 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.262355+0000", 2023-10-08T07:07:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48502680799999998, 2023-10-08T07:07:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48953182000000001, 2023-10-08T07:07:32.153 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124055 2023-10-08T07:07:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.262355+0000", 2023-10-08T07:07:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.262355+0000", 2023-10-08T07:07:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.266294+0000", 2023-10-08T07:07:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039398640000000004 2023-10-08T07:07:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.266309+0000", 2023-10-08T07:07:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4756000000000001e-05 2023-10-08T07:07:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.266322+0000", 2023-10-08T07:07:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.271e-05 2023-10-08T07:07:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.266331+0000", 2023-10-08T07:07:32.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0119999999999994e-06 2023-10-08T07:07:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124433 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.428389+0000", 2023-10-08T07:07:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.31899204399999997, 2023-10-08T07:07:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32352672799999999, 2023-10-08T07:07:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124433 2023-10-08T07:07:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.428389+0000", 2023-10-08T07:07:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.428389+0000", 2023-10-08T07:07:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.428390+0000", 2023-10-08T07:07:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5499999999999999e-07 2023-10-08T07:07:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.428399+0000", 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9770000000000006e-06 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.428405+0000", 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9900000000000002e-06 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.428409+0000", 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1160000000000001e-06 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124544 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.480591+0000", 2023-10-08T07:07:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.266790586, 2023-10-08T07:07:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27135578500000002, 2023-10-08T07:07:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124544 2023-10-08T07:07:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480591+0000", 2023-10-08T07:07:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480591+0000", 2023-10-08T07:07:32.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480591+0000", 2023-10-08T07:07:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3000000000000001e-07 2023-10-08T07:07:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480602+0000", 2023-10-08T07:07:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0852e-05 2023-10-08T07:07:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480609+0000", 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6089999999999997e-06 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480614+0000", 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3700000000000003e-06 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125042 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.694511+0000", 2023-10-08T07:07:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.052870729999999998, 2023-10-08T07:07:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057474694999999999, 2023-10-08T07:07:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125042 2023-10-08T07:07:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.165 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.694511+0000", 2023-10-08T07:07:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.694511+0000", 2023-10-08T07:07:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.699462+0000", 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049514290000000002 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.699485+0000", 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2694999999999999e-05 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.699495+0000", 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0562e-05 2023-10-08T07:07:32.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.699503+0000", 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7519999999999996e-06 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126435 4.1b e59/17 4:d97fb168:::10000000004.00000008:head v 59'3990, mlcod=59'3987)", 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.722368+0000", 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.025013695999999998, 2023-10-08T07:07:32.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.029672717000000001, 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722368+0000", 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722368+0000", 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722368+0000", 2023-10-08T07:07:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6899999999999996e-07 2023-10-08T07:07:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722386+0000", 2023-10-08T07:07:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7448e-05 2023-10-08T07:07:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722397+0000", 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0706999999999999e-05 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722404+0000", 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1049999999999997e-06 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.724854+0000", 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002450182 2023-10-08T07:07:32.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.724873+0000", 2023-10-08T07:07:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9555000000000002e-05 2023-10-08T07:07:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4556.0:125164 4.26 e59/17)", 2023-10-08T07:07:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.746674+0000", 2023-10-08T07:07:32.172 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00070727699999999997, 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054295840000000003, 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746674+0000", 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746674+0000", 2023-10-08T07:07:32.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746674+0000", 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4200000000000002e-07 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746677+0000", 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5490000000000001e-06 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746683+0000", 2023-10-08T07:07:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3509999999999998e-06 2023-10-08T07:07:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746688+0000", 2023-10-08T07:07:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339999999999997e-06 2023-10-08T07:07:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124598 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.496393+0000", 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.25098857499999999, 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.255762078, 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124598 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496393+0000", 2023-10-08T07:07:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496393+0000", 2023-10-08T07:07:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496393+0000", 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7800000000000001e-07 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496407+0000", 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3529999999999999e-05 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496415+0000", 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9589999999999995e-06 2023-10-08T07:07:32.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496421+0000", 2023-10-08T07:07:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7339999999999996e-06 2023-10-08T07:07:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126434 4.2b e59/17 4:d776c1c9:::10000000004.0000003d:head v 59'3995, mlcod=59'3989)", 2023-10-08T07:07:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.722439+0000", 2023-10-08T07:07:32.179 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.024942158999999998, 2023-10-08T07:07:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.029776985999999998, 2023-10-08T07:07:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722439+0000", 2023-10-08T07:07:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722439+0000", 2023-10-08T07:07:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722440+0000", 2023-10-08T07:07:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7500000000000001e-07 2023-10-08T07:07:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722456+0000", 2023-10-08T07:07:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6711e-05 2023-10-08T07:07:32.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722463+0000", 2023-10-08T07:07:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.764e-06 2023-10-08T07:07:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722468+0000", 2023-10-08T07:07:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1730000000000003e-06 2023-10-08T07:07:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.724932+0000", 2023-10-08T07:07:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024637729999999998 2023-10-08T07:07:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.724951+0000", 2023-10-08T07:07:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9205999999999999e-05 2023-10-08T07:07:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4556.0:125166 4.26 e59/17)", 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.746701+0000", 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00068074400000000005, 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055762620000000002, 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746701+0000", 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746701+0000", 2023-10-08T07:07:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746701+0000", 2023-10-08T07:07:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4999999999999998e-07 2023-10-08T07:07:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746704+0000", 2023-10-08T07:07:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.509e-06 2023-10-08T07:07:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746709+0000", 2023-10-08T07:07:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6980000000000003e-06 2023-10-08T07:07:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746714+0000", 2023-10-08T07:07:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7659999999999998e-06 2023-10-08T07:07:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124086 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.278380+0000", 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.46900101199999999, 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47395514900000002, 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124086 2023-10-08T07:07:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.278380+0000", 2023-10-08T07:07:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.278380+0000", 2023-10-08T07:07:32.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280294+0000", 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019139750000000001 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280312+0000", 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7490999999999999e-05 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280325+0000", 2023-10-08T07:07:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3088000000000001e-05 2023-10-08T07:07:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280332+0000", 2023-10-08T07:07:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2023-10-08T07:07:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124487 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.452347+0000", 2023-10-08T07:07:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.295033979, 2023-10-08T07:07:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.30004776399999999, 2023-10-08T07:07:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124487 2023-10-08T07:07:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.191 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.452347+0000", 2023-10-08T07:07:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.452347+0000", 2023-10-08T07:07:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.452348+0000", 2023-10-08T07:07:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0699999999999997e-07 2023-10-08T07:07:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.452360+0000", 2023-10-08T07:07:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1501999999999999e-05 2023-10-08T07:07:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.452368+0000", 2023-10-08T07:07:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0669999999999992e-06 2023-10-08T07:07:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.452373+0000", 2023-10-08T07:07:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2429999999999996e-06 2023-10-08T07:07:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4556.0:125152 4.b e59/17)", 2023-10-08T07:07:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.747089+0000", 2023-10-08T07:07:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00029276200000000001, 2023-10-08T07:07:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005373849, 2023-10-08T07:07:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.747089+0000", 2023-10-08T07:07:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.747089+0000", 2023-10-08T07:07:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.747089+0000", 2023-10-08T07:07:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5199999999999996e-07 2023-10-08T07:07:32.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.747093+0000", 2023-10-08T07:07:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5549999999999998e-06 2023-10-08T07:07:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.747103+0000", 2023-10-08T07:07:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0129000000000001e-05 2023-10-08T07:07:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.747110+0000", 2023-10-08T07:07:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2239999999999998e-06 2023-10-08T07:07:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124087 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.280346+0000", 2023-10-08T07:07:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.46703535800000001, 2023-10-08T07:07:32.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47217455000000003, 2023-10-08T07:07:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124087 2023-10-08T07:07:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280346+0000", 2023-10-08T07:07:32.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280346+0000", 2023-10-08T07:07:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280347+0000", 2023-10-08T07:07:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2023-10-08T07:07:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280372+0000", 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5931e-05 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280380+0000", 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4599999999999997e-06 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280385+0000", 2023-10-08T07:07:32.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1540000000000001e-06 2023-10-08T07:07:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124514 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.464476+0000", 2023-10-08T07:07:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28290562800000002, 2023-10-08T07:07:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.288107522, 2023-10-08T07:07:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.202 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124514 2023-10-08T07:07:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.464476+0000", 2023-10-08T07:07:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.464476+0000", 2023-10-08T07:07:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.472295+0000", 2023-10-08T07:07:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078196120000000001 2023-10-08T07:07:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.472319+0000", 2023-10-08T07:07:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3459e-05 2023-10-08T07:07:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.472330+0000", 2023-10-08T07:07:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0906e-05 2023-10-08T07:07:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.472338+0000", 2023-10-08T07:07:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8509999999999999e-06 2023-10-08T07:07:32.205 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124766 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.560425+0000", 2023-10-08T07:07:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18695679800000001, 2023-10-08T07:07:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19222225700000001, 2023-10-08T07:07:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.206 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124766 2023-10-08T07:07:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.560425+0000", 2023-10-08T07:07:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.560425+0000", 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.560425+0000", 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6800000000000001e-07 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.560439+0000", 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4344e-05 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.560446+0000", 2023-10-08T07:07:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8109999999999997e-06 2023-10-08T07:07:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.560452+0000", 2023-10-08T07:07:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469999999999997e-06 2023-10-08T07:07:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126440 4.1b e59/17 4:dbb7dde6:::10000000004.0000002c:head v 59'3991, mlcod=59'3987)", 2023-10-08T07:07:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.722524+0000", 2023-10-08T07:07:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.024857659000000001, 2023-10-08T07:07:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.030194993, 2023-10-08T07:07:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722524+0000", 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722524+0000", 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722524+0000", 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6399999999999998e-07 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722535+0000", 2023-10-08T07:07:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1351e-05 2023-10-08T07:07:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722542+0000", 2023-10-08T07:07:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8580000000000002e-06 2023-10-08T07:07:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722547+0000", 2023-10-08T07:07:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.206e-06 2023-10-08T07:07:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.727201+0000", 2023-10-08T07:07:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046541689999999997 2023-10-08T07:07:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.727218+0000", 2023-10-08T07:07:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7028e-05 2023-10-08T07:07:32.213 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126533 4.c e59/17 4:3352c333:::10000000004.00000012:head v 59'4012, mlcod=59'4010)", 2023-10-08T07:07:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.748351+0000", 2023-10-08T07:07:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9990301, 2023-10-08T07:07:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044444799999999998, 2023-10-08T07:07:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.748351+0000", 2023-10-08T07:07:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.748351+0000", 2023-10-08T07:07:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.748352+0000", 2023-10-08T07:07:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5499999999999998e-07 2023-10-08T07:07:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.748367+0000", 2023-10-08T07:07:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5036e-05 2023-10-08T07:07:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.748376+0000", 2023-10-08T07:07:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2669999999999995e-06 2023-10-08T07:07:32.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.748383+0000", 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7920000000000004e-06 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.748445+0000", 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1803000000000004e-05 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.748464+0000", 2023-10-08T07:07:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9052e-05 2023-10-08T07:07:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124348 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.383038+0000", 2023-10-08T07:07:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.36434343000000002, 2023-10-08T07:07:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.36982757999999999, 2023-10-08T07:07:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.218 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124348 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.383038+0000", 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.383038+0000", 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.384294+0000", 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012557180000000001 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.384307+0000", 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3644e-05 2023-10-08T07:07:32.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.384318+0000", 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0834e-05 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.384325+0000", 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1760000000000004e-06 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124457 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.440345+0000", 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.30703657899999998, 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.31258562699999998, 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124457 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.222 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.440345+0000", 2023-10-08T07:07:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.440345+0000", 2023-10-08T07:07:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.440345+0000", 2023-10-08T07:07:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2e-07 2023-10-08T07:07:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.440354+0000", 2023-10-08T07:07:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7919999999999998e-06 2023-10-08T07:07:32.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.440360+0000", 2023-10-08T07:07:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5380000000000002e-06 2023-10-08T07:07:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.440363+0000", 2023-10-08T07:07:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6619999999999998e-06 2023-10-08T07:07:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124670 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.521548+0000", 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.22583320000000001, 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23144682899999999, 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124670 2023-10-08T07:07:32.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521548+0000", 2023-10-08T07:07:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521548+0000", 2023-10-08T07:07:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521549+0000", 2023-10-08T07:07:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.879999999999999e-07 2023-10-08T07:07:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521599+0000", 2023-10-08T07:07:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9901999999999998e-05 2023-10-08T07:07:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521617+0000", 2023-10-08T07:07:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8184000000000001e-05 2023-10-08T07:07:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521625+0000", 2023-10-08T07:07:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8849999999999999e-06 2023-10-08T07:07:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.230 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124887 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.621500+0000", 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.12588158799999999, 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13156363300000001, 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124887 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.621500+0000", 2023-10-08T07:07:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.621500+0000", 2023-10-08T07:07:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.621500+0000", 2023-10-08T07:07:32.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4900000000000001e-07 2023-10-08T07:07:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.621514+0000", 2023-10-08T07:07:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3981e-05 2023-10-08T07:07:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.621521+0000", 2023-10-08T07:07:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2023-10-08T07:07:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.621526+0000", 2023-10-08T07:07:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4639999999999997e-06 2023-10-08T07:07:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126445 4.1b e59/17 4:dbb7dde6:::10000000004.0000002c:head v 59'3992, mlcod=59'3987)", 2023-10-08T07:07:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.722589+0000", 2023-10-08T07:07:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.024792756999999999, 2023-10-08T07:07:32.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.030539364999999999, 2023-10-08T07:07:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722589+0000", 2023-10-08T07:07:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722589+0000", 2023-10-08T07:07:32.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722589+0000", 2023-10-08T07:07:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4700000000000002e-07 2023-10-08T07:07:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722601+0000", 2023-10-08T07:07:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1805e-05 2023-10-08T07:07:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722607+0000", 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6830000000000002e-06 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.722612+0000", 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4440000000000001e-06 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.730359+0000", 2023-10-08T07:07:32.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077470810000000003 2023-10-08T07:07:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.730386+0000", 2023-10-08T07:07:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6957e-05 2023-10-08T07:07:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125181 4.16 4:69eefec8:::10000000004.0000003a:head [write 3141632~4096 in=4096b,write 3162112~4096 in=4096b,write 3239936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.238 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.746490+0000", 2023-10-08T07:07:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00089175300000000001, 2023-10-08T07:07:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067167570000000003, 2023-10-08T07:07:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125181 2023-10-08T07:07:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746490+0000", 2023-10-08T07:07:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746490+0000", 2023-10-08T07:07:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.749670+0000", 2023-10-08T07:07:32.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031801440000000002 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.749694+0000", 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4547999999999999e-05 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.749704+0000", 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0114e-05 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.749712+0000", 2023-10-08T07:07:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1659999999999997e-06 2023-10-08T07:07:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752506+0000", 2023-10-08T07:07:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027939660000000002 2023-10-08T07:07:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752802+0000", 2023-10-08T07:07:32.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029594099999999998 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752947+0000", 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014576899999999999 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124554 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.480759+0000", 2023-10-08T07:07:32.243 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26662253000000002, 2023-10-08T07:07:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27254585199999998, 2023-10-08T07:07:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124554 2023-10-08T07:07:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480759+0000", 2023-10-08T07:07:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480759+0000", 2023-10-08T07:07:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480759+0000", 2023-10-08T07:07:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3500000000000002e-07 2023-10-08T07:07:32.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480775+0000", 2023-10-08T07:07:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5395000000000001e-05 2023-10-08T07:07:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480782+0000", 2023-10-08T07:07:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2840000000000001e-06 2023-10-08T07:07:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.480787+0000", 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1189999999999996e-06 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124671 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.521636+0000", 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.225745852, 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23174471899999999, 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.247 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124671 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521636+0000", 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521636+0000", 2023-10-08T07:07:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521636+0000", 2023-10-08T07:07:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6599999999999996e-07 2023-10-08T07:07:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521651+0000", 2023-10-08T07:07:32.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4341999999999999e-05 2023-10-08T07:07:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521658+0000", 2023-10-08T07:07:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2509999999999997e-06 2023-10-08T07:07:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521664+0000", 2023-10-08T07:07:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3219999999999998e-06 2023-10-08T07:07:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.250 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124801 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.573713+0000", 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.17366878099999999, 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17973828, 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.251 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124801 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.573713+0000", 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.573713+0000", 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.576427+0000", 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027142820000000002 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.576445+0000", 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8598e-05 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.576457+0000", 2023-10-08T07:07:32.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1019000000000001e-05 2023-10-08T07:07:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.576464+0000", 2023-10-08T07:07:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3130000000000001e-06 2023-10-08T07:07:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125088 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.254 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.714350+0000", 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.033031533000000002, 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039171883999999997, 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125088 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.714350+0000", 2023-10-08T07:07:32.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.714350+0000", 2023-10-08T07:07:32.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.714351+0000", 2023-10-08T07:07:32.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8299999999999996e-07 2023-10-08T07:07:32.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.714367+0000", 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6609e-05 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.714375+0000", 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5089999999999996e-06 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.714381+0000", 2023-10-08T07:07:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9569999999999999e-06 2023-10-08T07:07:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125187 4.31 4:8ec1b377:::10000000004.00000019:head [write 1519616~4096 in=4096b,write 1589248~4096 in=4096b,write 1634304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.749726+0000", 2023-10-08T07:07:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9976554, 2023-10-08T07:07:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038654380000000001, 2023-10-08T07:07:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.258 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:32.259 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.259 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.259 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.259 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125187 2023-10-08T07:07:32.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.259 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.749726+0000", 2023-10-08T07:07:32.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.749726+0000", 2023-10-08T07:07:32.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.749727+0000", 2023-10-08T07:07:32.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2023-10-08T07:07:32.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.749739+0000", 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2344000000000001e-05 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.749747+0000", 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5989999999999996e-06 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.749752+0000", 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2460000000000003e-06 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750916+0000", 2023-10-08T07:07:32.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001163996 2023-10-08T07:07:32.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750995+0000", 2023-10-08T07:07:32.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.907e-05 2023-10-08T07:07:32.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:32.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.751168+0000", 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000173148 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125124 4.3b 4:df82de1b:::10000000004.0000000f:head [write 1925120~4096 in=4096b,write 2002944~4096 in=4096b,write 2035712~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.724346+0000", 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.023035096000000001, 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.02934968, 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.264 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.264 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.264 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125124 2023-10-08T07:07:32.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.264 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.724346+0000", 2023-10-08T07:07:32.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.724346+0000", 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.724347+0000", 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4300000000000003e-07 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.724359+0000", 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2114e-05 2023-10-08T07:07:32.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.724366+0000", 2023-10-08T07:07:32.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9369999999999998e-06 2023-10-08T07:07:32.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.724372+0000", 2023-10-08T07:07:32.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6779999999999997e-06 2023-10-08T07:07:32.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.737792+0000", 2023-10-08T07:07:32.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013420329999999999 2023-10-08T07:07:32.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.737875+0000", 2023-10-08T07:07:32.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2608999999999995e-05 2023-10-08T07:07:32.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.267 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125160 4.31 4:8ec1b377:::10000000004.00000019:head [write 3608576~4096 in=4096b,write 3616768~4096 in=4096b,write 3678208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.734410+0000", 2023-10-08T07:07:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012971043, 2023-10-08T07:07:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019371950999999998, 2023-10-08T07:07:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125160 2023-10-08T07:07:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.268 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.734410+0000", 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.734410+0000", 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.734411+0000", 2023-10-08T07:07:32.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1399999999999997e-07 2023-10-08T07:07:32.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.734424+0000", 2023-10-08T07:07:32.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3159000000000001e-05 2023-10-08T07:07:32.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.734432+0000", 2023-10-08T07:07:32.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8390000000000007e-06 2023-10-08T07:07:32.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.734438+0000", 2023-10-08T07:07:32.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.711e-06 2023-10-08T07:07:32.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.745977+0000", 2023-10-08T07:07:32.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011538952 2023-10-08T07:07:32.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746083+0000", 2023-10-08T07:07:32.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000106939 2023-10-08T07:07:32.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:32.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.746265+0000", 2023-10-08T07:07:32.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018194500000000001 2023-10-08T07:07:32.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.753146+0000", 2023-10-08T07:07:32.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068804410000000002 2023-10-08T07:07:32.273 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.273 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.273 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.273 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4556.0:125154 4.b e59/17)", 2023-10-08T07:07:32.273 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.750405+0000", 2023-10-08T07:07:32.273 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9969769, 2023-10-08T07:07:32.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034692080000000001, 2023-10-08T07:07:32.274 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.274 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.274 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750405+0000", 2023-10-08T07:07:32.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750405+0000", 2023-10-08T07:07:32.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750405+0000", 2023-10-08T07:07:32.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4199999999999996e-07 2023-10-08T07:07:32.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750409+0000", 2023-10-08T07:07:32.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9389999999999999e-06 2023-10-08T07:07:32.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750421+0000", 2023-10-08T07:07:32.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2165e-05 2023-10-08T07:07:32.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750428+0000", 2023-10-08T07:07:32.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5830000000000003e-06 2023-10-08T07:07:32.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.277 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.277 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.277 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124001 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.277 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.243379+0000", 2023-10-08T07:07:32.277 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.50400207399999997, 2023-10-08T07:07:32.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.51055824599999999, 2023-10-08T07:07:32.277 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.277 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.277 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.278 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124001 2023-10-08T07:07:32.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.278 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.243379+0000", 2023-10-08T07:07:32.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.243379+0000", 2023-10-08T07:07:32.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.243380+0000", 2023-10-08T07:07:32.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2023-10-08T07:07:32.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.243392+0000", 2023-10-08T07:07:32.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2182e-05 2023-10-08T07:07:32.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.243399+0000", 2023-10-08T07:07:32.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0700000000000001e-06 2023-10-08T07:07:32.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.243405+0000", 2023-10-08T07:07:32.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9630000000000003e-06 2023-10-08T07:07:32.281 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.281 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.281 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.281 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124028 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.281 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.257353+0000", 2023-10-08T07:07:32.281 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.490028454, 2023-10-08T07:07:32.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.49664961600000002, 2023-10-08T07:07:32.281 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.281 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.281 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.282 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124028 2023-10-08T07:07:32.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.282 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.257353+0000", 2023-10-08T07:07:32.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.257353+0000", 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.257353+0000", 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9800000000000004e-07 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.257365+0000", 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1671999999999999e-05 2023-10-08T07:07:32.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.257375+0000", 2023-10-08T07:07:32.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6530000000000006e-06 2023-10-08T07:07:32.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.257381+0000", 2023-10-08T07:07:32.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6930000000000001e-06 2023-10-08T07:07:32.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.284 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124606 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.496625+0000", 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.25075618300000002, 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.25744277599999998, 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124606 2023-10-08T07:07:32.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.286 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496625+0000", 2023-10-08T07:07:32.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496625+0000", 2023-10-08T07:07:32.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496626+0000", 2023-10-08T07:07:32.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3700000000000001e-07 2023-10-08T07:07:32.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496638+0000", 2023-10-08T07:07:32.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2327000000000001e-05 2023-10-08T07:07:32.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496646+0000", 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496651+0000", 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0309999999999998e-06 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.288 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126494 4.2b e59/17 4:d7a77d67:::10000000004.00000029:head v 59'3998, mlcod=59'3992)", 2023-10-08T07:07:32.289 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.736258+0000", 2023-10-08T07:07:32.289 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011123025, 2023-10-08T07:07:32.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017868970000000001, 2023-10-08T07:07:32.289 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.289 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.289 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.736258+0000", 2023-10-08T07:07:32.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.736258+0000", 2023-10-08T07:07:32.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.736259+0000", 2023-10-08T07:07:32.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4700000000000001e-07 2023-10-08T07:07:32.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.736275+0000", 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6211000000000001e-05 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.736285+0000", 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0151e-05 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.736297+0000", 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1214e-05 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.737797+0000", 2023-10-08T07:07:32.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001500854 2023-10-08T07:07:32.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.737814+0000", 2023-10-08T07:07:32.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6878e-05 2023-10-08T07:07:32.292 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.292 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.292 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.293 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124029 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.293 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.257391+0000", 2023-10-08T07:07:32.293 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48999088800000001, 2023-10-08T07:07:32.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.49680473600000002, 2023-10-08T07:07:32.293 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.293 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.293 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124029 2023-10-08T07:07:32.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.257391+0000", 2023-10-08T07:07:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.257391+0000", 2023-10-08T07:07:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.257391+0000", 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8200000000000001e-07 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.257407+0000", 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6015000000000002e-05 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.257415+0000", 2023-10-08T07:07:32.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8739999999999995e-06 2023-10-08T07:07:32.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.257420+0000", 2023-10-08T07:07:32.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9320000000000004e-06 2023-10-08T07:07:32.296 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.296 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.296 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.296 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124136 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.296 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.296378+0000", 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.45100344799999997, 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.45787951700000001, 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124136 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.296378+0000", 2023-10-08T07:07:32.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.296378+0000", 2023-10-08T07:07:32.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.296379+0000", 2023-10-08T07:07:32.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:07:32.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.296390+0000", 2023-10-08T07:07:32.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1745e-05 2023-10-08T07:07:32.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.296398+0000", 2023-10-08T07:07:32.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7179999999999996e-06 2023-10-08T07:07:32.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.296404+0000", 2023-10-08T07:07:32.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2550000000000003e-06 2023-10-08T07:07:32.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.300 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.300 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124864 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.300 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.605375+0000", 2023-10-08T07:07:32.300 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14200660200000001, 2023-10-08T07:07:32.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.14895301, 2023-10-08T07:07:32.300 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124864 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.605375+0000", 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.605375+0000", 2023-10-08T07:07:32.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.607084+0000", 2023-10-08T07:07:32.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001708935 2023-10-08T07:07:32.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.607115+0000", 2023-10-08T07:07:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0913e-05 2023-10-08T07:07:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.607253+0000", 2023-10-08T07:07:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000137868 2023-10-08T07:07:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.607262+0000", 2023-10-08T07:07:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.893e-06 2023-10-08T07:07:32.303 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124995 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.678393+0000", 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.068987940999999997, 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.075994084000000003, 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.304 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124995 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.678393+0000", 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.678393+0000", 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.678394+0000", 2023-10-08T07:07:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9200000000000002e-07 2023-10-08T07:07:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.678407+0000", 2023-10-08T07:07:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833999999999999e-05 2023-10-08T07:07:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.678414+0000", 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.939e-06 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.678420+0000", 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9320000000000001e-06 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.307 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126535 4.38 e59/46 4:1e0977c7:::10000000004.00000022:head v 59'1999, mlcod=59'1997)", 2023-10-08T07:07:32.308 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.750537+0000", 2023-10-08T07:07:32.308 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9968443, 2023-10-08T07:07:32.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039140529999999998, 2023-10-08T07:07:32.308 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.308 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.308 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750537+0000", 2023-10-08T07:07:32.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750537+0000", 2023-10-08T07:07:32.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750538+0000", 2023-10-08T07:07:32.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.15e-07 2023-10-08T07:07:32.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750550+0000", 2023-10-08T07:07:32.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2381000000000001e-05 2023-10-08T07:07:32.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750559+0000", 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3200000000000006e-06 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.750563+0000", 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.721e-06 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752668+0000", 2023-10-08T07:07:32.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021045249999999999 2023-10-08T07:07:32.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752682+0000", 2023-10-08T07:07:32.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4224e-05 2023-10-08T07:07:32.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.312 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.312 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124099 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.312 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.282459+0000", 2023-10-08T07:07:32.313 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.464922524, 2023-10-08T07:07:32.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.472178916, 2023-10-08T07:07:32.313 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.313 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.313 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124099 2023-10-08T07:07:32.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.313 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.282459+0000", 2023-10-08T07:07:32.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.282459+0000", 2023-10-08T07:07:32.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.282459+0000", 2023-10-08T07:07:32.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0200000000000002e-07 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.282471+0000", 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1798e-05 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.282477+0000", 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1929999999999998e-06 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.282488+0000", 2023-10-08T07:07:32.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0579e-05 2023-10-08T07:07:32.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.316 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.316 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124203 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.316 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.321663+0000", 2023-10-08T07:07:32.316 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42571820300000002, 2023-10-08T07:07:32.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43302941499999997, 2023-10-08T07:07:32.316 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.317 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.317 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124203 2023-10-08T07:07:32.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.317 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321663+0000", 2023-10-08T07:07:32.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321663+0000", 2023-10-08T07:07:32.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321664+0000", 2023-10-08T07:07:32.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.13e-07 2023-10-08T07:07:32.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321685+0000", 2023-10-08T07:07:32.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0868000000000001e-05 2023-10-08T07:07:32.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321694+0000", 2023-10-08T07:07:32.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3009999999999995e-06 2023-10-08T07:07:32.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321701+0000", 2023-10-08T07:07:32.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8950000000000001e-06 2023-10-08T07:07:32.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.320 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.320 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124229 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.320 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.331380+0000", 2023-10-08T07:07:32.320 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.416001864, 2023-10-08T07:07:32.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.42336807100000001, 2023-10-08T07:07:32.320 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.320 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.320 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124229 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.331380+0000", 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.331380+0000", 2023-10-08T07:07:32.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335297+0000", 2023-10-08T07:07:32.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039171129999999998 2023-10-08T07:07:32.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335315+0000", 2023-10-08T07:07:32.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8522e-05 2023-10-08T07:07:32.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335326+0000", 2023-10-08T07:07:32.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1269e-05 2023-10-08T07:07:32.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335334+0000", 2023-10-08T07:07:32.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4660000000000002e-06 2023-10-08T07:07:32.323 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.323 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.323 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124296 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.364340+0000", 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38304159700000001, 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.390459795, 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124296 2023-10-08T07:07:32.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.325 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.364340+0000", 2023-10-08T07:07:32.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.364340+0000", 2023-10-08T07:07:32.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.364340+0000", 2023-10-08T07:07:32.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1500000000000005e-07 2023-10-08T07:07:32.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.364356+0000", 2023-10-08T07:07:32.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5325e-05 2023-10-08T07:07:32.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.364362+0000", 2023-10-08T07:07:32.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7429999999999996e-06 2023-10-08T07:07:32.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.364367+0000", 2023-10-08T07:07:32.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0969999999999996e-06 2023-10-08T07:07:32.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.327 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.327 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124204 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.321711+0000", 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42567035399999997, 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43314335199999998, 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124204 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321711+0000", 2023-10-08T07:07:32.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321711+0000", 2023-10-08T07:07:32.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321712+0000", 2023-10-08T07:07:32.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.13e-07 2023-10-08T07:07:32.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321727+0000", 2023-10-08T07:07:32.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5429000000000001e-05 2023-10-08T07:07:32.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321751+0000", 2023-10-08T07:07:32.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3722000000000001e-05 2023-10-08T07:07:32.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321757+0000", 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5370000000000003e-06 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124954 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.663346+0000", 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.084035435000000006, 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.091560563999999997, 2023-10-08T07:07:32.331 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.332 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.332 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124954 2023-10-08T07:07:32.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.332 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.663346+0000", 2023-10-08T07:07:32.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.663346+0000", 2023-10-08T07:07:32.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.667296+0000", 2023-10-08T07:07:32.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039497239999999999 2023-10-08T07:07:32.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.667317+0000", 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1540999999999999e-05 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.667328+0000", 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1274000000000001e-05 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.667337+0000", 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6410000000000008e-06 2023-10-08T07:07:32.334 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.335 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.335 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126427 4.2b e59/17 4:d7a77d67:::10000000004.00000029:head v 59'3994, mlcod=59'3989)", 2023-10-08T07:07:32.335 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.715445+0000", 2023-10-08T07:07:32.335 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.031936362000000003, 2023-10-08T07:07:32.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039516390999999998, 2023-10-08T07:07:32.335 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.335 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.335 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.715445+0000", 2023-10-08T07:07:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.715445+0000", 2023-10-08T07:07:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.715446+0000", 2023-10-08T07:07:32.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1999999999999999e-07 2023-10-08T07:07:32.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.715457+0000", 2023-10-08T07:07:32.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1204e-05 2023-10-08T07:07:32.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.715510+0000", 2023-10-08T07:07:32.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3331000000000002e-05 2023-10-08T07:07:32.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.715518+0000", 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9459999999999998e-06 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.717360+0000", 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018414200000000001 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.717379+0000", 2023-10-08T07:07:32.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9185999999999999e-05 2023-10-08T07:07:32.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.339 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.339 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124205 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.339 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.321767+0000", 2023-10-08T07:07:32.339 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42561469299999999, 2023-10-08T07:07:32.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43325138200000002, 2023-10-08T07:07:32.339 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.339 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124205 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321767+0000", 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321767+0000", 2023-10-08T07:07:32.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321767+0000", 2023-10-08T07:07:32.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1900000000000003e-07 2023-10-08T07:07:32.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321786+0000", 2023-10-08T07:07:32.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8839999999999999e-05 2023-10-08T07:07:32.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321794+0000", 2023-10-08T07:07:32.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1929999999999993e-06 2023-10-08T07:07:32.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321801+0000", 2023-10-08T07:07:32.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7989999999999996e-06 2023-10-08T07:07:32.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.342 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124702 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.535537+0000", 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.211844425, 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.21953462900000001, 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.343 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124702 2023-10-08T07:07:32.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.344 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.535537+0000", 2023-10-08T07:07:32.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.535537+0000", 2023-10-08T07:07:32.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.537365+0000", 2023-10-08T07:07:32.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001828049 2023-10-08T07:07:32.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.537382+0000", 2023-10-08T07:07:32.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.694e-05 2023-10-08T07:07:32.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.537393+0000", 2023-10-08T07:07:32.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0905e-05 2023-10-08T07:07:32.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.537401+0000", 2023-10-08T07:07:32.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7190000000000001e-06 2023-10-08T07:07:32.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.346 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.347 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124926 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.347 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.645352+0000", 2023-10-08T07:07:32.347 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.10202939599999999, 2023-10-08T07:07:32.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.10976915299999999, 2023-10-08T07:07:32.347 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.347 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.347 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124926 2023-10-08T07:07:32.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.347 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.645352+0000", 2023-10-08T07:07:32.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.645352+0000", 2023-10-08T07:07:32.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.645353+0000", 2023-10-08T07:07:32.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0800000000000005e-07 2023-10-08T07:07:32.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.645368+0000", 2023-10-08T07:07:32.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5341000000000001e-05 2023-10-08T07:07:32.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.645374+0000", 2023-10-08T07:07:32.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3579999999999999e-06 2023-10-08T07:07:32.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.645379+0000", 2023-10-08T07:07:32.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339999999999997e-06 2023-10-08T07:07:32.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.350 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.350 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124998 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.350 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.678480+0000", 2023-10-08T07:07:32.351 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.068901825999999999, 2023-10-08T07:07:32.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.076694171000000005, 2023-10-08T07:07:32.351 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.351 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.351 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124998 2023-10-08T07:07:32.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.351 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.678480+0000", 2023-10-08T07:07:32.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.678480+0000", 2023-10-08T07:07:32.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.678480+0000", 2023-10-08T07:07:32.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3599999999999999e-07 2023-10-08T07:07:32.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.678490+0000", 2023-10-08T07:07:32.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9450000000000005e-06 2023-10-08T07:07:32.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.678494+0000", 2023-10-08T07:07:32.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-06 2023-10-08T07:07:32.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.678499+0000", 2023-10-08T07:07:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6500000000000004e-06 2023-10-08T07:07:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126456 4.2b e59/17 4:d776c1c9:::10000000004.0000003d:head v 59'3996, mlcod=59'3989)", 2023-10-08T07:07:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.727836+0000", 2023-10-08T07:07:32.354 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.019545528999999999, 2023-10-08T07:07:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.027389894000000001, 2023-10-08T07:07:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.727836+0000", 2023-10-08T07:07:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.727836+0000", 2023-10-08T07:07:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.727837+0000", 2023-10-08T07:07:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1999999999999998e-07 2023-10-08T07:07:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.727856+0000", 2023-10-08T07:07:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9443e-05 2023-10-08T07:07:32.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.727866+0000", 2023-10-08T07:07:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8239999999999995e-06 2023-10-08T07:07:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.727875+0000", 2023-10-08T07:07:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7919999999999998e-06 2023-10-08T07:07:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.729361+0000", 2023-10-08T07:07:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014863599999999999 2023-10-08T07:07:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.729377+0000", 2023-10-08T07:07:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5889999999999999e-05 2023-10-08T07:07:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125188 4.37 4:efdd41ff:::10000000004.0000001c:head [write 3325952~4096 in=4096b,write 3395584~4096 in=4096b,write 3424256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.749763+0000", 2023-10-08T07:07:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9976182, 2023-10-08T07:07:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055303360000000003, 2023-10-08T07:07:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125188 2023-10-08T07:07:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.359 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.749763+0000", 2023-10-08T07:07:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.749763+0000", 2023-10-08T07:07:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.751294+0000", 2023-10-08T07:07:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015309570000000001 2023-10-08T07:07:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.751309+0000", 2023-10-08T07:07:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5143999999999999e-05 2023-10-08T07:07:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.751319+0000", 2023-10-08T07:07:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0139000000000001e-05 2023-10-08T07:07:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.751327+0000", 2023-10-08T07:07:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.267e-06 2023-10-08T07:07:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.751376+0000", 2023-10-08T07:07:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9843999999999999e-05 2023-10-08T07:07:32.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.751426+0000", 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9744999999999999e-05 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124414 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.420910+0000", 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.326471701, 2023-10-08T07:07:32.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.33444573900000002, 2023-10-08T07:07:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124414 2023-10-08T07:07:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420910+0000", 2023-10-08T07:07:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420910+0000", 2023-10-08T07:07:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420910+0000", 2023-10-08T07:07:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.13e-07 2023-10-08T07:07:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420924+0000", 2023-10-08T07:07:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4238e-05 2023-10-08T07:07:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420931+0000", 2023-10-08T07:07:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7270000000000001e-06 2023-10-08T07:07:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420936+0000", 2023-10-08T07:07:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1209999999999998e-06 2023-10-08T07:07:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124498 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.456356+0000", 2023-10-08T07:07:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.291025166, 2023-10-08T07:07:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.299051118, 2023-10-08T07:07:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124498 2023-10-08T07:07:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.456356+0000", 2023-10-08T07:07:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.456356+0000", 2023-10-08T07:07:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.458294+0000", 2023-10-08T07:07:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001937811 2023-10-08T07:07:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.458315+0000", 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.105e-05 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.458325+0000", 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0319999999999999e-05 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.458332+0000", 2023-10-08T07:07:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0589999999999997e-06 2023-10-08T07:07:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124609 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.497276+0000", 2023-10-08T07:07:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.25010497900000001, 2023-10-08T07:07:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.25818023400000001, 2023-10-08T07:07:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124609 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.497276+0000", 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.497276+0000", 2023-10-08T07:07:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.497277+0000", 2023-10-08T07:07:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.06e-07 2023-10-08T07:07:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.497298+0000", 2023-10-08T07:07:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0622e-05 2023-10-08T07:07:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.497305+0000", 2023-10-08T07:07:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9199999999999998e-06 2023-10-08T07:07:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.497312+0000", 2023-10-08T07:07:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9340000000000006e-06 2023-10-08T07:07:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125056 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.704419+0000", 2023-10-08T07:07:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.042962688999999998, 2023-10-08T07:07:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051088445000000003, 2023-10-08T07:07:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125056 2023-10-08T07:07:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.704419+0000", 2023-10-08T07:07:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.704419+0000", 2023-10-08T07:07:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.704419+0000", 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7000000000000005e-07 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.704438+0000", 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8677000000000001e-05 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.704446+0000", 2023-10-08T07:07:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0209999999999999e-06 2023-10-08T07:07:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.704451+0000", 2023-10-08T07:07:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3369999999999999e-06 2023-10-08T07:07:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:126539 4.c e59/17 4:31e28161:::10000000004.00000011:head v 59'4013, mlcod=59'4010)", 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.752852+0000", 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9945292, 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027063009999999999, 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752852+0000", 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752852+0000", 2023-10-08T07:07:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752853+0000", 2023-10-08T07:07:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2399999999999998e-07 2023-10-08T07:07:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752867+0000", 2023-10-08T07:07:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4198e-05 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752883+0000", 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5670000000000001e-05 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752890+0000", 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3579999999999997e-06 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752931+0000", 2023-10-08T07:07:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1461999999999997e-05 2023-10-08T07:07:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.752948+0000", 2023-10-08T07:07:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6169000000000001e-05 2023-10-08T07:07:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 150 2023-10-08T07:07:32.383 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:32.383 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T07:07:32.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:32.386 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:32.383+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:32.485 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:32.485+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:32.583 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:32.583 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:32.583 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:32.583 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:32.583 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:32.585 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:32.585+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:32.598 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:32.687 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:32.686+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:32.788 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:32.788+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:32.794 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:32.795 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:32.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:32.795 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:32.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.795 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124055 4.28 4:16edf4d3:::10000000004.00000027:head [write 294912~4096,write 385024~4096,write 450560~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.795 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.262355+0000", 2023-10-08T07:07:32.795 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.5303424219999999, 2023-10-08T07:07:32.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2444932259999999, 2023-10-08T07:07:32.795 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.795 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124055 2023-10-08T07:07:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.262355+0000", 2023-10-08T07:07:32.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.262355+0000", 2023-10-08T07:07:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.266294+0000", 2023-10-08T07:07:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039398640000000004 2023-10-08T07:07:32.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.266309+0000", 2023-10-08T07:07:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4756000000000001e-05 2023-10-08T07:07:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.266322+0000", 2023-10-08T07:07:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.271e-05 2023-10-08T07:07:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.266331+0000", 2023-10-08T07:07:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0119999999999994e-06 2023-10-08T07:07:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.468617+0000", 2023-10-08T07:07:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2022856230000001 2023-10-08T07:07:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.468698+0000", 2023-10-08T07:07:32.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1593000000000003e-05 2023-10-08T07:07:32.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.506717+0000", 2023-10-08T07:07:32.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038018613 2023-10-08T07:07:32.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.506769+0000", 2023-10-08T07:07:32.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1816e-05 2023-10-08T07:07:32.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.506848+0000", 2023-10-08T07:07:32.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9239000000000005e-05 2023-10-08T07:07:32.805 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.805 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.805 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.805 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124087 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2547712~4096,write 2564096~4096,write 2809856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.805 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.280346+0000", 2023-10-08T07:07:32.805 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.5123509720000001, 2023-10-08T07:07:32.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2348197519999999, 2023-10-08T07:07:32.805 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.806 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.806 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.806 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.806 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.806 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124087 2023-10-08T07:07:32.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.806 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280346+0000", 2023-10-08T07:07:32.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280346+0000", 2023-10-08T07:07:32.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280347+0000", 2023-10-08T07:07:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2023-10-08T07:07:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280372+0000", 2023-10-08T07:07:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5931e-05 2023-10-08T07:07:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280380+0000", 2023-10-08T07:07:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4599999999999997e-06 2023-10-08T07:07:32.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.280385+0000", 2023-10-08T07:07:32.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1540000000000001e-06 2023-10-08T07:07:32.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.494731+0000", 2023-10-08T07:07:32.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.214345781 2023-10-08T07:07:32.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.494812+0000", 2023-10-08T07:07:32.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1452999999999994e-05 2023-10-08T07:07:32.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.515047+0000", 2023-10-08T07:07:32.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020234302999999999 2023-10-08T07:07:32.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.515096+0000", 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9166999999999999e-05 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.515166+0000", 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9993999999999994e-05 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.811 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124183 4.10 4:0b5763e1:::10000000004.00000015:head [write 532480~4096,write 626688~4096,write 638976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.812 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.316343+0000", 2023-10-08T07:07:32.812 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.4763543450000001, 2023-10-08T07:07:32.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.241693897, 2023-10-08T07:07:32.812 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.812 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.812 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.812 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.812 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.812 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124183 2023-10-08T07:07:32.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.812 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.316343+0000", 2023-10-08T07:07:32.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.316343+0000", 2023-10-08T07:07:32.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.316343+0000", 2023-10-08T07:07:32.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2800000000000003e-07 2023-10-08T07:07:32.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.316353+0000", 2023-10-08T07:07:32.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8819999999999996e-06 2023-10-08T07:07:32.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.316357+0000", 2023-10-08T07:07:32.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4410000000000003e-06 2023-10-08T07:07:32.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.316361+0000", 2023-10-08T07:07:32.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3459999999999998e-06 2023-10-08T07:07:32.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.516331+0000", 2023-10-08T07:07:32.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1999701970000001 2023-10-08T07:07:32.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.516411+0000", 2023-10-08T07:07:32.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0624999999999995e-05 2023-10-08T07:07:32.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.557916+0000", 2023-10-08T07:07:32.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.041504151000000003 2023-10-08T07:07:32.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.557963+0000", 2023-10-08T07:07:32.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7302999999999998e-05 2023-10-08T07:07:32.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.558037+0000", 2023-10-08T07:07:32.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3623999999999998e-05 2023-10-08T07:07:32.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.817 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.817 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124204 4.10 4:0b5763e1:::10000000004.00000015:head [write 946176~4096,write 987136~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.817 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.321711+0000", 2023-10-08T07:07:32.818 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.4709859679999999, 2023-10-08T07:07:32.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.236501439, 2023-10-08T07:07:32.818 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.818 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.818 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124204 2023-10-08T07:07:32.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.818 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321711+0000", 2023-10-08T07:07:32.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321711+0000", 2023-10-08T07:07:32.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321712+0000", 2023-10-08T07:07:32.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.13e-07 2023-10-08T07:07:32.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321727+0000", 2023-10-08T07:07:32.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5429000000000001e-05 2023-10-08T07:07:32.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321751+0000", 2023-10-08T07:07:32.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3722000000000001e-05 2023-10-08T07:07:32.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321757+0000", 2023-10-08T07:07:32.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5370000000000003e-06 2023-10-08T07:07:32.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.529846+0000", 2023-10-08T07:07:32.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2080886529999999 2023-10-08T07:07:32.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.529934+0000", 2023-10-08T07:07:32.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8088000000000001e-05 2023-10-08T07:07:32.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.558098+0000", 2023-10-08T07:07:32.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028164457 2023-10-08T07:07:32.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.558151+0000", 2023-10-08T07:07:32.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2269999999999999e-05 2023-10-08T07:07:32.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.558212+0000", 2023-10-08T07:07:32.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.177e-05 2023-10-08T07:07:32.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.823 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.823 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124205 4.28 4:15b6682b:::10000000004.0000000b:head [write 1982464~4096,write 2195456~4096,write 2207744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.823 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.321767+0000", 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.4709303069999999, 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.23657248, 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124205 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321767+0000", 2023-10-08T07:07:32.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321767+0000", 2023-10-08T07:07:32.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321767+0000", 2023-10-08T07:07:32.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1900000000000003e-07 2023-10-08T07:07:32.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321786+0000", 2023-10-08T07:07:32.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8839999999999999e-05 2023-10-08T07:07:32.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321794+0000", 2023-10-08T07:07:32.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1929999999999993e-06 2023-10-08T07:07:32.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.321801+0000", 2023-10-08T07:07:32.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7989999999999996e-06 2023-10-08T07:07:32.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.533132+0000", 2023-10-08T07:07:32.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.211330945 2023-10-08T07:07:32.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.533219+0000", 2023-10-08T07:07:32.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6640999999999999e-05 2023-10-08T07:07:32.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.558219+0000", 2023-10-08T07:07:32.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025000860999999999 2023-10-08T07:07:32.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.558262+0000", 2023-10-08T07:07:32.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2357999999999997e-05 2023-10-08T07:07:32.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.558339+0000", 2023-10-08T07:07:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7323999999999994e-05 2023-10-08T07:07:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124229 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2203648~4096,write 2387968~4096,write 2678784~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.331380+0000", 2023-10-08T07:07:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.461317478, 2023-10-08T07:07:32.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2365046660000001, 2023-10-08T07:07:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124229 2023-10-08T07:07:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.331380+0000", 2023-10-08T07:07:32.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.331380+0000", 2023-10-08T07:07:32.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335297+0000", 2023-10-08T07:07:32.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039171129999999998 2023-10-08T07:07:32.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335315+0000", 2023-10-08T07:07:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8522e-05 2023-10-08T07:07:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335326+0000", 2023-10-08T07:07:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1269e-05 2023-10-08T07:07:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335334+0000", 2023-10-08T07:07:32.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4660000000000002e-06 2023-10-08T07:07:32.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.533618+0000", 2023-10-08T07:07:32.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1982841900000001 2023-10-08T07:07:32.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.533691+0000", 2023-10-08T07:07:32.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2900999999999999e-05 2023-10-08T07:07:32.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.567762+0000", 2023-10-08T07:07:32.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034071248999999998 2023-10-08T07:07:32.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.567813+0000", 2023-10-08T07:07:32.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0748999999999998e-05 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.567884+0000", 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1206999999999998e-05 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124241 4.10 4:0b5763e1:::10000000004.00000015:head [write 3121152~4096,write 3227648~4096,write 3284992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.335440+0000", 2023-10-08T07:07:32.835 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.457257048, 2023-10-08T07:07:32.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2384096330000001, 2023-10-08T07:07:32.837 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.837 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.837 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.837 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.837 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.837 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124241 2023-10-08T07:07:32.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.838 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335440+0000", 2023-10-08T07:07:32.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335440+0000", 2023-10-08T07:07:32.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335440+0000", 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5900000000000003e-07 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335451+0000", 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0824e-05 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335458+0000", 2023-10-08T07:07:32.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5899999999999996e-06 2023-10-08T07:07:32.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.335462+0000", 2023-10-08T07:07:32.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7180000000000004e-06 2023-10-08T07:07:32.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.539119+0000", 2023-10-08T07:07:32.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2036566289999999 2023-10-08T07:07:32.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.539211+0000", 2023-10-08T07:07:32.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2149000000000002e-05 2023-10-08T07:07:32.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.573711+0000", 2023-10-08T07:07:32.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034499389999999998 2023-10-08T07:07:32.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.573773+0000", 2023-10-08T07:07:32.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2082000000000006e-05 2023-10-08T07:07:32.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.573850+0000", 2023-10-08T07:07:32.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6891999999999995e-05 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124339 4.28 4:16edf4d3:::10000000004.00000027:head [write 1839104~4096,write 1986560~4096,write 2236416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.376659+0000", 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.4160383050000001, 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2366229719999999, 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.844 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124339 2023-10-08T07:07:32.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.844 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.376659+0000", 2023-10-08T07:07:32.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.376659+0000", 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.378294+0000", 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016357730000000001 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.378319+0000", 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4698e-05 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.378331+0000", 2023-10-08T07:07:32.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.155e-05 2023-10-08T07:07:32.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.378338+0000", 2023-10-08T07:07:32.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3810000000000001e-06 2023-10-08T07:07:32.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.583114+0000", 2023-10-08T07:07:32.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.204775902 2023-10-08T07:07:32.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.583184+0000", 2023-10-08T07:07:32.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9504000000000004e-05 2023-10-08T07:07:32.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.613121+0000", 2023-10-08T07:07:32.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.029937246000000001 2023-10-08T07:07:32.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.613197+0000", 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6606000000000005e-05 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.613282+0000", 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4312000000000002e-05 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.849 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124348 4.0 4:02bf98b6:::10000000004.0000000e:head [write 1175552~4096,write 1245184~4096,write 1327104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.849 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.383038+0000", 2023-10-08T07:07:32.849 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.4096590440000001, 2023-10-08T07:07:32.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2580244620000001, 2023-10-08T07:07:32.849 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.849 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.849 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124348 2023-10-08T07:07:32.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.850 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.383038+0000", 2023-10-08T07:07:32.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.383038+0000", 2023-10-08T07:07:32.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.384294+0000", 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012557180000000001 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.384307+0000", 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3644e-05 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.384318+0000", 2023-10-08T07:07:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0834e-05 2023-10-08T07:07:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.384325+0000", 2023-10-08T07:07:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1760000000000004e-06 2023-10-08T07:07:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.619102+0000", 2023-10-08T07:07:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.234776415 2023-10-08T07:07:32.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.619176+0000", 2023-10-08T07:07:32.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4453e-05 2023-10-08T07:07:32.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:32.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.619322+0000", 2023-10-08T07:07:32.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014561000000000001 2023-10-08T07:07:32.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:32.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.630939+0000", 2023-10-08T07:07:32.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011617357 2023-10-08T07:07:32.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.640953+0000", 2023-10-08T07:07:32.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010013419000000001 2023-10-08T07:07:32.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.641011+0000", 2023-10-08T07:07:32.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8631999999999997e-05 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.641062+0000", 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1204e-05 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124373 4.28 4:15b6682b:::10000000004.0000000b:head [write 1400832~4096,write 1454080~4096,write 1531904~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.397628+0000", 2023-10-08T07:07:32.855 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.3950691069999999, 2023-10-08T07:07:32.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2436066619999999, 2023-10-08T07:07:32.856 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.856 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.856 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124373 2023-10-08T07:07:32.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.856 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.397628+0000", 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.397628+0000", 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.397629+0000", 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9999999999999997e-07 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.397640+0000", 2023-10-08T07:07:32.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1266e-05 2023-10-08T07:07:32.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.397648+0000", 2023-10-08T07:07:32.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7589999999999997e-06 2023-10-08T07:07:32.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.397652+0000", 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8400000000000002e-06 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.619230+0000", 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2215772249999999 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.619325+0000", 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5625999999999996e-05 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.641112+0000", 2023-10-08T07:07:32.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021786698 2023-10-08T07:07:32.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.641159+0000", 2023-10-08T07:07:32.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7224000000000001e-05 2023-10-08T07:07:32.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.641235+0000", 2023-10-08T07:07:32.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5424000000000002e-05 2023-10-08T07:07:32.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.861 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.861 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124414 4.10 4:08d50e0e:::10000000004.0000003f:head [write 1392640~4096,write 1409024~4096,write 1892352~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.861 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.420910+0000", 2023-10-08T07:07:32.861 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.371787315, 2023-10-08T07:07:32.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.240320734, 2023-10-08T07:07:32.861 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.861 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.862 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124414 2023-10-08T07:07:32.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.862 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420910+0000", 2023-10-08T07:07:32.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420910+0000", 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420910+0000", 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.13e-07 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420924+0000", 2023-10-08T07:07:32.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4238e-05 2023-10-08T07:07:32.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420931+0000", 2023-10-08T07:07:32.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7270000000000001e-06 2023-10-08T07:07:32.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420936+0000", 2023-10-08T07:07:32.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1209999999999998e-06 2023-10-08T07:07:32.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.633367+0000", 2023-10-08T07:07:32.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.212430466 2023-10-08T07:07:32.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.633443+0000", 2023-10-08T07:07:32.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6233e-05 2023-10-08T07:07:32.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.661107+0000", 2023-10-08T07:07:32.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.027664067000000001 2023-10-08T07:07:32.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.661156+0000", 2023-10-08T07:07:32.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8510999999999997e-05 2023-10-08T07:07:32.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.661230+0000", 2023-10-08T07:07:32.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4857999999999994e-05 2023-10-08T07:07:32.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.867 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.867 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124416 4.10 4:0b5763e1:::10000000004.00000015:head [write 258048~4096,write 303104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.867 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.420944+0000", 2023-10-08T07:07:32.867 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.371753389, 2023-10-08T07:07:32.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.240398259, 2023-10-08T07:07:32.867 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.867 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.868 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124416 2023-10-08T07:07:32.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.868 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420944+0000", 2023-10-08T07:07:32.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420944+0000", 2023-10-08T07:07:32.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420944+0000", 2023-10-08T07:07:32.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3000000000000002e-07 2023-10-08T07:07:32.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420954+0000", 2023-10-08T07:07:32.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7839999999999998e-06 2023-10-08T07:07:32.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420960+0000", 2023-10-08T07:07:32.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2023-10-08T07:07:32.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.420964+0000", 2023-10-08T07:07:32.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5190000000000003e-06 2023-10-08T07:07:32.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.636012+0000", 2023-10-08T07:07:32.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2150477020000001 2023-10-08T07:07:32.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.636095+0000", 2023-10-08T07:07:32.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3172999999999998e-05 2023-10-08T07:07:32.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.661237+0000", 2023-10-08T07:07:32.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025142253 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.661277+0000", 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9372999999999997e-05 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.661342+0000", 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5285999999999998e-05 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.872 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.873 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124420 4.28 4:16edf4d3:::10000000004.00000027:head [write 3780608~4096,write 3866624~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.873 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.422332+0000", 2023-10-08T07:07:32.873 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.3703654439999999, 2023-10-08T07:07:32.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.239196567, 2023-10-08T07:07:32.873 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.873 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.873 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.873 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.874 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.874 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124420 2023-10-08T07:07:32.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.874 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.422332+0000", 2023-10-08T07:07:32.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.422332+0000", 2023-10-08T07:07:32.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.426293+0000", 2023-10-08T07:07:32.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039616979999999996 2023-10-08T07:07:32.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.426309+0000", 2023-10-08T07:07:32.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6184999999999998e-05 2023-10-08T07:07:32.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.426320+0000", 2023-10-08T07:07:32.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242e-05 2023-10-08T07:07:32.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.426328+0000", 2023-10-08T07:07:32.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8199999999999997e-06 2023-10-08T07:07:32.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.643681+0000", 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2173532570000001 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.643759+0000", 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8226999999999995e-05 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.661425+0000", 2023-10-08T07:07:32.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017666342000000002 2023-10-08T07:07:32.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.661466+0000", 2023-10-08T07:07:32.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0500999999999997e-05 2023-10-08T07:07:32.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.661528+0000", 2023-10-08T07:07:32.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2294999999999999e-05 2023-10-08T07:07:32.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.879 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.879 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.879 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124433 4.10 4:08d50e0e:::10000000004.0000003f:head [write 4128768~4096,write 4177920~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.879 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.428389+0000", 2023-10-08T07:07:32.879 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.364307658, 2023-10-08T07:07:32.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.237715887, 2023-10-08T07:07:32.879 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.879 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.880 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.880 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124433 2023-10-08T07:07:32.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.880 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.428389+0000", 2023-10-08T07:07:32.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.428389+0000", 2023-10-08T07:07:32.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.428390+0000", 2023-10-08T07:07:32.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5499999999999999e-07 2023-10-08T07:07:32.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.428399+0000", 2023-10-08T07:07:32.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9770000000000006e-06 2023-10-08T07:07:32.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.428405+0000", 2023-10-08T07:07:32.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9900000000000002e-06 2023-10-08T07:07:32.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.428409+0000", 2023-10-08T07:07:32.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1160000000000001e-06 2023-10-08T07:07:32.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.646283+0000", 2023-10-08T07:07:32.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2178742979999999 2023-10-08T07:07:32.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.646410+0000", 2023-10-08T07:07:32.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000126618 2023-10-08T07:07:32.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.665983+0000", 2023-10-08T07:07:32.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019573173999999999 2023-10-08T07:07:32.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.666033+0000", 2023-10-08T07:07:32.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0575999999999998e-05 2023-10-08T07:07:32.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.666105+0000", 2023-10-08T07:07:32.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1883000000000003e-05 2023-10-08T07:07:32.884 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.884 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.885 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.885 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124598 4.28 4:16edf4d3:::10000000004.00000027:head [write 2744320~4096,write 2887680~4096,write 2973696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.885 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.496393+0000", 2023-10-08T07:07:32.885 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.296304189, 2023-10-08T07:07:32.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2470736819999999, 2023-10-08T07:07:32.885 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.885 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.885 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.885 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.886 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.886 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124598 2023-10-08T07:07:32.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.886 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496393+0000", 2023-10-08T07:07:32.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496393+0000", 2023-10-08T07:07:32.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496393+0000", 2023-10-08T07:07:32.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7800000000000001e-07 2023-10-08T07:07:32.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496407+0000", 2023-10-08T07:07:32.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3529999999999999e-05 2023-10-08T07:07:32.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496415+0000", 2023-10-08T07:07:32.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9589999999999995e-06 2023-10-08T07:07:32.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496421+0000", 2023-10-08T07:07:32.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7339999999999996e-06 2023-10-08T07:07:32.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.723617+0000", 2023-10-08T07:07:32.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2271966480000001 2023-10-08T07:07:32.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.723702+0000", 2023-10-08T07:07:32.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5006999999999994e-05 2023-10-08T07:07:32.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.743331+0000", 2023-10-08T07:07:32.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019628967000000001 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.743372+0000", 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0388e-05 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.743467+0000", 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4870999999999993e-05 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124606 4.10 4:08d50e0e:::10000000004.0000003f:head [write 471040~4096,write 561152~4096,write 647168~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.496625+0000", 2023-10-08T07:07:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.296071797, 2023-10-08T07:07:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2653901590000001, 2023-10-08T07:07:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.891 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124606 2023-10-08T07:07:32.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.892 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496625+0000", 2023-10-08T07:07:32.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496625+0000", 2023-10-08T07:07:32.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496626+0000", 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3700000000000001e-07 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496638+0000", 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2327000000000001e-05 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496646+0000", 2023-10-08T07:07:32.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2023-10-08T07:07:32.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.496651+0000", 2023-10-08T07:07:32.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0309999999999998e-06 2023-10-08T07:07:32.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.724611+0000", 2023-10-08T07:07:32.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2279604960000001 2023-10-08T07:07:32.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.724691+0000", 2023-10-08T07:07:32.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9845999999999994e-05 2023-10-08T07:07:32.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.761884+0000", 2023-10-08T07:07:32.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037192771999999999 2023-10-08T07:07:32.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.761939+0000", 2023-10-08T07:07:32.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4973999999999999e-05 2023-10-08T07:07:32.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.762015+0000", 2023-10-08T07:07:32.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6558999999999997e-05 2023-10-08T07:07:32.896 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.896 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.896 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.897 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124609 4.28 4:16edf4d3:::10000000004.00000027:head [write 3686400~4096,write 3706880~4096,write 3870720~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.897 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.497276+0000", 2023-10-08T07:07:32.897 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.295420593, 2023-10-08T07:07:32.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.268347605, 2023-10-08T07:07:32.897 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.897 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.897 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124609 2023-10-08T07:07:32.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.897 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.497276+0000", 2023-10-08T07:07:32.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.497276+0000", 2023-10-08T07:07:32.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.497277+0000", 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.06e-07 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.497298+0000", 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0622e-05 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.497305+0000", 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9199999999999998e-06 2023-10-08T07:07:32.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.497312+0000", 2023-10-08T07:07:32.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9340000000000006e-06 2023-10-08T07:07:32.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.733721+0000", 2023-10-08T07:07:32.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2364080040000001 2023-10-08T07:07:32.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.733801+0000", 2023-10-08T07:07:32.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0828000000000006e-05 2023-10-08T07:07:32.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.765466+0000", 2023-10-08T07:07:32.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.031664291999999997 2023-10-08T07:07:32.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.765521+0000", 2023-10-08T07:07:32.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5183999999999999e-05 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.765624+0000", 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010321499999999999 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124656 4.10 4:0b5763e1:::10000000004.00000015:head [write 1441792~4096,write 1470464~4096,write 1495040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.517396+0000", 2023-10-08T07:07:32.902 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2753012049999999, 2023-10-08T07:07:32.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2523777090000001, 2023-10-08T07:07:32.903 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.903 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.903 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.903 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.903 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.903 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124656 2023-10-08T07:07:32.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.903 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517396+0000", 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517396+0000", 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517396+0000", 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3300000000000003e-07 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517408+0000", 2023-10-08T07:07:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1503e-05 2023-10-08T07:07:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517414+0000", 2023-10-08T07:07:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3400000000000003e-06 2023-10-08T07:07:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517420+0000", 2023-10-08T07:07:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2759999999999997e-06 2023-10-08T07:07:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.746740+0000", 2023-10-08T07:07:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.229319638 2023-10-08T07:07:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.746820+0000", 2023-10-08T07:07:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0285999999999997e-05 2023-10-08T07:07:32.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.769650+0000", 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022829673000000002 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.769700+0000", 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9941000000000002e-05 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.769774+0000", 2023-10-08T07:07:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3619000000000001e-05 2023-10-08T07:07:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124657 4.28 4:15b6682b:::10000000004.0000000b:head [write 3858432~4096,write 4038656~4096,write 4046848~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.517427+0000", 2023-10-08T07:07:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.275270014, 2023-10-08T07:07:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2587403740000001, 2023-10-08T07:07:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.908 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124657 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517427+0000", 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.517427+0000", 2023-10-08T07:07:32.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.519295+0000", 2023-10-08T07:07:32.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001868211 2023-10-08T07:07:32.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.519313+0000", 2023-10-08T07:07:32.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7411999999999999e-05 2023-10-08T07:07:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.519325+0000", 2023-10-08T07:07:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2437e-05 2023-10-08T07:07:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.519332+0000", 2023-10-08T07:07:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4059999999999999e-06 2023-10-08T07:07:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.765657+0000", 2023-10-08T07:07:32.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2463242290000001 2023-10-08T07:07:32.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.765738+0000", 2023-10-08T07:07:32.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1637000000000005e-05 2023-10-08T07:07:32.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.776032+0000", 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010293706999999999 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.776087+0000", 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4585e-05 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.776167+0000", 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0749999999999998e-05 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.913 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.914 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:124670 4.28 4:15b6682b:::10000000004.0000000b:head [write 3051520~4096,write 3096576~4096,write 3149824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:32.914 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.521548+0000", 2023-10-08T07:07:32.914 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.271148814, 2023-10-08T07:07:32.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2629020120000001, 2023-10-08T07:07:32.914 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:32.914 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:32.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:32.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:32.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 124670 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521548+0000", 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521548+0000", 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:32.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:32.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521549+0000", 2023-10-08T07:07:32.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.879999999999999e-07 2023-10-08T07:07:32.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:32.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521599+0000", 2023-10-08T07:07:32.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9901999999999998e-05 2023-10-08T07:07:32.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:32.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521617+0000", 2023-10-08T07:07:32.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8184000000000001e-05 2023-10-08T07:07:32.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:32.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.521625+0000", 2023-10-08T07:07:32.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8849999999999999e-06 2023-10-08T07:07:32.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:32.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.769895+0000", 2023-10-08T07:07:32.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.248270072 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.769999+0000", 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010367 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.784298+0000", 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014299077 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:32.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.784362+0000", 2023-10-08T07:07:32.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4311000000000001e-05 2023-10-08T07:07:32.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:32.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:32.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:32.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:32.784450+0000", 2023-10-08T07:07:32.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7923000000000005e-05 2023-10-08T07:07:32.919 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.919 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.919 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.919 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:32.920 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:32.920 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:32.921 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:32.922 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:32.920+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:33.022 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:33.022+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:33.123 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:33.123+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:33.135 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:33.135 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:33.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.136 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130581 4.2 4.a29e5702 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.136 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.091882+0000", 2023-10-08T07:07:33.136 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.035088006999999997, 2023-10-08T07:07:33.136 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035115223000000001, 2023-10-08T07:07:33.136 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.136 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.136 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.136 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.136 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.136 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130581 2023-10-08T07:07:33.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.137 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.137 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.137 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.091882+0000", 2023-10-08T07:07:33.137 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.137 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.137 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.091882+0000", 2023-10-08T07:07:33.137 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.091883+0000", 2023-10-08T07:07:33.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4900000000000005e-07 2023-10-08T07:07:33.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.091897+0000", 2023-10-08T07:07:33.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.403e-05 2023-10-08T07:07:33.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.091906+0000", 2023-10-08T07:07:33.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9599999999999995e-06 2023-10-08T07:07:33.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.091915+0000", 2023-10-08T07:07:33.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4139999999999994e-06 2023-10-08T07:07:33.139 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.139 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.139 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.140 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130609 4.a 4.6e5df24a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.140 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.099636+0000", 2023-10-08T07:07:33.140 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027333757, 2023-10-08T07:07:33.140 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027427355, 2023-10-08T07:07:33.140 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.140 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.140 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.140 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.140 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.141 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130609 2023-10-08T07:07:33.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.141 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.141 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099636+0000", 2023-10-08T07:07:33.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.141 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099636+0000", 2023-10-08T07:07:33.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099637+0000", 2023-10-08T07:07:33.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.06e-07 2023-10-08T07:07:33.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099649+0000", 2023-10-08T07:07:33.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2182e-05 2023-10-08T07:07:33.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.143 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.143 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099656+0000", 2023-10-08T07:07:33.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4900000000000003e-06 2023-10-08T07:07:33.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.143 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.143 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099663+0000", 2023-10-08T07:07:33.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5100000000000004e-06 2023-10-08T07:07:33.143 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.143 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.144 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.144 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.144 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130645 4.1 4:8277d31e:::10000000004.00000013:head [write 2113536~4096 in=4096b,write 2150400~4096 in=4096b,write 2220032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.144 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.112253+0000", 2023-10-08T07:07:33.144 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.014716793000000001, 2023-10-08T07:07:33.144 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014875559999999999, 2023-10-08T07:07:33.144 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.144 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.144 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.144 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.144 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.145 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130645 2023-10-08T07:07:33.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.145 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.145 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.145 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112253+0000", 2023-10-08T07:07:33.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.145 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.145 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112253+0000", 2023-10-08T07:07:33.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112253+0000", 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2199999999999999e-07 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112264+0000", 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0351e-05 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112273+0000", 2023-10-08T07:07:33.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5389999999999996e-06 2023-10-08T07:07:33.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112280+0000", 2023-10-08T07:07:33.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.319e-06 2023-10-08T07:07:33.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112333+0000", 2023-10-08T07:07:33.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3751000000000001e-05 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112420+0000", 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6416999999999996e-05 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130648 4.2 4.a29e5702 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.112294+0000", 2023-10-08T07:07:33.148 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.014676120000000001, 2023-10-08T07:07:33.149 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014907848, 2023-10-08T07:07:33.149 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.149 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.149 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.149 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.149 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.149 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130648 2023-10-08T07:07:33.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.149 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.149 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.150 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112294+0000", 2023-10-08T07:07:33.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.150 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.150 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.150 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112294+0000", 2023-10-08T07:07:33.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.150 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.150 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.150 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112294+0000", 2023-10-08T07:07:33.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5999999999999999e-07 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112304+0000", 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0017000000000001e-05 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112310+0000", 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3640000000000004e-06 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.151 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112316+0000", 2023-10-08T07:07:33.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2310000000000004e-06 2023-10-08T07:07:33.152 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.152 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.152 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.152 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130612 4.30 4:0f322a22:::10000000004.00000014:head [write 1384448~4096 in=4096b,write 1810432~4096 in=4096b,write 1859584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.152 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.100776+0000", 2023-10-08T07:07:33.152 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.026193431999999999, 2023-10-08T07:07:33.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026487813999999998, 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130612 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.100776+0000", 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.154 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.154 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.100776+0000", 2023-10-08T07:07:33.154 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.154 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.154 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.100777+0000", 2023-10-08T07:07:33.154 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7400000000000002e-07 2023-10-08T07:07:33.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.154 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.100793+0000", 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6194000000000001e-05 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.100804+0000", 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0581000000000001e-05 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.100811+0000", 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5599999999999996e-06 2023-10-08T07:07:33.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.156 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.156 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.100856+0000", 2023-10-08T07:07:33.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.456e-05 2023-10-08T07:07:33.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.156 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.156 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.100931+0000", 2023-10-08T07:07:33.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4935e-05 2023-10-08T07:07:33.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.156 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.157 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101076+0000", 2023-10-08T07:07:33.157 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014478200000000001 2023-10-08T07:07:33.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.157 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:33.157 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113214+0000", 2023-10-08T07:07:33.157 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012138016 2023-10-08T07:07:33.157 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.157 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.157 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.158 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130651 4.13 4:c9f46be2:::10000000004.00000007:head [write 3923968~4096 in=4096b,write 3997696~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.158 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.113298+0000", 2023-10-08T07:07:33.158 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013671434, 2023-10-08T07:07:33.158 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014049007000000001, 2023-10-08T07:07:33.158 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.158 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.158 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.158 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.158 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.158 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130651 2023-10-08T07:07:33.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.159 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113298+0000", 2023-10-08T07:07:33.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113298+0000", 2023-10-08T07:07:33.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113299+0000", 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113319+0000", 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9395999999999999e-05 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113329+0000", 2023-10-08T07:07:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0030999999999999e-05 2023-10-08T07:07:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113336+0000", 2023-10-08T07:07:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.542e-06 2023-10-08T07:07:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113395+0000", 2023-10-08T07:07:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9259000000000003e-05 2023-10-08T07:07:33.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113480+0000", 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4726000000000002e-05 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130613 4.3a 4.f030edfa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.101014+0000", 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.025955860000000001, 2023-10-08T07:07:33.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026406613999999998, 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130613 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101014+0000", 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101014+0000", 2023-10-08T07:07:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101015+0000", 2023-10-08T07:07:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5000000000000002e-07 2023-10-08T07:07:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101028+0000", 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3669000000000001e-05 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101039+0000", 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0566e-05 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101046+0000", 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4560000000000003e-06 2023-10-08T07:07:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130511 4.32 4:4efc9492:::10000000004.00000032:head [write 1548288~4096 in=4096b,write 1875968~4096 in=4096b,write 1916928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.069441+0000", 2023-10-08T07:07:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.057529121000000003, 2023-10-08T07:07:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058051248999999999, 2023-10-08T07:07:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130511 2023-10-08T07:07:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.069441+0000", 2023-10-08T07:07:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.069441+0000", 2023-10-08T07:07:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.069441+0000", 2023-10-08T07:07:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8899999999999998e-07 2023-10-08T07:07:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.069465+0000", 2023-10-08T07:07:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3227e-05 2023-10-08T07:07:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.069477+0000", 2023-10-08T07:07:33.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2241e-05 2023-10-08T07:07:33.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.069485+0000", 2023-10-08T07:07:33.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8460000000000008e-06 2023-10-08T07:07:33.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.170 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.117954+0000", 2023-10-08T07:07:33.170 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048469587000000001 2023-10-08T07:07:33.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.170 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.170 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.170 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118085+0000", 2023-10-08T07:07:33.170 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013096700000000001 2023-10-08T07:07:33.170 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.170 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.170 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.171 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130559 4.3a 4.f030edfa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.171 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.084460+0000", 2023-10-08T07:07:33.171 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.042509848000000003, 2023-10-08T07:07:33.171 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.043110615999999997, 2023-10-08T07:07:33.171 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.171 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.171 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.171 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.171 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.171 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130559 2023-10-08T07:07:33.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.172 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.172 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.172 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.084460+0000", 2023-10-08T07:07:33.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.172 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.172 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.084460+0000", 2023-10-08T07:07:33.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.084461+0000", 2023-10-08T07:07:33.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4900000000000005e-07 2023-10-08T07:07:33.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.084475+0000", 2023-10-08T07:07:33.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4056000000000001e-05 2023-10-08T07:07:33.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.084485+0000", 2023-10-08T07:07:33.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9799999999999993e-06 2023-10-08T07:07:33.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.084492+0000", 2023-10-08T07:07:33.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6299999999999998e-06 2023-10-08T07:07:33.174 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.174 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.174 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.174 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130614 4.e 4:70352312:::10000000004.0000001a:head [write 966656~4096 in=4096b,write 1036288~4096 in=4096b,write 1073152~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.175 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.101254+0000", 2023-10-08T07:07:33.175 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.025715267999999999, 2023-10-08T07:07:33.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026386111, 2023-10-08T07:07:33.175 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.175 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.175 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.175 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.175 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.175 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130614 2023-10-08T07:07:33.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.175 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101254+0000", 2023-10-08T07:07:33.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101254+0000", 2023-10-08T07:07:33.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101255+0000", 2023-10-08T07:07:33.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7999999999999995e-07 2023-10-08T07:07:33.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.177 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.177 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101273+0000", 2023-10-08T07:07:33.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7535999999999999e-05 2023-10-08T07:07:33.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.177 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.177 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101282+0000", 2023-10-08T07:07:33.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.38e-06 2023-10-08T07:07:33.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101288+0000", 2023-10-08T07:07:33.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2539999999999998e-06 2023-10-08T07:07:33.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113149+0000", 2023-10-08T07:07:33.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011860417999999999 2023-10-08T07:07:33.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113244+0000", 2023-10-08T07:07:33.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4779999999999997e-05 2023-10-08T07:07:33.179 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.179 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.179 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.179 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:128380 4.26 e59/17 4:672c55ca:::10000000004.00000006:head v 59'2006, mlcod=59'2003)", 2023-10-08T07:07:33.179 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.115112+0000", 2023-10-08T07:07:33.179 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.011858254, 2023-10-08T07:07:33.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012604884, 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.115112+0000", 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.115112+0000", 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.115112+0000", 2023-10-08T07:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6300000000000001e-07 2023-10-08T07:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.115127+0000", 2023-10-08T07:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5387999999999999e-05 2023-10-08T07:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.115134+0000", 2023-10-08T07:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2400000000000001e-06 2023-10-08T07:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.115140+0000", 2023-10-08T07:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.203e-06 2023-10-08T07:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122638+0000", 2023-10-08T07:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074986590000000004 2023-10-08T07:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122662+0000", 2023-10-08T07:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3428999999999999e-05 2023-10-08T07:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130482 4.2 4:43cef10a:::10000000004.00000030:head [write 1179648~8192 in=8192b,write 1208320~4096 in=4096b,write 1314816~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.060383+0000", 2023-10-08T07:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.066587052999999993, 2023-10-08T07:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.067407502999999994, 2023-10-08T07:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130482 2023-10-08T07:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.060383+0000", 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.060383+0000", 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.060384+0000", 2023-10-08T07:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2799999999999995e-07 2023-10-08T07:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.060402+0000", 2023-10-08T07:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8621999999999999e-05 2023-10-08T07:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.060415+0000", 2023-10-08T07:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3067e-05 2023-10-08T07:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.060424+0000", 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5620000000000004e-06 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.111133+0000", 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050709380999999998 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.111191+0000", 2023-10-08T07:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8318e-05 2023-10-08T07:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:125355 4.0 e59/17 4:02bf98b6:::10000000004.0000000e:head v 59'1950, mlcod=59'1948)", 2023-10-08T07:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.101679+0000", 2023-10-08T07:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.025291227999999999, 2023-10-08T07:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026188646999999999, 2023-10-08T07:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.189 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101679+0000", 2023-10-08T07:07:33.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101679+0000", 2023-10-08T07:07:33.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101679+0000", 2023-10-08T07:07:33.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0699999999999999e-07 2023-10-08T07:07:33.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101697+0000", 2023-10-08T07:07:33.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7762999999999999e-05 2023-10-08T07:07:33.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.191 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.191 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101703+0000", 2023-10-08T07:07:33.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3670000000000002e-06 2023-10-08T07:07:33.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.191 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.191 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101708+0000", 2023-10-08T07:07:33.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.685e-06 2023-10-08T07:07:33.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.191 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.191 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.105022+0000", 2023-10-08T07:07:33.192 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0033143819999999998 2023-10-08T07:07:33.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.192 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.192 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.192 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.105043+0000", 2023-10-08T07:07:33.192 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0965e-05 2023-10-08T07:07:33.192 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.192 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.192 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.192 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.192 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130587 4.e 4:7242a848:::10000000004.00000020:head [write 3489792~4096 in=4096b,write 3579904~4096 in=4096b,write 3637248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.093685+0000", 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.033285005999999999, 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.034257008999999998, 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130587 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.193 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.093685+0000", 2023-10-08T07:07:33.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.093685+0000", 2023-10-08T07:07:33.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.093685+0000", 2023-10-08T07:07:33.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8500000000000001e-07 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.093695+0000", 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6520000000000001e-06 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.093700+0000", 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0130000000000001e-06 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.093703+0000", 2023-10-08T07:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3629999999999998e-06 2023-10-08T07:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.100942+0000", 2023-10-08T07:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0072383400000000002 2023-10-08T07:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101027+0000", 2023-10-08T07:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5094999999999998e-05 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:128350 4.11 e59/17 4:8963efe6:::10000000004.00000009:head v 59'1981, mlcod=59'1978)", 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.101714+0000", 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.02525531, 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026285921, 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101714+0000", 2023-10-08T07:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101714+0000", 2023-10-08T07:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101715+0000", 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2399999999999999e-07 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101726+0000", 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1235e-05 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101732+0000", 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.896e-06 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101736+0000", 2023-10-08T07:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1790000000000001e-06 2023-10-08T07:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101797+0000", 2023-10-08T07:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0949999999999998e-05 2023-10-08T07:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.101817+0000", 2023-10-08T07:07:33.201 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9803e-05 2023-10-08T07:07:33.201 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.201 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.201 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.201 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130431 4.2 4:43cef10a:::10000000004.00000030:head [write 2744320~4096 in=4096b,write 2789376~4096 in=4096b,write 2895872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.201 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.045985+0000", 2023-10-08T07:07:33.201 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.080984483999999995, 2023-10-08T07:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.08205722, 2023-10-08T07:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130431 2023-10-08T07:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.045985+0000", 2023-10-08T07:07:33.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.045985+0000", 2023-10-08T07:07:33.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.045986+0000", 2023-10-08T07:07:33.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4600000000000003e-07 2023-10-08T07:07:33.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.045998+0000", 2023-10-08T07:07:33.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1562e-05 2023-10-08T07:07:33.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.046020+0000", 2023-10-08T07:07:33.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2252e-05 2023-10-08T07:07:33.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.205 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.205 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.046027+0000", 2023-10-08T07:07:33.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.391e-06 2023-10-08T07:07:33.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.205 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.205 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.102355+0000", 2023-10-08T07:07:33.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.056327713000000001 2023-10-08T07:07:33.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.102437+0000", 2023-10-08T07:07:33.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2253e-05 2023-10-08T07:07:33.206 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.206 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.206 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.206 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130618 4.20 4:05b3915c:::10000000004.00000016:head [write 2904064~4096 in=4096b,write 2940928~4096 in=4096b,write 3084288~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.206 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.103093+0000", 2023-10-08T07:07:33.206 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.02387647, 2023-10-08T07:07:33.206 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024992249000000001, 2023-10-08T07:07:33.207 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.207 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.207 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.207 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.207 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.207 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130618 2023-10-08T07:07:33.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.207 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.207 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103093+0000", 2023-10-08T07:07:33.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103093+0000", 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103094+0000", 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4300000000000002e-07 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103111+0000", 2023-10-08T07:07:33.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6769000000000002e-05 2023-10-08T07:07:33.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103123+0000", 2023-10-08T07:07:33.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2281e-05 2023-10-08T07:07:33.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103131+0000", 2023-10-08T07:07:33.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7389999999999999e-06 2023-10-08T07:07:33.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106422+0000", 2023-10-08T07:07:33.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032909300000000001 2023-10-08T07:07:33.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106543+0000", 2023-10-08T07:07:33.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012105800000000001 2023-10-08T07:07:33.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106660+0000", 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011725799999999999 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130620 4.5 4:a367a3e8:::10000000004.00000000:head [write 2543616~4096 in=4096b,write 2584576~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.103144+0000", 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.023826067999999999, 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024987583000000001, 2023-10-08T07:07:33.211 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.212 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.212 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.212 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.212 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.212 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130620 2023-10-08T07:07:33.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.212 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103144+0000", 2023-10-08T07:07:33.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103144+0000", 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103144+0000", 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6899999999999998e-07 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103155+0000", 2023-10-08T07:07:33.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.096e-05 2023-10-08T07:07:33.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.214 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103164+0000", 2023-10-08T07:07:33.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4270000000000008e-06 2023-10-08T07:07:33.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.214 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103169+0000", 2023-10-08T07:07:33.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7239999999999997e-06 2023-10-08T07:07:33.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.215 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103934+0000", 2023-10-08T07:07:33.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00076451000000000004 2023-10-08T07:07:33.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.215 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.215 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.104023+0000", 2023-10-08T07:07:33.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9454000000000001e-05 2023-10-08T07:07:33.215 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.215 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.215 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.216 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.216 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:128391 4.29 e59/17 4:94216392:::10000000004.0000002b:head v 59'2025, mlcod=59'2023)", 2023-10-08T07:07:33.216 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.117790+0000", 2023-10-08T07:07:33.216 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0091801379999999991, 2023-10-08T07:07:33.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010381075999999999, 2023-10-08T07:07:33.216 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.216 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.216 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.216 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.216 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.117790+0000", 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.117790+0000", 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.117790+0000", 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4600000000000005e-07 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.117806+0000", 2023-10-08T07:07:33.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.607e-05 2023-10-08T07:07:33.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.117813+0000", 2023-10-08T07:07:33.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.472e-06 2023-10-08T07:07:33.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.117817+0000", 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7480000000000001e-06 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.117860+0000", 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2892000000000002e-05 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.117874+0000", 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3952e-05 2023-10-08T07:07:33.219 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.220 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.220 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.220 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130524 4.2a 4:5404a18c:::10000000004.00000025:head [write 3932160~4096 in=4096b,write 4091904~4096 in=4096b,write 4124672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.220 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.074386+0000", 2023-10-08T07:07:33.220 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.052584082999999997, 2023-10-08T07:07:33.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.053835320999999998, 2023-10-08T07:07:33.220 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.220 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.220 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.220 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.221 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.221 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130524 2023-10-08T07:07:33.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.221 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.074386+0000", 2023-10-08T07:07:33.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.074386+0000", 2023-10-08T07:07:33.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.074386+0000", 2023-10-08T07:07:33.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1900000000000002e-07 2023-10-08T07:07:33.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.074403+0000", 2023-10-08T07:07:33.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6526000000000001e-05 2023-10-08T07:07:33.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.074416+0000", 2023-10-08T07:07:33.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2876e-05 2023-10-08T07:07:33.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.074423+0000", 2023-10-08T07:07:33.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3660000000000003e-06 2023-10-08T07:07:33.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.224 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122910+0000", 2023-10-08T07:07:33.224 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048487423000000002 2023-10-08T07:07:33.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.224 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.224 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.123034+0000", 2023-10-08T07:07:33.224 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012386100000000001 2023-10-08T07:07:33.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.224 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.225 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130591 4.e 4:70352312:::10000000004.0000001a:head [write 3080192~4096 in=4096b,write 3117056~4096 in=4096b,write 3334144~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.225 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.094788+0000", 2023-10-08T07:07:33.225 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.032182017, 2023-10-08T07:07:33.225 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033475459999999999, 2023-10-08T07:07:33.225 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.225 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.225 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.225 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.225 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.225 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130591 2023-10-08T07:07:33.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.094788+0000", 2023-10-08T07:07:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.094788+0000", 2023-10-08T07:07:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.094788+0000", 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.094797+0000", 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6270000000000006e-06 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096573+0000", 2023-10-08T07:07:33.227 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0017765529999999999 2023-10-08T07:07:33.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.228 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.228 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096587+0000", 2023-10-08T07:07:33.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.358e-05 2023-10-08T07:07:33.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.228 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.228 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.104632+0000", 2023-10-08T07:07:33.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0080448099999999995 2023-10-08T07:07:33.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.104715+0000", 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3242e-05 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130621 4.20 4:05b3915c:::10000000004.00000016:head [write 159744~4096 in=4096b,write 303104~4096 in=4096b,write 335872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.103261+0000", 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.023709023999999999, 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.025092461, 2023-10-08T07:07:33.229 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.230 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.230 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.230 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.230 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.230 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130621 2023-10-08T07:07:33.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.230 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.230 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103261+0000", 2023-10-08T07:07:33.230 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103261+0000", 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103262+0000", 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4300000000000002e-07 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.231 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103276+0000", 2023-10-08T07:07:33.232 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4151999999999999e-05 2023-10-08T07:07:33.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.232 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.232 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.232 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103287+0000", 2023-10-08T07:07:33.232 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1079e-05 2023-10-08T07:07:33.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.232 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.232 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.232 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103294+0000", 2023-10-08T07:07:33.232 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.52e-06 2023-10-08T07:07:33.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112699+0000", 2023-10-08T07:07:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0094051550000000001 2023-10-08T07:07:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112817+0000", 2023-10-08T07:07:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0001177 2023-10-08T07:07:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112990+0000", 2023-10-08T07:07:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017320399999999999 2023-10-08T07:07:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130654 4.1b 4:d97fb168:::10000000004.00000008:head [write 1011712~4096 in=4096b,write 1069056~4096 in=4096b,write 1155072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.118134+0000", 2023-10-08T07:07:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0088360309999999994, 2023-10-08T07:07:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010314335000000001, 2023-10-08T07:07:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130654 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118134+0000", 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118134+0000", 2023-10-08T07:07:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118135+0000", 2023-10-08T07:07:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.156e-06 2023-10-08T07:07:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118150+0000", 2023-10-08T07:07:33.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4973999999999999e-05 2023-10-08T07:07:33.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118161+0000", 2023-10-08T07:07:33.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0696000000000001e-05 2023-10-08T07:07:33.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118170+0000", 2023-10-08T07:07:33.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1800000000000002e-06 2023-10-08T07:07:33.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.238 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118304+0000", 2023-10-08T07:07:33.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013438 2023-10-08T07:07:33.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.238 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118386+0000", 2023-10-08T07:07:33.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1791000000000003e-05 2023-10-08T07:07:33.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.239 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118544+0000", 2023-10-08T07:07:33.239 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000157968 2023-10-08T07:07:33.239 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.239 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.239 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.239 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.239 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130526 4.a 4:524fba76:::10000000004.0000001b:head [write 2097152~4096 in=4096b,write 2162688~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.239 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.074434+0000", 2023-10-08T07:07:33.239 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.052535485, 2023-10-08T07:07:33.239 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.054104223, 2023-10-08T07:07:33.239 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130526 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.074434+0000", 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.240 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.074434+0000", 2023-10-08T07:07:33.241 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.074435+0000", 2023-10-08T07:07:33.241 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1799999999999995e-07 2023-10-08T07:07:33.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.074446+0000", 2023-10-08T07:07:33.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0791000000000001e-05 2023-10-08T07:07:33.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.074454+0000", 2023-10-08T07:07:33.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.619e-06 2023-10-08T07:07:33.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.074461+0000", 2023-10-08T07:07:33.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4389999999999997e-06 2023-10-08T07:07:33.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.124745+0000", 2023-10-08T07:07:33.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050284625999999999 2023-10-08T07:07:33.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.245 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.124840+0000", 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4559e-05 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125007+0000", 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016688299999999999 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130592 4.e 4:7242a848:::10000000004.00000020:head [write 2068480~4096 in=4096b,write 2105344~4096 in=4096b,write 2154496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.246 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.096612+0000", 2023-10-08T07:07:33.247 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.030357568000000001, 2023-10-08T07:07:33.247 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032036293, 2023-10-08T07:07:33.247 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.247 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.247 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.247 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.247 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.247 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130592 2023-10-08T07:07:33.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.247 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.247 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.247 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096612+0000", 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096612+0000", 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096613+0000", 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.204e-06 2023-10-08T07:07:33.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096628+0000", 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5051e-05 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096638+0000", 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0046e-05 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.249 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096645+0000", 2023-10-08T07:07:33.250 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6100000000000002e-06 2023-10-08T07:07:33.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.250 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.250 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.250 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.110836+0000", 2023-10-08T07:07:33.250 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014190565 2023-10-08T07:07:33.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.250 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.250 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.250 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.110892+0000", 2023-10-08T07:07:33.250 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6520000000000001e-05 2023-10-08T07:07:33.251 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.251 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.251 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.251 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.251 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130623 4.a 4.6e5df24a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.251 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.103752+0000", 2023-10-08T07:07:33.251 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.023218195, 2023-10-08T07:07:33.251 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024970284999999998, 2023-10-08T07:07:33.251 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.251 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.251 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130623 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103752+0000", 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103752+0000", 2023-10-08T07:07:33.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103752+0000", 2023-10-08T07:07:33.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6799999999999999e-07 2023-10-08T07:07:33.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103793+0000", 2023-10-08T07:07:33.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0873e-05 2023-10-08T07:07:33.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.254 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103804+0000", 2023-10-08T07:07:33.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1137e-05 2023-10-08T07:07:33.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.254 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.103813+0000", 2023-10-08T07:07:33.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8570000000000001e-06 2023-10-08T07:07:33.254 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.254 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.254 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.255 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.255 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130655 4.30 4:0f322a22:::10000000004.00000014:head [write 344064~4096 in=4096b,write 507904~4096 in=4096b,write 540672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.255 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.118193+0000", 2023-10-08T07:07:33.255 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.008776275, 2023-10-08T07:07:33.255 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010590517000000001, 2023-10-08T07:07:33.255 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.255 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.255 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.255 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.255 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.256 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130655 2023-10-08T07:07:33.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.256 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118193+0000", 2023-10-08T07:07:33.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118193+0000", 2023-10-08T07:07:33.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118194+0000", 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1099999999999995e-07 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118208+0000", 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3881e-05 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.258 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118257+0000", 2023-10-08T07:07:33.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.863e-05 2023-10-08T07:07:33.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.258 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.258 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118266+0000", 2023-10-08T07:07:33.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2380000000000003e-06 2023-10-08T07:07:33.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.259 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.259 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.128262+0000", 2023-10-08T07:07:33.259 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0099964870000000001 2023-10-08T07:07:33.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.260 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.128343+0000", 2023-10-08T07:07:33.260 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1149000000000005e-05 2023-10-08T07:07:33.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.260 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.128438+0000", 2023-10-08T07:07:33.260 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4339000000000006e-05 2023-10-08T07:07:33.260 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.261 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.261 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.261 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.261 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130563 4.3a 4.d27c18fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.261 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.086320+0000", 2023-10-08T07:07:33.261 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.040649405999999999, 2023-10-08T07:07:33.261 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.042538026, 2023-10-08T07:07:33.261 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.261 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.261 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.261 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.262 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.262 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130563 2023-10-08T07:07:33.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.262 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.262 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.262 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.262 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.086320+0000", 2023-10-08T07:07:33.262 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.262 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.262 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.263 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.086320+0000", 2023-10-08T07:07:33.263 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.263 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.086321+0000", 2023-10-08T07:07:33.263 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1999999999999998e-07 2023-10-08T07:07:33.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.263 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.086337+0000", 2023-10-08T07:07:33.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5460000000000001e-05 2023-10-08T07:07:33.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.264 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.264 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.086346+0000", 2023-10-08T07:07:33.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8160000000000005e-06 2023-10-08T07:07:33.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.264 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.264 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.086354+0000", 2023-10-08T07:07:33.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0160000000000008e-06 2023-10-08T07:07:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130594 4.3a 4.7ab54aba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.096655+0000", 2023-10-08T07:07:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.030314437, 2023-10-08T07:07:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032265204999999998, 2023-10-08T07:07:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.266 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.266 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.266 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130594 2023-10-08T07:07:33.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.266 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096655+0000", 2023-10-08T07:07:33.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096655+0000", 2023-10-08T07:07:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096656+0000", 2023-10-08T07:07:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5000000000000003e-07 2023-10-08T07:07:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096667+0000", 2023-10-08T07:07:33.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1178e-05 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096675+0000", 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4649999999999997e-06 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096680+0000", 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.181e-06 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.268 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.269 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130625 4.1b 4:d97fb168:::10000000004.00000008:head [write 2715648~4096 in=4096b,write 3112960~4096 in=4096b,write 3239936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.269 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.104341+0000", 2023-10-08T07:07:33.269 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.022628966, 2023-10-08T07:07:33.269 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024672033999999999, 2023-10-08T07:07:33.269 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.269 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.269 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.269 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.269 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.269 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130625 2023-10-08T07:07:33.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.270 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.270 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.104341+0000", 2023-10-08T07:07:33.270 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.270 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.104341+0000", 2023-10-08T07:07:33.270 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.104342+0000", 2023-10-08T07:07:33.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2099999999999995e-07 2023-10-08T07:07:33.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.104353+0000", 2023-10-08T07:07:33.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1873e-05 2023-10-08T07:07:33.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.104363+0000", 2023-10-08T07:07:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3770000000000002e-06 2023-10-08T07:07:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.104368+0000", 2023-10-08T07:07:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2909999999999998e-06 2023-10-08T07:07:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.104416+0000", 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8103999999999999e-05 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.104489+0000", 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2305999999999995e-05 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.104644+0000", 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000155444 2023-10-08T07:07:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.274 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:33.274 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.116283+0000", 2023-10-08T07:07:33.274 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011638584 2023-10-08T07:07:33.274 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.274 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.274 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.274 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130656 4.1b 4:d97fb168:::10000000004.00000008:head [write 868352~4096 in=4096b,write 1204224~4096 in=4096b,write 1245184~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.274 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.118279+0000", 2023-10-08T07:07:33.274 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0086909369999999993, 2023-10-08T07:07:33.275 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010819319000000001, 2023-10-08T07:07:33.275 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.275 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.275 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.275 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.275 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.275 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130656 2023-10-08T07:07:33.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.275 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.275 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.275 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.275 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118279+0000", 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118279+0000", 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118279+0000", 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5700000000000002e-07 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118296+0000", 2023-10-08T07:07:33.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6565000000000001e-05 2023-10-08T07:07:33.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118305+0000", 2023-10-08T07:07:33.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3850000000000008e-06 2023-10-08T07:07:33.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118312+0000", 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5520000000000001e-06 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122819+0000", 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.004506548 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122876+0000", 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7513999999999999e-05 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122971+0000", 2023-10-08T07:07:33.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4684000000000004e-05 2023-10-08T07:07:33.279 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.279 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.279 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.279 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130443 4.2a 4:5404a18c:::10000000004.00000025:head [write 2801664~4096 in=4096b,write 2859008~4096 in=4096b,write 2867200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.279 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.048923+0000", 2023-10-08T07:07:33.279 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.078046704999999994, 2023-10-08T07:07:33.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.080265899000000002, 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130443 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.048923+0000", 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.281 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.281 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.281 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.048923+0000", 2023-10-08T07:07:33.281 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.281 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.281 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.281 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.048924+0000", 2023-10-08T07:07:33.281 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0529999999999999e-06 2023-10-08T07:07:33.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.281 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.281 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.048944+0000", 2023-10-08T07:07:33.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9442000000000001e-05 2023-10-08T07:07:33.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.048959+0000", 2023-10-08T07:07:33.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5143999999999999e-05 2023-10-08T07:07:33.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.048966+0000", 2023-10-08T07:07:33.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2339999999999997e-06 2023-10-08T07:07:33.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.283 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.102056+0000", 2023-10-08T07:07:33.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.053089833000000003 2023-10-08T07:07:33.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.283 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.283 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.102142+0000", 2023-10-08T07:07:33.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6576999999999995e-05 2023-10-08T07:07:33.283 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.283 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.284 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.284 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130566 4.1a 4.5c1f9a5a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.284 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.087065+0000", 2023-10-08T07:07:33.284 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.039904654999999997, 2023-10-08T07:07:33.284 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.042195704000000001, 2023-10-08T07:07:33.284 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.284 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.284 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.284 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.284 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.285 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130566 2023-10-08T07:07:33.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.285 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.285 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087065+0000", 2023-10-08T07:07:33.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.285 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087065+0000", 2023-10-08T07:07:33.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.288 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087066+0000", 2023-10-08T07:07:33.288 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:07:33.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087079+0000", 2023-10-08T07:07:33.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2989e-05 2023-10-08T07:07:33.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.289 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.290 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.290 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087090+0000", 2023-10-08T07:07:33.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0570999999999999e-05 2023-10-08T07:07:33.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.290 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.290 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087097+0000", 2023-10-08T07:07:33.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2169999999999997e-06 2023-10-08T07:07:33.291 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.291 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.291 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.291 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130596 4.30 4:0f322a22:::10000000004.00000014:head [write 2310144~4096 in=4096b,write 2342912~4096 in=4096b,write 2428928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.291 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.096687+0000", 2023-10-08T07:07:33.291 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.030282976, 2023-10-08T07:07:33.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032638304, 2023-10-08T07:07:33.291 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.291 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130596 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096687+0000", 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096687+0000", 2023-10-08T07:07:33.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.293 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096687+0000", 2023-10-08T07:07:33.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.58e-07 2023-10-08T07:07:33.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.293 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096703+0000", 2023-10-08T07:07:33.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5960999999999998e-05 2023-10-08T07:07:33.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096711+0000", 2023-10-08T07:07:33.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5850000000000002e-06 2023-10-08T07:07:33.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.096716+0000", 2023-10-08T07:07:33.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6489999999999996e-06 2023-10-08T07:07:33.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.098898+0000", 2023-10-08T07:07:33.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0021811140000000001 2023-10-08T07:07:33.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.098970+0000", 2023-10-08T07:07:33.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2539000000000005e-05 2023-10-08T07:07:33.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099112+0000", 2023-10-08T07:07:33.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014157199999999999 2023-10-08T07:07:33.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:33.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113207+0000", 2023-10-08T07:07:33.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014095233 2023-10-08T07:07:33.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.297 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.297 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130627 4.20 4:07572838:::10000000004.00000010:head [write 1630208~8192 in=8192b,write 1675264~4096 in=4096b,write 1863680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.297 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.106130+0000", 2023-10-08T07:07:33.297 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.020840052000000001, 2023-10-08T07:07:33.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023288067999999999, 2023-10-08T07:07:33.297 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.297 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130627 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106130+0000", 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.298 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106130+0000", 2023-10-08T07:07:33.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106131+0000", 2023-10-08T07:07:33.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1379999999999999e-06 2023-10-08T07:07:33.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106147+0000", 2023-10-08T07:07:33.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6583999999999999e-05 2023-10-08T07:07:33.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106159+0000", 2023-10-08T07:07:33.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1146e-05 2023-10-08T07:07:33.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106167+0000", 2023-10-08T07:07:33.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3450000000000006e-06 2023-10-08T07:07:33.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.115725+0000", 2023-10-08T07:07:33.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0095578899999999994 2023-10-08T07:07:33.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.115803+0000", 2023-10-08T07:07:33.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8449999999999996e-05 2023-10-08T07:07:33.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.115961+0000", 2023-10-08T07:07:33.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015783999999999999 2023-10-08T07:07:33.302 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.302 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.303 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.303 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130658 4.34 4:2dadb699:::10000000004.00000031:head [write 1396736~4096 in=4096b,write 1413120~4096 in=4096b,write 1421312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.303 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.118324+0000", 2023-10-08T07:07:33.303 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0086459650000000002, 2023-10-08T07:07:33.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011192519, 2023-10-08T07:07:33.303 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.304 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.304 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.304 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.304 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.304 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130658 2023-10-08T07:07:33.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.304 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118324+0000", 2023-10-08T07:07:33.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118324+0000", 2023-10-08T07:07:33.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118324+0000", 2023-10-08T07:07:33.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4000000000000002e-07 2023-10-08T07:07:33.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118337+0000", 2023-10-08T07:07:33.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2805e-05 2023-10-08T07:07:33.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118345+0000", 2023-10-08T07:07:33.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6909999999999997e-06 2023-10-08T07:07:33.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118353+0000", 2023-10-08T07:07:33.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8490000000000006e-06 2023-10-08T07:07:33.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118436+0000", 2023-10-08T07:07:33.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2911999999999995e-05 2023-10-08T07:07:33.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118519+0000", 2023-10-08T07:07:33.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3369999999999996e-05 2023-10-08T07:07:33.308 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.308 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.308 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.309 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130447 4.2 4:40ea7945:::10000000004.0000003e:head [write 1404928~8192 in=8192b,write 1474560~4096 in=4096b,write 1712128~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.309 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.050285+0000", 2023-10-08T07:07:33.309 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.076684691999999999, 2023-10-08T07:07:33.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.079323494999999994, 2023-10-08T07:07:33.309 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.309 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.309 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.309 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.310 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.310 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130447 2023-10-08T07:07:33.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.310 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.050285+0000", 2023-10-08T07:07:33.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.311 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.050285+0000", 2023-10-08T07:07:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.050286+0000", 2023-10-08T07:07:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4600000000000003e-07 2023-10-08T07:07:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.050300+0000", 2023-10-08T07:07:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4296e-05 2023-10-08T07:07:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.050310+0000", 2023-10-08T07:07:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0122000000000001e-05 2023-10-08T07:07:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.050318+0000", 2023-10-08T07:07:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0290000000000005e-06 2023-10-08T07:07:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.105038+0000", 2023-10-08T07:07:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.054719250999999997 2023-10-08T07:07:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.105116+0000", 2023-10-08T07:07:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8549999999999998e-05 2023-10-08T07:07:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130628 4.20 4:04004f2c:::10000000004.0000000d:head [write 233472~4096 in=4096b,write 270336~4096 in=4096b,write 315392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.106180+0000", 2023-10-08T07:07:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.020789575000000001, 2023-10-08T07:07:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023515318, 2023-10-08T07:07:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130628 2023-10-08T07:07:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106180+0000", 2023-10-08T07:07:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106180+0000", 2023-10-08T07:07:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106181+0000", 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3200000000000005e-07 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106199+0000", 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7904e-05 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106207+0000", 2023-10-08T07:07:33.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4649999999999994e-06 2023-10-08T07:07:33.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106214+0000", 2023-10-08T07:07:33.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1389999999999998e-06 2023-10-08T07:07:33.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125432+0000", 2023-10-08T07:07:33.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019217660000000001 2023-10-08T07:07:33.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125506+0000", 2023-10-08T07:07:33.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4164000000000003e-05 2023-10-08T07:07:33.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125671+0000", 2023-10-08T07:07:33.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000164721 2023-10-08T07:07:33.322 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.322 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.322 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130659 4.c 4:3352c333:::10000000004.00000012:head [write 3506176~4096 in=4096b,write 3731456~4096 in=4096b,write 3772416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.118362+0000", 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0086076950000000003, 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011427387000000001, 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130659 2023-10-08T07:07:33.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.324 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.324 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.324 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118362+0000", 2023-10-08T07:07:33.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.324 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.324 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118362+0000", 2023-10-08T07:07:33.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118363+0000", 2023-10-08T07:07:33.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.46e-07 2023-10-08T07:07:33.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118374+0000", 2023-10-08T07:07:33.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1505000000000001e-05 2023-10-08T07:07:33.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118382+0000", 2023-10-08T07:07:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4330000000000004e-06 2023-10-08T07:07:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118388+0000", 2023-10-08T07:07:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1919999999999996e-06 2023-10-08T07:07:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119961+0000", 2023-10-08T07:07:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0015735079999999999 2023-10-08T07:07:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.120072+0000", 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011068 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.120262+0000", 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000189667 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.328 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130631 4.e 4:70352312:::10000000004.0000001a:head [write 3952640~4096 in=4096b,write 4055040~4096 in=4096b,write 4149248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.328 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.106519+0000", 2023-10-08T07:07:33.328 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.020450824999999999, 2023-10-08T07:07:33.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023437269, 2023-10-08T07:07:33.328 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.328 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.328 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.328 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.328 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.328 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130631 2023-10-08T07:07:33.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.329 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106519+0000", 2023-10-08T07:07:33.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106519+0000", 2023-10-08T07:07:33.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106520+0000", 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6899999999999996e-07 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106533+0000", 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3242e-05 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106543+0000", 2023-10-08T07:07:33.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6949999999999995e-06 2023-10-08T07:07:33.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.106550+0000", 2023-10-08T07:07:33.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1099999999999997e-06 2023-10-08T07:07:33.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.115599+0000", 2023-10-08T07:07:33.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0090488740000000002 2023-10-08T07:07:33.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.115695+0000", 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6576000000000005e-05 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130662 4.2c 4:352c144c:::10000000004.00000003:head [write 1245184~4096 in=4096b,write 1449984~4096 in=4096b,write 1474560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.118395+0000", 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0085750150000000001, 2023-10-08T07:07:33.332 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01165441, 2023-10-08T07:07:33.333 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.333 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.333 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.333 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.333 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.333 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130662 2023-10-08T07:07:33.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.333 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.333 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118395+0000", 2023-10-08T07:07:33.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.334 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.334 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118395+0000", 2023-10-08T07:07:33.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.334 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.334 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118395+0000", 2023-10-08T07:07:33.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2899999999999999e-07 2023-10-08T07:07:33.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118405+0000", 2023-10-08T07:07:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0030999999999999e-05 2023-10-08T07:07:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118412+0000", 2023-10-08T07:07:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.844e-06 2023-10-08T07:07:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118417+0000", 2023-10-08T07:07:33.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7960000000000003e-06 2023-10-08T07:07:33.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125493+0000", 2023-10-08T07:07:33.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070759489999999998 2023-10-08T07:07:33.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125576+0000", 2023-10-08T07:07:33.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2851999999999999e-05 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125741+0000", 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016532299999999999 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130664 4.1 4:8277d31e:::10000000004.00000013:head [write 942080~4096 in=4096b,write 1126400~4096 in=4096b,write 1867776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.118423+0000", 2023-10-08T07:07:33.337 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0085468760000000001, 2023-10-08T07:07:33.338 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011723852999999999, 2023-10-08T07:07:33.338 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.338 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.338 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.338 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.338 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.338 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130664 2023-10-08T07:07:33.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.338 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118423+0000", 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118423+0000", 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118423+0000", 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6399999999999998e-07 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118433+0000", 2023-10-08T07:07:33.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4099999999999997e-06 2023-10-08T07:07:33.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118439+0000", 2023-10-08T07:07:33.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.874e-06 2023-10-08T07:07:33.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118443+0000", 2023-10-08T07:07:33.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6299999999999997e-06 2023-10-08T07:07:33.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.341 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118987+0000", 2023-10-08T07:07:33.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00054361500000000001 2023-10-08T07:07:33.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.341 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119038+0000", 2023-10-08T07:07:33.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1335999999999998e-05 2023-10-08T07:07:33.341 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130632 4.5 4:a367a3e8:::10000000004.00000000:head [write 761856~4096 in=4096b,write 790528~4096 in=4096b,write 860160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.107158+0000", 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.019811577, 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.02308431, 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.342 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.343 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130632 2023-10-08T07:07:33.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.343 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107158+0000", 2023-10-08T07:07:33.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107158+0000", 2023-10-08T07:07:33.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107159+0000", 2023-10-08T07:07:33.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:07:33.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107171+0000", 2023-10-08T07:07:33.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2142e-05 2023-10-08T07:07:33.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107193+0000", 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.139e-05 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107200+0000", 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8299999999999996e-06 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.110047+0000", 2023-10-08T07:07:33.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0028469580000000001 2023-10-08T07:07:33.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.110102+0000", 2023-10-08T07:07:33.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4561000000000002e-05 2023-10-08T07:07:33.346 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.346 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.346 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.346 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130665 4.3a 4.d27c18fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.347 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.118450+0000", 2023-10-08T07:07:33.347 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0085202369999999999, 2023-10-08T07:07:33.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011873378, 2023-10-08T07:07:33.347 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.347 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.347 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.347 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.347 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.347 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130665 2023-10-08T07:07:33.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.347 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.348 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.348 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118450+0000", 2023-10-08T07:07:33.348 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.348 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.348 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118450+0000", 2023-10-08T07:07:33.348 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.348 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.348 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118450+0000", 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1699999999999999e-07 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118459+0000", 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2220000000000008e-06 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118465+0000", 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7400000000000001e-06 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.118469+0000", 2023-10-08T07:07:33.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5630000000000002e-06 2023-10-08T07:07:33.350 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.350 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.350 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.350 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130568 4.2 4.a29e5702 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.350 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.087690+0000", 2023-10-08T07:07:33.350 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.039279796999999998, 2023-10-08T07:07:33.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.042705756999999997, 2023-10-08T07:07:33.351 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.351 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.351 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.351 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.351 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.351 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130568 2023-10-08T07:07:33.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.351 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.351 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.351 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087690+0000", 2023-10-08T07:07:33.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087690+0000", 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087691+0000", 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5000000000000002e-07 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087702+0000", 2023-10-08T07:07:33.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1684e-05 2023-10-08T07:07:33.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.353 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087719+0000", 2023-10-08T07:07:33.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6866000000000001e-05 2023-10-08T07:07:33.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.353 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087726+0000", 2023-10-08T07:07:33.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9190000000000002e-06 2023-10-08T07:07:33.354 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.354 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.354 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.354 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130633 4.2c 4:352c144c:::10000000004.00000003:head [write 147456~4096 in=4096b,write 475136~4096 in=4096b,write 827392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.354 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.107474+0000", 2023-10-08T07:07:33.354 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.019495392, 2023-10-08T07:07:33.354 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022995484, 2023-10-08T07:07:33.354 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.354 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.354 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.355 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.355 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.355 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130633 2023-10-08T07:07:33.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.355 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.355 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107474+0000", 2023-10-08T07:07:33.355 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.356 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107474+0000", 2023-10-08T07:07:33.356 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.356 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.356 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.356 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107475+0000", 2023-10-08T07:07:33.356 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.78e-07 2023-10-08T07:07:33.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.356 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.356 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.356 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107487+0000", 2023-10-08T07:07:33.356 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1386000000000001e-05 2023-10-08T07:07:33.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107498+0000", 2023-10-08T07:07:33.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0925e-05 2023-10-08T07:07:33.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107504+0000", 2023-10-08T07:07:33.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7220000000000002e-06 2023-10-08T07:07:33.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107559+0000", 2023-10-08T07:07:33.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4413000000000002e-05 2023-10-08T07:07:33.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107684+0000", 2023-10-08T07:07:33.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012551399999999999 2023-10-08T07:07:33.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107869+0000", 2023-10-08T07:07:33.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018443100000000001 2023-10-08T07:07:33.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.359 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:33.359 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.116397+0000", 2023-10-08T07:07:33.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0085287850000000005 2023-10-08T07:07:33.359 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.359 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.359 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.359 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130672 4.1b 4:d97fb168:::10000000004.00000008:head [write 3334144~8192 in=8192b,write 3350528~4096 in=4096b,write 3379200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.119580+0000", 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.007389835, 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010976794, 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130672 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119580+0000", 2023-10-08T07:07:33.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119580+0000", 2023-10-08T07:07:33.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119581+0000", 2023-10-08T07:07:33.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9900000000000009e-07 2023-10-08T07:07:33.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119598+0000", 2023-10-08T07:07:33.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6827999999999999e-05 2023-10-08T07:07:33.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119610+0000", 2023-10-08T07:07:33.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2228999999999999e-05 2023-10-08T07:07:33.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119619+0000", 2023-10-08T07:07:33.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5399999999999996e-06 2023-10-08T07:07:33.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.363 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125752+0000", 2023-10-08T07:07:33.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0061330689999999997 2023-10-08T07:07:33.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.363 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125833+0000", 2023-10-08T07:07:33.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0908999999999994e-05 2023-10-08T07:07:33.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.364 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.364 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125976+0000", 2023-10-08T07:07:33.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000143051 2023-10-08T07:07:33.364 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.364 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.364 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.364 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130492 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2387968~4096 in=4096b,write 2404352~4096 in=4096b,write 2531328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.064175+0000", 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.062795241000000002, 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.066460654999999993, 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130492 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.064175+0000", 2023-10-08T07:07:33.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.064175+0000", 2023-10-08T07:07:33.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.064175+0000", 2023-10-08T07:07:33.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0200000000000002e-07 2023-10-08T07:07:33.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.367 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.367 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.064192+0000", 2023-10-08T07:07:33.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7433000000000001e-05 2023-10-08T07:07:33.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.367 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.367 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.064203+0000", 2023-10-08T07:07:33.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0236e-05 2023-10-08T07:07:33.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.064209+0000", 2023-10-08T07:07:33.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0920000000000003e-06 2023-10-08T07:07:33.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113831+0000", 2023-10-08T07:07:33.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049622708000000001 2023-10-08T07:07:33.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.113904+0000", 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2809e-05 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.114051+0000", 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014712199999999999 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130569 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.369 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.087926+0000", 2023-10-08T07:07:33.370 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.039043656000000003, 2023-10-08T07:07:33.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.042778723999999997, 2023-10-08T07:07:33.370 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.370 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.370 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.370 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.370 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.370 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130569 2023-10-08T07:07:33.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.370 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087926+0000", 2023-10-08T07:07:33.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087926+0000", 2023-10-08T07:07:33.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087927+0000", 2023-10-08T07:07:33.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3600000000000002e-07 2023-10-08T07:07:33.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.372 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087942+0000", 2023-10-08T07:07:33.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.543e-05 2023-10-08T07:07:33.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087953+0000", 2023-10-08T07:07:33.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0910999999999999e-05 2023-10-08T07:07:33.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.087961+0000", 2023-10-08T07:07:33.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4959999999999999e-06 2023-10-08T07:07:33.373 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.373 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.373 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.374 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130635 4.2b 4:d776c1c9:::10000000004.0000003d:head [write 172032~4096 in=4096b,write 438272~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.374 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.107961+0000", 2023-10-08T07:07:33.374 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.019008849000000001, 2023-10-08T07:07:33.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022802882, 2023-10-08T07:07:33.374 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.374 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.374 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.374 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.374 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.374 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130635 2023-10-08T07:07:33.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.374 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107961+0000", 2023-10-08T07:07:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107961+0000", 2023-10-08T07:07:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107962+0000", 2023-10-08T07:07:33.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.61e-07 2023-10-08T07:07:33.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107972+0000", 2023-10-08T07:07:33.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0550999999999999e-05 2023-10-08T07:07:33.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107982+0000", 2023-10-08T07:07:33.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7079999999999992e-06 2023-10-08T07:07:33.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.377 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.107989+0000", 2023-10-08T07:07:33.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7240000000000003e-06 2023-10-08T07:07:33.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.377 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108028+0000", 2023-10-08T07:07:33.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9576000000000002e-05 2023-10-08T07:07:33.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.378 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108085+0000", 2023-10-08T07:07:33.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6731000000000003e-05 2023-10-08T07:07:33.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.378 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108176+0000", 2023-10-08T07:07:33.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0946000000000006e-05 2023-10-08T07:07:33.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:33.378 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122822+0000", 2023-10-08T07:07:33.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014646153 2023-10-08T07:07:33.379 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.379 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.379 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.379 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130673 4.2 4.a29e5702 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.379 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.119904+0000", 2023-10-08T07:07:33.379 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0070657360000000004, 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010935337999999999, 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130673 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119904+0000", 2023-10-08T07:07:33.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.381 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119904+0000", 2023-10-08T07:07:33.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119905+0000", 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3600000000000003e-07 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119920+0000", 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5159e-05 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119930+0000", 2023-10-08T07:07:33.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0112000000000001e-05 2023-10-08T07:07:33.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.119937+0000", 2023-10-08T07:07:33.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1269999999999997e-06 2023-10-08T07:07:33.383 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.383 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.383 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.384 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130636 4.e 4:70352312:::10000000004.0000001a:head [write 774144~8192 in=8192b,write 876544~4096 in=4096b,write 925696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.384 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.108151+0000", 2023-10-08T07:07:33.384 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.01881888, 2023-10-08T07:07:33.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022749124999999999, 2023-10-08T07:07:33.384 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.384 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.384 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.384 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.384 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.384 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130636 2023-10-08T07:07:33.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.385 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108151+0000", 2023-10-08T07:07:33.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108151+0000", 2023-10-08T07:07:33.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108151+0000", 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0100000000000005e-07 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108169+0000", 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7887e-05 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.386 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108181+0000", 2023-10-08T07:07:33.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1522000000000001e-05 2023-10-08T07:07:33.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.387 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108193+0000", 2023-10-08T07:07:33.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2357999999999999e-05 2023-10-08T07:07:33.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.387 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.123431+0000", 2023-10-08T07:07:33.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015237455 2023-10-08T07:07:33.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.123514+0000", 2023-10-08T07:07:33.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3738000000000004e-05 2023-10-08T07:07:33.388 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.388 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.388 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.388 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130675 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.388 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.120772+0000", 2023-10-08T07:07:33.388 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0061979039999999997, 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010196617, 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130675 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.120772+0000", 2023-10-08T07:07:33.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.120772+0000", 2023-10-08T07:07:33.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.120773+0000", 2023-10-08T07:07:33.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1399999999999995e-07 2023-10-08T07:07:33.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.120786+0000", 2023-10-08T07:07:33.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3254e-05 2023-10-08T07:07:33.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.120802+0000", 2023-10-08T07:07:33.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5590000000000002e-05 2023-10-08T07:07:33.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.120811+0000", 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3360000000000001e-06 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130459 4.32 4:4efc9492:::10000000004.00000032:head [write 94208~4096 in=4096b,write 385024~4096 in=4096b,write 434176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.055428+0000", 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.071541750000000001, 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.075600414000000005, 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.392 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130459 2023-10-08T07:07:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.055428+0000", 2023-10-08T07:07:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.055428+0000", 2023-10-08T07:07:33.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.055428+0000", 2023-10-08T07:07:33.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6499999999999999e-07 2023-10-08T07:07:33.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.055441+0000", 2023-10-08T07:07:33.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.055448+0000", 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0299999999999996e-06 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.055453+0000", 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5310000000000001e-06 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.105029+0000", 2023-10-08T07:07:33.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049575607000000001 2023-10-08T07:07:33.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.105119+0000", 2023-10-08T07:07:33.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9986000000000002e-05 2023-10-08T07:07:33.396 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.396 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.396 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130677 4.e 4.1215424e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.121294+0000", 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0056759829999999999, 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0098086400000000004, 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130677 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.121294+0000", 2023-10-08T07:07:33.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.121294+0000", 2023-10-08T07:07:33.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.121295+0000", 2023-10-08T07:07:33.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3699999999999999e-07 2023-10-08T07:07:33.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.121314+0000", 2023-10-08T07:07:33.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9230000000000001e-05 2023-10-08T07:07:33.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.121328+0000", 2023-10-08T07:07:33.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4153e-05 2023-10-08T07:07:33.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.400 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.400 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.121335+0000", 2023-10-08T07:07:33.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4699999999999996e-06 2023-10-08T07:07:33.400 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.400 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.400 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.400 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130463 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3833856~4096 in=4096b,write 3940352~4096 in=4096b,write 4009984~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.400 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.055461+0000", 2023-10-08T07:07:33.400 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.071508736000000003, 2023-10-08T07:07:33.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.075703431000000002, 2023-10-08T07:07:33.401 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.401 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.401 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.401 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.401 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.401 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130463 2023-10-08T07:07:33.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.401 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.055461+0000", 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.055461+0000", 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.055461+0000", 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8299999999999998e-07 2023-10-08T07:07:33.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.055471+0000", 2023-10-08T07:07:33.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9790000000000005e-06 2023-10-08T07:07:33.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.055477+0000", 2023-10-08T07:07:33.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0299999999999999e-06 2023-10-08T07:07:33.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.055483+0000", 2023-10-08T07:07:33.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0989999999999998e-06 2023-10-08T07:07:33.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.111016+0000", 2023-10-08T07:07:33.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055533866000000001 2023-10-08T07:07:33.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.111091+0000", 2023-10-08T07:07:33.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4412999999999994e-05 2023-10-08T07:07:33.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.111261+0000", 2023-10-08T07:07:33.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017067800000000001 2023-10-08T07:07:33.405 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.405 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.405 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.405 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130637 4.34 4:2dadb699:::10000000004.00000031:head [write 4091904~4096 in=4096b,write 4116480~4096 in=4096b,write 4132864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.405 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.108589+0000", 2023-10-08T07:07:33.406 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.018380486000000001, 2023-10-08T07:07:33.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022730579000000001, 2023-10-08T07:07:33.406 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.406 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.406 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.406 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.406 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.406 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130637 2023-10-08T07:07:33.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.406 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108589+0000", 2023-10-08T07:07:33.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108589+0000", 2023-10-08T07:07:33.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.407 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108590+0000", 2023-10-08T07:07:33.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.92e-07 2023-10-08T07:07:33.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108606+0000", 2023-10-08T07:07:33.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5846999999999999e-05 2023-10-08T07:07:33.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108620+0000", 2023-10-08T07:07:33.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3743e-05 2023-10-08T07:07:33.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108629+0000", 2023-10-08T07:07:33.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4760000000000004e-06 2023-10-08T07:07:33.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108687+0000", 2023-10-08T07:07:33.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7649000000000003e-05 2023-10-08T07:07:33.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.108792+0000", 2023-10-08T07:07:33.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000104862 2023-10-08T07:07:33.410 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.410 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.410 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.410 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130496 4.2 4:40ea7945:::10000000004.0000003e:head [write 851968~4096 in=4096b,write 905216~4096 in=4096b,write 1081344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.410 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.064314+0000", 2023-10-08T07:07:33.410 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.062655391000000005, 2023-10-08T07:07:33.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.067078879999999994, 2023-10-08T07:07:33.411 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.411 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.411 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.411 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.411 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.411 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130496 2023-10-08T07:07:33.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.411 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.064314+0000", 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.064314+0000", 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.064315+0000", 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.064325+0000", 2023-10-08T07:07:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0302000000000001e-05 2023-10-08T07:07:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.064332+0000", 2023-10-08T07:07:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3729999999999998e-06 2023-10-08T07:07:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.064336+0000", 2023-10-08T07:07:33.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6809999999999997e-06 2023-10-08T07:07:33.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.114088+0000", 2023-10-08T07:07:33.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049752013999999997 2023-10-08T07:07:33.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.114169+0000", 2023-10-08T07:07:33.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0709000000000003e-05 2023-10-08T07:07:33.414 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.415 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.415 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.415 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130639 4.20 4:07572838:::10000000004.00000010:head [write 1568768~4096 in=4096b,write 2269184~4096 in=4096b,write 2420736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.415 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.109230+0000", 2023-10-08T07:07:33.415 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.017740227000000001, 2023-10-08T07:07:33.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022276351, 2023-10-08T07:07:33.415 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.415 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.415 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.415 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130639 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.109230+0000", 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.109230+0000", 2023-10-08T07:07:33.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.109230+0000", 2023-10-08T07:07:33.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5000000000000001e-07 2023-10-08T07:07:33.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.109242+0000", 2023-10-08T07:07:33.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1694e-05 2023-10-08T07:07:33.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.109253+0000", 2023-10-08T07:07:33.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1199000000000001e-05 2023-10-08T07:07:33.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.109261+0000", 2023-10-08T07:07:33.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1839999999999999e-06 2023-10-08T07:07:33.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.131230+0000", 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021968061000000001 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.131318+0000", 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8276000000000007e-05 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.131508+0000", 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000190244 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.419 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.420 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.420 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130679 4.30 4.44544cf0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.420 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.121878+0000", 2023-10-08T07:07:33.420 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0050922390000000001, 2023-10-08T07:07:33.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0097202220000000006, 2023-10-08T07:07:33.420 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.420 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.420 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.420 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.421 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.421 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130679 2023-10-08T07:07:33.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.421 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.121878+0000", 2023-10-08T07:07:33.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.121878+0000", 2023-10-08T07:07:33.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.121878+0000", 2023-10-08T07:07:33.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9500000000000001e-07 2023-10-08T07:07:33.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.121906+0000", 2023-10-08T07:07:33.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7827e-05 2023-10-08T07:07:33.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.121920+0000", 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3499999999999999e-05 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.121928+0000", 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9000000000000006e-06 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.424 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130498 4.1a 4:5a59f83a:::10000000004.00000002:head [write 16384~4096 in=4096b,write 126976~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.424 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.065182+0000", 2023-10-08T07:07:33.424 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.061787612999999998, 2023-10-08T07:07:33.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.066488245000000001, 2023-10-08T07:07:33.424 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.424 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.424 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.424 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.424 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.424 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130498 2023-10-08T07:07:33.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.065182+0000", 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.065182+0000", 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.065189+0000", 2023-10-08T07:07:33.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2099999999999996e-06 2023-10-08T07:07:33.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.065200+0000", 2023-10-08T07:07:33.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0974e-05 2023-10-08T07:07:33.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.065211+0000", 2023-10-08T07:07:33.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0247e-05 2023-10-08T07:07:33.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.065218+0000", 2023-10-08T07:07:33.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.328e-06 2023-10-08T07:07:33.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.116197+0000", 2023-10-08T07:07:33.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050979099 2023-10-08T07:07:33.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.116266+0000", 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9128000000000006e-05 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.116391+0000", 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000125048 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.429 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130539 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2134016~4096 in=4096b,write 2158592~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.429 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.080268+0000", 2023-10-08T07:07:33.429 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.046702021000000003, 2023-10-08T07:07:33.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.051461622999999998, 2023-10-08T07:07:33.429 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.429 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.429 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.429 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.429 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.429 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130539 2023-10-08T07:07:33.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.429 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.080268+0000", 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.080268+0000", 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.080269+0000", 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2279999999999999e-06 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.080283+0000", 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4314000000000001e-05 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.080295+0000", 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1618e-05 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.080302+0000", 2023-10-08T07:07:33.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5530000000000004e-06 2023-10-08T07:07:33.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.126469+0000", 2023-10-08T07:07:33.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046166193000000001 2023-10-08T07:07:33.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.126541+0000", 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2407e-05 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.126671+0000", 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000130018 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130640 4.2 4.a29e5702 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.433 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.109521+0000", 2023-10-08T07:07:33.434 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.017448969000000002, 2023-10-08T07:07:33.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022252638000000002, 2023-10-08T07:07:33.434 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.434 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.434 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.434 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.434 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.434 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130640 2023-10-08T07:07:33.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.434 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.109521+0000", 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.109521+0000", 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.109522+0000", 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.06e-07 2023-10-08T07:07:33.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.109534+0000", 2023-10-08T07:07:33.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2424e-05 2023-10-08T07:07:33.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.109546+0000", 2023-10-08T07:07:33.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2401999999999999e-05 2023-10-08T07:07:33.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.109553+0000", 2023-10-08T07:07:33.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6479999999999997e-06 2023-10-08T07:07:33.437 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.437 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.437 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.437 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130681 4.2b 4:d776c1c9:::10000000004.0000003d:head [write 520192~4096 in=4096b,write 643072~4096 in=4096b,write 675840~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.437 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.122459+0000", 2023-10-08T07:07:33.437 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0045109950000000003, 2023-10-08T07:07:33.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0093525610000000006, 2023-10-08T07:07:33.437 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130681 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122459+0000", 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122459+0000", 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122460+0000", 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5099999999999998e-07 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122471+0000", 2023-10-08T07:07:33.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1746000000000001e-05 2023-10-08T07:07:33.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122486+0000", 2023-10-08T07:07:33.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4293e-05 2023-10-08T07:07:33.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.122494+0000", 2023-10-08T07:07:33.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2509999999999994e-06 2023-10-08T07:07:33.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125490+0000", 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029965170000000002 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125588+0000", 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7697999999999999e-05 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.126172+0000", 2023-10-08T07:07:33.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00058397699999999996 2023-10-08T07:07:33.442 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.442 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.442 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.442 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130499 4.a 4:524fba76:::10000000004.0000001b:head [write 524288~4096 in=4096b,write 540672~4096 in=4096b,write 565248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.442 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.065320+0000", 2023-10-08T07:07:33.442 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.061649865999999998, 2023-10-08T07:07:33.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.066535974999999997, 2023-10-08T07:07:33.442 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.442 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.442 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130499 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.065320+0000", 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.443 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.065320+0000", 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.065321+0000", 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4199999999999995e-07 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.065364+0000", 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3741e-05 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.065373+0000", 2023-10-08T07:07:33.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1789999999999997e-06 2023-10-08T07:07:33.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.065380+0000", 2023-10-08T07:07:33.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2750000000000001e-06 2023-10-08T07:07:33.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.116744+0000", 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.051363852000000002 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.116824+0000", 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0889000000000004e-05 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.116965+0000", 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014096200000000001 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.446 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.447 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.447 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130604 4.3a 4.d27c18fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.447 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.099391+0000", 2023-10-08T07:07:33.447 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027578464, 2023-10-08T07:07:33.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032507392000000003, 2023-10-08T07:07:33.447 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.447 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.447 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.447 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.447 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130604 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099391+0000", 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099391+0000", 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099393+0000", 2023-10-08T07:07:33.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2130000000000001e-06 2023-10-08T07:07:33.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099406+0000", 2023-10-08T07:07:33.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3687e-05 2023-10-08T07:07:33.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099417+0000", 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0539e-05 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099425+0000", 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3639999999999999e-06 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130642 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.450 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.110247+0000", 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.01672237, 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021682281000000001, 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130642 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.110247+0000", 2023-10-08T07:07:33.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.110247+0000", 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.110248+0000", 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3300000000000002e-07 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.110257+0000", 2023-10-08T07:07:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5369999999999997e-06 2023-10-08T07:07:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.110264+0000", 2023-10-08T07:07:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7400000000000004e-06 2023-10-08T07:07:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.110269+0000", 2023-10-08T07:07:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1410000000000004e-06 2023-10-08T07:07:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.454 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.454 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.454 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130684 4.c 4:3352c333:::10000000004.00000012:head [write 1716224~4096 in=4096b,write 1937408~4096 in=4096b,write 2031616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.454 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.123609+0000", 2023-10-08T07:07:33.454 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0033603299999999999, 2023-10-08T07:07:33.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083549269999999998, 2023-10-08T07:07:33.454 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.454 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.454 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.454 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130684 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.123609+0000", 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.123609+0000", 2023-10-08T07:07:33.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.123610+0000", 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3799999999999996e-07 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.123623+0000", 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.239e-05 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.123637+0000", 2023-10-08T07:07:33.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4168000000000001e-05 2023-10-08T07:07:33.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.123645+0000", 2023-10-08T07:07:33.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.422e-06 2023-10-08T07:07:33.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.127293+0000", 2023-10-08T07:07:33.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0036475650000000002 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.127365+0000", 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2371000000000002e-05 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.127516+0000", 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015075599999999999 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.458 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130605 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.099440+0000", 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027530071999999999, 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032567117999999999, 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130605 2023-10-08T07:07:33.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.460 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099440+0000", 2023-10-08T07:07:33.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099440+0000", 2023-10-08T07:07:33.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099440+0000", 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4799999999999999e-07 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099452+0000", 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.188e-05 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099463+0000", 2023-10-08T07:07:33.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1059e-05 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099469+0000", 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7620000000000001e-06 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130686 4.2 4.508f73c2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.124195+0000", 2023-10-08T07:07:33.462 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0027743849999999999, 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0078416779999999995, 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130686 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.124195+0000", 2023-10-08T07:07:33.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.124195+0000", 2023-10-08T07:07:33.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.124196+0000", 2023-10-08T07:07:33.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1699999999999997e-07 2023-10-08T07:07:33.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.124212+0000", 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6053999999999999e-05 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.124226+0000", 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3232e-05 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.124233+0000", 2023-10-08T07:07:33.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7980000000000006e-06 2023-10-08T07:07:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130606 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.099491+0000", 2023-10-08T07:07:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027478868, 2023-10-08T07:07:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032577726000000001, 2023-10-08T07:07:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.466 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.467 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.467 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.467 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130606 2023-10-08T07:07:33.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.467 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099491+0000", 2023-10-08T07:07:33.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099491+0000", 2023-10-08T07:07:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099492+0000", 2023-10-08T07:07:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8000000000000004e-07 2023-10-08T07:07:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099509+0000", 2023-10-08T07:07:33.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7632e-05 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099521+0000", 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1303e-05 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099528+0000", 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7849999999999992e-06 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.469 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.470 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130689 4.5 4:a2ff1403:::10000000004.00000039:head [write 434176~4096 in=4096b,write 450560~4096 in=4096b,write 475136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.470 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.125021+0000", 2023-10-08T07:07:33.470 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.001948532, 2023-10-08T07:07:33.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070810860000000003, 2023-10-08T07:07:33.470 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.470 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.470 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.470 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.470 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.470 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130689 2023-10-08T07:07:33.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.471 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125021+0000", 2023-10-08T07:07:33.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125021+0000", 2023-10-08T07:07:33.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125022+0000", 2023-10-08T07:07:33.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5600000000000004e-07 2023-10-08T07:07:33.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125034+0000", 2023-10-08T07:07:33.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1545e-05 2023-10-08T07:07:33.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.472 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125044+0000", 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.03e-05 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125052+0000", 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6299999999999998e-06 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125113+0000", 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0986000000000002e-05 2023-10-08T07:07:33.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125213+0000", 2023-10-08T07:07:33.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010045800000000001 2023-10-08T07:07:33.474 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.474 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.474 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.474 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130546 4.a 4:524fba76:::10000000004.0000001b:head [write 1683456~4096 in=4096b,write 1724416~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.474 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.080434+0000", 2023-10-08T07:07:33.474 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.046536069999999999, 2023-10-08T07:07:33.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.051708852, 2023-10-08T07:07:33.475 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.475 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.475 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.475 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.475 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.475 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130546 2023-10-08T07:07:33.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.475 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.080434+0000", 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.080434+0000", 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.080434+0000", 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2899999999999999e-07 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.080445+0000", 2023-10-08T07:07:33.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0468e-05 2023-10-08T07:07:33.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.080452+0000", 2023-10-08T07:07:33.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3379999999999999e-06 2023-10-08T07:07:33.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.477 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.080458+0000", 2023-10-08T07:07:33.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7019999999999998e-06 2023-10-08T07:07:33.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.128890+0000", 2023-10-08T07:07:33.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048432583000000001 2023-10-08T07:07:33.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.128939+0000", 2023-10-08T07:07:33.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8328000000000002e-05 2023-10-08T07:07:33.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129025+0000", 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6454999999999998e-05 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130607 4.20 4:07572838:::10000000004.00000010:head [write 3940352~4096 in=4096b,write 4005888~4096 in=4096b,write 4063232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.099542+0000", 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027427944999999999, 2023-10-08T07:07:33.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032656075, 2023-10-08T07:07:33.480 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.480 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:33.480 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.480 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.480 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.480 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130607 2023-10-08T07:07:33.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.480 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099542+0000", 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099542+0000", 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099542+0000", 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7100000000000002e-07 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099560+0000", 2023-10-08T07:07:33.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7159e-05 2023-10-08T07:07:33.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099574+0000", 2023-10-08T07:07:33.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.491e-05 2023-10-08T07:07:33.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099582+0000", 2023-10-08T07:07:33.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3980000000000002e-06 2023-10-08T07:07:33.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.483 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099768+0000", 2023-10-08T07:07:33.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000186386 2023-10-08T07:07:33.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.483 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.483 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099856+0000", 2023-10-08T07:07:33.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7896e-05 2023-10-08T07:07:33.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.100026+0000", 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000169941 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.125402+0000", 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.025375873 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop_reply(client.4556.0:130596 4.30 e59/17)", 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.129554+0000", 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9974155, 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027346359999999999, 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129554+0000", 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129554+0000", 2023-10-08T07:07:33.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129556+0000", 2023-10-08T07:07:33.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.299e-06 2023-10-08T07:07:33.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129564+0000", 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0819999999999999e-06 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129575+0000", 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1428e-05 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129585+0000", 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0156999999999999e-05 2023-10-08T07:07:33.487 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130580 4.2 4.508f73c2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.091546+0000", 2023-10-08T07:07:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.035423795000000001, 2023-10-08T07:07:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.040798028, 2023-10-08T07:07:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.489 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.489 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130580 2023-10-08T07:07:33.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.489 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.091546+0000", 2023-10-08T07:07:33.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.091546+0000", 2023-10-08T07:07:33.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.091547+0000", 2023-10-08T07:07:33.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7300000000000005e-07 2023-10-08T07:07:33.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.091558+0000", 2023-10-08T07:07:33.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1233000000000001e-05 2023-10-08T07:07:33.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.091568+0000", 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0454e-05 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.091576+0000", 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4059999999999999e-06 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130608 4.2 4.508f73c2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.099597+0000", 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027372357, 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032814817000000003, 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130608 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.492 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099597+0000", 2023-10-08T07:07:33.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.493 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099597+0000", 2023-10-08T07:07:33.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.493 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099598+0000", 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8999999999999996e-07 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099611+0000", 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3281999999999999e-05 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099620+0000", 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3480000000000004e-06 2023-10-08T07:07:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.099626+0000", 2023-10-08T07:07:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4729999999999997e-06 2023-10-08T07:07:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:130644 4.e 4:7242a848:::10000000004.00000020:head [write 102400~4096 in=4096b,write 135168~4096 in=4096b,write 397312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.112209+0000", 2023-10-08T07:07:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.014761016, 2023-10-08T07:07:33.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020275993999999999, 2023-10-08T07:07:33.496 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.496 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:33.496 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:33.496 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:33.496 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:33.496 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 130644 2023-10-08T07:07:33.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.496 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112209+0000", 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112209+0000", 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112210+0000", 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0780000000000001e-06 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112222+0000", 2023-10-08T07:07:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1829e-05 2023-10-08T07:07:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112233+0000", 2023-10-08T07:07:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1798e-05 2023-10-08T07:07:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.112241+0000", 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6729999999999992e-06 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.126139+0000", 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013897949999999999 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.126234+0000", 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4946999999999997e-05 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.499 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.500 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.500 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:128405 4.16 e59/17)", 2023-10-08T07:07:33.500 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:33.129603+0000", 2023-10-08T07:07:33.500 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9973664, 2023-10-08T07:07:33.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029563810000000001, 2023-10-08T07:07:33.500 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:33.500 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:33.500 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:33.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.500 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129603+0000", 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129603+0000", 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129604+0000", 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9799999999999999e-07 2023-10-08T07:07:33.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129629+0000", 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5168e-05 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129637+0000", 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6729999999999992e-06 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:33.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:33.129643+0000", 2023-10-08T07:07:33.503 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9580000000000004e-06 2023-10-08T07:07:33.503 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.503 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:33.503 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.503 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:33.503 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:07:33.503 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 79 2023-10-08T07:07:33.503 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:33.503 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:33.505 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:33.506 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:33.506+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2023-10-08T07:07:33.605 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:33.604+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:33.680 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:33.706 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:33.706 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:33.706 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:33.706 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:33.707 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:33.706+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:33.707 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:33.707 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:33.709 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:33.709 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:33.721 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:33.807 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:33.807+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:33.908 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:33.908+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:33.977 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:33.977 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:33.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:34.036 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:34.036+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:34.110 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:34.108+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:34.202 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:34.203 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:34.210 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:34.210+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:34.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:34.313 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:34.310+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:34.413 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:34.412+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:34.462 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:34.462 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:34.474 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:34.515 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:34.514+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:34.614 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:34.614+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:34.717 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:34.717 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:34.719 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:34.715+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:34.734 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:34.816 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:34.816+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:34.918 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:34.918+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:35.002 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:35.002 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:35.002 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:35.043 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:35.043+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:35.121 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:35.120+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:35.223 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:35.221+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:35.253 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:35.253 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:35.269 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:35.354 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:35.354+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:35.423 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:35.421+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:35.517 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:35.517 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:35.524 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:35.523+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:35.536 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:35.602 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T07:07:35.624 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:35.623+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:35.710 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:07:35.725 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:35.725+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:35.744 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:35.744 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:35.758 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:35.843 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:35.842+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:35.922 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:35.923 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:07:35.923 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:35.923 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:07:35.926 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:35.927 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:35.927 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:35.925+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:36.012 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:36.012 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:36.024 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:36.027 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:36.027+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:36.128 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:36.128+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:36.229 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:36.228+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:36.269 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:36.269 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:36.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:36.269 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:36.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.270 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125474 4.10 4:0b5763e1:::10000000004.00000015:head [write 122880~4096,write 159744~4096,write 450560~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.270 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.868442+0000", 2023-10-08T07:07:36.270 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3981226790000001, 2023-10-08T07:07:36.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.334172594, 2023-10-08T07:07:36.270 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.270 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.270 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125474 2023-10-08T07:07:36.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.271 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.868442+0000", 2023-10-08T07:07:36.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.868442+0000", 2023-10-08T07:07:36.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.868443+0000", 2023-10-08T07:07:36.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4099999999999998e-07 2023-10-08T07:07:36.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.868454+0000", 2023-10-08T07:07:36.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1049999999999999e-05 2023-10-08T07:07:36.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.868482+0000", 2023-10-08T07:07:36.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8636000000000002e-05 2023-10-08T07:07:36.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.868494+0000", 2023-10-08T07:07:36.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1325000000000001e-05 2023-10-08T07:07:36.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.186404+0000", 2023-10-08T07:07:36.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3179103089999999 2023-10-08T07:07:36.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.186497+0000", 2023-10-08T07:07:36.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3309999999999999e-05 2023-10-08T07:07:36.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.202456+0000", 2023-10-08T07:07:36.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015958809000000001 2023-10-08T07:07:36.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.202510+0000", 2023-10-08T07:07:36.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3686000000000001e-05 2023-10-08T07:07:36.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.202615+0000", 2023-10-08T07:07:36.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010482800000000001 2023-10-08T07:07:36.275 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.276 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.276 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125489 4.10 4:0b5763e1:::10000000004.00000015:head [write 491520~4096,write 770048~4096,write 798720~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.276 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.874345+0000", 2023-10-08T07:07:36.276 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.392219517, 2023-10-08T07:07:36.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3340265040000001, 2023-10-08T07:07:36.276 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.276 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.276 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.276 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.277 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.277 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125489 2023-10-08T07:07:36.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.277 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.874345+0000", 2023-10-08T07:07:36.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.874345+0000", 2023-10-08T07:07:36.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.874346+0000", 2023-10-08T07:07:36.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:07:36.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.874358+0000", 2023-10-08T07:07:36.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2313000000000001e-05 2023-10-08T07:07:36.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.874415+0000", 2023-10-08T07:07:36.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6736e-05 2023-10-08T07:07:36.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.874420+0000", 2023-10-08T07:07:36.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1089999999999997e-06 2023-10-08T07:07:36.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.194880+0000", 2023-10-08T07:07:36.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.320460575 2023-10-08T07:07:36.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.194952+0000", 2023-10-08T07:07:36.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1911999999999999e-05 2023-10-08T07:07:36.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.208220+0000", 2023-10-08T07:07:36.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01326722 2023-10-08T07:07:36.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.208270+0000", 2023-10-08T07:07:36.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0572000000000003e-05 2023-10-08T07:07:36.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.208372+0000", 2023-10-08T07:07:36.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101505 2023-10-08T07:07:36.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.282 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.282 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125491 4.10 4:0b5763e1:::10000000004.00000015:head [write 872448~4096,write 913408~4096,write 1048576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.282 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.874463+0000", 2023-10-08T07:07:36.282 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3921018460000001, 2023-10-08T07:07:36.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3340398419999999, 2023-10-08T07:07:36.282 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.283 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.283 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125491 2023-10-08T07:07:36.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.283 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.874463+0000", 2023-10-08T07:07:36.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.874463+0000", 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.874463+0000", 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2300000000000002e-07 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.874475+0000", 2023-10-08T07:07:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1841000000000001e-05 2023-10-08T07:07:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.874482+0000", 2023-10-08T07:07:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9840000000000004e-06 2023-10-08T07:07:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.874487+0000", 2023-10-08T07:07:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1839999999999998e-06 2023-10-08T07:07:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.197633+0000", 2023-10-08T07:07:36.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3231453040000001 2023-10-08T07:07:36.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.197707+0000", 2023-10-08T07:07:36.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4051e-05 2023-10-08T07:07:36.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.208381+0000", 2023-10-08T07:07:36.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010673846000000001 2023-10-08T07:07:36.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.208433+0000", 2023-10-08T07:07:36.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1999000000000001e-05 2023-10-08T07:07:36.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.208503+0000", 2023-10-08T07:07:36.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0209999999999994e-05 2023-10-08T07:07:36.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.288 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.288 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125497 4.28 4:15b6682b:::10000000004.0000000b:head [write 2617344~8192,write 2940928~4096,write 3006464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.288 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.878446+0000", 2023-10-08T07:07:36.288 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3881187409999995, 2023-10-08T07:07:36.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3301851600000001, 2023-10-08T07:07:36.288 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.289 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.289 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125497 2023-10-08T07:07:36.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.289 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.878446+0000", 2023-10-08T07:07:36.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.878446+0000", 2023-10-08T07:07:36.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.880294+0000", 2023-10-08T07:07:36.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018475340000000001 2023-10-08T07:07:36.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.880307+0000", 2023-10-08T07:07:36.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3774999999999999e-05 2023-10-08T07:07:36.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.880317+0000", 2023-10-08T07:07:36.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5200000000000003e-06 2023-10-08T07:07:36.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.880322+0000", 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2639999999999999e-06 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.197621+0000", 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3172985850000001 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.197692+0000", 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1667000000000003e-05 2023-10-08T07:07:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.208511+0000", 2023-10-08T07:07:36.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010818477999999999 2023-10-08T07:07:36.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.208559+0000", 2023-10-08T07:07:36.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8401e-05 2023-10-08T07:07:36.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.208631+0000", 2023-10-08T07:07:36.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1935999999999997e-05 2023-10-08T07:07:36.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.294 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.294 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125519 4.28 4:16edf4d3:::10000000004.00000027:head [write 3076096~4096,write 3198976~4096,write 3211264~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.294 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.888468+0000", 2023-10-08T07:07:36.294 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3780971920000002, 2023-10-08T07:07:36.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.332064057, 2023-10-08T07:07:36.294 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.295 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.295 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125519 2023-10-08T07:07:36.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.295 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.888468+0000", 2023-10-08T07:07:36.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.888468+0000", 2023-10-08T07:07:36.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.888468+0000", 2023-10-08T07:07:36.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1699999999999998e-07 2023-10-08T07:07:36.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.888482+0000", 2023-10-08T07:07:36.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4302e-05 2023-10-08T07:07:36.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.888489+0000", 2023-10-08T07:07:36.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.251e-06 2023-10-08T07:07:36.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.888494+0000", 2023-10-08T07:07:36.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8539999999999996e-06 2023-10-08T07:07:36.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.205312+0000", 2023-10-08T07:07:36.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.316817992 2023-10-08T07:07:36.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.205391+0000", 2023-10-08T07:07:36.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9808000000000006e-05 2023-10-08T07:07:36.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.220408+0000", 2023-10-08T07:07:36.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015016995 2023-10-08T07:07:36.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.220461+0000", 2023-10-08T07:07:36.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2330000000000002e-05 2023-10-08T07:07:36.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.220532+0000", 2023-10-08T07:07:36.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0908000000000006e-05 2023-10-08T07:07:36.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.300 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.300 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125537 4.28 4:15b6682b:::10000000004.0000000b:head [write 421888~4096,write 446464~4096,write 573440~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.301 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.893906+0000", 2023-10-08T07:07:36.301 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3726591990000001, 2023-10-08T07:07:36.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.332573483, 2023-10-08T07:07:36.301 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.301 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.301 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125537 2023-10-08T07:07:36.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.301 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.893906+0000", 2023-10-08T07:07:36.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.893906+0000", 2023-10-08T07:07:36.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.897296+0000", 2023-10-08T07:07:36.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033905960000000001 2023-10-08T07:07:36.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.897314+0000", 2023-10-08T07:07:36.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8253999999999998e-05 2023-10-08T07:07:36.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.897325+0000", 2023-10-08T07:07:36.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1059e-05 2023-10-08T07:07:36.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.897333+0000", 2023-10-08T07:07:36.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:07:36.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.208663+0000", 2023-10-08T07:07:36.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.311330613 2023-10-08T07:07:36.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.208750+0000", 2023-10-08T07:07:36.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6459999999999996e-05 2023-10-08T07:07:36.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.226393+0000", 2023-10-08T07:07:36.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017643157999999999 2023-10-08T07:07:36.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.226435+0000", 2023-10-08T07:07:36.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2061000000000003e-05 2023-10-08T07:07:36.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.226479+0000", 2023-10-08T07:07:36.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4144000000000003e-05 2023-10-08T07:07:36.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.306 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.307 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125539 4.28 4:16edf4d3:::10000000004.00000027:head [write 643072~4096,write 774144~4096,write 798720~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.307 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.899347+0000", 2023-10-08T07:07:36.307 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3672175969999998, 2023-10-08T07:07:36.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.327259942, 2023-10-08T07:07:36.307 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.307 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.308 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125539 2023-10-08T07:07:36.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.308 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.899347+0000", 2023-10-08T07:07:36.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.899347+0000", 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.899348+0000", 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9599999999999999e-07 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.899362+0000", 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4752999999999999e-05 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.899369+0000", 2023-10-08T07:07:36.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0400000000000004e-06 2023-10-08T07:07:36.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.899375+0000", 2023-10-08T07:07:36.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2039999999999996e-06 2023-10-08T07:07:36.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.213350+0000", 2023-10-08T07:07:36.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3139754080000001 2023-10-08T07:07:36.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.213446+0000", 2023-10-08T07:07:36.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5835999999999995e-05 2023-10-08T07:07:36.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.226488+0000", 2023-10-08T07:07:36.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013041719 2023-10-08T07:07:36.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.226538+0000", 2023-10-08T07:07:36.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.003e-05 2023-10-08T07:07:36.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.226607+0000", 2023-10-08T07:07:36.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9455999999999994e-05 2023-10-08T07:07:36.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.312 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.313 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125549 4.28 4:15b6682b:::10000000004.0000000b:head [write 823296~4096,write 897024~4096,write 958464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.313 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.905420+0000", 2023-10-08T07:07:36.313 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3611444419999996, 2023-10-08T07:07:36.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3334873090000001, 2023-10-08T07:07:36.313 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.313 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125549 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.905420+0000", 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.905420+0000", 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.905421+0000", 2023-10-08T07:07:36.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4700000000000001e-07 2023-10-08T07:07:36.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.905433+0000", 2023-10-08T07:07:36.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2551999999999999e-05 2023-10-08T07:07:36.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.905440+0000", 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.686e-06 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.905445+0000", 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1950000000000002e-06 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.218166+0000", 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.312720653 2023-10-08T07:07:36.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.218216+0000", 2023-10-08T07:07:36.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9611999999999999e-05 2023-10-08T07:07:36.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.238787+0000", 2023-10-08T07:07:36.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020571226000000001 2023-10-08T07:07:36.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.238839+0000", 2023-10-08T07:07:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2061000000000002e-05 2023-10-08T07:07:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.238908+0000", 2023-10-08T07:07:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8776999999999996e-05 2023-10-08T07:07:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.319 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125563 4.10 4:0b5763e1:::10000000004.00000015:head [write 684032~4096,write 1077248~4096,write 1204224~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.319 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.906842+0000", 2023-10-08T07:07:36.319 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.359722734, 2023-10-08T07:07:36.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.332220985, 2023-10-08T07:07:36.319 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.319 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.319 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125563 2023-10-08T07:07:36.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.906842+0000", 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.906842+0000", 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.906843+0000", 2023-10-08T07:07:36.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2023-10-08T07:07:36.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.906855+0000", 2023-10-08T07:07:36.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2391e-05 2023-10-08T07:07:36.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.906861+0000", 2023-10-08T07:07:36.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4489999999999996e-06 2023-10-08T07:07:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.906867+0000", 2023-10-08T07:07:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8289999999999996e-06 2023-10-08T07:07:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.221618+0000", 2023-10-08T07:07:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3147506629999999 2023-10-08T07:07:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.221667+0000", 2023-10-08T07:07:36.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9172999999999998e-05 2023-10-08T07:07:36.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.238952+0000", 2023-10-08T07:07:36.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017284651000000002 2023-10-08T07:07:36.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.238997+0000", 2023-10-08T07:07:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5031999999999998e-05 2023-10-08T07:07:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.239063+0000", 2023-10-08T07:07:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6246000000000002e-05 2023-10-08T07:07:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125566 4.28 4:16edf4d3:::10000000004.00000027:head [write 466944~4096,write 872448~4096,write 888832~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.906915+0000", 2023-10-08T07:07:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3596494540000004, 2023-10-08T07:07:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3397740790000001, 2023-10-08T07:07:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125566 2023-10-08T07:07:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.906915+0000", 2023-10-08T07:07:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.906915+0000", 2023-10-08T07:07:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.908296+0000", 2023-10-08T07:07:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013807470000000001 2023-10-08T07:07:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.908313+0000", 2023-10-08T07:07:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6951000000000001e-05 2023-10-08T07:07:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.908324+0000", 2023-10-08T07:07:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1268e-05 2023-10-08T07:07:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.908331+0000", 2023-10-08T07:07:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8909999999999998e-06 2023-10-08T07:07:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.228779+0000", 2023-10-08T07:07:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3204480089999999 2023-10-08T07:07:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.228855+0000", 2023-10-08T07:07:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5631999999999997e-05 2023-10-08T07:07:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.246556+0000", 2023-10-08T07:07:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017701102 2023-10-08T07:07:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.246606+0000", 2023-10-08T07:07:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0426000000000001e-05 2023-10-08T07:07:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.246689+0000", 2023-10-08T07:07:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3053000000000006e-05 2023-10-08T07:07:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125567 4.10 4:0b5763e1:::10000000004.00000015:head [write 3047424~4096,write 3100672~4096,write 3162112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.908346+0000", 2023-10-08T07:07:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3582187269999997, 2023-10-08T07:07:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3493486029999999, 2023-10-08T07:07:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125567 2023-10-08T07:07:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.908346+0000", 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.908346+0000", 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.910294+0000", 2023-10-08T07:07:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001947875 2023-10-08T07:07:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.910310+0000", 2023-10-08T07:07:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5780000000000001e-05 2023-10-08T07:07:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.910323+0000", 2023-10-08T07:07:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3675e-05 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.910331+0000", 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6590000000000007e-06 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.234103+0000", 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.32377221 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.234177+0000", 2023-10-08T07:07:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3695000000000005e-05 2023-10-08T07:07:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.257560+0000", 2023-10-08T07:07:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023383178000000001 2023-10-08T07:07:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.257611+0000", 2023-10-08T07:07:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1224000000000003e-05 2023-10-08T07:07:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.257695+0000", 2023-10-08T07:07:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3306999999999994e-05 2023-10-08T07:07:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125568 4.28 4:16edf4d3:::10000000004.00000027:head [write 1904640~4096,write 2011136~4096,write 2129920~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.910345+0000", 2023-10-08T07:07:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.35622022, 2023-10-08T07:07:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3543696780000001, 2023-10-08T07:07:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125568 2023-10-08T07:07:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.910345+0000", 2023-10-08T07:07:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.910345+0000", 2023-10-08T07:07:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.910345+0000", 2023-10-08T07:07:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5899999999999996e-07 2023-10-08T07:07:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.910360+0000", 2023-10-08T07:07:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4558e-05 2023-10-08T07:07:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.910367+0000", 2023-10-08T07:07:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1570000000000003e-06 2023-10-08T07:07:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.910373+0000", 2023-10-08T07:07:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6529999999999999e-06 2023-10-08T07:07:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.241308+0000", 2023-10-08T07:07:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3309350019999999 2023-10-08T07:07:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.241384+0000", 2023-10-08T07:07:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.682e-05 2023-10-08T07:07:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.264637+0000", 2023-10-08T07:07:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023252450000000001 2023-10-08T07:07:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.264670+0000", 2023-10-08T07:07:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3680000000000003e-05 2023-10-08T07:07:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.264714+0000", 2023-10-08T07:07:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3699000000000003e-05 2023-10-08T07:07:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125609 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2605056~4096,write 2699264~4096,write 2764800~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.922460+0000", 2023-10-08T07:07:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3441051970000002, 2023-10-08T07:07:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3378876339999999, 2023-10-08T07:07:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125609 2023-10-08T07:07:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.922460+0000", 2023-10-08T07:07:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.922460+0000", 2023-10-08T07:07:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.922460+0000", 2023-10-08T07:07:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.75e-07 2023-10-08T07:07:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.922475+0000", 2023-10-08T07:07:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4761e-05 2023-10-08T07:07:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.922481+0000", 2023-10-08T07:07:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.789e-06 2023-10-08T07:07:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.922485+0000", 2023-10-08T07:07:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2023-10-08T07:07:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.241353+0000", 2023-10-08T07:07:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.318867861 2023-10-08T07:07:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.241433+0000", 2023-10-08T07:07:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0018000000000005e-05 2023-10-08T07:07:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.260212+0000", 2023-10-08T07:07:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018778952000000002 2023-10-08T07:07:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.260264+0000", 2023-10-08T07:07:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1442e-05 2023-10-08T07:07:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.260347+0000", 2023-10-08T07:07:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3545000000000001e-05 2023-10-08T07:07:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125619 4.28 4:15b6682b:::10000000004.0000000b:head [write 1937408~4096,write 2310144~4096,write 3051520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.926378+0000", 2023-10-08T07:07:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3401868119999998, 2023-10-08T07:07:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3409612229999999, 2023-10-08T07:07:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125619 2023-10-08T07:07:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.926378+0000", 2023-10-08T07:07:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.926378+0000", 2023-10-08T07:07:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.926378+0000", 2023-10-08T07:07:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2699999999999999e-07 2023-10-08T07:07:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.926391+0000", 2023-10-08T07:07:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2567e-05 2023-10-08T07:07:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.926398+0000", 2023-10-08T07:07:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1040000000000001e-06 2023-10-08T07:07:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.926404+0000", 2023-10-08T07:07:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6879999999999996e-06 2023-10-08T07:07:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.246728+0000", 2023-10-08T07:07:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.320323812 2023-10-08T07:07:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.246812+0000", 2023-10-08T07:07:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4351999999999995e-05 2023-10-08T07:07:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.267213+0000", 2023-10-08T07:07:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020401096000000001 2023-10-08T07:07:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.267262+0000", 2023-10-08T07:07:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000002e-05 2023-10-08T07:07:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.267339+0000", 2023-10-08T07:07:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7477000000000004e-05 2023-10-08T07:07:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125620 4.10 4:08d50e0e:::10000000004.0000003f:head [write 1835008~4096,write 2002944~4096,write 2015232~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.926412+0000", 2023-10-08T07:07:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3401528169999999, 2023-10-08T07:07:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3406622859999999, 2023-10-08T07:07:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125620 2023-10-08T07:07:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.926412+0000", 2023-10-08T07:07:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.926412+0000", 2023-10-08T07:07:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.926412+0000", 2023-10-08T07:07:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2023-10-08T07:07:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.926431+0000", 2023-10-08T07:07:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8834e-05 2023-10-08T07:07:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.926437+0000", 2023-10-08T07:07:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1580000000000002e-06 2023-10-08T07:07:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.926443+0000", 2023-10-08T07:07:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:07:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.246750+0000", 2023-10-08T07:07:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3203073569999999 2023-10-08T07:07:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.246800+0000", 2023-10-08T07:07:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0541999999999998e-05 2023-10-08T07:07:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.266944+0000", 2023-10-08T07:07:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020143272 2023-10-08T07:07:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.266999+0000", 2023-10-08T07:07:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5299e-05 2023-10-08T07:07:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.267074+0000", 2023-10-08T07:07:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5213e-05 2023-10-08T07:07:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125631 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2125824~4096,write 2486272~4096,write 2768896~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.930340+0000", 2023-10-08T07:07:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3362248729999999, 2023-10-08T07:07:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3368655270000001, 2023-10-08T07:07:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125631 2023-10-08T07:07:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.930340+0000", 2023-10-08T07:07:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.930340+0000", 2023-10-08T07:07:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.932294+0000", 2023-10-08T07:07:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019539990000000001 2023-10-08T07:07:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.932324+0000", 2023-10-08T07:07:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9725000000000001e-05 2023-10-08T07:07:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.932333+0000", 2023-10-08T07:07:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7820000000000005e-06 2023-10-08T07:07:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.932339+0000", 2023-10-08T07:07:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5890000000000002e-06 2023-10-08T07:07:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.249315+0000", 2023-10-08T07:07:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.316976218 2023-10-08T07:07:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.249375+0000", 2023-10-08T07:07:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0136000000000002e-05 2023-10-08T07:07:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.267083+0000", 2023-10-08T07:07:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017707520000000001 2023-10-08T07:07:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.267137+0000", 2023-10-08T07:07:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3766e-05 2023-10-08T07:07:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.267205+0000", 2023-10-08T07:07:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8792000000000001e-05 2023-10-08T07:07:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125657 4.28 4:15b6682b:::10000000004.0000000b:head [write 1441792~4096,write 1466368~4096,write 1490944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.940347+0000", 2023-10-08T07:07:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3262177819999996, 2023-10-08T07:07:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3305972210000001, 2023-10-08T07:07:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125657 2023-10-08T07:07:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.940347+0000", 2023-10-08T07:07:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.940347+0000", 2023-10-08T07:07:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.942296+0000", 2023-10-08T07:07:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019486219999999999 2023-10-08T07:07:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.942311+0000", 2023-10-08T07:07:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5113000000000001e-05 2023-10-08T07:07:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.942319+0000", 2023-10-08T07:07:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0180000000000001e-06 2023-10-08T07:07:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.942324+0000", 2023-10-08T07:07:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1800000000000004e-06 2023-10-08T07:07:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.249620+0000", 2023-10-08T07:07:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3072958190000001 2023-10-08T07:07:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.249699+0000", 2023-10-08T07:07:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9684999999999993e-05 2023-10-08T07:07:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.270810+0000", 2023-10-08T07:07:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021110303 2023-10-08T07:07:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.270864+0000", 2023-10-08T07:07:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4508000000000001e-05 2023-10-08T07:07:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.270944+0000", 2023-10-08T07:07:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9973000000000002e-05 2023-10-08T07:07:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125665 4.28 4:16edf4d3:::10000000004.00000027:head [write 1351680~4096,write 1441792~4096,write 1466368~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.942470+0000", 2023-10-08T07:07:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3240949789999998, 2023-10-08T07:07:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.328602126, 2023-10-08T07:07:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125665 2023-10-08T07:07:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.942470+0000", 2023-10-08T07:07:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.942470+0000", 2023-10-08T07:07:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.942470+0000", 2023-10-08T07:07:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2699999999999999e-07 2023-10-08T07:07:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.942485+0000", 2023-10-08T07:07:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4559000000000001e-05 2023-10-08T07:07:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.942493+0000", 2023-10-08T07:07:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9240000000000007e-06 2023-10-08T07:07:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.942499+0000", 2023-10-08T07:07:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8989999999999998e-06 2023-10-08T07:07:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.252016+0000", 2023-10-08T07:07:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3095170870000001 2023-10-08T07:07:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.252095+0000", 2023-10-08T07:07:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9225000000000001e-05 2023-10-08T07:07:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.270953+0000", 2023-10-08T07:07:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018857946 2023-10-08T07:07:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.271002+0000", 2023-10-08T07:07:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9437000000000001e-05 2023-10-08T07:07:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.271072+0000", 2023-10-08T07:07:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9522000000000003e-05 2023-10-08T07:07:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125672 4.28 4:16edf4d3:::10000000004.00000027:head [write 1769472~4096,write 1880064~4096,write 2162688~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.944005+0000", 2023-10-08T07:07:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3225598520000004, 2023-10-08T07:07:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.327243111, 2023-10-08T07:07:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125672 2023-10-08T07:07:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.944005+0000", 2023-10-08T07:07:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.944005+0000", 2023-10-08T07:07:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.948295+0000", 2023-10-08T07:07:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042898199999999997 2023-10-08T07:07:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.948319+0000", 2023-10-08T07:07:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4263000000000001e-05 2023-10-08T07:07:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.948329+0000", 2023-10-08T07:07:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7769999999999997e-06 2023-10-08T07:07:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.948336+0000", 2023-10-08T07:07:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5920000000000003e-06 2023-10-08T07:07:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.257757+0000", 2023-10-08T07:07:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.309420477 2023-10-08T07:07:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.257842+0000", 2023-10-08T07:07:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5697000000000003e-05 2023-10-08T07:07:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.271122+0000", 2023-10-08T07:07:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013279426 2023-10-08T07:07:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.271172+0000", 2023-10-08T07:07:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0015999999999997e-05 2023-10-08T07:07:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.271248+0000", 2023-10-08T07:07:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6043000000000004e-05 2023-10-08T07:07:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:125721 4.10 4:08d50e0e:::10000000004.0000003f:head [write 831488~4096,write 880640~4096,write 888832~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2023-10-08T07:07:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:31.964466+0000", 2023-10-08T07:07:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.3020989040000002, 2023-10-08T07:07:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3270575449999999, 2023-10-08T07:07:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125721 2023-10-08T07:07:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.964466+0000", 2023-10-08T07:07:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.964466+0000", 2023-10-08T07:07:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.964466+0000", 2023-10-08T07:07:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4499999999999997e-07 2023-10-08T07:07:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.964478+0000", 2023-10-08T07:07:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2221e-05 2023-10-08T07:07:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.964485+0000", 2023-10-08T07:07:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8539999999999999e-06 2023-10-08T07:07:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:31.964491+0000", 2023-10-08T07:07:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.429e-06 2023-10-08T07:07:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.275134+0000", 2023-10-08T07:07:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.310643336 2023-10-08T07:07:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.275210+0000", 2023-10-08T07:07:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5913000000000003e-05 2023-10-08T07:07:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.291363+0000", 2023-10-08T07:07:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01615258 2023-10-08T07:07:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.291416+0000", 2023-10-08T07:07:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3146999999999998e-05 2023-10-08T07:07:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:33.291523+0000", 2023-10-08T07:07:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010762 2023-10-08T07:07:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:36.397 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:36.399 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:36.399 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:36.398+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:36.499 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:36.498+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:36.600 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:36.598+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:36.606 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:36.606 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:36.606 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.607 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141326 4.1a 4.5c1f9a5a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.607 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.595443+0000", 2023-10-08T07:07:36.607 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0066212399999999996, 2023-10-08T07:07:36.607 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0066565970000000002, 2023-10-08T07:07:36.607 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.607 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.607 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.607 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.607 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.607 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141326 2023-10-08T07:07:36.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.608 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.608 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.608 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.608 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595443+0000", 2023-10-08T07:07:36.608 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.608 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.608 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.608 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595443+0000", 2023-10-08T07:07:36.608 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.608 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595443+0000", 2023-10-08T07:07:36.609 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4600000000000003e-07 2023-10-08T07:07:36.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595456+0000", 2023-10-08T07:07:36.609 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2234e-05 2023-10-08T07:07:36.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595466+0000", 2023-10-08T07:07:36.610 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0159e-05 2023-10-08T07:07:36.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.610 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.610 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.610 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595475+0000", 2023-10-08T07:07:36.610 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3889999999999994e-06 2023-10-08T07:07:36.610 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.610 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.610 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.610 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.611 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141327 4.c 4:3352c333:::10000000004.00000012:head [write 786432~4096 in=4096b,write 1007616~4096 in=4096b,write 1040384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.611 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.595783+0000", 2023-10-08T07:07:36.611 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0062804760000000001, 2023-10-08T07:07:36.611 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00636996, 2023-10-08T07:07:36.611 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.611 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:36.611 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.611 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.611 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.611 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141327 2023-10-08T07:07:36.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.612 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.612 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.612 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.612 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595783+0000", 2023-10-08T07:07:36.612 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.612 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.612 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.612 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595783+0000", 2023-10-08T07:07:36.613 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.613 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.614 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.615 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.615 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595784+0000", 2023-10-08T07:07:36.615 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6300000000000004e-07 2023-10-08T07:07:36.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.615 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.615 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.615 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595798+0000", 2023-10-08T07:07:36.615 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4129e-05 2023-10-08T07:07:36.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.615 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.615 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.616 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595811+0000", 2023-10-08T07:07:36.616 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2714000000000001e-05 2023-10-08T07:07:36.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.616 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.616 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.616 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595818+0000", 2023-10-08T07:07:36.616 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5070000000000003e-06 2023-10-08T07:07:36.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.616 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.616 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.617 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595874+0000", 2023-10-08T07:07:36.617 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5923e-05 2023-10-08T07:07:36.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.617 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.617 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595988+0000", 2023-10-08T07:07:36.617 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000113189 2023-10-08T07:07:36.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.617 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:36.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.596143+0000", 2023-10-08T07:07:36.618 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015533100000000001 2023-10-08T07:07:36.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.618 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:36.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600689+0000", 2023-10-08T07:07:36.618 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045457450000000003 2023-10-08T07:07:36.619 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.619 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.619 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.620 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.620 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141239 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 3305472~4096 in=4096b,write 3313664~4096 in=4096b,write 3788800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.620 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.566434+0000", 2023-10-08T07:07:36.620 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.035629560999999997, 2023-10-08T07:07:36.620 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035796910000000001, 2023-10-08T07:07:36.620 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.620 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:36.620 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.621 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.621 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.621 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141239 2023-10-08T07:07:36.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.621 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.621 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.621 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.566434+0000", 2023-10-08T07:07:36.621 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.622 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.622 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.622 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.566434+0000", 2023-10-08T07:07:36.622 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.622 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.622 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.622 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.566435+0000", 2023-10-08T07:07:36.622 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8899999999999998e-07 2023-10-08T07:07:36.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.622 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.623 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.623 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.566447+0000", 2023-10-08T07:07:36.623 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2330000000000001e-05 2023-10-08T07:07:36.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.623 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.623 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.623 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.566459+0000", 2023-10-08T07:07:36.623 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1780000000000001e-05 2023-10-08T07:07:36.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.624 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.624 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.624 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.566467+0000", 2023-10-08T07:07:36.624 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9750000000000007e-06 2023-10-08T07:07:36.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.624 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.624 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.624 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601776+0000", 2023-10-08T07:07:36.624 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035308547000000003 2023-10-08T07:07:36.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.625 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.625 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.625 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601859+0000", 2023-10-08T07:07:36.625 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3017999999999997e-05 2023-10-08T07:07:36.625 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.625 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.625 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.625 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.626 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141240 4.2 4.a29e5702 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.626 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.567113+0000", 2023-10-08T07:07:36.626 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.034951293000000001, 2023-10-08T07:07:36.626 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035193310999999998, 2023-10-08T07:07:36.626 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.626 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.626 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.626 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.626 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.626 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141240 2023-10-08T07:07:36.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.627 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.627 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.627 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.627 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.567113+0000", 2023-10-08T07:07:36.627 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.627 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.627 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.627 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.567113+0000", 2023-10-08T07:07:36.628 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.628 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.628 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.628 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.567113+0000", 2023-10-08T07:07:36.628 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3799999999999996e-07 2023-10-08T07:07:36.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.628 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.628 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.628 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.567124+0000", 2023-10-08T07:07:36.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1093e-05 2023-10-08T07:07:36.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.629 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.629 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.567134+0000", 2023-10-08T07:07:36.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3249999999999997e-06 2023-10-08T07:07:36.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.629 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.629 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.567141+0000", 2023-10-08T07:07:36.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9920000000000001e-06 2023-10-08T07:07:36.630 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.630 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.630 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.630 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.630 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141243 4.3a 4.f030edfa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.630 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.567664+0000", 2023-10-08T07:07:36.630 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.034400192000000003, 2023-10-08T07:07:36.630 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.034710722999999999, 2023-10-08T07:07:36.630 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141243 2023-10-08T07:07:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.567664+0000", 2023-10-08T07:07:36.631 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.567664+0000", 2023-10-08T07:07:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.567665+0000", 2023-10-08T07:07:36.632 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.879999999999999e-07 2023-10-08T07:07:36.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.633 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.633 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.633 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.567679+0000", 2023-10-08T07:07:36.633 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4831000000000001e-05 2023-10-08T07:07:36.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.633 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.633 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.633 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.567694+0000", 2023-10-08T07:07:36.633 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4732000000000001e-05 2023-10-08T07:07:36.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.634 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.634 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.634 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.567701+0000", 2023-10-08T07:07:36.634 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1579999999999999e-06 2023-10-08T07:07:36.634 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.634 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.634 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.634 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.635 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141302 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.635 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.586089+0000", 2023-10-08T07:07:36.635 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.015974390000000002, 2023-10-08T07:07:36.635 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016349144999999999, 2023-10-08T07:07:36.635 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.635 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.635 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.635 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.635 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.635 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141302 2023-10-08T07:07:36.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.636 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.636 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.636 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.636 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586089+0000", 2023-10-08T07:07:36.636 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.636 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.636 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.636 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586089+0000", 2023-10-08T07:07:36.636 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.637 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.637 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.637 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586090+0000", 2023-10-08T07:07:36.637 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.540000000000001e-07 2023-10-08T07:07:36.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.637 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.637 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.637 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586102+0000", 2023-10-08T07:07:36.637 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1847e-05 2023-10-08T07:07:36.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.638 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.638 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.638 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586127+0000", 2023-10-08T07:07:36.638 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4981999999999999e-05 2023-10-08T07:07:36.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.638 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.638 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.638 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586135+0000", 2023-10-08T07:07:36.638 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2069999999999995e-06 2023-10-08T07:07:36.638 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.639 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.639 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.639 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.639 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.639 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141245 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.639 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.568265+0000", 2023-10-08T07:07:36.639 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.033798746999999997, 2023-10-08T07:07:36.639 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.034232315999999999, 2023-10-08T07:07:36.639 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.639 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.639 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.640 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.640 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.640 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141245 2023-10-08T07:07:36.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.640 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.640 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.640 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.640 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.568265+0000", 2023-10-08T07:07:36.640 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.641 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.641 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.641 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.568265+0000", 2023-10-08T07:07:36.641 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.641 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.641 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.641 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.568266+0000", 2023-10-08T07:07:36.641 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0900000000000001e-07 2023-10-08T07:07:36.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.641 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.642 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.642 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.568291+0000", 2023-10-08T07:07:36.642 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4746999999999999e-05 2023-10-08T07:07:36.642 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.642 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.642 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.642 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.568301+0000", 2023-10-08T07:07:36.642 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0869999999999999e-05 2023-10-08T07:07:36.642 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.642 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.643 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.643 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.568309+0000", 2023-10-08T07:07:36.643 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2509999999999997e-06 2023-10-08T07:07:36.643 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.643 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.643 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.643 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.643 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.643 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141303 4.20 4:04004f2c:::10000000004.0000000d:head [write 577536~4096 in=4096b,write 675840~4096 in=4096b,write 704512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.643 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.586431+0000", 2023-10-08T07:07:36.644 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.015632600999999999, 2023-10-08T07:07:36.644 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016130006999999998, 2023-10-08T07:07:36.644 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.644 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:36.644 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.644 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.644 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.644 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141303 2023-10-08T07:07:36.644 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.644 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.645 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.645 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.645 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586431+0000", 2023-10-08T07:07:36.645 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.645 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.645 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.645 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586431+0000", 2023-10-08T07:07:36.645 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.645 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.646 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.646 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586432+0000", 2023-10-08T07:07:36.646 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8100000000000002e-07 2023-10-08T07:07:36.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.646 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.646 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.646 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586443+0000", 2023-10-08T07:07:36.646 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0971999999999999e-05 2023-10-08T07:07:36.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.646 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.647 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.647 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586466+0000", 2023-10-08T07:07:36.647 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3036000000000001e-05 2023-10-08T07:07:36.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.647 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.647 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.647 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586473+0000", 2023-10-08T07:07:36.647 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0029999999999997e-06 2023-10-08T07:07:36.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.647 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.648 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.648 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586530+0000", 2023-10-08T07:07:36.648 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7423999999999998e-05 2023-10-08T07:07:36.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.648 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.648 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.648 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586622+0000", 2023-10-08T07:07:36.648 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.179e-05 2023-10-08T07:07:36.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.648 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.648 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.586829+0000", 2023-10-08T07:07:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020714999999999999 2023-10-08T07:07:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590774+0000", 2023-10-08T07:07:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039445030000000002 2023-10-08T07:07:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.650 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.650 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141204 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2457600~8192 in=8192b,write 2547712~4096 in=4096b,write 2596864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.650 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.554992+0000", 2023-10-08T07:07:36.650 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.047071469999999997, 2023-10-08T07:07:36.650 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047656603999999998, 2023-10-08T07:07:36.650 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.650 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:36.650 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.650 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.651 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.651 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141204 2023-10-08T07:07:36.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.651 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.651 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.651 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.651 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.554992+0000", 2023-10-08T07:07:36.651 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.651 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.652 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.652 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.554992+0000", 2023-10-08T07:07:36.652 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.652 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.652 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.652 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.554993+0000", 2023-10-08T07:07:36.652 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4199999999999996e-07 2023-10-08T07:07:36.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.652 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.653 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.653 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.555017+0000", 2023-10-08T07:07:36.653 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4099000000000001e-05 2023-10-08T07:07:36.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.653 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.653 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.653 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.555029+0000", 2023-10-08T07:07:36.653 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2046e-05 2023-10-08T07:07:36.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.653 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.654 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.654 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.555037+0000", 2023-10-08T07:07:36.654 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1359999999999997e-06 2023-10-08T07:07:36.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.654 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.654 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.654 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.588349+0000", 2023-10-08T07:07:36.654 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033312054000000001 2023-10-08T07:07:36.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.655 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.655 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.655 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.588437+0000", 2023-10-08T07:07:36.655 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7515999999999994e-05 2023-10-08T07:07:36.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.655 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.655 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:36.655 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.588608+0000", 2023-10-08T07:07:36.655 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000171521 2023-10-08T07:07:36.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.656 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.656 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:36.656 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599168+0000", 2023-10-08T07:07:36.656 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010559928 2023-10-08T07:07:36.656 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.656 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.656 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.656 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.656 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141306 4.2 4.a29e5702 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.657 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.587274+0000", 2023-10-08T07:07:36.657 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.014789556000000001, 2023-10-08T07:07:36.657 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015457032000000001, 2023-10-08T07:07:36.657 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.657 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.657 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.657 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.657 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.657 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141306 2023-10-08T07:07:36.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.658 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.658 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.658 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.658 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.587274+0000", 2023-10-08T07:07:36.658 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.658 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.658 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.659 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.587274+0000", 2023-10-08T07:07:36.659 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.659 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.659 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.659 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.587275+0000", 2023-10-08T07:07:36.659 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.61e-07 2023-10-08T07:07:36.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.659 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.659 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.660 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.587284+0000", 2023-10-08T07:07:36.660 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.234e-06 2023-10-08T07:07:36.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.660 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.660 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.660 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.587294+0000", 2023-10-08T07:07:36.660 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.026e-05 2023-10-08T07:07:36.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.660 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.661 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.661 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.587300+0000", 2023-10-08T07:07:36.661 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4700000000000001e-06 2023-10-08T07:07:36.661 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.661 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.661 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.661 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.661 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141310 4.2 4.a29e5702 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.662 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.588409+0000", 2023-10-08T07:07:36.662 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013654883, 2023-10-08T07:07:36.662 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014378798, 2023-10-08T07:07:36.662 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.662 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.663 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.663 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.663 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.663 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141310 2023-10-08T07:07:36.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.663 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.664 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.664 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.588409+0000", 2023-10-08T07:07:36.664 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.664 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.664 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.588409+0000", 2023-10-08T07:07:36.664 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.665 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.665 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.588410+0000", 2023-10-08T07:07:36.665 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4e-07 2023-10-08T07:07:36.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.665 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.665 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.588433+0000", 2023-10-08T07:07:36.665 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3073000000000001e-05 2023-10-08T07:07:36.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.666 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.666 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.666 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.588445+0000", 2023-10-08T07:07:36.666 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1807999999999999e-05 2023-10-08T07:07:36.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.666 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.666 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.666 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.588453+0000", 2023-10-08T07:07:36.667 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2050000000000002e-06 2023-10-08T07:07:36.667 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.667 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.667 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.667 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.667 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:136179 4.31 e60/48 4:8de29a03:::10000000004.00000001:head v 60'4223, mlcod=60'4220)", 2023-10-08T07:07:36.667 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.597080+0000", 2023-10-08T07:07:36.667 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0049834859999999996, 2023-10-08T07:07:36.667 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0057753199999999996, 2023-10-08T07:07:36.668 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.668 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:36.668 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.668 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.668 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.668 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.597080+0000", 2023-10-08T07:07:36.668 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.668 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.668 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.597080+0000", 2023-10-08T07:07:36.669 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.669 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.597081+0000", 2023-10-08T07:07:36.669 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6e-07 2023-10-08T07:07:36.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.670 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.670 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.597091+0000", 2023-10-08T07:07:36.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0592e-05 2023-10-08T07:07:36.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.670 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.670 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.597098+0000", 2023-10-08T07:07:36.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4869999999999999e-06 2023-10-08T07:07:36.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.671 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.671 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.597103+0000", 2023-10-08T07:07:36.671 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3410000000000002e-06 2023-10-08T07:07:36.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.671 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.671 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.597139+0000", 2023-10-08T07:07:36.671 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5942999999999998e-05 2023-10-08T07:07:36.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.672 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.672 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.597153+0000", 2023-10-08T07:07:36.672 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4358e-05 2023-10-08T07:07:36.672 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.672 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.672 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.672 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141335 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.673 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.598460+0000", 2023-10-08T07:07:36.673 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0036039660000000001, 2023-10-08T07:07:36.673 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0044556090000000001, 2023-10-08T07:07:36.673 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.673 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.673 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.673 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.673 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.673 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141335 2023-10-08T07:07:36.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.674 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.674 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.674 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598460+0000", 2023-10-08T07:07:36.674 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.674 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.674 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598460+0000", 2023-10-08T07:07:36.675 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.675 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.675 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.675 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598461+0000", 2023-10-08T07:07:36.675 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9999999999999996e-07 2023-10-08T07:07:36.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.675 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.675 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.676 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598475+0000", 2023-10-08T07:07:36.676 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.453e-05 2023-10-08T07:07:36.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.676 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.676 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.676 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598484+0000", 2023-10-08T07:07:36.676 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3950000000000001e-06 2023-10-08T07:07:36.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.676 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.677 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.677 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598489+0000", 2023-10-08T07:07:36.677 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.169e-06 2023-10-08T07:07:36.677 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.677 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.677 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.677 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.677 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141263 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.677 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.573873+0000", 2023-10-08T07:07:36.678 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.028190342, 2023-10-08T07:07:36.678 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.029108966, 2023-10-08T07:07:36.678 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.678 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.678 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.678 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.678 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.679 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141263 2023-10-08T07:07:36.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.679 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.679 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.679 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.573873+0000", 2023-10-08T07:07:36.679 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.573873+0000", 2023-10-08T07:07:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.573874+0000", 2023-10-08T07:07:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2900000000000002e-07 2023-10-08T07:07:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.680 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.573888+0000", 2023-10-08T07:07:36.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3383999999999999e-05 2023-10-08T07:07:36.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.681 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.681 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.573900+0000", 2023-10-08T07:07:36.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2418999999999999e-05 2023-10-08T07:07:36.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.681 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.682 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.682 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.573909+0000", 2023-10-08T07:07:36.682 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6149999999999997e-06 2023-10-08T07:07:36.682 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.682 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.682 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.682 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.682 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141336 4.2c 4:352c144c:::10000000004.00000003:head [write 3063808~4096 in=4096b,write 3072000~4096 in=4096b,write 3141632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.683 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.598684+0000", 2023-10-08T07:07:36.683 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0033794189999999998, 2023-10-08T07:07:36.683 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0043607170000000001, 2023-10-08T07:07:36.683 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.683 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:36.683 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.683 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.683 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.683 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141336 2023-10-08T07:07:36.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.683 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.684 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.684 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598684+0000", 2023-10-08T07:07:36.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.684 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.684 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598684+0000", 2023-10-08T07:07:36.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598685+0000", 2023-10-08T07:07:36.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0200000000000001e-07 2023-10-08T07:07:36.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598696+0000", 2023-10-08T07:07:36.685 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0869e-05 2023-10-08T07:07:36.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598711+0000", 2023-10-08T07:07:36.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5321000000000001e-05 2023-10-08T07:07:36.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598719+0000", 2023-10-08T07:07:36.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2110000000000001e-06 2023-10-08T07:07:36.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.687 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598885+0000", 2023-10-08T07:07:36.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000166534 2023-10-08T07:07:36.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.687 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598955+0000", 2023-10-08T07:07:36.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9763000000000003e-05 2023-10-08T07:07:36.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:36.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599067+0000", 2023-10-08T07:07:36.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000112416 2023-10-08T07:07:36.688 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.688 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.688 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.689 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:136189 4.29 e60/17 4:94216392:::10000000004.0000002b:head v 60'2147, mlcod=60'2143)", 2023-10-08T07:07:36.689 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.598794+0000", 2023-10-08T07:07:36.689 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.003269363, 2023-10-08T07:07:36.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0043279729999999997, 2023-10-08T07:07:36.689 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.689 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:36.689 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.689 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598794+0000", 2023-10-08T07:07:36.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598794+0000", 2023-10-08T07:07:36.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598795+0000", 2023-10-08T07:07:36.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3099999999999997e-07 2023-10-08T07:07:36.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598808+0000", 2023-10-08T07:07:36.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2802e-05 2023-10-08T07:07:36.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598816+0000", 2023-10-08T07:07:36.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4889999999999995e-06 2023-10-08T07:07:36.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598823+0000", 2023-10-08T07:07:36.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6379999999999998e-06 2023-10-08T07:07:36.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598979+0000", 2023-10-08T07:07:36.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015547400000000001 2023-10-08T07:07:36.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.598997+0000", 2023-10-08T07:07:36.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8274000000000002e-05 2023-10-08T07:07:36.693 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.693 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.693 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.694 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141222 4.2 4:43cef10a:::10000000004.00000030:head [write 2953216~4096 in=4096b,write 3203072~12288 in=12288b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.694 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.560961+0000", 2023-10-08T07:07:36.694 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.041102946000000001, 2023-10-08T07:07:36.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.042232045000000003, 2023-10-08T07:07:36.694 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.694 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:36.694 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.695 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.695 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.695 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141222 2023-10-08T07:07:36.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.695 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.560961+0000", 2023-10-08T07:07:36.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.560961+0000", 2023-10-08T07:07:36.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.560961+0000", 2023-10-08T07:07:36.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:07:36.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.560977+0000", 2023-10-08T07:07:36.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5407999999999999e-05 2023-10-08T07:07:36.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.560987+0000", 2023-10-08T07:07:36.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0573e-05 2023-10-08T07:07:36.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.698 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.560993+0000", 2023-10-08T07:07:36.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5890000000000002e-06 2023-10-08T07:07:36.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.698 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.698 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.593400+0000", 2023-10-08T07:07:36.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032407102 2023-10-08T07:07:36.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.698 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.593498+0000", 2023-10-08T07:07:36.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8078000000000005e-05 2023-10-08T07:07:36.699 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.699 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.699 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.699 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141312 4.3a 4.d27c18fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.699 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.589663+0000", 2023-10-08T07:07:36.699 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.012401109, 2023-10-08T07:07:36.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013598478000000001, 2023-10-08T07:07:36.700 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.700 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.700 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.700 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.700 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.700 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141312 2023-10-08T07:07:36.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.700 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.589663+0000", 2023-10-08T07:07:36.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.589663+0000", 2023-10-08T07:07:36.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.589663+0000", 2023-10-08T07:07:36.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2900000000000003e-07 2023-10-08T07:07:36.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.589676+0000", 2023-10-08T07:07:36.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2242000000000001e-05 2023-10-08T07:07:36.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.703 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.703 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.589687+0000", 2023-10-08T07:07:36.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0869e-05 2023-10-08T07:07:36.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.703 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.703 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.589694+0000", 2023-10-08T07:07:36.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3710000000000002e-06 2023-10-08T07:07:36.703 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.703 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.704 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.704 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141337 4.3a 4.d27c18fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.704 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.599088+0000", 2023-10-08T07:07:36.704 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0029758940000000002, 2023-10-08T07:07:36.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0042267299999999997, 2023-10-08T07:07:36.704 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.704 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.704 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.705 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.705 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.705 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141337 2023-10-08T07:07:36.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.705 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599088+0000", 2023-10-08T07:07:36.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599088+0000", 2023-10-08T07:07:36.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599089+0000", 2023-10-08T07:07:36.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4700000000000001e-07 2023-10-08T07:07:36.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.707 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599101+0000", 2023-10-08T07:07:36.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1973e-05 2023-10-08T07:07:36.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.707 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.707 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.707 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599110+0000", 2023-10-08T07:07:36.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6430000000000007e-06 2023-10-08T07:07:36.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.707 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.707 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.707 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599118+0000", 2023-10-08T07:07:36.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1999999999999994e-06 2023-10-08T07:07:36.708 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.708 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.708 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.708 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141223 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 3387392~4096 in=4096b,write 3461120~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.708 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.561402+0000", 2023-10-08T07:07:36.708 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.040661787999999997, 2023-10-08T07:07:36.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.041971021999999997, 2023-10-08T07:07:36.709 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.709 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:36.709 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.709 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.709 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.709 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141223 2023-10-08T07:07:36.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.709 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.561402+0000", 2023-10-08T07:07:36.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.561402+0000", 2023-10-08T07:07:36.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.561403+0000", 2023-10-08T07:07:36.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4600000000000004e-07 2023-10-08T07:07:36.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.561420+0000", 2023-10-08T07:07:36.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7521e-05 2023-10-08T07:07:36.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.711 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.711 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.561428+0000", 2023-10-08T07:07:36.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8469999999999996e-06 2023-10-08T07:07:36.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.561433+0000", 2023-10-08T07:07:36.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9130000000000002e-06 2023-10-08T07:07:36.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595585+0000", 2023-10-08T07:07:36.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.034152110999999999 2023-10-08T07:07:36.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595656+0000", 2023-10-08T07:07:36.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0443000000000003e-05 2023-10-08T07:07:36.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:36.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.596069+0000", 2023-10-08T07:07:36.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00041379999999999998 2023-10-08T07:07:36.713 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.713 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.713 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.714 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141313 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.714 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.590010+0000", 2023-10-08T07:07:36.714 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.012054023000000001, 2023-10-08T07:07:36.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013434868000000001, 2023-10-08T07:07:36.714 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.714 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.714 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.714 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.714 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.715 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141313 2023-10-08T07:07:36.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.715 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590010+0000", 2023-10-08T07:07:36.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590010+0000", 2023-10-08T07:07:36.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590010+0000", 2023-10-08T07:07:36.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7299999999999996e-07 2023-10-08T07:07:36.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590021+0000", 2023-10-08T07:07:36.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0210000000000001e-05 2023-10-08T07:07:36.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590029+0000", 2023-10-08T07:07:36.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9449999999999993e-06 2023-10-08T07:07:36.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590037+0000", 2023-10-08T07:07:36.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5620000000000004e-06 2023-10-08T07:07:36.717 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.718 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.718 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.718 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141338 4.5 4:a2ff1403:::10000000004.00000039:head [write 3219456~8192 in=8192b,write 3338240~4096 in=4096b,write 3510272~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.718 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.599525+0000", 2023-10-08T07:07:36.718 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.002538621, 2023-10-08T07:07:36.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039796040000000003, 2023-10-08T07:07:36.718 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.718 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:36.718 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.719 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.719 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.719 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141338 2023-10-08T07:07:36.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.719 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599525+0000", 2023-10-08T07:07:36.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599525+0000", 2023-10-08T07:07:36.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599526+0000", 2023-10-08T07:07:36.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0400000000000005e-07 2023-10-08T07:07:36.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599540+0000", 2023-10-08T07:07:36.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4314000000000001e-05 2023-10-08T07:07:36.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599549+0000", 2023-10-08T07:07:36.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0839999999999998e-06 2023-10-08T07:07:36.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.721 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599557+0000", 2023-10-08T07:07:36.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1999999999999997e-06 2023-10-08T07:07:36.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599651+0000", 2023-10-08T07:07:36.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4475000000000006e-05 2023-10-08T07:07:36.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599733+0000", 2023-10-08T07:07:36.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1872000000000005e-05 2023-10-08T07:07:36.723 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.723 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.723 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.723 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141315 4.3a 4.f030edfa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.723 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.590655+0000", 2023-10-08T07:07:36.723 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.011408560999999999, 2023-10-08T07:07:36.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012914264999999999, 2023-10-08T07:07:36.723 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.723 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.724 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.724 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.724 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.724 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141315 2023-10-08T07:07:36.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.724 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590655+0000", 2023-10-08T07:07:36.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590655+0000", 2023-10-08T07:07:36.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590656+0000", 2023-10-08T07:07:36.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0500000000000002e-07 2023-10-08T07:07:36.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590668+0000", 2023-10-08T07:07:36.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1977000000000001e-05 2023-10-08T07:07:36.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590682+0000", 2023-10-08T07:07:36.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4367e-05 2023-10-08T07:07:36.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.590690+0000", 2023-10-08T07:07:36.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8429999999999993e-06 2023-10-08T07:07:36.727 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.727 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.727 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.727 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141317 4.30 4:0f322a22:::10000000004.00000014:head [write 2170880~4096 in=4096b,write 2228224~4096 in=4096b,write 2256896~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.727 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.591705+0000", 2023-10-08T07:07:36.727 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.010358335999999999, 2023-10-08T07:07:36.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011923437, 2023-10-08T07:07:36.728 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.728 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:36.728 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.728 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.728 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.728 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141317 2023-10-08T07:07:36.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.728 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.591705+0000", 2023-10-08T07:07:36.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.591705+0000", 2023-10-08T07:07:36.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.591707+0000", 2023-10-08T07:07:36.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.15e-06 2023-10-08T07:07:36.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.591722+0000", 2023-10-08T07:07:36.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5037e-05 2023-10-08T07:07:36.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.591734+0000", 2023-10-08T07:07:36.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2802e-05 2023-10-08T07:07:36.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.591745+0000", 2023-10-08T07:07:36.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0586e-05 2023-10-08T07:07:36.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.591789+0000", 2023-10-08T07:07:36.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4005000000000003e-05 2023-10-08T07:07:36.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.591845+0000", 2023-10-08T07:07:36.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5605e-05 2023-10-08T07:07:36.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:36.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.591941+0000", 2023-10-08T07:07:36.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6197000000000001e-05 2023-10-08T07:07:36.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:36.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.595042+0000", 2023-10-08T07:07:36.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031012100000000001 2023-10-08T07:07:36.733 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.733 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.733 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.733 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:136196 4.26 e60/17 4:672c55ca:::10000000004.00000006:head v 60'2137, mlcod=60'2135)", 2023-10-08T07:07:36.733 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.599781+0000", 2023-10-08T07:07:36.733 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00228298, 2023-10-08T07:07:36.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039275279999999996, 2023-10-08T07:07:36.733 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.734 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:36.734 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599781+0000", 2023-10-08T07:07:36.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.734 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.734 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599781+0000", 2023-10-08T07:07:36.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599781+0000", 2023-10-08T07:07:36.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.06e-07 2023-10-08T07:07:36.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599796+0000", 2023-10-08T07:07:36.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4528e-05 2023-10-08T07:07:36.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599805+0000", 2023-10-08T07:07:36.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6799999999999999e-06 2023-10-08T07:07:36.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599809+0000", 2023-10-08T07:07:36.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8849999999999998e-06 2023-10-08T07:07:36.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599853+0000", 2023-10-08T07:07:36.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3205999999999999e-05 2023-10-08T07:07:36.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599866+0000", 2023-10-08T07:07:36.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3237999999999999e-05 2023-10-08T07:07:36.739 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.740 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.740 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.740 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141285 4.3a 4.7ab54aba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.740 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.580169+0000", 2023-10-08T07:07:36.740 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.021894921000000001, 2023-10-08T07:07:36.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023599960999999999, 2023-10-08T07:07:36.740 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.740 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.740 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.741 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.741 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.741 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141285 2023-10-08T07:07:36.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.741 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.580169+0000", 2023-10-08T07:07:36.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.580169+0000", 2023-10-08T07:07:36.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.742 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.580170+0000", 2023-10-08T07:07:36.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3969999999999999e-06 2023-10-08T07:07:36.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.742 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.580191+0000", 2023-10-08T07:07:36.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1002999999999999e-05 2023-10-08T07:07:36.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.580202+0000", 2023-10-08T07:07:36.743 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0896e-05 2023-10-08T07:07:36.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.743 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.743 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.743 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.580211+0000", 2023-10-08T07:07:36.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6160000000000002e-06 2023-10-08T07:07:36.744 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.744 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.744 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.744 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141321 4.1a 4.5c1f9a5a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.744 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.592902+0000", 2023-10-08T07:07:36.744 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0091619049999999997, 2023-10-08T07:07:36.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010931926, 2023-10-08T07:07:36.744 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.744 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.745 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.745 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.745 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.745 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141321 2023-10-08T07:07:36.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.745 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.745 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.745 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.592902+0000", 2023-10-08T07:07:36.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.592902+0000", 2023-10-08T07:07:36.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.592903+0000", 2023-10-08T07:07:36.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3200000000000003e-07 2023-10-08T07:07:36.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.592920+0000", 2023-10-08T07:07:36.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6694999999999999e-05 2023-10-08T07:07:36.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.592934+0000", 2023-10-08T07:07:36.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4826e-05 2023-10-08T07:07:36.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.592942+0000", 2023-10-08T07:07:36.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6090000000000003e-06 2023-10-08T07:07:36.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.748 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.748 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141340 4.30 4:0f322a22:::10000000004.00000014:head [write 3358720~4096 in=4096b,write 3371008~4096 in=4096b,write 3538944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.748 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.600163+0000", 2023-10-08T07:07:36.748 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00190088, 2023-10-08T07:07:36.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0037312809999999999, 2023-10-08T07:07:36.748 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.749 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:36.749 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.749 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.749 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.749 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141340 2023-10-08T07:07:36.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.749 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600163+0000", 2023-10-08T07:07:36.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600163+0000", 2023-10-08T07:07:36.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600164+0000", 2023-10-08T07:07:36.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1699999999999997e-07 2023-10-08T07:07:36.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600177+0000", 2023-10-08T07:07:36.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3322999999999999e-05 2023-10-08T07:07:36.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600195+0000", 2023-10-08T07:07:36.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7847e-05 2023-10-08T07:07:36.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600202+0000", 2023-10-08T07:07:36.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2110000000000001e-06 2023-10-08T07:07:36.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600255+0000", 2023-10-08T07:07:36.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2500000000000002e-05 2023-10-08T07:07:36.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.752 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.752 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600349+0000", 2023-10-08T07:07:36.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4442000000000001e-05 2023-10-08T07:07:36.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:36.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600510+0000", 2023-10-08T07:07:36.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000161337 2023-10-08T07:07:36.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.753 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.753 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141342 4.3a 4.7ab54aba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.753 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.600826+0000", 2023-10-08T07:07:36.754 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.001237756, 2023-10-08T07:07:36.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031398960000000001, 2023-10-08T07:07:36.754 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.754 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.754 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.754 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.754 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.754 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141342 2023-10-08T07:07:36.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.754 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600826+0000", 2023-10-08T07:07:36.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600826+0000", 2023-10-08T07:07:36.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600827+0000", 2023-10-08T07:07:36.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:07:36.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600842+0000", 2023-10-08T07:07:36.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5259000000000001e-05 2023-10-08T07:07:36.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600854+0000", 2023-10-08T07:07:36.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1959e-05 2023-10-08T07:07:36.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.600862+0000", 2023-10-08T07:07:36.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1110000000000008e-06 2023-10-08T07:07:36.757 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.757 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.757 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.757 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141343 4.3a 4.7ab54aba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.757 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.601095+0000", 2023-10-08T07:07:36.758 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00096869499999999999, 2023-10-08T07:07:36.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0029260219999999999, 2023-10-08T07:07:36.758 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.758 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.758 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.758 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.758 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.758 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141343 2023-10-08T07:07:36.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.758 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601095+0000", 2023-10-08T07:07:36.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601095+0000", 2023-10-08T07:07:36.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601096+0000", 2023-10-08T07:07:36.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2099999999999995e-07 2023-10-08T07:07:36.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601110+0000", 2023-10-08T07:07:36.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4284000000000001e-05 2023-10-08T07:07:36.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601123+0000", 2023-10-08T07:07:36.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2396e-05 2023-10-08T07:07:36.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601130+0000", 2023-10-08T07:07:36.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1890000000000001e-06 2023-10-08T07:07:36.761 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.761 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.761 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.762 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141344 4.38 4:1e0977c7:::10000000004.00000022:head [write 421888~4096 in=4096b,write 913408~4096 in=4096b,write 1040384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.762 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.601380+0000", 2023-10-08T07:07:36.762 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00068332799999999997, 2023-10-08T07:07:36.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027009629999999998, 2023-10-08T07:07:36.762 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.762 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:36.762 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.762 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.762 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.763 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141344 2023-10-08T07:07:36.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.763 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601380+0000", 2023-10-08T07:07:36.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601380+0000", 2023-10-08T07:07:36.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601381+0000", 2023-10-08T07:07:36.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5300000000000003e-07 2023-10-08T07:07:36.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601395+0000", 2023-10-08T07:07:36.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3407000000000001e-05 2023-10-08T07:07:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601402+0000", 2023-10-08T07:07:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1389999999999998e-06 2023-10-08T07:07:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601406+0000", 2023-10-08T07:07:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5000000000000001e-06 2023-10-08T07:07:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601450+0000", 2023-10-08T07:07:36.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3244999999999997e-05 2023-10-08T07:07:36.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601537+0000", 2023-10-08T07:07:36.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7434000000000003e-05 2023-10-08T07:07:36.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:36.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601703+0000", 2023-10-08T07:07:36.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016562099999999999 2023-10-08T07:07:36.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.767 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.767 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141289 4.2 4.508f73c2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.767 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.581437+0000", 2023-10-08T07:07:36.767 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.020626730999999999, 2023-10-08T07:07:36.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022736042000000001, 2023-10-08T07:07:36.768 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.768 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.768 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.768 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.768 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.768 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141289 2023-10-08T07:07:36.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.768 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.581437+0000", 2023-10-08T07:07:36.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.581437+0000", 2023-10-08T07:07:36.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.581438+0000", 2023-10-08T07:07:36.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7499999999999998e-07 2023-10-08T07:07:36.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.581451+0000", 2023-10-08T07:07:36.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3044000000000001e-05 2023-10-08T07:07:36.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.581466+0000", 2023-10-08T07:07:36.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4965e-05 2023-10-08T07:07:36.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.581482+0000", 2023-10-08T07:07:36.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6137000000000002e-05 2023-10-08T07:07:36.771 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.771 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.771 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.771 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141345 4.1b 4:d97fb168:::10000000004.00000008:head [write 3158016~4096 in=4096b,write 3178496~4096 in=4096b,write 3317760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.771 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.601659+0000", 2023-10-08T07:07:36.771 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00040515100000000002, 2023-10-08T07:07:36.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0025872709999999999, 2023-10-08T07:07:36.772 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.772 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:36.772 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.772 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.772 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.772 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141345 2023-10-08T07:07:36.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.772 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601659+0000", 2023-10-08T07:07:36.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601659+0000", 2023-10-08T07:07:36.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601659+0000", 2023-10-08T07:07:36.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4300000000000003e-07 2023-10-08T07:07:36.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601670+0000", 2023-10-08T07:07:36.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0266e-05 2023-10-08T07:07:36.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601675+0000", 2023-10-08T07:07:36.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8100000000000003e-06 2023-10-08T07:07:36.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601679+0000", 2023-10-08T07:07:36.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9480000000000001e-06 2023-10-08T07:07:36.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601718+0000", 2023-10-08T07:07:36.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9091000000000002e-05 2023-10-08T07:07:36.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601783+0000", 2023-10-08T07:07:36.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4239999999999995e-05 2023-10-08T07:07:36.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:36.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601894+0000", 2023-10-08T07:07:36.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000111443 2023-10-08T07:07:36.776 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.776 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.776 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.777 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141346 4.20 4:04004f2c:::10000000004.0000000d:head [write 4165632~4096 in=4096b,write 4177920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.777 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.602019+0000", 2023-10-08T07:07:36.777 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.4576000000000001e-05, 2023-10-08T07:07:36.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0023091850000000001, 2023-10-08T07:07:36.777 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.777 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:36.777 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.777 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.777 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.777 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141346 2023-10-08T07:07:36.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.778 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602019+0000", 2023-10-08T07:07:36.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602019+0000", 2023-10-08T07:07:36.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602020+0000", 2023-10-08T07:07:36.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.181e-06 2023-10-08T07:07:36.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602040+0000", 2023-10-08T07:07:36.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9876000000000001e-05 2023-10-08T07:07:36.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602087+0000", 2023-10-08T07:07:36.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6323999999999999e-05 2023-10-08T07:07:36.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602096+0000", 2023-10-08T07:07:36.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.516e-06 2023-10-08T07:07:36.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602416+0000", 2023-10-08T07:07:36.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00031984100000000002 2023-10-08T07:07:36.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602507+0000", 2023-10-08T07:07:36.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0748000000000006e-05 2023-10-08T07:07:36.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:36.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602639+0000", 2023-10-08T07:07:36.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000132075 2023-10-08T07:07:36.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.782 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.782 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141228 4.2 4:40ea7945:::10000000004.0000003e:head [write 2715648~4096 in=4096b,write 2764800~4096 in=4096b,write 2830336~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.782 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.564065+0000", 2023-10-08T07:07:36.782 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.037999049999999999, 2023-10-08T07:07:36.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.040343517000000002, 2023-10-08T07:07:36.782 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.782 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:36.783 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.783 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.783 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.783 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141228 2023-10-08T07:07:36.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.783 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.564065+0000", 2023-10-08T07:07:36.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.564065+0000", 2023-10-08T07:07:36.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.564065+0000", 2023-10-08T07:07:36.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2200000000000004e-07 2023-10-08T07:07:36.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.564079+0000", 2023-10-08T07:07:36.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.344e-05 2023-10-08T07:07:36.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.564088+0000", 2023-10-08T07:07:36.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9539999999999993e-06 2023-10-08T07:07:36.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.564094+0000", 2023-10-08T07:07:36.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0669999999999997e-06 2023-10-08T07:07:36.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599460+0000", 2023-10-08T07:07:36.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035365715999999998 2023-10-08T07:07:36.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.786 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.599533+0000", 2023-10-08T07:07:36.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3071999999999994e-05 2023-10-08T07:07:36.786 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.787 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.787 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141348 4.20 4.3a89cda0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.787 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.602494+0000", 2023-10-08T07:07:36.787 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9995699, 2023-10-08T07:07:36.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0019839620000000001, 2023-10-08T07:07:36.787 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.787 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.787 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.787 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.788 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.788 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141348 2023-10-08T07:07:36.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.788 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602494+0000", 2023-10-08T07:07:36.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602494+0000", 2023-10-08T07:07:36.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602495+0000", 2023-10-08T07:07:36.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8700000000000005e-07 2023-10-08T07:07:36.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602507+0000", 2023-10-08T07:07:36.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1756999999999999e-05 2023-10-08T07:07:36.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602515+0000", 2023-10-08T07:07:36.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5499999999999995e-06 2023-10-08T07:07:36.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.602521+0000", 2023-10-08T07:07:36.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.366e-06 2023-10-08T07:07:36.790 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.790 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.791 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.791 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141229 4.2 4:43cef10a:::10000000004.00000030:head [write 663552~4096 in=4096b,write 716800~4096 in=4096b,write 839680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.791 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.564103+0000", 2023-10-08T07:07:36.791 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.037960694000000003, 2023-10-08T07:07:36.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.040443444000000002, 2023-10-08T07:07:36.791 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.791 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:36.791 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.791 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.792 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.792 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141229 2023-10-08T07:07:36.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.792 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.564103+0000", 2023-10-08T07:07:36.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.564103+0000", 2023-10-08T07:07:36.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.564104+0000", 2023-10-08T07:07:36.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3599999999999999e-07 2023-10-08T07:07:36.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.564120+0000", 2023-10-08T07:07:36.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6439e-05 2023-10-08T07:07:36.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.564129+0000", 2023-10-08T07:07:36.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2769999999999994e-06 2023-10-08T07:07:36.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.564135+0000", 2023-10-08T07:07:36.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1099999999999999e-06 2023-10-08T07:07:36.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601787+0000", 2023-10-08T07:07:36.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037651472999999998 2023-10-08T07:07:36.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.601874+0000", 2023-10-08T07:07:36.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7387999999999997e-05 2023-10-08T07:07:36.795 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.795 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.795 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.796 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:136204 4.16 e60/17 4:69eefec8:::10000000004.0000003a:head v 60'2100, mlcod=60'2098)", 2023-10-08T07:07:36.796 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.603691+0000", 2023-10-08T07:07:36.796 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.998373, 2023-10-08T07:07:36.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00093245700000000003, 2023-10-08T07:07:36.796 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.796 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:36.796 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.603691+0000", 2023-10-08T07:07:36.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.603691+0000", 2023-10-08T07:07:36.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.603692+0000", 2023-10-08T07:07:36.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5700000000000002e-07 2023-10-08T07:07:36.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.603704+0000", 2023-10-08T07:07:36.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2493e-05 2023-10-08T07:07:36.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.603711+0000", 2023-10-08T07:07:36.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4100000000000002e-06 2023-10-08T07:07:36.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.603716+0000", 2023-10-08T07:07:36.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6160000000000004e-06 2023-10-08T07:07:36.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.603765+0000", 2023-10-08T07:07:36.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8661e-05 2023-10-08T07:07:36.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.603785+0000", 2023-10-08T07:07:36.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0406000000000001e-05 2023-10-08T07:07:36.800 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.800 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.800 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.800 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141353 4.a 4.6e5df24a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.800 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.603993+0000", 2023-10-08T07:07:36.800 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9980702, 2023-10-08T07:07:36.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00069813299999999998, 2023-10-08T07:07:36.800 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.801 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.801 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.801 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.801 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.801 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141353 2023-10-08T07:07:36.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.801 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.603993+0000", 2023-10-08T07:07:36.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.603993+0000", 2023-10-08T07:07:36.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.603994+0000", 2023-10-08T07:07:36.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6599999999999996e-07 2023-10-08T07:07:36.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604014+0000", 2023-10-08T07:07:36.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9816000000000001e-05 2023-10-08T07:07:36.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604021+0000", 2023-10-08T07:07:36.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6649999999999997e-06 2023-10-08T07:07:36.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604025+0000", 2023-10-08T07:07:36.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1860000000000002e-06 2023-10-08T07:07:36.804 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.804 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.804 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.804 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:141294 4.2 4.a29e5702 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:36.804 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.582814+0000", 2023-10-08T07:07:36.805 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.01924973, 2023-10-08T07:07:36.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021940998, 2023-10-08T07:07:36.805 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.805 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.805 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:36.805 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:36.805 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:36.805 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 141294 2023-10-08T07:07:36.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.805 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.582814+0000", 2023-10-08T07:07:36.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.582814+0000", 2023-10-08T07:07:36.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.582815+0000", 2023-10-08T07:07:36.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5000000000000001e-07 2023-10-08T07:07:36.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.582828+0000", 2023-10-08T07:07:36.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3152999999999999e-05 2023-10-08T07:07:36.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.582840+0000", 2023-10-08T07:07:36.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2094e-05 2023-10-08T07:07:36.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.582849+0000", 2023-10-08T07:07:36.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3059999999999998e-06 2023-10-08T07:07:36.808 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.808 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.808 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.808 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:136191 4.11 e60/17 4:8963efe6:::10000000004.00000009:head v 60'2108, mlcod=60'2106)", 2023-10-08T07:07:36.808 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.604149+0000", 2023-10-08T07:07:36.809 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9979153, 2023-10-08T07:07:36.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067311699999999999, 2023-10-08T07:07:36.809 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.809 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:36.809 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604149+0000", 2023-10-08T07:07:36.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604149+0000", 2023-10-08T07:07:36.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604149+0000", 2023-10-08T07:07:36.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8799999999999998e-07 2023-10-08T07:07:36.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604196+0000", 2023-10-08T07:07:36.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7352999999999999e-05 2023-10-08T07:07:36.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604202+0000", 2023-10-08T07:07:36.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.31e-06 2023-10-08T07:07:36.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604205+0000", 2023-10-08T07:07:36.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.506e-06 2023-10-08T07:07:36.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:36.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604249+0000", 2023-10-08T07:07:36.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3684999999999999e-05 2023-10-08T07:07:36.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:36.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604269+0000", 2023-10-08T07:07:36.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0027999999999999e-05 2023-10-08T07:07:36.812 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:136194 4.29 e60/17)", 2023-10-08T07:07:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:36.604220+0000", 2023-10-08T07:07:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9978437, 2023-10-08T07:07:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00066950099999999997, 2023-10-08T07:07:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:36.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:36.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604220+0000", 2023-10-08T07:07:36.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:36.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604220+0000", 2023-10-08T07:07:36.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:36.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:36.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604220+0000", 2023-10-08T07:07:36.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.79e-07 2023-10-08T07:07:36.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:36.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604232+0000", 2023-10-08T07:07:36.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1421e-05 2023-10-08T07:07:36.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:36.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604239+0000", 2023-10-08T07:07:36.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.379e-06 2023-10-08T07:07:36.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:36.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:36.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:36.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:36.604244+0000", 2023-10-08T07:07:36.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8520000000000003e-06 2023-10-08T07:07:36.816 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.816 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:36.816 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.816 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:36.816 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:07:36.816 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 42 2023-10-08T07:07:36.817 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:36.818 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:36.819 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:36.817+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:36.922 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:36.919+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2023-10-08T07:07:37.020 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:37.020+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:37.025 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:37.026 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:37.026 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:37.026 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:37.026 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:37.040 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:37.125 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:37.125+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:37.224 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:37.223+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:37.302 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:37.302 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:37.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:37.302 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:37.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.302 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:109757 4.20 4:05b3915c:::10000000004.00000016:head [write 1871872~4096,write 1912832~4096,write 1957888~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.302 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:25.931082+0000", 2023-10-08T07:07:37.303 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.36769928, 2023-10-08T07:07:37.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.111877037, 2023-10-08T07:07:37.303 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.303 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.303 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.303 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.303 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.303 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 109757 2023-10-08T07:07:37.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.303 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931082+0000", 2023-10-08T07:07:37.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.304 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931082+0000", 2023-10-08T07:07:37.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.304 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931083+0000", 2023-10-08T07:07:37.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4700000000000001e-07 2023-10-08T07:07:37.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931096+0000", 2023-10-08T07:07:37.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3352e-05 2023-10-08T07:07:37.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931104+0000", 2023-10-08T07:07:37.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9440000000000005e-06 2023-10-08T07:07:37.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931111+0000", 2023-10-08T07:07:37.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2319999999999998e-06 2023-10-08T07:07:37.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.977984+0000", 2023-10-08T07:07:37.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046873785000000001 2023-10-08T07:07:37.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.978037+0000", 2023-10-08T07:07:37.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2984e-05 2023-10-08T07:07:37.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.978133+0000", 2023-10-08T07:07:37.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5446999999999996e-05 2023-10-08T07:07:37.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.006001+0000", 2023-10-08T07:07:37.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027867861000000001 2023-10-08T07:07:37.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.042882+0000", 2023-10-08T07:07:37.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.036881377 2023-10-08T07:07:37.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.042920+0000", 2023-10-08T07:07:37.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8155999999999999e-05 2023-10-08T07:07:37.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.042960+0000", 2023-10-08T07:07:37.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9351999999999999e-05 2023-10-08T07:07:37.309 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.309 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.309 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.309 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:109768 4.20 4:04004f2c:::10000000004.0000000d:head [write 598016~4096,write 618496~4096,write 983040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.309 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:25.931321+0000", 2023-10-08T07:07:37.310 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.367460627, 2023-10-08T07:07:37.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.111790031, 2023-10-08T07:07:37.310 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.310 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.310 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.310 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.310 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.310 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 109768 2023-10-08T07:07:37.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.310 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931321+0000", 2023-10-08T07:07:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931321+0000", 2023-10-08T07:07:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931322+0000", 2023-10-08T07:07:37.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8200000000000001e-07 2023-10-08T07:07:37.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931335+0000", 2023-10-08T07:07:37.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.309e-05 2023-10-08T07:07:37.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931342+0000", 2023-10-08T07:07:37.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9800000000000001e-06 2023-10-08T07:07:37.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931347+0000", 2023-10-08T07:07:37.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8889999999999999e-06 2023-10-08T07:07:37.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.980798+0000", 2023-10-08T07:07:37.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049450539000000002 2023-10-08T07:07:37.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.980872+0000", 2023-10-08T07:07:37.314 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4203999999999996e-05 2023-10-08T07:07:37.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.314 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.981017+0000", 2023-10-08T07:07:37.314 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014521299999999999 2023-10-08T07:07:37.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.314 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.006008+0000", 2023-10-08T07:07:37.314 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024990104999999999 2023-10-08T07:07:37.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.315 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.043053+0000", 2023-10-08T07:07:37.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037045217999999998 2023-10-08T07:07:37.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.315 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.043089+0000", 2023-10-08T07:07:37.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6405000000000001e-05 2023-10-08T07:07:37.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.316 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.043111+0000", 2023-10-08T07:07:37.316 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2005999999999999e-05 2023-10-08T07:07:37.316 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.316 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.316 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.316 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:109791 4.20 4:04004f2c:::10000000004.0000000d:head [write 208896~8192,write 348160~4096,write 544768~4096,write 569344~4096,write 1052672~4096,write 1122304~4096,write 1261568~8192,write 1351680~4096,write 1540096~4096,write 1585152~4096,write 1736704~4096,write 1880064~4096,write 1916928~4096,write 2625536~4096,write 2662400~8192,write 2736128~4096,write 2904064~4096,write 2994176~4096,write 3121152~4096,write 3194880~4096,write 3203072~4096,write 3211264~4096,write 3473408~4096,write 3493888~4096,write 3670016~4096,write 3751936~4096,write 3842048~4096,write 3895296~4096,write 4034560~4096,write 4042752~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.316 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:25.931619+0000", 2023-10-08T07:07:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.367162593, 2023-10-08T07:07:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.121958767, 2023-10-08T07:07:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 109791 2023-10-08T07:07:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.317 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.318 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931619+0000", 2023-10-08T07:07:37.318 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.318 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931619+0000", 2023-10-08T07:07:37.318 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931620+0000", 2023-10-08T07:07:37.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9399999999999995e-07 2023-10-08T07:07:37.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.319 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931711+0000", 2023-10-08T07:07:37.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0838e-05 2023-10-08T07:07:37.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.319 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931720+0000", 2023-10-08T07:07:37.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.397e-06 2023-10-08T07:07:37.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.931727+0000", 2023-10-08T07:07:37.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9530000000000002e-06 2023-10-08T07:07:37.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.990307+0000", 2023-10-08T07:07:37.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058580225 2023-10-08T07:07:37.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.990420+0000", 2023-10-08T07:07:37.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000113338 2023-10-08T07:07:37.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:25.990988+0000", 2023-10-08T07:07:37.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00056734999999999999 2023-10-08T07:07:37.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.006171+0000", 2023-10-08T07:07:37.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015183202 2023-10-08T07:07:37.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.053454+0000", 2023-10-08T07:07:37.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.047282892999999999 2023-10-08T07:07:37.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.053539+0000", 2023-10-08T07:07:37.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5048000000000003e-05 2023-10-08T07:07:37.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.053578+0000", 2023-10-08T07:07:37.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9029000000000002e-05 2023-10-08T07:07:37.323 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.323 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.323 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.323 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110410 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 557056~4096,write 634880~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.323 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.151249+0000", 2023-10-08T07:07:37.324 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.147533107999999, 2023-10-08T07:07:37.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12446716100000001, 2023-10-08T07:07:37.324 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.324 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.324 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.324 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.324 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.324 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110410 2023-10-08T07:07:37.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.324 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.324 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151249+0000", 2023-10-08T07:07:37.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151249+0000", 2023-10-08T07:07:37.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.325 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.325 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151250+0000", 2023-10-08T07:07:37.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4e-07 2023-10-08T07:07:37.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151276+0000", 2023-10-08T07:07:37.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6818999999999999e-05 2023-10-08T07:07:37.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151287+0000", 2023-10-08T07:07:37.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0835e-05 2023-10-08T07:07:37.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.327 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151295+0000", 2023-10-08T07:07:37.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3529999999999997e-06 2023-10-08T07:07:37.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.327 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.164846+0000", 2023-10-08T07:07:37.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013551917 2023-10-08T07:07:37.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.327 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.164902+0000", 2023-10-08T07:07:37.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5736999999999998e-05 2023-10-08T07:07:37.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.328 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.164995+0000", 2023-10-08T07:07:37.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2942000000000006e-05 2023-10-08T07:07:37.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.328 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.173868+0000", 2023-10-08T07:07:37.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0088733379999999997 2023-10-08T07:07:37.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275615+0000", 2023-10-08T07:07:37.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.101746446 2023-10-08T07:07:37.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275677+0000", 2023-10-08T07:07:37.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1739e-05 2023-10-08T07:07:37.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275716+0000", 2023-10-08T07:07:37.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9195e-05 2023-10-08T07:07:37.330 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.330 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.330 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.330 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110411 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2457600~4096,write 3194880~4096,write 3284992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.330 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.151498+0000", 2023-10-08T07:07:37.330 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.147283702999999, 2023-10-08T07:07:37.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.124347257, 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110411 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151498+0000", 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151498+0000", 2023-10-08T07:07:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151499+0000", 2023-10-08T07:07:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7000000000000004e-07 2023-10-08T07:07:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.332 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151530+0000", 2023-10-08T07:07:37.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1637999999999998e-05 2023-10-08T07:07:37.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.333 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151539+0000", 2023-10-08T07:07:37.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.952e-06 2023-10-08T07:07:37.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.333 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.151546+0000", 2023-10-08T07:07:37.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2480000000000001e-06 2023-10-08T07:07:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.166753+0000", 2023-10-08T07:07:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015207165 2023-10-08T07:07:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.166804+0000", 2023-10-08T07:07:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0936999999999997e-05 2023-10-08T07:07:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.166901+0000", 2023-10-08T07:07:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7418999999999997e-05 2023-10-08T07:07:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178556+0000", 2023-10-08T07:07:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011654464 2023-10-08T07:07:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275764+0000", 2023-10-08T07:07:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.097208469000000006 2023-10-08T07:07:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275801+0000", 2023-10-08T07:07:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6715999999999999e-05 2023-10-08T07:07:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275845+0000", 2023-10-08T07:07:37.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4579000000000001e-05 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110422 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 774144~4096,write 880640~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.143794265, 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12745208799999999, 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.337 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.338 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.338 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110422 2023-10-08T07:07:37.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.338 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:37.338 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:37.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:37.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7399999999999998e-07 2023-10-08T07:07:37.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.339 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.339 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.155045+0000", 2023-10-08T07:07:37.339 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6687000000000001e-05 2023-10-08T07:07:37.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.155053+0000", 2023-10-08T07:07:37.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5569999999999996e-06 2023-10-08T07:07:37.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.340 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.155060+0000", 2023-10-08T07:07:37.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9090000000000003e-06 2023-10-08T07:07:37.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.341 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.168971+0000", 2023-10-08T07:07:37.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013910782999999999 2023-10-08T07:07:37.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.341 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169054+0000", 2023-10-08T07:07:37.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3051000000000002e-05 2023-10-08T07:07:37.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.341 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169194+0000", 2023-10-08T07:07:37.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013997799999999999 2023-10-08T07:07:37.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.342 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.342 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178725+0000", 2023-10-08T07:07:37.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0095310480000000003 2023-10-08T07:07:37.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.342 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.342 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282382+0000", 2023-10-08T07:07:37.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10365708 2023-10-08T07:07:37.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282416+0000", 2023-10-08T07:07:37.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4258999999999998e-05 2023-10-08T07:07:37.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282440+0000", 2023-10-08T07:07:37.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3261999999999999e-05 2023-10-08T07:07:37.343 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.343 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.343 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110428 4.a 4:524fba76:::10000000004.0000001b:head [write 1576960~4096,write 1830912~4096,write 1847296~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.156743+0000", 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.142038682000001, 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.1191084, 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110428 2023-10-08T07:07:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156743+0000", 2023-10-08T07:07:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156743+0000", 2023-10-08T07:07:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156744+0000", 2023-10-08T07:07:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5499999999999997e-07 2023-10-08T07:07:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156818+0000", 2023-10-08T07:07:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3955999999999995e-05 2023-10-08T07:07:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156829+0000", 2023-10-08T07:07:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1482e-05 2023-10-08T07:07:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.156837+0000", 2023-10-08T07:07:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8159999999999994e-06 2023-10-08T07:07:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.168957+0000", 2023-10-08T07:07:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012120077 2023-10-08T07:07:37.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.348 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.348 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169037+0000", 2023-10-08T07:07:37.348 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9730999999999999e-05 2023-10-08T07:07:37.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.348 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.348 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169172+0000", 2023-10-08T07:07:37.348 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013486999999999999 2023-10-08T07:07:37.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.348 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.348 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178565+0000", 2023-10-08T07:07:37.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0093934910000000003 2023-10-08T07:07:37.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275762+0000", 2023-10-08T07:07:37.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.097196649999999996 2023-10-08T07:07:37.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275811+0000", 2023-10-08T07:07:37.349 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9351999999999998e-05 2023-10-08T07:07:37.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275851+0000", 2023-10-08T07:07:37.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0120000000000002e-05 2023-10-08T07:07:37.350 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.350 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.350 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.350 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110434 4.a 4:524fba76:::10000000004.0000001b:head [write 3473408~4096,write 3694592~4096,write 3710976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.350 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.159018+0000", 2023-10-08T07:07:37.351 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.139763632999999, 2023-10-08T07:07:37.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11695425800000001, 2023-10-08T07:07:37.353 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.353 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.353 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.353 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.353 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.353 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110434 2023-10-08T07:07:37.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.353 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.354 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.354 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159018+0000", 2023-10-08T07:07:37.354 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159018+0000", 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159019+0000", 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0800000000000004e-07 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159032+0000", 2023-10-08T07:07:37.355 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2672e-05 2023-10-08T07:07:37.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.356 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.356 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.356 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159042+0000", 2023-10-08T07:07:37.356 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0882e-05 2023-10-08T07:07:37.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.356 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.356 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.356 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.159050+0000", 2023-10-08T07:07:37.356 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9889999999999992e-06 2023-10-08T07:07:37.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170445+0000", 2023-10-08T07:07:37.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011394826 2023-10-08T07:07:37.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170503+0000", 2023-10-08T07:07:37.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7574999999999997e-05 2023-10-08T07:07:37.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170619+0000", 2023-10-08T07:07:37.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011575599999999999 2023-10-08T07:07:37.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178729+0000", 2023-10-08T07:07:37.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0081105169999999994 2023-10-08T07:07:37.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275886+0000", 2023-10-08T07:07:37.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.097157073999999996 2023-10-08T07:07:37.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.359 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.359 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275936+0000", 2023-10-08T07:07:37.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9651000000000003e-05 2023-10-08T07:07:37.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.359 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.359 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.275972+0000", 2023-10-08T07:07:37.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6507999999999997e-05 2023-10-08T07:07:37.359 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.360 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.360 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.360 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110441 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2404352~8192,write 2510848~4096,write 2584576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.360 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.161045+0000", 2023-10-08T07:07:37.360 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.137736753, 2023-10-08T07:07:37.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12159005000000001, 2023-10-08T07:07:37.360 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.360 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.360 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.360 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110441 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161045+0000", 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161045+0000", 2023-10-08T07:07:37.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161046+0000", 2023-10-08T07:07:37.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.139e-06 2023-10-08T07:07:37.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161059+0000", 2023-10-08T07:07:37.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2616000000000001e-05 2023-10-08T07:07:37.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161069+0000", 2023-10-08T07:07:37.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9680000000000001e-06 2023-10-08T07:07:37.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.363 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.161077+0000", 2023-10-08T07:07:37.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8310000000000001e-06 2023-10-08T07:07:37.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.363 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.363 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.363 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.171413+0000", 2023-10-08T07:07:37.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010336675 2023-10-08T07:07:37.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.364 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.364 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.171509+0000", 2023-10-08T07:07:37.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5352000000000005e-05 2023-10-08T07:07:37.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.364 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.364 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.171664+0000", 2023-10-08T07:07:37.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015575699999999999 2023-10-08T07:07:37.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179024+0000", 2023-10-08T07:07:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.007359768 2023-10-08T07:07:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282494+0000", 2023-10-08T07:07:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10346983899999999 2023-10-08T07:07:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282582+0000", 2023-10-08T07:07:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7650000000000003e-05 2023-10-08T07:07:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282635+0000", 2023-10-08T07:07:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3455000000000002e-05 2023-10-08T07:07:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110460 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 385024~4096,write 438272~4096,write 446464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.167805+0000", 2023-10-08T07:07:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.130976517000001, 2023-10-08T07:07:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.114918704, 2023-10-08T07:07:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110460 2023-10-08T07:07:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167805+0000", 2023-10-08T07:07:37.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167805+0000", 2023-10-08T07:07:37.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167806+0000", 2023-10-08T07:07:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6799999999999999e-07 2023-10-08T07:07:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167819+0000", 2023-10-08T07:07:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.277e-05 2023-10-08T07:07:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167831+0000", 2023-10-08T07:07:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2009e-05 2023-10-08T07:07:37.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.167839+0000", 2023-10-08T07:07:37.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1790000000000008e-06 2023-10-08T07:07:37.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.370 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.370 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.173901+0000", 2023-10-08T07:07:37.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.006061533 2023-10-08T07:07:37.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.173999+0000", 2023-10-08T07:07:37.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8651000000000001e-05 2023-10-08T07:07:37.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.174160+0000", 2023-10-08T07:07:37.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000161211 2023-10-08T07:07:37.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191238+0000", 2023-10-08T07:07:37.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017077877000000002 2023-10-08T07:07:37.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.372 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282672+0000", 2023-10-08T07:07:37.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.091434122000000007 2023-10-08T07:07:37.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.372 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282704+0000", 2023-10-08T07:07:37.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1863000000000003e-05 2023-10-08T07:07:37.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282724+0000", 2023-10-08T07:07:37.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9621000000000001e-05 2023-10-08T07:07:37.373 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.373 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.373 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.373 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110467 4.1a 4:5a59f83a:::10000000004.00000002:head [write 1171456~4096,write 1269760~4096,write 1388544~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.373 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.170266+0000", 2023-10-08T07:07:37.373 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.128515604, 2023-10-08T07:07:37.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.124576939, 2023-10-08T07:07:37.374 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.374 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.374 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.374 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.374 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.374 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110467 2023-10-08T07:07:37.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.374 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170266+0000", 2023-10-08T07:07:37.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170266+0000", 2023-10-08T07:07:37.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170267+0000", 2023-10-08T07:07:37.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2799999999999996e-07 2023-10-08T07:07:37.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170277+0000", 2023-10-08T07:07:37.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0705e-05 2023-10-08T07:07:37.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170286+0000", 2023-10-08T07:07:37.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3459999999999994e-06 2023-10-08T07:07:37.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170291+0000", 2023-10-08T07:07:37.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4720000000000003e-06 2023-10-08T07:07:37.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.377 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179164+0000", 2023-10-08T07:07:37.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0088732729999999992 2023-10-08T07:07:37.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.377 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.377 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.377 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179250+0000", 2023-10-08T07:07:37.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5264000000000002e-05 2023-10-08T07:07:37.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.378 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179396+0000", 2023-10-08T07:07:37.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014668 2023-10-08T07:07:37.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.378 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191628+0000", 2023-10-08T07:07:37.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012231483 2023-10-08T07:07:37.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.294751+0000", 2023-10-08T07:07:37.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10312267999999999 2023-10-08T07:07:37.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.294794+0000", 2023-10-08T07:07:37.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3467999999999998e-05 2023-10-08T07:07:37.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.294843+0000", 2023-10-08T07:07:37.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9039999999999998e-05 2023-10-08T07:07:37.380 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.380 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.380 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.380 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110489 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2711552~4096,write 2859008~4096,write 2887680~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.380 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.178082+0000", 2023-10-08T07:07:37.380 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.120699378999999, 2023-10-08T07:07:37.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.13133874200000001, 2023-10-08T07:07:37.380 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.380 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.381 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.381 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.381 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.381 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110489 2023-10-08T07:07:37.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.381 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.381 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178082+0000", 2023-10-08T07:07:37.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178082+0000", 2023-10-08T07:07:37.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178083+0000", 2023-10-08T07:07:37.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4000000000000001e-07 2023-10-08T07:07:37.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178094+0000", 2023-10-08T07:07:37.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1144e-05 2023-10-08T07:07:37.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178101+0000", 2023-10-08T07:07:37.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1509999999999998e-06 2023-10-08T07:07:37.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178106+0000", 2023-10-08T07:07:37.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8470000000000003e-06 2023-10-08T07:07:37.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.384 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.180867+0000", 2023-10-08T07:07:37.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027610529999999999 2023-10-08T07:07:37.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.384 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.384 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.180923+0000", 2023-10-08T07:07:37.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5770000000000003e-05 2023-10-08T07:07:37.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181024+0000", 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100806 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191634+0000", 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010609809 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309361+0000", 2023-10-08T07:07:37.385 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.117727095 2023-10-08T07:07:37.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.386 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.386 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309397+0000", 2023-10-08T07:07:37.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6465999999999999e-05 2023-10-08T07:07:37.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.386 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.386 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309421+0000", 2023-10-08T07:07:37.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3961e-05 2023-10-08T07:07:37.386 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.386 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.387 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.387 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110495 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 528384~4096,write 663552~4096,write 974848~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.387 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.181379+0000", 2023-10-08T07:07:37.387 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.117402624, 2023-10-08T07:07:37.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.128198539, 2023-10-08T07:07:37.387 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.387 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.387 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.387 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.387 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.388 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110495 2023-10-08T07:07:37.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.388 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181379+0000", 2023-10-08T07:07:37.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181379+0000", 2023-10-08T07:07:37.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181380+0000", 2023-10-08T07:07:37.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2e-07 2023-10-08T07:07:37.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181397+0000", 2023-10-08T07:07:37.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7750000000000001e-05 2023-10-08T07:07:37.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181405+0000", 2023-10-08T07:07:37.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8210000000000002e-06 2023-10-08T07:07:37.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181411+0000", 2023-10-08T07:07:37.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9479999999999996e-06 2023-10-08T07:07:37.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.183521+0000", 2023-10-08T07:07:37.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0021102629999999998 2023-10-08T07:07:37.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.183600+0000", 2023-10-08T07:07:37.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8524999999999998e-05 2023-10-08T07:07:37.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.183748+0000", 2023-10-08T07:07:37.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014801300000000001 2023-10-08T07:07:37.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.392 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.194292+0000", 2023-10-08T07:07:37.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010544421999999999 2023-10-08T07:07:37.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.392 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309480+0000", 2023-10-08T07:07:37.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11518740800000001 2023-10-08T07:07:37.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.392 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.392 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309538+0000", 2023-10-08T07:07:37.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8128999999999999e-05 2023-10-08T07:07:37.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309578+0000", 2023-10-08T07:07:37.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9740000000000002e-05 2023-10-08T07:07:37.393 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.393 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.393 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.394 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110498 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 892928~4096,write 1101824~4096,write 1118208~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.394 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.181421+0000", 2023-10-08T07:07:37.394 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.117360363, 2023-10-08T07:07:37.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12831536399999999, 2023-10-08T07:07:37.394 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.394 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.394 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.394 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.394 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.394 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110498 2023-10-08T07:07:37.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.394 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181421+0000", 2023-10-08T07:07:37.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181421+0000", 2023-10-08T07:07:37.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181422+0000", 2023-10-08T07:07:37.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6899999999999997e-07 2023-10-08T07:07:37.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181435+0000", 2023-10-08T07:07:37.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3217999999999999e-05 2023-10-08T07:07:37.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181443+0000", 2023-10-08T07:07:37.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5719999999999997e-06 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181449+0000", 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8930000000000002e-06 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.186316+0000", 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048669539999999997 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.186386+0000", 2023-10-08T07:07:37.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0698000000000006e-05 2023-10-08T07:07:37.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.186499+0000", 2023-10-08T07:07:37.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000112408 2023-10-08T07:07:37.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.194298+0000", 2023-10-08T07:07:37.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.007799243 2023-10-08T07:07:37.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309638+0000", 2023-10-08T07:07:37.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.115339652 2023-10-08T07:07:37.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.399 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.399 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.399 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309697+0000", 2023-10-08T07:07:37.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9635000000000001e-05 2023-10-08T07:07:37.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.400 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.400 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309737+0000", 2023-10-08T07:07:37.400 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9521999999999999e-05 2023-10-08T07:07:37.400 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.400 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.400 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.400 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.400 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110500 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 53248~4096,write 278528~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.400 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.182173+0000", 2023-10-08T07:07:37.400 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.116608518, 2023-10-08T07:07:37.401 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12767258300000001, 2023-10-08T07:07:37.401 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.401 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.401 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.401 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.401 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.401 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110500 2023-10-08T07:07:37.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.401 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.401 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.401 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182173+0000", 2023-10-08T07:07:37.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182173+0000", 2023-10-08T07:07:37.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.402 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.402 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.402 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182174+0000", 2023-10-08T07:07:37.402 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:37.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182191+0000", 2023-10-08T07:07:37.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6511000000000002e-05 2023-10-08T07:07:37.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.403 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182213+0000", 2023-10-08T07:07:37.403 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1948999999999999e-05 2023-10-08T07:07:37.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.403 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182220+0000", 2023-10-08T07:07:37.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7710000000000006e-06 2023-10-08T07:07:37.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.188654+0000", 2023-10-08T07:07:37.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0064335299999999998 2023-10-08T07:07:37.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.404 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.404 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.188748+0000", 2023-10-08T07:07:37.404 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.433e-05 2023-10-08T07:07:37.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.188969+0000", 2023-10-08T07:07:37.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022088500000000001 2023-10-08T07:07:37.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.405 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.405 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197663+0000", 2023-10-08T07:07:37.405 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0086943860000000001 2023-10-08T07:07:37.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309781+0000", 2023-10-08T07:07:37.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11211758199999999 2023-10-08T07:07:37.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.406 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309825+0000", 2023-10-08T07:07:37.406 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3955000000000002e-05 2023-10-08T07:07:37.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.406 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.406 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309846+0000", 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0873000000000002e-05 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110508 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3907584~12288,write 3948544~4096,write 4030464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.184597+0000", 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.11418495, 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12538458, 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.407 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.408 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.408 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.408 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.408 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110508 2023-10-08T07:07:37.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.408 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.408 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.408 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184597+0000", 2023-10-08T07:07:37.408 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.408 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184597+0000", 2023-10-08T07:07:37.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184598+0000", 2023-10-08T07:07:37.409 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9299999999999997e-07 2023-10-08T07:07:37.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.409 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.409 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184609+0000", 2023-10-08T07:07:37.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1525999999999999e-05 2023-10-08T07:07:37.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184618+0000", 2023-10-08T07:07:37.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.037e-06 2023-10-08T07:07:37.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.410 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.410 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184623+0000", 2023-10-08T07:07:37.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6199999999999998e-06 2023-10-08T07:07:37.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191662+0000", 2023-10-08T07:07:37.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070390849999999996 2023-10-08T07:07:37.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191743+0000", 2023-10-08T07:07:37.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0982999999999994e-05 2023-10-08T07:07:37.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191901+0000", 2023-10-08T07:07:37.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000158379 2023-10-08T07:07:37.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.200125+0000", 2023-10-08T07:07:37.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0082239050000000001 2023-10-08T07:07:37.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309894+0000", 2023-10-08T07:07:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10976902099999999 2023-10-08T07:07:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309947+0000", 2023-10-08T07:07:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3295999999999999e-05 2023-10-08T07:07:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309981+0000", 2023-10-08T07:07:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4035000000000002e-05 2023-10-08T07:07:37.413 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.414 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.414 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.414 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110511 4.1a 4:5a59f83a:::10000000004.00000002:head [write 942080~4096,write 1011712~4096,write 1163264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.414 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.185809+0000", 2023-10-08T07:07:37.414 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.112973117999999, 2023-10-08T07:07:37.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.123881088, 2023-10-08T07:07:37.414 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.414 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.414 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.414 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.415 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.415 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110511 2023-10-08T07:07:37.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.415 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185809+0000", 2023-10-08T07:07:37.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.415 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.415 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185809+0000", 2023-10-08T07:07:37.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185809+0000", 2023-10-08T07:07:37.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.61e-07 2023-10-08T07:07:37.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185824+0000", 2023-10-08T07:07:37.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4487999999999999e-05 2023-10-08T07:07:37.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185835+0000", 2023-10-08T07:07:37.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1245e-05 2023-10-08T07:07:37.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.185842+0000", 2023-10-08T07:07:37.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2439999999999996e-06 2023-10-08T07:07:37.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.193541+0000", 2023-10-08T07:07:37.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0076988450000000002 2023-10-08T07:07:37.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.193632+0000", 2023-10-08T07:07:37.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0859000000000005e-05 2023-10-08T07:07:37.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.193800+0000", 2023-10-08T07:07:37.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016752100000000001 2023-10-08T07:07:37.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.200130+0000", 2023-10-08T07:07:37.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0063304379999999999 2023-10-08T07:07:37.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.419 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.419 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309629+0000", 2023-10-08T07:07:37.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.109498716 2023-10-08T07:07:37.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309669+0000", 2023-10-08T07:07:37.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0280000000000001e-05 2023-10-08T07:07:37.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309690+0000", 2023-10-08T07:07:37.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0690999999999999e-05 2023-10-08T07:07:37.420 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.420 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.420 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110528 4.3a 4:5f183e4b:::10000000004.00000023:head [write 0~4096,write 270336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.191132+0000", 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.107649513, 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11896013499999999, 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110528 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.421 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191132+0000", 2023-10-08T07:07:37.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191132+0000", 2023-10-08T07:07:37.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191133+0000", 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1299999999999999e-07 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191143+0000", 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0328e-05 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191154+0000", 2023-10-08T07:07:37.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0556e-05 2023-10-08T07:07:37.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191162+0000", 2023-10-08T07:07:37.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0930000000000003e-06 2023-10-08T07:07:37.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.195252+0000", 2023-10-08T07:07:37.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0040898719999999996 2023-10-08T07:07:37.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.195331+0000", 2023-10-08T07:07:37.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9093999999999999e-05 2023-10-08T07:07:37.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.195484+0000", 2023-10-08T07:07:37.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015313699999999999 2023-10-08T07:07:37.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.425 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.425 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.200515+0000", 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0050304950000000003 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310023+0000", 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10950808400000001 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310063+0000", 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0309999999999999e-05 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310092+0000", 2023-10-08T07:07:37.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.9453000000000001e-05 2023-10-08T07:07:37.427 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.427 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.427 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.427 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110532 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3649536~4096,write 4071424~4096,write 4169728~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.427 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.192360+0000", 2023-10-08T07:07:37.427 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.106421318000001, 2023-10-08T07:07:37.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.117879547, 2023-10-08T07:07:37.428 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.428 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.428 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.428 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.428 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.428 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110532 2023-10-08T07:07:37.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.428 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192360+0000", 2023-10-08T07:07:37.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192360+0000", 2023-10-08T07:07:37.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.429 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.429 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192361+0000", 2023-10-08T07:07:37.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5899999999999995e-07 2023-10-08T07:07:37.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192373+0000", 2023-10-08T07:07:37.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2099000000000001e-05 2023-10-08T07:07:37.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192402+0000", 2023-10-08T07:07:37.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8928000000000002e-05 2023-10-08T07:07:37.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.192413+0000", 2023-10-08T07:07:37.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1177e-05 2023-10-08T07:07:37.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2023-10-08T07:07:37.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197684+0000", 2023-10-08T07:07:37.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052704850000000001 2023-10-08T07:07:37.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197770+0000", 2023-10-08T07:07:37.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6493e-05 2023-10-08T07:07:37.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.433 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.433 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197935+0000", 2023-10-08T07:07:37.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016471500000000001 2023-10-08T07:07:37.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.201435+0000", 2023-10-08T07:07:37.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0035002359999999999 2023-10-08T07:07:37.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310136+0000", 2023-10-08T07:07:37.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.108701038 2023-10-08T07:07:37.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310194+0000", 2023-10-08T07:07:37.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8109999999999998e-05 2023-10-08T07:07:37.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.310240+0000", 2023-10-08T07:07:37.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5507000000000003e-05 2023-10-08T07:07:37.435 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.435 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.435 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110687 4.3a 4:5f183e4b:::10000000004.00000023:head [write 303104~4096,write 720896~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.244728+0000", 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 11.054054146, 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.113819712, 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110687 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:37.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:37.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244728+0000", 2023-10-08T07:07:37.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:37.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244728+0000", 2023-10-08T07:07:37.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:37.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:37.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244729+0000", 2023-10-08T07:07:37.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8800000000000001e-07 2023-10-08T07:07:37.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:37.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244739+0000", 2023-10-08T07:07:37.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0370000000000001e-05 2023-10-08T07:07:37.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.438 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:37.438 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244749+0000", 2023-10-08T07:07:37.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0135999999999999e-05 2023-10-08T07:07:37.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.244756+0000", 2023-10-08T07:07:37.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3969999999999997e-06 2023-10-08T07:07:37.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:37.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.247549+0000", 2023-10-08T07:07:37.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027921030000000002 2023-10-08T07:07:37.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:37.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.247630+0000", 2023-10-08T07:07:37.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1296000000000002e-05 2023-10-08T07:07:37.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:37.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.247777+0000", 2023-10-08T07:07:37.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014733899999999999 2023-10-08T07:07:37.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:37.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.258321+0000", 2023-10-08T07:07:37.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010543423 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.358450+0000", 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.100129684 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.358505+0000", 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4719999999999998e-05 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:37.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:37.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.358547+0000", 2023-10-08T07:07:37.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2355999999999999e-05 2023-10-08T07:07:37.442 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.442 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.442 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.442 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:37.442 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:37.442 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:37.443 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:37.443 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:37.432+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:37.533 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:37.532+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:37.635 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:37.635+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:37.686 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:37.686 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:37.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.686 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136461 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.686 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.708381+0000", 2023-10-08T07:07:37.687 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.95131891899999999, 2023-10-08T07:07:37.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95133614799999999, 2023-10-08T07:07:37.687 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.687 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.687 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.687 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.687 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.687 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136461 2023-10-08T07:07:37.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.687 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.708381+0000", 2023-10-08T07:07:37.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.708381+0000", 2023-10-08T07:07:37.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.712297+0000", 2023-10-08T07:07:37.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039156130000000001 2023-10-08T07:07:37.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.712319+0000", 2023-10-08T07:07:37.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2478999999999999e-05 2023-10-08T07:07:37.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.712331+0000", 2023-10-08T07:07:37.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1167e-05 2023-10-08T07:07:37.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.712346+0000", 2023-10-08T07:07:37.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4980999999999999e-05 2023-10-08T07:07:37.690 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.690 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.690 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.690 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137136 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.690 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.980352+0000", 2023-10-08T07:07:37.690 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67934859299999995, 2023-10-08T07:07:37.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.67940492699999999, 2023-10-08T07:07:37.691 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.691 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.691 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.691 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.691 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.691 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137136 2023-10-08T07:07:37.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.691 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.980352+0000", 2023-10-08T07:07:37.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.980352+0000", 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.980352+0000", 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000002e-07 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.980364+0000", 2023-10-08T07:07:37.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.199e-05 2023-10-08T07:07:37.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.980371+0000", 2023-10-08T07:07:37.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0040000000000002e-06 2023-10-08T07:07:37.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.980376+0000", 2023-10-08T07:07:37.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2059999999999998e-06 2023-10-08T07:07:37.694 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.694 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.694 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.694 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137902 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.694 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.291511+0000", 2023-10-08T07:07:37.694 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.36818878500000002, 2023-10-08T07:07:37.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.36827664300000001, 2023-10-08T07:07:37.694 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.694 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.695 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.695 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.695 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137902 2023-10-08T07:07:37.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.695 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.291511+0000", 2023-10-08T07:07:37.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.291511+0000", 2023-10-08T07:07:37.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.291512+0000", 2023-10-08T07:07:37.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:07:37.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.291526+0000", 2023-10-08T07:07:37.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4039000000000001e-05 2023-10-08T07:07:37.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.291535+0000", 2023-10-08T07:07:37.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9250000000000001e-06 2023-10-08T07:07:37.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.291541+0000", 2023-10-08T07:07:37.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2269999999999998e-06 2023-10-08T07:07:37.698 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.698 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.698 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.698 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137950 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.698 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.323126+0000", 2023-10-08T07:07:37.698 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.33657407, 2023-10-08T07:07:37.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.33669315100000002, 2023-10-08T07:07:37.698 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.698 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.699 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.699 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.699 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.699 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137950 2023-10-08T07:07:37.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.699 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.323126+0000", 2023-10-08T07:07:37.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.323126+0000", 2023-10-08T07:07:37.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.324576+0000", 2023-10-08T07:07:37.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00145005 2023-10-08T07:07:37.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.324592+0000", 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5344000000000001e-05 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.324599+0000", 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7049999999999999e-06 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.324604+0000", 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0839999999999999e-06 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.701 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.702 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.702 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138120 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.702 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.393864+0000", 2023-10-08T07:07:37.702 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.265835881, 2023-10-08T07:07:37.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.265985101, 2023-10-08T07:07:37.702 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.702 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.703 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138120 2023-10-08T07:07:37.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.703 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.393864+0000", 2023-10-08T07:07:37.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.393864+0000", 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.393865+0000", 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9400000000000005e-07 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.393888+0000", 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2595999999999998e-05 2023-10-08T07:07:37.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.393896+0000", 2023-10-08T07:07:37.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6819999999999992e-06 2023-10-08T07:07:37.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.393902+0000", 2023-10-08T07:07:37.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3310000000000003e-06 2023-10-08T07:07:37.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.705 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.706 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.706 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138693 4.36 4:6d7df329:::10000000004.00000034:head [write 835584~4096 in=4096b,write 843776~4096 in=4096b,write 913408~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.706 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.652495+0000", 2023-10-08T07:07:37.706 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0072048219999999996, 2023-10-08T07:07:37.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073891369999999996, 2023-10-08T07:07:37.706 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.706 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:37.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.707 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.707 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138693 2023-10-08T07:07:37.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.707 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652495+0000", 2023-10-08T07:07:37.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652495+0000", 2023-10-08T07:07:37.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652496+0000", 2023-10-08T07:07:37.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.15e-07 2023-10-08T07:07:37.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652508+0000", 2023-10-08T07:07:37.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1799e-05 2023-10-08T07:07:37.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652514+0000", 2023-10-08T07:07:37.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2929999999999997e-06 2023-10-08T07:07:37.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652519+0000", 2023-10-08T07:07:37.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3340000000000001e-06 2023-10-08T07:07:37.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655869+0000", 2023-10-08T07:07:37.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033494810000000001 2023-10-08T07:07:37.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655942+0000", 2023-10-08T07:07:37.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2803000000000001e-05 2023-10-08T07:07:37.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.710 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.711 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136518 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.711 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.740364+0000", 2023-10-08T07:07:37.711 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.91933614500000005, 2023-10-08T07:07:37.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91955698100000005, 2023-10-08T07:07:37.711 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.711 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.711 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136518 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.740364+0000", 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.740364+0000", 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.740365+0000", 2023-10-08T07:07:37.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1399999999999997e-07 2023-10-08T07:07:37.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.740383+0000", 2023-10-08T07:07:37.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8850000000000001e-05 2023-10-08T07:07:37.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.740391+0000", 2023-10-08T07:07:37.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3629999999999996e-06 2023-10-08T07:07:37.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.740397+0000", 2023-10-08T07:07:37.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6690000000000003e-06 2023-10-08T07:07:37.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.714 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136757 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.834546+0000", 2023-10-08T07:07:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.82515470199999996, 2023-10-08T07:07:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82540604100000003, 2023-10-08T07:07:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136757 2023-10-08T07:07:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834546+0000", 2023-10-08T07:07:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834546+0000", 2023-10-08T07:07:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834546+0000", 2023-10-08T07:07:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9000000000000002e-07 2023-10-08T07:07:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834568+0000", 2023-10-08T07:07:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.243e-05 2023-10-08T07:07:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834574+0000", 2023-10-08T07:07:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9159999999999998e-06 2023-10-08T07:07:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834579+0000", 2023-10-08T07:07:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5360000000000003e-06 2023-10-08T07:07:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136987 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.914348+0000", 2023-10-08T07:07:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74535204700000002, 2023-10-08T07:07:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.74563829500000001, 2023-10-08T07:07:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136987 2023-10-08T07:07:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.914348+0000", 2023-10-08T07:07:37.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.914348+0000", 2023-10-08T07:07:37.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.914349+0000", 2023-10-08T07:07:37.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4000000000000002e-07 2023-10-08T07:07:37.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.914364+0000", 2023-10-08T07:07:37.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5583999999999999e-05 2023-10-08T07:07:37.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.914371+0000", 2023-10-08T07:07:37.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7440000000000001e-06 2023-10-08T07:07:37.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.914376+0000", 2023-10-08T07:07:37.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.147e-06 2023-10-08T07:07:37.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.722 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.722 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137626 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.722 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.155848+0000", 2023-10-08T07:07:37.723 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.50385197900000001, 2023-10-08T07:07:37.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.50417291200000003, 2023-10-08T07:07:37.723 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.723 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.723 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137626 2023-10-08T07:07:37.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.723 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.155848+0000", 2023-10-08T07:07:37.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.155848+0000", 2023-10-08T07:07:37.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.157295+0000", 2023-10-08T07:07:37.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014471040000000001 2023-10-08T07:07:37.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.157311+0000", 2023-10-08T07:07:37.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5432000000000001e-05 2023-10-08T07:07:37.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.157323+0000", 2023-10-08T07:07:37.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1834999999999999e-05 2023-10-08T07:07:37.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.157330+0000", 2023-10-08T07:07:37.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0500000000000003e-06 2023-10-08T07:07:37.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.727 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.727 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.728 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138631 4.7 4:e13e8cdb:::10000000004.00000028:head [write 1404928~8192 in=8192b,write 1433600~4096 in=4096b,write 1556480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.728 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.621526+0000", 2023-10-08T07:07:37.728 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.038174226999999998, 2023-10-08T07:07:37.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038538941, 2023-10-08T07:07:37.728 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.728 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:37.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.728 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138631 2023-10-08T07:07:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621526+0000", 2023-10-08T07:07:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621526+0000", 2023-10-08T07:07:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621527+0000", 2023-10-08T07:07:37.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0500000000000004e-07 2023-10-08T07:07:37.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621543+0000", 2023-10-08T07:07:37.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6089000000000001e-05 2023-10-08T07:07:37.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621552+0000", 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3570000000000004e-06 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621557+0000", 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2209999999999996e-06 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.634084+0000", 2023-10-08T07:07:37.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012526577000000001 2023-10-08T07:07:37.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.634158+0000", 2023-10-08T07:07:37.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4579000000000005e-05 2023-10-08T07:07:37.732 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.732 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.732 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.732 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144561 4.2b e61/17)", 2023-10-08T07:07:37.732 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.637973+0000", 2023-10-08T07:07:37.733 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.021727164, 2023-10-08T07:07:37.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022159622, 2023-10-08T07:07:37.733 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.733 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.733 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.637973+0000", 2023-10-08T07:07:37.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.637973+0000", 2023-10-08T07:07:37.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.637973+0000", 2023-10-08T07:07:37.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7599999999999998e-07 2023-10-08T07:07:37.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.637992+0000", 2023-10-08T07:07:37.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8695e-05 2023-10-08T07:07:37.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.638002+0000", 2023-10-08T07:07:37.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9159999999999996e-06 2023-10-08T07:07:37.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.638008+0000", 2023-10-08T07:07:37.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8470000000000001e-06 2023-10-08T07:07:37.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.736 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.736 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.736 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138694 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.736 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.652527+0000", 2023-10-08T07:07:37.736 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0071733760000000004, 2023-10-08T07:07:37.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076621830000000004, 2023-10-08T07:07:37.736 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.736 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.736 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.736 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.737 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.737 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138694 2023-10-08T07:07:37.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.737 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652527+0000", 2023-10-08T07:07:37.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652527+0000", 2023-10-08T07:07:37.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652527+0000", 2023-10-08T07:07:37.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8999999999999997e-07 2023-10-08T07:07:37.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652541+0000", 2023-10-08T07:07:37.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3909e-05 2023-10-08T07:07:37.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652549+0000", 2023-10-08T07:07:37.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3520000000000001e-06 2023-10-08T07:07:37.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652554+0000", 2023-10-08T07:07:37.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.383e-06 2023-10-08T07:07:37.739 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.740 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.740 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.740 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135807 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.740 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.439370+0000", 2023-10-08T07:07:37.740 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.220330294, 2023-10-08T07:07:37.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2208827849999999, 2023-10-08T07:07:37.740 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.740 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.740 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.741 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.741 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.741 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135807 2023-10-08T07:07:37.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.741 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.439370+0000", 2023-10-08T07:07:37.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.439370+0000", 2023-10-08T07:07:37.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.439370+0000", 2023-10-08T07:07:37.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5600000000000001e-07 2023-10-08T07:07:37.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.439389+0000", 2023-10-08T07:07:37.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8743e-05 2023-10-08T07:07:37.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.439394+0000", 2023-10-08T07:07:37.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5739999999999997e-06 2023-10-08T07:07:37.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.439397+0000", 2023-10-08T07:07:37.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2090000000000001e-06 2023-10-08T07:07:37.743 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.744 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.744 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.744 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136272 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.744 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.622341+0000", 2023-10-08T07:07:37.744 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.037359659, 2023-10-08T07:07:37.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.037974468, 2023-10-08T07:07:37.744 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.744 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.744 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.744 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.745 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.745 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136272 2023-10-08T07:07:37.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.745 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.622341+0000", 2023-10-08T07:07:37.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.622341+0000", 2023-10-08T07:07:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.622341+0000", 2023-10-08T07:07:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2023-10-08T07:07:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.622350+0000", 2023-10-08T07:07:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2459999999999992e-06 2023-10-08T07:07:37.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.622356+0000", 2023-10-08T07:07:37.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3959999999999997e-06 2023-10-08T07:07:37.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.622359+0000", 2023-10-08T07:07:37.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7390000000000001e-06 2023-10-08T07:07:37.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.747 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.748 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.748 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136947 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.748 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.903784+0000", 2023-10-08T07:07:37.748 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.755916225, 2023-10-08T07:07:37.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.75657809799999998, 2023-10-08T07:07:37.748 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.748 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.748 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.748 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.748 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.749 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136947 2023-10-08T07:07:37.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.749 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.903784+0000", 2023-10-08T07:07:37.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.903784+0000", 2023-10-08T07:07:37.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.903785+0000", 2023-10-08T07:07:37.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.89e-07 2023-10-08T07:07:37.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.903796+0000", 2023-10-08T07:07:37.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1228e-05 2023-10-08T07:07:37.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.903802+0000", 2023-10-08T07:07:37.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4849999999999997e-06 2023-10-08T07:07:37.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.903808+0000", 2023-10-08T07:07:37.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1659999999999999e-06 2023-10-08T07:07:37.751 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.751 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.751 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.752 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137450 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.752 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.090374+0000", 2023-10-08T07:07:37.752 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.56932601599999999, 2023-10-08T07:07:37.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.57006246599999999, 2023-10-08T07:07:37.752 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.752 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.752 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137450 2023-10-08T07:07:37.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.753 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.090374+0000", 2023-10-08T07:07:37.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.090374+0000", 2023-10-08T07:07:37.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.090375+0000", 2023-10-08T07:07:37.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2300000000000001e-07 2023-10-08T07:07:37.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.090395+0000", 2023-10-08T07:07:37.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9896000000000001e-05 2023-10-08T07:07:37.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.090402+0000", 2023-10-08T07:07:37.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0489999999999998e-06 2023-10-08T07:07:37.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.090407+0000", 2023-10-08T07:07:37.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5439999999999998e-06 2023-10-08T07:07:37.755 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.755 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.755 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.756 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137492 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.756 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.100347+0000", 2023-10-08T07:07:37.756 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55935321999999998, 2023-10-08T07:07:37.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56015778199999999, 2023-10-08T07:07:37.756 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.756 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.756 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137492 2023-10-08T07:07:37.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.756 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.100347+0000", 2023-10-08T07:07:37.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.100347+0000", 2023-10-08T07:07:37.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.102295+0000", 2023-10-08T07:07:37.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00194772 2023-10-08T07:07:37.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.102315+0000", 2023-10-08T07:07:37.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0075999999999999e-05 2023-10-08T07:07:37.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.102335+0000", 2023-10-08T07:07:37.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9817e-05 2023-10-08T07:07:37.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.102342+0000", 2023-10-08T07:07:37.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.311e-06 2023-10-08T07:07:37.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.759 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.759 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138316 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.760 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.467353+0000", 2023-10-08T07:07:37.760 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.19234741799999999, 2023-10-08T07:07:37.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.193220275, 2023-10-08T07:07:37.760 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.760 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.760 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138316 2023-10-08T07:07:37.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.760 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.467353+0000", 2023-10-08T07:07:37.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.467353+0000", 2023-10-08T07:07:37.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.467353+0000", 2023-10-08T07:07:37.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2023-10-08T07:07:37.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.467368+0000", 2023-10-08T07:07:37.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4589999999999999e-05 2023-10-08T07:07:37.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.467373+0000", 2023-10-08T07:07:37.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3859999999999998e-06 2023-10-08T07:07:37.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.467377+0000", 2023-10-08T07:07:37.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8940000000000003e-06 2023-10-08T07:07:37.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.763 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.763 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138345 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.763 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.480400+0000", 2023-10-08T07:07:37.764 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.17930058199999999, 2023-10-08T07:07:37.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18022660800000001, 2023-10-08T07:07:37.764 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.764 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.764 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138345 2023-10-08T07:07:37.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.764 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.480400+0000", 2023-10-08T07:07:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.480400+0000", 2023-10-08T07:07:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.482788+0000", 2023-10-08T07:07:37.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023880379999999999 2023-10-08T07:07:37.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.482805+0000", 2023-10-08T07:07:37.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7263000000000001e-05 2023-10-08T07:07:37.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.482814+0000", 2023-10-08T07:07:37.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.952e-06 2023-10-08T07:07:37.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.482821+0000", 2023-10-08T07:07:37.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2880000000000004e-06 2023-10-08T07:07:37.767 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.767 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.767 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.767 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138632 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.767 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.621565+0000", 2023-10-08T07:07:37.767 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.038135123, 2023-10-08T07:07:37.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039112633000000001, 2023-10-08T07:07:37.768 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.768 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.768 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138632 2023-10-08T07:07:37.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.768 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621565+0000", 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621565+0000", 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621566+0000", 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7800000000000002e-07 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621578+0000", 2023-10-08T07:07:37.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2547e-05 2023-10-08T07:07:37.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621585+0000", 2023-10-08T07:07:37.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2089999999999999e-06 2023-10-08T07:07:37.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621591+0000", 2023-10-08T07:07:37.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5949999999999998e-06 2023-10-08T07:07:37.771 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.771 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.771 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.771 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144571 4.20 e61/17 4:05b3915c:::10000000004.00000016:head v 61'6823, mlcod=61'6818)", 2023-10-08T07:07:37.771 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.638018+0000", 2023-10-08T07:07:37.771 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.021682104000000001, 2023-10-08T07:07:37.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022237725, 2023-10-08T07:07:37.771 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.771 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:37.772 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.638018+0000", 2023-10-08T07:07:37.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.638018+0000", 2023-10-08T07:07:37.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.638018+0000", 2023-10-08T07:07:37.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0899999999999997e-07 2023-10-08T07:07:37.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.638030+0000", 2023-10-08T07:07:37.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1178999999999999e-05 2023-10-08T07:07:37.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.638038+0000", 2023-10-08T07:07:37.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2199999999999992e-06 2023-10-08T07:07:37.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.638043+0000", 2023-10-08T07:07:37.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8459999999999999e-06 2023-10-08T07:07:37.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.638792+0000", 2023-10-08T07:07:37.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000749455 2023-10-08T07:07:37.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.638810+0000", 2023-10-08T07:07:37.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7805e-05 2023-10-08T07:07:37.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:37.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.660224+0000", 2023-10-08T07:07:37.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021413973999999999 2023-10-08T07:07:37.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:37.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.660256+0000", 2023-10-08T07:07:37.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1937000000000003e-05 2023-10-08T07:07:37.776 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.776 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.776 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.777 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138695 4.16 4:69eefec8:::10000000004.0000003a:head [write 135168~4096 in=4096b,write 348160~4096 in=4096b,write 516096~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.777 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.652562+0000", 2023-10-08T07:07:37.777 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0071386319999999998, 2023-10-08T07:07:37.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082407969999999994, 2023-10-08T07:07:37.777 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.777 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:37.777 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.777 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.777 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.777 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138695 2023-10-08T07:07:37.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.778 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652562+0000", 2023-10-08T07:07:37.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652562+0000", 2023-10-08T07:07:37.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652562+0000", 2023-10-08T07:07:37.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:07:37.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652575+0000", 2023-10-08T07:07:37.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2492e-05 2023-10-08T07:07:37.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652581+0000", 2023-10-08T07:07:37.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5019999999999998e-06 2023-10-08T07:07:37.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652586+0000", 2023-10-08T07:07:37.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2129999999999999e-06 2023-10-08T07:07:37.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655857+0000", 2023-10-08T07:07:37.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032710700000000001 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655937+0000", 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9325000000000004e-05 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.656082+0000", 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000144826 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.782 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135836 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.782 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.452344+0000", 2023-10-08T07:07:37.782 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2073562609999999, 2023-10-08T07:07:37.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.208529518, 2023-10-08T07:07:37.782 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.782 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.782 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.782 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.782 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.782 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135836 2023-10-08T07:07:37.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.783 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.452344+0000", 2023-10-08T07:07:37.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.452344+0000", 2023-10-08T07:07:37.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.452344+0000", 2023-10-08T07:07:37.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2899999999999999e-07 2023-10-08T07:07:37.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.452354+0000", 2023-10-08T07:07:37.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8549999999999997e-06 2023-10-08T07:07:37.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.452359+0000", 2023-10-08T07:07:37.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.639e-06 2023-10-08T07:07:37.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.452362+0000", 2023-10-08T07:07:37.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.242e-06 2023-10-08T07:07:37.785 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.785 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.785 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.786 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136158 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.786 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.584497+0000", 2023-10-08T07:07:37.786 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0752037480000001, 2023-10-08T07:07:37.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0764309439999999, 2023-10-08T07:07:37.786 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.786 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.786 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.786 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.786 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.786 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136158 2023-10-08T07:07:37.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.786 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.584497+0000", 2023-10-08T07:07:37.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.584497+0000", 2023-10-08T07:07:37.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.584497+0000", 2023-10-08T07:07:37.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1799999999999995e-07 2023-10-08T07:07:37.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.584510+0000", 2023-10-08T07:07:37.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2911000000000001e-05 2023-10-08T07:07:37.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.584516+0000", 2023-10-08T07:07:37.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4139999999999999e-06 2023-10-08T07:07:37.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.584522+0000", 2023-10-08T07:07:37.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1660000000000002e-06 2023-10-08T07:07:37.789 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.789 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.789 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.789 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137207 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.790 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.007656+0000", 2023-10-08T07:07:37.790 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.65204412899999997, 2023-10-08T07:07:37.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65333790999999997, 2023-10-08T07:07:37.790 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.790 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.790 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.790 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.790 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.790 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137207 2023-10-08T07:07:37.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.790 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.007656+0000", 2023-10-08T07:07:37.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.007656+0000", 2023-10-08T07:07:37.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.007657+0000", 2023-10-08T07:07:37.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5099999999999999e-07 2023-10-08T07:07:37.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.007670+0000", 2023-10-08T07:07:37.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3037000000000001e-05 2023-10-08T07:07:37.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.007677+0000", 2023-10-08T07:07:37.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4699999999999996e-06 2023-10-08T07:07:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.007683+0000", 2023-10-08T07:07:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5990000000000001e-06 2023-10-08T07:07:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137493 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.793 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.102355+0000", 2023-10-08T07:07:37.794 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55734556000000002, 2023-10-08T07:07:37.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.55870351699999998, 2023-10-08T07:07:37.794 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.794 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.794 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137493 2023-10-08T07:07:37.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.794 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.102355+0000", 2023-10-08T07:07:37.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.102355+0000", 2023-10-08T07:07:37.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.104295+0000", 2023-10-08T07:07:37.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001940244 2023-10-08T07:07:37.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.104310+0000", 2023-10-08T07:07:37.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2023-10-08T07:07:37.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.104322+0000", 2023-10-08T07:07:37.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2418999999999999e-05 2023-10-08T07:07:37.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.104327+0000", 2023-10-08T07:07:37.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2140000000000004e-06 2023-10-08T07:07:37.797 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.797 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.797 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.797 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137700 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.797 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.196388+0000", 2023-10-08T07:07:37.797 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.463311996, 2023-10-08T07:07:37.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46472192800000001, 2023-10-08T07:07:37.798 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.798 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.798 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.798 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.798 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.798 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137700 2023-10-08T07:07:37.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.798 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.196388+0000", 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.196388+0000", 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.200297+0000", 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039086260000000001 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.200313+0000", 2023-10-08T07:07:37.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6266e-05 2023-10-08T07:07:37.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.200324+0000", 2023-10-08T07:07:37.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0849999999999999e-05 2023-10-08T07:07:37.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.200332+0000", 2023-10-08T07:07:37.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0839999999999992e-06 2023-10-08T07:07:37.801 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.801 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.801 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.801 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137953 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.801 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.324641+0000", 2023-10-08T07:07:37.801 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.33505909900000003, 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.336520606, 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137953 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.324641+0000", 2023-10-08T07:07:37.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.324641+0000", 2023-10-08T07:07:37.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.326294+0000", 2023-10-08T07:07:37.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653112 2023-10-08T07:07:37.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.326312+0000", 2023-10-08T07:07:37.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7278999999999998e-05 2023-10-08T07:07:37.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.326324+0000", 2023-10-08T07:07:37.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2434e-05 2023-10-08T07:07:37.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.326331+0000", 2023-10-08T07:07:37.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3969999999999997e-06 2023-10-08T07:07:37.805 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.805 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.805 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.805 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138125 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.805 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.393979+0000", 2023-10-08T07:07:37.805 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26572141999999999, 2023-10-08T07:07:37.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.26723456699999998, 2023-10-08T07:07:37.805 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.806 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.806 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.806 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.806 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.806 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138125 2023-10-08T07:07:37.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.806 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.393979+0000", 2023-10-08T07:07:37.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.393979+0000", 2023-10-08T07:07:37.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.393979+0000", 2023-10-08T07:07:37.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7599999999999998e-07 2023-10-08T07:07:37.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.393993+0000", 2023-10-08T07:07:37.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3664e-05 2023-10-08T07:07:37.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.393999+0000", 2023-10-08T07:07:37.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2023-10-08T07:07:37.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.394003+0000", 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6500000000000004e-06 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144582 4.c e61/17 4:31e28161:::10000000004.00000011:head v 61'4567, mlcod=61'4564)", 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.640778+0000", 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018922680000000001, 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020488747000000002, 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.809 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:37.810 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640778+0000", 2023-10-08T07:07:37.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640778+0000", 2023-10-08T07:07:37.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640778+0000", 2023-10-08T07:07:37.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2099999999999996e-07 2023-10-08T07:07:37.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640795+0000", 2023-10-08T07:07:37.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7280999999999999e-05 2023-10-08T07:07:37.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640807+0000", 2023-10-08T07:07:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1287000000000001e-05 2023-10-08T07:07:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640814+0000", 2023-10-08T07:07:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8079999999999999e-06 2023-10-08T07:07:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640937+0000", 2023-10-08T07:07:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012314800000000001 2023-10-08T07:07:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640956+0000", 2023-10-08T07:07:37.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9182999999999999e-05 2023-10-08T07:07:37.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.813 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.813 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144628 4.1b e61/17)", 2023-10-08T07:07:37.813 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.654016+0000", 2023-10-08T07:07:37.813 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0056844119999999998, 2023-10-08T07:07:37.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073131100000000003, 2023-10-08T07:07:37.814 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.814 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.814 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654016+0000", 2023-10-08T07:07:37.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654016+0000", 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654017+0000", 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1800000000000005e-07 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654032+0000", 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5818999999999999e-05 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654042+0000", 2023-10-08T07:07:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4930000000000004e-06 2023-10-08T07:07:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654048+0000", 2023-10-08T07:07:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3130000000000004e-06 2023-10-08T07:07:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.817 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135772 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.817 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.426529+0000", 2023-10-08T07:07:37.817 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.233171738, 2023-10-08T07:07:37.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2348484799999999, 2023-10-08T07:07:37.817 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.817 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.817 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135772 2023-10-08T07:07:37.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.426529+0000", 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.426529+0000", 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.426529+0000", 2023-10-08T07:07:37.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.84e-07 2023-10-08T07:07:37.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.426540+0000", 2023-10-08T07:07:37.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1199999999999999e-05 2023-10-08T07:07:37.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.426547+0000", 2023-10-08T07:07:37.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6730000000000003e-06 2023-10-08T07:07:37.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.426552+0000", 2023-10-08T07:07:37.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.57e-06 2023-10-08T07:07:37.820 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.820 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.820 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.820 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135941 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.820 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.489598+0000", 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1701027070000001, 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1718334910000001, 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135941 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489598+0000", 2023-10-08T07:07:37.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489598+0000", 2023-10-08T07:07:37.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489598+0000", 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2500000000000001e-07 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489610+0000", 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1925e-05 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489617+0000", 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6560000000000003e-06 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489621+0000", 2023-10-08T07:07:37.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9130000000000002e-06 2023-10-08T07:07:37.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.824 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.824 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136227 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.824 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.611422+0000", 2023-10-08T07:07:37.824 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0482784270000001, 2023-10-08T07:07:37.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.050072213, 2023-10-08T07:07:37.825 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.825 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.825 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.825 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.825 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.825 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136227 2023-10-08T07:07:37.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.825 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.611422+0000", 2023-10-08T07:07:37.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.611422+0000", 2023-10-08T07:07:37.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.611422+0000", 2023-10-08T07:07:37.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2023-10-08T07:07:37.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.611435+0000", 2023-10-08T07:07:37.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2595000000000001e-05 2023-10-08T07:07:37.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.611442+0000", 2023-10-08T07:07:37.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1380000000000001e-06 2023-10-08T07:07:37.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.611448+0000", 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5049999999999998e-06 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137029 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.929596+0000", 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.73010447499999998, 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.731977459, 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.829 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.829 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.829 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137029 2023-10-08T07:07:37.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.829 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.929596+0000", 2023-10-08T07:07:37.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.929596+0000", 2023-10-08T07:07:37.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.931296+0000", 2023-10-08T07:07:37.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001700158 2023-10-08T07:07:37.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.931324+0000", 2023-10-08T07:07:37.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7654999999999999e-05 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.931334+0000", 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0831e-05 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.931342+0000", 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.832 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137494 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.832 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.104337+0000", 2023-10-08T07:07:37.832 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.555363147, 2023-10-08T07:07:37.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.55729170900000002, 2023-10-08T07:07:37.832 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.832 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.832 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137494 2023-10-08T07:07:37.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.833 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.104337+0000", 2023-10-08T07:07:37.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.104337+0000", 2023-10-08T07:07:37.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.104337+0000", 2023-10-08T07:07:37.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2099999999999998e-07 2023-10-08T07:07:37.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.104351+0000", 2023-10-08T07:07:37.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3393999999999999e-05 2023-10-08T07:07:37.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.104357+0000", 2023-10-08T07:07:37.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1920000000000002e-06 2023-10-08T07:07:37.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.104360+0000", 2023-10-08T07:07:37.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.269e-06 2023-10-08T07:07:37.835 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.835 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.835 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.836 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137652 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.836 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.170348+0000", 2023-10-08T07:07:37.836 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48935242899999998, 2023-10-08T07:07:37.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.49133742400000002, 2023-10-08T07:07:37.836 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.836 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.836 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.836 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.836 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.836 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137652 2023-10-08T07:07:37.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.836 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.170348+0000", 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.170348+0000", 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.170348+0000", 2023-10-08T07:07:37.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2900000000000004e-07 2023-10-08T07:07:37.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.170362+0000", 2023-10-08T07:07:37.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.411e-05 2023-10-08T07:07:37.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.170370+0000", 2023-10-08T07:07:37.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6939999999999995e-06 2023-10-08T07:07:37.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.170376+0000", 2023-10-08T07:07:37.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0759999999999999e-06 2023-10-08T07:07:37.839 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.839 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.839 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.839 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138536 4.b 4.789930b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.840 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.570353+0000", 2023-10-08T07:07:37.840 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.089346841999999996, 2023-10-08T07:07:37.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.091387795999999993, 2023-10-08T07:07:37.840 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.841 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.842 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.842 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138536 2023-10-08T07:07:37.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.842 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.570353+0000", 2023-10-08T07:07:37.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.570353+0000", 2023-10-08T07:07:37.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.574299+0000", 2023-10-08T07:07:37.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039452890000000003 2023-10-08T07:07:37.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.574314+0000", 2023-10-08T07:07:37.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5778999999999999e-05 2023-10-08T07:07:37.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.574326+0000", 2023-10-08T07:07:37.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1942e-05 2023-10-08T07:07:37.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.574333+0000", 2023-10-08T07:07:37.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9999999999999999e-06 2023-10-08T07:07:37.845 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.845 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.845 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.845 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144566 4.2b e61/17)", 2023-10-08T07:07:37.845 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.640857+0000", 2023-10-08T07:07:37.845 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018843707000000001, 2023-10-08T07:07:37.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020934364, 2023-10-08T07:07:37.846 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.846 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.846 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640857+0000", 2023-10-08T07:07:37.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640857+0000", 2023-10-08T07:07:37.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640857+0000", 2023-10-08T07:07:37.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.84e-07 2023-10-08T07:07:37.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640870+0000", 2023-10-08T07:07:37.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2574e-05 2023-10-08T07:07:37.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640876+0000", 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.878e-06 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640881+0000", 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9200000000000003e-06 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.849 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138696 4.29 4:94216392:::10000000004.0000002b:head [write 2240512~4096 in=4096b,write 2297856~4096 in=4096b,write 2527232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.849 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.652593+0000", 2023-10-08T07:07:37.849 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0071069230000000002, 2023-10-08T07:07:37.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092499309999999994, 2023-10-08T07:07:37.849 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.849 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:37.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.849 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138696 2023-10-08T07:07:37.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.850 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652593+0000", 2023-10-08T07:07:37.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652593+0000", 2023-10-08T07:07:37.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654295+0000", 2023-10-08T07:07:37.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017014160000000001 2023-10-08T07:07:37.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654311+0000", 2023-10-08T07:07:37.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6629e-05 2023-10-08T07:07:37.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654321+0000", 2023-10-08T07:07:37.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0000000000000001e-05 2023-10-08T07:07:37.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654329+0000", 2023-10-08T07:07:37.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2980000000000003e-06 2023-10-08T07:07:37.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655162+0000", 2023-10-08T07:07:37.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00083376200000000004 2023-10-08T07:07:37.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655208+0000", 2023-10-08T07:07:37.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5250999999999998e-05 2023-10-08T07:07:37.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:37.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655303+0000", 2023-10-08T07:07:37.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5058999999999999e-05 2023-10-08T07:07:37.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.853 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.854 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.854 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135841 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.854 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.452422+0000", 2023-10-08T07:07:37.854 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2072784000000001, 2023-10-08T07:07:37.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2094908040000001, 2023-10-08T07:07:37.854 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.854 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135841 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.452422+0000", 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.452422+0000", 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.452422+0000", 2023-10-08T07:07:37.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6899999999999997e-07 2023-10-08T07:07:37.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.452435+0000", 2023-10-08T07:07:37.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2162e-05 2023-10-08T07:07:37.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.452441+0000", 2023-10-08T07:07:37.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3409999999999999e-06 2023-10-08T07:07:37.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.452446+0000", 2023-10-08T07:07:37.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1699999999999996e-06 2023-10-08T07:07:37.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.857 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.858 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136130 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.858 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.570397+0000", 2023-10-08T07:07:37.858 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0893034340000001, 2023-10-08T07:07:37.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0915671179999999, 2023-10-08T07:07:37.858 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.858 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.859 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136130 2023-10-08T07:07:37.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.859 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.570397+0000", 2023-10-08T07:07:37.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.570397+0000", 2023-10-08T07:07:37.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.572296+0000", 2023-10-08T07:07:37.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001898832 2023-10-08T07:07:37.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.572309+0000", 2023-10-08T07:07:37.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3237e-05 2023-10-08T07:07:37.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.572316+0000", 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4619999999999999e-06 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.572322+0000", 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4369999999999998e-06 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.862 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137454 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.862 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.090494+0000", 2023-10-08T07:07:37.862 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.56920600799999999, 2023-10-08T07:07:37.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.57152193100000004, 2023-10-08T07:07:37.862 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.862 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.862 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137454 2023-10-08T07:07:37.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.090494+0000", 2023-10-08T07:07:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.090494+0000", 2023-10-08T07:07:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.090495+0000", 2023-10-08T07:07:37.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5499999999999998e-07 2023-10-08T07:07:37.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.090512+0000", 2023-10-08T07:07:37.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7686e-05 2023-10-08T07:07:37.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.090519+0000", 2023-10-08T07:07:37.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4710000000000004e-06 2023-10-08T07:07:37.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.090525+0000", 2023-10-08T07:07:37.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2023-10-08T07:07:37.865 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.865 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.865 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.865 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138409 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.866 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.514386+0000", 2023-10-08T07:07:37.866 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14531439800000001, 2023-10-08T07:07:37.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.14768492499999999, 2023-10-08T07:07:37.866 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.866 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.866 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138409 2023-10-08T07:07:37.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.866 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.514386+0000", 2023-10-08T07:07:37.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.514386+0000", 2023-10-08T07:07:37.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.514805+0000", 2023-10-08T07:07:37.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00041925000000000003 2023-10-08T07:07:37.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.514830+0000", 2023-10-08T07:07:37.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4617000000000002e-05 2023-10-08T07:07:37.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.514839+0000", 2023-10-08T07:07:37.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2023-10-08T07:07:37.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.514846+0000", 2023-10-08T07:07:37.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.939e-06 2023-10-08T07:07:37.869 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.869 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.869 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.869 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144590 4.30 e61/17 4:0f322a22:::10000000004.00000014:head v 61'2297, mlcod=61'2295)", 2023-10-08T07:07:37.869 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.642567+0000", 2023-10-08T07:07:37.869 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.017133716, 2023-10-08T07:07:37.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019557696999999999, 2023-10-08T07:07:37.870 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.870 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:37.870 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.642567+0000", 2023-10-08T07:07:37.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.642567+0000", 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.642567+0000", 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2300000000000001e-07 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.642582+0000", 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4989e-05 2023-10-08T07:07:37.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.642591+0000", 2023-10-08T07:07:37.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6780000000000006e-06 2023-10-08T07:07:37.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.642598+0000", 2023-10-08T07:07:37.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.759e-06 2023-10-08T07:07:37.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.645042+0000", 2023-10-08T07:07:37.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024442140000000001 2023-10-08T07:07:37.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.645059+0000", 2023-10-08T07:07:37.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6922000000000002e-05 2023-10-08T07:07:37.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.873 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.873 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.874 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144626 4.3a e61/17 4:5d52ad5e:::10000000004.00000026:head v 61'6626, mlcod=61'6622)", 2023-10-08T07:07:37.874 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.655326+0000", 2023-10-08T07:07:37.874 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.004373821, 2023-10-08T07:07:37.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068547779999999997, 2023-10-08T07:07:37.874 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.874 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:37.874 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655326+0000", 2023-10-08T07:07:37.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655326+0000", 2023-10-08T07:07:37.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655327+0000", 2023-10-08T07:07:37.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4999999999999998e-07 2023-10-08T07:07:37.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655342+0000", 2023-10-08T07:07:37.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5288999999999999e-05 2023-10-08T07:07:37.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655349+0000", 2023-10-08T07:07:37.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5390000000000004e-06 2023-10-08T07:07:37.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655355+0000", 2023-10-08T07:07:37.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6100000000000002e-06 2023-10-08T07:07:37.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655397+0000", 2023-10-08T07:07:37.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2043999999999999e-05 2023-10-08T07:07:37.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655417+0000", 2023-10-08T07:07:37.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9814999999999999e-05 2023-10-08T07:07:37.877 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136912 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.893346+0000", 2023-10-08T07:07:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.766354168, 2023-10-08T07:07:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.76889243399999996, 2023-10-08T07:07:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.879 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136912 2023-10-08T07:07:37.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.879 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.893346+0000", 2023-10-08T07:07:37.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.893346+0000", 2023-10-08T07:07:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.893347+0000", 2023-10-08T07:07:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1500000000000005e-07 2023-10-08T07:07:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.893359+0000", 2023-10-08T07:07:37.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2554e-05 2023-10-08T07:07:37.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.893366+0000", 2023-10-08T07:07:37.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9879999999999998e-06 2023-10-08T07:07:37.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.893372+0000", 2023-10-08T07:07:37.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3909999999999997e-06 2023-10-08T07:07:37.881 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.881 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.882 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137054 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.882 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.937463+0000", 2023-10-08T07:07:37.882 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.72223774299999999, 2023-10-08T07:07:37.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.72483213099999999, 2023-10-08T07:07:37.882 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.882 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.883 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137054 2023-10-08T07:07:37.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.883 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.937463+0000", 2023-10-08T07:07:37.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.937463+0000", 2023-10-08T07:07:37.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.941295+0000", 2023-10-08T07:07:37.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038323699999999999 2023-10-08T07:07:37.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.941309+0000", 2023-10-08T07:07:37.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4578e-05 2023-10-08T07:07:37.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.941320+0000", 2023-10-08T07:07:37.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0463e-05 2023-10-08T07:07:37.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.941325+0000", 2023-10-08T07:07:37.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5489999999999997e-06 2023-10-08T07:07:37.885 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.885 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.885 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137701 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.200345+0000", 2023-10-08T07:07:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.459355138, 2023-10-08T07:07:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46200338600000002, 2023-10-08T07:07:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137701 2023-10-08T07:07:37.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.887 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.200345+0000", 2023-10-08T07:07:37.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.200345+0000", 2023-10-08T07:07:37.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.202294+0000", 2023-10-08T07:07:37.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019484599999999999 2023-10-08T07:07:37.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.202311+0000", 2023-10-08T07:07:37.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7744000000000002e-05 2023-10-08T07:07:37.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.202327+0000", 2023-10-08T07:07:37.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5865000000000001e-05 2023-10-08T07:07:37.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.202335+0000", 2023-10-08T07:07:37.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:07:37.889 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.889 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.889 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.889 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138350 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.890 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.483001+0000", 2023-10-08T07:07:37.890 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.17669900099999999, 2023-10-08T07:07:37.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17939930000000001, 2023-10-08T07:07:37.890 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.890 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.890 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138350 2023-10-08T07:07:37.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.890 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.483001+0000", 2023-10-08T07:07:37.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.483001+0000", 2023-10-08T07:07:37.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.483002+0000", 2023-10-08T07:07:37.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:07:37.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.483014+0000", 2023-10-08T07:07:37.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2515e-05 2023-10-08T07:07:37.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.483022+0000", 2023-10-08T07:07:37.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5569999999999998e-06 2023-10-08T07:07:37.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.483028+0000", 2023-10-08T07:07:37.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2990000000000002e-06 2023-10-08T07:07:37.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.893 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.893 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138500 4.b 4.789930b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.893 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.557460+0000", 2023-10-08T07:07:37.894 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.10223987, 2023-10-08T07:07:37.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.10499314899999999, 2023-10-08T07:07:37.894 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.894 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.894 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138500 2023-10-08T07:07:37.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.894 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.557460+0000", 2023-10-08T07:07:37.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.557460+0000", 2023-10-08T07:07:37.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.563296+0000", 2023-10-08T07:07:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058356550000000004 2023-10-08T07:07:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.563313+0000", 2023-10-08T07:07:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.647e-05 2023-10-08T07:07:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.563321+0000", 2023-10-08T07:07:37.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3850000000000002e-06 2023-10-08T07:07:37.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.563326+0000", 2023-10-08T07:07:37.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.147e-06 2023-10-08T07:07:37.897 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.897 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.897 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.897 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144511 4.1b e61/17 4:dbb7dde6:::10000000004.0000002c:head v 61'4558, mlcod=61'4552)", 2023-10-08T07:07:37.898 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.622390+0000", 2023-10-08T07:07:37.898 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.037310097, 2023-10-08T07:07:37.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040117675999999998, 2023-10-08T07:07:37.898 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.898 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:37.898 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.622390+0000", 2023-10-08T07:07:37.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.622390+0000", 2023-10-08T07:07:37.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.622390+0000", 2023-10-08T07:07:37.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9799999999999999e-07 2023-10-08T07:07:37.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.622403+0000", 2023-10-08T07:07:37.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2541000000000001e-05 2023-10-08T07:07:37.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.622410+0000", 2023-10-08T07:07:37.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8580000000000002e-06 2023-10-08T07:07:37.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.622415+0000", 2023-10-08T07:07:37.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0710000000000002e-06 2023-10-08T07:07:37.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.632219+0000", 2023-10-08T07:07:37.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0098041840000000005 2023-10-08T07:07:37.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.632237+0000", 2023-10-08T07:07:37.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7788999999999999e-05 2023-10-08T07:07:37.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.902 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.902 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144593 4.20 e61/17 4:04004f2c:::10000000004.0000000d:head v 61'6824, mlcod=61'6818)", 2023-10-08T07:07:37.902 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.643320+0000", 2023-10-08T07:07:37.902 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016380077999999999, 2023-10-08T07:07:37.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019250478000000001, 2023-10-08T07:07:37.902 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.902 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:37.903 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643320+0000", 2023-10-08T07:07:37.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643320+0000", 2023-10-08T07:07:37.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643321+0000", 2023-10-08T07:07:37.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3300000000000002e-07 2023-10-08T07:07:37.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643331+0000", 2023-10-08T07:07:37.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0298e-05 2023-10-08T07:07:37.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643339+0000", 2023-10-08T07:07:37.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3680000000000002e-06 2023-10-08T07:07:37.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643345+0000", 2023-10-08T07:07:37.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2780000000000001e-06 2023-10-08T07:07:37.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.650367+0000", 2023-10-08T07:07:37.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070223259999999997 2023-10-08T07:07:37.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.650386+0000", 2023-10-08T07:07:37.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9332999999999999e-05 2023-10-08T07:07:37.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.906 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.906 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144629 4.30 e61/17)", 2023-10-08T07:07:37.906 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.655372+0000", 2023-10-08T07:07:37.906 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0043287389999999999, 2023-10-08T07:07:37.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0072630489999999997, 2023-10-08T07:07:37.907 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.907 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.907 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655372+0000", 2023-10-08T07:07:37.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655372+0000", 2023-10-08T07:07:37.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655372+0000", 2023-10-08T07:07:37.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3799999999999998e-07 2023-10-08T07:07:37.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655384+0000", 2023-10-08T07:07:37.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2421e-05 2023-10-08T07:07:37.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655392+0000", 2023-10-08T07:07:37.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2439999999999996e-06 2023-10-08T07:07:37.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655397+0000", 2023-10-08T07:07:37.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2660000000000001e-06 2023-10-08T07:07:37.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.909 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.910 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.910 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136817 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.910 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.845013+0000", 2023-10-08T07:07:37.910 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.81468752799999999, 2023-10-08T07:07:37.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.81768238100000001, 2023-10-08T07:07:37.910 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.910 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.910 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.910 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136817 2023-10-08T07:07:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.845013+0000", 2023-10-08T07:07:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.845013+0000", 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.845013+0000", 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2800000000000002e-07 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.845031+0000", 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8074e-05 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.845038+0000", 2023-10-08T07:07:37.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9990000000000002e-06 2023-10-08T07:07:37.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.845044+0000", 2023-10-08T07:07:37.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7640000000000002e-06 2023-10-08T07:07:37.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.913 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.914 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137279 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.914 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.029405+0000", 2023-10-08T07:07:37.914 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63029506199999996, 2023-10-08T07:07:37.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.63335396600000005, 2023-10-08T07:07:37.914 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.914 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.914 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137279 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.029405+0000", 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.029405+0000", 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.031307+0000", 2023-10-08T07:07:37.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019019480000000001 2023-10-08T07:07:37.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.031324+0000", 2023-10-08T07:07:37.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6660999999999999e-05 2023-10-08T07:07:37.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.031335+0000", 2023-10-08T07:07:37.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1494999999999999e-05 2023-10-08T07:07:37.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.031342+0000", 2023-10-08T07:07:37.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1579999999999999e-06 2023-10-08T07:07:37.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.917 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.917 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137702 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.918 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.202349+0000", 2023-10-08T07:07:37.918 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.45735168900000001, 2023-10-08T07:07:37.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46047222599999998, 2023-10-08T07:07:37.918 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.918 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.918 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137702 2023-10-08T07:07:37.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.918 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.202349+0000", 2023-10-08T07:07:37.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.202349+0000", 2023-10-08T07:07:37.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.202349+0000", 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9100000000000004e-07 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.202363+0000", 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3599e-05 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.202370+0000", 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9210000000000003e-06 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.202375+0000", 2023-10-08T07:07:37.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4999999999999999e-06 2023-10-08T07:07:37.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.921 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.921 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137882 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.921 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.283529+0000", 2023-10-08T07:07:37.921 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37617157800000001, 2023-10-08T07:07:37.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.37935340299999998, 2023-10-08T07:07:37.922 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.922 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.922 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.922 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.922 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.922 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137882 2023-10-08T07:07:37.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.922 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.283529+0000", 2023-10-08T07:07:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.283529+0000", 2023-10-08T07:07:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.283529+0000", 2023-10-08T07:07:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9499999999999998e-07 2023-10-08T07:07:37.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.283542+0000", 2023-10-08T07:07:37.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3294e-05 2023-10-08T07:07:37.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.283549+0000", 2023-10-08T07:07:37.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3990000000000001e-06 2023-10-08T07:07:37.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.283554+0000", 2023-10-08T07:07:37.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8590000000000004e-06 2023-10-08T07:07:37.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.925 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.925 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137959 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.925 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.326443+0000", 2023-10-08T07:07:37.925 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.33325762799999997, 2023-10-08T07:07:37.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.33650055800000001, 2023-10-08T07:07:37.925 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.926 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.926 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.926 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.926 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.926 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137959 2023-10-08T07:07:37.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.926 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.326443+0000", 2023-10-08T07:07:37.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.326443+0000", 2023-10-08T07:07:37.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.326443+0000", 2023-10-08T07:07:37.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6100000000000002e-07 2023-10-08T07:07:37.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.326452+0000", 2023-10-08T07:07:37.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0929999999999992e-06 2023-10-08T07:07:37.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.326458+0000", 2023-10-08T07:07:37.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4990000000000002e-06 2023-10-08T07:07:37.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.326462+0000", 2023-10-08T07:07:37.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.459e-06 2023-10-08T07:07:37.929 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.929 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.929 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.929 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138021 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.929 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.349367+0000", 2023-10-08T07:07:37.929 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.310333148, 2023-10-08T07:07:37.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.31363644899999998, 2023-10-08T07:07:37.929 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.929 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.929 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.930 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.930 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.930 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138021 2023-10-08T07:07:37.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.930 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.349367+0000", 2023-10-08T07:07:37.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.349367+0000", 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.351294+0000", 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001926978 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.351311+0000", 2023-10-08T07:07:37.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7161000000000001e-05 2023-10-08T07:07:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.351321+0000", 2023-10-08T07:07:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8409999999999995e-06 2023-10-08T07:07:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.351328+0000", 2023-10-08T07:07:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7769999999999997e-06 2023-10-08T07:07:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.932 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.933 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.933 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144513 4.2b e61/17 4:d7a77d67:::10000000004.00000029:head v 61'4549, mlcod=61'4544)", 2023-10-08T07:07:37.933 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.622423+0000", 2023-10-08T07:07:37.933 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.037277179000000001, 2023-10-08T07:07:37.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040640900000000001, 2023-10-08T07:07:37.933 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.933 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:37.933 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.622423+0000", 2023-10-08T07:07:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.622423+0000", 2023-10-08T07:07:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.622423+0000", 2023-10-08T07:07:37.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1199999999999999e-07 2023-10-08T07:07:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.622447+0000", 2023-10-08T07:07:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.366e-05 2023-10-08T07:07:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.622454+0000", 2023-10-08T07:07:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9500000000000004e-06 2023-10-08T07:07:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.622459+0000", 2023-10-08T07:07:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9049999999999996e-06 2023-10-08T07:07:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640306+0000", 2023-10-08T07:07:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017846608 2023-10-08T07:07:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640326+0000", 2023-10-08T07:07:37.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0979999999999999e-05 2023-10-08T07:07:37.937 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.937 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.937 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.937 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144567 4.2b e61/17)", 2023-10-08T07:07:37.937 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.643526+0000", 2023-10-08T07:07:37.937 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016174167999999999, 2023-10-08T07:07:37.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019603194000000001, 2023-10-08T07:07:37.937 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.937 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.938 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643526+0000", 2023-10-08T07:07:37.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643526+0000", 2023-10-08T07:07:37.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643527+0000", 2023-10-08T07:07:37.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9900000000000001e-07 2023-10-08T07:07:37.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643556+0000", 2023-10-08T07:07:37.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9e-05 2023-10-08T07:07:37.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643565+0000", 2023-10-08T07:07:37.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:07:37.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643571+0000", 2023-10-08T07:07:37.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3409999999999999e-06 2023-10-08T07:07:37.940 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.940 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.940 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.940 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144631 4.c e61/17 4:3352c333:::10000000004.00000012:head v 61'4569, mlcod=61'4565)", 2023-10-08T07:07:37.941 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.655405+0000", 2023-10-08T07:07:37.941 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0042954159999999998, 2023-10-08T07:07:37.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077886220000000003, 2023-10-08T07:07:37.941 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.941 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:37.941 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655405+0000", 2023-10-08T07:07:37.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655405+0000", 2023-10-08T07:07:37.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655405+0000", 2023-10-08T07:07:37.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7300000000000002e-07 2023-10-08T07:07:37.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655416+0000", 2023-10-08T07:07:37.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1269e-05 2023-10-08T07:07:37.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655422+0000", 2023-10-08T07:07:37.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2023-10-08T07:07:37.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655427+0000", 2023-10-08T07:07:37.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2023-10-08T07:07:37.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655465+0000", 2023-10-08T07:07:37.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7883000000000003e-05 2023-10-08T07:07:37.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655482+0000", 2023-10-08T07:07:37.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6735000000000002e-05 2023-10-08T07:07:37.945 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.945 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.945 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.945 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136436 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.945 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.702384+0000", 2023-10-08T07:07:37.945 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.95731628499999999, 2023-10-08T07:07:37.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96087154100000005, 2023-10-08T07:07:37.945 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.946 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.946 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.946 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.946 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.946 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136436 2023-10-08T07:07:37.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.946 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.702384+0000", 2023-10-08T07:07:37.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.702384+0000", 2023-10-08T07:07:37.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.704296+0000", 2023-10-08T07:07:37.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001911909 2023-10-08T07:07:37.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.704312+0000", 2023-10-08T07:07:37.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6208000000000001e-05 2023-10-08T07:07:37.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.704322+0000", 2023-10-08T07:07:37.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9199999999999999e-06 2023-10-08T07:07:37.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.704330+0000", 2023-10-08T07:07:37.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.554e-06 2023-10-08T07:07:37.949 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.949 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.949 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.949 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136997 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.949 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.922354+0000", 2023-10-08T07:07:37.949 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.73734671200000002, 2023-10-08T07:07:37.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.74096601600000001, 2023-10-08T07:07:37.949 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.949 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.950 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.950 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.950 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.950 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136997 2023-10-08T07:07:37.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.950 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922354+0000", 2023-10-08T07:07:37.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922354+0000", 2023-10-08T07:07:37.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922354+0000", 2023-10-08T07:07:37.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7199999999999999e-07 2023-10-08T07:07:37.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922367+0000", 2023-10-08T07:07:37.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2726e-05 2023-10-08T07:07:37.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922374+0000", 2023-10-08T07:07:37.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.204e-06 2023-10-08T07:07:37.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922380+0000", 2023-10-08T07:07:37.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0329999999999997e-06 2023-10-08T07:07:37.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137155 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.982348+0000", 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67735215299999996, 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.68103285000000002, 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.954 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137155 2023-10-08T07:07:37.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.954 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982348+0000", 2023-10-08T07:07:37.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982348+0000", 2023-10-08T07:07:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982349+0000", 2023-10-08T07:07:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3300000000000002e-07 2023-10-08T07:07:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982361+0000", 2023-10-08T07:07:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.278e-05 2023-10-08T07:07:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982368+0000", 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6379999999999998e-06 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982373+0000", 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8620000000000002e-06 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.957 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137213 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.957 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.010176+0000", 2023-10-08T07:07:37.957 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64952388000000005, 2023-10-08T07:07:37.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.653262016, 2023-10-08T07:07:37.957 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.957 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.957 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.957 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.957 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.957 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137213 2023-10-08T07:07:37.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.958 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.010176+0000", 2023-10-08T07:07:37.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.010176+0000", 2023-10-08T07:07:37.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.010177+0000", 2023-10-08T07:07:37.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3600000000000003e-07 2023-10-08T07:07:37.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.010195+0000", 2023-10-08T07:07:37.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8037e-05 2023-10-08T07:07:37.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.010202+0000", 2023-10-08T07:07:37.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2590000000000003e-06 2023-10-08T07:07:37.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.010208+0000", 2023-10-08T07:07:37.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1070000000000001e-06 2023-10-08T07:07:37.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.960 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.961 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137324 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.961 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.048033+0000", 2023-10-08T07:07:37.961 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61166680900000003, 2023-10-08T07:07:37.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.615473983, 2023-10-08T07:07:37.961 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.961 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.961 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137324 2023-10-08T07:07:37.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.962 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.048033+0000", 2023-10-08T07:07:37.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.048033+0000", 2023-10-08T07:07:37.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.048034+0000", 2023-10-08T07:07:37.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6499999999999999e-07 2023-10-08T07:07:37.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.048050+0000", 2023-10-08T07:07:37.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5968e-05 2023-10-08T07:07:37.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.048059+0000", 2023-10-08T07:07:37.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5900000000000008e-06 2023-10-08T07:07:37.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.048065+0000", 2023-10-08T07:07:37.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6069999999999996e-06 2023-10-08T07:07:37.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.966 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.966 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138540 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.966 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.574415+0000", 2023-10-08T07:07:37.966 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.085285483999999995, 2023-10-08T07:07:37.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.089144397, 2023-10-08T07:07:37.966 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.966 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.967 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138540 2023-10-08T07:07:37.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.967 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.574415+0000", 2023-10-08T07:07:37.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.574415+0000", 2023-10-08T07:07:37.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.578295+0000", 2023-10-08T07:07:37.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038801740000000001 2023-10-08T07:07:37.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.578314+0000", 2023-10-08T07:07:37.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9321e-05 2023-10-08T07:07:37.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.578325+0000", 2023-10-08T07:07:37.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0728e-05 2023-10-08T07:07:37.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.578333+0000", 2023-10-08T07:07:37.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9249999999999995e-06 2023-10-08T07:07:37.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.969 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.970 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138567 4.3b 4.1fd270fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.970 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.593432+0000", 2023-10-08T07:07:37.970 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.066268582000000006, 2023-10-08T07:07:37.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.070178279999999996, 2023-10-08T07:07:37.970 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.970 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.971 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138567 2023-10-08T07:07:37.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.971 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.593432+0000", 2023-10-08T07:07:37.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.593432+0000", 2023-10-08T07:07:37.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.593432+0000", 2023-10-08T07:07:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:07:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.593449+0000", 2023-10-08T07:07:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6325999999999999e-05 2023-10-08T07:07:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.593456+0000", 2023-10-08T07:07:37.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0330000000000003e-06 2023-10-08T07:07:37.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.593462+0000", 2023-10-08T07:07:37.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2023-10-08T07:07:37.973 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.973 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.973 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.974 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138606 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.974 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.609349+0000", 2023-10-08T07:07:37.974 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.050350760000000001, 2023-10-08T07:07:37.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054312173999999998, 2023-10-08T07:07:37.974 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.974 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.974 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.974 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.974 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.974 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138606 2023-10-08T07:07:37.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.975 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.609349+0000", 2023-10-08T07:07:37.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.609349+0000", 2023-10-08T07:07:37.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.609350+0000", 2023-10-08T07:07:37.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6400000000000002e-07 2023-10-08T07:07:37.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.609366+0000", 2023-10-08T07:07:37.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6393999999999999e-05 2023-10-08T07:07:37.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.609373+0000", 2023-10-08T07:07:37.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0029999999999997e-06 2023-10-08T07:07:37.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.609379+0000", 2023-10-08T07:07:37.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4890000000000003e-06 2023-10-08T07:07:37.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.977 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.978 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138633 4.7 4:e2d089ed:::10000000004.00000033:head [write 3674112~4096 in=4096b,write 4087808~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.978 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.621598+0000", 2023-10-08T07:07:37.978 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.038102508, 2023-10-08T07:07:37.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.042121128000000001, 2023-10-08T07:07:37.978 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.978 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:37.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.978 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138633 2023-10-08T07:07:37.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621598+0000", 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621598+0000", 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.623295+0000", 2023-10-08T07:07:37.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001696784 2023-10-08T07:07:37.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.623310+0000", 2023-10-08T07:07:37.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4976e-05 2023-10-08T07:07:37.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.623318+0000", 2023-10-08T07:07:37.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7900000000000005e-06 2023-10-08T07:07:37.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.623323+0000", 2023-10-08T07:07:37.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0769999999999998e-06 2023-10-08T07:07:37.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:37.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.642257+0000", 2023-10-08T07:07:37.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018933926 2023-10-08T07:07:37.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:37.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.642341+0000", 2023-10-08T07:07:37.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3702000000000006e-05 2023-10-08T07:07:37.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.982 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.982 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144595 4.1b e61/17)", 2023-10-08T07:07:37.982 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.644156+0000", 2023-10-08T07:07:37.982 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.015544186999999999, 2023-10-08T07:07:37.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019622924, 2023-10-08T07:07:37.983 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.983 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644156+0000", 2023-10-08T07:07:37.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644156+0000", 2023-10-08T07:07:37.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644161+0000", 2023-10-08T07:07:37.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9359999999999998e-06 2023-10-08T07:07:37.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644173+0000", 2023-10-08T07:07:37.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2397e-05 2023-10-08T07:07:37.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644183+0000", 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4539999999999996e-06 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644189+0000", 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3419999999999996e-06 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.986 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144632 4.38 e61/46)", 2023-10-08T07:07:37.986 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.655440+0000", 2023-10-08T07:07:37.986 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0042605969999999996, 2023-10-08T07:07:37.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083831429999999992, 2023-10-08T07:07:37.986 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.986 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.986 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655440+0000", 2023-10-08T07:07:37.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655440+0000", 2023-10-08T07:07:37.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655440+0000", 2023-10-08T07:07:37.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8700000000000002e-07 2023-10-08T07:07:37.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655453+0000", 2023-10-08T07:07:37.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3156000000000001e-05 2023-10-08T07:07:37.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655460+0000", 2023-10-08T07:07:37.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8210000000000004e-06 2023-10-08T07:07:37.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655465+0000", 2023-10-08T07:07:37.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9169999999999997e-06 2023-10-08T07:07:37.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.989 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.989 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135778 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.989 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.429346+0000", 2023-10-08T07:07:37.989 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2303545769999999, 2023-10-08T07:07:37.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2345236669999999, 2023-10-08T07:07:37.989 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.989 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.990 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135778 2023-10-08T07:07:37.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.990 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429346+0000", 2023-10-08T07:07:37.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429346+0000", 2023-10-08T07:07:37.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429346+0000", 2023-10-08T07:07:37.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1200000000000003e-07 2023-10-08T07:07:37.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429366+0000", 2023-10-08T07:07:37.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9748000000000001e-05 2023-10-08T07:07:37.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429374+0000", 2023-10-08T07:07:37.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7000000000000008e-06 2023-10-08T07:07:37.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429381+0000", 2023-10-08T07:07:37.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3930000000000002e-06 2023-10-08T07:07:37.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.992 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.993 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136165 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.993 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.588391+0000", 2023-10-08T07:07:37.993 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0713093899999999, 2023-10-08T07:07:37.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0755307059999999, 2023-10-08T07:07:37.993 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.993 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.993 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.993 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.993 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.994 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136165 2023-10-08T07:07:37.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.994 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.588391+0000", 2023-10-08T07:07:37.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.588391+0000", 2023-10-08T07:07:37.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.588391+0000", 2023-10-08T07:07:37.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0499999999999999e-07 2023-10-08T07:07:37.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.588402+0000", 2023-10-08T07:07:37.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0842000000000001e-05 2023-10-08T07:07:37.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.588408+0000", 2023-10-08T07:07:37.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0129999999999999e-06 2023-10-08T07:07:37.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:37.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.588413+0000", 2023-10-08T07:07:37.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.639e-06 2023-10-08T07:07:37.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.996 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:37.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:37.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137675 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.188395+0000", 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47130487199999999, 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47557803500000001, 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137675 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.997 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:37.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:37.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.188395+0000", 2023-10-08T07:07:37.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:37.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.188395+0000", 2023-10-08T07:07:37.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:37.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.188396+0000", 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3399999999999999e-07 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.188411+0000", 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5000999999999999e-05 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.188419+0000", 2023-10-08T07:07:37.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8329999999999994e-06 2023-10-08T07:07:38.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.188425+0000", 2023-10-08T07:07:38.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7049999999999996e-06 2023-10-08T07:07:38.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.000 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.000 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137733 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.000 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.215410+0000", 2023-10-08T07:07:38.001 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.444290346, 2023-10-08T07:07:38.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44861539499999997, 2023-10-08T07:07:38.001 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.001 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.001 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137733 2023-10-08T07:07:38.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.001 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.215410+0000", 2023-10-08T07:07:38.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.215410+0000", 2023-10-08T07:07:38.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.215410+0000", 2023-10-08T07:07:38.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3499999999999996e-07 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.215424+0000", 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3448999999999999e-05 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.215431+0000", 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9999999999999999e-06 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.215436+0000", 2023-10-08T07:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3770000000000004e-06 2023-10-08T07:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138161 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.406353+0000", 2023-10-08T07:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.25334726800000001, 2023-10-08T07:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.25772393300000002, 2023-10-08T07:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138161 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.406353+0000", 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.406353+0000", 2023-10-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.410295+0000", 2023-10-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039416090000000004 2023-10-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.410310+0000", 2023-10-08T07:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5386000000000001e-05 2023-10-08T07:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.410320+0000", 2023-10-08T07:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0358e-05 2023-10-08T07:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.410327+0000", 2023-10-08T07:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8009999999999998e-06 2023-10-08T07:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138352 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.483070+0000", 2023-10-08T07:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.176629974, 2023-10-08T07:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.181058211, 2023-10-08T07:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138352 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.483070+0000", 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.483070+0000", 2023-10-08T07:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.484297+0000", 2023-10-08T07:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001226258 2023-10-08T07:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.484313+0000", 2023-10-08T07:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6812000000000001e-05 2023-10-08T07:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.484323+0000", 2023-10-08T07:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9860000000000006e-06 2023-10-08T07:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.484331+0000", 2023-10-08T07:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6750000000000002e-06 2023-10-08T07:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144531 4.1b e61/17 4:dbb7dde6:::10000000004.0000002c:head v 61'4559, mlcod=61'4552)", 2023-10-08T07:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.625471+0000", 2023-10-08T07:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.034229333000000001, 2023-10-08T07:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038711043000000001, 2023-10-08T07:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.625471+0000", 2023-10-08T07:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.625471+0000", 2023-10-08T07:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.625471+0000", 2023-10-08T07:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.58e-07 2023-10-08T07:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.625481+0000", 2023-10-08T07:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6139999999999998e-06 2023-10-08T07:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.625487+0000", 2023-10-08T07:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3659999999999997e-06 2023-10-08T07:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.625491+0000", 2023-10-08T07:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9929999999999997e-06 2023-10-08T07:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640272+0000", 2023-10-08T07:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014780678 2023-10-08T07:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.640298+0000", 2023-10-08T07:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6495e-05 2023-10-08T07:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144596 4.2c e61/17 4:352c144c:::10000000004.00000003:head v 61'2266, mlcod=61'2264)", 2023-10-08T07:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.644314+0000", 2023-10-08T07:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.015386211, 2023-10-08T07:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019924971, 2023-10-08T07:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644314+0000", 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644314+0000", 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644315+0000", 2023-10-08T07:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4700000000000001e-07 2023-10-08T07:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644327+0000", 2023-10-08T07:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2723e-05 2023-10-08T07:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644336+0000", 2023-10-08T07:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2400000000000007e-06 2023-10-08T07:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644342+0000", 2023-10-08T07:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4060000000000002e-06 2023-10-08T07:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644389+0000", 2023-10-08T07:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6598999999999999e-05 2023-10-08T07:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644406+0000", 2023-10-08T07:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7274000000000001e-05 2023-10-08T07:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136167 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.588420+0000", 2023-10-08T07:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0712800200000001, 2023-10-08T07:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0758841690000001, 2023-10-08T07:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136167 2023-10-08T07:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.588420+0000", 2023-10-08T07:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.588420+0000", 2023-10-08T07:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.588421+0000", 2023-10-08T07:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4099999999999999e-07 2023-10-08T07:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.588438+0000", 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7333000000000002e-05 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.588444+0000", 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9510000000000003e-06 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.588449+0000", 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8620000000000002e-06 2023-10-08T07:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136232 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.614468+0000", 2023-10-08T07:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.04523195, 2023-10-08T07:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0498888769999999, 2023-10-08T07:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136232 2023-10-08T07:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.614468+0000", 2023-10-08T07:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.614468+0000", 2023-10-08T07:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.614469+0000", 2023-10-08T07:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2023-10-08T07:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.614482+0000", 2023-10-08T07:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3242e-05 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.614489+0000", 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.861e-06 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.614494+0000", 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8670000000000002e-06 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136726 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.822457+0000", 2023-10-08T07:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.83724314399999999, 2023-10-08T07:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84195227100000003, 2023-10-08T07:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136726 2023-10-08T07:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.822457+0000", 2023-10-08T07:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.822457+0000", 2023-10-08T07:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.826297+0000", 2023-10-08T07:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038396390000000002 2023-10-08T07:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.826313+0000", 2023-10-08T07:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6405e-05 2023-10-08T07:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.826330+0000", 2023-10-08T07:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7244e-05 2023-10-08T07:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.826338+0000", 2023-10-08T07:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4719999999999998e-06 2023-10-08T07:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137284 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.031419+0000", 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.62828093900000004, 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.63304298000000003, 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137284 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.031419+0000", 2023-10-08T07:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.031419+0000", 2023-10-08T07:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.031420+0000", 2023-10-08T07:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.84e-07 2023-10-08T07:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.031431+0000", 2023-10-08T07:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1640999999999999e-05 2023-10-08T07:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.031437+0000", 2023-10-08T07:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9750000000000004e-06 2023-10-08T07:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.031442+0000", 2023-10-08T07:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6149999999999999e-06 2023-10-08T07:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137654 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.172349+0000", 2023-10-08T07:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48735118700000002, 2023-10-08T07:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.492165515, 2023-10-08T07:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137654 2023-10-08T07:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.172349+0000", 2023-10-08T07:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.172349+0000", 2023-10-08T07:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.174294+0000", 2023-10-08T07:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00194451 2023-10-08T07:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.174309+0000", 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5407999999999999e-05 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.174320+0000", 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0702e-05 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.174327+0000", 2023-10-08T07:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1300000000000003e-06 2023-10-08T07:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137833 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.257426+0000", 2023-10-08T07:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.402274301, 2023-10-08T07:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40714143200000003, 2023-10-08T07:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137833 2023-10-08T07:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.257426+0000", 2023-10-08T07:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.257426+0000", 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.259296+0000", 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001869721 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.259309+0000", 2023-10-08T07:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3798000000000001e-05 2023-10-08T07:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.259319+0000", 2023-10-08T07:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2023-10-08T07:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.259325+0000", 2023-10-08T07:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4859999999999997e-06 2023-10-08T07:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144583 4.c e61/17 4:3352c333:::10000000004.00000012:head v 61'4568, mlcod=61'4564)", 2023-10-08T07:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.644358+0000", 2023-10-08T07:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.015342451999999999, 2023-10-08T07:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020263797, 2023-10-08T07:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644358+0000", 2023-10-08T07:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644358+0000", 2023-10-08T07:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644358+0000", 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3999999999999997e-07 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644369+0000", 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1185999999999999e-05 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644375+0000", 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0809999999999999e-06 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644380+0000", 2023-10-08T07:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6519999999999997e-06 2023-10-08T07:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644435+0000", 2023-10-08T07:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.452e-05 2023-10-08T07:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.644452+0000", 2023-10-08T07:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7198999999999999e-05 2023-10-08T07:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144635 4.30 e61/17)", 2023-10-08T07:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.657026+0000", 2023-10-08T07:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0026745380000000002, 2023-10-08T07:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076514440000000003, 2023-10-08T07:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657026+0000", 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657026+0000", 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657026+0000", 2023-10-08T07:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657041+0000", 2023-10-08T07:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4459e-05 2023-10-08T07:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657050+0000", 2023-10-08T07:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5809999999999997e-06 2023-10-08T07:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657057+0000", 2023-10-08T07:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4830000000000002e-06 2023-10-08T07:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135989 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.511428+0000", 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1482719139999999, 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1532979809999999, 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135989 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.511428+0000", 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.511428+0000", 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.511429+0000", 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7199999999999999e-07 2023-10-08T07:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.511446+0000", 2023-10-08T07:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6915e-05 2023-10-08T07:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.511453+0000", 2023-10-08T07:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.092e-06 2023-10-08T07:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.511458+0000", 2023-10-08T07:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3279999999999996e-06 2023-10-08T07:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137163 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.982452+0000", 2023-10-08T07:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67724873500000005, 2023-10-08T07:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.68232809900000002, 2023-10-08T07:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137163 2023-10-08T07:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982452+0000", 2023-10-08T07:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982452+0000", 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982452+0000", 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982468+0000", 2023-10-08T07:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6585000000000001e-05 2023-10-08T07:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982475+0000", 2023-10-08T07:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0090000000000001e-06 2023-10-08T07:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982480+0000", 2023-10-08T07:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7589999999999997e-06 2023-10-08T07:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137834 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.259336+0000", 2023-10-08T07:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.40036416699999999, 2023-10-08T07:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40549619799999997, 2023-10-08T07:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137834 2023-10-08T07:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.259336+0000", 2023-10-08T07:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.259336+0000", 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.259336+0000", 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9499999999999998e-07 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.259347+0000", 2023-10-08T07:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0132999999999999e-05 2023-10-08T07:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.259353+0000", 2023-10-08T07:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9290000000000003e-06 2023-10-08T07:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.259356+0000", 2023-10-08T07:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2679999999999999e-06 2023-10-08T07:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137988 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.341358+0000", 2023-10-08T07:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.31834237900000001, 2023-10-08T07:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32352735799999999, 2023-10-08T07:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137988 2023-10-08T07:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.341358+0000", 2023-10-08T07:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.341358+0000", 2023-10-08T07:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.341359+0000", 2023-10-08T07:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.341376+0000", 2023-10-08T07:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7405e-05 2023-10-08T07:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.341383+0000", 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3130000000000001e-06 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.341389+0000", 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9619999999999998e-06 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138027 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.353349+0000", 2023-10-08T07:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.30635080599999998, 2023-10-08T07:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.31158865699999999, 2023-10-08T07:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138027 2023-10-08T07:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.353349+0000", 2023-10-08T07:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.353349+0000", 2023-10-08T07:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.355294+0000", 2023-10-08T07:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001944765 2023-10-08T07:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.355312+0000", 2023-10-08T07:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8229000000000001e-05 2023-10-08T07:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.355322+0000", 2023-10-08T07:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9529999999999994e-06 2023-10-08T07:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.355330+0000", 2023-10-08T07:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2570000000000001e-06 2023-10-08T07:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138414 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.518357+0000", 2023-10-08T07:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14134282200000001, 2023-10-08T07:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.14663422300000001, 2023-10-08T07:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138414 2023-10-08T07:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.518357+0000", 2023-10-08T07:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.518357+0000", 2023-10-08T07:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.518358+0000", 2023-10-08T07:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3900000000000001e-07 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.518366+0000", 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5080000000000005e-06 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.518370+0000", 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.49e-06 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.518373+0000", 2023-10-08T07:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9900000000000002e-06 2023-10-08T07:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138485 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.542274+0000", 2023-10-08T07:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.11742657200000001, 2023-10-08T07:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12277139300000001, 2023-10-08T07:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138485 2023-10-08T07:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.542274+0000", 2023-10-08T07:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.542274+0000", 2023-10-08T07:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.547297+0000", 2023-10-08T07:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050231160000000002 2023-10-08T07:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.547315+0000", 2023-10-08T07:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8459999999999999e-05 2023-10-08T07:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.547325+0000", 2023-10-08T07:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6879999999999994e-06 2023-10-08T07:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.547332+0000", 2023-10-08T07:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9859999999999997e-06 2023-10-08T07:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144546 4.1b e61/17 4:dbb7dde6:::10000000004.0000002c:head v 61'4560, mlcod=61'4552)", 2023-10-08T07:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.631337+0000", 2023-10-08T07:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.028362985, 2023-10-08T07:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033762784999999997, 2023-10-08T07:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.631337+0000", 2023-10-08T07:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.631337+0000", 2023-10-08T07:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.631338+0000", 2023-10-08T07:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.61e-07 2023-10-08T07:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.631356+0000", 2023-10-08T07:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7671000000000001e-05 2023-10-08T07:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.631364+0000", 2023-10-08T07:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7280000000000001e-06 2023-10-08T07:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.631372+0000", 2023-10-08T07:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8019999999999992e-06 2023-10-08T07:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643800+0000", 2023-10-08T07:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012427980999999999 2023-10-08T07:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643820+0000", 2023-10-08T07:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9434999999999999e-05 2023-10-08T07:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138673 4.7 4:e2479c46:::10000000004.00000024:head [write 4030464~4096 in=4096b,write 4071424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.637449+0000", 2023-10-08T07:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.022251666999999999, 2023-10-08T07:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.027713907999999999, 2023-10-08T07:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138673 2023-10-08T07:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.637449+0000", 2023-10-08T07:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.637449+0000", 2023-10-08T07:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646304+0000", 2023-10-08T07:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088550699999999996 2023-10-08T07:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646323+0000", 2023-10-08T07:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9741e-05 2023-10-08T07:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646335+0000", 2023-10-08T07:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1809e-05 2023-10-08T07:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646343+0000", 2023-10-08T07:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1499999999999999e-06 2023-10-08T07:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654932+0000", 2023-10-08T07:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085885730000000004 2023-10-08T07:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655026+0000", 2023-10-08T07:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4215999999999994e-05 2023-10-08T07:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144637 4.20 e61/17)", 2023-10-08T07:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.657070+0000", 2023-10-08T07:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0026301380000000002, 2023-10-08T07:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081563079999999993, 2023-10-08T07:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657070+0000", 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657070+0000", 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657070+0000", 2023-10-08T07:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3700000000000001e-07 2023-10-08T07:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657083+0000", 2023-10-08T07:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2459e-05 2023-10-08T07:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657090+0000", 2023-10-08T07:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2169999999999997e-06 2023-10-08T07:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657370+0000", 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00027961000000000001 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135782 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.429472+0000", 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.230227816, 2023-10-08T07:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2358001320000001, 2023-10-08T07:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135782 2023-10-08T07:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429472+0000", 2023-10-08T07:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429472+0000", 2023-10-08T07:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429473+0000", 2023-10-08T07:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2899999999999999e-07 2023-10-08T07:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429496+0000", 2023-10-08T07:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2864e-05 2023-10-08T07:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429502+0000", 2023-10-08T07:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4450000000000001e-06 2023-10-08T07:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429507+0000", 2023-10-08T07:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.972e-06 2023-10-08T07:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135990 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.511467+0000", 2023-10-08T07:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1482331809999999, 2023-10-08T07:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.153862776, 2023-10-08T07:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135990 2023-10-08T07:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.511467+0000", 2023-10-08T07:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.511467+0000", 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.511468+0000", 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8699999999999995e-07 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.511482+0000", 2023-10-08T07:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4419e-05 2023-10-08T07:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.511489+0000", 2023-10-08T07:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5969999999999997e-06 2023-10-08T07:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.511494+0000", 2023-10-08T07:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.101e-06 2023-10-08T07:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136668 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.796505+0000", 2023-10-08T07:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.86319521399999999, 2023-10-08T07:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.868883568, 2023-10-08T07:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136668 2023-10-08T07:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.796505+0000", 2023-10-08T07:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.796505+0000", 2023-10-08T07:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.796506+0000", 2023-10-08T07:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1500000000000005e-07 2023-10-08T07:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.796518+0000", 2023-10-08T07:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2482e-05 2023-10-08T07:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.796525+0000", 2023-10-08T07:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6370000000000002e-06 2023-10-08T07:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.796530+0000", 2023-10-08T07:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1739999999999999e-06 2023-10-08T07:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137065 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.941419+0000", 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.71828168599999997, 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.72402930200000004, 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137065 2023-10-08T07:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.941419+0000", 2023-10-08T07:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.941419+0000", 2023-10-08T07:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.943294+0000", 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001875449 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.943316+0000", 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1560999999999999e-05 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.943326+0000", 2023-10-08T07:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0769e-05 2023-10-08T07:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.943334+0000", 2023-10-08T07:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5730000000000002e-06 2023-10-08T07:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137164 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.982486+0000", 2023-10-08T07:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.677213811, 2023-10-08T07:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.68302076499999997, 2023-10-08T07:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137164 2023-10-08T07:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982486+0000", 2023-10-08T07:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.982486+0000", 2023-10-08T07:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.986295+0000", 2023-10-08T07:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038087389999999998 2023-10-08T07:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.986315+0000", 2023-10-08T07:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9619999999999998e-05 2023-10-08T07:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.986323+0000", 2023-10-08T07:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8609999999999998e-06 2023-10-08T07:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.986329+0000", 2023-10-08T07:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2210000000000002e-06 2023-10-08T07:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137497 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.106809+0000", 2023-10-08T07:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55289096500000001, 2023-10-08T07:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.55875754300000002, 2023-10-08T07:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137497 2023-10-08T07:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106809+0000", 2023-10-08T07:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106809+0000", 2023-10-08T07:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106810+0000", 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0699999999999997e-07 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106820+0000", 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0212e-05 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106827+0000", 2023-10-08T07:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.956e-06 2023-10-08T07:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106834+0000", 2023-10-08T07:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7950000000000002e-06 2023-10-08T07:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137888 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.285342+0000", 2023-10-08T07:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37435801000000002, 2023-10-08T07:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.38028479199999998, 2023-10-08T07:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137888 2023-10-08T07:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.285342+0000", 2023-10-08T07:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.285342+0000", 2023-10-08T07:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.285343+0000", 2023-10-08T07:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3000000000000001e-07 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.285364+0000", 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0868000000000001e-05 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.285370+0000", 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7909999999999999e-06 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.285376+0000", 2023-10-08T07:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6779999999999997e-06 2023-10-08T07:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138674 4.19 4:9a1dab10:::10000000004.0000001d:head [write 12288~4096 in=4096b,write 53248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.646359+0000", 2023-10-08T07:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013341555999999999, 2023-10-08T07:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019330907000000001, 2023-10-08T07:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138674 2023-10-08T07:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646359+0000", 2023-10-08T07:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646359+0000", 2023-10-08T07:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646359+0000", 2023-10-08T07:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6400000000000002e-07 2023-10-08T07:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646377+0000", 2023-10-08T07:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7411e-05 2023-10-08T07:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646401+0000", 2023-10-08T07:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4023999999999999e-05 2023-10-08T07:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646410+0000", 2023-10-08T07:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7839999999999998e-06 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646466+0000", 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5198000000000002e-05 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646558+0000", 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2237000000000005e-05 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.665644+0000", 2023-10-08T07:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019085934999999998 2023-10-08T07:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138700 4.15 4:a88808fa:::10000000004.0000001f:head [write 1769472~4096 in=4096b,write 1785856~4096 in=4096b,write 1994752~12288 in=12288b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.654342+0000", 2023-10-08T07:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0053582780000000002, 2023-10-08T07:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011435109000000001, 2023-10-08T07:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138700 2023-10-08T07:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654342+0000", 2023-10-08T07:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.654342+0000", 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657155+0000", 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028134570000000001 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657179+0000", 2023-10-08T07:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3207999999999999e-05 2023-10-08T07:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657189+0000", 2023-10-08T07:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0406e-05 2023-10-08T07:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657196+0000", 2023-10-08T07:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2729999999999997e-06 2023-10-08T07:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657330+0000", 2023-10-08T07:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013338099999999999 2023-10-08T07:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657419+0000", 2023-10-08T07:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9425999999999994e-05 2023-10-08T07:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135714 4.10 4:0b5763e1:::10000000004.00000015:head [write 3284992~4096 in=4096b,write 3330048~4096 in=4096b,write 3448832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.401341+0000", 2023-10-08T07:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2583589800000001, 2023-10-08T07:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2645036140000001, 2023-10-08T07:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135714 2023-10-08T07:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.401341+0000", 2023-10-08T07:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.401341+0000", 2023-10-08T07:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.403296+0000", 2023-10-08T07:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001954688 2023-10-08T07:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.403308+0000", 2023-10-08T07:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2227e-05 2023-10-08T07:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.403318+0000", 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7489999999999993e-06 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.403323+0000", 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3240000000000002e-06 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.642463+0000", 2023-10-08T07:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2391393879999999 2023-10-08T07:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.642545+0000", 2023-10-08T07:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2249999999999993e-05 2023-10-08T07:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135783 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.429514+0000", 2023-10-08T07:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2301863630000001, 2023-10-08T07:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.236404836, 2023-10-08T07:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135783 2023-10-08T07:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429514+0000", 2023-10-08T07:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.429514+0000", 2023-10-08T07:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.431293+0000", 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017795230000000001 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.431308+0000", 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4260000000000001e-05 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.431318+0000", 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0804e-05 2023-10-08T07:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.431325+0000", 2023-10-08T07:07:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0219999999999999e-06 2023-10-08T07:07:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135818 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.446604+0000", 2023-10-08T07:07:38.134 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.213096551, 2023-10-08T07:07:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2193670889999999, 2023-10-08T07:07:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135818 2023-10-08T07:07:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446604+0000", 2023-10-08T07:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446604+0000", 2023-10-08T07:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446604+0000", 2023-10-08T07:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7100000000000001e-07 2023-10-08T07:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446626+0000", 2023-10-08T07:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1129e-05 2023-10-08T07:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446639+0000", 2023-10-08T07:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2999999999999999e-05 2023-10-08T07:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446649+0000", 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0098999999999999e-05 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136340 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.651824+0000", 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.007876073, 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0141850969999999, 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136340 2023-10-08T07:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.651824+0000", 2023-10-08T07:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.651824+0000", 2023-10-08T07:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.651825+0000", 2023-10-08T07:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2023-10-08T07:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.651840+0000", 2023-10-08T07:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5359999999999999e-05 2023-10-08T07:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.651847+0000", 2023-10-08T07:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4499999999999998e-06 2023-10-08T07:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.651853+0000", 2023-10-08T07:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5570000000000003e-06 2023-10-08T07:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137218 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.012136+0000", 2023-10-08T07:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.647564684, 2023-10-08T07:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65393352800000004, 2023-10-08T07:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137218 2023-10-08T07:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012136+0000", 2023-10-08T07:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012136+0000", 2023-10-08T07:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012136+0000", 2023-10-08T07:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1699999999999998e-07 2023-10-08T07:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012150+0000", 2023-10-08T07:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3933e-05 2023-10-08T07:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012159+0000", 2023-10-08T07:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4950000000000008e-06 2023-10-08T07:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012165+0000", 2023-10-08T07:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9349999999999999e-06 2023-10-08T07:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137629 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.159362+0000", 2023-10-08T07:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.50033818900000004, 2023-10-08T07:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.50677159299999996, 2023-10-08T07:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137629 2023-10-08T07:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.159362+0000", 2023-10-08T07:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.159362+0000", 2023-10-08T07:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162295+0000", 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029333129999999999 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162319+0000", 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3730000000000001e-05 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162329+0000", 2023-10-08T07:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5810000000000003e-06 2023-10-08T07:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162336+0000", 2023-10-08T07:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2320000000000004e-06 2023-10-08T07:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138203 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.424747+0000", 2023-10-08T07:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.23495339500000001, 2023-10-08T07:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.241448617, 2023-10-08T07:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138203 2023-10-08T07:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.424747+0000", 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.424747+0000", 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.424748+0000", 2023-10-08T07:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5400000000000001e-07 2023-10-08T07:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.424761+0000", 2023-10-08T07:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3067e-05 2023-10-08T07:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.424767+0000", 2023-10-08T07:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6680000000000004e-06 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.424774+0000", 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4309999999999999e-06 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144554 4.2b e61/17 4:d776c1c9:::10000000004.0000003d:head v 61'4550, mlcod=61'4544)", 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.633146+0000", 2023-10-08T07:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026554253, 2023-10-08T07:07:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033106011999999997, 2023-10-08T07:07:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633146+0000", 2023-10-08T07:07:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633146+0000", 2023-10-08T07:07:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633147+0000", 2023-10-08T07:07:38.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-07 2023-10-08T07:07:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633159+0000", 2023-10-08T07:07:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2031999999999999e-05 2023-10-08T07:07:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633168+0000", 2023-10-08T07:07:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3519999999999996e-06 2023-10-08T07:07:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633175+0000", 2023-10-08T07:07:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4769999999999997e-06 2023-10-08T07:07:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643837+0000", 2023-10-08T07:07:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010661937 2023-10-08T07:07:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.643855+0000", 2023-10-08T07:07:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7584e-05 2023-10-08T07:07:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138676 4.15 4:aaa619cf:::10000000004.00000004:head [write 823296~4096 in=4096b,write 921600~4096 in=4096b,write 954368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.646429+0000", 2023-10-08T07:07:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013271542000000001, 2023-10-08T07:07:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019896316000000001, 2023-10-08T07:07:38.158 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138676 2023-10-08T07:07:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646429+0000", 2023-10-08T07:07:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646429+0000", 2023-10-08T07:07:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646429+0000", 2023-10-08T07:07:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3600000000000003e-07 2023-10-08T07:07:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646451+0000", 2023-10-08T07:07:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1467999999999998e-05 2023-10-08T07:07:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646467+0000", 2023-10-08T07:07:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6171000000000002e-05 2023-10-08T07:07:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646474+0000", 2023-10-08T07:07:38.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.754e-06 2023-10-08T07:07:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646524+0000", 2023-10-08T07:07:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9725000000000002e-05 2023-10-08T07:07:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646604+0000", 2023-10-08T07:07:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0619999999999997e-05 2023-10-08T07:07:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.162 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138701 4.19 4:9a1dab10:::10000000004.0000001d:head [write 2834432~4096 in=4096b,write 2973696~4096 in=4096b,write 3072000~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.657215+0000", 2023-10-08T07:07:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024849799999999999, 2023-10-08T07:07:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091781789999999999, 2023-10-08T07:07:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.163 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138701 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657215+0000", 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657215+0000", 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657216+0000", 2023-10-08T07:07:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7899999999999999e-07 2023-10-08T07:07:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657228+0000", 2023-10-08T07:07:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2653000000000001e-05 2023-10-08T07:07:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657235+0000", 2023-10-08T07:07:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.866e-06 2023-10-08T07:07:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657240+0000", 2023-10-08T07:07:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1930000000000001e-06 2023-10-08T07:07:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657999+0000", 2023-10-08T07:07:38.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00075892699999999995 2023-10-08T07:07:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.658085+0000", 2023-10-08T07:07:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5797000000000005e-05 2023-10-08T07:07:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135733 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.167 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.419352+0000", 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2403477540000001, 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2471124490000001, 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135733 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.419352+0000", 2023-10-08T07:07:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.419352+0000", 2023-10-08T07:07:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.419353+0000", 2023-10-08T07:07:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:07:38.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.419365+0000", 2023-10-08T07:07:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2337000000000001e-05 2023-10-08T07:07:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.419373+0000", 2023-10-08T07:07:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5159999999999997e-06 2023-10-08T07:07:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.419379+0000", 2023-10-08T07:07:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6969999999999998e-06 2023-10-08T07:07:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135819 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.446662+0000", 2023-10-08T07:07:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2130385029999999, 2023-10-08T07:07:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.219855551, 2023-10-08T07:07:38.171 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135819 2023-10-08T07:07:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446662+0000", 2023-10-08T07:07:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446662+0000", 2023-10-08T07:07:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446662+0000", 2023-10-08T07:07:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8899999999999999e-07 2023-10-08T07:07:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446675+0000", 2023-10-08T07:07:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2353e-05 2023-10-08T07:07:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446682+0000", 2023-10-08T07:07:38.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9319999999999999e-06 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446687+0000", 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1880000000000001e-06 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136066 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.543488+0000", 2023-10-08T07:07:38.176 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.116212134, 2023-10-08T07:07:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.123081489, 2023-10-08T07:07:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136066 2023-10-08T07:07:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.543488+0000", 2023-10-08T07:07:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.543488+0000", 2023-10-08T07:07:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.545293+0000", 2023-10-08T07:07:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001805379 2023-10-08T07:07:38.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.545310+0000", 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6906e-05 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.545320+0000", 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9690000000000006e-06 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.545329+0000", 2023-10-08T07:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4999999999999999e-06 2023-10-08T07:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136092 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.553665+0000", 2023-10-08T07:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.106035613, 2023-10-08T07:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1129565880000001, 2023-10-08T07:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136092 2023-10-08T07:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.553665+0000", 2023-10-08T07:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.553665+0000", 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.553665+0000", 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3499999999999996e-07 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.553681+0000", 2023-10-08T07:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5515999999999998e-05 2023-10-08T07:07:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.553687+0000", 2023-10-08T07:07:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4119999999999998e-06 2023-10-08T07:07:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.553692+0000", 2023-10-08T07:07:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2719999999999997e-06 2023-10-08T07:07:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.183 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136143 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.574496+0000", 2023-10-08T07:07:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.085204429, 2023-10-08T07:07:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.092177052, 2023-10-08T07:07:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.184 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136143 2023-10-08T07:07:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.574496+0000", 2023-10-08T07:07:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.574496+0000", 2023-10-08T07:07:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.574496+0000", 2023-10-08T07:07:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2e-07 2023-10-08T07:07:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.574514+0000", 2023-10-08T07:07:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7346999999999998e-05 2023-10-08T07:07:38.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.574521+0000", 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8460000000000008e-06 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.574527+0000", 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2499999999999997e-06 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136392 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.683452+0000", 2023-10-08T07:07:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.97624845599999999, 2023-10-08T07:07:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98327306800000003, 2023-10-08T07:07:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136392 2023-10-08T07:07:38.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.683452+0000", 2023-10-08T07:07:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.683452+0000", 2023-10-08T07:07:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.683452+0000", 2023-10-08T07:07:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8999999999999996e-07 2023-10-08T07:07:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.683472+0000", 2023-10-08T07:07:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9658000000000001e-05 2023-10-08T07:07:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.683480+0000", 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5490000000000001e-06 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.683485+0000", 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5589999999999996e-06 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136445 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.191 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.704449+0000", 2023-10-08T07:07:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.95525128699999995, 2023-10-08T07:07:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96232770099999998, 2023-10-08T07:07:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136445 2023-10-08T07:07:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.704449+0000", 2023-10-08T07:07:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.704449+0000", 2023-10-08T07:07:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.706686+0000", 2023-10-08T07:07:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022367229999999999 2023-10-08T07:07:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.706711+0000", 2023-10-08T07:07:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5310999999999999e-05 2023-10-08T07:07:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.706719+0000", 2023-10-08T07:07:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2700000000000004e-06 2023-10-08T07:07:38.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.706728+0000", 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9539999999999993e-06 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136838 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.862372+0000", 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.797328496, 2023-10-08T07:07:38.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.80445692899999999, 2023-10-08T07:07:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136838 2023-10-08T07:07:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.862372+0000", 2023-10-08T07:07:38.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.862372+0000", 2023-10-08T07:07:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.864293+0000", 2023-10-08T07:07:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019213209999999999 2023-10-08T07:07:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.864309+0000", 2023-10-08T07:07:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5449999999999999e-05 2023-10-08T07:07:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.864318+0000", 2023-10-08T07:07:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2820000000000002e-06 2023-10-08T07:07:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.864326+0000", 2023-10-08T07:07:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7859999999999997e-06 2023-10-08T07:07:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137166 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.986367+0000", 2023-10-08T07:07:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67333366299999997, 2023-10-08T07:07:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.68051490199999998, 2023-10-08T07:07:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.199 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137166 2023-10-08T07:07:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.986367+0000", 2023-10-08T07:07:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.986367+0000", 2023-10-08T07:07:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.986367+0000", 2023-10-08T07:07:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8299999999999998e-07 2023-10-08T07:07:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.986376+0000", 2023-10-08T07:07:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1409999999999994e-06 2023-10-08T07:07:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.986380+0000", 2023-10-08T07:07:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5590000000000001e-06 2023-10-08T07:07:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.986385+0000", 2023-10-08T07:07:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9359999999999998e-06 2023-10-08T07:07:38.202 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137340 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.050667+0000", 2023-10-08T07:07:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.609033559, 2023-10-08T07:07:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61626809900000001, 2023-10-08T07:07:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.203 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137340 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.050667+0000", 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.050667+0000", 2023-10-08T07:07:38.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.050667+0000", 2023-10-08T07:07:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5000000000000003e-07 2023-10-08T07:07:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.050683+0000", 2023-10-08T07:07:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5515e-05 2023-10-08T07:07:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.050690+0000", 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0870000000000001e-06 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.050696+0000", 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7370000000000003e-06 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137373 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.060240+0000", 2023-10-08T07:07:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.59946043299999996, 2023-10-08T07:07:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.60674981699999997, 2023-10-08T07:07:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137373 2023-10-08T07:07:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.207 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.060240+0000", 2023-10-08T07:07:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.060240+0000", 2023-10-08T07:07:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.060240+0000", 2023-10-08T07:07:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2023-10-08T07:07:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.060258+0000", 2023-10-08T07:07:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7418000000000002e-05 2023-10-08T07:07:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.060266+0000", 2023-10-08T07:07:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7139999999999993e-06 2023-10-08T07:07:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.060271+0000", 2023-10-08T07:07:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9100000000000002e-06 2023-10-08T07:07:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.210 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137500 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.106878+0000", 2023-10-08T07:07:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55282237599999995, 2023-10-08T07:07:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56016641300000003, 2023-10-08T07:07:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137500 2023-10-08T07:07:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106878+0000", 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106878+0000", 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106878+0000", 2023-10-08T07:07:38.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9599999999999999e-07 2023-10-08T07:07:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106898+0000", 2023-10-08T07:07:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9476000000000001e-05 2023-10-08T07:07:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106905+0000", 2023-10-08T07:07:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.905e-06 2023-10-08T07:07:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106911+0000", 2023-10-08T07:07:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1510000000000001e-06 2023-10-08T07:07:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137630 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.162349+0000", 2023-10-08T07:07:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.49735154399999998, 2023-10-08T07:07:38.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.50474905400000003, 2023-10-08T07:07:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137630 2023-10-08T07:07:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162349+0000", 2023-10-08T07:07:38.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162349+0000", 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162349+0000", 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6400000000000003e-07 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162362+0000", 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2447e-05 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162372+0000", 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9299999999999998e-06 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162376+0000", 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9200000000000003e-06 2023-10-08T07:07:38.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137963 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.326500+0000", 2023-10-08T07:07:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.33320033199999999, 2023-10-08T07:07:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.34065052000000001, 2023-10-08T07:07:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137963 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.326500+0000", 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.326500+0000", 2023-10-08T07:07:38.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.328294+0000", 2023-10-08T07:07:38.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001794543 2023-10-08T07:07:38.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.328312+0000", 2023-10-08T07:07:38.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7244e-05 2023-10-08T07:07:38.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.328322+0000", 2023-10-08T07:07:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0569e-05 2023-10-08T07:07:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.328330+0000", 2023-10-08T07:07:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3919999999999997e-06 2023-10-08T07:07:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138286 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.453616+0000", 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.20608394799999999, 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.21359477499999999, 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138286 2023-10-08T07:07:38.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.453616+0000", 2023-10-08T07:07:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.453616+0000", 2023-10-08T07:07:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.453617+0000", 2023-10-08T07:07:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0500000000000003e-07 2023-10-08T07:07:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.453631+0000", 2023-10-08T07:07:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4569000000000001e-05 2023-10-08T07:07:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.453638+0000", 2023-10-08T07:07:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4030000000000004e-06 2023-10-08T07:07:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.453644+0000", 2023-10-08T07:07:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8379999999999998e-06 2023-10-08T07:07:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138329 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.473347+0000", 2023-10-08T07:07:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.186353619, 2023-10-08T07:07:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.193957832, 2023-10-08T07:07:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138329 2023-10-08T07:07:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.226 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473347+0000", 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473347+0000", 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473347+0000", 2023-10-08T07:07:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4900000000000001e-07 2023-10-08T07:07:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473359+0000", 2023-10-08T07:07:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2381999999999999e-05 2023-10-08T07:07:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473372+0000", 2023-10-08T07:07:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2791e-05 2023-10-08T07:07:38.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473378+0000", 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9789999999999998e-06 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138547 4.3b 4.1fd270fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.581128+0000", 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.078572721999999998, 2023-10-08T07:07:38.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.086231810000000006, 2023-10-08T07:07:38.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.230 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.230 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138547 2023-10-08T07:07:38.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.230 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.581128+0000", 2023-10-08T07:07:38.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.581128+0000", 2023-10-08T07:07:38.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.581128+0000", 2023-10-08T07:07:38.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:07:38.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.581141+0000", 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3390999999999999e-05 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.581149+0000", 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2080000000000003e-06 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.581154+0000", 2023-10-08T07:07:38.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4129999999999997e-06 2023-10-08T07:07:38.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.233 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.233 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138677 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.233 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.646490+0000", 2023-10-08T07:07:38.233 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013210400000000001, 2023-10-08T07:07:38.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020925404000000002, 2023-10-08T07:07:38.233 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.233 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.233 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138677 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646490+0000", 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646490+0000", 2023-10-08T07:07:38.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646490+0000", 2023-10-08T07:07:38.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0500000000000004e-07 2023-10-08T07:07:38.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646508+0000", 2023-10-08T07:07:38.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7391999999999999e-05 2023-10-08T07:07:38.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646514+0000", 2023-10-08T07:07:38.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3400000000000003e-06 2023-10-08T07:07:38.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646520+0000", 2023-10-08T07:07:38.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0630000000000002e-06 2023-10-08T07:07:38.236 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.236 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.236 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138702 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.657250+0000", 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024505719999999998, 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010219113, 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138702 2023-10-08T07:07:38.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657250+0000", 2023-10-08T07:07:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657250+0000", 2023-10-08T07:07:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657250+0000", 2023-10-08T07:07:38.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3999999999999997e-07 2023-10-08T07:07:38.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657262+0000", 2023-10-08T07:07:38.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1970000000000001e-05 2023-10-08T07:07:38.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657268+0000", 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8690000000000001e-06 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657273+0000", 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.843e-06 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135870 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.240 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.468490+0000", 2023-10-08T07:07:38.241 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1912099979999999, 2023-10-08T07:07:38.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.199040592, 2023-10-08T07:07:38.241 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.241 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.241 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135870 2023-10-08T07:07:38.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.241 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.468490+0000", 2023-10-08T07:07:38.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.468490+0000", 2023-10-08T07:07:38.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.468491+0000", 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.58e-07 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.468503+0000", 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2043e-05 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.468507+0000", 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9500000000000003e-06 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.468510+0000", 2023-10-08T07:07:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7479999999999999e-06 2023-10-08T07:07:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136114 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.564368+0000", 2023-10-08T07:07:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.095332706, 2023-10-08T07:07:38.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1032153199999999, 2023-10-08T07:07:38.245 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.245 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.245 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136114 2023-10-08T07:07:38.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.245 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.564368+0000", 2023-10-08T07:07:38.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.564368+0000", 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.564368+0000", 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2300000000000001e-07 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.564382+0000", 2023-10-08T07:07:38.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3515e-05 2023-10-08T07:07:38.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.564390+0000", 2023-10-08T07:07:38.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4910000000000005e-06 2023-10-08T07:07:38.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.564396+0000", 2023-10-08T07:07:38.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0220000000000001e-06 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136393 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.683495+0000", 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.97620543000000004, 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.98414854200000002, 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.249 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136393 2023-10-08T07:07:38.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.249 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.683495+0000", 2023-10-08T07:07:38.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.683495+0000", 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.683495+0000", 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2499999999999995e-07 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.683506+0000", 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0479000000000001e-05 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.683513+0000", 2023-10-08T07:07:38.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2269999999999996e-06 2023-10-08T07:07:38.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.683519+0000", 2023-10-08T07:07:38.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.891e-06 2023-10-08T07:07:38.251 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.251 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.251 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136840 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.864339+0000", 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.79536147300000004, 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.80335763100000002, 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136840 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.252 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.864339+0000", 2023-10-08T07:07:38.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.864339+0000", 2023-10-08T07:07:38.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.864339+0000", 2023-10-08T07:07:38.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2699999999999999e-07 2023-10-08T07:07:38.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.864353+0000", 2023-10-08T07:07:38.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3497e-05 2023-10-08T07:07:38.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.864362+0000", 2023-10-08T07:07:38.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2320000000000007e-06 2023-10-08T07:07:38.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.864368+0000", 2023-10-08T07:07:38.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8540000000000002e-06 2023-10-08T07:07:38.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.255 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.255 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137009 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.255 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.922612+0000", 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.73708845599999995, 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.74513950299999998, 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137009 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922612+0000", 2023-10-08T07:07:38.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922612+0000", 2023-10-08T07:07:38.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922612+0000", 2023-10-08T07:07:38.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3599999999999999e-07 2023-10-08T07:07:38.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922636+0000", 2023-10-08T07:07:38.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3796000000000001e-05 2023-10-08T07:07:38.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922643+0000", 2023-10-08T07:07:38.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.007e-06 2023-10-08T07:07:38.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922648+0000", 2023-10-08T07:07:38.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.13e-06 2023-10-08T07:07:38.259 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.259 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.259 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.259 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137633 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.259 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.162383+0000", 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.49731687299999999, 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.50542061400000005, 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137633 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162383+0000", 2023-10-08T07:07:38.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162383+0000", 2023-10-08T07:07:38.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162384+0000", 2023-10-08T07:07:38.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5400000000000002e-07 2023-10-08T07:07:38.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162400+0000", 2023-10-08T07:07:38.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6614999999999999e-05 2023-10-08T07:07:38.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162408+0000", 2023-10-08T07:07:38.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1140000000000006e-06 2023-10-08T07:07:38.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.162413+0000", 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9130000000000002e-06 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137937 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.313448+0000", 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.346251908, 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.354409223, 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.263 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.264 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.264 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.264 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.264 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137937 2023-10-08T07:07:38.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.264 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.313448+0000", 2023-10-08T07:07:38.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.313448+0000", 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.315293+0000", 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018445180000000001 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.315308+0000", 2023-10-08T07:07:38.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4684999999999999e-05 2023-10-08T07:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.315316+0000", 2023-10-08T07:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0479999999999999e-06 2023-10-08T07:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.315321+0000", 2023-10-08T07:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6300000000000003e-06 2023-10-08T07:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138056 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.363387+0000", 2023-10-08T07:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29631358699999999, 2023-10-08T07:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.30452615999999999, 2023-10-08T07:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138056 2023-10-08T07:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.363387+0000", 2023-10-08T07:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.363387+0000", 2023-10-08T07:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.371309+0000", 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079225549999999995 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.371325+0000", 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5288e-05 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.371336+0000", 2023-10-08T07:07:38.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1331e-05 2023-10-08T07:07:38.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.371344+0000", 2023-10-08T07:07:38.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1310000000000006e-06 2023-10-08T07:07:38.270 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.270 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.270 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.271 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138085 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.271 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.385359+0000", 2023-10-08T07:07:38.271 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.27434172899999998, 2023-10-08T07:07:38.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.282611212, 2023-10-08T07:07:38.271 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.271 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.271 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138085 2023-10-08T07:07:38.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.271 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.385359+0000", 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.385359+0000", 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.385359+0000", 2023-10-08T07:07:38.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9999999999999997e-07 2023-10-08T07:07:38.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.385372+0000", 2023-10-08T07:07:38.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2897999999999999e-05 2023-10-08T07:07:38.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.385379+0000", 2023-10-08T07:07:38.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4630000000000004e-06 2023-10-08T07:07:38.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.385386+0000", 2023-10-08T07:07:38.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.015e-06 2023-10-08T07:07:38.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.274 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.274 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138523 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.274 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.564305+0000", 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.095395708999999995, 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.10373023100000001, 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138523 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.564305+0000", 2023-10-08T07:07:38.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.564305+0000", 2023-10-08T07:07:38.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.564305+0000", 2023-10-08T07:07:38.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7899999999999998e-07 2023-10-08T07:07:38.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.564328+0000", 2023-10-08T07:07:38.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3159999999999998e-05 2023-10-08T07:07:38.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.564336+0000", 2023-10-08T07:07:38.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3200000000000002e-06 2023-10-08T07:07:38.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.564342+0000", 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0929999999999999e-06 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138548 4.b 4.789930b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.581162+0000", 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.078537895999999996, 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.086932209999999996, 2023-10-08T07:07:38.278 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.279 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.279 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138548 2023-10-08T07:07:38.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.279 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.581162+0000", 2023-10-08T07:07:38.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.581162+0000", 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.581163+0000", 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5299999999999999e-07 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.581181+0000", 2023-10-08T07:07:38.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8678999999999999e-05 2023-10-08T07:07:38.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.581195+0000", 2023-10-08T07:07:38.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3936e-05 2023-10-08T07:07:38.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.581201+0000", 2023-10-08T07:07:38.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2023-10-08T07:07:38.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.282 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.282 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138637 4.3b 4.d87b41fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.282 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.623332+0000", 2023-10-08T07:07:38.282 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.036367867999999998, 2023-10-08T07:07:38.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.044823803000000002, 2023-10-08T07:07:38.282 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.282 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138637 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.623332+0000", 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.623332+0000", 2023-10-08T07:07:38.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633299+0000", 2023-10-08T07:07:38.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.009966875 2023-10-08T07:07:38.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633320+0000", 2023-10-08T07:07:38.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0869999999999998e-05 2023-10-08T07:07:38.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633332+0000", 2023-10-08T07:07:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2197e-05 2023-10-08T07:07:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633341+0000", 2023-10-08T07:07:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8009999999999993e-06 2023-10-08T07:07:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.285 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.286 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144599 4.20 e61/17 4:05b3915c:::10000000004.00000016:head v 61'6825, mlcod=61'6818)", 2023-10-08T07:07:38.286 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.646588+0000", 2023-10-08T07:07:38.286 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013112674, 2023-10-08T07:07:38.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021633914000000001, 2023-10-08T07:07:38.286 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.286 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.286 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646588+0000", 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646588+0000", 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646588+0000", 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7599999999999997e-07 2023-10-08T07:07:38.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646601+0000", 2023-10-08T07:07:38.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3077e-05 2023-10-08T07:07:38.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646612+0000", 2023-10-08T07:07:38.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0484e-05 2023-10-08T07:07:38.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646619+0000", 2023-10-08T07:07:38.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0299999999999996e-06 2023-10-08T07:07:38.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652835+0000", 2023-10-08T07:07:38.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062163849999999996 2023-10-08T07:07:38.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652853+0000", 2023-10-08T07:07:38.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8009999999999999e-05 2023-10-08T07:07:38.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.290 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.290 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135824 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.290 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.446728+0000", 2023-10-08T07:07:38.290 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.212972012, 2023-10-08T07:07:38.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2215671290000001, 2023-10-08T07:07:38.290 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.290 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.291 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135824 2023-10-08T07:07:38.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.291 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446728+0000", 2023-10-08T07:07:38.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446728+0000", 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446729+0000", 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0200000000000003e-07 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446739+0000", 2023-10-08T07:07:38.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0379e-05 2023-10-08T07:07:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446745+0000", 2023-10-08T07:07:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.297e-06 2023-10-08T07:07:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446750+0000", 2023-10-08T07:07:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5900000000000001e-06 2023-10-08T07:07:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136115 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.564406+0000", 2023-10-08T07:07:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0952943509999999, 2023-10-08T07:07:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1039518239999999, 2023-10-08T07:07:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136115 2023-10-08T07:07:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.564406+0000", 2023-10-08T07:07:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.564406+0000", 2023-10-08T07:07:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.564406+0000", 2023-10-08T07:07:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1799999999999995e-07 2023-10-08T07:07:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.564428+0000", 2023-10-08T07:07:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1447999999999999e-05 2023-10-08T07:07:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.564435+0000", 2023-10-08T07:07:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9999999999999999e-06 2023-10-08T07:07:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.564441+0000", 2023-10-08T07:07:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2330000000000003e-06 2023-10-08T07:07:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136207 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.603384+0000", 2023-10-08T07:07:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.056316595, 2023-10-08T07:07:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0650331019999999, 2023-10-08T07:07:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136207 2023-10-08T07:07:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.603384+0000", 2023-10-08T07:07:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.603384+0000", 2023-10-08T07:07:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.603384+0000", 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.603406+0000", 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1994999999999999e-05 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.603413+0000", 2023-10-08T07:07:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0489999999999998e-06 2023-10-08T07:07:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.603418+0000", 2023-10-08T07:07:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0969999999999996e-06 2023-10-08T07:07:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136638 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.785498+0000", 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.87420215099999998, 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88297803600000002, 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136638 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.785498+0000", 2023-10-08T07:07:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.785498+0000", 2023-10-08T07:07:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.787715+0000", 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022164960000000001 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.787731+0000", 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5984000000000001e-05 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.787742+0000", 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1109e-05 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.787749+0000", 2023-10-08T07:07:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0910000000000004e-06 2023-10-08T07:07:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137502 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.106952+0000", 2023-10-08T07:07:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55274834799999994, 2023-10-08T07:07:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56158191499999999, 2023-10-08T07:07:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137502 2023-10-08T07:07:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106952+0000", 2023-10-08T07:07:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106952+0000", 2023-10-08T07:07:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106952+0000", 2023-10-08T07:07:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1100000000000001e-07 2023-10-08T07:07:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106964+0000", 2023-10-08T07:07:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1358e-05 2023-10-08T07:07:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106970+0000", 2023-10-08T07:07:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4309999999999999e-06 2023-10-08T07:07:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.106975+0000", 2023-10-08T07:07:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.843e-06 2023-10-08T07:07:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137549 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.122368+0000", 2023-10-08T07:07:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.53733273500000001, 2023-10-08T07:07:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.546231142, 2023-10-08T07:07:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137549 2023-10-08T07:07:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.122368+0000", 2023-10-08T07:07:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.122368+0000", 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.122368+0000", 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8800000000000002e-07 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.122381+0000", 2023-10-08T07:07:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2393e-05 2023-10-08T07:07:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.122388+0000", 2023-10-08T07:07:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0659999999999998e-06 2023-10-08T07:07:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.122393+0000", 2023-10-08T07:07:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8220000000000003e-06 2023-10-08T07:07:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137911 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.295380+0000", 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.36432073399999998, 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.37326933000000001, 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137911 2023-10-08T07:07:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.295380+0000", 2023-10-08T07:07:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.295380+0000", 2023-10-08T07:07:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.299296+0000", 2023-10-08T07:07:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039164239999999999 2023-10-08T07:07:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.299314+0000", 2023-10-08T07:07:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8326e-05 2023-10-08T07:07:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.299328+0000", 2023-10-08T07:07:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3275000000000001e-05 2023-10-08T07:07:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.299335+0000", 2023-10-08T07:07:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3100000000000003e-06 2023-10-08T07:07:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138168 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.414348+0000", 2023-10-08T07:07:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.24535242400000001, 2023-10-08T07:07:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.254334322, 2023-10-08T07:07:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138168 2023-10-08T07:07:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.414348+0000", 2023-10-08T07:07:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.414348+0000", 2023-10-08T07:07:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.414348+0000", 2023-10-08T07:07:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8299999999999998e-07 2023-10-08T07:07:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.414367+0000", 2023-10-08T07:07:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8660000000000001e-05 2023-10-08T07:07:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.414375+0000", 2023-10-08T07:07:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9470000000000003e-06 2023-10-08T07:07:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.414381+0000", 2023-10-08T07:07:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7699999999999998e-06 2023-10-08T07:07:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138524 4.3b 4.1fd270fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.564351+0000", 2023-10-08T07:07:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.095349372000000002, 2023-10-08T07:07:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.104365228, 2023-10-08T07:07:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138524 2023-10-08T07:07:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.564351+0000", 2023-10-08T07:07:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.564351+0000", 2023-10-08T07:07:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.564351+0000", 2023-10-08T07:07:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6600000000000002e-07 2023-10-08T07:07:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.564366+0000", 2023-10-08T07:07:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4214e-05 2023-10-08T07:07:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.564372+0000", 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6340000000000003e-06 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.564377+0000", 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0309999999999998e-06 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138638 4.f 4:f2537947:::10000000004.00000017:head [write 2482176~4096 in=4096b,write 2543616~4096 in=4096b,write 2564096~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.633356+0000", 2023-10-08T07:07:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026344001999999998, 2023-10-08T07:07:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034968640000000002, 2023-10-08T07:07:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138638 2023-10-08T07:07:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.326 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633356+0000", 2023-10-08T07:07:38.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633356+0000", 2023-10-08T07:07:38.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633357+0000", 2023-10-08T07:07:38.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0399999999999996e-07 2023-10-08T07:07:38.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633377+0000", 2023-10-08T07:07:38.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9972000000000001e-05 2023-10-08T07:07:38.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633385+0000", 2023-10-08T07:07:38.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9500000000000001e-06 2023-10-08T07:07:38.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633391+0000", 2023-10-08T07:07:38.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8490000000000002e-06 2023-10-08T07:07:38.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.642242+0000", 2023-10-08T07:07:38.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088516879999999999 2023-10-08T07:07:38.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.642340+0000", 2023-10-08T07:07:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8163000000000002e-05 2023-10-08T07:07:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.668181+0000", 2023-10-08T07:07:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025840795 2023-10-08T07:07:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.668237+0000", 2023-10-08T07:07:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5900999999999999e-05 2023-10-08T07:07:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.668325+0000", 2023-10-08T07:07:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7718000000000003e-05 2023-10-08T07:07:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.331 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144605 4.30 e61/17 4:0f322a22:::10000000004.00000014:head v 61'2298, mlcod=61'2295)", 2023-10-08T07:07:38.331 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.646639+0000", 2023-10-08T07:07:38.331 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013061488, 2023-10-08T07:07:38.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022181080999999998, 2023-10-08T07:07:38.331 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.331 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.331 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646639+0000", 2023-10-08T07:07:38.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646639+0000", 2023-10-08T07:07:38.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646639+0000", 2023-10-08T07:07:38.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4099999999999999e-07 2023-10-08T07:07:38.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646666+0000", 2023-10-08T07:07:38.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6740000000000001e-05 2023-10-08T07:07:38.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646674+0000", 2023-10-08T07:07:38.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4160000000000004e-06 2023-10-08T07:07:38.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646681+0000", 2023-10-08T07:07:38.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3439999999999997e-06 2023-10-08T07:07:38.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652825+0000", 2023-10-08T07:07:38.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061444719999999998 2023-10-08T07:07:38.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652843+0000", 2023-10-08T07:07:38.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8193e-05 2023-10-08T07:07:38.334 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.335 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.335 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144647 4.2b e61/17)", 2023-10-08T07:07:38.335 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.659237+0000", 2023-10-08T07:07:38.335 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00046342399999999999, 2023-10-08T07:07:38.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0096179639999999997, 2023-10-08T07:07:38.335 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.335 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.335 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.659237+0000", 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.659237+0000", 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.659237+0000", 2023-10-08T07:07:38.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2200000000000004e-07 2023-10-08T07:07:38.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.659254+0000", 2023-10-08T07:07:38.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6273000000000002e-05 2023-10-08T07:07:38.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.659265+0000", 2023-10-08T07:07:38.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1718e-05 2023-10-08T07:07:38.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.659272+0000", 2023-10-08T07:07:38.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6379999999999998e-06 2023-10-08T07:07:38.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.338 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.338 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135825 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.338 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.446755+0000", 2023-10-08T07:07:38.338 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.212944781, 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.22215644, 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135825 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446755+0000", 2023-10-08T07:07:38.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446755+0000", 2023-10-08T07:07:38.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446756+0000", 2023-10-08T07:07:38.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7800000000000002e-07 2023-10-08T07:07:38.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446767+0000", 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0732e-05 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446772+0000", 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.417e-06 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446776+0000", 2023-10-08T07:07:38.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3900000000000003e-06 2023-10-08T07:07:38.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.342 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.342 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136312 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.342 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.639348+0000", 2023-10-08T07:07:38.342 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.020352642, 2023-10-08T07:07:38.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.029624903, 2023-10-08T07:07:38.342 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.342 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.343 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136312 2023-10-08T07:07:38.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.343 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.639348+0000", 2023-10-08T07:07:38.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.639348+0000", 2023-10-08T07:07:38.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.643295+0000", 2023-10-08T07:07:38.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039473110000000002 2023-10-08T07:07:38.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.643318+0000", 2023-10-08T07:07:38.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2734999999999998e-05 2023-10-08T07:07:38.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.643329+0000", 2023-10-08T07:07:38.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0964e-05 2023-10-08T07:07:38.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.643336+0000", 2023-10-08T07:07:38.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8660000000000006e-06 2023-10-08T07:07:38.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.346 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.346 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136738 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.346 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.828163+0000", 2023-10-08T07:07:38.346 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.83153745300000004, 2023-10-08T07:07:38.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84087146400000001, 2023-10-08T07:07:38.346 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.346 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136738 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.828163+0000", 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.828163+0000", 2023-10-08T07:07:38.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.828164+0000", 2023-10-08T07:07:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9199999999999999e-07 2023-10-08T07:07:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.828180+0000", 2023-10-08T07:07:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6141999999999999e-05 2023-10-08T07:07:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.828189+0000", 2023-10-08T07:07:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.594e-06 2023-10-08T07:07:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.828196+0000", 2023-10-08T07:07:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6340000000000003e-06 2023-10-08T07:07:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136885 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.880904+0000", 2023-10-08T07:07:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.77879641899999996, 2023-10-08T07:07:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.78816825499999998, 2023-10-08T07:07:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.350 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136885 2023-10-08T07:07:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.880904+0000", 2023-10-08T07:07:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.880904+0000", 2023-10-08T07:07:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.880904+0000", 2023-10-08T07:07:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8999999999999997e-07 2023-10-08T07:07:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.880920+0000", 2023-10-08T07:07:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5709000000000002e-05 2023-10-08T07:07:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.880927+0000", 2023-10-08T07:07:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1799999999999999e-06 2023-10-08T07:07:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.880932+0000", 2023-10-08T07:07:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0119999999999996e-06 2023-10-08T07:07:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137251 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.019089+0000", 2023-10-08T07:07:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64061146000000002, 2023-10-08T07:07:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65001372700000004, 2023-10-08T07:07:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137251 2023-10-08T07:07:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.354 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.019089+0000", 2023-10-08T07:07:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.019089+0000", 2023-10-08T07:07:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.020606+0000", 2023-10-08T07:07:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015172409999999999 2023-10-08T07:07:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.020623+0000", 2023-10-08T07:07:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7263999999999999e-05 2023-10-08T07:07:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.020634+0000", 2023-10-08T07:07:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0560999999999999e-05 2023-10-08T07:07:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.020641+0000", 2023-10-08T07:07:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.216e-06 2023-10-08T07:07:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.357 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138045 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.358 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.355514+0000", 2023-10-08T07:07:38.358 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.304186554, 2023-10-08T07:07:38.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.31363004, 2023-10-08T07:07:38.358 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.358 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.358 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138045 2023-10-08T07:07:38.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.358 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.355514+0000", 2023-10-08T07:07:38.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.355514+0000", 2023-10-08T07:07:38.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.355514+0000", 2023-10-08T07:07:38.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2023-10-08T07:07:38.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.355525+0000", 2023-10-08T07:07:38.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0730999999999999e-05 2023-10-08T07:07:38.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.355531+0000", 2023-10-08T07:07:38.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6890000000000001e-06 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.355535+0000", 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5079999999999999e-06 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144645 4.20 e61/17)", 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.659488+0000", 2023-10-08T07:07:38.361 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000212356, 2023-10-08T07:07:38.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097130789999999995, 2023-10-08T07:07:38.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.362 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.659488+0000", 2023-10-08T07:07:38.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.659488+0000", 2023-10-08T07:07:38.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.659488+0000", 2023-10-08T07:07:38.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:07:38.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.659513+0000", 2023-10-08T07:07:38.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5006000000000001e-05 2023-10-08T07:07:38.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.659527+0000", 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3247999999999999e-05 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.659532+0000", 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.609e-06 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.365 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136257 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.365 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.616713+0000", 2023-10-08T07:07:38.365 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0429870640000001, 2023-10-08T07:07:38.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.052543563, 2023-10-08T07:07:38.365 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.365 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.365 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136257 2023-10-08T07:07:38.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.366 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.616713+0000", 2023-10-08T07:07:38.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.616713+0000", 2023-10-08T07:07:38.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.616748+0000", 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5108999999999999e-05 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.616763+0000", 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4567e-05 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.616771+0000", 2023-10-08T07:07:38.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6830000000000008e-06 2023-10-08T07:07:38.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.616777+0000", 2023-10-08T07:07:38.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4969999999999998e-06 2023-10-08T07:07:38.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.368 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.368 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136469 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.368 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.722356+0000", 2023-10-08T07:07:38.369 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.93734415400000004, 2023-10-08T07:07:38.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94697206, 2023-10-08T07:07:38.369 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.369 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.369 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136469 2023-10-08T07:07:38.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.369 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.722356+0000", 2023-10-08T07:07:38.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.722356+0000", 2023-10-08T07:07:38.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.722357+0000", 2023-10-08T07:07:38.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7899999999999998e-07 2023-10-08T07:07:38.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.722374+0000", 2023-10-08T07:07:38.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7540000000000001e-05 2023-10-08T07:07:38.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.722382+0000", 2023-10-08T07:07:38.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3339999999999996e-06 2023-10-08T07:07:38.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.722388+0000", 2023-10-08T07:07:38.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2700000000000001e-06 2023-10-08T07:07:38.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.372 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.372 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136564 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.372 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.763354+0000", 2023-10-08T07:07:38.372 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.89634663299999995, 2023-10-08T07:07:38.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.90603727599999995, 2023-10-08T07:07:38.373 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.373 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.373 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136564 2023-10-08T07:07:38.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.373 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.763354+0000", 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.763354+0000", 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.763354+0000", 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.63e-07 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.763367+0000", 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.243e-05 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.763373+0000", 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7769999999999997e-06 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.763378+0000", 2023-10-08T07:07:38.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1220000000000003e-06 2023-10-08T07:07:38.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.376 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.377 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136601 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.377 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.781435+0000", 2023-10-08T07:07:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.87826517500000001, 2023-10-08T07:07:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88801851600000004, 2023-10-08T07:07:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136601 2023-10-08T07:07:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.781435+0000", 2023-10-08T07:07:38.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.781435+0000", 2023-10-08T07:07:38.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.781436+0000", 2023-10-08T07:07:38.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.781446+0000", 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0540000000000001e-05 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.781453+0000", 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1189999999999999e-06 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.781459+0000", 2023-10-08T07:07:38.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5659999999999997e-06 2023-10-08T07:07:38.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.381 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.381 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137013 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.381 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.922736+0000", 2023-10-08T07:07:38.381 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.73696427600000003, 2023-10-08T07:07:38.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.74678144000000002, 2023-10-08T07:07:38.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137013 2023-10-08T07:07:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922736+0000", 2023-10-08T07:07:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922736+0000", 2023-10-08T07:07:38.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922736+0000", 2023-10-08T07:07:38.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7399999999999998e-07 2023-10-08T07:07:38.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922753+0000", 2023-10-08T07:07:38.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6813999999999999e-05 2023-10-08T07:07:38.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922760+0000", 2023-10-08T07:07:38.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.241e-06 2023-10-08T07:07:38.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.922765+0000", 2023-10-08T07:07:38.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000001e-06 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137223 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.012322+0000", 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64737865299999997, 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65726133099999995, 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137223 2023-10-08T07:07:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012322+0000", 2023-10-08T07:07:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012322+0000", 2023-10-08T07:07:38.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012322+0000", 2023-10-08T07:07:38.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:07:38.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012334+0000", 2023-10-08T07:07:38.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1671000000000001e-05 2023-10-08T07:07:38.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012341+0000", 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.537e-06 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012717+0000", 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037549399999999998 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.389 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137504 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.389 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.107023+0000", 2023-10-08T07:07:38.389 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55267738, 2023-10-08T07:07:38.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56262688699999996, 2023-10-08T07:07:38.389 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.389 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.389 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137504 2023-10-08T07:07:38.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.390 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.107023+0000", 2023-10-08T07:07:38.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.107023+0000", 2023-10-08T07:07:38.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.107023+0000", 2023-10-08T07:07:38.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7999999999999996e-07 2023-10-08T07:07:38.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.107038+0000", 2023-10-08T07:07:38.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4663e-05 2023-10-08T07:07:38.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.107044+0000", 2023-10-08T07:07:38.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3210000000000001e-06 2023-10-08T07:07:38.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.107049+0000", 2023-10-08T07:07:38.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9559999999999996e-06 2023-10-08T07:07:38.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.392 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.393 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137996 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.393 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.341581+0000", 2023-10-08T07:07:38.393 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.31811937699999998, 2023-10-08T07:07:38.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32813261199999999, 2023-10-08T07:07:38.393 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.393 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.393 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137996 2023-10-08T07:07:38.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.393 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.341581+0000", 2023-10-08T07:07:38.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.341581+0000", 2023-10-08T07:07:38.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.343295+0000", 2023-10-08T07:07:38.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001713731 2023-10-08T07:07:38.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.343310+0000", 2023-10-08T07:07:38.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5619000000000001e-05 2023-10-08T07:07:38.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.343321+0000", 2023-10-08T07:07:38.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0302999999999999e-05 2023-10-08T07:07:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.343327+0000", 2023-10-08T07:07:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979999999999999e-06 2023-10-08T07:07:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138150 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.396 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.399618+0000", 2023-10-08T07:07:38.397 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26008199900000001, 2023-10-08T07:07:38.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27015881600000002, 2023-10-08T07:07:38.397 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.397 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.397 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.397 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.397 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.397 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138150 2023-10-08T07:07:38.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.397 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.399618+0000", 2023-10-08T07:07:38.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.399618+0000", 2023-10-08T07:07:38.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.399619+0000", 2023-10-08T07:07:38.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7e-07 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.399630+0000", 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1625e-05 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.399637+0000", 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5169999999999996e-06 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.399642+0000", 2023-10-08T07:07:38.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5419999999999996e-06 2023-10-08T07:07:38.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.400 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.400 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138332 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.400 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.473534+0000", 2023-10-08T07:07:38.400 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18616660800000001, 2023-10-08T07:07:38.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19630909299999999, 2023-10-08T07:07:38.400 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.401 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.401 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138332 2023-10-08T07:07:38.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.401 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473534+0000", 2023-10-08T07:07:38.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473534+0000", 2023-10-08T07:07:38.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473534+0000", 2023-10-08T07:07:38.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2023-10-08T07:07:38.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473547+0000", 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2625e-05 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473560+0000", 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3291e-05 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473571+0000", 2023-10-08T07:07:38.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0502e-05 2023-10-08T07:07:38.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.404 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.404 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138642 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.404 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.633439+0000", 2023-10-08T07:07:38.404 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026261484000000002, 2023-10-08T07:07:38.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.036469383000000001, 2023-10-08T07:07:38.404 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.404 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.405 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138642 2023-10-08T07:07:38.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.405 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633439+0000", 2023-10-08T07:07:38.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633439+0000", 2023-10-08T07:07:38.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633439+0000", 2023-10-08T07:07:38.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6400000000000003e-07 2023-10-08T07:07:38.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633459+0000", 2023-10-08T07:07:38.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9491e-05 2023-10-08T07:07:38.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633466+0000", 2023-10-08T07:07:38.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7519999999999996e-06 2023-10-08T07:07:38.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633472+0000", 2023-10-08T07:07:38.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2689999999999999e-06 2023-10-08T07:07:38.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.408 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.408 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138678 4.36 4:6d7df329:::10000000004.00000034:head [write 1773568~4096 in=4096b,write 2015232~4096 in=4096b,write 2179072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.408 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.646529+0000", 2023-10-08T07:07:38.408 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01317115, 2023-10-08T07:07:38.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023450122, 2023-10-08T07:07:38.408 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.409 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.409 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138678 2023-10-08T07:07:38.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.409 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646529+0000", 2023-10-08T07:07:38.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.646529+0000", 2023-10-08T07:07:38.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648293+0000", 2023-10-08T07:07:38.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00176418 2023-10-08T07:07:38.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648318+0000", 2023-10-08T07:07:38.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4803e-05 2023-10-08T07:07:38.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648332+0000", 2023-10-08T07:07:38.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3901e-05 2023-10-08T07:07:38.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648343+0000", 2023-10-08T07:07:38.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1131000000000001e-05 2023-10-08T07:07:38.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648404+0000", 2023-10-08T07:07:38.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1061000000000004e-05 2023-10-08T07:07:38.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648493+0000", 2023-10-08T07:07:38.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9289999999999994e-05 2023-10-08T07:07:38.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.412 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.413 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138703 4.f 4:f2537947:::10000000004.00000017:head [write 3694592~4096 in=4096b,write 3821568~4096 in=4096b,write 3887104~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.413 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.657282+0000", 2023-10-08T07:07:38.413 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024184839999999998, 2023-10-08T07:07:38.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012781476, 2023-10-08T07:07:38.413 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.413 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.413 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.413 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.413 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.414 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138703 2023-10-08T07:07:38.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.414 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657282+0000", 2023-10-08T07:07:38.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.657282+0000", 2023-10-08T07:07:38.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661293+0000", 2023-10-08T07:07:38.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00401082 2023-10-08T07:07:38.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661310+0000", 2023-10-08T07:07:38.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7329e-05 2023-10-08T07:07:38.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661320+0000", 2023-10-08T07:07:38.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0234000000000001e-05 2023-10-08T07:07:38.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661326+0000", 2023-10-08T07:07:38.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4569999999999996e-06 2023-10-08T07:07:38.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661374+0000", 2023-10-08T07:07:38.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8210000000000001e-05 2023-10-08T07:07:38.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661465+0000", 2023-10-08T07:07:38.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1296000000000001e-05 2023-10-08T07:07:38.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.417 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.417 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135829 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.446815+0000", 2023-10-08T07:07:38.418 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2128851059999999, 2023-10-08T07:07:38.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.223311831, 2023-10-08T07:07:38.418 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.418 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.418 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135829 2023-10-08T07:07:38.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.418 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446815+0000", 2023-10-08T07:07:38.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446815+0000", 2023-10-08T07:07:38.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446816+0000", 2023-10-08T07:07:38.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2023-10-08T07:07:38.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446827+0000", 2023-10-08T07:07:38.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1663e-05 2023-10-08T07:07:38.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446843+0000", 2023-10-08T07:07:38.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5733999999999999e-05 2023-10-08T07:07:38.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.446853+0000", 2023-10-08T07:07:38.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6560000000000004e-06 2023-10-08T07:07:38.421 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.421 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.421 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.421 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135908 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.421 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.483478+0000", 2023-10-08T07:07:38.421 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.176222385, 2023-10-08T07:07:38.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.186701314, 2023-10-08T07:07:38.422 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.422 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.422 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135908 2023-10-08T07:07:38.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.422 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.483478+0000", 2023-10-08T07:07:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.483478+0000", 2023-10-08T07:07:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.483478+0000", 2023-10-08T07:07:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4700000000000001e-07 2023-10-08T07:07:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.483492+0000", 2023-10-08T07:07:38.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3121e-05 2023-10-08T07:07:38.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.483498+0000", 2023-10-08T07:07:38.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4640000000000003e-06 2023-10-08T07:07:38.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.483503+0000", 2023-10-08T07:07:38.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7849999999999999e-06 2023-10-08T07:07:38.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.425 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.425 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136032 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.425 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.530346+0000", 2023-10-08T07:07:38.425 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.12935403, 2023-10-08T07:07:38.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1398843590000001, 2023-10-08T07:07:38.426 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.426 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.426 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136032 2023-10-08T07:07:38.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.426 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.530346+0000", 2023-10-08T07:07:38.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.530346+0000", 2023-10-08T07:07:38.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.530347+0000", 2023-10-08T07:07:38.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4899999999999995e-07 2023-10-08T07:07:38.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.530361+0000", 2023-10-08T07:07:38.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4039000000000001e-05 2023-10-08T07:07:38.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.530369+0000", 2023-10-08T07:07:38.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7449999999999995e-06 2023-10-08T07:07:38.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.530375+0000", 2023-10-08T07:07:38.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5069999999999997e-06 2023-10-08T07:07:38.429 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.429 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.429 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.429 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136258 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.429 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.616787+0000", 2023-10-08T07:07:38.429 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0429133770000001, 2023-10-08T07:07:38.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0534960529999999, 2023-10-08T07:07:38.429 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.429 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.430 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136258 2023-10-08T07:07:38.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.430 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.616787+0000", 2023-10-08T07:07:38.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.616787+0000", 2023-10-08T07:07:38.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.616788+0000", 2023-10-08T07:07:38.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6199999999999997e-07 2023-10-08T07:07:38.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.616861+0000", 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3064000000000004e-05 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.616868+0000", 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6359999999999994e-06 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.616874+0000", 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1070000000000001e-06 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.432 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.433 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136929 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.433 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.899333+0000", 2023-10-08T07:07:38.433 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.76036685999999998, 2023-10-08T07:07:38.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.77100776000000004, 2023-10-08T07:07:38.433 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.433 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.434 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136929 2023-10-08T07:07:38.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.434 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.899333+0000", 2023-10-08T07:07:38.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.899333+0000", 2023-10-08T07:07:38.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.899334+0000", 2023-10-08T07:07:38.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.46e-07 2023-10-08T07:07:38.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.899347+0000", 2023-10-08T07:07:38.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3542e-05 2023-10-08T07:07:38.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.899356+0000", 2023-10-08T07:07:38.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2740000000000007e-06 2023-10-08T07:07:38.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.899360+0000", 2023-10-08T07:07:38.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.019e-06 2023-10-08T07:07:38.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.436 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137119 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.966756+0000", 2023-10-08T07:07:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.69294403199999999, 2023-10-08T07:07:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.70363574799999995, 2023-10-08T07:07:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137119 2023-10-08T07:07:38.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.438 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.966756+0000", 2023-10-08T07:07:38.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.966756+0000", 2023-10-08T07:07:38.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.972295+0000", 2023-10-08T07:07:38.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055384379999999997 2023-10-08T07:07:38.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.972315+0000", 2023-10-08T07:07:38.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0574e-05 2023-10-08T07:07:38.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.972331+0000", 2023-10-08T07:07:38.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5403000000000001e-05 2023-10-08T07:07:38.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.972338+0000", 2023-10-08T07:07:38.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5399999999999998e-06 2023-10-08T07:07:38.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.440 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.440 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137577 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.133349+0000", 2023-10-08T07:07:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.52635113300000003, 2023-10-08T07:07:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.53709376399999997, 2023-10-08T07:07:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137577 2023-10-08T07:07:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133349+0000", 2023-10-08T07:07:38.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133349+0000", 2023-10-08T07:07:38.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133350+0000", 2023-10-08T07:07:38.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0699999999999997e-07 2023-10-08T07:07:38.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133368+0000", 2023-10-08T07:07:38.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8652e-05 2023-10-08T07:07:38.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133376+0000", 2023-10-08T07:07:38.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5379999999999997e-06 2023-10-08T07:07:38.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133381+0000", 2023-10-08T07:07:38.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5350000000000004e-06 2023-10-08T07:07:38.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.444 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.444 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137972 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.444 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.330379+0000", 2023-10-08T07:07:38.444 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.32932140900000001, 2023-10-08T07:07:38.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.34011635299999998, 2023-10-08T07:07:38.445 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.445 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.445 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137972 2023-10-08T07:07:38.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.445 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.330379+0000", 2023-10-08T07:07:38.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.330379+0000", 2023-10-08T07:07:38.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.330379+0000", 2023-10-08T07:07:38.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000005e-07 2023-10-08T07:07:38.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.330393+0000", 2023-10-08T07:07:38.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3892e-05 2023-10-08T07:07:38.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.330399+0000", 2023-10-08T07:07:38.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1480000000000003e-06 2023-10-08T07:07:38.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.330404+0000", 2023-10-08T07:07:38.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2023-10-08T07:07:38.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.448 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.448 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138151 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.448 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.399650+0000", 2023-10-08T07:07:38.448 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.260049896, 2023-10-08T07:07:38.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27089695200000002, 2023-10-08T07:07:38.449 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.449 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.449 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138151 2023-10-08T07:07:38.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.449 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.399650+0000", 2023-10-08T07:07:38.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.399650+0000", 2023-10-08T07:07:38.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.399651+0000", 2023-10-08T07:07:38.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6600000000000002e-07 2023-10-08T07:07:38.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.399663+0000", 2023-10-08T07:07:38.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2132e-05 2023-10-08T07:07:38.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.399669+0000", 2023-10-08T07:07:38.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3659999999999997e-06 2023-10-08T07:07:38.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.399675+0000", 2023-10-08T07:07:38.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5659999999999997e-06 2023-10-08T07:07:38.452 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.452 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.452 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.452 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138333 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.452 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.473743+0000", 2023-10-08T07:07:38.452 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.185957392, 2023-10-08T07:07:38.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19685713899999999, 2023-10-08T07:07:38.453 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.453 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.453 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138333 2023-10-08T07:07:38.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.453 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473743+0000", 2023-10-08T07:07:38.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.473743+0000", 2023-10-08T07:07:38.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.475300+0000", 2023-10-08T07:07:38.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001556789 2023-10-08T07:07:38.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.475318+0000", 2023-10-08T07:07:38.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7985000000000001e-05 2023-10-08T07:07:38.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.475328+0000", 2023-10-08T07:07:38.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0652000000000001e-05 2023-10-08T07:07:38.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.475336+0000", 2023-10-08T07:07:38.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2359999999999998e-06 2023-10-08T07:07:38.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.456 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.456 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138575 4.b 4.789930b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.456 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.603342+0000", 2023-10-08T07:07:38.456 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.056357936999999997, 2023-10-08T07:07:38.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067310572999999999, 2023-10-08T07:07:38.456 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.456 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.457 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138575 2023-10-08T07:07:38.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.457 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.603342+0000", 2023-10-08T07:07:38.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.603342+0000", 2023-10-08T07:07:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.603343+0000", 2023-10-08T07:07:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3499999999999996e-07 2023-10-08T07:07:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.603355+0000", 2023-10-08T07:07:38.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2184999999999999e-05 2023-10-08T07:07:38.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.603362+0000", 2023-10-08T07:07:38.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9879999999999998e-06 2023-10-08T07:07:38.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.603369+0000", 2023-10-08T07:07:38.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5649999999999998e-06 2023-10-08T07:07:38.460 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.460 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.460 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.460 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138645 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.460 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.633480+0000", 2023-10-08T07:07:38.460 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026220118000000001, 2023-10-08T07:07:38.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037226990000000001, 2023-10-08T07:07:38.460 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.460 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.460 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.461 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138645 2023-10-08T07:07:38.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.461 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633480+0000", 2023-10-08T07:07:38.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633480+0000", 2023-10-08T07:07:38.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633481+0000", 2023-10-08T07:07:38.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.32e-07 2023-10-08T07:07:38.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633496+0000", 2023-10-08T07:07:38.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5662e-05 2023-10-08T07:07:38.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633504+0000", 2023-10-08T07:07:38.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5259999999999996e-06 2023-10-08T07:07:38.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633509+0000", 2023-10-08T07:07:38.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7200000000000003e-06 2023-10-08T07:07:38.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.463 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.464 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138680 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.464 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.648372+0000", 2023-10-08T07:07:38.464 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011328146000000001, 2023-10-08T07:07:38.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022389737, 2023-10-08T07:07:38.464 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.464 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.465 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138680 2023-10-08T07:07:38.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.465 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648372+0000", 2023-10-08T07:07:38.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648372+0000", 2023-10-08T07:07:38.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648373+0000", 2023-10-08T07:07:38.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6000000000000003e-07 2023-10-08T07:07:38.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648398+0000", 2023-10-08T07:07:38.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5181000000000002e-05 2023-10-08T07:07:38.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648407+0000", 2023-10-08T07:07:38.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7809999999999994e-06 2023-10-08T07:07:38.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648413+0000", 2023-10-08T07:07:38.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5780000000000004e-06 2023-10-08T07:07:38.467 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.467 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.467 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135964 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.497460+0000", 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1622405060000001, 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1733562280000001, 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135964 2023-10-08T07:07:38.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.497460+0000", 2023-10-08T07:07:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.497460+0000", 2023-10-08T07:07:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.497460+0000", 2023-10-08T07:07:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.75e-07 2023-10-08T07:07:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.497474+0000", 2023-10-08T07:07:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.347e-05 2023-10-08T07:07:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.497480+0000", 2023-10-08T07:07:38.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8939999999999998e-06 2023-10-08T07:07:38.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.497485+0000", 2023-10-08T07:07:38.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2769999999999996e-06 2023-10-08T07:07:38.471 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.471 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.471 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.471 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136531 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.472 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.751348+0000", 2023-10-08T07:07:38.472 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.90835181600000003, 2023-10-08T07:07:38.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.91952072600000001, 2023-10-08T07:07:38.472 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.472 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.472 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136531 2023-10-08T07:07:38.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.472 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.751348+0000", 2023-10-08T07:07:38.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.751348+0000", 2023-10-08T07:07:38.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.751349+0000", 2023-10-08T07:07:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:07:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.751366+0000", 2023-10-08T07:07:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7031999999999999e-05 2023-10-08T07:07:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.751374+0000", 2023-10-08T07:07:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4789999999999999e-06 2023-10-08T07:07:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.751379+0000", 2023-10-08T07:07:38.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7799999999999997e-06 2023-10-08T07:07:38.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.475 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.475 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136643 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.475 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.789375+0000", 2023-10-08T07:07:38.475 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.87032521900000004, 2023-10-08T07:07:38.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88154897200000004, 2023-10-08T07:07:38.476 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.476 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.476 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136643 2023-10-08T07:07:38.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.476 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.789375+0000", 2023-10-08T07:07:38.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.789375+0000", 2023-10-08T07:07:38.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.789375+0000", 2023-10-08T07:07:38.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:07:38.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.789385+0000", 2023-10-08T07:07:38.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.414e-06 2023-10-08T07:07:38.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.789389+0000", 2023-10-08T07:07:38.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1529999999999999e-06 2023-10-08T07:07:38.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.789392+0000", 2023-10-08T07:07:38.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9610000000000001e-06 2023-10-08T07:07:38.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.479 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.479 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138261 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.479 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.443475+0000", 2023-10-08T07:07:38.479 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.216225695, 2023-10-08T07:07:38.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22750392699999999, 2023-10-08T07:07:38.479 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.480 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.480 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138261 2023-10-08T07:07:38.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.480 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.443475+0000", 2023-10-08T07:07:38.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.443475+0000", 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.443475+0000", 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.443489+0000", 2023-10-08T07:07:38.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3903000000000001e-05 2023-10-08T07:07:38.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.443494+0000", 2023-10-08T07:07:38.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.631e-06 2023-10-08T07:07:38.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.443499+0000", 2023-10-08T07:07:38.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6e-06 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144509 4.2b e61/17 4:d776c1c9:::10000000004.0000003d:head v 61'4548, mlcod=61'4544)", 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.618419+0000", 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.041281275999999999, 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052620976999999999, 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.618419+0000", 2023-10-08T07:07:38.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.618419+0000", 2023-10-08T07:07:38.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.618419+0000", 2023-10-08T07:07:38.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4799999999999999e-07 2023-10-08T07:07:38.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.618431+0000", 2023-10-08T07:07:38.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1155000000000001e-05 2023-10-08T07:07:38.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.618436+0000", 2023-10-08T07:07:38.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2170000000000002e-06 2023-10-08T07:07:38.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.618440+0000", 2023-10-08T07:07:38.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1629999999999998e-06 2023-10-08T07:07:38.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.632294+0000", 2023-10-08T07:07:38.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013854016 2023-10-08T07:07:38.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.632310+0000", 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6186000000000001e-05 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138681 4.3e 4:7cb83261:::10000000004.0000003b:head [write 2232320~4096 in=4096b,write 2310144~4096 in=4096b,write 2347008~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.648424+0000", 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011275792999999999, 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022688302, 2023-10-08T07:07:38.487 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.488 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.488 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138681 2023-10-08T07:07:38.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.488 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648424+0000", 2023-10-08T07:07:38.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648424+0000", 2023-10-08T07:07:38.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648425+0000", 2023-10-08T07:07:38.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6000000000000004e-07 2023-10-08T07:07:38.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648447+0000", 2023-10-08T07:07:38.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1489e-05 2023-10-08T07:07:38.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648453+0000", 2023-10-08T07:07:38.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5540000000000003e-06 2023-10-08T07:07:38.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648458+0000", 2023-10-08T07:07:38.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.147e-06 2023-10-08T07:07:38.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648543+0000", 2023-10-08T07:07:38.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4614e-05 2023-10-08T07:07:38.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648617+0000", 2023-10-08T07:07:38.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4318000000000002e-05 2023-10-08T07:07:38.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.492 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.492 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144648 4.1b e61/17)", 2023-10-08T07:07:38.492 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.661408+0000", 2023-10-08T07:07:38.492 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9982924, 2023-10-08T07:07:38.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097818520000000006, 2023-10-08T07:07:38.492 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.492 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.492 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661408+0000", 2023-10-08T07:07:38.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661408+0000", 2023-10-08T07:07:38.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661408+0000", 2023-10-08T07:07:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6399999999999998e-07 2023-10-08T07:07:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661425+0000", 2023-10-08T07:07:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7067000000000001e-05 2023-10-08T07:07:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661432+0000", 2023-10-08T07:07:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6490000000000002e-06 2023-10-08T07:07:38.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661437+0000", 2023-10-08T07:07:38.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2023-10-08T07:07:38.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.495 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.495 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135879 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.495 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.470391+0000", 2023-10-08T07:07:38.495 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1893090989999999, 2023-10-08T07:07:38.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.200852907, 2023-10-08T07:07:38.496 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.496 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.496 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135879 2023-10-08T07:07:38.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.496 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.470391+0000", 2023-10-08T07:07:38.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.470391+0000", 2023-10-08T07:07:38.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.470392+0000", 2023-10-08T07:07:38.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2023-10-08T07:07:38.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.470405+0000", 2023-10-08T07:07:38.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3514e-05 2023-10-08T07:07:38.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.470413+0000", 2023-10-08T07:07:38.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.14e-06 2023-10-08T07:07:38.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.470419+0000", 2023-10-08T07:07:38.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.716e-06 2023-10-08T07:07:38.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.499 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.499 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136367 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.499 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.668422+0000", 2023-10-08T07:07:38.499 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.99127794899999999, 2023-10-08T07:07:38.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0028868609999999, 2023-10-08T07:07:38.499 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.500 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.500 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136367 2023-10-08T07:07:38.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.500 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.668422+0000", 2023-10-08T07:07:38.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.668422+0000", 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.668423+0000", 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8299999999999996e-07 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.668444+0000", 2023-10-08T07:07:38.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0913000000000001e-05 2023-10-08T07:07:38.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.668451+0000", 2023-10-08T07:07:38.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6279999999999999e-06 2023-10-08T07:07:38.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.668456+0000", 2023-10-08T07:07:38.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2023-10-08T07:07:38.503 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.503 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.503 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.503 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136776 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.503 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.834813+0000", 2023-10-08T07:07:38.503 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.82488706599999995, 2023-10-08T07:07:38.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83655913000000004, 2023-10-08T07:07:38.503 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.503 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.504 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.504 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136776 2023-10-08T07:07:38.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.504 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834813+0000", 2023-10-08T07:07:38.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834813+0000", 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.840302+0000", 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054892580000000003 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.840328+0000", 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5607999999999999e-05 2023-10-08T07:07:38.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.840339+0000", 2023-10-08T07:07:38.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0502e-05 2023-10-08T07:07:38.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.840346+0000", 2023-10-08T07:07:38.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1740000000000003e-06 2023-10-08T07:07:38.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.506 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.507 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137254 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.507 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.021674+0000", 2023-10-08T07:07:38.507 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63802604200000002, 2023-10-08T07:07:38.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.64976109100000001, 2023-10-08T07:07:38.507 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.507 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.508 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137254 2023-10-08T07:07:38.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.508 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.021674+0000", 2023-10-08T07:07:38.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.021674+0000", 2023-10-08T07:07:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.021675+0000", 2023-10-08T07:07:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2799999999999996e-07 2023-10-08T07:07:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.021689+0000", 2023-10-08T07:07:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3760999999999999e-05 2023-10-08T07:07:38.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.021696+0000", 2023-10-08T07:07:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5460000000000003e-06 2023-10-08T07:07:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.021702+0000", 2023-10-08T07:07:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8749999999999997e-06 2023-10-08T07:07:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138063 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.373430+0000", 2023-10-08T07:07:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28627008700000001, 2023-10-08T07:07:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29807203900000001, 2023-10-08T07:07:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138063 2023-10-08T07:07:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.373430+0000", 2023-10-08T07:07:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.373430+0000", 2023-10-08T07:07:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.373431+0000", 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9900000000000001e-07 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.373450+0000", 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9743000000000001e-05 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.373458+0000", 2023-10-08T07:07:38.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7489999999999998e-06 2023-10-08T07:07:38.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.373463+0000", 2023-10-08T07:07:38.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9899999999999997e-06 2023-10-08T07:07:38.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.514 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.514 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138648 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.515 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.633565+0000", 2023-10-08T07:07:38.515 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026135491, 2023-10-08T07:07:38.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037999593999999998, 2023-10-08T07:07:38.515 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.515 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.515 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138648 2023-10-08T07:07:38.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.515 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633565+0000", 2023-10-08T07:07:38.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633565+0000", 2023-10-08T07:07:38.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633565+0000", 2023-10-08T07:07:38.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2600000000000002e-07 2023-10-08T07:07:38.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633583+0000", 2023-10-08T07:07:38.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7923000000000001e-05 2023-10-08T07:07:38.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633591+0000", 2023-10-08T07:07:38.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7200000000000006e-06 2023-10-08T07:07:38.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633597+0000", 2023-10-08T07:07:38.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.93e-06 2023-10-08T07:07:38.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.518 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.518 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138687 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.518 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.648466+0000", 2023-10-08T07:07:38.519 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011234737, 2023-10-08T07:07:38.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023165844000000001, 2023-10-08T07:07:38.519 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.519 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.519 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138687 2023-10-08T07:07:38.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.519 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648466+0000", 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648466+0000", 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648466+0000", 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:07:38.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648480+0000", 2023-10-08T07:07:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3597e-05 2023-10-08T07:07:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648486+0000", 2023-10-08T07:07:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3199999999999996e-06 2023-10-08T07:07:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.648491+0000", 2023-10-08T07:07:38.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2023-10-08T07:07:38.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.522 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.523 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144649 4.c e61/17 4:3352c333:::10000000004.00000012:head v 61'4570, mlcod=61'4565)", 2023-10-08T07:07:38.523 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.661445+0000", 2023-10-08T07:07:38.523 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9982553, 2023-10-08T07:07:38.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010255234, 2023-10-08T07:07:38.523 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.523 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661445+0000", 2023-10-08T07:07:38.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661445+0000", 2023-10-08T07:07:38.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661445+0000", 2023-10-08T07:07:38.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799999999999999e-07 2023-10-08T07:07:38.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661456+0000", 2023-10-08T07:07:38.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0264e-05 2023-10-08T07:07:38.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661461+0000", 2023-10-08T07:07:38.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.558e-06 2023-10-08T07:07:38.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661465+0000", 2023-10-08T07:07:38.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0670000000000002e-06 2023-10-08T07:07:38.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.663300+0000", 2023-10-08T07:07:38.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018344119999999999 2023-10-08T07:07:38.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.663322+0000", 2023-10-08T07:07:38.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1911000000000001e-05 2023-10-08T07:07:38.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.527 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.527 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.527 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136001 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.527 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.515403+0000", 2023-10-08T07:07:38.527 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1442971639999999, 2023-10-08T07:07:38.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1563650430000001, 2023-10-08T07:07:38.527 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.527 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136001 2023-10-08T07:07:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.515403+0000", 2023-10-08T07:07:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.515403+0000", 2023-10-08T07:07:38.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.515404+0000", 2023-10-08T07:07:38.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2699999999999999e-07 2023-10-08T07:07:38.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.515416+0000", 2023-10-08T07:07:38.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2584e-05 2023-10-08T07:07:38.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.515432+0000", 2023-10-08T07:07:38.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5531000000000001e-05 2023-10-08T07:07:38.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.515437+0000", 2023-10-08T07:07:38.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.614e-06 2023-10-08T07:07:38.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.531 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.531 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136508 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.531 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.736343+0000", 2023-10-08T07:07:38.531 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.92335769899999998, 2023-10-08T07:07:38.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93551071299999999, 2023-10-08T07:07:38.531 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.531 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.532 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136508 2023-10-08T07:07:38.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.532 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.736343+0000", 2023-10-08T07:07:38.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.736343+0000", 2023-10-08T07:07:38.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.736343+0000", 2023-10-08T07:07:38.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2e-07 2023-10-08T07:07:38.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.736357+0000", 2023-10-08T07:07:38.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3611999999999999e-05 2023-10-08T07:07:38.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.736366+0000", 2023-10-08T07:07:38.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1570000000000006e-06 2023-10-08T07:07:38.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.736371+0000", 2023-10-08T07:07:38.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0839999999999999e-06 2023-10-08T07:07:38.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.535 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.535 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136777 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.535 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.840359+0000", 2023-10-08T07:07:38.535 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.81934083999999996, 2023-10-08T07:07:38.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83154188299999998, 2023-10-08T07:07:38.536 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.536 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.536 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136777 2023-10-08T07:07:38.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.536 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.840359+0000", 2023-10-08T07:07:38.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.840359+0000", 2023-10-08T07:07:38.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.840360+0000", 2023-10-08T07:07:38.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2023-10-08T07:07:38.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.840372+0000", 2023-10-08T07:07:38.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2170999999999999e-05 2023-10-08T07:07:38.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.840379+0000", 2023-10-08T07:07:38.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.391e-06 2023-10-08T07:07:38.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.840385+0000", 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4829999999999999e-06 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137488 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.096616+0000", 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.56308393800000001, 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.57532475199999999, 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.539 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.540 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137488 2023-10-08T07:07:38.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.540 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.096616+0000", 2023-10-08T07:07:38.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.096616+0000", 2023-10-08T07:07:38.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.096617+0000", 2023-10-08T07:07:38.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9100000000000004e-07 2023-10-08T07:07:38.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.096630+0000", 2023-10-08T07:07:38.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3193000000000001e-05 2023-10-08T07:07:38.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.096636+0000", 2023-10-08T07:07:38.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1029999999999998e-06 2023-10-08T07:07:38.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.096641+0000", 2023-10-08T07:07:38.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4909999999999999e-06 2023-10-08T07:07:38.543 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.543 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.543 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.543 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137582 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.543 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.133471+0000", 2023-10-08T07:07:38.543 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.52622897700000004, 2023-10-08T07:07:38.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.53850641700000001, 2023-10-08T07:07:38.544 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.544 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.544 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.544 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.544 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.544 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137582 2023-10-08T07:07:38.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.544 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133471+0000", 2023-10-08T07:07:38.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133471+0000", 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133472+0000", 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2399999999999998e-07 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133487+0000", 2023-10-08T07:07:38.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5659999999999999e-05 2023-10-08T07:07:38.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133495+0000", 2023-10-08T07:07:38.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000003e-06 2023-10-08T07:07:38.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133500+0000", 2023-10-08T07:07:38.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4589999999999997e-06 2023-10-08T07:07:38.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.547 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.547 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137636 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.547 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.164342+0000", 2023-10-08T07:07:38.547 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.49535799800000002, 2023-10-08T07:07:38.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.50767245999999999, 2023-10-08T07:07:38.547 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.547 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137636 2023-10-08T07:07:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.164342+0000", 2023-10-08T07:07:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.164342+0000", 2023-10-08T07:07:38.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.164343+0000", 2023-10-08T07:07:38.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6800000000000001e-07 2023-10-08T07:07:38.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.164354+0000", 2023-10-08T07:07:38.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1401e-05 2023-10-08T07:07:38.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.164361+0000", 2023-10-08T07:07:38.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0199999999999997e-06 2023-10-08T07:07:38.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.164365+0000", 2023-10-08T07:07:38.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4589999999999998e-06 2023-10-08T07:07:38.550 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.551 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.551 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137776 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.551 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.235430+0000", 2023-10-08T07:07:38.551 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42427053199999998, 2023-10-08T07:07:38.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43661458600000003, 2023-10-08T07:07:38.551 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.551 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.551 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.551 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137776 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.235430+0000", 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.235430+0000", 2023-10-08T07:07:38.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.237296+0000", 2023-10-08T07:07:38.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018662259999999999 2023-10-08T07:07:38.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.237322+0000", 2023-10-08T07:07:38.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5734000000000001e-05 2023-10-08T07:07:38.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.237338+0000", 2023-10-08T07:07:38.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6427999999999999e-05 2023-10-08T07:07:38.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.237348+0000", 2023-10-08T07:07:38.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0217999999999999e-05 2023-10-08T07:07:38.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.554 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.555 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136040 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.555 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.532356+0000", 2023-10-08T07:07:38.555 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1273443300000001, 2023-10-08T07:07:38.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1397178649999999, 2023-10-08T07:07:38.555 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.555 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.555 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136040 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.532356+0000", 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.532356+0000", 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.532356+0000", 2023-10-08T07:07:38.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0699999999999997e-07 2023-10-08T07:07:38.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.532369+0000", 2023-10-08T07:07:38.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2197e-05 2023-10-08T07:07:38.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.532387+0000", 2023-10-08T07:07:38.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8434999999999999e-05 2023-10-08T07:07:38.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.532394+0000", 2023-10-08T07:07:38.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5270000000000004e-06 2023-10-08T07:07:38.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.558 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.559 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136181 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.559 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.593515+0000", 2023-10-08T07:07:38.559 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.066185272, 2023-10-08T07:07:38.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0785883329999999, 2023-10-08T07:07:38.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.559 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136181 2023-10-08T07:07:38.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.593515+0000", 2023-10-08T07:07:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.593515+0000", 2023-10-08T07:07:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.593515+0000", 2023-10-08T07:07:38.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2023-10-08T07:07:38.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.593527+0000", 2023-10-08T07:07:38.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1884e-05 2023-10-08T07:07:38.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.593533+0000", 2023-10-08T07:07:38.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1890000000000004e-06 2023-10-08T07:07:38.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.593539+0000", 2023-10-08T07:07:38.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6289999999999998e-06 2023-10-08T07:07:38.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.562 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137412 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.563 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.075358+0000", 2023-10-08T07:07:38.563 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.58434260500000001, 2023-10-08T07:07:38.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.59677492300000001, 2023-10-08T07:07:38.563 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.563 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.563 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137412 2023-10-08T07:07:38.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.563 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075358+0000", 2023-10-08T07:07:38.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075358+0000", 2023-10-08T07:07:38.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075358+0000", 2023-10-08T07:07:38.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2023-10-08T07:07:38.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075377+0000", 2023-10-08T07:07:38.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9128e-05 2023-10-08T07:07:38.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075385+0000", 2023-10-08T07:07:38.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5859999999999999e-06 2023-10-08T07:07:38.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075392+0000", 2023-10-08T07:07:38.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.255e-06 2023-10-08T07:07:38.566 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.566 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.566 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.566 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137686 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.566 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.194347+0000", 2023-10-08T07:07:38.566 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.46535321699999999, 2023-10-08T07:07:38.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47781466099999997, 2023-10-08T07:07:38.567 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.567 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.567 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.567 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.567 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.567 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137686 2023-10-08T07:07:38.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.567 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194347+0000", 2023-10-08T07:07:38.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194347+0000", 2023-10-08T07:07:38.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194348+0000", 2023-10-08T07:07:38.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2200000000000004e-07 2023-10-08T07:07:38.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194367+0000", 2023-10-08T07:07:38.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9029999999999999e-05 2023-10-08T07:07:38.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194377+0000", 2023-10-08T07:07:38.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0716999999999999e-05 2023-10-08T07:07:38.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194382+0000", 2023-10-08T07:07:38.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9509999999999997e-06 2023-10-08T07:07:38.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.570 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.570 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137717 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.570 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.208428+0000", 2023-10-08T07:07:38.570 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.45127187099999999, 2023-10-08T07:07:38.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46376251400000001, 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137717 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.208428+0000", 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.208428+0000", 2023-10-08T07:07:38.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.208429+0000", 2023-10-08T07:07:38.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4899999999999995e-07 2023-10-08T07:07:38.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.208440+0000", 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1559000000000001e-05 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.208447+0000", 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2419999999999997e-06 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.208452+0000", 2023-10-08T07:07:38.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8300000000000003e-06 2023-10-08T07:07:38.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.574 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.574 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137779 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.574 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.237361+0000", 2023-10-08T07:07:38.574 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42233913099999998, 2023-10-08T07:07:38.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.434859249, 2023-10-08T07:07:38.574 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.574 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.575 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137779 2023-10-08T07:07:38.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.575 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.237361+0000", 2023-10-08T07:07:38.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.237361+0000", 2023-10-08T07:07:38.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.237362+0000", 2023-10-08T07:07:38.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3499999999999996e-07 2023-10-08T07:07:38.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.237405+0000", 2023-10-08T07:07:38.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3154000000000001e-05 2023-10-08T07:07:38.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.237426+0000", 2023-10-08T07:07:38.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1369000000000002e-05 2023-10-08T07:07:38.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.237432+0000", 2023-10-08T07:07:38.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2023-10-08T07:07:38.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.578 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.578 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144606 4.20 e61/17 4:04004f2c:::10000000004.0000000d:head v 61'6826, mlcod=61'6818)", 2023-10-08T07:07:38.578 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.649822+0000", 2023-10-08T07:07:38.578 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0098785990000000001, 2023-10-08T07:07:38.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022429484999999999, 2023-10-08T07:07:38.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.578 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.649822+0000", 2023-10-08T07:07:38.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.649822+0000", 2023-10-08T07:07:38.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.649822+0000", 2023-10-08T07:07:38.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3300000000000001e-07 2023-10-08T07:07:38.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.649831+0000", 2023-10-08T07:07:38.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8599999999999999e-06 2023-10-08T07:07:38.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.649836+0000", 2023-10-08T07:07:38.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7620000000000003e-06 2023-10-08T07:07:38.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.649839+0000", 2023-10-08T07:07:38.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2023-10-08T07:07:38.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.660894+0000", 2023-10-08T07:07:38.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011055262999999999 2023-10-08T07:07:38.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.660916+0000", 2023-10-08T07:07:38.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2192999999999999e-05 2023-10-08T07:07:38.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.582 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.582 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144651 4.20 e61/17)", 2023-10-08T07:07:38.582 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.661996+0000", 2023-10-08T07:07:38.582 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.997704, 2023-10-08T07:07:38.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010287157999999999, 2023-10-08T07:07:38.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.583 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661996+0000", 2023-10-08T07:07:38.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661996+0000", 2023-10-08T07:07:38.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661997+0000", 2023-10-08T07:07:38.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2023-10-08T07:07:38.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.662028+0000", 2023-10-08T07:07:38.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1711999999999997e-05 2023-10-08T07:07:38.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.662039+0000", 2023-10-08T07:07:38.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.004e-05 2023-10-08T07:07:38.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.662044+0000", 2023-10-08T07:07:38.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3890000000000004e-06 2023-10-08T07:07:38.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.587 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.587 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136424 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.587 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.696352+0000", 2023-10-08T07:07:38.587 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.96334804500000004, 2023-10-08T07:07:38.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.97597121200000003, 2023-10-08T07:07:38.587 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.587 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.588 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.588 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.588 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.588 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136424 2023-10-08T07:07:38.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.588 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.696352+0000", 2023-10-08T07:07:38.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.696352+0000", 2023-10-08T07:07:38.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.696353+0000", 2023-10-08T07:07:38.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9999999999999997e-07 2023-10-08T07:07:38.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.696372+0000", 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9281999999999999e-05 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.696382+0000", 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5910000000000002e-06 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.696388+0000", 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9769999999999997e-06 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.590 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.591 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137049 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.591 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.937347+0000", 2023-10-08T07:07:38.591 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.72235291300000004, 2023-10-08T07:07:38.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.73500634300000001, 2023-10-08T07:07:38.591 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.591 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.591 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.591 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.591 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.592 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137049 2023-10-08T07:07:38.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.592 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.937347+0000", 2023-10-08T07:07:38.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.937347+0000", 2023-10-08T07:07:38.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.937348+0000", 2023-10-08T07:07:38.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6899999999999997e-07 2023-10-08T07:07:38.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.937360+0000", 2023-10-08T07:07:38.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1815e-05 2023-10-08T07:07:38.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.937365+0000", 2023-10-08T07:07:38.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8400000000000002e-06 2023-10-08T07:07:38.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.937369+0000", 2023-10-08T07:07:38.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1439999999999996e-06 2023-10-08T07:07:38.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.594 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.595 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137380 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.595 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.064392+0000", 2023-10-08T07:07:38.595 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.59530802599999999, 2023-10-08T07:07:38.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.60799544400000005, 2023-10-08T07:07:38.595 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.595 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.595 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137380 2023-10-08T07:07:38.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.596 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.064392+0000", 2023-10-08T07:07:38.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.064392+0000", 2023-10-08T07:07:38.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.064393+0000", 2023-10-08T07:07:38.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6600000000000002e-07 2023-10-08T07:07:38.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.064406+0000", 2023-10-08T07:07:38.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3696000000000001e-05 2023-10-08T07:07:38.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.064413+0000", 2023-10-08T07:07:38.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6059999999999999e-06 2023-10-08T07:07:38.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.064418+0000", 2023-10-08T07:07:38.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4999999999999999e-06 2023-10-08T07:07:38.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.598 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.599 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137687 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.599 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.194389+0000", 2023-10-08T07:07:38.599 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.46531093299999998, 2023-10-08T07:07:38.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47804103599999997, 2023-10-08T07:07:38.599 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.599 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.599 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137687 2023-10-08T07:07:38.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.599 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194389+0000", 2023-10-08T07:07:38.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194389+0000", 2023-10-08T07:07:38.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194390+0000", 2023-10-08T07:07:38.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8299999999999997e-07 2023-10-08T07:07:38.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194402+0000", 2023-10-08T07:07:38.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2043e-05 2023-10-08T07:07:38.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194406+0000", 2023-10-08T07:07:38.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.177e-06 2023-10-08T07:07:38.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194409+0000", 2023-10-08T07:07:38.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.134e-06 2023-10-08T07:07:38.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.602 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.602 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138290 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.602 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.457351+0000", 2023-10-08T07:07:38.603 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.20234944099999999, 2023-10-08T07:07:38.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.21513737999999999, 2023-10-08T07:07:38.603 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.603 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.603 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138290 2023-10-08T07:07:38.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.603 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.457351+0000", 2023-10-08T07:07:38.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.457351+0000", 2023-10-08T07:07:38.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.463296+0000", 2023-10-08T07:07:38.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059452300000000001 2023-10-08T07:07:38.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.463314+0000", 2023-10-08T07:07:38.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7655e-05 2023-10-08T07:07:38.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.463330+0000", 2023-10-08T07:07:38.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6291e-05 2023-10-08T07:07:38.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.463339+0000", 2023-10-08T07:07:38.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6049999999999998e-06 2023-10-08T07:07:38.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.606 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.606 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144555 4.2b e61/17 4:d7a77d67:::10000000004.00000029:head v 61'4551, mlcod=61'4544)", 2023-10-08T07:07:38.606 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.635328+0000", 2023-10-08T07:07:38.606 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.024371952999999998, 2023-10-08T07:07:38.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037220469999999999, 2023-10-08T07:07:38.607 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.607 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.607 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635328+0000", 2023-10-08T07:07:38.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635328+0000", 2023-10-08T07:07:38.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635329+0000", 2023-10-08T07:07:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2399999999999999e-07 2023-10-08T07:07:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635341+0000", 2023-10-08T07:07:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2469999999999999e-05 2023-10-08T07:07:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635348+0000", 2023-10-08T07:07:38.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4849999999999997e-06 2023-10-08T07:07:38.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635354+0000", 2023-10-08T07:07:38.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4289999999999998e-06 2023-10-08T07:07:38.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655335+0000", 2023-10-08T07:07:38.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019980786 2023-10-08T07:07:38.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.655355+0000", 2023-10-08T07:07:38.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9899e-05 2023-10-08T07:07:38.610 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.610 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.610 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.611 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144650 4.1b e61/17)", 2023-10-08T07:07:38.611 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.662259+0000", 2023-10-08T07:07:38.611 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9974413, 2023-10-08T07:07:38.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010327886999999999, 2023-10-08T07:07:38.611 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.611 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.611 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.662259+0000", 2023-10-08T07:07:38.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.662259+0000", 2023-10-08T07:07:38.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.662260+0000", 2023-10-08T07:07:38.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9399999999999995e-07 2023-10-08T07:07:38.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.662303+0000", 2023-10-08T07:07:38.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3306000000000002e-05 2023-10-08T07:07:38.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.662312+0000", 2023-10-08T07:07:38.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2390000000000008e-06 2023-10-08T07:07:38.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.662317+0000", 2023-10-08T07:07:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2023-10-08T07:07:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136124 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.566440+0000", 2023-10-08T07:07:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0932600269999999, 2023-10-08T07:07:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1061742320000001, 2023-10-08T07:07:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.614 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.615 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136124 2023-10-08T07:07:38.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.615 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.566440+0000", 2023-10-08T07:07:38.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.566440+0000", 2023-10-08T07:07:38.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.566441+0000", 2023-10-08T07:07:38.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.44e-07 2023-10-08T07:07:38.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.566454+0000", 2023-10-08T07:07:38.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3499000000000001e-05 2023-10-08T07:07:38.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.566465+0000", 2023-10-08T07:07:38.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0375e-05 2023-10-08T07:07:38.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.566471+0000", 2023-10-08T07:07:38.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3149999999999997e-06 2023-10-08T07:07:38.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.618 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.618 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137257 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.618 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.023401+0000", 2023-10-08T07:07:38.618 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63629948700000005, 2023-10-08T07:07:38.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.64925556100000004, 2023-10-08T07:07:38.618 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.618 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.619 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137257 2023-10-08T07:07:38.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.619 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.023401+0000", 2023-10-08T07:07:38.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.023401+0000", 2023-10-08T07:07:38.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.025297+0000", 2023-10-08T07:07:38.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018962759999999999 2023-10-08T07:07:38.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.025313+0000", 2023-10-08T07:07:38.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5829e-05 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.025321+0000", 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6699999999999994e-06 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.025326+0000", 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1919999999999996e-06 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.622 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137415 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.622 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.075433+0000", 2023-10-08T07:07:38.622 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.58426736800000001, 2023-10-08T07:07:38.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.59727822900000005, 2023-10-08T07:07:38.622 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.622 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137415 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075433+0000", 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075433+0000", 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075433+0000", 2023-10-08T07:07:38.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2023-10-08T07:07:38.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075459+0000", 2023-10-08T07:07:38.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6149e-05 2023-10-08T07:07:38.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075466+0000", 2023-10-08T07:07:38.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6170000000000003e-06 2023-10-08T07:07:38.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075471+0000", 2023-10-08T07:07:38.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2610000000000001e-06 2023-10-08T07:07:38.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.625 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.626 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137585 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.626 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.133585+0000", 2023-10-08T07:07:38.626 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.52611502300000001, 2023-10-08T07:07:38.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.53918287499999995, 2023-10-08T07:07:38.626 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.626 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.626 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137585 2023-10-08T07:07:38.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.626 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133585+0000", 2023-10-08T07:07:38.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133585+0000", 2023-10-08T07:07:38.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133586+0000", 2023-10-08T07:07:38.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6499999999999999e-07 2023-10-08T07:07:38.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133601+0000", 2023-10-08T07:07:38.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5279999999999999e-05 2023-10-08T07:07:38.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133607+0000", 2023-10-08T07:07:38.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2580000000000001e-06 2023-10-08T07:07:38.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.133612+0000", 2023-10-08T07:07:38.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1259999999999997e-06 2023-10-08T07:07:38.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.629 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.629 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137923 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.630 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.299503+0000", 2023-10-08T07:07:38.630 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.36019765399999998, 2023-10-08T07:07:38.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.37332229500000003, 2023-10-08T07:07:38.630 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.630 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.630 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137923 2023-10-08T07:07:38.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.630 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.299503+0000", 2023-10-08T07:07:38.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.299503+0000", 2023-10-08T07:07:38.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.307296+0000", 2023-10-08T07:07:38.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007793828 2023-10-08T07:07:38.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.307322+0000", 2023-10-08T07:07:38.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5703000000000001e-05 2023-10-08T07:07:38.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.307335+0000", 2023-10-08T07:07:38.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2709e-05 2023-10-08T07:07:38.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.307345+0000", 2023-10-08T07:07:38.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9480000000000003e-06 2023-10-08T07:07:38.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.633 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.633 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138579 4.3b 4.1fd270fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.633 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.607572+0000", 2023-10-08T07:07:38.633 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.052127864000000003, 2023-10-08T07:07:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065295687000000005, 2023-10-08T07:07:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138579 2023-10-08T07:07:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607572+0000", 2023-10-08T07:07:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607572+0000", 2023-10-08T07:07:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607573+0000", 2023-10-08T07:07:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0839999999999999e-06 2023-10-08T07:07:38.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607592+0000", 2023-10-08T07:07:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2023-10-08T07:07:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607601+0000", 2023-10-08T07:07:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7850000000000003e-06 2023-10-08T07:07:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607609+0000", 2023-10-08T07:07:38.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:07:38.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.637 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.637 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144611 4.20 e61/17 4:07572838:::10000000004.00000010:head v 61'6827, mlcod=61'6818)", 2023-10-08T07:07:38.637 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.651506+0000", 2023-10-08T07:07:38.637 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0081943820000000001, 2023-10-08T07:07:38.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021397880000000001, 2023-10-08T07:07:38.637 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.638 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.638 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.651506+0000", 2023-10-08T07:07:38.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.651506+0000", 2023-10-08T07:07:38.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.651507+0000", 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4199999999999995e-07 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.651525+0000", 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7946999999999999e-05 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.651535+0000", 2023-10-08T07:07:38.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0360000000000001e-05 2023-10-08T07:07:38.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.651542+0000", 2023-10-08T07:07:38.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5730000000000002e-06 2023-10-08T07:07:38.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.663098+0000", 2023-10-08T07:07:38.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011555566 2023-10-08T07:07:38.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.663116+0000", 2023-10-08T07:07:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7615999999999999e-05 2023-10-08T07:07:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144652 4.c e61/17 4:31e28161:::10000000004.00000011:head v 61'4571, mlcod=61'4565)", 2023-10-08T07:07:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.664689+0000", 2023-10-08T07:07:38.641 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9950113, 2023-10-08T07:07:38.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082506669999999997, 2023-10-08T07:07:38.642 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.642 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.642 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.664689+0000", 2023-10-08T07:07:38.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.664689+0000", 2023-10-08T07:07:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.664690+0000", 2023-10-08T07:07:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0100000000000005e-07 2023-10-08T07:07:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.664701+0000", 2023-10-08T07:07:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1596999999999999e-05 2023-10-08T07:07:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.664714+0000", 2023-10-08T07:07:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2882e-05 2023-10-08T07:07:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.664732+0000", 2023-10-08T07:07:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7761000000000002e-05 2023-10-08T07:07:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.666088+0000", 2023-10-08T07:07:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013557790000000001 2023-10-08T07:07:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.666106+0000", 2023-10-08T07:07:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8065000000000001e-05 2023-10-08T07:07:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137232 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.012870+0000", 2023-10-08T07:07:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64683012500000003, 2023-10-08T07:07:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.66011002500000004, 2023-10-08T07:07:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137232 2023-10-08T07:07:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012870+0000", 2023-10-08T07:07:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.012870+0000", 2023-10-08T07:07:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.014294+0000", 2023-10-08T07:07:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014241429999999999 2023-10-08T07:07:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.014312+0000", 2023-10-08T07:07:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7544e-05 2023-10-08T07:07:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.014325+0000", 2023-10-08T07:07:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2938999999999999e-05 2023-10-08T07:07:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.014333+0000", 2023-10-08T07:07:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8350000000000004e-06 2023-10-08T07:07:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137259 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.025335+0000", 2023-10-08T07:07:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63436527600000003, 2023-10-08T07:07:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.64767712300000002, 2023-10-08T07:07:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137259 2023-10-08T07:07:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.025335+0000", 2023-10-08T07:07:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.025335+0000", 2023-10-08T07:07:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.025335+0000", 2023-10-08T07:07:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7300000000000002e-07 2023-10-08T07:07:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.025344+0000", 2023-10-08T07:07:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1460000000000002e-06 2023-10-08T07:07:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.025349+0000", 2023-10-08T07:07:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.775e-06 2023-10-08T07:07:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.025354+0000", 2023-10-08T07:07:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9930000000000003e-06 2023-10-08T07:07:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138650 4.3b 4.1fd270fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.633643+0000", 2023-10-08T07:07:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026056761000000001, 2023-10-08T07:07:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039403981999999997, 2023-10-08T07:07:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138650 2023-10-08T07:07:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633643+0000", 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.633643+0000", 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635412+0000", 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001768501 2023-10-08T07:07:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635430+0000", 2023-10-08T07:07:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7713000000000001e-05 2023-10-08T07:07:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635442+0000", 2023-10-08T07:07:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1882000000000001e-05 2023-10-08T07:07:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635450+0000", 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5189999999999992e-06 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144614 4.38 e61/46 4:1e0977c7:::10000000004.00000022:head v 61'2288, mlcod=61'2286)", 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.651555+0000", 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0081448430000000006, 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021524215999999999, 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.651555+0000", 2023-10-08T07:07:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.651555+0000", 2023-10-08T07:07:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.651556+0000", 2023-10-08T07:07:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5900000000000003e-07 2023-10-08T07:07:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.651569+0000", 2023-10-08T07:07:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3193000000000001e-05 2023-10-08T07:07:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.651577+0000", 2023-10-08T07:07:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4950000000000008e-06 2023-10-08T07:07:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.651583+0000", 2023-10-08T07:07:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9819999999999996e-06 2023-10-08T07:07:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.663094+0000", 2023-10-08T07:07:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011510566 2023-10-08T07:07:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.663115+0000", 2023-10-08T07:07:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0910000000000001e-05 2023-10-08T07:07:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144664 4.1a e61/17 4:5a59f83a:::10000000004.00000002:head v 61'2308, mlcod=61'2305)", 2023-10-08T07:07:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.664759+0000", 2023-10-08T07:07:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9949412, 2023-10-08T07:07:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083644289999999996, 2023-10-08T07:07:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.664759+0000", 2023-10-08T07:07:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.664759+0000", 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.664759+0000", 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.89e-07 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.664769+0000", 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0141e-05 2023-10-08T07:07:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.664779+0000", 2023-10-08T07:07:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5719999999999992e-06 2023-10-08T07:07:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.664785+0000", 2023-10-08T07:07:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6729999999999997e-06 2023-10-08T07:07:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.665839+0000", 2023-10-08T07:07:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001054836 2023-10-08T07:07:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.665861+0000", 2023-10-08T07:07:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.137e-05 2023-10-08T07:07:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136351 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.652046+0000", 2023-10-08T07:07:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.007654064, 2023-10-08T07:07:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.021115741, 2023-10-08T07:07:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136351 2023-10-08T07:07:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.652046+0000", 2023-10-08T07:07:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.652046+0000", 2023-10-08T07:07:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.655294+0000", 2023-10-08T07:07:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032481709999999998 2023-10-08T07:07:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.655312+0000", 2023-10-08T07:07:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7258999999999999e-05 2023-10-08T07:07:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.655328+0000", 2023-10-08T07:07:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6820000000000002e-05 2023-10-08T07:07:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.655348+0000", 2023-10-08T07:07:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9199999999999999e-05 2023-10-08T07:07:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136512 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.738346+0000", 2023-10-08T07:07:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.92135410399999995, 2023-10-08T07:07:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93485344000000004, 2023-10-08T07:07:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136512 2023-10-08T07:07:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.738346+0000", 2023-10-08T07:07:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.738346+0000", 2023-10-08T07:07:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.738347+0000", 2023-10-08T07:07:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0500000000000004e-07 2023-10-08T07:07:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.738367+0000", 2023-10-08T07:07:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0052e-05 2023-10-08T07:07:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.738374+0000", 2023-10-08T07:07:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9269999999999999e-06 2023-10-08T07:07:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.738379+0000", 2023-10-08T07:07:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4129999999999997e-06 2023-10-08T07:07:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137108 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.961382+0000", 2023-10-08T07:07:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.69831816899999999, 2023-10-08T07:07:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.71187435600000004, 2023-10-08T07:07:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137108 2023-10-08T07:07:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.961382+0000", 2023-10-08T07:07:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.961382+0000", 2023-10-08T07:07:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.961382+0000", 2023-10-08T07:07:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4999999999999998e-07 2023-10-08T07:07:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.961391+0000", 2023-10-08T07:07:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0010000000000007e-06 2023-10-08T07:07:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.961395+0000", 2023-10-08T07:07:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.817e-06 2023-10-08T07:07:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.961399+0000", 2023-10-08T07:07:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7479999999999999e-06 2023-10-08T07:07:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137169 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.986436+0000", 2023-10-08T07:07:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67326463400000003, 2023-10-08T07:07:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.68688441899999997, 2023-10-08T07:07:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137169 2023-10-08T07:07:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.986436+0000", 2023-10-08T07:07:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.986436+0000", 2023-10-08T07:07:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.988296+0000", 2023-10-08T07:07:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018604139999999999 2023-10-08T07:07:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.988311+0000", 2023-10-08T07:07:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5097e-05 2023-10-08T07:07:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.988321+0000", 2023-10-08T07:07:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9869999999999994e-06 2023-10-08T07:07:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.988328+0000", 2023-10-08T07:07:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.99e-06 2023-10-08T07:07:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137262 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.025362+0000", 2023-10-08T07:07:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63433804199999999, 2023-10-08T07:07:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.64801726299999995, 2023-10-08T07:07:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137262 2023-10-08T07:07:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.025362+0000", 2023-10-08T07:07:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.025362+0000", 2023-10-08T07:07:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.027294+0000", 2023-10-08T07:07:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019319750000000001 2023-10-08T07:07:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.027308+0000", 2023-10-08T07:07:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3484e-05 2023-10-08T07:07:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.027316+0000", 2023-10-08T07:07:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9570000000000002e-06 2023-10-08T07:07:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.027321+0000", 2023-10-08T07:07:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2650000000000004e-06 2023-10-08T07:07:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137355 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.055393+0000", 2023-10-08T07:07:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.60430699899999996, 2023-10-08T07:07:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61804587099999997, 2023-10-08T07:07:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137355 2023-10-08T07:07:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.055393+0000", 2023-10-08T07:07:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.055393+0000", 2023-10-08T07:07:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.055394+0000", 2023-10-08T07:07:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6599999999999996e-07 2023-10-08T07:07:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.055431+0000", 2023-10-08T07:07:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7115e-05 2023-10-08T07:07:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.055440+0000", 2023-10-08T07:07:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6510000000000007e-06 2023-10-08T07:07:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.055454+0000", 2023-10-08T07:07:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4739000000000001e-05 2023-10-08T07:07:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137417 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.075519+0000", 2023-10-08T07:07:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.58418174599999995, 2023-10-08T07:07:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.597979865, 2023-10-08T07:07:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137417 2023-10-08T07:07:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075519+0000", 2023-10-08T07:07:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075519+0000", 2023-10-08T07:07:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075519+0000", 2023-10-08T07:07:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8100000000000003e-07 2023-10-08T07:07:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075539+0000", 2023-10-08T07:07:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9834999999999999e-05 2023-10-08T07:07:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075546+0000", 2023-10-08T07:07:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1720000000000001e-06 2023-10-08T07:07:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.075552+0000", 2023-10-08T07:07:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2689999999999996e-06 2023-10-08T07:07:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137750 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.223396+0000", 2023-10-08T07:07:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43630406100000002, 2023-10-08T07:07:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.45016214700000001, 2023-10-08T07:07:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137750 2023-10-08T07:07:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.223396+0000", 2023-10-08T07:07:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.223396+0000", 2023-10-08T07:07:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.225767+0000", 2023-10-08T07:07:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023708869999999999 2023-10-08T07:07:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.225788+0000", 2023-10-08T07:07:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1058999999999999e-05 2023-10-08T07:07:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.225799+0000", 2023-10-08T07:07:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1148999999999999e-05 2023-10-08T07:07:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.225809+0000", 2023-10-08T07:07:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4790000000000002e-06 2023-10-08T07:07:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138584 4.3b 4.d87b41fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.607661+0000", 2023-10-08T07:07:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.052039014000000001, 2023-10-08T07:07:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065953906000000007, 2023-10-08T07:07:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138584 2023-10-08T07:07:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607661+0000", 2023-10-08T07:07:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607661+0000", 2023-10-08T07:07:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607662+0000", 2023-10-08T07:07:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:07:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607680+0000", 2023-10-08T07:07:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8114999999999999e-05 2023-10-08T07:07:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607687+0000", 2023-10-08T07:07:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.114e-06 2023-10-08T07:07:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607693+0000", 2023-10-08T07:07:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0079999999999999e-06 2023-10-08T07:07:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138656 4.3b 4.d87b41fb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.635465+0000", 2023-10-08T07:07:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.024235175000000001, 2023-10-08T07:07:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038205471999999997, 2023-10-08T07:07:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138656 2023-10-08T07:07:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635465+0000", 2023-10-08T07:07:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635465+0000", 2023-10-08T07:07:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635466+0000", 2023-10-08T07:07:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9100000000000004e-07 2023-10-08T07:07:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635483+0000", 2023-10-08T07:07:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7484999999999999e-05 2023-10-08T07:07:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635491+0000", 2023-10-08T07:07:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2023-10-08T07:07:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.635497+0000", 2023-10-08T07:07:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8039999999999998e-06 2023-10-08T07:07:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144668 4.2b e61/17)", 2023-10-08T07:07:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.665147+0000", 2023-10-08T07:07:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9945536, 2023-10-08T07:07:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00857809, 2023-10-08T07:07:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.665147+0000", 2023-10-08T07:07:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.665147+0000", 2023-10-08T07:07:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.665147+0000", 2023-10-08T07:07:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4799999999999999e-07 2023-10-08T07:07:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.665158+0000", 2023-10-08T07:07:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1365e-05 2023-10-08T07:07:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.665168+0000", 2023-10-08T07:07:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5650000000000007e-06 2023-10-08T07:07:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.665174+0000", 2023-10-08T07:07:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8030000000000002e-06 2023-10-08T07:07:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135800 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.434998+0000", 2023-10-08T07:07:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2247023669999999, 2023-10-08T07:07:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2387748240000001, 2023-10-08T07:07:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135800 2023-10-08T07:07:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.434998+0000", 2023-10-08T07:07:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.434998+0000", 2023-10-08T07:07:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.437575+0000", 2023-10-08T07:07:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025769719999999999 2023-10-08T07:07:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.437592+0000", 2023-10-08T07:07:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6693000000000001e-05 2023-10-08T07:07:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.437602+0000", 2023-10-08T07:07:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0086e-05 2023-10-08T07:07:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.437609+0000", 2023-10-08T07:07:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0210000000000002e-06 2023-10-08T07:07:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136352 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.655361+0000", 2023-10-08T07:07:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0043395390000001, 2023-10-08T07:07:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0184656839999999, 2023-10-08T07:07:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136352 2023-10-08T07:07:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.655361+0000", 2023-10-08T07:07:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.655361+0000", 2023-10-08T07:07:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.655361+0000", 2023-10-08T07:07:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0200000000000002e-07 2023-10-08T07:07:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.655372+0000", 2023-10-08T07:07:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0711e-05 2023-10-08T07:07:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.655379+0000", 2023-10-08T07:07:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6220000000000003e-06 2023-10-08T07:07:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.655384+0000", 2023-10-08T07:07:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9540000000000003e-06 2023-10-08T07:07:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136611 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.784925+0000", 2023-10-08T07:07:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.87477534000000001, 2023-10-08T07:07:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88895501799999999, 2023-10-08T07:07:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136611 2023-10-08T07:07:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.784925+0000", 2023-10-08T07:07:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.784925+0000", 2023-10-08T07:07:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.784926+0000", 2023-10-08T07:07:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9900000000000009e-07 2023-10-08T07:07:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.784946+0000", 2023-10-08T07:07:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0360000000000002e-05 2023-10-08T07:07:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.784955+0000", 2023-10-08T07:07:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0129999999999999e-06 2023-10-08T07:07:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.784962+0000", 2023-10-08T07:07:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9099999999999999e-06 2023-10-08T07:07:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137385 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.064547+0000", 2023-10-08T07:07:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.59515359899999998, 2023-10-08T07:07:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.609388131, 2023-10-08T07:07:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137385 2023-10-08T07:07:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.064547+0000", 2023-10-08T07:07:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.064547+0000", 2023-10-08T07:07:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.064547+0000", 2023-10-08T07:07:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7599999999999997e-07 2023-10-08T07:07:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.064563+0000", 2023-10-08T07:07:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5271e-05 2023-10-08T07:07:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.064569+0000", 2023-10-08T07:07:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8600000000000004e-06 2023-10-08T07:07:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.064575+0000", 2023-10-08T07:07:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2989999999999996e-06 2023-10-08T07:07:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138010 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.345612+0000", 2023-10-08T07:07:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.31408791800000002, 2023-10-08T07:07:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32837501800000002, 2023-10-08T07:07:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138010 2023-10-08T07:07:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.345612+0000", 2023-10-08T07:07:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.345612+0000", 2023-10-08T07:07:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.347323+0000", 2023-10-08T07:07:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017103190000000001 2023-10-08T07:07:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.347339+0000", 2023-10-08T07:07:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5869999999999999e-05 2023-10-08T07:07:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.347641+0000", 2023-10-08T07:07:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030202400000000002 2023-10-08T07:07:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.347649+0000", 2023-10-08T07:07:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5450000000000003e-06 2023-10-08T07:07:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138228 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.432355+0000", 2023-10-08T07:07:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.22734506900000001, 2023-10-08T07:07:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.24168567499999999, 2023-10-08T07:07:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138228 2023-10-08T07:07:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.432355+0000", 2023-10-08T07:07:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.432355+0000", 2023-10-08T07:07:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.436299+0000", 2023-10-08T07:07:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039440880000000001 2023-10-08T07:07:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.436319+0000", 2023-10-08T07:07:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9579999999999999e-05 2023-10-08T07:07:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.436331+0000", 2023-10-08T07:07:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2483000000000001e-05 2023-10-08T07:07:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.436343+0000", 2023-10-08T07:07:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1615e-05 2023-10-08T07:07:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138585 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.607701+0000", 2023-10-08T07:07:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.051998849, 2023-10-08T07:07:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066392730999999996, 2023-10-08T07:07:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138585 2023-10-08T07:07:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607701+0000", 2023-10-08T07:07:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607701+0000", 2023-10-08T07:07:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607702+0000", 2023-10-08T07:07:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:07:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607714+0000", 2023-10-08T07:07:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2439000000000001e-05 2023-10-08T07:07:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607721+0000", 2023-10-08T07:07:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4269999999999996e-06 2023-10-08T07:07:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.607726+0000", 2023-10-08T07:07:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0930000000000002e-06 2023-10-08T07:07:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138704 4.14 4:2b72a8af:::10000000004.0000000c:head [write 491520~4096 in=4096b,write 684032~4096 in=4096b,write 712704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.661339+0000", 2023-10-08T07:07:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9983606, 2023-10-08T07:07:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012817172999999999, 2023-10-08T07:07:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138704 2023-10-08T07:07:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661339+0000", 2023-10-08T07:07:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.661339+0000", 2023-10-08T07:07:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667300+0000", 2023-10-08T07:07:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005960796 2023-10-08T07:07:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667324+0000", 2023-10-08T07:07:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3799e-05 2023-10-08T07:07:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667337+0000", 2023-10-08T07:07:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3073e-05 2023-10-08T07:07:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667347+0000", 2023-10-08T07:07:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9180000000000006e-06 2023-10-08T07:07:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.673668+0000", 2023-10-08T07:07:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063206139999999996 2023-10-08T07:07:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.673750+0000", 2023-10-08T07:07:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2358e-05 2023-10-08T07:07:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135919 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.489351+0000", 2023-10-08T07:07:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1703491539999999, 2023-10-08T07:07:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1848709470000001, 2023-10-08T07:07:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135919 2023-10-08T07:07:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489351+0000", 2023-10-08T07:07:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489351+0000", 2023-10-08T07:07:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489352+0000", 2023-10-08T07:07:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4799999999999998e-07 2023-10-08T07:07:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489365+0000", 2023-10-08T07:07:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3239e-05 2023-10-08T07:07:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489373+0000", 2023-10-08T07:07:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9829999999999996e-06 2023-10-08T07:07:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489380+0000", 2023-10-08T07:07:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9090000000000003e-06 2023-10-08T07:07:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136100 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.557435+0000", 2023-10-08T07:07:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1022652690000001, 2023-10-08T07:07:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1168402639999999, 2023-10-08T07:07:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136100 2023-10-08T07:07:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.557435+0000", 2023-10-08T07:07:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.557435+0000", 2023-10-08T07:07:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.557435+0000", 2023-10-08T07:07:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5900000000000003e-07 2023-10-08T07:07:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.557447+0000", 2023-10-08T07:07:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1678999999999999e-05 2023-10-08T07:07:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.557453+0000", 2023-10-08T07:07:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.806e-06 2023-10-08T07:07:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.557457+0000", 2023-10-08T07:07:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.566e-06 2023-10-08T07:07:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136575 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.767408+0000", 2023-10-08T07:07:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.89229203899999998, 2023-10-08T07:07:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.90692635499999996, 2023-10-08T07:07:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136575 2023-10-08T07:07:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.767408+0000", 2023-10-08T07:07:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.767408+0000", 2023-10-08T07:07:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.767409+0000", 2023-10-08T07:07:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0500000000000004e-07 2023-10-08T07:07:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.767422+0000", 2023-10-08T07:07:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2875e-05 2023-10-08T07:07:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.767428+0000", 2023-10-08T07:07:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5139999999999998e-06 2023-10-08T07:07:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.767434+0000", 2023-10-08T07:07:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0240000000000003e-06 2023-10-08T07:07:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136619 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.784974+0000", 2023-10-08T07:07:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.87472611700000003, 2023-10-08T07:07:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88941367000000005, 2023-10-08T07:07:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136619 2023-10-08T07:07:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.784974+0000", 2023-10-08T07:07:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.784974+0000", 2023-10-08T07:07:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.784975+0000", 2023-10-08T07:07:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3499999999999996e-07 2023-10-08T07:07:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.784987+0000", 2023-10-08T07:07:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2662e-05 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.784996+0000", 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6489999999999997e-06 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.785001+0000", 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4519999999999996e-06 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136705 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.816790+0000", 2023-10-08T07:07:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.84291036799999997, 2023-10-08T07:07:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.85765887600000001, 2023-10-08T07:07:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136705 2023-10-08T07:07:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.816790+0000", 2023-10-08T07:07:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.816790+0000", 2023-10-08T07:07:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.816790+0000", 2023-10-08T07:07:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2399999999999999e-07 2023-10-08T07:07:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.816803+0000", 2023-10-08T07:07:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2785999999999999e-05 2023-10-08T07:07:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.816809+0000", 2023-10-08T07:07:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.224e-06 2023-10-08T07:07:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.816814+0000", 2023-10-08T07:07:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.916e-06 2023-10-08T07:07:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136749 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.834388+0000", 2023-10-08T07:07:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.82531271500000003, 2023-10-08T07:07:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84011381699999998, 2023-10-08T07:07:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136749 2023-10-08T07:07:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834388+0000", 2023-10-08T07:07:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834388+0000", 2023-10-08T07:07:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834388+0000", 2023-10-08T07:07:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-07 2023-10-08T07:07:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834412+0000", 2023-10-08T07:07:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4239999999999998e-05 2023-10-08T07:07:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834420+0000", 2023-10-08T07:07:38.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6990000000000003e-06 2023-10-08T07:07:38.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834426+0000", 2023-10-08T07:07:38.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8710000000000002e-06 2023-10-08T07:07:38.765 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.765 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.765 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.766 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137110 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.766 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.961427+0000", 2023-10-08T07:07:38.766 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.69827323399999996, 2023-10-08T07:07:38.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.71348944400000003, 2023-10-08T07:07:38.766 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.766 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.766 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.766 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.766 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.766 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137110 2023-10-08T07:07:38.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.767 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.961427+0000", 2023-10-08T07:07:38.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.961427+0000", 2023-10-08T07:07:38.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.961427+0000", 2023-10-08T07:07:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4499999999999998e-07 2023-10-08T07:07:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.961438+0000", 2023-10-08T07:07:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0669999999999999e-05 2023-10-08T07:07:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.961441+0000", 2023-10-08T07:07:38.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5310000000000002e-06 2023-10-08T07:07:38.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.961444+0000", 2023-10-08T07:07:38.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7659999999999999e-06 2023-10-08T07:07:38.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.769 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.770 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137205 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.770 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.004529+0000", 2023-10-08T07:07:38.770 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.65517118299999999, 2023-10-08T07:07:38.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.67042129800000005, 2023-10-08T07:07:38.770 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.770 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.770 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137205 2023-10-08T07:07:38.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.770 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.004529+0000", 2023-10-08T07:07:38.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.004529+0000", 2023-10-08T07:07:38.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.004530+0000", 2023-10-08T07:07:38.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7399999999999998e-07 2023-10-08T07:07:38.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.004542+0000", 2023-10-08T07:07:38.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2686e-05 2023-10-08T07:07:38.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.004549+0000", 2023-10-08T07:07:38.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2023-10-08T07:07:38.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.004554+0000", 2023-10-08T07:07:38.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1089999999999997e-06 2023-10-08T07:07:38.773 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.773 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.773 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.773 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137264 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.774 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.027330+0000", 2023-10-08T07:07:38.774 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63237022700000001, 2023-10-08T07:07:38.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.64765539599999999, 2023-10-08T07:07:38.774 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.774 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.774 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.774 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.774 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.774 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137264 2023-10-08T07:07:38.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.774 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.027330+0000", 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.027330+0000", 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.027330+0000", 2023-10-08T07:07:38.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.27e-07 2023-10-08T07:07:38.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.027340+0000", 2023-10-08T07:07:38.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5089999999999999e-06 2023-10-08T07:07:38.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.027345+0000", 2023-10-08T07:07:38.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6489999999999999e-06 2023-10-08T07:07:38.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.027348+0000", 2023-10-08T07:07:38.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3009999999999998e-06 2023-10-08T07:07:38.777 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.777 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.777 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.777 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137754 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.777 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.225891+0000", 2023-10-08T07:07:38.777 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43380963, 2023-10-08T07:07:38.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.449124837, 2023-10-08T07:07:38.778 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.778 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.778 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.778 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.778 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.778 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137754 2023-10-08T07:07:38.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.778 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.225891+0000", 2023-10-08T07:07:38.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.225891+0000", 2023-10-08T07:07:38.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.225891+0000", 2023-10-08T07:07:38.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2023-10-08T07:07:38.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.225904+0000", 2023-10-08T07:07:38.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2598e-05 2023-10-08T07:07:38.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.225911+0000", 2023-10-08T07:07:38.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0829999999999998e-06 2023-10-08T07:07:38.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.225919+0000", 2023-10-08T07:07:38.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1529999999999997e-06 2023-10-08T07:07:38.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.781 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.781 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137782 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.781 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.240090+0000", 2023-10-08T07:07:38.781 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.419610184, 2023-10-08T07:07:38.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43495644900000002, 2023-10-08T07:07:38.781 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.782 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.782 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.782 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.782 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.782 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137782 2023-10-08T07:07:38.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.782 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.240090+0000", 2023-10-08T07:07:38.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.240090+0000", 2023-10-08T07:07:38.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.240091+0000", 2023-10-08T07:07:38.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4499999999999997e-07 2023-10-08T07:07:38.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.240103+0000", 2023-10-08T07:07:38.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2425e-05 2023-10-08T07:07:38.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.240107+0000", 2023-10-08T07:07:38.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3970000000000004e-06 2023-10-08T07:07:38.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.240111+0000", 2023-10-08T07:07:38.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.213e-06 2023-10-08T07:07:38.785 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.785 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.785 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.785 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138705 4.26 4:672c55ca:::10000000004.00000006:head [write 315392~8192 in=8192b,write 331776~4096 in=4096b,write 421888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.785 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.667362+0000", 2023-10-08T07:07:38.785 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9923387, 2023-10-08T07:07:38.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077198070000000004, 2023-10-08T07:07:38.785 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.785 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138705 2023-10-08T07:07:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667362+0000", 2023-10-08T07:07:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667362+0000", 2023-10-08T07:07:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667362+0000", 2023-10-08T07:07:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8100000000000003e-07 2023-10-08T07:07:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667376+0000", 2023-10-08T07:07:38.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4029000000000001e-05 2023-10-08T07:07:38.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667385+0000", 2023-10-08T07:07:38.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.585e-06 2023-10-08T07:07:38.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667390+0000", 2023-10-08T07:07:38.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.699e-06 2023-10-08T07:07:38.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.668554+0000", 2023-10-08T07:07:38.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0011636280000000001 2023-10-08T07:07:38.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.668649+0000", 2023-10-08T07:07:38.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2023-10-08T07:07:38.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:38.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.668827+0000", 2023-10-08T07:07:38.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017812700000000001 2023-10-08T07:07:38.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:38.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.672927+0000", 2023-10-08T07:07:38.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040996119999999999 2023-10-08T07:07:38.790 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.790 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.790 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.791 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136151 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.791 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.584338+0000", 2023-10-08T07:07:38.791 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0753621010000001, 2023-10-08T07:07:38.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0907887540000001, 2023-10-08T07:07:38.791 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.791 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.791 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136151 2023-10-08T07:07:38.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.793 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.584338+0000", 2023-10-08T07:07:38.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.584338+0000", 2023-10-08T07:07:38.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.584339+0000", 2023-10-08T07:07:38.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7199999999999999e-07 2023-10-08T07:07:38.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.584359+0000", 2023-10-08T07:07:38.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9802000000000001e-05 2023-10-08T07:07:38.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.584366+0000", 2023-10-08T07:07:38.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5379999999999997e-06 2023-10-08T07:07:38.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.584373+0000", 2023-10-08T07:07:38.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8510000000000001e-06 2023-10-08T07:07:38.795 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.795 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.796 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.796 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136751 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.796 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.834435+0000", 2023-10-08T07:07:38.796 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.825265209, 2023-10-08T07:07:38.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84072338599999996, 2023-10-08T07:07:38.796 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.796 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136751 2023-10-08T07:07:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834435+0000", 2023-10-08T07:07:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834435+0000", 2023-10-08T07:07:38.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834435+0000", 2023-10-08T07:07:38.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4299999999999998e-07 2023-10-08T07:07:38.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834453+0000", 2023-10-08T07:07:38.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7796e-05 2023-10-08T07:07:38.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834460+0000", 2023-10-08T07:07:38.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.392e-06 2023-10-08T07:07:38.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.834464+0000", 2023-10-08T07:07:38.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8239999999999999e-06 2023-10-08T07:07:38.799 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.799 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.799 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.800 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136790 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.800 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.844653+0000", 2023-10-08T07:07:38.800 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.81504682699999997, 2023-10-08T07:07:38.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83053703300000004, 2023-10-08T07:07:38.800 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.800 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.800 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.800 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.800 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.800 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136790 2023-10-08T07:07:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.844653+0000", 2023-10-08T07:07:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.844653+0000", 2023-10-08T07:07:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.844654+0000", 2023-10-08T07:07:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1100000000000001e-07 2023-10-08T07:07:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.844669+0000", 2023-10-08T07:07:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5409000000000001e-05 2023-10-08T07:07:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.844674+0000", 2023-10-08T07:07:38.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4859999999999999e-06 2023-10-08T07:07:38.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.844677+0000", 2023-10-08T07:07:38.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3699999999999999e-06 2023-10-08T07:07:38.803 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.803 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.803 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.804 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137848 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.804 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.265561+0000", 2023-10-08T07:07:38.804 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39413947700000002, 2023-10-08T07:07:38.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40968862099999998, 2023-10-08T07:07:38.804 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.804 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.804 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.804 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.804 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.804 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137848 2023-10-08T07:07:38.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.805 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.265561+0000", 2023-10-08T07:07:38.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.265561+0000", 2023-10-08T07:07:38.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.265561+0000", 2023-10-08T07:07:38.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3200000000000005e-07 2023-10-08T07:07:38.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.265575+0000", 2023-10-08T07:07:38.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3789e-05 2023-10-08T07:07:38.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.265582+0000", 2023-10-08T07:07:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9120000000000001e-06 2023-10-08T07:07:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.265587+0000", 2023-10-08T07:07:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1070000000000004e-06 2023-10-08T07:07:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.808 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138626 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.808 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.621422+0000", 2023-10-08T07:07:38.808 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.038277769000000003, 2023-10-08T07:07:38.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.053903663999999997, 2023-10-08T07:07:38.808 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.808 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.808 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138626 2023-10-08T07:07:38.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.808 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621422+0000", 2023-10-08T07:07:38.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621422+0000", 2023-10-08T07:07:38.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621423+0000", 2023-10-08T07:07:38.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7000000000000005e-07 2023-10-08T07:07:38.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621436+0000", 2023-10-08T07:07:38.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2689e-05 2023-10-08T07:07:38.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621443+0000", 2023-10-08T07:07:38.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5050000000000001e-06 2023-10-08T07:07:38.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.621449+0000", 2023-10-08T07:07:38.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8220000000000003e-06 2023-10-08T07:07:38.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.811 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.811 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138691 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.652422+0000", 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.007278624, 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022970434000000001, 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138691 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652422+0000", 2023-10-08T07:07:38.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652422+0000", 2023-10-08T07:07:38.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652422+0000", 2023-10-08T07:07:38.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4000000000000002e-07 2023-10-08T07:07:38.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652439+0000", 2023-10-08T07:07:38.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6393e-05 2023-10-08T07:07:38.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652445+0000", 2023-10-08T07:07:38.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.365e-06 2023-10-08T07:07:38.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.652450+0000", 2023-10-08T07:07:38.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0889999999999999e-06 2023-10-08T07:07:38.815 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.815 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.815 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.815 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144665 4.c e61/17 4:31e28161:::10000000004.00000011:head v 61'4572, mlcod=61'4565)", 2023-10-08T07:07:38.815 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.667944+0000", 2023-10-08T07:07:38.816 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9917564, 2023-10-08T07:07:38.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075180669999999998, 2023-10-08T07:07:38.816 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.816 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:38.816 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667944+0000", 2023-10-08T07:07:38.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667944+0000", 2023-10-08T07:07:38.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667944+0000", 2023-10-08T07:07:38.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2200000000000004e-07 2023-10-08T07:07:38.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667956+0000", 2023-10-08T07:07:38.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1738e-05 2023-10-08T07:07:38.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667966+0000", 2023-10-08T07:07:38.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8959999999999998e-06 2023-10-08T07:07:38.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667973+0000", 2023-10-08T07:07:38.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9299999999999997e-06 2023-10-08T07:07:38.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:38.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.673660+0000", 2023-10-08T07:07:38.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056871309999999998 2023-10-08T07:07:38.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:38.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.673680+0000", 2023-10-08T07:07:38.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0463999999999999e-05 2023-10-08T07:07:38.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.819 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.820 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:135927 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.820 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.489426+0000", 2023-10-08T07:07:38.820 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1702746399999999, 2023-10-08T07:07:38.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.186108172, 2023-10-08T07:07:38.820 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.820 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.820 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 135927 2023-10-08T07:07:38.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.821 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489426+0000", 2023-10-08T07:07:38.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489426+0000", 2023-10-08T07:07:38.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489426+0000", 2023-10-08T07:07:38.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8999999999999997e-07 2023-10-08T07:07:38.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489437+0000", 2023-10-08T07:07:38.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0892e-05 2023-10-08T07:07:38.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489444+0000", 2023-10-08T07:07:38.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7070000000000003e-06 2023-10-08T07:07:38.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.489450+0000", 2023-10-08T07:07:38.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4459999999999998e-06 2023-10-08T07:07:38.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.823 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136049 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.534464+0000", 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.125236315, 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1411373819999999, 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136049 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.824 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.534464+0000", 2023-10-08T07:07:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.534464+0000", 2023-10-08T07:07:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.536294+0000", 2023-10-08T07:07:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001830351 2023-10-08T07:07:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.536316+0000", 2023-10-08T07:07:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1401999999999999e-05 2023-10-08T07:07:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.536334+0000", 2023-10-08T07:07:38.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7886000000000001e-05 2023-10-08T07:07:38.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.536341+0000", 2023-10-08T07:07:38.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8050000000000007e-06 2023-10-08T07:07:38.827 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.827 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.827 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.827 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:136433 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.827 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:36.700357+0000", 2023-10-08T07:07:38.828 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.95934293599999998, 2023-10-08T07:07:38.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.97530744700000005, 2023-10-08T07:07:38.828 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.828 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.828 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 136433 2023-10-08T07:07:38.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.828 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.700357+0000", 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.700357+0000", 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.700358+0000", 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9299999999999998e-07 2023-10-08T07:07:38.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.700370+0000", 2023-10-08T07:07:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2408e-05 2023-10-08T07:07:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.700379+0000", 2023-10-08T07:07:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3489999999999992e-06 2023-10-08T07:07:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:36.700384+0000", 2023-10-08T07:07:38.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7400000000000001e-06 2023-10-08T07:07:38.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.831 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.831 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137694 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.831 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.194519+0000", 2023-10-08T07:07:38.831 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.46518144700000003, 2023-10-08T07:07:38.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48120951099999998, 2023-10-08T07:07:38.831 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.832 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.832 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137694 2023-10-08T07:07:38.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.832 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194519+0000", 2023-10-08T07:07:38.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.194519+0000", 2023-10-08T07:07:38.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.196296+0000", 2023-10-08T07:07:38.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001777332 2023-10-08T07:07:38.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.196313+0000", 2023-10-08T07:07:38.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6965000000000001e-05 2023-10-08T07:07:38.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.196323+0000", 2023-10-08T07:07:38.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0045e-05 2023-10-08T07:07:38.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.196330+0000", 2023-10-08T07:07:38.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9999999999999999e-06 2023-10-08T07:07:38.835 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.835 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.835 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.835 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:137786 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.835 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.240142+0000", 2023-10-08T07:07:38.835 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.41955860299999997, 2023-10-08T07:07:38.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.435655862, 2023-10-08T07:07:38.835 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.835 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.836 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.836 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.836 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137786 2023-10-08T07:07:38.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.836 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.240142+0000", 2023-10-08T07:07:38.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.240142+0000", 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.240142+0000", 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.240158+0000", 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5622999999999999e-05 2023-10-08T07:07:38.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.240164+0000", 2023-10-08T07:07:38.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2870000000000001e-06 2023-10-08T07:07:38.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.240169+0000", 2023-10-08T07:07:38.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339999999999997e-06 2023-10-08T07:07:38.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.838 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.839 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:138398 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2023-10-08T07:07:38.839 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.512386+0000", 2023-10-08T07:07:38.839 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14731465499999999, 2023-10-08T07:07:38.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.163476758, 2023-10-08T07:07:38.839 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.839 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:38.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:38.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:38.839 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 138398 2023-10-08T07:07:38.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.840 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.512386+0000", 2023-10-08T07:07:38.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.512386+0000", 2023-10-08T07:07:38.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.512386+0000", 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4999999999999998e-07 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.512398+0000", 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1518999999999999e-05 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.512404+0000", 2023-10-08T07:07:38.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2650000000000002e-06 2023-10-08T07:07:38.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.512409+0000", 2023-10-08T07:07:38.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8300000000000003e-06 2023-10-08T07:07:38.842 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.842 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.842 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.842 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:144658 4.1b e61/17)", 2023-10-08T07:07:38.843 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:37.667984+0000", 2023-10-08T07:07:38.843 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9917159, 2023-10-08T07:07:38.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079473310000000002, 2023-10-08T07:07:38.843 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:38.843 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:38.843 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:38.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:38.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667984+0000", 2023-10-08T07:07:38.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:38.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667984+0000", 2023-10-08T07:07:38.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:38.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:38.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667985+0000", 2023-10-08T07:07:38.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.27e-07 2023-10-08T07:07:38.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:38.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.667996+0000", 2023-10-08T07:07:38.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1353e-05 2023-10-08T07:07:38.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:38.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.668004+0000", 2023-10-08T07:07:38.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6129999999999998e-06 2023-10-08T07:07:38.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:38.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:38.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:38.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:37.668009+0000", 2023-10-08T07:07:38.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8539999999999996e-06 2023-10-08T07:07:38.845 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.846 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:38.846 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.846 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:38.846 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:38.846 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 292 2023-10-08T07:07:38.846 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:38.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:38.848 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:38.847+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:38.848 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:38.948 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:38.948+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:39.019 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:39.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T07:07:39.045 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:39.045 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:39.045 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:39.045 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:39.045 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:39.055 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:39.055 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:39.055 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:39.055 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:39.055 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:39.052+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:39.058 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:39.059 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:39.060 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:39.155 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:39.154+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:39.253 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:39.253+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:39.299 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:39.299 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:39.318 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:39.361 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:39.361+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:39.455 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:39.453+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:39.525 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:39.525 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:39.542 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:39.555 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:39.554+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:39.656 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:39.656+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:39.757 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:39.757+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:39.799 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:39.800 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:39.817 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:39.858 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:39.858+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:39.960 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:39.960+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:40.025 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2023-10-08T07:07:40.060 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:40.060+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:40.074 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:40.074 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:40.089 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:40.166 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:40.165+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:40.262 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:40.262+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:40.279 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:40.280 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:40.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:40.363 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:40.363+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:40.464 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:40.463+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:40.537 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:40.538 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:40.554 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:40.564 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:40.564+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:40.665 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:40.665+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:40.763 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:40.763 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:40.766 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:40.766+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:40.777 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:40.867 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:40.866+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:40.968 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:40.968+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:40.989 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:40.989 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:41.008 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:41.060 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:07:41.069 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:41.068+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:41.171 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:41.171+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:41.231 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:41.259 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:41.260 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:41.260 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:41.260 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:07:41.261 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:41.261 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:07:41.263 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:41.264 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:41.271 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:41.271+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:41.276 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:41.374 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:41.374+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:41.472 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:41.471+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:41.532 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:41.532 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:41.532 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:41.532 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:41.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.533 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110422 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 774144~4096,write 880640~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:41.533 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:41.533 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 15.371608605, 2023-10-08T07:07:41.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12745208799999999, 2023-10-08T07:07:41.533 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.533 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.534 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.534 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.534 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.534 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110422 2023-10-08T07:07:41.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.534 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.535 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:41.535 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.536 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:41.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.536 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.154988+0000", 2023-10-08T07:07:41.537 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7399999999999998e-07 2023-10-08T07:07:41.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.537 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.155045+0000", 2023-10-08T07:07:41.538 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6687000000000001e-05 2023-10-08T07:07:41.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.538 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.538 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.538 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.155053+0000", 2023-10-08T07:07:41.538 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5569999999999996e-06 2023-10-08T07:07:41.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.539 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.539 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.539 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.155060+0000", 2023-10-08T07:07:41.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9090000000000003e-06 2023-10-08T07:07:41.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.168971+0000", 2023-10-08T07:07:41.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013910782999999999 2023-10-08T07:07:41.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.541 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.541 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169054+0000", 2023-10-08T07:07:41.541 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3051000000000002e-05 2023-10-08T07:07:41.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.541 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.541 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.542 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.169194+0000", 2023-10-08T07:07:41.542 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013997799999999999 2023-10-08T07:07:41.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.542 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.542 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178725+0000", 2023-10-08T07:07:41.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0095310480000000003 2023-10-08T07:07:41.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.543 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.543 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282382+0000", 2023-10-08T07:07:41.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10365708 2023-10-08T07:07:41.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282416+0000", 2023-10-08T07:07:41.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4258999999999998e-05 2023-10-08T07:07:41.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.545 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.545 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.282440+0000", 2023-10-08T07:07:41.545 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3261999999999999e-05 2023-10-08T07:07:41.545 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.545 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.545 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.546 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.546 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110467 4.1a 4:5a59f83a:::10000000004.00000002:head [write 1171456~4096,write 1269760~4096,write 1388544~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:41.546 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.170266+0000", 2023-10-08T07:07:41.546 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 15.356329944000001, 2023-10-08T07:07:41.546 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.124576939, 2023-10-08T07:07:41.546 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.546 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.546 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.547 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.547 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.547 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110467 2023-10-08T07:07:41.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.547 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.547 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.547 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170266+0000", 2023-10-08T07:07:41.547 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170266+0000", 2023-10-08T07:07:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170267+0000", 2023-10-08T07:07:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2799999999999996e-07 2023-10-08T07:07:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170277+0000", 2023-10-08T07:07:41.549 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0705e-05 2023-10-08T07:07:41.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.549 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.549 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170286+0000", 2023-10-08T07:07:41.549 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3459999999999994e-06 2023-10-08T07:07:41.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.549 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.549 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.170291+0000", 2023-10-08T07:07:41.549 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4720000000000003e-06 2023-10-08T07:07:41.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.550 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.550 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.550 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179164+0000", 2023-10-08T07:07:41.550 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0088732729999999992 2023-10-08T07:07:41.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.550 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.550 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.550 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179250+0000", 2023-10-08T07:07:41.550 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5264000000000002e-05 2023-10-08T07:07:41.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.550 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.551 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.551 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.179396+0000", 2023-10-08T07:07:41.551 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014668 2023-10-08T07:07:41.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.551 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.551 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.551 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191628+0000", 2023-10-08T07:07:41.551 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012231483 2023-10-08T07:07:41.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.551 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.551 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.552 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.294751+0000", 2023-10-08T07:07:41.552 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10312267999999999 2023-10-08T07:07:41.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.552 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.552 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.552 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.294794+0000", 2023-10-08T07:07:41.552 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3467999999999998e-05 2023-10-08T07:07:41.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.552 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.552 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.552 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.294843+0000", 2023-10-08T07:07:41.552 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9039999999999998e-05 2023-10-08T07:07:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110489 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2711552~4096,write 2859008~4096,write 2887680~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.178082+0000", 2023-10-08T07:07:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 15.348513719, 2023-10-08T07:07:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.13133874200000001, 2023-10-08T07:07:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.553 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.554 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.554 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.554 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110489 2023-10-08T07:07:41.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.554 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.554 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.554 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178082+0000", 2023-10-08T07:07:41.554 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.554 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.555 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178082+0000", 2023-10-08T07:07:41.555 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.555 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.555 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.555 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178083+0000", 2023-10-08T07:07:41.555 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4000000000000001e-07 2023-10-08T07:07:41.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.555 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.555 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.555 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178094+0000", 2023-10-08T07:07:41.556 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1144e-05 2023-10-08T07:07:41.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.556 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.556 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.556 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178101+0000", 2023-10-08T07:07:41.556 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1509999999999998e-06 2023-10-08T07:07:41.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.556 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.556 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.556 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.178106+0000", 2023-10-08T07:07:41.556 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8470000000000003e-06 2023-10-08T07:07:41.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.557 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.557 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.180867+0000", 2023-10-08T07:07:41.557 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0027610529999999999 2023-10-08T07:07:41.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.557 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.557 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.180923+0000", 2023-10-08T07:07:41.557 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5770000000000003e-05 2023-10-08T07:07:41.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.557 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.558 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181024+0000", 2023-10-08T07:07:41.558 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100806 2023-10-08T07:07:41.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.558 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.558 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.558 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191634+0000", 2023-10-08T07:07:41.558 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010609809 2023-10-08T07:07:41.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.558 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.558 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.559 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309361+0000", 2023-10-08T07:07:41.559 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.117727095 2023-10-08T07:07:41.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.559 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.559 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.559 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309397+0000", 2023-10-08T07:07:41.559 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6465999999999999e-05 2023-10-08T07:07:41.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.559 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.559 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.560 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309421+0000", 2023-10-08T07:07:41.560 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3961e-05 2023-10-08T07:07:41.560 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.560 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.560 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.560 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.560 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110495 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 528384~4096,write 663552~4096,write 974848~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:41.560 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.181379+0000", 2023-10-08T07:07:41.560 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 15.345216964, 2023-10-08T07:07:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.128198539, 2023-10-08T07:07:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110495 2023-10-08T07:07:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181379+0000", 2023-10-08T07:07:41.562 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.562 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.562 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.562 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181379+0000", 2023-10-08T07:07:41.562 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.562 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.562 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.562 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181380+0000", 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2e-07 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181397+0000", 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7750000000000001e-05 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181405+0000", 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8210000000000002e-06 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.563 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.564 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.564 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181411+0000", 2023-10-08T07:07:41.564 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9479999999999996e-06 2023-10-08T07:07:41.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.564 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.564 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.564 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.183521+0000", 2023-10-08T07:07:41.564 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0021102629999999998 2023-10-08T07:07:41.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.564 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.564 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.564 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.183600+0000", 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8524999999999998e-05 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.183748+0000", 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014801300000000001 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.194292+0000", 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010544421999999999 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.565 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.566 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.566 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309480+0000", 2023-10-08T07:07:41.566 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11518740800000001 2023-10-08T07:07:41.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.566 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.566 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.566 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309538+0000", 2023-10-08T07:07:41.566 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8128999999999999e-05 2023-10-08T07:07:41.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.567 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.567 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.567 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309578+0000", 2023-10-08T07:07:41.567 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9740000000000002e-05 2023-10-08T07:07:41.567 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.567 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.567 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.568 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.568 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110498 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 892928~4096,write 1101824~4096,write 1118208~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:41.568 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.181421+0000", 2023-10-08T07:07:41.568 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 15.345174703, 2023-10-08T07:07:41.568 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12831536399999999, 2023-10-08T07:07:41.568 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.568 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.568 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.569 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.569 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.569 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110498 2023-10-08T07:07:41.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.569 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.569 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.569 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.570 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181421+0000", 2023-10-08T07:07:41.570 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.570 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.570 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.571 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181421+0000", 2023-10-08T07:07:41.571 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.571 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.571 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.571 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181422+0000", 2023-10-08T07:07:41.572 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6899999999999997e-07 2023-10-08T07:07:41.572 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.572 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.572 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.572 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181435+0000", 2023-10-08T07:07:41.573 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3217999999999999e-05 2023-10-08T07:07:41.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.573 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.573 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.573 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181443+0000", 2023-10-08T07:07:41.573 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5719999999999997e-06 2023-10-08T07:07:41.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.574 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.574 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.574 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.181449+0000", 2023-10-08T07:07:41.574 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8930000000000002e-06 2023-10-08T07:07:41.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.575 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.575 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.575 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.186316+0000", 2023-10-08T07:07:41.575 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0048669539999999997 2023-10-08T07:07:41.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.576 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.576 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.576 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.186386+0000", 2023-10-08T07:07:41.576 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0698000000000006e-05 2023-10-08T07:07:41.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.576 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.577 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.577 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.186499+0000", 2023-10-08T07:07:41.577 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000112408 2023-10-08T07:07:41.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.577 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.577 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.577 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.194298+0000", 2023-10-08T07:07:41.578 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.007799243 2023-10-08T07:07:41.578 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.578 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.578 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.578 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309638+0000", 2023-10-08T07:07:41.578 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.115339652 2023-10-08T07:07:41.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.579 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.579 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.579 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309697+0000", 2023-10-08T07:07:41.579 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9635000000000001e-05 2023-10-08T07:07:41.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.579 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.580 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.580 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309737+0000", 2023-10-08T07:07:41.580 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9521999999999999e-05 2023-10-08T07:07:41.580 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.580 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.580 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.580 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.581 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110500 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 53248~4096,write 278528~4096,write 319488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:41.581 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.182173+0000", 2023-10-08T07:07:41.581 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 15.344422858, 2023-10-08T07:07:41.581 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12767258300000001, 2023-10-08T07:07:41.581 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.581 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.581 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.581 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.581 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.581 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110500 2023-10-08T07:07:41.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.582 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.582 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.582 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.582 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182173+0000", 2023-10-08T07:07:41.582 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.582 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.583 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.583 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182173+0000", 2023-10-08T07:07:41.583 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.583 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.583 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.583 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.583 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182174+0000", 2023-10-08T07:07:41.583 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:41.583 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.583 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.583 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.583 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182191+0000", 2023-10-08T07:07:41.584 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6511000000000002e-05 2023-10-08T07:07:41.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.584 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.584 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.584 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182213+0000", 2023-10-08T07:07:41.584 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1948999999999999e-05 2023-10-08T07:07:41.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.584 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.584 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.584 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.182220+0000", 2023-10-08T07:07:41.584 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7710000000000006e-06 2023-10-08T07:07:41.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.585 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.585 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.585 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.188654+0000", 2023-10-08T07:07:41.585 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0064335299999999998 2023-10-08T07:07:41.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.585 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.585 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.585 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.188748+0000", 2023-10-08T07:07:41.585 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.433e-05 2023-10-08T07:07:41.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.585 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.586 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.586 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.188969+0000", 2023-10-08T07:07:41.586 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00022088500000000001 2023-10-08T07:07:41.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.586 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.586 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.586 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.197663+0000", 2023-10-08T07:07:41.586 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0086943860000000001 2023-10-08T07:07:41.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.586 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.586 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.587 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309781+0000", 2023-10-08T07:07:41.587 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.11211758199999999 2023-10-08T07:07:41.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.587 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.587 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.587 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309825+0000", 2023-10-08T07:07:41.587 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3955000000000002e-05 2023-10-08T07:07:41.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.587 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.587 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.587 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309846+0000", 2023-10-08T07:07:41.588 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0873000000000002e-05 2023-10-08T07:07:41.588 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.588 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.588 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.588 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.588 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:110508 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3907584~12288,write 3948544~4096,write 4030464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-10-08T07:07:41.588 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:26.184597+0000", 2023-10-08T07:07:41.588 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 15.34199929, 2023-10-08T07:07:41.588 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12538458, 2023-10-08T07:07:41.588 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.589 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.589 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.589 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.589 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.589 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 110508 2023-10-08T07:07:41.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.589 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.589 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.589 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.589 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184597+0000", 2023-10-08T07:07:41.589 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.590 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.590 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.590 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184597+0000", 2023-10-08T07:07:41.590 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.590 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.590 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.590 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184598+0000", 2023-10-08T07:07:41.590 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9299999999999997e-07 2023-10-08T07:07:41.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.591 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.591 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.591 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184609+0000", 2023-10-08T07:07:41.591 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1525999999999999e-05 2023-10-08T07:07:41.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.591 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.591 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.592 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184618+0000", 2023-10-08T07:07:41.592 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.037e-06 2023-10-08T07:07:41.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.592 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.592 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.592 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.184623+0000", 2023-10-08T07:07:41.592 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6199999999999998e-06 2023-10-08T07:07:41.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.592 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191662+0000", 2023-10-08T07:07:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0070390849999999996 2023-10-08T07:07:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191743+0000", 2023-10-08T07:07:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0982999999999994e-05 2023-10-08T07:07:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.593 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.191901+0000", 2023-10-08T07:07:41.594 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000158379 2023-10-08T07:07:41.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.594 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.594 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.594 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.200125+0000", 2023-10-08T07:07:41.594 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0082239050000000001 2023-10-08T07:07:41.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.594 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.594 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.594 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309894+0000", 2023-10-08T07:07:41.595 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.10976902099999999 2023-10-08T07:07:41.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.595 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.595 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.595 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309947+0000", 2023-10-08T07:07:41.595 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3295999999999999e-05 2023-10-08T07:07:41.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.595 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.595 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.595 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:26.309981+0000", 2023-10-08T07:07:41.595 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4035000000000002e-05 2023-10-08T07:07:41.596 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.596 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.596 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.596 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.596 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:155904 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 421888~4096,write 528384~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.596 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.344940+0000", 2023-10-08T07:07:41.596 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.18165629599999999, 2023-10-08T07:07:41.596 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.127341696, 2023-10-08T07:07:41.596 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.597 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.597 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.597 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.597 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.597 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 155904 2023-10-08T07:07:41.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.597 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.597 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.597 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.597 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.344940+0000", 2023-10-08T07:07:41.597 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.598 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.598 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.598 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.344940+0000", 2023-10-08T07:07:41.598 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.598 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.598 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.598 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.344941+0000", 2023-10-08T07:07:41.599 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1699999999999997e-07 2023-10-08T07:07:41.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.599 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.599 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.599 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.344951+0000", 2023-10-08T07:07:41.599 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8630000000000003e-06 2023-10-08T07:07:41.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.599 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.599 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.599 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.344960+0000", 2023-10-08T07:07:41.600 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8390000000000002e-06 2023-10-08T07:07:41.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.600 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.600 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.600 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.344968+0000", 2023-10-08T07:07:41.600 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6790000000000005e-06 2023-10-08T07:07:41.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.600 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.600 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.600 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.403591+0000", 2023-10-08T07:07:41.601 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058622436 2023-10-08T07:07:41.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.601 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.601 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.403662+0000", 2023-10-08T07:07:41.601 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1940999999999994e-05 2023-10-08T07:07:41.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.601 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.602 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.403795+0000", 2023-10-08T07:07:41.602 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000132533 2023-10-08T07:07:41.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.602 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.602 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.432522+0000", 2023-10-08T07:07:41.602 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.028727369999999999 2023-10-08T07:07:41.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.602 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.603 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.472196+0000", 2023-10-08T07:07:41.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.039674029999999999 2023-10-08T07:07:41.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.603 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.603 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.603 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.472248+0000", 2023-10-08T07:07:41.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1314999999999999e-05 2023-10-08T07:07:41.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.603 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.603 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.603 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.472282+0000", 2023-10-08T07:07:41.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3772999999999997e-05 2023-10-08T07:07:41.604 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.604 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.604 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.604 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:155927 4.3a 4:5f183e4b:::10000000004.00000023:head [write 794624~4096,write 970752~4096,write 1417216~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.604 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.350945+0000", 2023-10-08T07:07:41.604 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.17565070299999999, 2023-10-08T07:07:41.604 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.13815527899999999, 2023-10-08T07:07:41.604 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.604 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.605 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.605 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.605 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.605 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 155927 2023-10-08T07:07:41.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.605 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.605 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.605 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.605 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.350945+0000", 2023-10-08T07:07:41.605 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.606 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.606 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.606 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.350945+0000", 2023-10-08T07:07:41.606 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.606 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.606 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.606 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.350946+0000", 2023-10-08T07:07:41.606 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:07:41.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.607 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.607 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.350973+0000", 2023-10-08T07:07:41.607 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6720000000000002e-05 2023-10-08T07:07:41.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.607 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.607 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.350985+0000", 2023-10-08T07:07:41.607 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1977000000000001e-05 2023-10-08T07:07:41.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.608 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.608 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.350990+0000", 2023-10-08T07:07:41.608 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6420000000000004e-06 2023-10-08T07:07:41.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.608 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.608 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.608 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.410997+0000", 2023-10-08T07:07:41.608 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.060006447999999997 2023-10-08T07:07:41.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.411096+0000", 2023-10-08T07:07:41.609 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9395000000000006e-05 2023-10-08T07:07:41.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.610 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.610 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.411268+0000", 2023-10-08T07:07:41.610 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017194899999999999 2023-10-08T07:07:41.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.610 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.610 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.610 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.432642+0000", 2023-10-08T07:07:41.611 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021374074 2023-10-08T07:07:41.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.611 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.611 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.611 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.488477+0000", 2023-10-08T07:07:41.611 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055834921000000003 2023-10-08T07:07:41.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.611 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.611 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.611 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489059+0000", 2023-10-08T07:07:41.611 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00058190399999999995 2023-10-08T07:07:41.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.612 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.612 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.612 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489101+0000", 2023-10-08T07:07:41.612 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1508999999999998e-05 2023-10-08T07:07:41.612 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.612 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.612 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.613 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.613 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:155929 4.1a 4:5a59f83a:::10000000004.00000002:head [write 16384~4096,write 65536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.613 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.351499+0000", 2023-10-08T07:07:41.613 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.17509760399999999, 2023-10-08T07:07:41.613 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.13696876299999999, 2023-10-08T07:07:41.613 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.614 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.614 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.614 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.614 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.614 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 155929 2023-10-08T07:07:41.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.614 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.614 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.615 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.615 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.351499+0000", 2023-10-08T07:07:41.615 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.615 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.615 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.615 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.351499+0000", 2023-10-08T07:07:41.615 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.615 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.615 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.616 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.351499+0000", 2023-10-08T07:07:41.616 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2999999999999999e-07 2023-10-08T07:07:41.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.616 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.616 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.616 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.351512+0000", 2023-10-08T07:07:41.616 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2359e-05 2023-10-08T07:07:41.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.616 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.616 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.616 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.351525+0000", 2023-10-08T07:07:41.617 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3261999999999999e-05 2023-10-08T07:07:41.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.617 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.617 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.351533+0000", 2023-10-08T07:07:41.617 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2979999999999992e-06 2023-10-08T07:07:41.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.618 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.410436+0000", 2023-10-08T07:07:41.618 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058903016000000002 2023-10-08T07:07:41.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.619 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.619 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.410522+0000", 2023-10-08T07:07:41.619 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5599000000000005e-05 2023-10-08T07:07:41.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.619 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.619 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.619 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.410671+0000", 2023-10-08T07:07:41.620 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014895699999999999 2023-10-08T07:07:41.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.620 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.620 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.620 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.432579+0000", 2023-10-08T07:07:41.621 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021908405999999998 2023-10-08T07:07:41.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.621 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.621 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.488362+0000", 2023-10-08T07:07:41.621 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055782716000000003 2023-10-08T07:07:41.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.622 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.622 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.622 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.488421+0000", 2023-10-08T07:07:41.622 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8557999999999997e-05 2023-10-08T07:07:41.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.623 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.623 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.623 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.488467+0000", 2023-10-08T07:07:41.623 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6761999999999997e-05 2023-10-08T07:07:41.623 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.623 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.623 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.624 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.624 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:155939 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 548864~4096,write 684032~4096,write 978944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.624 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.355118+0000", 2023-10-08T07:07:41.624 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.17147820499999999, 2023-10-08T07:07:41.624 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.13426249200000001, 2023-10-08T07:07:41.624 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.625 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.625 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.625 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.625 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.625 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 155939 2023-10-08T07:07:41.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.625 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.626 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.626 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.626 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.355118+0000", 2023-10-08T07:07:41.626 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.626 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.626 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.627 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.355118+0000", 2023-10-08T07:07:41.627 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.627 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.627 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.627 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.355119+0000", 2023-10-08T07:07:41.627 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9699999999999995e-07 2023-10-08T07:07:41.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.627 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.627 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.627 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.355134+0000", 2023-10-08T07:07:41.628 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5849999999999999e-05 2023-10-08T07:07:41.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.628 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.628 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.628 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.355151+0000", 2023-10-08T07:07:41.628 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6900000000000001e-05 2023-10-08T07:07:41.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.628 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.628 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.628 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.355158+0000", 2023-10-08T07:07:41.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6340000000000003e-06 2023-10-08T07:07:41.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.630 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.630 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.419512+0000", 2023-10-08T07:07:41.630 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.064353640000000004 2023-10-08T07:07:41.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.630 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.630 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.631 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.419583+0000", 2023-10-08T07:07:41.631 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1198999999999994e-05 2023-10-08T07:07:41.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.631 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.631 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.631 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.419739+0000", 2023-10-08T07:07:41.632 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015659300000000001 2023-10-08T07:07:41.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.632 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.632 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.632 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.432697+0000", 2023-10-08T07:07:41.632 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012957879 2023-10-08T07:07:41.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.632 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.633 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.633 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489292+0000", 2023-10-08T07:07:41.633 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.056594644 2023-10-08T07:07:41.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.633 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.633 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.634 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489346+0000", 2023-10-08T07:07:41.634 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3690000000000003e-05 2023-10-08T07:07:41.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.634 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.635 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.635 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489380+0000", 2023-10-08T07:07:41.635 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4765999999999999e-05 2023-10-08T07:07:41.635 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.635 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.635 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.636 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.636 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:155947 4.2 4:43cef10a:::10000000004.00000030:head [write 1863680~4096,write 1949696~4096,write 2146304~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.636 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.357538+0000", 2023-10-08T07:07:41.636 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.169058028, 2023-10-08T07:07:41.636 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.13173204599999999, 2023-10-08T07:07:41.636 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.637 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.637 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.637 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.637 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.637 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 155947 2023-10-08T07:07:41.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.637 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.638 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.638 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.638 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.357538+0000", 2023-10-08T07:07:41.638 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.639 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.639 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.639 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.357538+0000", 2023-10-08T07:07:41.639 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.639 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.639 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.639 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.639 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.357539+0000", 2023-10-08T07:07:41.639 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7899999999999999e-07 2023-10-08T07:07:41.639 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.640 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.640 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.640 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.357550+0000", 2023-10-08T07:07:41.640 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.186e-05 2023-10-08T07:07:41.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.640 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.640 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.640 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.357558+0000", 2023-10-08T07:07:41.640 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5299999999999999e-06 2023-10-08T07:07:41.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.641 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.641 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.641 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.357563+0000", 2023-10-08T07:07:41.641 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5380000000000002e-06 2023-10-08T07:07:41.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.641 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.641 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.641 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.419456+0000", 2023-10-08T07:07:41.641 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.061892448000000003 2023-10-08T07:07:41.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.641 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.642 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.642 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.419555+0000", 2023-10-08T07:07:41.642 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9223999999999997e-05 2023-10-08T07:07:41.642 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.642 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.642 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.642 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489117+0000", 2023-10-08T07:07:41.642 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.069561488000000005 2023-10-08T07:07:41.642 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.642 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.643 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.643 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489170+0000", 2023-10-08T07:07:41.643 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3256e-05 2023-10-08T07:07:41.643 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.643 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.643 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.643 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489270+0000", 2023-10-08T07:07:41.643 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010022300000000001 2023-10-08T07:07:41.643 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.643 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.643 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.644 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.644 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.644 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:155952 4.32 4:4efc9492:::10000000004.00000032:head [write 3895296~4096,write 3948544~4096,write 3981312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.644 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.358821+0000", 2023-10-08T07:07:41.644 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.16777482899999999, 2023-10-08T07:07:41.644 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.13077192000000001, 2023-10-08T07:07:41.644 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.644 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.644 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.644 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.644 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.645 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 155952 2023-10-08T07:07:41.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.645 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.645 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.645 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.645 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.358821+0000", 2023-10-08T07:07:41.645 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.645 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.645 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.646 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.358821+0000", 2023-10-08T07:07:41.646 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.646 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.646 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.646 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.358822+0000", 2023-10-08T07:07:41.646 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9299999999999997e-07 2023-10-08T07:07:41.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.646 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.646 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.646 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.358881+0000", 2023-10-08T07:07:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8567999999999999e-05 2023-10-08T07:07:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.358899+0000", 2023-10-08T07:07:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7918e-05 2023-10-08T07:07:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.358910+0000", 2023-10-08T07:07:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1868000000000001e-05 2023-10-08T07:07:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.648 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.648 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.648 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.432680+0000", 2023-10-08T07:07:41.648 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.073769830999999994 2023-10-08T07:07:41.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.648 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.648 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.648 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.432760+0000", 2023-10-08T07:07:41.648 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9600999999999999e-05 2023-10-08T07:07:41.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.648 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.648 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.649 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489476+0000", 2023-10-08T07:07:41.649 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.056715834999999999 2023-10-08T07:07:41.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.649 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.649 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.649 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489520+0000", 2023-10-08T07:07:41.649 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3804999999999998e-05 2023-10-08T07:07:41.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.649 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.649 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.649 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489593+0000", 2023-10-08T07:07:41.649 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3701000000000005e-05 2023-10-08T07:07:41.650 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.650 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.650 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.650 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.650 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:155965 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2080768~4096,write 2097152~4096,write 2392064~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.650 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.364390+0000", 2023-10-08T07:07:41.650 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.16220568599999999, 2023-10-08T07:07:41.650 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12507606199999999, 2023-10-08T07:07:41.651 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.651 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.651 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.651 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.651 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.651 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 155965 2023-10-08T07:07:41.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.651 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.651 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.651 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.651 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.364390+0000", 2023-10-08T07:07:41.652 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.652 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.652 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.652 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.364390+0000", 2023-10-08T07:07:41.652 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.652 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.652 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.652 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.364392+0000", 2023-10-08T07:07:41.652 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3570000000000001e-06 2023-10-08T07:07:41.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.364407+0000", 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5217e-05 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.364421+0000", 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3614e-05 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.653 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.364429+0000", 2023-10-08T07:07:41.654 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6659999999999997e-06 2023-10-08T07:07:41.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.654 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.654 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.654 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.432732+0000", 2023-10-08T07:07:41.654 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.068302806999999993 2023-10-08T07:07:41.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.654 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.654 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.654 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.432838+0000", 2023-10-08T07:07:41.654 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000106148 2023-10-08T07:07:41.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.655 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.655 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.655 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.433118+0000", 2023-10-08T07:07:41.655 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00028015700000000001 2023-10-08T07:07:41.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.655 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.655 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.656 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.442722+0000", 2023-10-08T07:07:41.656 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0096039109999999997 2023-10-08T07:07:41.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.656 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.656 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.656 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489389+0000", 2023-10-08T07:07:41.656 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046666763999999999 2023-10-08T07:07:41.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.657 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.657 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.657 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489433+0000", 2023-10-08T07:07:41.657 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4169999999999999e-05 2023-10-08T07:07:41.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.658 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.658 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.658 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489466+0000", 2023-10-08T07:07:41.658 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3250999999999997e-05 2023-10-08T07:07:41.658 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:155966 4.32 4:4efc9492:::10000000004.00000032:head [write 65536~4096,write 245760~4096,write 294912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.659 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.364448+0000", 2023-10-08T07:07:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.16214842600000001, 2023-10-08T07:07:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.12546997900000001, 2023-10-08T07:07:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.660 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 155966 2023-10-08T07:07:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.364448+0000", 2023-10-08T07:07:41.661 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.364448+0000", 2023-10-08T07:07:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.663 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.663 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.663 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.364448+0000", 2023-10-08T07:07:41.663 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.58e-07 2023-10-08T07:07:41.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.364460+0000", 2023-10-08T07:07:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2309e-05 2023-10-08T07:07:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.364468+0000", 2023-10-08T07:07:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.96e-06 2023-10-08T07:07:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.364477+0000", 2023-10-08T07:07:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8810000000000002e-06 2023-10-08T07:07:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.440964+0000", 2023-10-08T07:07:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.076486870999999998 2023-10-08T07:07:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.441065+0000", 2023-10-08T07:07:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000101067 2023-10-08T07:07:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489740+0000", 2023-10-08T07:07:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048675206999999998 2023-10-08T07:07:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489838+0000", 2023-10-08T07:07:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7322000000000001e-05 2023-10-08T07:07:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489918+0000", 2023-10-08T07:07:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9903999999999999e-05 2023-10-08T07:07:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:156008 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2211840~4096,write 2220032~4096,write 2363392~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.375301+0000", 2023-10-08T07:07:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.15129551499999999, 2023-10-08T07:07:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.133459726, 2023-10-08T07:07:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 156008 2023-10-08T07:07:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.375301+0000", 2023-10-08T07:07:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.375301+0000", 2023-10-08T07:07:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.375301+0000", 2023-10-08T07:07:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8299999999999996e-07 2023-10-08T07:07:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.375310+0000", 2023-10-08T07:07:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0850000000000003e-06 2023-10-08T07:07:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.375318+0000", 2023-10-08T07:07:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9950000000000005e-06 2023-10-08T07:07:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.375324+0000", 2023-10-08T07:07:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5280000000000003e-06 2023-10-08T07:07:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.442742+0000", 2023-10-08T07:07:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.067418139000000002 2023-10-08T07:07:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.442793+0000", 2023-10-08T07:07:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0868999999999997e-05 2023-10-08T07:07:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.442896+0000", 2023-10-08T07:07:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000103269 2023-10-08T07:07:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.454674+0000", 2023-10-08T07:07:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011777673000000001 2023-10-08T07:07:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.508654+0000", 2023-10-08T07:07:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.053980141000000002 2023-10-08T07:07:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.508717+0000", 2023-10-08T07:07:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2990000000000005e-05 2023-10-08T07:07:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.508760+0000", 2023-10-08T07:07:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3353999999999999e-05 2023-10-08T07:07:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:156026 4.1a 4:5a59f83a:::10000000004.00000002:head [write 1732608~4096,write 1740800~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.380051+0000", 2023-10-08T07:07:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.146544864, 2023-10-08T07:07:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.134972855, 2023-10-08T07:07:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 156026 2023-10-08T07:07:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.380051+0000", 2023-10-08T07:07:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.380051+0000", 2023-10-08T07:07:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.380052+0000", 2023-10-08T07:07:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9200000000000002e-07 2023-10-08T07:07:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.380067+0000", 2023-10-08T07:07:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5016e-05 2023-10-08T07:07:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.380073+0000", 2023-10-08T07:07:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7050000000000002e-06 2023-10-08T07:07:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.380077+0000", 2023-10-08T07:07:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8349999999999997e-06 2023-10-08T07:07:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.449717+0000", 2023-10-08T07:07:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.069640037000000002 2023-10-08T07:07:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.449804+0000", 2023-10-08T07:07:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6510999999999999e-05 2023-10-08T07:07:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.449964+0000", 2023-10-08T07:07:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016041800000000001 2023-10-08T07:07:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.463072+0000", 2023-10-08T07:07:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013107819 2023-10-08T07:07:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.514942+0000", 2023-10-08T07:07:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.051870459000000001 2023-10-08T07:07:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.514990+0000", 2023-10-08T07:07:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7515999999999997e-05 2023-10-08T07:07:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.515024+0000", 2023-10-08T07:07:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4146999999999997e-05 2023-10-08T07:07:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:156027 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 3039232~4096,write 3469312~4096,write 3690496~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.380323+0000", 2023-10-08T07:07:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.14627348100000001, 2023-10-08T07:07:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.138980781, 2023-10-08T07:07:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 156027 2023-10-08T07:07:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.380323+0000", 2023-10-08T07:07:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.380323+0000", 2023-10-08T07:07:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.380323+0000", 2023-10-08T07:07:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7199999999999999e-07 2023-10-08T07:07:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.380341+0000", 2023-10-08T07:07:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7890999999999999e-05 2023-10-08T07:07:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.380348+0000", 2023-10-08T07:07:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9920000000000001e-06 2023-10-08T07:07:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.380352+0000", 2023-10-08T07:07:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6399999999999999e-06 2023-10-08T07:07:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.454711+0000", 2023-10-08T07:07:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.074359826000000004 2023-10-08T07:07:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.454795+0000", 2023-10-08T07:07:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3114000000000004e-05 2023-10-08T07:07:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.455170+0000", 2023-10-08T07:07:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00037560099999999998 2023-10-08T07:07:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.489274+0000", 2023-10-08T07:07:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.034103650999999999 2023-10-08T07:07:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.519205+0000", 2023-10-08T07:07:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.029931388999999999 2023-10-08T07:07:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.519264+0000", 2023-10-08T07:07:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8652e-05 2023-10-08T07:07:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.519303+0000", 2023-10-08T07:07:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9552999999999999e-05 2023-10-08T07:07:41.709 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:156031 4.32 4:4efc9492:::10000000004.00000032:head [write 4005888~4096,write 4087808~4096,write 4124672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.710 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.381343+0000", 2023-10-08T07:07:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.145253306, 2023-10-08T07:07:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.138092364, 2023-10-08T07:07:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.711 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 156031 2023-10-08T07:07:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.381343+0000", 2023-10-08T07:07:41.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.381343+0000", 2023-10-08T07:07:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.381343+0000", 2023-10-08T07:07:41.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2500000000000001e-07 2023-10-08T07:07:41.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.381391+0000", 2023-10-08T07:07:41.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7858000000000002e-05 2023-10-08T07:07:41.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.381399+0000", 2023-10-08T07:07:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5429999999999996e-06 2023-10-08T07:07:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.381406+0000", 2023-10-08T07:07:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3359999999999997e-06 2023-10-08T07:07:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.463114+0000", 2023-10-08T07:07:41.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.081708355999999996 2023-10-08T07:07:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.463209+0000", 2023-10-08T07:07:41.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4381000000000003e-05 2023-10-08T07:07:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.519314+0000", 2023-10-08T07:07:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.056105546999999999 2023-10-08T07:07:41.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.519362+0000", 2023-10-08T07:07:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7531999999999998e-05 2023-10-08T07:07:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.720 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.519435+0000", 2023-10-08T07:07:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3386000000000005e-05 2023-10-08T07:07:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.721 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:156041 4.32 4:4efc9492:::10000000004.00000032:head [write 819200~4096,write 827392~4096,write 888832~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:41.384839+0000", 2023-10-08T07:07:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.141756614, 2023-10-08T07:07:41.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.134714167, 2023-10-08T07:07:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:41.723 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 156041 2023-10-08T07:07:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.384839+0000", 2023-10-08T07:07:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.384839+0000", 2023-10-08T07:07:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.384841+0000", 2023-10-08T07:07:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0249999999999999e-06 2023-10-08T07:07:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.384861+0000", 2023-10-08T07:07:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0713e-05 2023-10-08T07:07:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:41.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.384878+0000", 2023-10-08T07:07:41.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6365999999999999e-05 2023-10-08T07:07:41.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.384888+0000", 2023-10-08T07:07:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0669000000000001e-05 2023-10-08T07:07:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.466068+0000", 2023-10-08T07:07:41.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.081180107000000001 2023-10-08T07:07:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.466156+0000", 2023-10-08T07:07:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8092999999999998e-05 2023-10-08T07:07:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.519443+0000", 2023-10-08T07:07:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.053286030999999998 2023-10-08T07:07:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.519488+0000", 2023-10-08T07:07:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5621000000000002e-05 2023-10-08T07:07:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:41.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:41.519554+0000", 2023-10-08T07:07:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5542000000000004e-05 2023-10-08T07:07:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:41.733 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:41.733 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:41.734 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:41.733+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:41.735 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:41.838 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:41.835+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:41.936 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:41.935+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:41.947 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:41.947 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147962 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.727495+0000", 2023-10-08T07:07:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.207738754, 2023-10-08T07:07:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.207757784, 2023-10-08T07:07:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.948 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147962 2023-10-08T07:07:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.727495+0000", 2023-10-08T07:07:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.727495+0000", 2023-10-08T07:07:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.727495+0000", 2023-10-08T07:07:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.82e-07 2023-10-08T07:07:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.727509+0000", 2023-10-08T07:07:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3200000000000001e-05 2023-10-08T07:07:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.727515+0000", 2023-10-08T07:07:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.905e-06 2023-10-08T07:07:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.727521+0000", 2023-10-08T07:07:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5110000000000003e-06 2023-10-08T07:07:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157709 4.38 e62/46 4:1e0977c7:::10000000004.00000022:head v 62'2486, mlcod=62'2483)", 2023-10-08T07:07:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.913819+0000", 2023-10-08T07:07:41.952 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.021414208000000001, 2023-10-08T07:07:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021479543, 2023-10-08T07:07:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.913819+0000", 2023-10-08T07:07:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.913819+0000", 2023-10-08T07:07:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.913820+0000", 2023-10-08T07:07:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2600000000000002e-07 2023-10-08T07:07:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.913833+0000", 2023-10-08T07:07:41.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2916e-05 2023-10-08T07:07:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.913847+0000", 2023-10-08T07:07:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4378e-05 2023-10-08T07:07:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.913855+0000", 2023-10-08T07:07:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1030000000000002e-06 2023-10-08T07:07:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.922229+0000", 2023-10-08T07:07:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083737410000000005 2023-10-08T07:07:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.922251+0000", 2023-10-08T07:07:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2082999999999998e-05 2023-10-08T07:07:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:41.956 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157775 4.30 e62/17)", 2023-10-08T07:07:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.930802+0000", 2023-10-08T07:07:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.004431936, 2023-10-08T07:07:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004530521, 2023-10-08T07:07:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:41.957 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.930802+0000", 2023-10-08T07:07:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.930802+0000", 2023-10-08T07:07:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.930802+0000", 2023-10-08T07:07:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4499999999999997e-07 2023-10-08T07:07:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.930815+0000", 2023-10-08T07:07:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2683999999999999e-05 2023-10-08T07:07:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:41.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.930825+0000", 2023-10-08T07:07:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0501e-05 2023-10-08T07:07:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.930832+0000", 2023-10-08T07:07:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8730000000000001e-06 2023-10-08T07:07:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.960 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146955 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.318568+0000", 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61666570099999996, 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61679189999999995, 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146955 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.318568+0000", 2023-10-08T07:07:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.318568+0000", 2023-10-08T07:07:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.318568+0000", 2023-10-08T07:07:41.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0900000000000001e-07 2023-10-08T07:07:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.318577+0000", 2023-10-08T07:07:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5939999999999994e-06 2023-10-08T07:07:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.318586+0000", 2023-10-08T07:07:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7729999999999994e-06 2023-10-08T07:07:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.318590+0000", 2023-10-08T07:07:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0639999999999998e-06 2023-10-08T07:07:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147460 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.526386+0000", 2023-10-08T07:07:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.40884725700000002, 2023-10-08T07:07:41.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40900450100000002, 2023-10-08T07:07:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147460 2023-10-08T07:07:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:41.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.526386+0000", 2023-10-08T07:07:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.526386+0000", 2023-10-08T07:07:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.526387+0000", 2023-10-08T07:07:41.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4900000000000005e-07 2023-10-08T07:07:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.526402+0000", 2023-10-08T07:07:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4486e-05 2023-10-08T07:07:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.526412+0000", 2023-10-08T07:07:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0189e-05 2023-10-08T07:07:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.526420+0000", 2023-10-08T07:07:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7749999999999993e-06 2023-10-08T07:07:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147481 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.533405+0000", 2023-10-08T07:07:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.40182839100000001, 2023-10-08T07:07:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40201746799999999, 2023-10-08T07:07:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147481 2023-10-08T07:07:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:41.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533405+0000", 2023-10-08T07:07:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533405+0000", 2023-10-08T07:07:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533406+0000", 2023-10-08T07:07:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4099999999999999e-07 2023-10-08T07:07:41.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533423+0000", 2023-10-08T07:07:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7638e-05 2023-10-08T07:07:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533434+0000", 2023-10-08T07:07:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1197e-05 2023-10-08T07:07:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533442+0000", 2023-10-08T07:07:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4399999999999999e-06 2023-10-08T07:07:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157702 4.20 e62/17 4:05b3915c:::10000000004.00000016:head v 62'7448, mlcod=62'7441)", 2023-10-08T07:07:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.913868+0000", 2023-10-08T07:07:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.021365823999999999, 2023-10-08T07:07:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021612645999999999, 2023-10-08T07:07:41.972 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.913868+0000", 2023-10-08T07:07:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.913868+0000", 2023-10-08T07:07:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.913868+0000", 2023-10-08T07:07:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5499999999999999e-07 2023-10-08T07:07:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.913878+0000", 2023-10-08T07:07:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9140000000000003e-06 2023-10-08T07:07:41.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.913888+0000", 2023-10-08T07:07:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0057999999999999e-05 2023-10-08T07:07:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.913894+0000", 2023-10-08T07:07:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1689999999999997e-06 2023-10-08T07:07:41.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.922632+0000", 2023-10-08T07:07:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087381950000000007 2023-10-08T07:07:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.922649+0000", 2023-10-08T07:07:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6767000000000001e-05 2023-10-08T07:07:41.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157582 4.3a e62/17 4:5f183e4b:::10000000004.00000023:head v 62'7231, mlcod=62'7225)", 2023-10-08T07:07:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.931005+0000", 2023-10-08T07:07:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0042289169999999996, 2023-10-08T07:07:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045443719999999996, 2023-10-08T07:07:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:41.977 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931005+0000", 2023-10-08T07:07:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931005+0000", 2023-10-08T07:07:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931005+0000", 2023-10-08T07:07:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.37e-07 2023-10-08T07:07:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931019+0000", 2023-10-08T07:07:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3366e-05 2023-10-08T07:07:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:41.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931027+0000", 2023-10-08T07:07:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1689999999999992e-06 2023-10-08T07:07:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931033+0000", 2023-10-08T07:07:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3740000000000003e-06 2023-10-08T07:07:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931320+0000", 2023-10-08T07:07:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00028692799999999999 2023-10-08T07:07:41.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931338+0000", 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7737999999999999e-05 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146852 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.281359+0000", 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.65387453299999998, 2023-10-08T07:07:41.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65423346400000004, 2023-10-08T07:07:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146852 2023-10-08T07:07:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.281359+0000", 2023-10-08T07:07:41.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.281359+0000", 2023-10-08T07:07:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.281360+0000", 2023-10-08T07:07:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0500000000000003e-07 2023-10-08T07:07:41.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.281374+0000", 2023-10-08T07:07:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4025999999999999e-05 2023-10-08T07:07:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.281381+0000", 2023-10-08T07:07:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5850000000000002e-06 2023-10-08T07:07:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.281389+0000", 2023-10-08T07:07:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5120000000000002e-06 2023-10-08T07:07:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147525 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:41.985 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39341348399999998, 2023-10-08T07:07:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39380621599999999, 2023-10-08T07:07:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147525 2023-10-08T07:07:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.986 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545293+0000", 2023-10-08T07:07:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034732809999999999 2023-10-08T07:07:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545312+0000", 2023-10-08T07:07:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8156999999999999e-05 2023-10-08T07:07:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545323+0000", 2023-10-08T07:07:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1215e-05 2023-10-08T07:07:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545331+0000", 2023-10-08T07:07:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2859999999999999e-06 2023-10-08T07:07:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148146 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.819470+0000", 2023-10-08T07:07:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.115763123, 2023-10-08T07:07:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116203427, 2023-10-08T07:07:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:41.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148146 2023-10-08T07:07:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.819470+0000", 2023-10-08T07:07:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.819470+0000", 2023-10-08T07:07:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.819471+0000", 2023-10-08T07:07:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0100000000000004e-07 2023-10-08T07:07:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.819485+0000", 2023-10-08T07:07:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4090000000000001e-05 2023-10-08T07:07:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.819494+0000", 2023-10-08T07:07:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.098e-06 2023-10-08T07:07:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.819501+0000", 2023-10-08T07:07:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2023-10-08T07:07:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.994 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148240 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.868546+0000", 2023-10-08T07:07:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.06668731, 2023-10-08T07:07:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067189833000000004, 2023-10-08T07:07:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148240 2023-10-08T07:07:41.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.868546+0000", 2023-10-08T07:07:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.868546+0000", 2023-10-08T07:07:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.868547+0000", 2023-10-08T07:07:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5199999999999996e-07 2023-10-08T07:07:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.868561+0000", 2023-10-08T07:07:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4068e-05 2023-10-08T07:07:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.868568+0000", 2023-10-08T07:07:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.391e-06 2023-10-08T07:07:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.868574+0000", 2023-10-08T07:07:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8760000000000002e-06 2023-10-08T07:07:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148353 4.16 4:69eefec8:::10000000004.0000003a:head [write 2568192~4096 in=4096b,write 2756608~4096 in=4096b,write 2867200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.929418+0000", 2023-10-08T07:07:41.999 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0058151460000000002, 2023-10-08T07:07:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006384954, 2023-10-08T07:07:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148353 2023-10-08T07:07:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.929418+0000", 2023-10-08T07:07:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.929418+0000", 2023-10-08T07:07:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931294+0000", 2023-10-08T07:07:42.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001875306 2023-10-08T07:07:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931314+0000", 2023-10-08T07:07:42.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.035e-05 2023-10-08T07:07:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931325+0000", 2023-10-08T07:07:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0781000000000001e-05 2023-10-08T07:07:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931332+0000", 2023-10-08T07:07:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3950000000000003e-06 2023-10-08T07:07:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931405+0000", 2023-10-08T07:07:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2501000000000003e-05 2023-10-08T07:07:42.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931482+0000", 2023-10-08T07:07:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7119999999999993e-05 2023-10-08T07:07:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931618+0000", 2023-10-08T07:07:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013585299999999999 2023-10-08T07:07:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.007 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146915 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.308402+0000", 2023-10-08T07:07:42.008 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.62683163799999997, 2023-10-08T07:07:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.62749168600000005, 2023-10-08T07:07:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.009 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146915 2023-10-08T07:07:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.308402+0000", 2023-10-08T07:07:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.308402+0000", 2023-10-08T07:07:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.308402+0000", 2023-10-08T07:07:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3799999999999998e-07 2023-10-08T07:07:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.308414+0000", 2023-10-08T07:07:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.168e-05 2023-10-08T07:07:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.308421+0000", 2023-10-08T07:07:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7680000000000003e-06 2023-10-08T07:07:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.308426+0000", 2023-10-08T07:07:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2023-10-08T07:07:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147867 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.686636+0000", 2023-10-08T07:07:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.24859800800000001, 2023-10-08T07:07:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.24934087399999999, 2023-10-08T07:07:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147867 2023-10-08T07:07:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.686636+0000", 2023-10-08T07:07:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.686636+0000", 2023-10-08T07:07:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.686636+0000", 2023-10-08T07:07:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000005e-07 2023-10-08T07:07:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.686653+0000", 2023-10-08T07:07:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6495999999999999e-05 2023-10-08T07:07:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.686660+0000", 2023-10-08T07:07:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6480000000000003e-06 2023-10-08T07:07:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.686666+0000", 2023-10-08T07:07:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0430000000000004e-06 2023-10-08T07:07:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148149 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.819513+0000", 2023-10-08T07:07:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.11572081100000001, 2023-10-08T07:07:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116534057, 2023-10-08T07:07:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148149 2023-10-08T07:07:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.819513+0000", 2023-10-08T07:07:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.819513+0000", 2023-10-08T07:07:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.819513+0000", 2023-10-08T07:07:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.37e-07 2023-10-08T07:07:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.819535+0000", 2023-10-08T07:07:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1685e-05 2023-10-08T07:07:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.819543+0000", 2023-10-08T07:07:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2770000000000005e-06 2023-10-08T07:07:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.819550+0000", 2023-10-08T07:07:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7469999999999999e-06 2023-10-08T07:07:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157708 4.2b e62/17 4:d776c1c9:::10000000004.0000003d:head v 62'4968, mlcod=62'4964)", 2023-10-08T07:07:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.916283+0000", 2023-10-08T07:07:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018950969000000002, 2023-10-08T07:07:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019758343000000001, 2023-10-08T07:07:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.916283+0000", 2023-10-08T07:07:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.916283+0000", 2023-10-08T07:07:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.916283+0000", 2023-10-08T07:07:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7899999999999997e-07 2023-10-08T07:07:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.916310+0000", 2023-10-08T07:07:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6426000000000001e-05 2023-10-08T07:07:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.916324+0000", 2023-10-08T07:07:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4127999999999999e-05 2023-10-08T07:07:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.916332+0000", 2023-10-08T07:07:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8350000000000004e-06 2023-10-08T07:07:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.916477+0000", 2023-10-08T07:07:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000145174 2023-10-08T07:07:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.916501+0000", 2023-10-08T07:07:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3791999999999999e-05 2023-10-08T07:07:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.936003+0000", 2023-10-08T07:07:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019502019999999998 2023-10-08T07:07:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.936041+0000", 2023-10-08T07:07:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8189000000000003e-05 2023-10-08T07:07:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157778 4.30 e62/17)", 2023-10-08T07:07:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.932430+0000", 2023-10-08T07:07:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0028040719999999999, 2023-10-08T07:07:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037058379999999999, 2023-10-08T07:07:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.932430+0000", 2023-10-08T07:07:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.932430+0000", 2023-10-08T07:07:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.932430+0000", 2023-10-08T07:07:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9299999999999998e-07 2023-10-08T07:07:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.932443+0000", 2023-10-08T07:07:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2758999999999999e-05 2023-10-08T07:07:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.932452+0000", 2023-10-08T07:07:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2439999999999999e-06 2023-10-08T07:07:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.932458+0000", 2023-10-08T07:07:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2090000000000002e-06 2023-10-08T07:07:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147072 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.374350+0000", 2023-10-08T07:07:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.56088342999999996, 2023-10-08T07:07:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56181466099999999, 2023-10-08T07:07:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147072 2023-10-08T07:07:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374350+0000", 2023-10-08T07:07:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374350+0000", 2023-10-08T07:07:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374351+0000", 2023-10-08T07:07:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4999999999999998e-07 2023-10-08T07:07:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374367+0000", 2023-10-08T07:07:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6688999999999999e-05 2023-10-08T07:07:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374374+0000", 2023-10-08T07:07:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1099999999999997e-06 2023-10-08T07:07:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374383+0000", 2023-10-08T07:07:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1750000000000005e-06 2023-10-08T07:07:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147529 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38985217300000002, 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39081477399999998, 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147529 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545382+0000", 2023-10-08T07:07:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2023-10-08T07:07:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545394+0000", 2023-10-08T07:07:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1969e-05 2023-10-08T07:07:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545403+0000", 2023-10-08T07:07:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7460000000000006e-06 2023-10-08T07:07:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545408+0000", 2023-10-08T07:07:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6749999999999999e-06 2023-10-08T07:07:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147608 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.35784247299999999, 2023-10-08T07:07:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.35883933499999998, 2023-10-08T07:07:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147608 2023-10-08T07:07:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577392+0000", 2023-10-08T07:07:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2023-10-08T07:07:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577404+0000", 2023-10-08T07:07:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2544999999999999e-05 2023-10-08T07:07:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577411+0000", 2023-10-08T07:07:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4219999999999997e-06 2023-10-08T07:07:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577416+0000", 2023-10-08T07:07:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9729999999999997e-06 2023-10-08T07:07:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147667 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.34069444799999998, 2023-10-08T07:07:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.34172095200000002, 2023-10-08T07:07:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147667 2023-10-08T07:07:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596594+0000", 2023-10-08T07:07:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020548599999999999 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596614+0000", 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0228e-05 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596625+0000", 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0721e-05 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596633+0000", 2023-10-08T07:07:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5900000000000002e-06 2023-10-08T07:07:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147793 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.650358+0000", 2023-10-08T07:07:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28487554999999998, 2023-10-08T07:07:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.28594168199999997, 2023-10-08T07:07:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147793 2023-10-08T07:07:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.650358+0000", 2023-10-08T07:07:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.650358+0000", 2023-10-08T07:07:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.650359+0000", 2023-10-08T07:07:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1699999999999998e-07 2023-10-08T07:07:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.650374+0000", 2023-10-08T07:07:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5051e-05 2023-10-08T07:07:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.650381+0000", 2023-10-08T07:07:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0530000000000001e-06 2023-10-08T07:07:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.650387+0000", 2023-10-08T07:07:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8839999999999999e-06 2023-10-08T07:07:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148032 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.759381+0000", 2023-10-08T07:07:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.175852914, 2023-10-08T07:07:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17694975199999999, 2023-10-08T07:07:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148032 2023-10-08T07:07:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.759381+0000", 2023-10-08T07:07:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.759381+0000", 2023-10-08T07:07:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.759381+0000", 2023-10-08T07:07:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2023-10-08T07:07:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.759394+0000", 2023-10-08T07:07:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2670000000000001e-05 2023-10-08T07:07:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.759400+0000", 2023-10-08T07:07:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2023-10-08T07:07:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.759405+0000", 2023-10-08T07:07:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7820000000000001e-06 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148354 4.9 4:90f7d93b:::10000000004.00000021:head [write 3108864~8192 in=8192b,write 3141632~4096 in=4096b,write 3190784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.931351+0000", 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038827750000000002, 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050369669999999998, 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148354 2023-10-08T07:07:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931351+0000", 2023-10-08T07:07:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931351+0000", 2023-10-08T07:07:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933295+0000", 2023-10-08T07:07:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019437300000000001 2023-10-08T07:07:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933315+0000", 2023-10-08T07:07:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0809e-05 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933326+0000", 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0215e-05 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933333+0000", 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3889999999999999e-06 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.935687+0000", 2023-10-08T07:07:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023541809999999999 2023-10-08T07:07:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.935775+0000", 2023-10-08T07:07:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8219000000000004e-05 2023-10-08T07:07:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146864 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.281476+0000", 2023-10-08T07:07:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.65375721399999998, 2023-10-08T07:07:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65498564299999995, 2023-10-08T07:07:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146864 2023-10-08T07:07:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.281476+0000", 2023-10-08T07:07:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.281476+0000", 2023-10-08T07:07:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.281477+0000", 2023-10-08T07:07:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699999999999995e-07 2023-10-08T07:07:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.281489+0000", 2023-10-08T07:07:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1711e-05 2023-10-08T07:07:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.281496+0000", 2023-10-08T07:07:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0299999999999996e-06 2023-10-08T07:07:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.281501+0000", 2023-10-08T07:07:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3970000000000002e-06 2023-10-08T07:07:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146956 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.318594+0000", 2023-10-08T07:07:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61663930700000003, 2023-10-08T07:07:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61792750399999996, 2023-10-08T07:07:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146956 2023-10-08T07:07:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.318594+0000", 2023-10-08T07:07:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.318594+0000", 2023-10-08T07:07:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.320294+0000", 2023-10-08T07:07:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001699484 2023-10-08T07:07:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.320307+0000", 2023-10-08T07:07:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2743e-05 2023-10-08T07:07:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.320315+0000", 2023-10-08T07:07:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7490000000000004e-06 2023-10-08T07:07:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.320324+0000", 2023-10-08T07:07:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6179999999999995e-06 2023-10-08T07:07:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147073 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.374390+0000", 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.56084312199999997, 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56219405099999997, 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147073 2023-10-08T07:07:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374390+0000", 2023-10-08T07:07:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374390+0000", 2023-10-08T07:07:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374391+0000", 2023-10-08T07:07:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:07:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374402+0000", 2023-10-08T07:07:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1484999999999999e-05 2023-10-08T07:07:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374452+0000", 2023-10-08T07:07:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9966000000000002e-05 2023-10-08T07:07:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374470+0000", 2023-10-08T07:07:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7944999999999998e-05 2023-10-08T07:07:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147207 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.442422+0000", 2023-10-08T07:07:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.49281154599999999, 2023-10-08T07:07:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.49422463900000002, 2023-10-08T07:07:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147207 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.442422+0000", 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.442422+0000", 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.444307+0000", 2023-10-08T07:07:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001885124 2023-10-08T07:07:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.444324+0000", 2023-10-08T07:07:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7036000000000001e-05 2023-10-08T07:07:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.444334+0000", 2023-10-08T07:07:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0006999999999999e-05 2023-10-08T07:07:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.444341+0000", 2023-10-08T07:07:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0129999999999996e-06 2023-10-08T07:07:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147377 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.501563+0000", 2023-10-08T07:07:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43367080200000002, 2023-10-08T07:07:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.435143108, 2023-10-08T07:07:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147377 2023-10-08T07:07:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.501563+0000", 2023-10-08T07:07:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.501563+0000", 2023-10-08T07:07:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.501563+0000", 2023-10-08T07:07:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2899999999999999e-07 2023-10-08T07:07:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.501575+0000", 2023-10-08T07:07:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2221e-05 2023-10-08T07:07:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.501582+0000", 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4679999999999997e-06 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.501589+0000", 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6420000000000001e-06 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147579 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37188924699999998, 2023-10-08T07:07:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.37340816199999999, 2023-10-08T07:07:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147579 2023-10-08T07:07:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563345+0000", 2023-10-08T07:07:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000005e-07 2023-10-08T07:07:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563359+0000", 2023-10-08T07:07:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4199000000000001e-05 2023-10-08T07:07:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563366+0000", 2023-10-08T07:07:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8619999999999997e-06 2023-10-08T07:07:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563371+0000", 2023-10-08T07:07:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4060000000000004e-06 2023-10-08T07:07:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147795 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.650395+0000", 2023-10-08T07:07:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.284838433, 2023-10-08T07:07:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.28640959799999999, 2023-10-08T07:07:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147795 2023-10-08T07:07:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.650395+0000", 2023-10-08T07:07:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.650395+0000", 2023-10-08T07:07:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.650396+0000", 2023-10-08T07:07:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8299999999999997e-07 2023-10-08T07:07:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.650406+0000", 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0635000000000001e-05 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.650412+0000", 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8610000000000003e-06 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.650417+0000", 2023-10-08T07:07:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2920000000000003e-06 2023-10-08T07:07:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148034 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.759411+0000", 2023-10-08T07:07:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.17582246200000001, 2023-10-08T07:07:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.177446927, 2023-10-08T07:07:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148034 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.759411+0000", 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.759411+0000", 2023-10-08T07:07:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.759412+0000", 2023-10-08T07:07:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9900000000000001e-07 2023-10-08T07:07:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.759424+0000", 2023-10-08T07:07:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2241e-05 2023-10-08T07:07:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.759429+0000", 2023-10-08T07:07:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6609999999999997e-06 2023-10-08T07:07:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.759435+0000", 2023-10-08T07:07:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7980000000000002e-06 2023-10-08T07:07:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148054 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.766395+0000", 2023-10-08T07:07:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.16883864700000001, 2023-10-08T07:07:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17051834699999999, 2023-10-08T07:07:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148054 2023-10-08T07:07:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.766395+0000", 2023-10-08T07:07:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.766395+0000", 2023-10-08T07:07:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.774297+0000", 2023-10-08T07:07:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079022550000000004 2023-10-08T07:07:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.774317+0000", 2023-10-08T07:07:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0220999999999998e-05 2023-10-08T07:07:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.774328+0000", 2023-10-08T07:07:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0283e-05 2023-10-08T07:07:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.774335+0000", 2023-10-08T07:07:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5390000000000002e-06 2023-10-08T07:07:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148355 4.2f 4:f790ef75:::10000000004.00000038:head [write 2990080~4096 in=4096b,write 3018752~4096 in=4096b,write 3047424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.933348+0000", 2023-10-08T07:07:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001885395, 2023-10-08T07:07:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00355223, 2023-10-08T07:07:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148355 2023-10-08T07:07:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933348+0000", 2023-10-08T07:07:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933348+0000", 2023-10-08T07:07:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933349+0000", 2023-10-08T07:07:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:07:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933361+0000", 2023-10-08T07:07:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2319e-05 2023-10-08T07:07:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933369+0000", 2023-10-08T07:07:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5809999999999999e-06 2023-10-08T07:07:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933374+0000", 2023-10-08T07:07:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5289999999999999e-06 2023-10-08T07:07:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933424+0000", 2023-10-08T07:07:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0249e-05 2023-10-08T07:07:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933503+0000", 2023-10-08T07:07:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8893000000000005e-05 2023-10-08T07:07:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.936776+0000", 2023-10-08T07:07:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032730179999999999 2023-10-08T07:07:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.936826+0000", 2023-10-08T07:07:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9981000000000001e-05 2023-10-08T07:07:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.936900+0000", 2023-10-08T07:07:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4067999999999996e-05 2023-10-08T07:07:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148117 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.804686+0000", 2023-10-08T07:07:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.13054766300000001, 2023-10-08T07:07:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.132376406, 2023-10-08T07:07:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148117 2023-10-08T07:07:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.804686+0000", 2023-10-08T07:07:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.804686+0000", 2023-10-08T07:07:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.804686+0000", 2023-10-08T07:07:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0600000000000001e-07 2023-10-08T07:07:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.804708+0000", 2023-10-08T07:07:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1362e-05 2023-10-08T07:07:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.804715+0000", 2023-10-08T07:07:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4290000000000004e-06 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.804720+0000", 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1699999999999996e-06 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157781 4.30 e62/17)", 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.934444+0000", 2023-10-08T07:07:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00078977400000000003, 2023-10-08T07:07:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026737219999999999, 2023-10-08T07:07:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.934444+0000", 2023-10-08T07:07:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.934444+0000", 2023-10-08T07:07:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.934444+0000", 2023-10-08T07:07:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4700000000000001e-07 2023-10-08T07:07:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.934458+0000", 2023-10-08T07:07:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3787e-05 2023-10-08T07:07:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.934472+0000", 2023-10-08T07:07:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3338e-05 2023-10-08T07:07:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.934479+0000", 2023-10-08T07:07:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3139999999999998e-06 2023-10-08T07:07:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147750 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.642426+0000", 2023-10-08T07:07:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29280774399999998, 2023-10-08T07:07:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29474265999999999, 2023-10-08T07:07:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147750 2023-10-08T07:07:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.642426+0000", 2023-10-08T07:07:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.642426+0000", 2023-10-08T07:07:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.642426+0000", 2023-10-08T07:07:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2023-10-08T07:07:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.642439+0000", 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2843000000000001e-05 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.642447+0000", 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5320000000000001e-06 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.642453+0000", 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6730000000000003e-06 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148057 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.776383+0000", 2023-10-08T07:07:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15885084399999999, 2023-10-08T07:07:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.16087452199999999, 2023-10-08T07:07:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148057 2023-10-08T07:07:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776383+0000", 2023-10-08T07:07:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776383+0000", 2023-10-08T07:07:42.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776383+0000", 2023-10-08T07:07:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:07:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776398+0000", 2023-10-08T07:07:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4395e-05 2023-10-08T07:07:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776406+0000", 2023-10-08T07:07:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2349999999999999e-06 2023-10-08T07:07:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776412+0000", 2023-10-08T07:07:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.896e-06 2023-10-08T07:07:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148270 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.888349+0000", 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.046884435000000002, 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048982892, 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148270 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.888349+0000", 2023-10-08T07:07:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.888349+0000", 2023-10-08T07:07:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.888350+0000", 2023-10-08T07:07:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.37e-07 2023-10-08T07:07:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.888363+0000", 2023-10-08T07:07:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3712e-05 2023-10-08T07:07:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.888370+0000", 2023-10-08T07:07:42.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7220000000000002e-06 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.888376+0000", 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3789999999999997e-06 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157785 4.20 e62/17)", 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.937047+0000", 2023-10-08T07:07:42.123 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9981861, 2023-10-08T07:07:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000346495, 2023-10-08T07:07:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937047+0000", 2023-10-08T07:07:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937047+0000", 2023-10-08T07:07:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937048+0000", 2023-10-08T07:07:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1600000000000001e-07 2023-10-08T07:07:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937066+0000", 2023-10-08T07:07:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7782999999999999e-05 2023-10-08T07:07:42.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937075+0000", 2023-10-08T07:07:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4960000000000002e-06 2023-10-08T07:07:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937082+0000", 2023-10-08T07:07:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7619999999999998e-06 2023-10-08T07:07:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146959 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.320378+0000", 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61485551900000002, 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61707232899999997, 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146959 2023-10-08T07:07:42.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.320378+0000", 2023-10-08T07:07:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.320378+0000", 2023-10-08T07:07:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.322296+0000", 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019175010000000001 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.322311+0000", 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5126999999999999e-05 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.322324+0000", 2023-10-08T07:07:42.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3249e-05 2023-10-08T07:07:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.322331+0000", 2023-10-08T07:07:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8889999999999996e-06 2023-10-08T07:07:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.130 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147118 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.392396+0000", 2023-10-08T07:07:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.54283782400000002, 2023-10-08T07:07:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.54511636399999996, 2023-10-08T07:07:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147118 2023-10-08T07:07:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.392396+0000", 2023-10-08T07:07:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.392396+0000", 2023-10-08T07:07:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396294+0000", 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038978279999999999 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396307+0000", 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3730000000000001e-05 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396318+0000", 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0365e-05 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396323+0000", 2023-10-08T07:07:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1850000000000003e-06 2023-10-08T07:07:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157790 4.2c e62/17 4:352c144c:::10000000004.00000003:head v 62'2470, mlcod=62'2468)", 2023-10-08T07:07:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.937099+0000", 2023-10-08T07:07:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9981351, 2023-10-08T07:07:42.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000477582, 2023-10-08T07:07:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937099+0000", 2023-10-08T07:07:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937099+0000", 2023-10-08T07:07:42.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937099+0000", 2023-10-08T07:07:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0499999999999999e-07 2023-10-08T07:07:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937115+0000", 2023-10-08T07:07:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.575e-05 2023-10-08T07:07:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937122+0000", 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2119999999999997e-06 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937131+0000", 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1900000000000001e-06 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937230+0000", 2023-10-08T07:07:42.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8898000000000001e-05 2023-10-08T07:07:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937249+0000", 2023-10-08T07:07:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8621999999999999e-05 2023-10-08T07:07:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147076 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.138 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.374615+0000", 2023-10-08T07:07:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.560618854, 2023-10-08T07:07:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56302855799999996, 2023-10-08T07:07:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147076 2023-10-08T07:07:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374615+0000", 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.374615+0000", 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.380295+0000", 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056801020000000002 2023-10-08T07:07:42.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.380307+0000", 2023-10-08T07:07:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2394e-05 2023-10-08T07:07:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.380316+0000", 2023-10-08T07:07:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9760000000000001e-06 2023-10-08T07:07:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.380323+0000", 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147120 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.396333+0000", 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.53890047699999999, 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.54137124999999997, 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.142 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147120 2023-10-08T07:07:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396333+0000", 2023-10-08T07:07:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396333+0000", 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396333+0000", 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.53e-07 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396343+0000", 2023-10-08T07:07:42.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7380000000000006e-06 2023-10-08T07:07:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396349+0000", 2023-10-08T07:07:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4929999999999998e-06 2023-10-08T07:07:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396352+0000", 2023-10-08T07:07:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.208e-06 2023-10-08T07:07:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.145 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147491 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.535987+0000", 2023-10-08T07:07:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.399246145, 2023-10-08T07:07:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40177938499999999, 2023-10-08T07:07:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.146 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147491 2023-10-08T07:07:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.535987+0000", 2023-10-08T07:07:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.535987+0000", 2023-10-08T07:07:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.535988+0000", 2023-10-08T07:07:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3499999999999996e-07 2023-10-08T07:07:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.536005+0000", 2023-10-08T07:07:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7280000000000001e-05 2023-10-08T07:07:42.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.536013+0000", 2023-10-08T07:07:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7400000000000004e-06 2023-10-08T07:07:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.536019+0000", 2023-10-08T07:07:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8370000000000002e-06 2023-10-08T07:07:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157794 4.38 e62/46)", 2023-10-08T07:07:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.937147+0000", 2023-10-08T07:07:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9980865, 2023-10-08T07:07:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00068072800000000002, 2023-10-08T07:07:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937147+0000", 2023-10-08T07:07:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937147+0000", 2023-10-08T07:07:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937147+0000", 2023-10-08T07:07:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5400000000000002e-07 2023-10-08T07:07:42.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937158+0000", 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0696000000000001e-05 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937164+0000", 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0310000000000004e-06 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937169+0000", 2023-10-08T07:07:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1510000000000003e-06 2023-10-08T07:07:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147044 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.360424+0000", 2023-10-08T07:07:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.57480942099999999, 2023-10-08T07:07:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.577458519, 2023-10-08T07:07:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.153 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147044 2023-10-08T07:07:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.360424+0000", 2023-10-08T07:07:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.360424+0000", 2023-10-08T07:07:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.364295+0000", 2023-10-08T07:07:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038707250000000002 2023-10-08T07:07:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.364313+0000", 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7853999999999999e-05 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.364324+0000", 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1508999999999999e-05 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.364333+0000", 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3809999999999999e-06 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.156 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147253 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.460390+0000", 2023-10-08T07:07:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47484395200000001, 2023-10-08T07:07:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47755491500000002, 2023-10-08T07:07:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147253 2023-10-08T07:07:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.460390+0000", 2023-10-08T07:07:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.460390+0000", 2023-10-08T07:07:42.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.460390+0000", 2023-10-08T07:07:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5099999999999999e-07 2023-10-08T07:07:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.460404+0000", 2023-10-08T07:07:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3234999999999999e-05 2023-10-08T07:07:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.460411+0000", 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.075e-06 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.460416+0000", 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.823e-06 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157719 4.30 e62/17 4:0f322a22:::10000000004.00000014:head v 62'2491, mlcod=62'2487)", 2023-10-08T07:07:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.920681+0000", 2023-10-08T07:07:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014552677999999999, 2023-10-08T07:07:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017321405000000002, 2023-10-08T07:07:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.920681+0000", 2023-10-08T07:07:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.920681+0000", 2023-10-08T07:07:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.920681+0000", 2023-10-08T07:07:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2900000000000004e-07 2023-10-08T07:07:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.920693+0000", 2023-10-08T07:07:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1647999999999999e-05 2023-10-08T07:07:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.920701+0000", 2023-10-08T07:07:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2099999999999993e-06 2023-10-08T07:07:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.920707+0000", 2023-10-08T07:07:42.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7440000000000004e-06 2023-10-08T07:07:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.925857+0000", 2023-10-08T07:07:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051503649999999996 2023-10-08T07:07:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.925876+0000", 2023-10-08T07:07:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9031000000000001e-05 2023-10-08T07:07:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.164 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157795 4.1b e62/17 4:dbb7dde6:::10000000004.0000002c:head v 62'4979, mlcod=62'4975)", 2023-10-08T07:07:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.937176+0000", 2023-10-08T07:07:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9980574, 2023-10-08T07:07:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00088467799999999996, 2023-10-08T07:07:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937176+0000", 2023-10-08T07:07:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937176+0000", 2023-10-08T07:07:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937177+0000", 2023-10-08T07:07:42.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3999999999999998e-07 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937185+0000", 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8130000000000002e-06 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937193+0000", 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9999999999999996e-06 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937198+0000", 2023-10-08T07:07:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:07:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937258+0000", 2023-10-08T07:07:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9756000000000002e-05 2023-10-08T07:07:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937276+0000", 2023-10-08T07:07:42.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8422000000000001e-05 2023-10-08T07:07:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147122 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.396357+0000", 2023-10-08T07:07:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.53887698799999995, 2023-10-08T07:07:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.54176213500000003, 2023-10-08T07:07:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147122 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396357+0000", 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396357+0000", 2023-10-08T07:07:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.398293+0000", 2023-10-08T07:07:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019360829999999999 2023-10-08T07:07:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.398305+0000", 2023-10-08T07:07:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2551000000000001e-05 2023-10-08T07:07:42.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.398314+0000", 2023-10-08T07:07:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8689999999999993e-06 2023-10-08T07:07:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.398319+0000", 2023-10-08T07:07:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9409999999999998e-06 2023-10-08T07:07:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147344 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.491339+0000", 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.44389486099999997, 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44683237999999997, 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147344 2023-10-08T07:07:42.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.491339+0000", 2023-10-08T07:07:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.491339+0000", 2023-10-08T07:07:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.491339+0000", 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7899999999999998e-07 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.491350+0000", 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.043e-05 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.491358+0000", 2023-10-08T07:07:42.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0209999999999999e-06 2023-10-08T07:07:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.491363+0000", 2023-10-08T07:07:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7010000000000001e-06 2023-10-08T07:07:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147478 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.176 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.530452+0000", 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.40478115999999997, 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40777058100000002, 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147478 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530452+0000", 2023-10-08T07:07:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530452+0000", 2023-10-08T07:07:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530453+0000", 2023-10-08T07:07:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2023-10-08T07:07:42.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530464+0000", 2023-10-08T07:07:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1314999999999999e-05 2023-10-08T07:07:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530470+0000", 2023-10-08T07:07:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5249999999999996e-06 2023-10-08T07:07:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530474+0000", 2023-10-08T07:07:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3980000000000001e-06 2023-10-08T07:07:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157718 4.20 e62/17 4:05b3915c:::10000000004.00000016:head v 62'7449, mlcod=62'7441)", 2023-10-08T07:07:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.920718+0000", 2023-10-08T07:07:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014515447000000001, 2023-10-08T07:07:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017557888000000001, 2023-10-08T07:07:42.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.920718+0000", 2023-10-08T07:07:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.920718+0000", 2023-10-08T07:07:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.920718+0000", 2023-10-08T07:07:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0699999999999998e-07 2023-10-08T07:07:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.920727+0000", 2023-10-08T07:07:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.242e-06 2023-10-08T07:07:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.920732+0000", 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2580000000000003e-06 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.920735+0000", 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7489999999999999e-06 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.928796+0000", 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080610290000000008 2023-10-08T07:07:42.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.928807+0000", 2023-10-08T07:07:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1241e-05 2023-10-08T07:07:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148356 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.933388+0000", 2023-10-08T07:07:42.184 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001845806, 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049525039999999999, 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148356 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933388+0000", 2023-10-08T07:07:42.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933388+0000", 2023-10-08T07:07:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937296+0000", 2023-10-08T07:07:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039082759999999996 2023-10-08T07:07:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937313+0000", 2023-10-08T07:07:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7229000000000001e-05 2023-10-08T07:07:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937323+0000", 2023-10-08T07:07:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8980000000000008e-06 2023-10-08T07:07:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937331+0000", 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5320000000000001e-06 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147541 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38784781800000001, 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39100748899999999, 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147541 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1899999999999998e-07 2023-10-08T07:07:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547397+0000", 2023-10-08T07:07:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1263999999999999e-05 2023-10-08T07:07:42.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547401+0000", 2023-10-08T07:07:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7409999999999998e-06 2023-10-08T07:07:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547404+0000", 2023-10-08T07:07:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9890000000000001e-06 2023-10-08T07:07:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148096 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.790465+0000", 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14476909600000001, 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.147980367, 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148096 2023-10-08T07:07:42.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.790465+0000", 2023-10-08T07:07:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.790465+0000", 2023-10-08T07:07:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.790465+0000", 2023-10-08T07:07:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2200000000000004e-07 2023-10-08T07:07:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.790488+0000", 2023-10-08T07:07:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.302e-05 2023-10-08T07:07:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.790496+0000", 2023-10-08T07:07:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5989999999999996e-06 2023-10-08T07:07:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.790501+0000", 2023-10-08T07:07:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4909999999999996e-06 2023-10-08T07:07:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.195 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148217 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.852427+0000", 2023-10-08T07:07:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.082806124999999994, 2023-10-08T07:07:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.086069270000000003, 2023-10-08T07:07:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148217 2023-10-08T07:07:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.852427+0000", 2023-10-08T07:07:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.852427+0000", 2023-10-08T07:07:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.857337+0000", 2023-10-08T07:07:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049091380000000004 2023-10-08T07:07:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.857361+0000", 2023-10-08T07:07:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4008000000000001e-05 2023-10-08T07:07:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.857372+0000", 2023-10-08T07:07:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.188e-05 2023-10-08T07:07:42.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.857381+0000", 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0809999999999994e-06 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148357 4.19 4:9a1dab10:::10000000004.0000001d:head [write 1339392~4096 in=4096b,write 1347584~4096 in=4096b,write 1396736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.937344+0000", 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9978895, 2023-10-08T07:07:42.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012118579999999999, 2023-10-08T07:07:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148357 2023-10-08T07:07:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937344+0000", 2023-10-08T07:07:42.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937344+0000", 2023-10-08T07:07:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937344+0000", 2023-10-08T07:07:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4000000000000002e-07 2023-10-08T07:07:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937362+0000", 2023-10-08T07:07:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7472000000000001e-05 2023-10-08T07:07:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937369+0000", 2023-10-08T07:07:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4590000000000001e-06 2023-10-08T07:07:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937375+0000", 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937465+0000", 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9483999999999999e-05 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937562+0000", 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7083999999999994e-05 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.203 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147259 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.460503+0000", 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.474730174, 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47811604299999999, 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147259 2023-10-08T07:07:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.460503+0000", 2023-10-08T07:07:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.460503+0000", 2023-10-08T07:07:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.460504+0000", 2023-10-08T07:07:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1799999999999995e-07 2023-10-08T07:07:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.460521+0000", 2023-10-08T07:07:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6747000000000001e-05 2023-10-08T07:07:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.460528+0000", 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.905e-06 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.460533+0000", 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5539999999999997e-06 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.207 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147542 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38782508900000001, 2023-10-08T07:07:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39126397400000001, 2023-10-08T07:07:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147542 2023-10-08T07:07:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549299+0000", 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018905650000000001 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549316+0000", 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7065999999999999e-05 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549327+0000", 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0573e-05 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549335+0000", 2023-10-08T07:07:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9410000000000007e-06 2023-10-08T07:07:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147876 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.688206+0000", 2023-10-08T07:07:42.211 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.24702755900000001, 2023-10-08T07:07:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.25052117400000001, 2023-10-08T07:07:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147876 2023-10-08T07:07:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.688206+0000", 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.688206+0000", 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.692295+0000", 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040893279999999997 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.692315+0000", 2023-10-08T07:07:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9454e-05 2023-10-08T07:07:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.692331+0000", 2023-10-08T07:07:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6515e-05 2023-10-08T07:07:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.692339+0000", 2023-10-08T07:07:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5190000000000003e-06 2023-10-08T07:07:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148041 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.762650+0000", 2023-10-08T07:07:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.172583397, 2023-10-08T07:07:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17613002999999999, 2023-10-08T07:07:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148041 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.762650+0000", 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.762650+0000", 2023-10-08T07:07:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.762651+0000", 2023-10-08T07:07:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:07:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.762663+0000", 2023-10-08T07:07:42.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2203e-05 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.762671+0000", 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9410000000000007e-06 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.762676+0000", 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3369999999999999e-06 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.218 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157734 4.38 e62/46 4:1e0977c7:::10000000004.00000022:head v 62'2487, mlcod=62'2483)", 2023-10-08T07:07:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.922198+0000", 2023-10-08T07:07:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013035566, 2023-10-08T07:07:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016637059999999999, 2023-10-08T07:07:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.922198+0000", 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.922198+0000", 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.922199+0000", 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6499999999999999e-07 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.922212+0000", 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3485e-05 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.922221+0000", 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5450000000000003e-06 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.922227+0000", 2023-10-08T07:07:42.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3210000000000001e-06 2023-10-08T07:07:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.930734+0000", 2023-10-08T07:07:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085067660000000007 2023-10-08T07:07:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.930762+0000", 2023-10-08T07:07:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8064000000000001e-05 2023-10-08T07:07:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.222 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148358 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.937387+0000", 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9978461, 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015060340000000001, 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.223 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148358 2023-10-08T07:07:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937387+0000", 2023-10-08T07:07:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937387+0000", 2023-10-08T07:07:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937388+0000", 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9699999999999996e-07 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937402+0000", 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4569999999999999e-05 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937410+0000", 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7780000000000007e-06 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937417+0000", 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7190000000000004e-06 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146898 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.226 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.298742+0000", 2023-10-08T07:07:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63649162000000004, 2023-10-08T07:07:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.64027288699999996, 2023-10-08T07:07:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146898 2023-10-08T07:07:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.298742+0000", 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.298742+0000", 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.298743+0000", 2023-10-08T07:07:42.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-07 2023-10-08T07:07:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.298758+0000", 2023-10-08T07:07:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5155e-05 2023-10-08T07:07:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.298768+0000", 2023-10-08T07:07:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0074999999999999e-05 2023-10-08T07:07:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.298773+0000", 2023-10-08T07:07:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2499999999999997e-06 2023-10-08T07:07:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147436 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.520851+0000", 2023-10-08T07:07:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.41438236099999998, 2023-10-08T07:07:42.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41821877899999998, 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147436 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520851+0000", 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520851+0000", 2023-10-08T07:07:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520852+0000", 2023-10-08T07:07:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.63e-07 2023-10-08T07:07:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520864+0000", 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2731000000000001e-05 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520873+0000", 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6770000000000001e-06 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520879+0000", 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7300000000000002e-06 2023-10-08T07:07:42.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147614 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.35585207499999999, 2023-10-08T07:07:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.35974191999999999, 2023-10-08T07:07:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.234 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147614 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:42.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.51e-07 2023-10-08T07:07:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579394+0000", 2023-10-08T07:07:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.207e-05 2023-10-08T07:07:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579401+0000", 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3900000000000004e-06 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579406+0000", 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9490000000000004e-06 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147702 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.317667168, 2023-10-08T07:07:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32161298300000002, 2023-10-08T07:07:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147702 2023-10-08T07:07:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.238 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617567+0000", 2023-10-08T07:07:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2023-10-08T07:07:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617578+0000", 2023-10-08T07:07:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0922e-05 2023-10-08T07:07:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617584+0000", 2023-10-08T07:07:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7849999999999997e-06 2023-10-08T07:07:42.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617588+0000", 2023-10-08T07:07:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6310000000000002e-06 2023-10-08T07:07:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147939 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.722460+0000", 2023-10-08T07:07:42.241 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.21277353299999999, 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.21677352699999999, 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147939 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.722460+0000", 2023-10-08T07:07:42.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.722460+0000", 2023-10-08T07:07:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.722460+0000", 2023-10-08T07:07:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9000000000000002e-07 2023-10-08T07:07:42.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.722471+0000", 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0941000000000001e-05 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.722479+0000", 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4240000000000004e-06 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.722484+0000", 2023-10-08T07:07:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8040000000000001e-06 2023-10-08T07:07:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148162 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.823591+0000", 2023-10-08T07:07:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.11164297300000001, 2023-10-08T07:07:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.115713098, 2023-10-08T07:07:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.245 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148162 2023-10-08T07:07:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.823591+0000", 2023-10-08T07:07:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.823591+0000", 2023-10-08T07:07:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.823591+0000", 2023-10-08T07:07:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6899999999999997e-07 2023-10-08T07:07:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.823604+0000", 2023-10-08T07:07:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2490999999999999e-05 2023-10-08T07:07:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.823611+0000", 2023-10-08T07:07:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0060000000000003e-06 2023-10-08T07:07:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.823616+0000", 2023-10-08T07:07:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1549999999999998e-06 2023-10-08T07:07:42.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148359 4.7 4:e13e8cdb:::10000000004.00000028:head [write 1617920~4096 in=4096b,write 1810432~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.937424+0000", 2023-10-08T07:07:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9978094, 2023-10-08T07:07:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001948228, 2023-10-08T07:07:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148359 2023-10-08T07:07:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937424+0000", 2023-10-08T07:07:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937424+0000", 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937425+0000", 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4499999999999997e-07 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937439+0000", 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4041e-05 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937445+0000", 2023-10-08T07:07:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6320000000000002e-06 2023-10-08T07:07:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937451+0000", 2023-10-08T07:07:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5079999999999996e-06 2023-10-08T07:07:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937656+0000", 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00020549699999999999 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937740+0000", 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3209999999999998e-05 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146900 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.253 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.298782+0000", 2023-10-08T07:07:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.63645127899999998, 2023-10-08T07:07:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.64066056900000001, 2023-10-08T07:07:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146900 2023-10-08T07:07:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.298782+0000", 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.298782+0000", 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.298783+0000", 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.08e-07 2023-10-08T07:07:42.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.298794+0000", 2023-10-08T07:07:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1243000000000001e-05 2023-10-08T07:07:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.298811+0000", 2023-10-08T07:07:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6699999999999999e-05 2023-10-08T07:07:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.298816+0000", 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4040000000000003e-06 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147545 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.385836283, 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.390100418, 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.257 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147545 2023-10-08T07:07:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549407+0000", 2023-10-08T07:07:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103e-05 2023-10-08T07:07:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549421+0000", 2023-10-08T07:07:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3995999999999999e-05 2023-10-08T07:07:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549430+0000", 2023-10-08T07:07:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3329999999999997e-06 2023-10-08T07:07:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549443+0000", 2023-10-08T07:07:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3492000000000001e-05 2023-10-08T07:07:42.260 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148100 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.792355+0000", 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14287841500000001, 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.14719884999999999, 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148100 2023-10-08T07:07:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.792355+0000", 2023-10-08T07:07:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.792355+0000", 2023-10-08T07:07:42.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.792356+0000", 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.89e-07 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.792373+0000", 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7104000000000001e-05 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.792380+0000", 2023-10-08T07:07:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0369999999999997e-06 2023-10-08T07:07:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.792385+0000", 2023-10-08T07:07:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4920000000000001e-06 2023-10-08T07:07:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148339 4.19 4:9b26afe3:::10000000004.00000005:head [write 2670592~4096 in=4096b,write 2727936~4096 in=4096b,write 2879488~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.923377+0000", 2023-10-08T07:07:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011856693999999999, 2023-10-08T07:07:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016238896999999999, 2023-10-08T07:07:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148339 2023-10-08T07:07:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.265 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923377+0000", 2023-10-08T07:07:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923377+0000", 2023-10-08T07:07:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923378+0000", 2023-10-08T07:07:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:07:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923398+0000", 2023-10-08T07:07:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0591999999999999e-05 2023-10-08T07:07:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923406+0000", 2023-10-08T07:07:42.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8809999999999996e-06 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923412+0000", 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1380000000000004e-06 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923465+0000", 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2646999999999999e-05 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923563+0000", 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8332000000000007e-05 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148360 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.937463+0000", 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9977708, 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022206389999999999, 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.269 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148360 2023-10-08T07:07:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937463+0000", 2023-10-08T07:07:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937463+0000", 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937463+0000", 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0200000000000003e-07 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937476+0000", 2023-10-08T07:07:42.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2458e-05 2023-10-08T07:07:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937489+0000", 2023-10-08T07:07:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2656999999999999e-05 2023-10-08T07:07:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937495+0000", 2023-10-08T07:07:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0510000000000002e-06 2023-10-08T07:07:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.272 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148340 4.31 4:8de29a03:::10000000004.00000001:head [write 3964928~8192 in=8192b,write 4034560~4096 in=4096b,write 4177920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.923426+0000", 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011807148, 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016316878, 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.273 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148340 2023-10-08T07:07:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923426+0000", 2023-10-08T07:07:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923426+0000", 2023-10-08T07:07:42.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923427+0000", 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7899999999999998e-07 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923444+0000", 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6956000000000002e-05 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923451+0000", 2023-10-08T07:07:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4290000000000004e-06 2023-10-08T07:07:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923457+0000", 2023-10-08T07:07:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7520000000000002e-06 2023-10-08T07:07:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923651+0000", 2023-10-08T07:07:42.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019424500000000001 2023-10-08T07:07:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923737+0000", 2023-10-08T07:07:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5603e-05 2023-10-08T07:07:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923903+0000", 2023-10-08T07:07:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016555199999999999 2023-10-08T07:07:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931610+0000", 2023-10-08T07:07:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077074969999999998 2023-10-08T07:07:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148361 4.7 4.db317c87 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.937502+0000", 2023-10-08T07:07:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9977317, 2023-10-08T07:07:42.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002335574, 2023-10-08T07:07:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148361 2023-10-08T07:07:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937502+0000", 2023-10-08T07:07:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937502+0000", 2023-10-08T07:07:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937502+0000", 2023-10-08T07:07:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2e-07 2023-10-08T07:07:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937518+0000", 2023-10-08T07:07:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5452999999999999e-05 2023-10-08T07:07:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937524+0000", 2023-10-08T07:07:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5400000000000001e-06 2023-10-08T07:07:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937530+0000", 2023-10-08T07:07:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7239999999999997e-06 2023-10-08T07:07:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147591 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.36779038200000003, 2023-10-08T07:07:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.37244970700000002, 2023-10-08T07:07:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147591 2023-10-08T07:07:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567444+0000", 2023-10-08T07:07:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8500000000000001e-07 2023-10-08T07:07:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567456+0000", 2023-10-08T07:07:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2221e-05 2023-10-08T07:07:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567463+0000", 2023-10-08T07:07:42.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.652e-06 2023-10-08T07:07:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567468+0000", 2023-10-08T07:07:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8500000000000002e-06 2023-10-08T07:07:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.286 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148071 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.776761+0000", 2023-10-08T07:07:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15847217899999999, 2023-10-08T07:07:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.163184465, 2023-10-08T07:07:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148071 2023-10-08T07:07:42.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776761+0000", 2023-10-08T07:07:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776761+0000", 2023-10-08T07:07:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776762+0000", 2023-10-08T07:07:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4299999999999998e-07 2023-10-08T07:07:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776777+0000", 2023-10-08T07:07:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4926000000000001e-05 2023-10-08T07:07:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776782+0000", 2023-10-08T07:07:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4820000000000002e-06 2023-10-08T07:07:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776786+0000", 2023-10-08T07:07:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.242e-06 2023-10-08T07:07:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148169 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.823698+0000", 2023-10-08T07:07:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.111535969, 2023-10-08T07:07:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116296807, 2023-10-08T07:07:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.291 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148169 2023-10-08T07:07:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.823698+0000", 2023-10-08T07:07:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.823698+0000", 2023-10-08T07:07:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.823698+0000", 2023-10-08T07:07:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0399999999999996e-07 2023-10-08T07:07:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.823713+0000", 2023-10-08T07:07:42.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4810999999999999e-05 2023-10-08T07:07:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.823720+0000", 2023-10-08T07:07:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6869999999999997e-06 2023-10-08T07:07:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.823725+0000", 2023-10-08T07:07:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:07:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148281 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.890525+0000", 2023-10-08T07:07:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.044708155999999999, 2023-10-08T07:07:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049534979999999999, 2023-10-08T07:07:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148281 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.890525+0000", 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.890525+0000", 2023-10-08T07:07:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.890526+0000", 2023-10-08T07:07:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:07:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.890542+0000", 2023-10-08T07:07:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5920999999999999e-05 2023-10-08T07:07:42.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.890549+0000", 2023-10-08T07:07:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6939999999999998e-06 2023-10-08T07:07:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.890554+0000", 2023-10-08T07:07:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6110000000000001e-06 2023-10-08T07:07:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.298 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148364 4.3f 4.9eb4593f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.937537+0000", 2023-10-08T07:07:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9976969, 2023-10-08T07:07:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025865089999999999, 2023-10-08T07:07:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.299 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148364 2023-10-08T07:07:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937537+0000", 2023-10-08T07:07:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937537+0000", 2023-10-08T07:07:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937537+0000", 2023-10-08T07:07:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3799999999999998e-07 2023-10-08T07:07:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937553+0000", 2023-10-08T07:07:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6022e-05 2023-10-08T07:07:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937560+0000", 2023-10-08T07:07:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9519999999999997e-06 2023-10-08T07:07:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937565+0000", 2023-10-08T07:07:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.135e-06 2023-10-08T07:07:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146993 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.336562+0000", 2023-10-08T07:07:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.59867203199999997, 2023-10-08T07:07:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.60362687100000001, 2023-10-08T07:07:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146993 2023-10-08T07:07:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.303 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.336562+0000", 2023-10-08T07:07:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.336562+0000", 2023-10-08T07:07:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.338430+0000", 2023-10-08T07:07:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001868691 2023-10-08T07:07:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.338447+0000", 2023-10-08T07:07:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6351e-05 2023-10-08T07:07:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.338457+0000", 2023-10-08T07:07:42.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9920000000000002e-06 2023-10-08T07:07:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.338465+0000", 2023-10-08T07:07:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2023-10-08T07:07:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147159 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.306 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.418346+0000", 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51688780000000001, 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.52190315899999995, 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147159 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.418346+0000", 2023-10-08T07:07:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.418346+0000", 2023-10-08T07:07:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.418346+0000", 2023-10-08T07:07:42.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3200000000000005e-07 2023-10-08T07:07:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.418360+0000", 2023-10-08T07:07:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3686000000000001e-05 2023-10-08T07:07:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.418367+0000", 2023-10-08T07:07:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.759e-06 2023-10-08T07:07:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.418371+0000", 2023-10-08T07:07:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2930000000000002e-06 2023-10-08T07:07:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147713 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:42.310 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.317534645, 2023-10-08T07:07:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.322596247, 2023-10-08T07:07:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147713 2023-10-08T07:07:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.89e-07 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617718+0000", 2023-10-08T07:07:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8287e-05 2023-10-08T07:07:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617724+0000", 2023-10-08T07:07:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7939999999999997e-06 2023-10-08T07:07:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617730+0000", 2023-10-08T07:07:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1819999999999997e-06 2023-10-08T07:07:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148072 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.776791+0000", 2023-10-08T07:07:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15844255600000001, 2023-10-08T07:07:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.16353932700000001, 2023-10-08T07:07:42.314 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148072 2023-10-08T07:07:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776791+0000", 2023-10-08T07:07:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776791+0000", 2023-10-08T07:07:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776815+0000", 2023-10-08T07:07:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4321e-05 2023-10-08T07:07:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776827+0000", 2023-10-08T07:07:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1939999999999999e-05 2023-10-08T07:07:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776832+0000", 2023-10-08T07:07:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7380000000000002e-06 2023-10-08T07:07:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776836+0000", 2023-10-08T07:07:42.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2919999999999997e-06 2023-10-08T07:07:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148365 4.4 4:2158769a:::10000000004.0000002a:head [write 610304~8192 in=8192b,write 663552~4096 in=4096b,write 684032~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.937572+0000", 2023-10-08T07:07:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9976616, 2023-10-08T07:07:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027963630000000001, 2023-10-08T07:07:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.318 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148365 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937572+0000", 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937572+0000", 2023-10-08T07:07:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937572+0000", 2023-10-08T07:07:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2e-07 2023-10-08T07:07:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937592+0000", 2023-10-08T07:07:42.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9398999999999998e-05 2023-10-08T07:07:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937599+0000", 2023-10-08T07:07:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2023-10-08T07:07:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937604+0000", 2023-10-08T07:07:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4110000000000004e-06 2023-10-08T07:07:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937677+0000", 2023-10-08T07:07:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2385000000000006e-05 2023-10-08T07:07:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937761+0000", 2023-10-08T07:07:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4475999999999996e-05 2023-10-08T07:07:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147134 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.404385+0000", 2023-10-08T07:07:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.53084830999999999, 2023-10-08T07:07:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.53602061499999998, 2023-10-08T07:07:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147134 2023-10-08T07:07:42.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.404385+0000", 2023-10-08T07:07:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.404385+0000", 2023-10-08T07:07:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.404386+0000", 2023-10-08T07:07:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2199999999999999e-07 2023-10-08T07:07:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.404402+0000", 2023-10-08T07:07:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6198999999999999e-05 2023-10-08T07:07:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.404409+0000", 2023-10-08T07:07:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3189999999999997e-06 2023-10-08T07:07:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.404415+0000", 2023-10-08T07:07:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3530000000000002e-06 2023-10-08T07:07:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147439 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.520936+0000", 2023-10-08T07:07:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.41429740399999998, 2023-10-08T07:07:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41950196899999997, 2023-10-08T07:07:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147439 2023-10-08T07:07:42.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520936+0000", 2023-10-08T07:07:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520936+0000", 2023-10-08T07:07:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520937+0000", 2023-10-08T07:07:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3399999999999999e-07 2023-10-08T07:07:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520949+0000", 2023-10-08T07:07:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2724999999999999e-05 2023-10-08T07:07:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.522199+0000", 2023-10-08T07:07:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012496110000000001 2023-10-08T07:07:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.522205+0000", 2023-10-08T07:07:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1820000000000003e-06 2023-10-08T07:07:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.330 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147714 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.31749653500000002, 2023-10-08T07:07:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.322731512, 2023-10-08T07:07:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147714 2023-10-08T07:07:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:07:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617751+0000", 2023-10-08T07:07:42.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3570000000000001e-05 2023-10-08T07:07:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617757+0000", 2023-10-08T07:07:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.229e-06 2023-10-08T07:07:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617762+0000", 2023-10-08T07:07:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7670000000000003e-06 2023-10-08T07:07:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.334 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148073 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.776842+0000", 2023-10-08T07:07:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15839187900000001, 2023-10-08T07:07:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.163657727, 2023-10-08T07:07:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148073 2023-10-08T07:07:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776842+0000", 2023-10-08T07:07:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.776842+0000", 2023-10-08T07:07:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.778299+0000", 2023-10-08T07:07:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001457411 2023-10-08T07:07:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.778321+0000", 2023-10-08T07:07:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1837000000000001e-05 2023-10-08T07:07:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.778332+0000", 2023-10-08T07:07:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1287000000000001e-05 2023-10-08T07:07:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.778340+0000", 2023-10-08T07:07:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0600000000000008e-06 2023-10-08T07:07:42.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148251 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.876350+0000", 2023-10-08T07:07:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.058883422999999997, 2023-10-08T07:07:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.064178637999999996, 2023-10-08T07:07:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148251 2023-10-08T07:07:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.876350+0000", 2023-10-08T07:07:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.876350+0000", 2023-10-08T07:07:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.876351+0000", 2023-10-08T07:07:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000005e-07 2023-10-08T07:07:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.876363+0000", 2023-10-08T07:07:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2741e-05 2023-10-08T07:07:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.876370+0000", 2023-10-08T07:07:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9990000000000002e-06 2023-10-08T07:07:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.876377+0000", 2023-10-08T07:07:42.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6619999999999999e-06 2023-10-08T07:07:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148344 4.21 4:867af9ba:::10000000004.0000000a:head [write 1032192~4096 in=4096b,write 1138688~4096 in=4096b,write 1445888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.923538+0000", 2023-10-08T07:07:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011695914, 2023-10-08T07:07:42.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017024576999999999, 2023-10-08T07:07:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148344 2023-10-08T07:07:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923538+0000", 2023-10-08T07:07:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923538+0000", 2023-10-08T07:07:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923538+0000", 2023-10-08T07:07:42.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7199999999999999e-07 2023-10-08T07:07:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923555+0000", 2023-10-08T07:07:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6348e-05 2023-10-08T07:07:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923561+0000", 2023-10-08T07:07:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7569999999999998e-06 2023-10-08T07:07:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.923567+0000", 2023-10-08T07:07:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8050000000000003e-06 2023-10-08T07:07:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.926443+0000", 2023-10-08T07:07:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002875561 2023-10-08T07:07:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.926518+0000", 2023-10-08T07:07:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5360999999999999e-05 2023-10-08T07:07:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157797 4.c e62/17 4:31e28161:::10000000004.00000011:head v 62'5002, mlcod=62'5000)", 2023-10-08T07:07:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.939948+0000", 2023-10-08T07:07:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.995285, 2023-10-08T07:07:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00065061100000000005, 2023-10-08T07:07:42.348 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.939948+0000", 2023-10-08T07:07:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.939948+0000", 2023-10-08T07:07:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.939949+0000", 2023-10-08T07:07:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3399999999999998e-07 2023-10-08T07:07:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.939965+0000", 2023-10-08T07:07:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5885000000000001e-05 2023-10-08T07:07:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.939975+0000", 2023-10-08T07:07:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.006e-05 2023-10-08T07:07:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.939985+0000", 2023-10-08T07:07:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7089999999999997e-06 2023-10-08T07:07:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940030+0000", 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5163000000000001e-05 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940048+0000", 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7479e-05 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.352 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146872 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.287452+0000", 2023-10-08T07:07:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64778143899999996, 2023-10-08T07:07:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65318061199999999, 2023-10-08T07:07:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146872 2023-10-08T07:07:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.287452+0000", 2023-10-08T07:07:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.287452+0000", 2023-10-08T07:07:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.287453+0000", 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5999999999999999e-07 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.287472+0000", 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9151e-05 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.287478+0000", 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.37e-06 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.287483+0000", 2023-10-08T07:07:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6410000000000001e-06 2023-10-08T07:07:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147051 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.368350+0000", 2023-10-08T07:07:42.356 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.56688388499999998, 2023-10-08T07:07:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.57231238200000001, 2023-10-08T07:07:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147051 2023-10-08T07:07:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.368350+0000", 2023-10-08T07:07:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.368350+0000", 2023-10-08T07:07:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.368350+0000", 2023-10-08T07:07:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5600000000000005e-07 2023-10-08T07:07:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.368362+0000", 2023-10-08T07:07:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1314999999999999e-05 2023-10-08T07:07:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.368369+0000", 2023-10-08T07:07:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0480000000000001e-06 2023-10-08T07:07:42.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.368375+0000", 2023-10-08T07:07:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3600000000000001e-06 2023-10-08T07:07:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147645 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:42.360 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.34487659599999998, 2023-10-08T07:07:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.35033538800000003, 2023-10-08T07:07:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147645 2023-10-08T07:07:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0100000000000001e-07 2023-10-08T07:07:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590367+0000", 2023-10-08T07:07:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2830000000000007e-06 2023-10-08T07:07:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590372+0000", 2023-10-08T07:07:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0880000000000002e-06 2023-10-08T07:07:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590375+0000", 2023-10-08T07:07:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9869999999999999e-06 2023-10-08T07:07:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148255 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.876385+0000", 2023-10-08T07:07:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.058848971999999999, 2023-10-08T07:07:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.064336949000000004, 2023-10-08T07:07:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148255 2023-10-08T07:07:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.365 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.876385+0000", 2023-10-08T07:07:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.876385+0000", 2023-10-08T07:07:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.876385+0000", 2023-10-08T07:07:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8000000000000001e-07 2023-10-08T07:07:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.876397+0000", 2023-10-08T07:07:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1833e-05 2023-10-08T07:07:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.876403+0000", 2023-10-08T07:07:42.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8470000000000001e-06 2023-10-08T07:07:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.876407+0000", 2023-10-08T07:07:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6580000000000001e-06 2023-10-08T07:07:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.368 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157793 4.2c e62/17)", 2023-10-08T07:07:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.940001+0000", 2023-10-08T07:07:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9952326, 2023-10-08T07:07:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00074920499999999997, 2023-10-08T07:07:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940001+0000", 2023-10-08T07:07:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940001+0000", 2023-10-08T07:07:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940001+0000", 2023-10-08T07:07:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2399999999999999e-07 2023-10-08T07:07:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940012+0000", 2023-10-08T07:07:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0550000000000001e-05 2023-10-08T07:07:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940019+0000", 2023-10-08T07:07:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3730000000000004e-06 2023-10-08T07:07:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940025+0000", 2023-10-08T07:07:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9939999999999997e-06 2023-10-08T07:07:42.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147513 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541417+0000", 2023-10-08T07:07:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39381676599999998, 2023-10-08T07:07:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39936195800000002, 2023-10-08T07:07:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147513 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541417+0000", 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541417+0000", 2023-10-08T07:07:42.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541417+0000", 2023-10-08T07:07:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7500000000000001e-07 2023-10-08T07:07:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541425+0000", 2023-10-08T07:07:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.503e-06 2023-10-08T07:07:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541430+0000", 2023-10-08T07:07:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0200000000000002e-06 2023-10-08T07:07:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541433+0000", 2023-10-08T07:07:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8959999999999999e-06 2023-10-08T07:07:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147623 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.35572888899999999, 2023-10-08T07:07:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.36130339299999997, 2023-10-08T07:07:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147623 2023-10-08T07:07:42.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:42.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582310+0000", 2023-10-08T07:07:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028050800000000002 2023-10-08T07:07:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582327+0000", 2023-10-08T07:07:42.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6807e-05 2023-10-08T07:07:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582337+0000", 2023-10-08T07:07:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0454e-05 2023-10-08T07:07:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582344+0000", 2023-10-08T07:07:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2239999999999998e-06 2023-10-08T07:07:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.379 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147649 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.34485487199999998, 2023-10-08T07:07:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.35045954099999999, 2023-10-08T07:07:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.380 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147649 2023-10-08T07:07:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7399999999999999e-07 2023-10-08T07:07:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590389+0000", 2023-10-08T07:07:42.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7019999999999996e-06 2023-10-08T07:07:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590394+0000", 2023-10-08T07:07:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1229999999999999e-06 2023-10-08T07:07:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590397+0000", 2023-10-08T07:07:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8480000000000001e-06 2023-10-08T07:07:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.383 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147834 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.668432+0000", 2023-10-08T07:07:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26680120099999999, 2023-10-08T07:07:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27243501399999998, 2023-10-08T07:07:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147834 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.668432+0000", 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.668432+0000", 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.668433+0000", 2023-10-08T07:07:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.44e-07 2023-10-08T07:07:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.668450+0000", 2023-10-08T07:07:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7428e-05 2023-10-08T07:07:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.668457+0000", 2023-10-08T07:07:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.041e-06 2023-10-08T07:07:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.668463+0000", 2023-10-08T07:07:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2680000000000002e-06 2023-10-08T07:07:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148172 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.827354+0000", 2023-10-08T07:07:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.107879459, 2023-10-08T07:07:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.113543492, 2023-10-08T07:07:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148172 2023-10-08T07:07:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.388 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.827354+0000", 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.827354+0000", 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.827355+0000", 2023-10-08T07:07:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0500000000000003e-07 2023-10-08T07:07:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.827366+0000", 2023-10-08T07:07:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1436e-05 2023-10-08T07:07:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.827374+0000", 2023-10-08T07:07:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1249999999999993e-06 2023-10-08T07:07:42.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.827380+0000", 2023-10-08T07:07:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3809999999999998e-06 2023-10-08T07:07:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157735 4.20 e62/17 4:05b3915c:::10000000004.00000016:head v 62'7450, mlcod=62'7444)", 2023-10-08T07:07:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.925811+0000", 2023-10-08T07:07:42.391 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0094229499999999994, 2023-10-08T07:07:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015118009999999999, 2023-10-08T07:07:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.925811+0000", 2023-10-08T07:07:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.925811+0000", 2023-10-08T07:07:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.925811+0000", 2023-10-08T07:07:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.85e-07 2023-10-08T07:07:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.925826+0000", 2023-10-08T07:07:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4107999999999999e-05 2023-10-08T07:07:42.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.925836+0000", 2023-10-08T07:07:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0265000000000001e-05 2023-10-08T07:07:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.925843+0000", 2023-10-08T07:07:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.515e-06 2023-10-08T07:07:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933465+0000", 2023-10-08T07:07:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076213610000000001 2023-10-08T07:07:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.933484+0000", 2023-10-08T07:07:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9432e-05 2023-10-08T07:07:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157803 4.1b e62/17 4:dbb7dde6:::10000000004.0000002c:head v 62'4980, mlcod=62'4976)", 2023-10-08T07:07:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.940033+0000", 2023-10-08T07:07:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9952002, 2023-10-08T07:07:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00092927799999999996, 2023-10-08T07:07:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940033+0000", 2023-10-08T07:07:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940033+0000", 2023-10-08T07:07:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940034+0000", 2023-10-08T07:07:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3200000000000001e-07 2023-10-08T07:07:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940044+0000", 2023-10-08T07:07:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0691e-05 2023-10-08T07:07:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940051+0000", 2023-10-08T07:07:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2790000000000004e-06 2023-10-08T07:07:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940056+0000", 2023-10-08T07:07:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0769999999999998e-06 2023-10-08T07:07:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940098+0000", 2023-10-08T07:07:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2224000000000001e-05 2023-10-08T07:07:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940116+0000", 2023-10-08T07:07:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8136000000000001e-05 2023-10-08T07:07:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147281 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.464610+0000", 2023-10-08T07:07:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.470623552, 2023-10-08T07:07:42.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.476402832, 2023-10-08T07:07:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147281 2023-10-08T07:07:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.464610+0000", 2023-10-08T07:07:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.464610+0000", 2023-10-08T07:07:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.470294+0000", 2023-10-08T07:07:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056834939999999999 2023-10-08T07:07:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.470317+0000", 2023-10-08T07:07:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3000999999999999e-05 2023-10-08T07:07:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.470327+0000", 2023-10-08T07:07:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0356999999999999e-05 2023-10-08T07:07:42.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.470335+0000", 2023-10-08T07:07:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9030000000000004e-06 2023-10-08T07:07:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147514 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541436+0000", 2023-10-08T07:07:42.404 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39379719299999999, 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.399632555, 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147514 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541436+0000", 2023-10-08T07:07:42.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541436+0000", 2023-10-08T07:07:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541437+0000", 2023-10-08T07:07:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2000000000000001e-07 2023-10-08T07:07:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541448+0000", 2023-10-08T07:07:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1421e-05 2023-10-08T07:07:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541453+0000", 2023-10-08T07:07:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8790000000000002e-06 2023-10-08T07:07:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541456+0000", 2023-10-08T07:07:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7949999999999999e-06 2023-10-08T07:07:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148295 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.892374+0000", 2023-10-08T07:07:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.042859254999999999, 2023-10-08T07:07:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048748800000000002, 2023-10-08T07:07:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.408 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148295 2023-10-08T07:07:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.892374+0000", 2023-10-08T07:07:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.892374+0000", 2023-10-08T07:07:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.895311+0000", 2023-10-08T07:07:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002937046 2023-10-08T07:07:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.895332+0000", 2023-10-08T07:07:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0370999999999999e-05 2023-10-08T07:07:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.895344+0000", 2023-10-08T07:07:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1815e-05 2023-10-08T07:07:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.895352+0000", 2023-10-08T07:07:42.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4290000000000001e-06 2023-10-08T07:07:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157800 4.2b e62/17 4:d776c1c9:::10000000004.0000003d:head v 62'4969, mlcod=62'4967)", 2023-10-08T07:07:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.940067+0000", 2023-10-08T07:07:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9951663, 2023-10-08T07:07:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0011124660000000001, 2023-10-08T07:07:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940067+0000", 2023-10-08T07:07:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940067+0000", 2023-10-08T07:07:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940067+0000", 2023-10-08T07:07:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6300000000000001e-07 2023-10-08T07:07:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940079+0000", 2023-10-08T07:07:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1338999999999999e-05 2023-10-08T07:07:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940085+0000", 2023-10-08T07:07:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3690000000000003e-06 2023-10-08T07:07:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940091+0000", 2023-10-08T07:07:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7690000000000002e-06 2023-10-08T07:07:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940147+0000", 2023-10-08T07:07:42.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5825999999999997e-05 2023-10-08T07:07:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.940160+0000", 2023-10-08T07:07:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3144e-05 2023-10-08T07:07:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146834 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.416 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.276439+0000", 2023-10-08T07:07:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.65879469800000001, 2023-10-08T07:07:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.66479958699999997, 2023-10-08T07:07:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146834 2023-10-08T07:07:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.276439+0000", 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.276439+0000", 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.276439+0000", 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5699999999999998e-07 2023-10-08T07:07:42.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.276451+0000", 2023-10-08T07:07:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1258e-05 2023-10-08T07:07:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.276460+0000", 2023-10-08T07:07:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5400000000000001e-06 2023-10-08T07:07:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.276465+0000", 2023-10-08T07:07:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1100000000000002e-06 2023-10-08T07:07:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146971 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.324349+0000", 2023-10-08T07:07:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61088451300000002, 2023-10-08T07:07:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61694846800000003, 2023-10-08T07:07:42.420 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146971 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.324349+0000", 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.324349+0000", 2023-10-08T07:07:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.330294+0000", 2023-10-08T07:07:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00594481 2023-10-08T07:07:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.330312+0000", 2023-10-08T07:07:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8283000000000001e-05 2023-10-08T07:07:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.330324+0000", 2023-10-08T07:07:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2109999999999999e-05 2023-10-08T07:07:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.330333+0000", 2023-10-08T07:07:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8980000000000002e-06 2023-10-08T07:07:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146997 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.338609+0000", 2023-10-08T07:07:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.59662496200000004, 2023-10-08T07:07:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.60272300899999998, 2023-10-08T07:07:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.424 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146997 2023-10-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.338609+0000", 2023-10-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.338609+0000", 2023-10-08T07:07:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340276+0000", 2023-10-08T07:07:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016672049999999999 2023-10-08T07:07:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340310+0000", 2023-10-08T07:07:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3738999999999997e-05 2023-10-08T07:07:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340319+0000", 2023-10-08T07:07:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1989999999999995e-06 2023-10-08T07:07:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340326+0000", 2023-10-08T07:07:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4229999999999999e-06 2023-10-08T07:07:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147229 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.448507+0000", 2023-10-08T07:07:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48672644599999998, 2023-10-08T07:07:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.49286136800000002, 2023-10-08T07:07:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147229 2023-10-08T07:07:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.448507+0000", 2023-10-08T07:07:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.448507+0000", 2023-10-08T07:07:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.450294+0000", 2023-10-08T07:07:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001786646 2023-10-08T07:07:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.450311+0000", 2023-10-08T07:07:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7550999999999998e-05 2023-10-08T07:07:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.450322+0000", 2023-10-08T07:07:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0934999999999999e-05 2023-10-08T07:07:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.450331+0000", 2023-10-08T07:07:42.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.687e-06 2023-10-08T07:07:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147318 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.481483+0000", 2023-10-08T07:07:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.45375028099999998, 2023-10-08T07:07:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.45991736599999999, 2023-10-08T07:07:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.432 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147318 2023-10-08T07:07:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.481483+0000", 2023-10-08T07:07:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.481483+0000", 2023-10-08T07:07:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.481484+0000", 2023-10-08T07:07:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7999999999999996e-07 2023-10-08T07:07:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.481499+0000", 2023-10-08T07:07:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4722000000000001e-05 2023-10-08T07:07:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.481524+0000", 2023-10-08T07:07:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5584000000000001e-05 2023-10-08T07:07:42.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.481530+0000", 2023-10-08T07:07:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5389999999999998e-06 2023-10-08T07:07:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.436 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147023 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.354508+0000", 2023-10-08T07:07:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.58072602699999998, 2023-10-08T07:07:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.58692298099999995, 2023-10-08T07:07:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147023 2023-10-08T07:07:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.437 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.354508+0000", 2023-10-08T07:07:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.354508+0000", 2023-10-08T07:07:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.354508+0000", 2023-10-08T07:07:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6300000000000005e-07 2023-10-08T07:07:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.354524+0000", 2023-10-08T07:07:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6163000000000001e-05 2023-10-08T07:07:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.354533+0000", 2023-10-08T07:07:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3780000000000001e-06 2023-10-08T07:07:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.354538+0000", 2023-10-08T07:07:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3800000000000002e-06 2023-10-08T07:07:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147887 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.698451+0000", 2023-10-08T07:07:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.23678302600000001, 2023-10-08T07:07:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.24301035100000001, 2023-10-08T07:07:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147887 2023-10-08T07:07:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.698451+0000", 2023-10-08T07:07:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.698451+0000", 2023-10-08T07:07:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.698451+0000", 2023-10-08T07:07:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2023-10-08T07:07:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.698462+0000", 2023-10-08T07:07:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1107000000000001e-05 2023-10-08T07:07:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.698468+0000", 2023-10-08T07:07:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.879e-06 2023-10-08T07:07:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.698474+0000", 2023-10-08T07:07:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1999999999999999e-06 2023-10-08T07:07:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.444 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148132 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.810355+0000", 2023-10-08T07:07:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.12487872799999999, 2023-10-08T07:07:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13113540900000001, 2023-10-08T07:07:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148132 2023-10-08T07:07:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.810355+0000", 2023-10-08T07:07:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.810355+0000", 2023-10-08T07:07:42.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.812295+0000", 2023-10-08T07:07:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001939784 2023-10-08T07:07:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.812310+0000", 2023-10-08T07:07:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5486e-05 2023-10-08T07:07:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.812322+0000", 2023-10-08T07:07:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1799e-05 2023-10-08T07:07:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.812330+0000", 2023-10-08T07:07:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0260000000000007e-06 2023-10-08T07:07:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157696 4.20 e62/17 4:07572838:::10000000004.00000010:head v 62'7447, mlcod=62'7441)", 2023-10-08T07:07:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.911342+0000", 2023-10-08T07:07:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.023891718999999999, 2023-10-08T07:07:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.030180222, 2023-10-08T07:07:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.911342+0000", 2023-10-08T07:07:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.911342+0000", 2023-10-08T07:07:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.911342+0000", 2023-10-08T07:07:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.22e-07 2023-10-08T07:07:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.911355+0000", 2023-10-08T07:07:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2473999999999999e-05 2023-10-08T07:07:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.911362+0000", 2023-10-08T07:07:42.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2690000000000002e-06 2023-10-08T07:07:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.911366+0000", 2023-10-08T07:07:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2780000000000004e-06 2023-10-08T07:07:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.915853+0000", 2023-10-08T07:07:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004486571 2023-10-08T07:07:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.915870+0000", 2023-10-08T07:07:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7391999999999999e-05 2023-10-08T07:07:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:157763 4.20 e62/17 4:05b3915c:::10000000004.00000016:head v 62'7451, mlcod=62'7444)", 2023-10-08T07:07:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.927076+0000", 2023-10-08T07:07:42.453 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0081578190000000002, 2023-10-08T07:07:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014480051000000001, 2023-10-08T07:07:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.927076+0000", 2023-10-08T07:07:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.927076+0000", 2023-10-08T07:07:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.927076+0000", 2023-10-08T07:07:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3900000000000004e-07 2023-10-08T07:07:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.927113+0000", 2023-10-08T07:07:42.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6847999999999997e-05 2023-10-08T07:07:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.927123+0000", 2023-10-08T07:07:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0093e-05 2023-10-08T07:07:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.927132+0000", 2023-10-08T07:07:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9120000000000004e-06 2023-10-08T07:07:42.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937152+0000", 2023-10-08T07:07:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010020055 2023-10-08T07:07:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.937171+0000", 2023-10-08T07:07:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8487000000000001e-05 2023-10-08T07:07:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147519 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.393732837, 2023-10-08T07:07:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40009004599999998, 2023-10-08T07:07:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.458 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147519 2023-10-08T07:07:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:42.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5199999999999998e-07 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541510+0000", 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4690000000000003e-06 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541515+0000", 2023-10-08T07:07:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7260000000000002e-06 2023-10-08T07:07:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541518+0000", 2023-10-08T07:07:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7329999999999999e-06 2023-10-08T07:07:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147596 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.365878759, 2023-10-08T07:07:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.372266286, 2023-10-08T07:07:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147596 2023-10-08T07:07:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.462 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571294+0000", 2023-10-08T07:07:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001939037 2023-10-08T07:07:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571314+0000", 2023-10-08T07:07:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9791000000000001e-05 2023-10-08T07:07:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571327+0000", 2023-10-08T07:07:42.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3078000000000001e-05 2023-10-08T07:07:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571334+0000", 2023-10-08T07:07:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2429999999999999e-06 2023-10-08T07:07:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.465 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148133 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.812344+0000", 2023-10-08T07:07:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.122889132, 2023-10-08T07:07:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.129308744, 2023-10-08T07:07:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148133 2023-10-08T07:07:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.466 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.812344+0000", 2023-10-08T07:07:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.812344+0000", 2023-10-08T07:07:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.815370+0000", 2023-10-08T07:07:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030254819999999999 2023-10-08T07:07:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.815394+0000", 2023-10-08T07:07:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3822999999999999e-05 2023-10-08T07:07:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.815408+0000", 2023-10-08T07:07:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4208e-05 2023-10-08T07:07:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.815418+0000", 2023-10-08T07:07:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0069e-05 2023-10-08T07:07:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.469 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147000 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.340406+0000", 2023-10-08T07:07:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.59482764700000001, 2023-10-08T07:07:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.60127854800000002, 2023-10-08T07:07:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147000 2023-10-08T07:07:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340406+0000", 2023-10-08T07:07:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340406+0000", 2023-10-08T07:07:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340406+0000", 2023-10-08T07:07:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8000000000000001e-07 2023-10-08T07:07:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340417+0000", 2023-10-08T07:07:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1075e-05 2023-10-08T07:07:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340423+0000", 2023-10-08T07:07:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0460000000000002e-06 2023-10-08T07:07:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340428+0000", 2023-10-08T07:07:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.651e-06 2023-10-08T07:07:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147894 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.698510+0000", 2023-10-08T07:07:42.474 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.23672331199999999, 2023-10-08T07:07:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.24320807899999999, 2023-10-08T07:07:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147894 2023-10-08T07:07:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.698510+0000", 2023-10-08T07:07:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.698510+0000", 2023-10-08T07:07:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.698511+0000", 2023-10-08T07:07:42.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8200000000000001e-07 2023-10-08T07:07:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.698524+0000", 2023-10-08T07:07:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2984e-05 2023-10-08T07:07:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.698530+0000", 2023-10-08T07:07:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5339999999999996e-06 2023-10-08T07:07:42.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.698535+0000", 2023-10-08T07:07:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4499999999999997e-06 2023-10-08T07:07:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.478 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147001 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.340434+0000", 2023-10-08T07:07:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.59479973100000005, 2023-10-08T07:07:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.60131669200000004, 2023-10-08T07:07:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147001 2023-10-08T07:07:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340434+0000", 2023-10-08T07:07:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340434+0000", 2023-10-08T07:07:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340434+0000", 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9499999999999998e-07 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340446+0000", 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1905e-05 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340452+0000", 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.733e-06 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.340457+0000", 2023-10-08T07:07:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8709999999999996e-06 2023-10-08T07:07:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147233 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.454345+0000", 2023-10-08T07:07:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48088832500000001, 2023-10-08T07:07:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48743870299999997, 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147233 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.454345+0000", 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.454345+0000", 2023-10-08T07:07:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.454346+0000", 2023-10-08T07:07:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8500000000000001e-07 2023-10-08T07:07:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.454359+0000", 2023-10-08T07:07:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2744e-05 2023-10-08T07:07:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.454365+0000", 2023-10-08T07:07:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6239999999999996e-06 2023-10-08T07:07:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.454371+0000", 2023-10-08T07:07:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8900000000000004e-06 2023-10-08T07:07:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147326 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.485416+0000", 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.44981725900000002, 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.456399787, 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147326 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.485416+0000", 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.485416+0000", 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.485417+0000", 2023-10-08T07:07:42.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2900000000000004e-07 2023-10-08T07:07:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.485429+0000", 2023-10-08T07:07:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2316e-05 2023-10-08T07:07:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.485435+0000", 2023-10-08T07:07:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1229999999999997e-06 2023-10-08T07:07:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.485441+0000", 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.57e-06 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147365 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.498455+0000", 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43677898599999998, 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44339330199999999, 2023-10-08T07:07:42.491 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147365 2023-10-08T07:07:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.498455+0000", 2023-10-08T07:07:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.498455+0000", 2023-10-08T07:07:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.498455+0000", 2023-10-08T07:07:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8799999999999998e-07 2023-10-08T07:07:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.498470+0000", 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4741e-05 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.498476+0000", 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0120000000000002e-06 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.498480+0000", 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4939999999999997e-06 2023-10-08T07:07:42.494 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147407 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.513421+0000", 2023-10-08T07:07:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42181275400000001, 2023-10-08T07:07:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.42845937299999998, 2023-10-08T07:07:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.495 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147407 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.513421+0000", 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.513421+0000", 2023-10-08T07:07:42.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515295+0000", 2023-10-08T07:07:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001873862 2023-10-08T07:07:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515312+0000", 2023-10-08T07:07:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6824999999999999e-05 2023-10-08T07:07:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515322+0000", 2023-10-08T07:07:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0088000000000001e-05 2023-10-08T07:07:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515329+0000", 2023-10-08T07:07:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1470000000000004e-06 2023-10-08T07:07:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147523 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39369174400000001, 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40036856799999998, 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147523 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2023-10-08T07:07:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541554+0000", 2023-10-08T07:07:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1515000000000001e-05 2023-10-08T07:07:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541557+0000", 2023-10-08T07:07:42.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.675e-06 2023-10-08T07:07:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541560+0000", 2023-10-08T07:07:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.841e-06 2023-10-08T07:07:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147850 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.502 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.686342+0000", 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.24889159499999999, 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.255693426, 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147850 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.686342+0000", 2023-10-08T07:07:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.686342+0000", 2023-10-08T07:07:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.686343+0000", 2023-10-08T07:07:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0399999999999996e-07 2023-10-08T07:07:42.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.686361+0000", 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8009999999999999e-05 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.686368+0000", 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2989999999999999e-06 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.686374+0000", 2023-10-08T07:07:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9989999999999997e-06 2023-10-08T07:07:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148329 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.909600+0000", 2023-10-08T07:07:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.025633900000000001, 2023-10-08T07:07:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.032466790000000002, 2023-10-08T07:07:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.506 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148329 2023-10-08T07:07:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.909600+0000", 2023-10-08T07:07:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.909600+0000", 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.912136+0000", 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025362079999999999 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.912154+0000", 2023-10-08T07:07:42.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7611000000000001e-05 2023-10-08T07:07:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.912163+0000", 2023-10-08T07:07:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7019999999999996e-06 2023-10-08T07:07:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.912172+0000", 2023-10-08T07:07:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8699999999999998e-06 2023-10-08T07:07:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148349 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.927466+0000", 2023-10-08T07:07:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0077678460000000001, 2023-10-08T07:07:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014632726, 2023-10-08T07:07:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148349 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.927466+0000", 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.927466+0000", 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.929294+0000", 2023-10-08T07:07:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001828025 2023-10-08T07:07:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.929312+0000", 2023-10-08T07:07:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8012e-05 2023-10-08T07:07:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.929322+0000", 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0386e-05 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.929330+0000", 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5290000000000003e-06 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.513 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148350 4.9 4:90f7d93b:::10000000004.00000021:head [write 3198976~4096 in=4096b,write 3342336~4096 in=4096b,write 3432448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.929343+0000", 2023-10-08T07:07:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0058904700000000001, 2023-10-08T07:07:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012789965, 2023-10-08T07:07:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148350 2023-10-08T07:07:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.929343+0000", 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.929343+0000", 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.929344+0000", 2023-10-08T07:07:42.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0999999999999998e-07 2023-10-08T07:07:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.929359+0000", 2023-10-08T07:07:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4837999999999999e-05 2023-10-08T07:07:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.929365+0000", 2023-10-08T07:07:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9160000000000004e-06 2023-10-08T07:07:42.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.929371+0000", 2023-10-08T07:07:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8359999999999997e-06 2023-10-08T07:07:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931640+0000", 2023-10-08T07:07:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022682259999999999 2023-10-08T07:07:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.931722+0000", 2023-10-08T07:07:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2242000000000003e-05 2023-10-08T07:07:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147165 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.422389+0000", 2023-10-08T07:07:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51284419599999997, 2023-10-08T07:07:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.51978214700000003, 2023-10-08T07:07:42.518 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147165 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.422389+0000", 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.422389+0000", 2023-10-08T07:07:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.424295+0000", 2023-10-08T07:07:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019052920000000001 2023-10-08T07:07:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.424311+0000", 2023-10-08T07:07:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6269999999999998e-05 2023-10-08T07:07:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.424321+0000", 2023-10-08T07:07:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7100000000000002e-06 2023-10-08T07:07:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.424328+0000", 2023-10-08T07:07:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2320000000000004e-06 2023-10-08T07:07:42.521 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146943 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.316350+0000", 2023-10-08T07:07:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61888352700000004, 2023-10-08T07:07:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.62585090799999998, 2023-10-08T07:07:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146943 2023-10-08T07:07:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.316350+0000", 2023-10-08T07:07:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.316350+0000", 2023-10-08T07:07:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.318482+0000", 2023-10-08T07:07:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002131717 2023-10-08T07:07:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.318496+0000", 2023-10-08T07:07:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3738e-05 2023-10-08T07:07:42.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.318506+0000", 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0299000000000001e-05 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.318511+0000", 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6280000000000002e-06 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147238 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.454463+0000", 2023-10-08T07:07:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48077042599999997, 2023-10-08T07:07:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48777121600000001, 2023-10-08T07:07:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147238 2023-10-08T07:07:42.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.454463+0000", 2023-10-08T07:07:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.454463+0000", 2023-10-08T07:07:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.454464+0000", 2023-10-08T07:07:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2023-10-08T07:07:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.454477+0000", 2023-10-08T07:07:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3787e-05 2023-10-08T07:07:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.454484+0000", 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4350000000000002e-06 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.454490+0000", 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1249999999999998e-06 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147291 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.529 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.470683+0000", 2023-10-08T07:07:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.46455090199999999, 2023-10-08T07:07:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47158345299999999, 2023-10-08T07:07:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147291 2023-10-08T07:07:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.470683+0000", 2023-10-08T07:07:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.470683+0000", 2023-10-08T07:07:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.474295+0000", 2023-10-08T07:07:42.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003612756 2023-10-08T07:07:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.474314+0000", 2023-10-08T07:07:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8498000000000001e-05 2023-10-08T07:07:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.474327+0000", 2023-10-08T07:07:42.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2592000000000001e-05 2023-10-08T07:07:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.474337+0000", 2023-10-08T07:07:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.063e-05 2023-10-08T07:07:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148136 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.533 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.815510+0000", 2023-10-08T07:07:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.119723103, 2023-10-08T07:07:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12679844400000001, 2023-10-08T07:07:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148136 2023-10-08T07:07:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.815510+0000", 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.815510+0000", 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.817296+0000", 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001785437 2023-10-08T07:07:42.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.817325+0000", 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9252e-05 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.817338+0000", 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.289e-05 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.817346+0000", 2023-10-08T07:07:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8169999999999999e-06 2023-10-08T07:07:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:146974 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.330390+0000", 2023-10-08T07:07:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.60484350200000003, 2023-10-08T07:07:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61195440000000001, 2023-10-08T07:07:42.537 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 146974 2023-10-08T07:07:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.330390+0000", 2023-10-08T07:07:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.330390+0000", 2023-10-08T07:07:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.332294+0000", 2023-10-08T07:07:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001903905 2023-10-08T07:07:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.332310+0000", 2023-10-08T07:07:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6319000000000001e-05 2023-10-08T07:07:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.332323+0000", 2023-10-08T07:07:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2243e-05 2023-10-08T07:07:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.332331+0000", 2023-10-08T07:07:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2209999999999997e-06 2023-10-08T07:07:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147412 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.515443+0000", 2023-10-08T07:07:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.419790147, 2023-10-08T07:07:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.426959427, 2023-10-08T07:07:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147412 2023-10-08T07:07:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515443+0000", 2023-10-08T07:07:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515443+0000", 2023-10-08T07:07:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515444+0000", 2023-10-08T07:07:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7800000000000002e-07 2023-10-08T07:07:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515463+0000", 2023-10-08T07:07:42.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8771999999999999e-05 2023-10-08T07:07:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515469+0000", 2023-10-08T07:07:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0900000000000001e-06 2023-10-08T07:07:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515474+0000", 2023-10-08T07:07:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3159999999999996e-06 2023-10-08T07:07:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.544 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147479 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.40475387499999999, 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41198114499999999, 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.545 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147479 2023-10-08T07:07:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533313+0000", 2023-10-08T07:07:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002832841 2023-10-08T07:07:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533338+0000", 2023-10-08T07:07:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5052999999999999e-05 2023-10-08T07:07:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533350+0000", 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2561000000000001e-05 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533357+0000", 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0870000000000001e-06 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.548 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:148142 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.817360+0000", 2023-10-08T07:07:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.11787373900000001, 2023-10-08T07:07:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.125156498, 2023-10-08T07:07:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 148142 2023-10-08T07:07:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:42.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.817360+0000", 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.817360+0000", 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.817360+0000", 2023-10-08T07:07:42.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3900000000000004e-07 2023-10-08T07:07:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.817377+0000", 2023-10-08T07:07:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6354e-05 2023-10-08T07:07:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.817385+0000", 2023-10-08T07:07:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4179999999999997e-06 2023-10-08T07:07:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:42.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.817391+0000", 2023-10-08T07:07:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.049e-06 2023-10-08T07:07:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:42.552 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 148 2023-10-08T07:07:42.552 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:42.553 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T07:07:42.554 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:42.552+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:42.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:42.654 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:42.653+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:42.754 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:42.754 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:42.754 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:42.754 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:42.754 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:42.756 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:42.754+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:42.770 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:42.856 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:42.855+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:42.959 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:42.956+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:43.017 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:43.017 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:43.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:43.018 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:43.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.018 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147120 4.28 4:16edf4d3:::10000000004.00000027:head [write 2162688~4096,write 2207744~4096,write 2367488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.018 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.396333+0000", 2023-10-08T07:07:43.018 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.6180865340000001, 2023-10-08T07:07:43.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4068324169999999, 2023-10-08T07:07:43.019 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.019 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.019 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147120 2023-10-08T07:07:43.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.019 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396333+0000", 2023-10-08T07:07:43.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396333+0000", 2023-10-08T07:07:43.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396333+0000", 2023-10-08T07:07:43.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.53e-07 2023-10-08T07:07:43.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396343+0000", 2023-10-08T07:07:43.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7380000000000006e-06 2023-10-08T07:07:43.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396349+0000", 2023-10-08T07:07:43.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4929999999999998e-06 2023-10-08T07:07:43.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396352+0000", 2023-10-08T07:07:43.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.208e-06 2023-10-08T07:07:43.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.770600+0000", 2023-10-08T07:07:43.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.374248406 2023-10-08T07:07:43.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.770657+0000", 2023-10-08T07:07:43.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6981000000000002e-05 2023-10-08T07:07:43.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.803025+0000", 2023-10-08T07:07:43.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.032367893000000002 2023-10-08T07:07:43.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.803087+0000", 2023-10-08T07:07:43.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1478999999999999e-05 2023-10-08T07:07:43.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.803166+0000", 2023-10-08T07:07:43.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8866e-05 2023-10-08T07:07:43.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.026 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.027 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147122 4.10 4:08d50e0e:::10000000004.0000003f:head [write 692224~4096,write 770048~4096,write 884736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.027 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.396357+0000", 2023-10-08T07:07:43.027 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.618063045, 2023-10-08T07:07:43.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.40694992, 2023-10-08T07:07:43.027 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.027 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.027 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.028 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147122 2023-10-08T07:07:43.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.028 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396357+0000", 2023-10-08T07:07:43.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.396357+0000", 2023-10-08T07:07:43.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.398293+0000", 2023-10-08T07:07:43.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019360829999999999 2023-10-08T07:07:43.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.398305+0000", 2023-10-08T07:07:43.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2551000000000001e-05 2023-10-08T07:07:43.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.398314+0000", 2023-10-08T07:07:43.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8689999999999993e-06 2023-10-08T07:07:43.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.398319+0000", 2023-10-08T07:07:43.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9409999999999998e-06 2023-10-08T07:07:43.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.773268+0000", 2023-10-08T07:07:43.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.374948512 2023-10-08T07:07:43.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.773345+0000", 2023-10-08T07:07:43.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6948999999999998e-05 2023-10-08T07:07:43.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.803177+0000", 2023-10-08T07:07:43.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.029832346999999999 2023-10-08T07:07:43.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.803228+0000", 2023-10-08T07:07:43.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1631000000000001e-05 2023-10-08T07:07:43.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.803307+0000", 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8036999999999998e-05 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147134 4.10 4:0b5763e1:::10000000004.00000015:head [write 2945024~4096,write 2998272~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.404385+0000", 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.6100343669999999, 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3990415119999999, 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.033 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.034 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147134 2023-10-08T07:07:43.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.034 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.404385+0000", 2023-10-08T07:07:43.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.404385+0000", 2023-10-08T07:07:43.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.404386+0000", 2023-10-08T07:07:43.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2199999999999999e-07 2023-10-08T07:07:43.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.404402+0000", 2023-10-08T07:07:43.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6198999999999999e-05 2023-10-08T07:07:43.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.404409+0000", 2023-10-08T07:07:43.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3189999999999997e-06 2023-10-08T07:07:43.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.404415+0000", 2023-10-08T07:07:43.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3530000000000002e-06 2023-10-08T07:07:43.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.778766+0000", 2023-10-08T07:07:43.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.374350934 2023-10-08T07:07:43.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.778839+0000", 2023-10-08T07:07:43.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3215999999999998e-05 2023-10-08T07:07:43.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.803314+0000", 2023-10-08T07:07:43.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024475552000000001 2023-10-08T07:07:43.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.803356+0000", 2023-10-08T07:07:43.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1625000000000002e-05 2023-10-08T07:07:43.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.803427+0000", 2023-10-08T07:07:43.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0891999999999998e-05 2023-10-08T07:07:43.042 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.042 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.042 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.043 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147318 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2695168~4096,write 2764800~4096,write 2772992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.043 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.481483+0000", 2023-10-08T07:07:43.043 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.5329363379999998, 2023-10-08T07:07:43.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.399074223, 2023-10-08T07:07:43.043 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.043 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.043 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.044 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147318 2023-10-08T07:07:43.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.044 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.481483+0000", 2023-10-08T07:07:43.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.481483+0000", 2023-10-08T07:07:43.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.481484+0000", 2023-10-08T07:07:43.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7999999999999996e-07 2023-10-08T07:07:43.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.481499+0000", 2023-10-08T07:07:43.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4722000000000001e-05 2023-10-08T07:07:43.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.481524+0000", 2023-10-08T07:07:43.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5584000000000001e-05 2023-10-08T07:07:43.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.481530+0000", 2023-10-08T07:07:43.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5389999999999998e-06 2023-10-08T07:07:43.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.837425+0000", 2023-10-08T07:07:43.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.355895673 2023-10-08T07:07:43.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.837510+0000", 2023-10-08T07:07:43.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4543999999999996e-05 2023-10-08T07:07:43.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:43.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.838038+0000", 2023-10-08T07:07:43.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00052783599999999995 2023-10-08T07:07:43.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:43.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.846027+0000", 2023-10-08T07:07:43.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007989164 2023-10-08T07:07:43.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.880448+0000", 2023-10-08T07:07:43.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034421159999999999 2023-10-08T07:07:43.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.880511+0000", 2023-10-08T07:07:43.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3236000000000002e-05 2023-10-08T07:07:43.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.880558+0000", 2023-10-08T07:07:43.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6285000000000002e-05 2023-10-08T07:07:43.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.052 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.053 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147344 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3883008~4096,write 3903488~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.053 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.491339+0000", 2023-10-08T07:07:43.053 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.523080918, 2023-10-08T07:07:43.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.406697123, 2023-10-08T07:07:43.053 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.053 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.053 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147344 2023-10-08T07:07:43.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.054 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.491339+0000", 2023-10-08T07:07:43.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.491339+0000", 2023-10-08T07:07:43.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.491339+0000", 2023-10-08T07:07:43.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7899999999999998e-07 2023-10-08T07:07:43.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.491350+0000", 2023-10-08T07:07:43.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.043e-05 2023-10-08T07:07:43.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.491358+0000", 2023-10-08T07:07:43.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0209999999999999e-06 2023-10-08T07:07:43.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.491363+0000", 2023-10-08T07:07:43.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7010000000000001e-06 2023-10-08T07:07:43.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.846058+0000", 2023-10-08T07:07:43.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.354694364 2023-10-08T07:07:43.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.846133+0000", 2023-10-08T07:07:43.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4973000000000002e-05 2023-10-08T07:07:43.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:43.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.846264+0000", 2023-10-08T07:07:43.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013090399999999999 2023-10-08T07:07:43.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:43.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.855191+0000", 2023-10-08T07:07:43.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089272090000000002 2023-10-08T07:07:43.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.897939+0000", 2023-10-08T07:07:43.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.042747625999999997 2023-10-08T07:07:43.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.897995+0000", 2023-10-08T07:07:43.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6833999999999998e-05 2023-10-08T07:07:43.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.898036+0000", 2023-10-08T07:07:43.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0482000000000003e-05 2023-10-08T07:07:43.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.066 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.066 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.066 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147365 4.28 4:16edf4d3:::10000000004.00000027:head [write 2375680~4096,write 2592768~4096,write 2682880~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.067 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.498455+0000", 2023-10-08T07:07:43.067 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.515965043, 2023-10-08T07:07:43.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3997552660000001, 2023-10-08T07:07:43.067 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.067 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.068 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147365 2023-10-08T07:07:43.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.069 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.498455+0000", 2023-10-08T07:07:43.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.498455+0000", 2023-10-08T07:07:43.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.498455+0000", 2023-10-08T07:07:43.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8799999999999998e-07 2023-10-08T07:07:43.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.498470+0000", 2023-10-08T07:07:43.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4741e-05 2023-10-08T07:07:43.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.498476+0000", 2023-10-08T07:07:43.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0120000000000002e-06 2023-10-08T07:07:43.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.498480+0000", 2023-10-08T07:07:43.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4939999999999997e-06 2023-10-08T07:07:43.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.848019+0000", 2023-10-08T07:07:43.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.34953894 2023-10-08T07:07:43.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.848093+0000", 2023-10-08T07:07:43.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3447000000000003e-05 2023-10-08T07:07:43.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.898084+0000", 2023-10-08T07:07:43.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049991122999999998 2023-10-08T07:07:43.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.898137+0000", 2023-10-08T07:07:43.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3134000000000003e-05 2023-10-08T07:07:43.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.898210+0000", 2023-10-08T07:07:43.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2986999999999998e-05 2023-10-08T07:07:43.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.079 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.080 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147377 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3878912~4096,write 3928064~4096,write 4096000~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.080 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.501563+0000", 2023-10-08T07:07:43.080 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.512856859, 2023-10-08T07:07:43.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.434639131, 2023-10-08T07:07:43.080 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.081 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.081 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.081 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.081 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.081 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147377 2023-10-08T07:07:43.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.082 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.501563+0000", 2023-10-08T07:07:43.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.501563+0000", 2023-10-08T07:07:43.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.501563+0000", 2023-10-08T07:07:43.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2899999999999999e-07 2023-10-08T07:07:43.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.501575+0000", 2023-10-08T07:07:43.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2221e-05 2023-10-08T07:07:43.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.501582+0000", 2023-10-08T07:07:43.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4679999999999997e-06 2023-10-08T07:07:43.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.501589+0000", 2023-10-08T07:07:43.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6420000000000001e-06 2023-10-08T07:07:43.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.903371+0000", 2023-10-08T07:07:43.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4017824800000001 2023-10-08T07:07:43.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.903456+0000", 2023-10-08T07:07:43.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5007999999999997e-05 2023-10-08T07:07:43.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.936056+0000", 2023-10-08T07:07:43.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.032600373000000002 2023-10-08T07:07:43.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.936118+0000", 2023-10-08T07:07:43.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1618999999999994e-05 2023-10-08T07:07:43.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.936202+0000", 2023-10-08T07:07:43.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3891e-05 2023-10-08T07:07:43.092 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.092 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.092 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.093 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147407 4.28 4:15b6682b:::10000000004.0000000b:head [write 1478656~4096,write 1613824~4096,write 1626112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.093 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.513421+0000", 2023-10-08T07:07:43.093 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.5009988110000001, 2023-10-08T07:07:43.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.408862756, 2023-10-08T07:07:43.093 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.094 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.094 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147407 2023-10-08T07:07:43.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.095 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.513421+0000", 2023-10-08T07:07:43.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.513421+0000", 2023-10-08T07:07:43.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515295+0000", 2023-10-08T07:07:43.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001873862 2023-10-08T07:07:43.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515312+0000", 2023-10-08T07:07:43.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6824999999999999e-05 2023-10-08T07:07:43.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515322+0000", 2023-10-08T07:07:43.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0088000000000001e-05 2023-10-08T07:07:43.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515329+0000", 2023-10-08T07:07:43.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1470000000000004e-06 2023-10-08T07:07:43.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.906106+0000", 2023-10-08T07:07:43.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.39077717 2023-10-08T07:07:43.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.906194+0000", 2023-10-08T07:07:43.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8517000000000006e-05 2023-10-08T07:07:43.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.922171+0000", 2023-10-08T07:07:43.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015977018999999999 2023-10-08T07:07:43.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.922217+0000", 2023-10-08T07:07:43.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5504999999999999e-05 2023-10-08T07:07:43.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.922284+0000", 2023-10-08T07:07:43.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6623000000000002e-05 2023-10-08T07:07:43.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.103 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.103 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147412 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3796992~4096,write 3870720~4096,write 4026368~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.103 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.515443+0000", 2023-10-08T07:07:43.103 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.4989762039999999, 2023-10-08T07:07:43.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4069327389999999, 2023-10-08T07:07:43.106 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.106 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.106 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.106 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147412 2023-10-08T07:07:43.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.106 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515443+0000", 2023-10-08T07:07:43.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515443+0000", 2023-10-08T07:07:43.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515444+0000", 2023-10-08T07:07:43.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7800000000000002e-07 2023-10-08T07:07:43.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515463+0000", 2023-10-08T07:07:43.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8771999999999999e-05 2023-10-08T07:07:43.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515469+0000", 2023-10-08T07:07:43.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0900000000000001e-06 2023-10-08T07:07:43.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.515474+0000", 2023-10-08T07:07:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3159999999999996e-06 2023-10-08T07:07:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.911539+0000", 2023-10-08T07:07:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3960650349999999 2023-10-08T07:07:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.911620+0000", 2023-10-08T07:07:43.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0846000000000005e-05 2023-10-08T07:07:43.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:43.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.911764+0000", 2023-10-08T07:07:43.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143941 2023-10-08T07:07:43.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:43.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.918995+0000", 2023-10-08T07:07:43.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0072313120000000002 2023-10-08T07:07:43.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.922297+0000", 2023-10-08T07:07:43.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033017910000000001 2023-10-08T07:07:43.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.922342+0000", 2023-10-08T07:07:43.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5506000000000001e-05 2023-10-08T07:07:43.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.922376+0000", 2023-10-08T07:07:43.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3751999999999998e-05 2023-10-08T07:07:43.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.112 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.112 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147436 4.10 4:0b5763e1:::10000000004.00000015:head [write 3866624~4096,write 3903488~4096,write 3940352~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.113 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.520851+0000", 2023-10-08T07:07:43.113 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.493568418, 2023-10-08T07:07:43.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.415506259, 2023-10-08T07:07:43.113 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.113 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.113 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147436 2023-10-08T07:07:43.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.113 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520851+0000", 2023-10-08T07:07:43.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520851+0000", 2023-10-08T07:07:43.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520852+0000", 2023-10-08T07:07:43.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.63e-07 2023-10-08T07:07:43.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520864+0000", 2023-10-08T07:07:43.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2731000000000001e-05 2023-10-08T07:07:43.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520873+0000", 2023-10-08T07:07:43.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6770000000000001e-06 2023-10-08T07:07:43.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520879+0000", 2023-10-08T07:07:43.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7300000000000002e-06 2023-10-08T07:07:43.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.914737+0000", 2023-10-08T07:07:43.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3938584679999999 2023-10-08T07:07:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.914818+0000", 2023-10-08T07:07:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0704999999999994e-05 2023-10-08T07:07:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.936221+0000", 2023-10-08T07:07:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021402636999999999 2023-10-08T07:07:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.936269+0000", 2023-10-08T07:07:43.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8300000000000002e-05 2023-10-08T07:07:43.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.936357+0000", 2023-10-08T07:07:43.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8548000000000007e-05 2023-10-08T07:07:43.118 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.118 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.119 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147439 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2338816~4096,write 2379776~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.119 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.520936+0000", 2023-10-08T07:07:43.119 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.4934834610000001, 2023-10-08T07:07:43.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.422219619, 2023-10-08T07:07:43.119 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.119 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.119 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.120 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147439 2023-10-08T07:07:43.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520936+0000", 2023-10-08T07:07:43.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520936+0000", 2023-10-08T07:07:43.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520937+0000", 2023-10-08T07:07:43.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3399999999999999e-07 2023-10-08T07:07:43.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.520949+0000", 2023-10-08T07:07:43.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2724999999999999e-05 2023-10-08T07:07:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.522199+0000", 2023-10-08T07:07:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012496110000000001 2023-10-08T07:07:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.522205+0000", 2023-10-08T07:07:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1820000000000003e-06 2023-10-08T07:07:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.914712+0000", 2023-10-08T07:07:43.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3925071680000001 2023-10-08T07:07:43.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.914783+0000", 2023-10-08T07:07:43.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0492000000000002e-05 2023-10-08T07:07:43.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:43.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.914921+0000", 2023-10-08T07:07:43.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013764300000000001 2023-10-08T07:07:43.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.936212+0000", 2023-10-08T07:07:43.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021291509 2023-10-08T07:07:43.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:43.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.943077+0000", 2023-10-08T07:07:43.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068650359999999997 2023-10-08T07:07:43.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.943115+0000", 2023-10-08T07:07:43.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7713999999999998e-05 2023-10-08T07:07:43.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.943156+0000", 2023-10-08T07:07:43.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1004999999999998e-05 2023-10-08T07:07:43.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.125 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.126 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147460 4.10 4:0b5763e1:::10000000004.00000015:head [write 1376256~4096,write 1671168~4096,write 1789952~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.126 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.526386+0000", 2023-10-08T07:07:43.126 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.4880333139999999, 2023-10-08T07:07:43.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.410109262, 2023-10-08T07:07:43.126 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.126 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.127 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147460 2023-10-08T07:07:43.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.127 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.526386+0000", 2023-10-08T07:07:43.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.526386+0000", 2023-10-08T07:07:43.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.526387+0000", 2023-10-08T07:07:43.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4900000000000005e-07 2023-10-08T07:07:43.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.526402+0000", 2023-10-08T07:07:43.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4486e-05 2023-10-08T07:07:43.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.526412+0000", 2023-10-08T07:07:43.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0189e-05 2023-10-08T07:07:43.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.526420+0000", 2023-10-08T07:07:43.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7749999999999993e-06 2023-10-08T07:07:43.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.919610+0000", 2023-10-08T07:07:43.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3931907190000001 2023-10-08T07:07:43.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.919699+0000", 2023-10-08T07:07:43.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8967000000000004e-05 2023-10-08T07:07:43.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.936373+0000", 2023-10-08T07:07:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016673813999999999 2023-10-08T07:07:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.936428+0000", 2023-10-08T07:07:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4483e-05 2023-10-08T07:07:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.936496+0000", 2023-10-08T07:07:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8079999999999999e-05 2023-10-08T07:07:43.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.132 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.132 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147478 4.28 4:16edf4d3:::10000000004.00000027:head [write 2797568~4096,write 2830336~4096,write 3002368~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.132 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.530452+0000", 2023-10-08T07:07:43.132 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.483967217, 2023-10-08T07:07:43.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4166909699999999, 2023-10-08T07:07:43.132 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.132 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.132 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.133 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147478 2023-10-08T07:07:43.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.133 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530452+0000", 2023-10-08T07:07:43.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530452+0000", 2023-10-08T07:07:43.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530453+0000", 2023-10-08T07:07:43.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2023-10-08T07:07:43.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530464+0000", 2023-10-08T07:07:43.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1314999999999999e-05 2023-10-08T07:07:43.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530470+0000", 2023-10-08T07:07:43.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5249999999999996e-06 2023-10-08T07:07:43.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530474+0000", 2023-10-08T07:07:43.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3980000000000001e-06 2023-10-08T07:07:43.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.922404+0000", 2023-10-08T07:07:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3919294360000001 2023-10-08T07:07:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.922473+0000", 2023-10-08T07:07:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9123999999999998e-05 2023-10-08T07:07:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.946731+0000", 2023-10-08T07:07:43.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024258056 2023-10-08T07:07:43.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.946779+0000", 2023-10-08T07:07:43.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8495000000000002e-05 2023-10-08T07:07:43.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.947143+0000", 2023-10-08T07:07:43.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00036419499999999999 2023-10-08T07:07:43.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.138 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.138 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147479 4.0 4:02bf98b6:::10000000004.0000000e:head [write 258048~4096,write 442368~4096,write 520192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.138 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:43.138 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.483939932, 2023-10-08T07:07:43.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.462729097, 2023-10-08T07:07:43.138 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.138 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.139 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147479 2023-10-08T07:07:43.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.139 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:43.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:43.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533313+0000", 2023-10-08T07:07:43.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002832841 2023-10-08T07:07:43.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533338+0000", 2023-10-08T07:07:43.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5052999999999999e-05 2023-10-08T07:07:43.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533350+0000", 2023-10-08T07:07:43.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2561000000000001e-05 2023-10-08T07:07:43.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533357+0000", 2023-10-08T07:07:43.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0870000000000001e-06 2023-10-08T07:07:43.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963719+0000", 2023-10-08T07:07:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4303612779999999 2023-10-08T07:07:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963788+0000", 2023-10-08T07:07:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9751000000000004e-05 2023-10-08T07:07:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963941+0000", 2023-10-08T07:07:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015224499999999999 2023-10-08T07:07:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.971897+0000", 2023-10-08T07:07:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079562769999999994 2023-10-08T07:07:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993080+0000", 2023-10-08T07:07:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021183400000000002 2023-10-08T07:07:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993161+0000", 2023-10-08T07:07:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1045999999999996e-05 2023-10-08T07:07:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993209+0000", 2023-10-08T07:07:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7558000000000001e-05 2023-10-08T07:07:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147481 4.10 4:08d50e0e:::10000000004.0000003f:head [write 4136960~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.533405+0000", 2023-10-08T07:07:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.481014448, 2023-10-08T07:07:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.461558586, 2023-10-08T07:07:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147481 2023-10-08T07:07:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533405+0000", 2023-10-08T07:07:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533405+0000", 2023-10-08T07:07:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533406+0000", 2023-10-08T07:07:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4099999999999999e-07 2023-10-08T07:07:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533423+0000", 2023-10-08T07:07:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7638e-05 2023-10-08T07:07:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533434+0000", 2023-10-08T07:07:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1197e-05 2023-10-08T07:07:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533442+0000", 2023-10-08T07:07:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4399999999999999e-06 2023-10-08T07:07:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.966952+0000", 2023-10-08T07:07:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4335103010000001 2023-10-08T07:07:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.967025+0000", 2023-10-08T07:07:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3195999999999995e-05 2023-10-08T07:07:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.994825+0000", 2023-10-08T07:07:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.027799669999999999 2023-10-08T07:07:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.994882+0000", 2023-10-08T07:07:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7367000000000001e-05 2023-10-08T07:07:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.994964+0000", 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1335999999999995e-05 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147491 4.10 4:08d50e0e:::10000000004.0000003f:head [write 933888~4096,write 1052672~4096,write 1073152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.535987+0000", 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.478432202, 2023-10-08T07:07:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.459121989, 2023-10-08T07:07:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147491 2023-10-08T07:07:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.535987+0000", 2023-10-08T07:07:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.535987+0000", 2023-10-08T07:07:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.535988+0000", 2023-10-08T07:07:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3499999999999996e-07 2023-10-08T07:07:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.536005+0000", 2023-10-08T07:07:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7280000000000001e-05 2023-10-08T07:07:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.536013+0000", 2023-10-08T07:07:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7400000000000004e-06 2023-10-08T07:07:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.536019+0000", 2023-10-08T07:07:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8370000000000002e-06 2023-10-08T07:07:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.969595+0000", 2023-10-08T07:07:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4335757579999999 2023-10-08T07:07:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.969672+0000", 2023-10-08T07:07:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7610999999999999e-05 2023-10-08T07:07:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.994972+0000", 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025299680000000001 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.995030+0000", 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7921999999999999e-05 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.995109+0000", 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9626e-05 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147513 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3633152~4096,write 3674112~4096,write 3719168~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541417+0000", 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.4730028230000001, 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4538015879999999, 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.158 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147513 2023-10-08T07:07:43.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.158 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541417+0000", 2023-10-08T07:07:43.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541417+0000", 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541417+0000", 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7500000000000001e-07 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541425+0000", 2023-10-08T07:07:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.503e-06 2023-10-08T07:07:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541430+0000", 2023-10-08T07:07:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0200000000000002e-06 2023-10-08T07:07:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541433+0000", 2023-10-08T07:07:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8959999999999999e-06 2023-10-08T07:07:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.971954+0000", 2023-10-08T07:07:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4305211899999999 2023-10-08T07:07:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.972029+0000", 2023-10-08T07:07:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5607999999999998e-05 2023-10-08T07:07:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.972192+0000", 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016273000000000001 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.974968+0000", 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002775596 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.995120+0000", 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020151974 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.995179+0000", 2023-10-08T07:07:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9750000000000002e-05 2023-10-08T07:07:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.995218+0000", 2023-10-08T07:07:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9045999999999999e-05 2023-10-08T07:07:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147514 4.10 4:0b5763e1:::10000000004.00000015:head [write 712704~4096,write 872448~4096,write 917504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541436+0000", 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.47298325, 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.453967056, 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147514 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541436+0000", 2023-10-08T07:07:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541436+0000", 2023-10-08T07:07:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541437+0000", 2023-10-08T07:07:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2000000000000001e-07 2023-10-08T07:07:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541448+0000", 2023-10-08T07:07:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1421e-05 2023-10-08T07:07:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541453+0000", 2023-10-08T07:07:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8790000000000002e-06 2023-10-08T07:07:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541456+0000", 2023-10-08T07:07:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7949999999999999e-06 2023-10-08T07:07:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.974998+0000", 2023-10-08T07:07:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.433542665 2023-10-08T07:07:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.975096+0000", 2023-10-08T07:07:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7967999999999994e-05 2023-10-08T07:07:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.995266+0000", 2023-10-08T07:07:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020169237999999999 2023-10-08T07:07:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.995326+0000", 2023-10-08T07:07:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0142000000000001e-05 2023-10-08T07:07:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.995403+0000", 2023-10-08T07:07:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7727999999999998e-05 2023-10-08T07:07:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147519 4.10 4:08d50e0e:::10000000004.0000003f:head [write 258048~4096,write 417792~4096,write 1318912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.472918894, 2023-10-08T07:07:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.467910235, 2023-10-08T07:07:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147519 2023-10-08T07:07:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5199999999999998e-07 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541510+0000", 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4690000000000003e-06 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541515+0000", 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7260000000000002e-06 2023-10-08T07:07:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541518+0000", 2023-10-08T07:07:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7329999999999999e-06 2023-10-08T07:07:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.977538+0000", 2023-10-08T07:07:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.436020313 2023-10-08T07:07:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.977630+0000", 2023-10-08T07:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1893999999999998e-05 2023-10-08T07:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009278+0000", 2023-10-08T07:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.031647661000000001 2023-10-08T07:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009334+0000", 2023-10-08T07:07:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6366999999999998e-05 2023-10-08T07:07:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009411+0000", 2023-10-08T07:07:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.682e-05 2023-10-08T07:07:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147523 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2183168~4096,write 2215936~4096,write 2228224~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.4728778010000001, 2023-10-08T07:07:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4714357950000001, 2023-10-08T07:07:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147523 2023-10-08T07:07:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2023-10-08T07:07:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541554+0000", 2023-10-08T07:07:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1515000000000001e-05 2023-10-08T07:07:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541557+0000", 2023-10-08T07:07:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.675e-06 2023-10-08T07:07:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541560+0000", 2023-10-08T07:07:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.841e-06 2023-10-08T07:07:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980499+0000", 2023-10-08T07:07:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.43893866 2023-10-08T07:07:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980591+0000", 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1970000000000002e-05 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980759+0000", 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016861099999999999 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993040+0000", 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012280798000000001 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012884+0000", 2023-10-08T07:07:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019843573 2023-10-08T07:07:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012938+0000", 2023-10-08T07:07:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4462000000000001e-05 2023-10-08T07:07:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012978+0000", 2023-10-08T07:07:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9455000000000001e-05 2023-10-08T07:07:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:43.182 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:43.185 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2023-10-08T07:07:43.185 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:43.182+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:43.186 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:43.265 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:43.284 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:43.283+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:43.384 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:43.383+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:43.409 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:43.409 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:43.410 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.410 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162171 4.34 4:2dadb699:::10000000004.00000031:head [write 3813376~4096 in=4096b,write 3846144~4096 in=4096b,write 3862528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.410 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.389764+0000", 2023-10-08T07:07:43.410 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.012310073, 2023-10-08T07:07:43.410 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012338422999999999, 2023-10-08T07:07:43.410 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.410 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.410 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.410 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.410 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.410 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162171 2023-10-08T07:07:43.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.411 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389764+0000", 2023-10-08T07:07:43.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.411 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.411 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389764+0000", 2023-10-08T07:07:43.411 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389764+0000", 2023-10-08T07:07:43.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0500000000000002e-07 2023-10-08T07:07:43.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.412 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.412 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389776+0000", 2023-10-08T07:07:43.412 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2055000000000001e-05 2023-10-08T07:07:43.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.412 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389788+0000", 2023-10-08T07:07:43.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1224e-05 2023-10-08T07:07:43.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.413 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389796+0000", 2023-10-08T07:07:43.413 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1009999999999992e-06 2023-10-08T07:07:43.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.413 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.413 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389879+0000", 2023-10-08T07:07:43.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3636999999999999e-05 2023-10-08T07:07:43.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.414 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.414 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.414 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389972+0000", 2023-10-08T07:07:43.414 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2787000000000005e-05 2023-10-08T07:07:43.414 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.414 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.414 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.415 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.415 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162131 4.2 4.508f73c2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.415 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.377612+0000", 2023-10-08T07:07:43.415 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.024462012000000002, 2023-10-08T07:07:43.415 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024565152999999999, 2023-10-08T07:07:43.415 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.415 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.415 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.415 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.415 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.415 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162131 2023-10-08T07:07:43.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.416 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.377612+0000", 2023-10-08T07:07:43.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.416 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.416 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.416 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.377612+0000", 2023-10-08T07:07:43.416 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.377613+0000", 2023-10-08T07:07:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5600000000000004e-07 2023-10-08T07:07:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.377624+0000", 2023-10-08T07:07:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1747e-05 2023-10-08T07:07:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.377637+0000", 2023-10-08T07:07:43.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2676e-05 2023-10-08T07:07:43.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.418 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.418 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.377646+0000", 2023-10-08T07:07:43.418 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5650000000000002e-06 2023-10-08T07:07:43.418 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.418 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.418 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.419 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.419 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162134 4.20 4:04004f2c:::10000000004.0000000d:head [write 733184~4096 in=4096b,write 749568~4096 in=4096b,write 909312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.419 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.378532+0000", 2023-10-08T07:07:43.419 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.023541870999999999, 2023-10-08T07:07:43.419 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023717017999999999, 2023-10-08T07:07:43.419 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.419 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.419 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.419 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.419 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.419 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162134 2023-10-08T07:07:43.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.420 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.378532+0000", 2023-10-08T07:07:43.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.420 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.420 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.420 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.378532+0000", 2023-10-08T07:07:43.420 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.378533+0000", 2023-10-08T07:07:43.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1999999999999998e-07 2023-10-08T07:07:43.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.421 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.421 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.378546+0000", 2023-10-08T07:07:43.421 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3162999999999999e-05 2023-10-08T07:07:43.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.421 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.378554+0000", 2023-10-08T07:07:43.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3270000000000001e-06 2023-10-08T07:07:43.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.422 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.378559+0000", 2023-10-08T07:07:43.422 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2850000000000002e-06 2023-10-08T07:07:43.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.422 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.378607+0000", 2023-10-08T07:07:43.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7666000000000001e-05 2023-10-08T07:07:43.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.378693+0000", 2023-10-08T07:07:43.423 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6259000000000002e-05 2023-10-08T07:07:43.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.423 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.423 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.378829+0000", 2023-10-08T07:07:43.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013589099999999999 2023-10-08T07:07:43.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.424 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.424 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394815+0000", 2023-10-08T07:07:43.424 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015986233999999998 2023-10-08T07:07:43.424 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.424 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.424 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.424 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.424 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162173 4.32 4.49293f72 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.390328+0000", 2023-10-08T07:07:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.011745656, 2023-10-08T07:07:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012002653, 2023-10-08T07:07:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162173 2023-10-08T07:07:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390328+0000", 2023-10-08T07:07:43.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.426 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.426 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390328+0000", 2023-10-08T07:07:43.426 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.426 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390329+0000", 2023-10-08T07:07:43.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3499999999999995e-07 2023-10-08T07:07:43.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.427 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390340+0000", 2023-10-08T07:07:43.427 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.166e-05 2023-10-08T07:07:43.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.427 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.427 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390354+0000", 2023-10-08T07:07:43.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4029000000000001e-05 2023-10-08T07:07:43.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.428 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.428 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.428 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390362+0000", 2023-10-08T07:07:43.428 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.605e-06 2023-10-08T07:07:43.428 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.428 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.428 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.429 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.429 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162174 4.3a 4.f030edfa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.429 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.390591+0000", 2023-10-08T07:07:43.429 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.011482872999999999, 2023-10-08T07:07:43.429 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011796875, 2023-10-08T07:07:43.429 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.429 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.429 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.429 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.429 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.429 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162174 2023-10-08T07:07:43.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.430 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390591+0000", 2023-10-08T07:07:43.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.430 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.430 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.430 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390591+0000", 2023-10-08T07:07:43.430 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390591+0000", 2023-10-08T07:07:43.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:07:43.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.431 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390606+0000", 2023-10-08T07:07:43.431 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5061e-05 2023-10-08T07:07:43.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.431 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.431 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390617+0000", 2023-10-08T07:07:43.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0927000000000001e-05 2023-10-08T07:07:43.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.432 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.432 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390623+0000", 2023-10-08T07:07:43.432 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9000000000000003e-06 2023-10-08T07:07:43.432 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.432 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.432 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.432 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.433 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162137 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 2973696~4096 in=4096b,write 3125248~4096 in=4096b,write 3158016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.433 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.379609+0000", 2023-10-08T07:07:43.433 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.022464973999999999, 2023-10-08T07:07:43.433 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022838014, 2023-10-08T07:07:43.433 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.433 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.433 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.433 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.433 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.433 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162137 2023-10-08T07:07:43.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.434 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.379609+0000", 2023-10-08T07:07:43.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.434 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.434 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.379609+0000", 2023-10-08T07:07:43.434 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.379609+0000", 2023-10-08T07:07:43.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4300000000000002e-07 2023-10-08T07:07:43.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.435 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.435 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.435 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.379622+0000", 2023-10-08T07:07:43.435 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2611e-05 2023-10-08T07:07:43.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.379633+0000", 2023-10-08T07:07:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0672999999999999e-05 2023-10-08T07:07:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.379640+0000", 2023-10-08T07:07:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3490000000000003e-06 2023-10-08T07:07:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.380596+0000", 2023-10-08T07:07:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00095545799999999996 2023-10-08T07:07:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.380681+0000", 2023-10-08T07:07:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5267999999999997e-05 2023-10-08T07:07:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.380920+0000", 2023-10-08T07:07:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00023867699999999999 2023-10-08T07:07:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:151685 4.16 e63/17 4:69eefec8:::10000000004.0000003a:head v 63'2334, mlcod=63'2331)", 2023-10-08T07:07:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.390899+0000", 2023-10-08T07:07:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.011174939, 2023-10-08T07:07:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011619805, 2023-10-08T07:07:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390899+0000", 2023-10-08T07:07:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390899+0000", 2023-10-08T07:07:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390899+0000", 2023-10-08T07:07:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.06e-07 2023-10-08T07:07:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390914+0000", 2023-10-08T07:07:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4645e-05 2023-10-08T07:07:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390923+0000", 2023-10-08T07:07:43.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6829999999999997e-06 2023-10-08T07:07:43.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.441 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390931+0000", 2023-10-08T07:07:43.441 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6260000000000001e-06 2023-10-08T07:07:43.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.441 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.441 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396723+0000", 2023-10-08T07:07:43.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0057916360000000002 2023-10-08T07:07:43.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.442 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.442 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396747+0000", 2023-10-08T07:07:43.442 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3853e-05 2023-10-08T07:07:43.442 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.442 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.442 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.442 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.443 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162179 4.20 4:07572838:::10000000004.00000010:head [write 2195456~4096 in=4096b,write 2228224~4096 in=4096b,write 2322432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.443 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.392056+0000", 2023-10-08T07:07:43.443 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0100178, 2023-10-08T07:07:43.443 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010527139, 2023-10-08T07:07:43.443 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.443 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.443 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.443 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.443 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.443 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162179 2023-10-08T07:07:43.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.444 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392056+0000", 2023-10-08T07:07:43.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.444 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.444 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.444 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392056+0000", 2023-10-08T07:07:43.444 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392056+0000", 2023-10-08T07:07:43.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.37e-07 2023-10-08T07:07:43.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.445 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392067+0000", 2023-10-08T07:07:43.445 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0409e-05 2023-10-08T07:07:43.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.445 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.445 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392078+0000", 2023-10-08T07:07:43.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0944999999999999e-05 2023-10-08T07:07:43.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392085+0000", 2023-10-08T07:07:43.446 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5730000000000002e-06 2023-10-08T07:07:43.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.446 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.446 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.446 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400307+0000", 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0082218159999999998 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400448+0000", 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000140555 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400643+0000", 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000195601 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.447 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.448 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.448 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.448 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162085 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 536576~8192 in=8192b,write 724992~4096 in=4096b,write 999424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.448 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.362731+0000", 2023-10-08T07:07:43.448 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.039342820000000001, 2023-10-08T07:07:43.448 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.039935874000000003, 2023-10-08T07:07:43.448 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.448 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.448 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.448 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.448 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.449 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162085 2023-10-08T07:07:43.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.449 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.362731+0000", 2023-10-08T07:07:43.449 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.449 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.449 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.449 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.362731+0000", 2023-10-08T07:07:43.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.362732+0000", 2023-10-08T07:07:43.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7600000000000006e-07 2023-10-08T07:07:43.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.450 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.450 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.362750+0000", 2023-10-08T07:07:43.450 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8624e-05 2023-10-08T07:07:43.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.362767+0000", 2023-10-08T07:07:43.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7054999999999998e-05 2023-10-08T07:07:43.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.451 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.362776+0000", 2023-10-08T07:07:43.451 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7909999999999993e-06 2023-10-08T07:07:43.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.451 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.451 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387394+0000", 2023-10-08T07:07:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024618088 2023-10-08T07:07:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387474+0000", 2023-10-08T07:07:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0012000000000006e-05 2023-10-08T07:07:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387642+0000", 2023-10-08T07:07:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016773600000000001 2023-10-08T07:07:43.453 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.453 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.453 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.453 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.453 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162138 4.20 4:07572838:::10000000004.00000010:head [write 2101248~4096 in=4096b,write 2162688~4096 in=4096b,write 2170880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.453 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.379741+0000", 2023-10-08T07:07:43.453 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.022332273999999999, 2023-10-08T07:07:43.453 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023007518000000001, 2023-10-08T07:07:43.453 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.453 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.453 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.454 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.454 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.454 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162138 2023-10-08T07:07:43.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.454 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.454 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.379741+0000", 2023-10-08T07:07:43.454 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.454 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.454 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.379741+0000", 2023-10-08T07:07:43.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.379742+0000", 2023-10-08T07:07:43.455 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:07:43.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.455 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.455 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.455 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.379753+0000", 2023-10-08T07:07:43.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0586e-05 2023-10-08T07:07:43.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.379763+0000", 2023-10-08T07:07:43.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0413e-05 2023-10-08T07:07:43.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.456 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.456 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.456 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.379770+0000", 2023-10-08T07:07:43.456 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5509999999999996e-06 2023-10-08T07:07:43.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383681+0000", 2023-10-08T07:07:43.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0039117029999999999 2023-10-08T07:07:43.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.457 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383767+0000", 2023-10-08T07:07:43.457 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5381000000000001e-05 2023-10-08T07:07:43.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.457 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.457 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.458 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383955+0000", 2023-10-08T07:07:43.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000188245 2023-10-08T07:07:43.458 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.458 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.458 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.458 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:151689 4.26 e63/17 4:672c55ca:::10000000004.00000006:head v 63'2389, mlcod=63'2386)", 2023-10-08T07:07:43.458 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.392225+0000", 2023-10-08T07:07:43.458 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0098489839999999999, 2023-10-08T07:07:43.458 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010601714999999999, 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392225+0000", 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392225+0000", 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392225+0000", 2023-10-08T07:07:43.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7599999999999998e-07 2023-10-08T07:07:43.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.460 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.460 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.460 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392241+0000", 2023-10-08T07:07:43.460 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6481e-05 2023-10-08T07:07:43.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392248+0000", 2023-10-08T07:07:43.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7240000000000003e-06 2023-10-08T07:07:43.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.461 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392254+0000", 2023-10-08T07:07:43.461 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5480000000000001e-06 2023-10-08T07:07:43.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.461 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.461 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396827+0000", 2023-10-08T07:07:43.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0045735009999999998 2023-10-08T07:07:43.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.462 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.462 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396846+0000", 2023-10-08T07:07:43.462 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9224000000000001e-05 2023-10-08T07:07:43.462 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.462 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.462 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.462 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.463 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162094 4.1b 4:d97fb168:::10000000004.00000008:head [write 3710976~8192 in=8192b,write 3801088~4096 in=4096b,write 3985408~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.463 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.365783+0000", 2023-10-08T07:07:43.463 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.036290355000000003, 2023-10-08T07:07:43.463 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037112582999999998, 2023-10-08T07:07:43.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.463 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.463 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.463 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.463 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.463 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162094 2023-10-08T07:07:43.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.463 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.365783+0000", 2023-10-08T07:07:43.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.464 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.365783+0000", 2023-10-08T07:07:43.464 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.464 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.464 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.365784+0000", 2023-10-08T07:07:43.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9899999999999999e-07 2023-10-08T07:07:43.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.365801+0000", 2023-10-08T07:07:43.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6728e-05 2023-10-08T07:07:43.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.465 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.465 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.365812+0000", 2023-10-08T07:07:43.465 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1229999999999999e-05 2023-10-08T07:07:43.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.365820+0000", 2023-10-08T07:07:43.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2740000000000007e-06 2023-10-08T07:07:43.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.466 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.466 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.366004+0000", 2023-10-08T07:07:43.466 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000183444 2023-10-08T07:07:43.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.366088+0000", 2023-10-08T07:07:43.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4392000000000001e-05 2023-10-08T07:07:43.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.467 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.467 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.366270+0000", 2023-10-08T07:07:43.467 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000181387 2023-10-08T07:07:43.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.468 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.468 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.384808+0000", 2023-10-08T07:07:43.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018537913 2023-10-08T07:07:43.468 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.468 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.468 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.468 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162139 4.a 4.6e5df24a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.468 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.380013+0000", 2023-10-08T07:07:43.468 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.022060430999999998, 2023-10-08T07:07:43.468 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022964737999999998, 2023-10-08T07:07:43.469 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.469 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.469 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.469 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.469 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.469 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162139 2023-10-08T07:07:43.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.469 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.469 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.469 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.469 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.380013+0000", 2023-10-08T07:07:43.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.380013+0000", 2023-10-08T07:07:43.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.470 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.470 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.470 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.380014+0000", 2023-10-08T07:07:43.470 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9299999999999997e-07 2023-10-08T07:07:43.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.380027+0000", 2023-10-08T07:07:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2599000000000001e-05 2023-10-08T07:07:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.380037+0000", 2023-10-08T07:07:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0740999999999999e-05 2023-10-08T07:07:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.471 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.472 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.380044+0000", 2023-10-08T07:07:43.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0670000000000003e-06 2023-10-08T07:07:43.472 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.472 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.472 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.472 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.472 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162180 4.2b 4:d776c1c9:::10000000004.0000003d:head [write 1560576~4096 in=4096b,write 1589248~4096 in=4096b,write 1617920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.472 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.392354+0000", 2023-10-08T07:07:43.472 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0097193090000000006, 2023-10-08T07:07:43.472 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010687465, 2023-10-08T07:07:43.472 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162180 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392354+0000", 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.473 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392354+0000", 2023-10-08T07:07:43.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392355+0000", 2023-10-08T07:07:43.474 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2900000000000003e-07 2023-10-08T07:07:43.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.474 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.474 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.474 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392366+0000", 2023-10-08T07:07:43.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1253000000000001e-05 2023-10-08T07:07:43.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392376+0000", 2023-10-08T07:07:43.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0057999999999999e-05 2023-10-08T07:07:43.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.475 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.475 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.475 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392383+0000", 2023-10-08T07:07:43.475 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4579999999999998e-06 2023-10-08T07:07:43.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397161+0000", 2023-10-08T07:07:43.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047782359999999999 2023-10-08T07:07:43.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.476 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397238+0000", 2023-10-08T07:07:43.476 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7349999999999996e-05 2023-10-08T07:07:43.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.476 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.477 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397339+0000", 2023-10-08T07:07:43.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010026000000000001 2023-10-08T07:07:43.477 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.477 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.477 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.477 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.477 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162095 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 3305472~4096 in=4096b,write 3313664~4096 in=4096b,write 3391488~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.477 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.365840+0000", 2023-10-08T07:07:43.477 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.036233125999999997, 2023-10-08T07:07:43.477 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037288270999999998, 2023-10-08T07:07:43.477 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.478 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.478 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.478 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.478 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.478 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162095 2023-10-08T07:07:43.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.478 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.478 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.478 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.478 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.365840+0000", 2023-10-08T07:07:43.478 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.365840+0000", 2023-10-08T07:07:43.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.479 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.479 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.365841+0000", 2023-10-08T07:07:43.479 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9800000000000003e-07 2023-10-08T07:07:43.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.479 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.365853+0000", 2023-10-08T07:07:43.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2055000000000001e-05 2023-10-08T07:07:43.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.480 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.365861+0000", 2023-10-08T07:07:43.480 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2309999999999996e-06 2023-10-08T07:07:43.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.480 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.480 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.365868+0000", 2023-10-08T07:07:43.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0680000000000002e-06 2023-10-08T07:07:43.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392961+0000", 2023-10-08T07:07:43.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027093421999999999 2023-10-08T07:07:43.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.481 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.481 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.481 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393011+0000", 2023-10-08T07:07:43.481 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0182999999999997e-05 2023-10-08T07:07:43.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.482 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.482 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393138+0000", 2023-10-08T07:07:43.482 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000127358 2023-10-08T07:07:43.482 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.482 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.482 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.482 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.482 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162182 4.1f 4:f9156152:::10000000004.00000036:head [write 2301952~4096 in=4096b,write 2347008~4096 in=4096b,write 2740224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.483 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.392997+0000", 2023-10-08T07:07:43.483 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.009076499, 2023-10-08T07:07:43.483 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010225471999999999, 2023-10-08T07:07:43.483 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.483 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.483 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.483 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162182 2023-10-08T07:07:43.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.483 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.483 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392997+0000", 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392997+0000", 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392998+0000", 2023-10-08T07:07:43.484 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0499999999999999e-06 2023-10-08T07:07:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393018+0000", 2023-10-08T07:07:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9964999999999999e-05 2023-10-08T07:07:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393031+0000", 2023-10-08T07:07:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3351e-05 2023-10-08T07:07:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393040+0000", 2023-10-08T07:07:43.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4540000000000007e-06 2023-10-08T07:07:43.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.486 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393093+0000", 2023-10-08T07:07:43.486 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2621000000000003e-05 2023-10-08T07:07:43.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.486 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.486 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.487 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393176+0000", 2023-10-08T07:07:43.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3799000000000002e-05 2023-10-08T07:07:43.487 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.487 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.487 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.487 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162056 4.3a 4:5f183e4b:::10000000004.00000023:head [write 12288~4096 in=4096b,write 192512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.487 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.352550+0000", 2023-10-08T07:07:43.487 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.049523652000000001, 2023-10-08T07:07:43.487 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050755921000000002, 2023-10-08T07:07:43.487 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.488 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.488 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.488 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.488 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.488 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162056 2023-10-08T07:07:43.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.488 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.488 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.488 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.488 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.352550+0000", 2023-10-08T07:07:43.488 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.352550+0000", 2023-10-08T07:07:43.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.489 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.352551+0000", 2023-10-08T07:07:43.489 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2600000000000001e-07 2023-10-08T07:07:43.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.489 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.489 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.352560+0000", 2023-10-08T07:07:43.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8950000000000004e-06 2023-10-08T07:07:43.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.352571+0000", 2023-10-08T07:07:43.490 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1194e-05 2023-10-08T07:07:43.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.490 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.490 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.352577+0000", 2023-10-08T07:07:43.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4110000000000001e-06 2023-10-08T07:07:43.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.369775+0000", 2023-10-08T07:07:43.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017197565000000001 2023-10-08T07:07:43.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.491 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.491 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.369873+0000", 2023-10-08T07:07:43.491 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8171000000000006e-05 2023-10-08T07:07:43.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.370051+0000", 2023-10-08T07:07:43.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017833200000000001 2023-10-08T07:07:43.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.492 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.492 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383666+0000", 2023-10-08T07:07:43.492 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013614318 2023-10-08T07:07:43.493 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.493 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.493 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.493 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.493 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162143 4.20 4:07572838:::10000000004.00000010:head [write 2674688~4096 in=4096b,write 3039232~4096 in=4096b,write 3088384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.493 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.381243+0000", 2023-10-08T07:07:43.493 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.020830386999999999, 2023-10-08T07:07:43.493 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022158998999999999, 2023-10-08T07:07:43.493 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.494 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.494 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.494 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.494 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.494 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162143 2023-10-08T07:07:43.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.494 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381243+0000", 2023-10-08T07:07:43.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.495 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.495 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.495 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381243+0000", 2023-10-08T07:07:43.495 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381244+0000", 2023-10-08T07:07:43.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6000000000000002e-07 2023-10-08T07:07:43.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.496 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.496 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.496 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381255+0000", 2023-10-08T07:07:43.496 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1297e-05 2023-10-08T07:07:43.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381268+0000", 2023-10-08T07:07:43.497 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2965e-05 2023-10-08T07:07:43.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.497 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.497 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.497 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381274+0000", 2023-10-08T07:07:43.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8340000000000004e-06 2023-10-08T07:07:43.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.498 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392209+0000", 2023-10-08T07:07:43.498 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010935146999999999 2023-10-08T07:07:43.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.498 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.498 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392300+0000", 2023-10-08T07:07:43.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0457999999999993e-05 2023-10-08T07:07:43.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.499 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.499 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.499 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392481+0000", 2023-10-08T07:07:43.499 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000181664 2023-10-08T07:07:43.499 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.499 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.499 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.500 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.500 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162184 4.32 4.49293f72 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.500 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.393624+0000", 2023-10-08T07:07:43.500 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0084491740000000003, 2023-10-08T07:07:43.500 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0098632760000000007, 2023-10-08T07:07:43.500 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.500 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.501 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.501 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.501 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.501 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162184 2023-10-08T07:07:43.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.501 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.501 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.501 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393624+0000", 2023-10-08T07:07:43.501 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393624+0000", 2023-10-08T07:07:43.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.502 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.502 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393625+0000", 2023-10-08T07:07:43.502 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5199999999999995e-07 2023-10-08T07:07:43.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.502 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393637+0000", 2023-10-08T07:07:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.189e-05 2023-10-08T07:07:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393652+0000", 2023-10-08T07:07:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4586000000000001e-05 2023-10-08T07:07:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.393660+0000", 2023-10-08T07:07:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2830000000000001e-06 2023-10-08T07:07:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162057 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2633728~4096 in=4096b,write 2756608~4096 in=4096b,write 2768896~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.352754+0000", 2023-10-08T07:07:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.049319783999999998, 2023-10-08T07:07:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050806083000000002, 2023-10-08T07:07:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162057 2023-10-08T07:07:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.352754+0000", 2023-10-08T07:07:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.352754+0000", 2023-10-08T07:07:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.352755+0000", 2023-10-08T07:07:43.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3499999999999995e-07 2023-10-08T07:07:43.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.507 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.507 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.507 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.352818+0000", 2023-10-08T07:07:43.507 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3701999999999994e-05 2023-10-08T07:07:43.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.352831+0000", 2023-10-08T07:07:43.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2388999999999999e-05 2023-10-08T07:07:43.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.508 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.508 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.352840+0000", 2023-10-08T07:07:43.508 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2669999999999995e-06 2023-10-08T07:07:43.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372545+0000", 2023-10-08T07:07:43.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019704607999999998 2023-10-08T07:07:43.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.509 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.509 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372640+0000", 2023-10-08T07:07:43.509 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5501000000000006e-05 2023-10-08T07:07:43.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.510 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372815+0000", 2023-10-08T07:07:43.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000175179 2023-10-08T07:07:43.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.510 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.510 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.510 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383671+0000", 2023-10-08T07:07:43.510 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010855818 2023-10-08T07:07:43.510 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.510 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.510 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.511 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.511 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162144 4.2b 4:d7a77d67:::10000000004.00000029:head [write 3788800~4096 in=4096b,write 3796992~4096 in=4096b,write 3821568~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.511 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.381526+0000", 2023-10-08T07:07:43.511 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.020547683000000001, 2023-10-08T07:07:43.511 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022140387000000001, 2023-10-08T07:07:43.511 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.511 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.511 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.511 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.511 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.512 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162144 2023-10-08T07:07:43.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.512 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381526+0000", 2023-10-08T07:07:43.512 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.512 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.512 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.512 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381526+0000", 2023-10-08T07:07:43.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381527+0000", 2023-10-08T07:07:43.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1200000000000003e-07 2023-10-08T07:07:43.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.513 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.513 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.513 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381536+0000", 2023-10-08T07:07:43.513 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.363e-06 2023-10-08T07:07:43.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381545+0000", 2023-10-08T07:07:43.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5659999999999996e-06 2023-10-08T07:07:43.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.514 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.514 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381550+0000", 2023-10-08T07:07:43.514 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0620000000000002e-06 2023-10-08T07:07:43.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.514 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383644+0000", 2023-10-08T07:07:43.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020947499999999998 2023-10-08T07:07:43.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383764+0000", 2023-10-08T07:07:43.515 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00011997000000000001 2023-10-08T07:07:43.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.515 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.515 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.515 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383945+0000", 2023-10-08T07:07:43.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018094300000000001 2023-10-08T07:07:43.516 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.516 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.516 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.516 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.516 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162186 4.1 4:8277d31e:::10000000004.00000013:head [write 2916352~4096 in=4096b,write 3006464~4096 in=4096b,write 3031040~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.516 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.394144+0000", 2023-10-08T07:07:43.516 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0079300340000000007, 2023-10-08T07:07:43.516 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009617436, 2023-10-08T07:07:43.516 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.516 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.517 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.517 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.517 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.517 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162186 2023-10-08T07:07:43.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.517 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.517 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.517 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394144+0000", 2023-10-08T07:07:43.517 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394144+0000", 2023-10-08T07:07:43.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394144+0000", 2023-10-08T07:07:43.518 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2500000000000004e-07 2023-10-08T07:07:43.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.518 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.518 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.518 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394162+0000", 2023-10-08T07:07:43.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8053000000000001e-05 2023-10-08T07:07:43.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394177+0000", 2023-10-08T07:07:43.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.471e-05 2023-10-08T07:07:43.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.519 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.519 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.519 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394190+0000", 2023-10-08T07:07:43.519 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2663000000000001e-05 2023-10-08T07:07:43.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394270+0000", 2023-10-08T07:07:43.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0551999999999997e-05 2023-10-08T07:07:43.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.520 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.520 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.520 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394378+0000", 2023-10-08T07:07:43.520 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000107153 2023-10-08T07:07:43.520 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.520 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.520 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.521 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.521 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162059 4.3a 4:5f183e4b:::10000000004.00000023:head [write 1236992~4096 in=4096b,write 1323008~4096 in=4096b,write 1736704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.521 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.353414+0000", 2023-10-08T07:07:43.521 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.048659474000000001, 2023-10-08T07:07:43.521 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050453514999999997, 2023-10-08T07:07:43.521 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.521 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.521 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.521 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.521 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.521 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162059 2023-10-08T07:07:43.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.522 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.353414+0000", 2023-10-08T07:07:43.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.522 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.522 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.522 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.353414+0000", 2023-10-08T07:07:43.522 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.353415+0000", 2023-10-08T07:07:43.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1800000000000005e-07 2023-10-08T07:07:43.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.523 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.523 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.353427+0000", 2023-10-08T07:07:43.523 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2386e-05 2023-10-08T07:07:43.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.523 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.353440+0000", 2023-10-08T07:07:43.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2894000000000001e-05 2023-10-08T07:07:43.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.524 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.353449+0000", 2023-10-08T07:07:43.524 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7159999999999992e-06 2023-10-08T07:07:43.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.524 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.524 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.375459+0000", 2023-10-08T07:07:43.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022010612999999998 2023-10-08T07:07:43.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.375547+0000", 2023-10-08T07:07:43.525 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7274000000000005e-05 2023-10-08T07:07:43.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.525 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.525 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.525 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.375725+0000", 2023-10-08T07:07:43.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017864399999999999 2023-10-08T07:07:43.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.526 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.526 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387362+0000", 2023-10-08T07:07:43.526 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011637096 2023-10-08T07:07:43.526 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.526 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.526 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.526 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162145 4.20 4:05b3915c:::10000000004.00000016:head [write 790528~4096 in=4096b,write 798720~4096 in=4096b,write 909312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.527 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.381867+0000", 2023-10-08T07:07:43.527 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.020206895999999998, 2023-10-08T07:07:43.527 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022089925999999999, 2023-10-08T07:07:43.527 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.527 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.527 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.527 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.527 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.527 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162145 2023-10-08T07:07:43.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.527 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381867+0000", 2023-10-08T07:07:43.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.528 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.528 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381867+0000", 2023-10-08T07:07:43.528 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.528 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381867+0000", 2023-10-08T07:07:43.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8999999999999996e-07 2023-10-08T07:07:43.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.529 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.529 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.529 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381878+0000", 2023-10-08T07:07:43.529 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0232e-05 2023-10-08T07:07:43.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.530 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.530 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381885+0000", 2023-10-08T07:07:43.530 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2599999999999999e-06 2023-10-08T07:07:43.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.530 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.530 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.381890+0000", 2023-10-08T07:07:43.530 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2889999999999997e-06 2023-10-08T07:07:43.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.530 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.531 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.531 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394841+0000", 2023-10-08T07:07:43.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012951295999999999 2023-10-08T07:07:43.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.531 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.531 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.531 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394918+0000", 2023-10-08T07:07:43.531 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6346000000000004e-05 2023-10-08T07:07:43.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.531 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.532 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.532 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395067+0000", 2023-10-08T07:07:43.532 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014891500000000001 2023-10-08T07:07:43.532 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.532 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.532 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.533 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.533 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162188 4.34 4:2dadb699:::10000000004.00000031:head [write 2060288~4096 in=4096b,write 2179072~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.533 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.394982+0000", 2023-10-08T07:07:43.533 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0070913419999999996, 2023-10-08T07:07:43.533 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0090570949999999994, 2023-10-08T07:07:43.533 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.533 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.534 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.534 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.535 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.535 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162188 2023-10-08T07:07:43.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.535 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.535 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394982+0000", 2023-10-08T07:07:43.535 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.535 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.535 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394982+0000", 2023-10-08T07:07:43.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.536 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394983+0000", 2023-10-08T07:07:43.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9899999999999999e-07 2023-10-08T07:07:43.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.536 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.536 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.536 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394996+0000", 2023-10-08T07:07:43.536 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3157e-05 2023-10-08T07:07:43.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.537 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395007+0000", 2023-10-08T07:07:43.537 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0661e-05 2023-10-08T07:07:43.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.537 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.537 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395014+0000", 2023-10-08T07:07:43.537 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4830000000000002e-06 2023-10-08T07:07:43.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.537 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.538 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.538 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395147+0000", 2023-10-08T07:07:43.538 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000132912 2023-10-08T07:07:43.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.538 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.538 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.538 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395242+0000", 2023-10-08T07:07:43.538 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4291999999999998e-05 2023-10-08T07:07:43.538 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.538 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.538 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.539 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.539 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162148 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 1175552~4096 in=4096b,write 1208320~4096 in=4096b,write 1257472~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.539 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.382665+0000", 2023-10-08T07:07:43.539 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.019408759000000001, 2023-10-08T07:07:43.539 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021449573, 2023-10-08T07:07:43.539 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.539 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.539 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.539 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.539 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.539 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162148 2023-10-08T07:07:43.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.540 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.382665+0000", 2023-10-08T07:07:43.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.540 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.540 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.540 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.382665+0000", 2023-10-08T07:07:43.540 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.541 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.541 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.542 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.382666+0000", 2023-10-08T07:07:43.542 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2799999999999995e-07 2023-10-08T07:07:43.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.542 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.542 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.382675+0000", 2023-10-08T07:07:43.542 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5619999999999993e-06 2023-10-08T07:07:43.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.542 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.542 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.542 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.382688+0000", 2023-10-08T07:07:43.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3172e-05 2023-10-08T07:07:43.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.543 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.543 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.382694+0000", 2023-10-08T07:07:43.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7919999999999998e-06 2023-10-08T07:07:43.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.543 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.543 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.543 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389896+0000", 2023-10-08T07:07:43.543 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0072014210000000004 2023-10-08T07:07:43.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389982+0000", 2023-10-08T07:07:43.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6199000000000006e-05 2023-10-08T07:07:43.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.544 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.544 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.390149+0000", 2023-10-08T07:07:43.544 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000167121 2023-10-08T07:07:43.544 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.545 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.545 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.546 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.546 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162189 4.e 4:7242a848:::10000000004.00000020:head [write 2854912~4096 in=4096b,write 2953216~4096 in=4096b,write 3072000~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.546 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.395411+0000", 2023-10-08T07:07:43.546 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0066621229999999998, 2023-10-08T07:07:43.546 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0087898149999999994, 2023-10-08T07:07:43.546 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.546 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.546 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.546 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.546 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.546 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162189 2023-10-08T07:07:43.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.547 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.547 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.547 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395411+0000", 2023-10-08T07:07:43.547 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.547 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.547 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.547 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395411+0000", 2023-10-08T07:07:43.547 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.548 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395412+0000", 2023-10-08T07:07:43.548 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0400000000000005e-07 2023-10-08T07:07:43.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.548 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.548 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.548 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395423+0000", 2023-10-08T07:07:43.548 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.101e-05 2023-10-08T07:07:43.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.549 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.549 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395434+0000", 2023-10-08T07:07:43.549 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.039e-05 2023-10-08T07:07:43.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.549 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.549 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395441+0000", 2023-10-08T07:07:43.549 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4549999999999998e-06 2023-10-08T07:07:43.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.549 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.550 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.550 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.398570+0000", 2023-10-08T07:07:43.550 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.003129344 2023-10-08T07:07:43.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.550 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.550 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.550 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.398655+0000", 2023-10-08T07:07:43.550 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4132e-05 2023-10-08T07:07:43.550 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.550 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.550 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.551 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.551 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162191 4.5 4:a2ff1403:::10000000004.00000039:head [write 3973120~4096 in=4096b,write 3981312~4096 in=4096b,write 4014080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.551 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.396109+0000", 2023-10-08T07:07:43.551 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0059641399999999997, 2023-10-08T07:07:43.551 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0081750750000000004, 2023-10-08T07:07:43.551 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.551 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.551 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.551 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.551 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.552 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162191 2023-10-08T07:07:43.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.552 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.552 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.552 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.552 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396109+0000", 2023-10-08T07:07:43.552 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.552 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.552 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.553 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396109+0000", 2023-10-08T07:07:43.553 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.553 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.553 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396110+0000", 2023-10-08T07:07:43.553 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1200000000000002e-07 2023-10-08T07:07:43.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.553 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.554 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396141+0000", 2023-10-08T07:07:43.554 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.0889000000000002e-05 2023-10-08T07:07:43.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.554 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.554 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396151+0000", 2023-10-08T07:07:43.554 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0108999999999999e-05 2023-10-08T07:07:43.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.554 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.554 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.555 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396158+0000", 2023-10-08T07:07:43.555 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.951e-06 2023-10-08T07:07:43.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.555 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.555 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.555 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396221+0000", 2023-10-08T07:07:43.555 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3007000000000002e-05 2023-10-08T07:07:43.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.555 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.555 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.555 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396334+0000", 2023-10-08T07:07:43.556 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000112574 2023-10-08T07:07:43.556 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.556 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.556 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.556 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.556 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162150 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 2428928~4096 in=4096b,write 2461696~4096 in=4096b,write 2527232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.556 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.383244+0000", 2023-10-08T07:07:43.556 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.018829803999999999, 2023-10-08T07:07:43.556 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021118593000000001, 2023-10-08T07:07:43.556 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.556 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.557 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.557 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.557 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.557 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162150 2023-10-08T07:07:43.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.557 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.557 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.557 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383244+0000", 2023-10-08T07:07:43.557 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.557 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.558 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.558 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383244+0000", 2023-10-08T07:07:43.558 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.558 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.558 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.558 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383245+0000", 2023-10-08T07:07:43.558 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9500000000000001e-07 2023-10-08T07:07:43.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.558 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.558 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.559 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383262+0000", 2023-10-08T07:07:43.559 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7034e-05 2023-10-08T07:07:43.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.559 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.559 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.559 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383270+0000", 2023-10-08T07:07:43.559 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8249999999999994e-06 2023-10-08T07:07:43.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.559 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.560 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.560 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383276+0000", 2023-10-08T07:07:43.560 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5049999999999998e-06 2023-10-08T07:07:43.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.560 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.560 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.560 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392589+0000", 2023-10-08T07:07:43.560 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0093126259999999992 2023-10-08T07:07:43.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.560 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.560 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.561 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392671+0000", 2023-10-08T07:07:43.561 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2165999999999999e-05 2023-10-08T07:07:43.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.561 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.561 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.561 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392866+0000", 2023-10-08T07:07:43.561 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000195529 2023-10-08T07:07:43.561 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.561 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.561 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.562 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.562 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162192 4.13 4:c9f46be2:::10000000004.00000007:head [write 3682304~4096 in=4096b,write 3706880~4096 in=4096b,write 3850240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.562 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.396498+0000", 2023-10-08T07:07:43.562 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0055752470000000002, 2023-10-08T07:07:43.562 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0079427379999999995, 2023-10-08T07:07:43.562 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.562 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.562 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.562 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.562 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162192 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396498+0000", 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396498+0000", 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.564 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.564 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.564 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396499+0000", 2023-10-08T07:07:43.564 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4399999999999999e-07 2023-10-08T07:07:43.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.564 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.564 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.564 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396532+0000", 2023-10-08T07:07:43.564 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2799000000000002e-05 2023-10-08T07:07:43.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.564 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.564 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.565 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396542+0000", 2023-10-08T07:07:43.565 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0339e-05 2023-10-08T07:07:43.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.565 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.565 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.565 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.396549+0000", 2023-10-08T07:07:43.565 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1470000000000004e-06 2023-10-08T07:07:43.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.565 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.565 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.565 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.403496+0000", 2023-10-08T07:07:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0069465680000000002 2023-10-08T07:07:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.403591+0000", 2023-10-08T07:07:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5401000000000004e-05 2023-10-08T07:07:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.566 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162105 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 2179072~4096 in=4096b,write 2191360~4096 in=4096b,write 2289664~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.368861+0000", 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.033212507000000002, 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035653272, 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162105 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.568 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.368861+0000", 2023-10-08T07:07:43.568 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.568 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.568 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.568 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.368861+0000", 2023-10-08T07:07:43.568 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.568 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.568 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.568 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.368862+0000", 2023-10-08T07:07:43.568 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3099999999999997e-07 2023-10-08T07:07:43.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.569 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.569 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.569 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.368874+0000", 2023-10-08T07:07:43.569 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.184e-05 2023-10-08T07:07:43.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.569 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.569 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.569 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.368884+0000", 2023-10-08T07:07:43.569 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0502999999999999e-05 2023-10-08T07:07:43.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.570 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.570 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.570 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.368891+0000", 2023-10-08T07:07:43.570 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9399999999999996e-06 2023-10-08T07:07:43.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.570 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.570 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.570 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.369051+0000", 2023-10-08T07:07:43.570 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000159574 2023-10-08T07:07:43.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.570 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.571 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.571 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.369130+0000", 2023-10-08T07:07:43.571 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9277999999999995e-05 2023-10-08T07:07:43.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.571 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.571 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.571 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.369276+0000", 2023-10-08T07:07:43.571 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014592699999999999 2023-10-08T07:07:43.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.571 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.571 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.572 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.384816+0000", 2023-10-08T07:07:43.572 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015540125 2023-10-08T07:07:43.572 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.572 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.572 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.572 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.572 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.572 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162152 4.e 4:70352312:::10000000004.0000001a:head [write 1449984~4096 in=4096b,write 1470464~4096 in=4096b,write 1490944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.572 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.383959+0000", 2023-10-08T07:07:43.572 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.018114254999999999, 2023-10-08T07:07:43.572 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020643802999999999, 2023-10-08T07:07:43.572 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.573 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.573 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.573 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.573 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.573 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162152 2023-10-08T07:07:43.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.573 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.573 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.573 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.573 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383959+0000", 2023-10-08T07:07:43.573 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.574 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.574 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.574 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383959+0000", 2023-10-08T07:07:43.574 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.574 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.574 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.574 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383960+0000", 2023-10-08T07:07:43.574 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6700000000000002e-07 2023-10-08T07:07:43.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.574 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.574 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.575 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383971+0000", 2023-10-08T07:07:43.575 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0839000000000001e-05 2023-10-08T07:07:43.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.575 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.575 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.575 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383982+0000", 2023-10-08T07:07:43.575 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1168999999999999e-05 2023-10-08T07:07:43.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.575 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.575 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.575 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383991+0000", 2023-10-08T07:07:43.575 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4449999999999996e-06 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.384062+0000", 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1336999999999998e-05 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.384138+0000", 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6256999999999999e-05 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.576 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.577 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.577 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162194 4.1b 4:d97fb168:::10000000004.00000008:head [write 2338816~4096 in=4096b,write 2498560~4096 in=4096b,write 2846720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.577 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.397200+0000", 2023-10-08T07:07:43.577 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0048737470000000003, 2023-10-08T07:07:43.577 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074742960000000001, 2023-10-08T07:07:43.577 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.577 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.577 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.577 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.577 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.578 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162194 2023-10-08T07:07:43.578 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.578 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.578 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.578 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.578 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397200+0000", 2023-10-08T07:07:43.578 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.578 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.578 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.578 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.578 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397200+0000", 2023-10-08T07:07:43.578 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397201+0000", 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3900000000000004e-07 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397213+0000", 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2632999999999999e-05 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.579 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397225+0000", 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1481000000000001e-05 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397232+0000", 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5340000000000002e-06 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.403657+0000", 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0064247799999999997 2023-10-08T07:07:43.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.581 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.581 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.581 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.403733+0000", 2023-10-08T07:07:43.581 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5488000000000006e-05 2023-10-08T07:07:43.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.581 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.581 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.581 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.403890+0000", 2023-10-08T07:07:43.581 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015789800000000001 2023-10-08T07:07:43.582 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.582 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.582 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.582 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.582 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162020 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 532480~4096 in=4096b,write 892928~4096 in=4096b,write 1327104~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.582 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.339120+0000", 2023-10-08T07:07:43.582 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.062953989000000002, 2023-10-08T07:07:43.582 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.065632462000000003, 2023-10-08T07:07:43.582 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.582 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.583 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.583 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.583 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.583 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162020 2023-10-08T07:07:43.583 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.583 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.583 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.583 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.583 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.339120+0000", 2023-10-08T07:07:43.583 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.583 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.583 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.339120+0000", 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.339120+0000", 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2600000000000001e-07 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.339133+0000", 2023-10-08T07:07:43.584 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2479e-05 2023-10-08T07:07:43.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.585 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.585 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.585 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.339142+0000", 2023-10-08T07:07:43.585 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0240000000000003e-06 2023-10-08T07:07:43.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.585 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.585 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.585 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.339150+0000", 2023-10-08T07:07:43.585 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4489999999999999e-06 2023-10-08T07:07:43.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.585 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.586 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.586 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.366177+0000", 2023-10-08T07:07:43.586 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027027031999999999 2023-10-08T07:07:43.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.586 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.586 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.586 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.366275+0000", 2023-10-08T07:07:43.586 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7404000000000005e-05 2023-10-08T07:07:43.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.586 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.586 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.586 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.366476+0000", 2023-10-08T07:07:43.587 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020156199999999999 2023-10-08T07:07:43.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.587 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.587 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.587 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383508+0000", 2023-10-08T07:07:43.587 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017031956000000001 2023-10-08T07:07:43.587 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.587 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.587 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.587 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.587 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162106 4.2b 4:d7a77d67:::10000000004.00000029:head [write 978944~4096 in=4096b,write 1130496~4096 in=4096b,write 1175552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.368971+0000", 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.033102158999999999, 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035864360999999997, 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162106 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.588 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.589 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.368971+0000", 2023-10-08T07:07:43.589 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.589 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.589 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.589 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.368971+0000", 2023-10-08T07:07:43.589 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.589 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.589 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.589 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.368972+0000", 2023-10-08T07:07:43.589 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5700000000000001e-07 2023-10-08T07:07:43.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.590 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.590 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.590 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.368983+0000", 2023-10-08T07:07:43.590 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0380999999999999e-05 2023-10-08T07:07:43.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.590 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.590 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.590 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.368993+0000", 2023-10-08T07:07:43.590 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0587999999999999e-05 2023-10-08T07:07:43.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.369001+0000", 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4599999999999997e-06 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.371712+0000", 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00271142 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.591 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.371801+0000", 2023-10-08T07:07:43.592 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8809999999999998e-05 2023-10-08T07:07:43.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.592 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.592 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.592 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.371981+0000", 2023-10-08T07:07:43.592 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000180063 2023-10-08T07:07:43.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.592 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.592 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.592 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389515+0000", 2023-10-08T07:07:43.592 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017533483999999998 2023-10-08T07:07:43.592 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162155 4.20 4:05b3915c:::10000000004.00000016:head [write 520192~4096 in=4096b,write 536576~4096 in=4096b,write 1114112~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.384844+0000", 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.017230069000000001, 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020075098, 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.593 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.594 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162155 2023-10-08T07:07:43.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.594 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.594 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.594 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.594 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.384844+0000", 2023-10-08T07:07:43.594 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.594 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.594 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.594 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.384844+0000", 2023-10-08T07:07:43.594 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.595 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.595 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.595 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.384844+0000", 2023-10-08T07:07:43.595 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.54e-07 2023-10-08T07:07:43.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.595 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.595 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.595 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.384856+0000", 2023-10-08T07:07:43.595 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1725e-05 2023-10-08T07:07:43.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.595 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.596 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.596 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.384867+0000", 2023-10-08T07:07:43.596 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0732e-05 2023-10-08T07:07:43.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.596 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.596 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.596 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.384875+0000", 2023-10-08T07:07:43.596 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9580000000000007e-06 2023-10-08T07:07:43.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.596 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.596 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.596 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397475+0000", 2023-10-08T07:07:43.597 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012599856 2023-10-08T07:07:43.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.597 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.597 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.597 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397561+0000", 2023-10-08T07:07:43.597 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6268999999999997e-05 2023-10-08T07:07:43.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.597 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.597 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.597 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397736+0000", 2023-10-08T07:07:43.597 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017460199999999999 2023-10-08T07:07:43.597 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:148916 4.0 e63/17 4:02bf98b6:::10000000004.0000000e:head v 63'2317, mlcod=63'2314)", 2023-10-08T07:07:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.397652+0000", 2023-10-08T07:07:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0044211850000000002, 2023-10-08T07:07:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0073402160000000001, 2023-10-08T07:07:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397652+0000", 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397652+0000", 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397653+0000", 2023-10-08T07:07:43.599 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5899999999999996e-07 2023-10-08T07:07:43.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.600 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.600 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.600 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397669+0000", 2023-10-08T07:07:43.600 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5899000000000001e-05 2023-10-08T07:07:43.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.600 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.600 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.600 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397678+0000", 2023-10-08T07:07:43.600 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8440000000000004e-06 2023-10-08T07:07:43.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.601 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.601 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397684+0000", 2023-10-08T07:07:43.601 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2090000000000002e-06 2023-10-08T07:07:43.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.601 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.601 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.399217+0000", 2023-10-08T07:07:43.601 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0015334159999999999 2023-10-08T07:07:43.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.601 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.399238+0000", 2023-10-08T07:07:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0339999999999998e-05 2023-10-08T07:07:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162065 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2895872~4096 in=4096b,write 2965504~4096 in=4096b,write 3031040~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.355914+0000", 2023-10-08T07:07:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.046159683, 2023-10-08T07:07:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049149167000000001, 2023-10-08T07:07:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162065 2023-10-08T07:07:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.355914+0000", 2023-10-08T07:07:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.355914+0000", 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.355915+0000", 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0399999999999996e-07 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.355925+0000", 2023-10-08T07:07:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0924000000000001e-05 2023-10-08T07:07:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.355933+0000", 2023-10-08T07:07:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3749999999999997e-06 2023-10-08T07:07:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.355939+0000", 2023-10-08T07:07:43.606 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9529999999999996e-06 2023-10-08T07:07:43.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.606 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.606 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.606 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.378382+0000", 2023-10-08T07:07:43.606 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022443333999999999 2023-10-08T07:07:43.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.606 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.606 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.606 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.378476+0000", 2023-10-08T07:07:43.606 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3403e-05 2023-10-08T07:07:43.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.607 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.607 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.378650+0000", 2023-10-08T07:07:43.607 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000174389 2023-10-08T07:07:43.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.607 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.607 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.392504+0000", 2023-10-08T07:07:43.607 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013854521 2023-10-08T07:07:43.607 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.607 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.608 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.608 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.608 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162157 4.1b 4:d97fb168:::10000000004.00000008:head [write 3633152~4096 in=4096b,write 3670016~4096 in=4096b,write 4038656~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.608 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.385320+0000", 2023-10-08T07:07:43.608 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.016754048000000001, 2023-10-08T07:07:43.608 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01984008, 2023-10-08T07:07:43.608 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.608 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.608 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.608 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.608 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.609 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162157 2023-10-08T07:07:43.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.609 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385320+0000", 2023-10-08T07:07:43.609 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.609 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.609 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.609 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385320+0000", 2023-10-08T07:07:43.609 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385320+0000", 2023-10-08T07:07:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.06e-07 2023-10-08T07:07:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385329+0000", 2023-10-08T07:07:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1130000000000007e-06 2023-10-08T07:07:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385336+0000", 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0160000000000003e-06 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385341+0000", 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8690000000000003e-06 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.398462+0000", 2023-10-08T07:07:43.611 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013120341000000001 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.398550+0000", 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8627000000000004e-05 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.398735+0000", 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018478599999999999 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.612 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.613 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.613 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.613 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162196 4.30 4.44544cf0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.613 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.397931+0000", 2023-10-08T07:07:43.613 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.004142845, 2023-10-08T07:07:43.613 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0073783649999999996, 2023-10-08T07:07:43.613 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.613 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.613 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.613 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.613 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.614 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162196 2023-10-08T07:07:43.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.614 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.614 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.614 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.614 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397931+0000", 2023-10-08T07:07:43.614 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.614 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.614 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.614 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397931+0000", 2023-10-08T07:07:43.614 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397931+0000", 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7000000000000004e-07 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397948+0000", 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6787e-05 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.615 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.616 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397958+0000", 2023-10-08T07:07:43.616 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6409999999999997e-06 2023-10-08T07:07:43.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.616 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.616 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.616 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397965+0000", 2023-10-08T07:07:43.616 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.737e-06 2023-10-08T07:07:43.616 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.616 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.616 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.616 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162067 4.a 4:524fba76:::10000000004.0000001b:head [write 53248~4096 in=4096b,write 69632~4096 in=4096b,write 274432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.356520+0000", 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.045553429999999999, 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048864106999999997, 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162067 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.618 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.356520+0000", 2023-10-08T07:07:43.618 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.618 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.356520+0000", 2023-10-08T07:07:43.618 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.618 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.356521+0000", 2023-10-08T07:07:43.619 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5499999999999997e-07 2023-10-08T07:07:43.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.619 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.619 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.619 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.356534+0000", 2023-10-08T07:07:43.619 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2516e-05 2023-10-08T07:07:43.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.619 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.619 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.619 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.356547+0000", 2023-10-08T07:07:43.619 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3624e-05 2023-10-08T07:07:43.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.356555+0000", 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6660000000000008e-06 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383406+0000", 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026851453000000001 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.620 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383483+0000", 2023-10-08T07:07:43.621 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6477000000000007e-05 2023-10-08T07:07:43.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.621 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.621 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.383609+0000", 2023-10-08T07:07:43.621 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000126208 2023-10-08T07:07:43.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.621 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.621 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404222+0000", 2023-10-08T07:07:43.621 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020612596 2023-10-08T07:07:43.621 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.622 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.622 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.622 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.622 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162158 4.2c 4:352c144c:::10000000004.00000003:head [write 4112384~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.622 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.385582+0000", 2023-10-08T07:07:43.622 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.016491661000000001, 2023-10-08T07:07:43.622 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019888583000000001, 2023-10-08T07:07:43.622 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.622 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.622 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.622 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.623 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.623 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162158 2023-10-08T07:07:43.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.623 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.623 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.623 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.623 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385582+0000", 2023-10-08T07:07:43.623 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.623 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.623 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.623 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385582+0000", 2023-10-08T07:07:43.624 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.624 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.624 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.624 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385582+0000", 2023-10-08T07:07:43.624 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.13e-07 2023-10-08T07:07:43.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.624 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.624 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.624 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385589+0000", 2023-10-08T07:07:43.624 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5259999999999999e-06 2023-10-08T07:07:43.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385594+0000", 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8659999999999997e-06 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385598+0000", 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8850000000000001e-06 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385643+0000", 2023-10-08T07:07:43.626 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5460999999999997e-05 2023-10-08T07:07:43.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.626 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.626 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.626 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385691+0000", 2023-10-08T07:07:43.626 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8151e-05 2023-10-08T07:07:43.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.626 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.626 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.626 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385774+0000", 2023-10-08T07:07:43.626 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2218000000000005e-05 2023-10-08T07:07:43.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.627 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.627 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.627 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400949+0000", 2023-10-08T07:07:43.627 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015175182000000001 2023-10-08T07:07:43.627 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.627 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.627 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.627 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.627 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162108 4.1b 4:d97fb168:::10000000004.00000008:head [write 1363968~4096 in=4096b,write 1413120~4096 in=4096b,write 1552384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.627 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.372221+0000", 2023-10-08T07:07:43.627 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.029853105000000001, 2023-10-08T07:07:43.628 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033333226000000001, 2023-10-08T07:07:43.628 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.628 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.628 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.628 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.628 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.628 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162108 2023-10-08T07:07:43.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.628 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.628 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.628 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.628 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372221+0000", 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372221+0000", 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372221+0000", 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1600000000000001e-07 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372236+0000", 2023-10-08T07:07:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4555e-05 2023-10-08T07:07:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372247+0000", 2023-10-08T07:07:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0927999999999999e-05 2023-10-08T07:07:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372253+0000", 2023-10-08T07:07:43.631 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8360000000000003e-06 2023-10-08T07:07:43.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.631 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.631 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.631 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374752+0000", 2023-10-08T07:07:43.631 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0024988250000000001 2023-10-08T07:07:43.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.631 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.631 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.631 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374838+0000", 2023-10-08T07:07:43.631 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6123000000000002e-05 2023-10-08T07:07:43.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.375028+0000", 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019007599999999999 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389862+0000", 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014833727 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.633 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.633 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162159 4.2c 4:352c144c:::10000000004.00000003:head [write 3244032~4096 in=4096b,write 3440640~4096 in=4096b,write 3448832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.633 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.385837+0000", 2023-10-08T07:07:43.633 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.016236120999999999, 2023-10-08T07:07:43.633 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019802573, 2023-10-08T07:07:43.633 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.633 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.633 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.633 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.633 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.633 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162159 2023-10-08T07:07:43.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.634 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.634 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.634 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.634 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385837+0000", 2023-10-08T07:07:43.634 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.634 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.634 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.634 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385837+0000", 2023-10-08T07:07:43.634 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385838+0000", 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6899999999999996e-07 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385851+0000", 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2345e-05 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385860+0000", 2023-10-08T07:07:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8109999999999997e-06 2023-10-08T07:07:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.385868+0000", 2023-10-08T07:07:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9920000000000007e-06 2023-10-08T07:07:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387435+0000", 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001566289 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387509+0000", 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4037999999999998e-05 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387655+0000", 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014655899999999999 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400996+0000", 2023-10-08T07:07:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0133408 2023-10-08T07:07:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162197 4.1b 4.168dfe9b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.399207+0000", 2023-10-08T07:07:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0028661340000000002, 2023-10-08T07:07:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0065097059999999997, 2023-10-08T07:07:43.639 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.639 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.639 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.639 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.639 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.639 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162197 2023-10-08T07:07:43.639 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.639 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.639 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.639 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.639 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.399207+0000", 2023-10-08T07:07:43.639 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.640 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.640 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.640 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.399207+0000", 2023-10-08T07:07:43.640 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.640 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.640 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.640 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.399208+0000", 2023-10-08T07:07:43.640 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.95e-07 2023-10-08T07:07:43.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.640 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.641 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.641 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.399222+0000", 2023-10-08T07:07:43.641 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3106e-05 2023-10-08T07:07:43.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.641 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.641 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.641 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.399231+0000", 2023-10-08T07:07:43.641 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6870000000000006e-06 2023-10-08T07:07:43.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.641 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.641 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.641 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.399239+0000", 2023-10-08T07:07:43.642 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6890000000000004e-06 2023-10-08T07:07:43.642 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.642 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.642 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.642 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.642 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.642 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162110 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 954368~4096 in=4096b,write 1155072~4096 in=4096b,write 1167360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.642 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.372265+0000", 2023-10-08T07:07:43.642 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.029809057, 2023-10-08T07:07:43.642 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033512139000000003, 2023-10-08T07:07:43.642 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.642 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.643 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.643 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.643 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.643 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162110 2023-10-08T07:07:43.643 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.643 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.643 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.643 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.643 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372265+0000", 2023-10-08T07:07:43.643 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.643 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.643 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.644 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.644 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372265+0000", 2023-10-08T07:07:43.644 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.644 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.644 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.644 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.644 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372265+0000", 2023-10-08T07:07:43.644 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1600000000000001e-07 2023-10-08T07:07:43.644 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.644 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.645 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.645 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372277+0000", 2023-10-08T07:07:43.645 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2132e-05 2023-10-08T07:07:43.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.645 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.645 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.645 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372285+0000", 2023-10-08T07:07:43.645 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8180000000000004e-06 2023-10-08T07:07:43.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.645 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.645 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.645 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.372300+0000", 2023-10-08T07:07:43.646 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4783999999999999e-05 2023-10-08T07:07:43.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.646 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.646 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.646 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.377453+0000", 2023-10-08T07:07:43.646 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0051530209999999998 2023-10-08T07:07:43.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.646 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.646 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.646 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.377539+0000", 2023-10-08T07:07:43.646 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5655000000000006e-05 2023-10-08T07:07:43.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.647 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.647 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.647 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.377742+0000", 2023-10-08T07:07:43.647 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020359499999999999 2023-10-08T07:07:43.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.647 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.647 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:43.647 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395023+0000", 2023-10-08T07:07:43.647 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017280499000000001 2023-10-08T07:07:43.647 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.647 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.647 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.648 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.648 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162160 4.2 4.508f73c2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.648 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.386080+0000", 2023-10-08T07:07:43.648 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.015993688999999998, 2023-10-08T07:07:43.648 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019774841000000001, 2023-10-08T07:07:43.648 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.648 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.648 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.648 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.648 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.648 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162160 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.386080+0000", 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.386080+0000", 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.649 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.650 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.650 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.386081+0000", 2023-10-08T07:07:43.650 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4099999999999998e-07 2023-10-08T07:07:43.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.650 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.650 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.650 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.386094+0000", 2023-10-08T07:07:43.650 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.384e-05 2023-10-08T07:07:43.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.650 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.650 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.651 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.386105+0000", 2023-10-08T07:07:43.651 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0193e-05 2023-10-08T07:07:43.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.651 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.651 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.651 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.386111+0000", 2023-10-08T07:07:43.651 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3459999999999999e-06 2023-10-08T07:07:43.651 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.651 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.651 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.652 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.652 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162202 4.24 4:25ba01c5:::10000000004.00000035:head [write 622592~4096 in=4096b,write 630784~4096 in=4096b,write 655360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.652 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.400354+0000", 2023-10-08T07:07:43.652 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.001719422, 2023-10-08T07:07:43.652 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0055599070000000002, 2023-10-08T07:07:43.652 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.652 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.652 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.652 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.652 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.653 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162202 2023-10-08T07:07:43.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.653 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.653 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.653 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.653 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400354+0000", 2023-10-08T07:07:43.653 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.653 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.653 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.653 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400354+0000", 2023-10-08T07:07:43.653 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.654 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.654 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.654 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400355+0000", 2023-10-08T07:07:43.654 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3699999999999999e-07 2023-10-08T07:07:43.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.654 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.654 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.654 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400369+0000", 2023-10-08T07:07:43.654 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3634e-05 2023-10-08T07:07:43.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.655 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.655 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.655 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400384+0000", 2023-10-08T07:07:43.655 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5187e-05 2023-10-08T07:07:43.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.655 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.655 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.655 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400394+0000", 2023-10-08T07:07:43.655 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5910000000000002e-06 2023-10-08T07:07:43.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.655 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400450+0000", 2023-10-08T07:07:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6072000000000001e-05 2023-10-08T07:07:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400546+0000", 2023-10-08T07:07:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6424999999999999e-05 2023-10-08T07:07:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.657 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.657 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162162 4.e 4:70352312:::10000000004.0000001a:head [write 3100672~4096 in=4096b,write 3428352~4096 in=4096b,write 3444736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.657 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.386623+0000", 2023-10-08T07:07:43.657 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.015450274, 2023-10-08T07:07:43.657 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019372363, 2023-10-08T07:07:43.657 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.657 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.657 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.657 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.657 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.657 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162162 2023-10-08T07:07:43.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.658 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.658 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.658 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.658 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.386623+0000", 2023-10-08T07:07:43.658 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.658 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.658 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.658 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.386623+0000", 2023-10-08T07:07:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.386624+0000", 2023-10-08T07:07:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1600000000000001e-07 2023-10-08T07:07:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.386636+0000", 2023-10-08T07:07:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2052000000000001e-05 2023-10-08T07:07:43.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.660 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.660 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.660 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.386645+0000", 2023-10-08T07:07:43.660 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4239999999999999e-06 2023-10-08T07:07:43.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.660 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.660 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.660 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.386651+0000", 2023-10-08T07:07:43.660 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7939999999999999e-06 2023-10-08T07:07:43.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.660 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.661 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.661 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389776+0000", 2023-10-08T07:07:43.661 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031247800000000002 2023-10-08T07:07:43.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.661 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.661 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.661 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389868+0000", 2023-10-08T07:07:43.661 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2252999999999999e-05 2023-10-08T07:07:43.661 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.661 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.662 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.662 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.662 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:148935 4.0 e63/17 4:02bf98b6:::10000000004.0000000e:head v 63'2318, mlcod=63'2315)", 2023-10-08T07:07:43.662 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.400712+0000", 2023-10-08T07:07:43.662 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0013615350000000001, 2023-10-08T07:07:43.662 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0053617120000000002, 2023-10-08T07:07:43.662 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.662 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.662 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.662 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400712+0000", 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400712+0000", 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400713+0000", 2023-10-08T07:07:43.663 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1370000000000001e-06 2023-10-08T07:07:43.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.664 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.664 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400728+0000", 2023-10-08T07:07:43.664 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4392e-05 2023-10-08T07:07:43.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.664 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.664 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400737+0000", 2023-10-08T07:07:43.664 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7480000000000005e-06 2023-10-08T07:07:43.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400744+0000", 2023-10-08T07:07:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7970000000000003e-06 2023-10-08T07:07:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.401417+0000", 2023-10-08T07:07:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00067315699999999997 2023-10-08T07:07:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.401439+0000", 2023-10-08T07:07:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1265999999999999e-05 2023-10-08T07:07:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162204 4.20 4.3a89cda0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.400925+0000", 2023-10-08T07:07:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0011483299999999999, 2023-10-08T07:07:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052176330000000002, 2023-10-08T07:07:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.667 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.667 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.667 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.667 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162204 2023-10-08T07:07:43.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.667 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.667 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.667 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.667 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400925+0000", 2023-10-08T07:07:43.667 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.667 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400925+0000", 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400926+0000", 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.017e-06 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400939+0000", 2023-10-08T07:07:43.668 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2972999999999999e-05 2023-10-08T07:07:43.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.669 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400975+0000", 2023-10-08T07:07:43.669 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5982000000000002e-05 2023-10-08T07:07:43.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.669 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.669 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.400987+0000", 2023-10-08T07:07:43.669 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1989e-05 2023-10-08T07:07:43.669 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.669 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162117 4.2a 4:5404a18c:::10000000004.00000025:head [write 3096576~4096 in=4096b,write 3125248~4096 in=4096b,write 3153920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.374096+0000", 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027977517, 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032129313999999999, 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.670 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162117 2023-10-08T07:07:43.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.671 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.671 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.671 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374096+0000", 2023-10-08T07:07:43.671 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.671 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.671 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374096+0000", 2023-10-08T07:07:43.671 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.672 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.672 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374097+0000", 2023-10-08T07:07:43.672 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.223e-06 2023-10-08T07:07:43.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.672 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.672 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374113+0000", 2023-10-08T07:07:43.672 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5208000000000001e-05 2023-10-08T07:07:43.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.672 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.673 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374127+0000", 2023-10-08T07:07:43.673 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4554e-05 2023-10-08T07:07:43.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.673 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.673 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.673 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374136+0000", 2023-10-08T07:07:43.673 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7369999999999995e-06 2023-10-08T07:07:43.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.673 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.673 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.673 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394243+0000", 2023-10-08T07:07:43.673 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020107323999999999 2023-10-08T07:07:43.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.674 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.674 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.394336+0000", 2023-10-08T07:07:43.674 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2973000000000006e-05 2023-10-08T07:07:43.674 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.674 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.674 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.674 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162164 4.38 4:1e0977c7:::10000000004.00000022:head [write 1777664~4096 in=4096b,write 1794048~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.674 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.387141+0000", 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.014932503999999999, 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019127348999999998, 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162164 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.675 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387141+0000", 2023-10-08T07:07:43.676 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.676 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.676 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.676 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387141+0000", 2023-10-08T07:07:43.676 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.676 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.676 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.676 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387142+0000", 2023-10-08T07:07:43.676 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3500000000000005e-07 2023-10-08T07:07:43.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.677 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.677 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.677 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387153+0000", 2023-10-08T07:07:43.677 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.155e-05 2023-10-08T07:07:43.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.677 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.677 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.677 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387166+0000", 2023-10-08T07:07:43.677 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.258e-05 2023-10-08T07:07:43.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.677 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.677 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.678 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387175+0000", 2023-10-08T07:07:43.678 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4530000000000002e-06 2023-10-08T07:07:43.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.678 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.678 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.678 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397455+0000", 2023-10-08T07:07:43.678 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010280809 2023-10-08T07:07:43.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.678 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.678 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.678 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397530+0000", 2023-10-08T07:07:43.678 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4579000000000005e-05 2023-10-08T07:07:43.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.679 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:43.679 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.397657+0000", 2023-10-08T07:07:43.679 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012698700000000001 2023-10-08T07:07:43.679 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.679 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.679 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.679 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.679 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162206 4.34 4:2dadb699:::10000000004.00000031:head [write 1032192~4096 in=4096b,write 1200128~4096 in=4096b,write 1462272~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.679 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.401535+0000", 2023-10-08T07:07:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00053906199999999998, 2023-10-08T07:07:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0047940769999999999, 2023-10-08T07:07:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162206 2023-10-08T07:07:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.401535+0000", 2023-10-08T07:07:43.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.681 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.681 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.401535+0000", 2023-10-08T07:07:43.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.681 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.681 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.681 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.401535+0000", 2023-10-08T07:07:43.681 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.23e-07 2023-10-08T07:07:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.401547+0000", 2023-10-08T07:07:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1892999999999999e-05 2023-10-08T07:07:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.401558+0000", 2023-10-08T07:07:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0288999999999999e-05 2023-10-08T07:07:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.401565+0000", 2023-10-08T07:07:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3089999999999998e-06 2023-10-08T07:07:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.401625+0000", 2023-10-08T07:07:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0336e-05 2023-10-08T07:07:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.401772+0000", 2023-10-08T07:07:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014711300000000001 2023-10-08T07:07:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162166 4.5 4:a2ff1403:::10000000004.00000039:head [write 2043904~4096 in=4096b,write 2768896~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.387908+0000", 2023-10-08T07:07:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0141657, 2023-10-08T07:07:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018462190999999999, 2023-10-08T07:07:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162166 2023-10-08T07:07:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387908+0000", 2023-10-08T07:07:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387908+0000", 2023-10-08T07:07:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387909+0000", 2023-10-08T07:07:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1800000000000005e-07 2023-10-08T07:07:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.687 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387934+0000", 2023-10-08T07:07:43.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5446999999999999e-05 2023-10-08T07:07:43.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.687 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387948+0000", 2023-10-08T07:07:43.687 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4138000000000001e-05 2023-10-08T07:07:43.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.687 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.687 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387956+0000", 2023-10-08T07:07:43.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.374e-06 2023-10-08T07:07:43.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388004+0000", 2023-10-08T07:07:43.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7967999999999999e-05 2023-10-08T07:07:43.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.688 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.688 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.688 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388057+0000", 2023-10-08T07:07:43.688 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3287e-05 2023-10-08T07:07:43.689 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.689 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.689 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.689 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.689 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162209 4.1 4:8277d31e:::10000000004.00000013:head [write 1314816~4096 in=4096b,write 1527808~4096 in=4096b,write 1548288~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.689 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.402572+0000", 2023-10-08T07:07:43.689 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9995017, 2023-10-08T07:07:43.689 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038393920000000001, 2023-10-08T07:07:43.689 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.689 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.689 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162209 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402572+0000", 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.690 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402572+0000", 2023-10-08T07:07:43.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402573+0000", 2023-10-08T07:07:43.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2399999999999996e-07 2023-10-08T07:07:43.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.691 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.691 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.691 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402591+0000", 2023-10-08T07:07:43.691 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8029e-05 2023-10-08T07:07:43.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402604+0000", 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2636999999999999e-05 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402612+0000", 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2390000000000002e-06 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.692 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402678+0000", 2023-10-08T07:07:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5983999999999997e-05 2023-10-08T07:07:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402787+0000", 2023-10-08T07:07:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000109654 2023-10-08T07:07:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.693 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162121 4.2a 4:5404a18c:::10000000004.00000025:head [write 2469888~4096 in=4096b,write 2547712~4096 in=4096b,write 3055616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.694 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.374357+0000", 2023-10-08T07:07:43.694 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027716965999999999, 2023-10-08T07:07:43.694 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032094859000000003, 2023-10-08T07:07:43.694 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.694 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.694 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.694 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.694 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.694 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162121 2023-10-08T07:07:43.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.694 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.694 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374357+0000", 2023-10-08T07:07:43.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374357+0000", 2023-10-08T07:07:43.695 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.695 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.695 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.695 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374357+0000", 2023-10-08T07:07:43.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2099999999999996e-07 2023-10-08T07:07:43.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374371+0000", 2023-10-08T07:07:43.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3968000000000001e-05 2023-10-08T07:07:43.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.696 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.696 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374384+0000", 2023-10-08T07:07:43.696 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3047000000000001e-05 2023-10-08T07:07:43.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374391+0000", 2023-10-08T07:07:43.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7610000000000002e-06 2023-10-08T07:07:43.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.697 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.401684+0000", 2023-10-08T07:07:43.697 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027292370999999999 2023-10-08T07:07:43.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.697 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.698 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402206+0000", 2023-10-08T07:07:43.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00052204599999999997 2023-10-08T07:07:43.698 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.698 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.698 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.698 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.698 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162167 4.3a 4.f030edfa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.698 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.388444+0000", 2023-10-08T07:07:43.698 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013629934, 2023-10-08T07:07:43.698 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018071576999999998, 2023-10-08T07:07:43.698 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162167 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388444+0000", 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.699 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388444+0000", 2023-10-08T07:07:43.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388445+0000", 2023-10-08T07:07:43.700 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9500000000000001e-07 2023-10-08T07:07:43.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.700 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.700 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.700 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388458+0000", 2023-10-08T07:07:43.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2981e-05 2023-10-08T07:07:43.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388483+0000", 2023-10-08T07:07:43.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4967999999999999e-05 2023-10-08T07:07:43.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.701 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.701 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388492+0000", 2023-10-08T07:07:43.701 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6010000000000001e-06 2023-10-08T07:07:43.701 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162210 4.e 4:70352312:::10000000004.0000001a:head [write 36864~4096 in=4096b,write 253952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.402772+0000", 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9993019, 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0038030049999999999, 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.703 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162210 2023-10-08T07:07:43.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.703 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.703 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.703 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402772+0000", 2023-10-08T07:07:43.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.703 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.703 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.703 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402772+0000", 2023-10-08T07:07:43.703 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402773+0000", 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6599999999999995e-07 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402782+0000", 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7110000000000007e-06 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.704 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402792+0000", 2023-10-08T07:07:43.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8449999999999998e-06 2023-10-08T07:07:43.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402800+0000", 2023-10-08T07:07:43.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5399999999999998e-06 2023-10-08T07:07:43.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.705 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.705 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.705 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402855+0000", 2023-10-08T07:07:43.705 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4829e-05 2023-10-08T07:07:43.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.706 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.706 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.402944+0000", 2023-10-08T07:07:43.706 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9436000000000002e-05 2023-10-08T07:07:43.706 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.706 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.706 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.706 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162073 4.2a 4:5404a18c:::10000000004.00000025:head [write 2035712~4096 in=4096b,write 2105344~4096 in=4096b,write 2154496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.706 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.358366+0000", 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.043707818000000002, 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048271165999999997, 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162073 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.707 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.358366+0000", 2023-10-08T07:07:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.358366+0000", 2023-10-08T07:07:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.358367+0000", 2023-10-08T07:07:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6299999999999993e-07 2023-10-08T07:07:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.358378+0000", 2023-10-08T07:07:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1712999999999999e-05 2023-10-08T07:07:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.358389+0000", 2023-10-08T07:07:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0893999999999999e-05 2023-10-08T07:07:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.358400+0000", 2023-10-08T07:07:43.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0706999999999999e-05 2023-10-08T07:07:43.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387296+0000", 2023-10-08T07:07:43.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.028895667999999999 2023-10-08T07:07:43.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.710 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.710 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.710 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.387385+0000", 2023-10-08T07:07:43.710 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9115000000000003e-05 2023-10-08T07:07:43.711 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.711 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.711 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.711 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.711 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162123 4.2a 4:5404a18c:::10000000004.00000025:head [write 1642496~4096 in=4096b,write 1691648~4096 in=4096b,write 1708032~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.711 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.374570+0000", 2023-10-08T07:07:43.711 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027504003999999999, 2023-10-08T07:07:43.711 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032125194000000003, 2023-10-08T07:07:43.711 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.711 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.711 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.712 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.712 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.712 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162123 2023-10-08T07:07:43.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.712 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.712 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374570+0000", 2023-10-08T07:07:43.712 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.712 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.712 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374570+0000", 2023-10-08T07:07:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374571+0000", 2023-10-08T07:07:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.012e-06 2023-10-08T07:07:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374586+0000", 2023-10-08T07:07:43.713 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5574e-05 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374599+0000", 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3076e-05 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.374607+0000", 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9920000000000007e-06 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.714 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.403949+0000", 2023-10-08T07:07:43.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.029342185 2023-10-08T07:07:43.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.715 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.715 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404034+0000", 2023-10-08T07:07:43.715 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4166999999999996e-05 2023-10-08T07:07:43.715 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.715 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.715 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.715 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:151673 4.26 e63/17 4:672c55ca:::10000000004.00000006:head v 63'2388, mlcod=63'2386)", 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.388749+0000", 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013324455000000001, 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017990598, 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388749+0000", 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.716 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388749+0000", 2023-10-08T07:07:43.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388750+0000", 2023-10-08T07:07:43.717 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8199999999999999e-07 2023-10-08T07:07:43.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.717 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.717 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.717 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388764+0000", 2023-10-08T07:07:43.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4238e-05 2023-10-08T07:07:43.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388777+0000", 2023-10-08T07:07:43.718 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3091000000000001e-05 2023-10-08T07:07:43.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.718 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.718 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.388784+0000", 2023-10-08T07:07:43.721 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.267e-06 2023-10-08T07:07:43.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389756+0000", 2023-10-08T07:07:43.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00097203700000000003 2023-10-08T07:07:43.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.722 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.722 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.722 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389780+0000", 2023-10-08T07:07:43.722 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3478000000000001e-05 2023-10-08T07:07:43.722 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.722 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.722 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.723 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop_reply(client.4556.0:162020 4.3a e63/17)", 2023-10-08T07:07:43.723 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.404456+0000", 2023-10-08T07:07:43.723 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9976177, 2023-10-08T07:07:43.723 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0023737749999999998, 2023-10-08T07:07:43.723 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.723 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.723 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.723 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.723 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404456+0000", 2023-10-08T07:07:43.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404456+0000", 2023-10-08T07:07:43.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.724 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.724 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404457+0000", 2023-10-08T07:07:43.724 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2810000000000001e-06 2023-10-08T07:07:43.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404462+0000", 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2009999999999998e-06 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404472+0000", 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9869999999999994e-06 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.725 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404481+0000", 2023-10-08T07:07:43.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6910000000000003e-06 2023-10-08T07:07:43.726 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.726 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.726 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.726 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.726 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162125 4.2 4:40ea7945:::10000000004.0000003e:head [write 3772416~4096 in=4096b,write 3866624~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.726 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.375346+0000", 2023-10-08T07:07:43.726 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.026727280999999999, 2023-10-08T07:07:43.726 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.031553577999999999, 2023-10-08T07:07:43.726 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.726 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.727 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.727 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.727 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.727 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162125 2023-10-08T07:07:43.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.727 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.727 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.727 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.375346+0000", 2023-10-08T07:07:43.727 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.727 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.375346+0000", 2023-10-08T07:07:43.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.375347+0000", 2023-10-08T07:07:43.728 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9199999999999999e-07 2023-10-08T07:07:43.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.728 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.728 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.375360+0000", 2023-10-08T07:07:43.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.295e-05 2023-10-08T07:07:43.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.375388+0000", 2023-10-08T07:07:43.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7576000000000002e-05 2023-10-08T07:07:43.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.729 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.729 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.729 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.375399+0000", 2023-10-08T07:07:43.729 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1642e-05 2023-10-08T07:07:43.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404253+0000", 2023-10-08T07:07:43.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.028853983 2023-10-08T07:07:43.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.730 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.730 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404337+0000", 2023-10-08T07:07:43.730 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4096000000000003e-05 2023-10-08T07:07:43.730 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.730 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.730 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop_reply(client.4556.0:162056 4.3a e63/17)", 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.404501+0000", 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9975724, 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0024667539999999998, 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404501+0000", 2023-10-08T07:07:43.731 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404501+0000", 2023-10-08T07:07:43.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.732 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.732 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404502+0000", 2023-10-08T07:07:43.732 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.06e-07 2023-10-08T07:07:43.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.732 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404505+0000", 2023-10-08T07:07:43.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.994e-06 2023-10-08T07:07:43.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404512+0000", 2023-10-08T07:07:43.733 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9519999999999997e-06 2023-10-08T07:07:43.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.733 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.733 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.733 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404518+0000", 2023-10-08T07:07:43.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9950000000000002e-06 2023-10-08T07:07:43.734 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.734 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.734 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.734 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.734 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:162169 4.13 4:c9f46be2:::10000000004.00000007:head [write 2396160~4096 in=4096b,write 2408448~4096 in=4096b,write 2445312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:43.734 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.389068+0000", 2023-10-08T07:07:43.734 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.013005859999999999, 2023-10-08T07:07:43.734 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017957040000000001, 2023-10-08T07:07:43.734 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.734 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:43.735 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:43.735 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:43.735 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:43.735 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 162169 2023-10-08T07:07:43.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.735 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.735 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.735 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389068+0000", 2023-10-08T07:07:43.735 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.735 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389068+0000", 2023-10-08T07:07:43.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389069+0000", 2023-10-08T07:07:43.736 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6199999999999996e-07 2023-10-08T07:07:43.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.736 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.736 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.736 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389118+0000", 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9738999999999999e-05 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389130+0000", 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1548e-05 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.389138+0000", 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8010000000000004e-06 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.737 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:43.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395050+0000", 2023-10-08T07:07:43.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0059127759999999998 2023-10-08T07:07:43.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.738 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:43.738 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.395106+0000", 2023-10-08T07:07:43.738 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5145000000000001e-05 2023-10-08T07:07:43.738 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.738 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.738 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop_reply(client.4556.0:162057 4.3a e63/17)", 2023-10-08T07:07:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:43.404526+0000", 2023-10-08T07:07:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4294967295.9975471, 2023-10-08T07:07:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002568978, 2023-10-08T07:07:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404526+0000", 2023-10-08T07:07:43.739 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:43.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404526+0000", 2023-10-08T07:07:43.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:43.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.740 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:43.740 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404527+0000", 2023-10-08T07:07:43.740 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8200000000000001e-07 2023-10-08T07:07:43.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.740 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:43.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404529+0000", 2023-10-08T07:07:43.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.413e-06 2023-10-08T07:07:43.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:43.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404536+0000", 2023-10-08T07:07:43.741 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6490000000000002e-06 2023-10-08T07:07:43.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:43.741 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:43.741 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:43.741 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:43.404541+0000", 2023-10-08T07:07:43.742 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2800000000000003e-06 2023-10-08T07:07:43.742 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.742 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:43.742 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.742 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:43.742 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:07:43.742 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 67 2023-10-08T07:07:43.742 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:43.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2023-10-08T07:07:43.744 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:43.744 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:43.745 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:43.745 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:43.742+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:43.745 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:43.746 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:43.746 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:43.746 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:43.746 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:43.847 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:43.844+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:43.945 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:43.944+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:44.005 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:44.005 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:44.015 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:44.056 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:44.055+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:44.148 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:44.146+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:44.254 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:44.253+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:44.271 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:44.272 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:44.284 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:44.350 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:44.347+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:44.450 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:44.449+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:44.492 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:44.492 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:44.509 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:44.551 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:44.549+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:44.651 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:44.650+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:44.747 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:44.747 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:44.752 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:44.751+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:44.762 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:44.855 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:44.854+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:44.955 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:44.954+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:44.968 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:44.968 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:44.983 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:45.056 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:45.055+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:45.157 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:45.156+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:45.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T07:07:45.187 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:45.187 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:45.204 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:45.258 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:45.257+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:45.359 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:45.358+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:45.413 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:45.413 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:45.431 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:45.473 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:45.472+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:45.562 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:45.561+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:45.663 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:45.662+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:45.685 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:45.685 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:45.697 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:45.751 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:07:45.766 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:45.763+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:45.866 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:45.864+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:45.898 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:45.898 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:45.915 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:45.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:45.957 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:07:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:07:45.960 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:45.961 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:46.003 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:46.000+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:46.039 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2023-10-08T07:07:46.068 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:46.067+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:46.171 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:46.171 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:46.171 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:46.171 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:46.172 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:46.172 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:46.170+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:46.184 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:46.271 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:46.270+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:46.375 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:46.374+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:46.430 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:46.430 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:46.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:46.431 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:46.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.431 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147479 4.0 4:02bf98b6:::10000000004.0000000e:head [write 258048~4096,write 442368~4096,write 520192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.431 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:46.431 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8970934540000002, 2023-10-08T07:07:46.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.462729097, 2023-10-08T07:07:46.431 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.431 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.432 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147479 2023-10-08T07:07:46.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.432 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:46.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:46.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533313+0000", 2023-10-08T07:07:46.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002832841 2023-10-08T07:07:46.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533338+0000", 2023-10-08T07:07:46.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5052999999999999e-05 2023-10-08T07:07:46.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533350+0000", 2023-10-08T07:07:46.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2561000000000001e-05 2023-10-08T07:07:46.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533357+0000", 2023-10-08T07:07:46.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0870000000000001e-06 2023-10-08T07:07:46.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963719+0000", 2023-10-08T07:07:46.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4303612779999999 2023-10-08T07:07:46.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963788+0000", 2023-10-08T07:07:46.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9751000000000004e-05 2023-10-08T07:07:46.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:46.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963941+0000", 2023-10-08T07:07:46.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015224499999999999 2023-10-08T07:07:46.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:46.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.971897+0000", 2023-10-08T07:07:46.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079562769999999994 2023-10-08T07:07:46.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993080+0000", 2023-10-08T07:07:46.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021183400000000002 2023-10-08T07:07:46.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993161+0000", 2023-10-08T07:07:46.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1045999999999996e-05 2023-10-08T07:07:46.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993209+0000", 2023-10-08T07:07:46.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7558000000000001e-05 2023-10-08T07:07:46.438 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.438 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.438 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.438 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147519 4.10 4:08d50e0e:::10000000004.0000003f:head [write 258048~4096,write 417792~4096,write 1318912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.438 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:46.438 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8860724160000002, 2023-10-08T07:07:46.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.467910235, 2023-10-08T07:07:46.439 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.439 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.439 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.439 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.439 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.439 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147519 2023-10-08T07:07:46.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.440 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:46.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:46.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:46.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5199999999999998e-07 2023-10-08T07:07:46.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541510+0000", 2023-10-08T07:07:46.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4690000000000003e-06 2023-10-08T07:07:46.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541515+0000", 2023-10-08T07:07:46.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7260000000000002e-06 2023-10-08T07:07:46.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541518+0000", 2023-10-08T07:07:46.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7329999999999999e-06 2023-10-08T07:07:46.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.977538+0000", 2023-10-08T07:07:46.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.436020313 2023-10-08T07:07:46.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.977630+0000", 2023-10-08T07:07:46.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1893999999999998e-05 2023-10-08T07:07:46.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009278+0000", 2023-10-08T07:07:46.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.031647661000000001 2023-10-08T07:07:46.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009334+0000", 2023-10-08T07:07:46.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6366999999999998e-05 2023-10-08T07:07:46.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009411+0000", 2023-10-08T07:07:46.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.682e-05 2023-10-08T07:07:46.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.445 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.445 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.445 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147523 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2183168~4096,write 2215936~4096,write 2228224~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.445 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:46.445 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8860313230000001, 2023-10-08T07:07:46.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4714357950000001, 2023-10-08T07:07:46.446 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.446 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.447 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147523 2023-10-08T07:07:46.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.447 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:46.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:46.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:46.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2023-10-08T07:07:46.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541554+0000", 2023-10-08T07:07:46.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1515000000000001e-05 2023-10-08T07:07:46.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541557+0000", 2023-10-08T07:07:46.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.675e-06 2023-10-08T07:07:46.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541560+0000", 2023-10-08T07:07:46.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.841e-06 2023-10-08T07:07:46.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980499+0000", 2023-10-08T07:07:46.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.43893866 2023-10-08T07:07:46.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980591+0000", 2023-10-08T07:07:46.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1970000000000002e-05 2023-10-08T07:07:46.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:46.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980759+0000", 2023-10-08T07:07:46.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016861099999999999 2023-10-08T07:07:46.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:46.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993040+0000", 2023-10-08T07:07:46.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012280798000000001 2023-10-08T07:07:46.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012884+0000", 2023-10-08T07:07:46.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019843573 2023-10-08T07:07:46.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012938+0000", 2023-10-08T07:07:46.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4462000000000001e-05 2023-10-08T07:07:46.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012978+0000", 2023-10-08T07:07:46.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9455000000000001e-05 2023-10-08T07:07:46.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.462 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.463 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147525 4.28 4:16edf4d3:::10000000004.00000027:head [write 1671168~4096,write 1994752~4096,write 2002944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.463 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:46.463 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8857530630000001, 2023-10-08T07:07:46.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4828482860000001, 2023-10-08T07:07:46.464 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.464 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.465 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147525 2023-10-08T07:07:46.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.465 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:46.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:46.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545293+0000", 2023-10-08T07:07:46.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034732809999999999 2023-10-08T07:07:46.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545312+0000", 2023-10-08T07:07:46.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8156999999999999e-05 2023-10-08T07:07:46.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545323+0000", 2023-10-08T07:07:46.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1215e-05 2023-10-08T07:07:46.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545331+0000", 2023-10-08T07:07:46.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2859999999999999e-06 2023-10-08T07:07:46.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.998284+0000", 2023-10-08T07:07:46.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4529525249999999 2023-10-08T07:07:46.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.998394+0000", 2023-10-08T07:07:46.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000110214 2023-10-08T07:07:46.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024519+0000", 2023-10-08T07:07:46.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026125603000000001 2023-10-08T07:07:46.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024578+0000", 2023-10-08T07:07:46.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8779000000000001e-05 2023-10-08T07:07:46.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024668+0000", 2023-10-08T07:07:46.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0226e-05 2023-10-08T07:07:46.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.478 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.479 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147529 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3813376~4096,write 3833856~4096,write 3846144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.479 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:46.480 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8821917519999998, 2023-10-08T07:07:46.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4795143450000001, 2023-10-08T07:07:46.480 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.480 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.481 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147529 2023-10-08T07:07:46.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.482 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:46.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:46.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545382+0000", 2023-10-08T07:07:46.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2023-10-08T07:07:46.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545394+0000", 2023-10-08T07:07:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1969e-05 2023-10-08T07:07:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545403+0000", 2023-10-08T07:07:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7460000000000006e-06 2023-10-08T07:07:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545408+0000", 2023-10-08T07:07:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6749999999999999e-06 2023-10-08T07:07:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.999994+0000", 2023-10-08T07:07:46.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4545859759999999 2023-10-08T07:07:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.000091+0000", 2023-10-08T07:07:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6803000000000001e-05 2023-10-08T07:07:46.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024769+0000", 2023-10-08T07:07:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024677977 2023-10-08T07:07:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024819+0000", 2023-10-08T07:07:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.02e-05 2023-10-08T07:07:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024896+0000", 2023-10-08T07:07:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6447999999999997e-05 2023-10-08T07:07:46.491 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147541 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3600384~4096,write 3616768~4096,write 3747840~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8801873970000003, 2023-10-08T07:07:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478191619, 2023-10-08T07:07:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.493 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147541 2023-10-08T07:07:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1899999999999998e-07 2023-10-08T07:07:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547397+0000", 2023-10-08T07:07:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1263999999999999e-05 2023-10-08T07:07:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547401+0000", 2023-10-08T07:07:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7409999999999998e-06 2023-10-08T07:07:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547404+0000", 2023-10-08T07:07:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9890000000000001e-06 2023-10-08T07:07:46.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.004793+0000", 2023-10-08T07:07:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.457389024 2023-10-08T07:07:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.004869+0000", 2023-10-08T07:07:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6027999999999998e-05 2023-10-08T07:07:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005024+0000", 2023-10-08T07:07:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015473799999999999 2023-10-08T07:07:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024718+0000", 2023-10-08T07:07:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019694555999999998 2023-10-08T07:07:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024905+0000", 2023-10-08T07:07:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018695800000000001 2023-10-08T07:07:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025500+0000", 2023-10-08T07:07:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00059492300000000002 2023-10-08T07:07:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025577+0000", 2023-10-08T07:07:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7078999999999998e-05 2023-10-08T07:07:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147542 4.28 4:15b6682b:::10000000004.0000000b:head [write 1032192~4096,write 1110016~4096,write 1138688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8801646679999999, 2023-10-08T07:07:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478297658, 2023-10-08T07:07:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.500 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147542 2023-10-08T07:07:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549299+0000", 2023-10-08T07:07:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018905650000000001 2023-10-08T07:07:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549316+0000", 2023-10-08T07:07:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7065999999999999e-05 2023-10-08T07:07:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549327+0000", 2023-10-08T07:07:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0573e-05 2023-10-08T07:07:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549335+0000", 2023-10-08T07:07:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9410000000000007e-06 2023-10-08T07:07:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005115+0000", 2023-10-08T07:07:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.455780069 2023-10-08T07:07:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005188+0000", 2023-10-08T07:07:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3668e-05 2023-10-08T07:07:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025587+0000", 2023-10-08T07:07:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020398199999999998 2023-10-08T07:07:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025640+0000", 2023-10-08T07:07:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2023-10-08T07:07:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025706+0000", 2023-10-08T07:07:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6589999999999998e-05 2023-10-08T07:07:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147545 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3223552~4096,write 3239936~4096,write 3317760~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.878175862, 2023-10-08T07:07:46.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.485135557, 2023-10-08T07:07:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147545 2023-10-08T07:07:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549407+0000", 2023-10-08T07:07:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103e-05 2023-10-08T07:07:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549421+0000", 2023-10-08T07:07:46.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3995999999999999e-05 2023-10-08T07:07:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549430+0000", 2023-10-08T07:07:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3329999999999997e-06 2023-10-08T07:07:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549443+0000", 2023-10-08T07:07:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3492000000000001e-05 2023-10-08T07:07:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009122+0000", 2023-10-08T07:07:46.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4596791790000001 2023-10-08T07:07:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009194+0000", 2023-10-08T07:07:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1960999999999998e-05 2023-10-08T07:07:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:46.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009336+0000", 2023-10-08T07:07:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014156999999999999 2023-10-08T07:07:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025872+0000", 2023-10-08T07:07:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016536417000000001 2023-10-08T07:07:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034437+0000", 2023-10-08T07:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085645029999999994 2023-10-08T07:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034492+0000", 2023-10-08T07:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4688999999999998e-05 2023-10-08T07:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034533+0000", 2023-10-08T07:07:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1313999999999998e-05 2023-10-08T07:07:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.517 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147579 4.28 4:15b6682b:::10000000004.0000000b:head [write 3035136~8192,write 3059712~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8642288259999997, 2023-10-08T07:07:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.462488893, 2023-10-08T07:07:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.519 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147579 2023-10-08T07:07:46.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.519 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:46.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:46.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563345+0000", 2023-10-08T07:07:46.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000005e-07 2023-10-08T07:07:46.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563359+0000", 2023-10-08T07:07:46.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4199000000000001e-05 2023-10-08T07:07:46.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563366+0000", 2023-10-08T07:07:46.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8619999999999997e-06 2023-10-08T07:07:46.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563371+0000", 2023-10-08T07:07:46.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4060000000000004e-06 2023-10-08T07:07:46.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009484+0000", 2023-10-08T07:07:46.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4461131300000001 2023-10-08T07:07:46.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009562+0000", 2023-10-08T07:07:46.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8046999999999993e-05 2023-10-08T07:07:46.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025714+0000", 2023-10-08T07:07:46.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016151327 2023-10-08T07:07:46.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025754+0000", 2023-10-08T07:07:46.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0049000000000002e-05 2023-10-08T07:07:46.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025833+0000", 2023-10-08T07:07:46.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9395999999999997e-05 2023-10-08T07:07:46.525 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.526 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.526 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147591 4.28 4:16edf4d3:::10000000004.00000027:head [write 684032~4096,write 741376~4096,write 765952~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.526 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:46.526 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8601299610000002, 2023-10-08T07:07:46.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4805182619999999, 2023-10-08T07:07:46.527 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.527 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.527 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147591 2023-10-08T07:07:46.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.527 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:46.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:46.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567444+0000", 2023-10-08T07:07:46.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8500000000000001e-07 2023-10-08T07:07:46.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567456+0000", 2023-10-08T07:07:46.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2221e-05 2023-10-08T07:07:46.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567463+0000", 2023-10-08T07:07:46.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.652e-06 2023-10-08T07:07:46.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567468+0000", 2023-10-08T07:07:46.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8500000000000002e-06 2023-10-08T07:07:46.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025908+0000", 2023-10-08T07:07:46.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.458440948 2023-10-08T07:07:46.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.026004+0000", 2023-10-08T07:07:46.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5805999999999997e-05 2023-10-08T07:07:46.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047842+0000", 2023-10-08T07:07:46.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021837770999999999 2023-10-08T07:07:46.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047894+0000", 2023-10-08T07:07:46.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2079000000000001e-05 2023-10-08T07:07:46.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047961+0000", 2023-10-08T07:07:46.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7349999999999997e-05 2023-10-08T07:07:46.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.534 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.535 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147596 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2379776~4096,write 2428928~4096,write 2531328~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.535 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:46.535 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8582183380000004, 2023-10-08T07:07:46.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478728255, 2023-10-08T07:07:46.535 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.535 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.535 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.536 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147596 2023-10-08T07:07:46.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.536 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:46.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:46.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571294+0000", 2023-10-08T07:07:46.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001939037 2023-10-08T07:07:46.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571314+0000", 2023-10-08T07:07:46.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9791000000000001e-05 2023-10-08T07:07:46.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571327+0000", 2023-10-08T07:07:46.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3078000000000001e-05 2023-10-08T07:07:46.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571334+0000", 2023-10-08T07:07:46.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2429999999999999e-06 2023-10-08T07:07:46.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.028808+0000", 2023-10-08T07:07:46.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4574743030000001 2023-10-08T07:07:46.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.028888+0000", 2023-10-08T07:07:46.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9818e-05 2023-10-08T07:07:46.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047970+0000", 2023-10-08T07:07:46.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019082359 2023-10-08T07:07:46.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048017+0000", 2023-10-08T07:07:46.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6943000000000001e-05 2023-10-08T07:07:46.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048083+0000", 2023-10-08T07:07:46.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5683000000000001e-05 2023-10-08T07:07:46.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.546 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.546 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147608 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3088384~4096,write 3145728~4096,write 3276800~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.547 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:46.547 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8501820520000001, 2023-10-08T07:07:46.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4708017579999999, 2023-10-08T07:07:46.547 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.547 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.548 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147608 2023-10-08T07:07:46.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.548 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:46.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:46.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577392+0000", 2023-10-08T07:07:46.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2023-10-08T07:07:46.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577404+0000", 2023-10-08T07:07:46.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2544999999999999e-05 2023-10-08T07:07:46.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577411+0000", 2023-10-08T07:07:46.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4219999999999997e-06 2023-10-08T07:07:46.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577416+0000", 2023-10-08T07:07:46.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9729999999999997e-06 2023-10-08T07:07:46.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031697+0000", 2023-10-08T07:07:46.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.454281656 2023-10-08T07:07:46.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031771+0000", 2023-10-08T07:07:46.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3440000000000002e-05 2023-10-08T07:07:46.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048095+0000", 2023-10-08T07:07:46.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016324241999999999 2023-10-08T07:07:46.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048134+0000", 2023-10-08T07:07:46.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9558999999999999e-05 2023-10-08T07:07:46.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048193+0000", 2023-10-08T07:07:46.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8409999999999998e-05 2023-10-08T07:07:46.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.557 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.557 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147614 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2973696~4096,write 3149824~4096,write 3158016~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.557 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:46.558 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8481916539999999, 2023-10-08T07:07:46.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4709725659999999, 2023-10-08T07:07:46.558 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.558 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.559 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147614 2023-10-08T07:07:46.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.559 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:46.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:46.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:46.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.51e-07 2023-10-08T07:07:46.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579394+0000", 2023-10-08T07:07:46.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.207e-05 2023-10-08T07:07:46.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579401+0000", 2023-10-08T07:07:46.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3900000000000004e-06 2023-10-08T07:07:46.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579406+0000", 2023-10-08T07:07:46.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9490000000000004e-06 2023-10-08T07:07:46.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031686+0000", 2023-10-08T07:07:46.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4522797299999999 2023-10-08T07:07:46.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031763+0000", 2023-10-08T07:07:46.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6432000000000003e-05 2023-10-08T07:07:46.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:46.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031910+0000", 2023-10-08T07:07:46.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014741900000000001 2023-10-08T07:07:46.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048090+0000", 2023-10-08T07:07:46.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016179948999999999 2023-10-08T07:07:46.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:46.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050261+0000", 2023-10-08T07:07:46.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021715860000000001 2023-10-08T07:07:46.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050320+0000", 2023-10-08T07:07:46.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8217999999999997e-05 2023-10-08T07:07:46.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050354+0000", 2023-10-08T07:07:46.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4372000000000002e-05 2023-10-08T07:07:46.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.567 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.568 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147623 4.28 4:16edf4d3:::10000000004.00000027:head [write 1306624~4096,write 1331200~4096,write 1429504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.568 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:46.568 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8480684680000001, 2023-10-08T07:07:46.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.497941188, 2023-10-08T07:07:46.569 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.569 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.569 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147623 2023-10-08T07:07:46.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.569 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:46.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:46.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582310+0000", 2023-10-08T07:07:46.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028050800000000002 2023-10-08T07:07:46.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582327+0000", 2023-10-08T07:07:46.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6807e-05 2023-10-08T07:07:46.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582337+0000", 2023-10-08T07:07:46.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0454e-05 2023-10-08T07:07:46.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582344+0000", 2023-10-08T07:07:46.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2239999999999998e-06 2023-10-08T07:07:46.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.052947+0000", 2023-10-08T07:07:46.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4706025979999999 2023-10-08T07:07:46.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.053025+0000", 2023-10-08T07:07:46.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7985000000000006e-05 2023-10-08T07:07:46.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077312+0000", 2023-10-08T07:07:46.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024286855999999999 2023-10-08T07:07:46.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077368+0000", 2023-10-08T07:07:46.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5834000000000001e-05 2023-10-08T07:07:46.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077446+0000", 2023-10-08T07:07:46.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8349999999999994e-05 2023-10-08T07:07:46.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.576 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.577 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147645 4.0 4:02bf98b6:::10000000004.0000000e:head [write 1941504~4096,write 2043904~4096,write 2076672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.577 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:46.577 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.837216175, 2023-10-08T07:07:46.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4872246599999999, 2023-10-08T07:07:46.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.582 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147645 2023-10-08T07:07:46.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.582 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0100000000000001e-07 2023-10-08T07:07:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590367+0000", 2023-10-08T07:07:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2830000000000007e-06 2023-10-08T07:07:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590372+0000", 2023-10-08T07:07:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0880000000000002e-06 2023-10-08T07:07:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590375+0000", 2023-10-08T07:07:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9869999999999999e-06 2023-10-08T07:07:46.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055521+0000", 2023-10-08T07:07:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4651462099999999 2023-10-08T07:07:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055589+0000", 2023-10-08T07:07:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7916999999999994e-05 2023-10-08T07:07:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055718+0000", 2023-10-08T07:07:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012877200000000001 2023-10-08T07:07:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.076842+0000", 2023-10-08T07:07:46.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021124074999999999 2023-10-08T07:07:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077494+0000", 2023-10-08T07:07:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00065233700000000001 2023-10-08T07:07:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077539+0000", 2023-10-08T07:07:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4829000000000001e-05 2023-10-08T07:07:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077582+0000", 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2861000000000002e-05 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147649 4.10 4:08d50e0e:::10000000004.0000003f:head [write 1347584~4096,write 1568768~4096,write 1728512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8371944510000002, 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4873494039999999, 2023-10-08T07:07:46.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.590 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.590 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.590 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.590 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.590 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147649 2023-10-08T07:07:46.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.590 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:46.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:46.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:46.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7399999999999999e-07 2023-10-08T07:07:46.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590389+0000", 2023-10-08T07:07:46.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7019999999999996e-06 2023-10-08T07:07:46.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590394+0000", 2023-10-08T07:07:46.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1229999999999999e-06 2023-10-08T07:07:46.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590397+0000", 2023-10-08T07:07:46.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8480000000000001e-06 2023-10-08T07:07:46.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.056106+0000", 2023-10-08T07:07:46.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4657090159999999 2023-10-08T07:07:46.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.056177+0000", 2023-10-08T07:07:46.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1148000000000004e-05 2023-10-08T07:07:46.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077593+0000", 2023-10-08T07:07:46.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021416101 2023-10-08T07:07:46.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077652+0000", 2023-10-08T07:07:46.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9005999999999997e-05 2023-10-08T07:07:46.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077728+0000", 2023-10-08T07:07:46.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6186000000000005e-05 2023-10-08T07:07:46.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.595 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.595 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147667 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2600960~4096,write 2826240~4096,write 2871296~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.595 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:46.595 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8330340270000001, 2023-10-08T07:07:46.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4900356029999999, 2023-10-08T07:07:46.596 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.596 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.596 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147667 2023-10-08T07:07:46.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.596 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:46.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:46.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596594+0000", 2023-10-08T07:07:46.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020548599999999999 2023-10-08T07:07:46.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596614+0000", 2023-10-08T07:07:46.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0228e-05 2023-10-08T07:07:46.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596625+0000", 2023-10-08T07:07:46.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0721e-05 2023-10-08T07:07:46.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596633+0000", 2023-10-08T07:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5900000000000002e-06 2023-10-08T07:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.059476+0000", 2023-10-08T07:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4628431820000001 2023-10-08T07:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.059555+0000", 2023-10-08T07:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9192999999999999e-05 2023-10-08T07:07:46.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084434+0000", 2023-10-08T07:07:46.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024879571999999999 2023-10-08T07:07:46.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084501+0000", 2023-10-08T07:07:46.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6129000000000003e-05 2023-10-08T07:07:46.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084575+0000", 2023-10-08T07:07:46.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4128000000000006e-05 2023-10-08T07:07:46.601 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.601 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.601 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.601 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147702 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3768320~4096,write 3788800~4096,write 3817472~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.602 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:46.602 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8100067470000001, 2023-10-08T07:07:46.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4668568, 2023-10-08T07:07:46.602 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.602 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.602 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.602 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.602 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.602 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147702 2023-10-08T07:07:46.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.602 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:46.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:46.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617567+0000", 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617578+0000", 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0922e-05 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617584+0000", 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7849999999999997e-06 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617588+0000", 2023-10-08T07:07:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6310000000000002e-06 2023-10-08T07:07:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062218+0000", 2023-10-08T07:07:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4446299810000001 2023-10-08T07:07:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062303+0000", 2023-10-08T07:07:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4648999999999995e-05 2023-10-08T07:07:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062425+0000", 2023-10-08T07:07:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012220899999999999 2023-10-08T07:07:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.076883+0000", 2023-10-08T07:07:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014458354 2023-10-08T07:07:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084302+0000", 2023-10-08T07:07:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074189310000000001 2023-10-08T07:07:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084374+0000", 2023-10-08T07:07:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1519000000000004e-05 2023-10-08T07:07:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084423+0000", 2023-10-08T07:07:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000003e-05 2023-10-08T07:07:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147713 4.28 4:15b6682b:::10000000004.0000000b:head [write 2990080~4096,write 3133440~4096,write 3362816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8098742239999996, 2023-10-08T07:07:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707889380000001, 2023-10-08T07:07:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147713 2023-10-08T07:07:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.89e-07 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617718+0000", 2023-10-08T07:07:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8287e-05 2023-10-08T07:07:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617724+0000", 2023-10-08T07:07:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7939999999999997e-06 2023-10-08T07:07:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617730+0000", 2023-10-08T07:07:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1819999999999997e-06 2023-10-08T07:07:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062893+0000", 2023-10-08T07:07:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4451633429999999 2023-10-08T07:07:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062969+0000", 2023-10-08T07:07:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6119999999999996e-05 2023-10-08T07:07:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088335+0000", 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025366289 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088399+0000", 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4067999999999997e-05 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088488+0000", 2023-10-08T07:07:46.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8466000000000003e-05 2023-10-08T07:07:46.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.614 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.614 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147714 4.28 4:15b6682b:::10000000004.0000000b:head [write 1286144~4096,write 1372160~4096,write 1523712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:46.614 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:46.614 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.8098361140000003, 2023-10-08T07:07:46.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.471492757, 2023-10-08T07:07:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147714 2023-10-08T07:07:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:46.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:46.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:46.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:46.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:46.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:07:46.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:46.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617751+0000", 2023-10-08T07:07:46.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3570000000000001e-05 2023-10-08T07:07:46.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:46.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617757+0000", 2023-10-08T07:07:46.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.229e-06 2023-10-08T07:07:46.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617762+0000", 2023-10-08T07:07:46.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7670000000000003e-06 2023-10-08T07:07:46.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:46.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.068000+0000", 2023-10-08T07:07:46.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4502380930000001 2023-10-08T07:07:46.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:46.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.068049+0000", 2023-10-08T07:07:46.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9051999999999997e-05 2023-10-08T07:07:46.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:46.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089117+0000", 2023-10-08T07:07:46.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021067536000000001 2023-10-08T07:07:46.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:46.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089164+0000", 2023-10-08T07:07:46.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7178999999999997e-05 2023-10-08T07:07:46.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:46.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:46.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:46.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089230+0000", 2023-10-08T07:07:46.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5896999999999996e-05 2023-10-08T07:07:46.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.620 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:46.621 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:46.621 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:46.622 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:46.621+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:46.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:46.723 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:46.722+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:46.826 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:46.823+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:46.847 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172529 4.2b 4:d776c1c9:::10000000004.0000003d:head [write 73728~4096 in=4096b,write 552960~4096 in=4096b,write 626688~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.799122+0000", 2023-10-08T07:07:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.039621643999999998, 2023-10-08T07:07:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.039641873000000001, 2023-10-08T07:07:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172529 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.799122+0000", 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.799122+0000", 2023-10-08T07:07:46.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.799123+0000", 2023-10-08T07:07:46.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9400000000000005e-07 2023-10-08T07:07:46.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.799138+0000", 2023-10-08T07:07:46.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4843e-05 2023-10-08T07:07:46.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.799149+0000", 2023-10-08T07:07:46.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1508000000000001e-05 2023-10-08T07:07:46.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.799157+0000", 2023-10-08T07:07:46.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2799999999999998e-06 2023-10-08T07:07:46.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813652+0000", 2023-10-08T07:07:46.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014495601 2023-10-08T07:07:46.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813726+0000", 2023-10-08T07:07:46.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4175e-05 2023-10-08T07:07:46.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:46.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813888+0000", 2023-10-08T07:07:46.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000162063 2023-10-08T07:07:46.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.837770+0000", 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023881093999999999 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172575 4.a 4.6e5df24a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.812227+0000", 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.026516722, 2023-10-08T07:07:46.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026590444000000001, 2023-10-08T07:07:46.854 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.854 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:46.854 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.854 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.854 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.854 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172575 2023-10-08T07:07:46.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.855 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.812227+0000", 2023-10-08T07:07:46.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.812227+0000", 2023-10-08T07:07:46.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.812228+0000", 2023-10-08T07:07:46.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.71e-07 2023-10-08T07:07:46.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.812244+0000", 2023-10-08T07:07:46.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5824e-05 2023-10-08T07:07:46.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.857 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.857 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.857 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.812258+0000", 2023-10-08T07:07:46.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3708e-05 2023-10-08T07:07:46.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.857 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.857 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.857 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.812265+0000", 2023-10-08T07:07:46.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4869999999999996e-06 2023-10-08T07:07:46.857 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.858 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.858 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.858 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172615 4.a 4.6e5df24a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.858 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.823731+0000", 2023-10-08T07:07:46.858 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.015012543, 2023-10-08T07:07:46.858 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015119481000000001, 2023-10-08T07:07:46.858 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.858 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:46.858 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.859 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.859 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.859 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172615 2023-10-08T07:07:46.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.859 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823731+0000", 2023-10-08T07:07:46.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823731+0000", 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823732+0000", 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.68e-07 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823744+0000", 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2502e-05 2023-10-08T07:07:46.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823753+0000", 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9600000000000006e-06 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823760+0000", 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5259999999999999e-06 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172664 4.38 4.e3ee9078 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.836406+0000", 2023-10-08T07:07:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0023374770000000001, 2023-10-08T07:07:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.002475587, 2023-10-08T07:07:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172664 2023-10-08T07:07:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.863 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.836406+0000", 2023-10-08T07:07:46.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.836406+0000", 2023-10-08T07:07:46.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.864 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.864 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.836407+0000", 2023-10-08T07:07:46.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8199999999999999e-07 2023-10-08T07:07:46.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.864 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.864 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.836416+0000", 2023-10-08T07:07:46.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9309999999999997e-06 2023-10-08T07:07:46.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.864 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.864 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.836426+0000", 2023-10-08T07:07:46.865 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9839999999999996e-06 2023-10-08T07:07:46.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.865 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.865 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.865 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.836431+0000", 2023-10-08T07:07:46.865 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0300000000000001e-06 2023-10-08T07:07:46.865 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.865 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.865 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.865 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.865 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172455 4.2a 4:5404a18c:::10000000004.00000025:head [write 757760~4096 in=4096b,write 770048~4096 in=4096b,write 790528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.776254+0000", 2023-10-08T07:07:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.062490180999999999, 2023-10-08T07:07:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062665157999999999, 2023-10-08T07:07:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172455 2023-10-08T07:07:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.776254+0000", 2023-10-08T07:07:46.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.776254+0000", 2023-10-08T07:07:46.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.868 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.868 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.776255+0000", 2023-10-08T07:07:46.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.47e-07 2023-10-08T07:07:46.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.868 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.868 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.868 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.776269+0000", 2023-10-08T07:07:46.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4141999999999999e-05 2023-10-08T07:07:46.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.868 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.868 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.869 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.776289+0000", 2023-10-08T07:07:46.869 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0237999999999998e-05 2023-10-08T07:07:46.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.869 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.869 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.869 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.776295+0000", 2023-10-08T07:07:46.869 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3999999999999997e-06 2023-10-08T07:07:46.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.869 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.869 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.869 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.808102+0000", 2023-10-08T07:07:46.869 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.031806515 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.808196+0000", 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4369000000000004e-05 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172487 4.2 4:40ea7945:::10000000004.0000003e:head [write 2101248~4096 in=4096b,write 2174976~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.789293+0000", 2023-10-08T07:07:46.870 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.049450597999999998, 2023-10-08T07:07:46.871 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049666145000000002, 2023-10-08T07:07:46.871 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.871 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:46.871 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.871 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.871 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.871 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172487 2023-10-08T07:07:46.871 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.871 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.871 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.871 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.871 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789293+0000", 2023-10-08T07:07:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789293+0000", 2023-10-08T07:07:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789294+0000", 2023-10-08T07:07:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.41e-07 2023-10-08T07:07:46.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.873 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.873 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.874 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789302+0000", 2023-10-08T07:07:46.874 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1440000000000003e-06 2023-10-08T07:07:46.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.874 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.874 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.874 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789305+0000", 2023-10-08T07:07:46.874 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6820000000000001e-06 2023-10-08T07:07:46.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.874 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.875 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.875 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789310+0000", 2023-10-08T07:07:46.875 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.228e-06 2023-10-08T07:07:46.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.875 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.875 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.875 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.816533+0000", 2023-10-08T07:07:46.875 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027223774999999999 2023-10-08T07:07:46.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.875 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.875 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.875 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.816620+0000", 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6637000000000004e-05 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172578 4.3a 4.d27c18fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.813074+0000", 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.025670114000000001, 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.025923587000000001, 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:46.876 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172578 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813074+0000", 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813074+0000", 2023-10-08T07:07:46.878 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.878 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.878 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813075+0000", 2023-10-08T07:07:46.878 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2500000000000004e-07 2023-10-08T07:07:46.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.878 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.878 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813086+0000", 2023-10-08T07:07:46.878 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1297e-05 2023-10-08T07:07:46.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.879 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.879 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.879 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813096+0000", 2023-10-08T07:07:46.879 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8640000000000008e-06 2023-10-08T07:07:46.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.879 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.879 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.879 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813104+0000", 2023-10-08T07:07:46.879 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2039999999999997e-06 2023-10-08T07:07:46.879 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.879 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.879 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.880 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.880 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172616 4.5 4:a367a3e8:::10000000004.00000000:head [write 3715072~4096 in=4096b,write 3727360~4096 in=4096b,write 3874816~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.880 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.823770+0000", 2023-10-08T07:07:46.880 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.014974407, 2023-10-08T07:07:46.880 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015262145, 2023-10-08T07:07:46.880 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.880 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:46.880 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.880 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.880 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.881 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172616 2023-10-08T07:07:46.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.881 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.881 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.881 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.881 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823770+0000", 2023-10-08T07:07:46.881 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.881 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.881 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.881 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823770+0000", 2023-10-08T07:07:46.882 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.882 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.882 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.882 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823770+0000", 2023-10-08T07:07:46.882 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1399999999999997e-07 2023-10-08T07:07:46.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.882 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.882 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.882 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823781+0000", 2023-10-08T07:07:46.883 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1070000000000001e-05 2023-10-08T07:07:46.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.883 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.883 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.883 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823789+0000", 2023-10-08T07:07:46.883 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5900000000000002e-06 2023-10-08T07:07:46.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.883 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.883 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.883 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823796+0000", 2023-10-08T07:07:46.883 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6389999999999992e-06 2023-10-08T07:07:46.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.884 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.884 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.884 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823942+0000", 2023-10-08T07:07:46.884 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014592399999999999 2023-10-08T07:07:46.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.884 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.884 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.884 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.824076+0000", 2023-10-08T07:07:46.884 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013349799999999999 2023-10-08T07:07:46.884 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.884 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.884 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.885 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.885 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172579 4.5 4:a2ff1403:::10000000004.00000039:head [write 3137536~4096 in=4096b,write 3321856~4096 in=4096b,write 3358720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.885 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.813431+0000", 2023-10-08T07:07:46.885 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.025313179000000002, 2023-10-08T07:07:46.886 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.025645787, 2023-10-08T07:07:46.886 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.886 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:46.886 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.886 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.886 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.886 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172579 2023-10-08T07:07:46.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.886 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.886 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.886 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.886 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813431+0000", 2023-10-08T07:07:46.887 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.887 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.887 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.887 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813431+0000", 2023-10-08T07:07:46.887 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.887 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.887 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.887 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813432+0000", 2023-10-08T07:07:46.887 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6199999999999996e-07 2023-10-08T07:07:46.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.888 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.888 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.888 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813446+0000", 2023-10-08T07:07:46.888 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4440999999999999e-05 2023-10-08T07:07:46.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.888 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.888 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.888 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813456+0000", 2023-10-08T07:07:46.888 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0176e-05 2023-10-08T07:07:46.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.888 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.888 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813464+0000", 2023-10-08T07:07:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6899999999999992e-06 2023-10-08T07:07:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813517+0000", 2023-10-08T07:07:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3258999999999999e-05 2023-10-08T07:07:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813597+0000", 2023-10-08T07:07:46.889 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9726000000000002e-05 2023-10-08T07:07:46.890 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.890 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.890 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.890 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.890 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172617 4.c 4.8681478c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.890 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.823813+0000", 2023-10-08T07:07:46.890 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.014931062, 2023-10-08T07:07:46.890 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015310453, 2023-10-08T07:07:46.890 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.890 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:46.891 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.891 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.891 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.891 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172617 2023-10-08T07:07:46.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.891 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.891 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.891 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.891 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823813+0000", 2023-10-08T07:07:46.891 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.891 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823813+0000", 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823813+0000", 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2300000000000001e-07 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823825+0000", 2023-10-08T07:07:46.892 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1167e-05 2023-10-08T07:07:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823831+0000", 2023-10-08T07:07:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8449999999999997e-06 2023-10-08T07:07:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823837+0000", 2023-10-08T07:07:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9909999999999999e-06 2023-10-08T07:07:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.893 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.894 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.894 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.894 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172582 4.2 4.a29e5702 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.894 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.814132+0000", 2023-10-08T07:07:46.894 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.024611584999999998, 2023-10-08T07:07:46.894 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.025022447999999999, 2023-10-08T07:07:46.894 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.894 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:46.894 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.894 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.895 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.895 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172582 2023-10-08T07:07:46.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.895 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.895 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.895 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.895 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.814132+0000", 2023-10-08T07:07:46.895 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.896 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.896 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.896 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.814132+0000", 2023-10-08T07:07:46.896 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.896 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.896 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.896 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.814133+0000", 2023-10-08T07:07:46.897 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6099999999999999e-07 2023-10-08T07:07:46.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.897 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.897 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.897 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.814145+0000", 2023-10-08T07:07:46.897 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1899000000000001e-05 2023-10-08T07:07:46.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.897 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.897 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.897 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.814159+0000", 2023-10-08T07:07:46.897 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3691e-05 2023-10-08T07:07:46.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.898 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.898 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.898 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.814166+0000", 2023-10-08T07:07:46.898 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3089999999999998e-06 2023-10-08T07:07:46.898 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.898 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.898 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.899 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.899 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172618 4.c 4.ccc34acc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.899 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.823846+0000", 2023-10-08T07:07:46.899 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.014897713, 2023-10-08T07:07:46.899 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015346165, 2023-10-08T07:07:46.899 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.899 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:46.899 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.899 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.900 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.900 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172618 2023-10-08T07:07:46.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.900 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.900 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.900 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.900 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823846+0000", 2023-10-08T07:07:46.900 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.901 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.901 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823846+0000", 2023-10-08T07:07:46.901 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.901 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.901 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823847+0000", 2023-10-08T07:07:46.901 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7999999999999996e-07 2023-10-08T07:07:46.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.902 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.902 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823857+0000", 2023-10-08T07:07:46.902 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0183999999999999e-05 2023-10-08T07:07:46.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.902 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.902 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.902 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823864+0000", 2023-10-08T07:07:46.902 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2189999999999998e-06 2023-10-08T07:07:46.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.903 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.903 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.903 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823870+0000", 2023-10-08T07:07:46.903 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4009999999999996e-06 2023-10-08T07:07:46.903 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.903 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.903 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.903 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.903 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172535 4.20 4:05b3915c:::10000000004.00000016:head [write 2252800~4096 in=4096b,write 2273280~4096 in=4096b,write 2416640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.800918+0000", 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.037826158999999998, 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.038311284000000001, 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172535 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.904 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.800918+0000", 2023-10-08T07:07:46.905 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.905 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.800918+0000", 2023-10-08T07:07:46.905 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.905 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.800918+0000", 2023-10-08T07:07:46.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:07:46.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.906 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.906 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.906 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.800932+0000", 2023-10-08T07:07:46.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3551e-05 2023-10-08T07:07:46.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.906 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.906 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.906 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.800941+0000", 2023-10-08T07:07:46.907 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0389999999999993e-06 2023-10-08T07:07:46.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.907 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.907 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.907 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.800947+0000", 2023-10-08T07:07:46.907 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.285e-06 2023-10-08T07:07:46.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.907 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.908 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.908 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.829974+0000", 2023-10-08T07:07:46.908 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.029026798999999999 2023-10-08T07:07:46.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.908 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.908 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.908 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830063+0000", 2023-10-08T07:07:46.908 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9251000000000003e-05 2023-10-08T07:07:46.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.908 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.909 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:46.909 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830248+0000", 2023-10-08T07:07:46.909 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018482500000000001 2023-10-08T07:07:46.909 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.909 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.909 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.909 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.909 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172624 4.c 4.8681478c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.910 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.826633+0000", 2023-10-08T07:07:46.910 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.012110833, 2023-10-08T07:07:46.910 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012636517999999999, 2023-10-08T07:07:46.910 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.910 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:46.910 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.910 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.910 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.910 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172624 2023-10-08T07:07:46.910 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.910 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.911 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.911 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.911 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826633+0000", 2023-10-08T07:07:46.911 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.911 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.911 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.911 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826633+0000", 2023-10-08T07:07:46.911 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.912 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.912 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826634+0000", 2023-10-08T07:07:46.912 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.328e-06 2023-10-08T07:07:46.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.912 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.912 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826655+0000", 2023-10-08T07:07:46.912 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0557999999999999e-05 2023-10-08T07:07:46.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.913 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.913 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826666+0000", 2023-10-08T07:07:46.913 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0900000000000001e-05 2023-10-08T07:07:46.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.913 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.913 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.913 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826674+0000", 2023-10-08T07:07:46.913 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0919999999999998e-06 2023-10-08T07:07:46.914 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.914 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.914 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.914 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.914 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172460 4.2a 4:5404a18c:::10000000004.00000025:head [write 1507328~4096 in=4096b,write 1605632~4096 in=4096b,write 1896448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.914 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.779442+0000", 2023-10-08T07:07:46.914 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.059301824000000003, 2023-10-08T07:07:46.914 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.059862284000000002, 2023-10-08T07:07:46.914 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.915 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:46.915 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.915 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.915 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.915 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172460 2023-10-08T07:07:46.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.915 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.915 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.915 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.915 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.779442+0000", 2023-10-08T07:07:46.915 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.916 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.779442+0000", 2023-10-08T07:07:46.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.916 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.916 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.916 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.779443+0000", 2023-10-08T07:07:46.916 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1629999999999999e-06 2023-10-08T07:07:46.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.779459+0000", 2023-10-08T07:07:46.917 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5625e-05 2023-10-08T07:07:46.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.917 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.917 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.779472+0000", 2023-10-08T07:07:46.917 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3226e-05 2023-10-08T07:07:46.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.918 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.918 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.918 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.779481+0000", 2023-10-08T07:07:46.918 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7450000000000001e-06 2023-10-08T07:07:46.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.918 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.918 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.918 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.812970+0000", 2023-10-08T07:07:46.918 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033489486999999998 2023-10-08T07:07:46.919 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.919 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.919 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.919 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813034+0000", 2023-10-08T07:07:46.919 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3547000000000007e-05 2023-10-08T07:07:46.919 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.919 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.919 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.919 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.919 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.919 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172536 4.20 4:05b3915c:::10000000004.00000016:head [write 2637824~4096 in=4096b,write 2916352~4096 in=4096b,write 3100672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.920 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.801177+0000", 2023-10-08T07:07:46.920 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.037566956999999998, 2023-10-08T07:07:46.920 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.038243539999999999, 2023-10-08T07:07:46.920 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.920 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:46.920 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.920 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.920 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.920 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172536 2023-10-08T07:07:46.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.921 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.921 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.921 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.801177+0000", 2023-10-08T07:07:46.921 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.921 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.921 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.921 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.801177+0000", 2023-10-08T07:07:46.921 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.922 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.922 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.801178+0000", 2023-10-08T07:07:46.922 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7599999999999997e-07 2023-10-08T07:07:46.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.922 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.922 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.922 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.801193+0000", 2023-10-08T07:07:46.923 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.573e-05 2023-10-08T07:07:46.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.923 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.923 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.801202+0000", 2023-10-08T07:07:46.923 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3520000000000007e-06 2023-10-08T07:07:46.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.923 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.923 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.801208+0000", 2023-10-08T07:07:46.924 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0290000000000002e-06 2023-10-08T07:07:46.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.836359+0000", 2023-10-08T07:07:46.924 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035151611999999999 2023-10-08T07:07:46.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.924 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.924 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.924 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.836452+0000", 2023-10-08T07:07:46.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2434000000000003e-05 2023-10-08T07:07:46.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.925 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.925 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:46.925 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.836659+0000", 2023-10-08T07:07:46.925 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020757100000000001 2023-10-08T07:07:46.925 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.925 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.925 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.926 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.926 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172627 4.c 4.ccc34acc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.926 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.826688+0000", 2023-10-08T07:07:46.926 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.012055649999999999, 2023-10-08T07:07:46.926 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012789978, 2023-10-08T07:07:46.926 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.926 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:46.927 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.927 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.927 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.927 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172627 2023-10-08T07:07:46.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.927 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.927 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826688+0000", 2023-10-08T07:07:46.928 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.928 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826688+0000", 2023-10-08T07:07:46.928 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.928 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.928 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826689+0000", 2023-10-08T07:07:46.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.13e-07 2023-10-08T07:07:46.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.929 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.929 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826701+0000", 2023-10-08T07:07:46.929 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2156e-05 2023-10-08T07:07:46.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.929 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.929 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826710+0000", 2023-10-08T07:07:46.930 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5030000000000003e-06 2023-10-08T07:07:46.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.930 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.930 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.930 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826717+0000", 2023-10-08T07:07:46.930 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4219999999999997e-06 2023-10-08T07:07:46.930 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.930 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.930 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.931 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.931 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172495 4.30 4:0f322a22:::10000000004.00000014:head [write 3809280~8192 in=8192b,write 4141056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.931 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.789427+0000", 2023-10-08T07:07:46.931 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.049317064000000001, 2023-10-08T07:07:46.931 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050090203, 2023-10-08T07:07:46.931 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.931 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:46.931 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.931 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.932 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.932 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172495 2023-10-08T07:07:46.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.932 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.932 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.932 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789427+0000", 2023-10-08T07:07:46.932 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789427+0000", 2023-10-08T07:07:46.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.933 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789427+0000", 2023-10-08T07:07:46.933 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9999999999999998e-07 2023-10-08T07:07:46.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.933 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.934 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789439+0000", 2023-10-08T07:07:46.934 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1868999999999999e-05 2023-10-08T07:07:46.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.934 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.934 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.934 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789447+0000", 2023-10-08T07:07:46.934 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3810000000000001e-06 2023-10-08T07:07:46.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.935 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.935 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.935 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789452+0000", 2023-10-08T07:07:46.935 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-06 2023-10-08T07:07:46.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.935 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.935 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.935 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822095+0000", 2023-10-08T07:07:46.935 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032642749999999998 2023-10-08T07:07:46.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.936 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.936 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.936 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822174+0000", 2023-10-08T07:07:46.936 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8419999999999998e-05 2023-10-08T07:07:46.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.936 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.936 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:46.936 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822350+0000", 2023-10-08T07:07:46.936 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017666900000000001 2023-10-08T07:07:46.936 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.936 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.937 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.937 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.937 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172537 4.20 4:04004f2c:::10000000004.0000000d:head [write 1642496~4096 in=4096b,write 1900544~4096 in=4096b,write 2002944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.937 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.801453+0000", 2023-10-08T07:07:46.937 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.037290816999999997, 2023-10-08T07:07:46.937 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.038112080999999999, 2023-10-08T07:07:46.937 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.937 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:46.938 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.938 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.938 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.938 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172537 2023-10-08T07:07:46.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.938 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.938 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.938 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.938 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.801453+0000", 2023-10-08T07:07:46.939 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.939 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.939 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.939 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.801453+0000", 2023-10-08T07:07:46.939 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.939 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.940 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.940 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.801454+0000", 2023-10-08T07:07:46.940 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2600000000000002e-07 2023-10-08T07:07:46.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.940 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.940 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.801467+0000", 2023-10-08T07:07:46.940 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2999999999999999e-05 2023-10-08T07:07:46.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.941 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.941 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.801475+0000", 2023-10-08T07:07:46.941 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8099999999999998e-06 2023-10-08T07:07:46.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.941 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.941 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.941 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.801480+0000", 2023-10-08T07:07:46.941 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.699e-06 2023-10-08T07:07:46.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.942 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.942 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.942 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.839339+0000", 2023-10-08T07:07:46.942 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.037858726000000002 2023-10-08T07:07:46.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.942 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.942 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.942 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.839421+0000", 2023-10-08T07:07:46.942 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1959000000000006e-05 2023-10-08T07:07:46.943 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.943 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.943 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.943 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.943 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172628 4.2b 4:d776c1c9:::10000000004.0000003d:head [write 647168~4096 in=4096b,write 675840~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.943 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.826728+0000", 2023-10-08T07:07:46.943 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.012016275, 2023-10-08T07:07:46.943 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012940755, 2023-10-08T07:07:46.943 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.944 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:46.944 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.944 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.944 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.945 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172628 2023-10-08T07:07:46.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.945 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.945 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.945 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.945 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826728+0000", 2023-10-08T07:07:46.945 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.946 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826728+0000", 2023-10-08T07:07:46.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.946 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826728+0000", 2023-10-08T07:07:46.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1799999999999995e-07 2023-10-08T07:07:46.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.947 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826738+0000", 2023-10-08T07:07:46.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8830000000000001e-06 2023-10-08T07:07:46.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.947 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826746+0000", 2023-10-08T07:07:46.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9079999999999995e-06 2023-10-08T07:07:46.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.948 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.948 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.948 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826752+0000", 2023-10-08T07:07:46.948 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8560000000000003e-06 2023-10-08T07:07:46.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.948 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.948 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.948 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830408+0000", 2023-10-08T07:07:46.948 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0036558519999999998 2023-10-08T07:07:46.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.949 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830489+0000", 2023-10-08T07:07:46.949 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0885999999999998e-05 2023-10-08T07:07:46.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.949 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:46.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830623+0000", 2023-10-08T07:07:46.949 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013469999999999999 2023-10-08T07:07:46.949 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.949 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.950 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.950 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.950 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172497 4.30 4:0f322a22:::10000000004.00000014:head [write 2621440~4096 in=4096b,write 2707456~4096 in=4096b,write 2859008~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.950 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.789462+0000", 2023-10-08T07:07:46.950 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.049281881, 2023-10-08T07:07:46.950 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050292816999999997, 2023-10-08T07:07:46.950 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.950 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:46.950 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.951 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.951 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.951 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172497 2023-10-08T07:07:46.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.951 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.951 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.951 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.951 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789462+0000", 2023-10-08T07:07:46.951 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.952 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.952 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.952 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789462+0000", 2023-10-08T07:07:46.952 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.952 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.952 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.952 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789463+0000", 2023-10-08T07:07:46.952 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3099999999999998e-07 2023-10-08T07:07:46.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.952 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789473+0000", 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0467e-05 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789480+0000", 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7220000000000002e-06 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789485+0000", 2023-10-08T07:07:46.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5060000000000003e-06 2023-10-08T07:07:46.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.954 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.954 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.824742+0000", 2023-10-08T07:07:46.954 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035256414 2023-10-08T07:07:46.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.954 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.954 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.824815+0000", 2023-10-08T07:07:46.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3588000000000001e-05 2023-10-08T07:07:46.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.955 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.955 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:46.955 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.824954+0000", 2023-10-08T07:07:46.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000139018 2023-10-08T07:07:46.955 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.955 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.955 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.956 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172629 4.20 4.1c14eae0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.956 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.826761+0000", 2023-10-08T07:07:46.956 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.011983216, 2023-10-08T07:07:46.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013080441999999999, 2023-10-08T07:07:46.956 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.956 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:46.956 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.956 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.956 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172629 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826761+0000", 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826761+0000", 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.958 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826761+0000", 2023-10-08T07:07:46.958 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2899999999999999e-07 2023-10-08T07:07:46.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.958 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826771+0000", 2023-10-08T07:07:46.958 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0319999999999999e-05 2023-10-08T07:07:46.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.959 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826780+0000", 2023-10-08T07:07:46.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4710000000000007e-06 2023-10-08T07:07:46.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.959 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.959 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.959 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826786+0000", 2023-10-08T07:07:46.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.66e-06 2023-10-08T07:07:46.959 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.959 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.960 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.960 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172541 4.2c 4:352c144c:::10000000004.00000003:head [write 3584000~4096 in=4096b,write 3813376~4096 in=4096b,write 3846144~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.960 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.804242+0000", 2023-10-08T07:07:46.960 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.034502315999999998, 2023-10-08T07:07:46.960 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035669118999999999, 2023-10-08T07:07:46.960 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.960 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:46.960 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.960 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.960 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.961 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172541 2023-10-08T07:07:46.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.961 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804242+0000", 2023-10-08T07:07:46.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804242+0000", 2023-10-08T07:07:46.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804243+0000", 2023-10-08T07:07:46.962 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.265e-06 2023-10-08T07:07:46.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804259+0000", 2023-10-08T07:07:46.962 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.607e-05 2023-10-08T07:07:46.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804270+0000", 2023-10-08T07:07:46.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1205e-05 2023-10-08T07:07:46.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804279+0000", 2023-10-08T07:07:46.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5140000000000001e-06 2023-10-08T07:07:46.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822392+0000", 2023-10-08T07:07:46.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018112998000000002 2023-10-08T07:07:46.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.964 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822475+0000", 2023-10-08T07:07:46.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3237000000000003e-05 2023-10-08T07:07:46.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.964 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:46.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822636+0000", 2023-10-08T07:07:46.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016098499999999999 2023-10-08T07:07:46.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:46.965 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.829919+0000", 2023-10-08T07:07:46.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0072833189999999999 2023-10-08T07:07:46.965 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.965 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.965 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.965 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172585 4.3a 4.f030edfa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.965 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.814919+0000", 2023-10-08T07:07:46.965 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0238254, 2023-10-08T07:07:46.966 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.025083289000000002, 2023-10-08T07:07:46.966 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.966 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:46.966 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.966 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.966 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.966 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172585 2023-10-08T07:07:46.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.966 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.966 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.966 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.966 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.814919+0000", 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.814919+0000", 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.814919+0000", 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.967 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.968 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.968 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.814937+0000", 2023-10-08T07:07:46.968 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7322000000000001e-05 2023-10-08T07:07:46.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.968 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.968 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.814947+0000", 2023-10-08T07:07:46.969 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0642000000000001e-05 2023-10-08T07:07:46.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.969 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.969 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.969 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.814955+0000", 2023-10-08T07:07:46.969 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5159999999999997e-06 2023-10-08T07:07:46.969 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.969 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.969 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.969 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.969 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172543 4.3a 4:5f183e4b:::10000000004.00000023:head [write 806912~4096 in=4096b,write 1040384~4096 in=4096b,write 1077248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.970 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.804293+0000", 2023-10-08T07:07:46.970 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.034450768, 2023-10-08T07:07:46.970 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035796287000000003, 2023-10-08T07:07:46.970 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.970 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:46.970 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.970 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.970 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.970 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172543 2023-10-08T07:07:46.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.970 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.970 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804293+0000", 2023-10-08T07:07:46.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804293+0000", 2023-10-08T07:07:46.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804294+0000", 2023-10-08T07:07:46.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2200000000000004e-07 2023-10-08T07:07:46.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.972 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804306+0000", 2023-10-08T07:07:46.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2334000000000001e-05 2023-10-08T07:07:46.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.972 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804316+0000", 2023-10-08T07:07:46.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5589999999999994e-06 2023-10-08T07:07:46.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.973 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804322+0000", 2023-10-08T07:07:46.973 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2770000000000002e-06 2023-10-08T07:07:46.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.973 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.837835+0000", 2023-10-08T07:07:46.973 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033513426999999998 2023-10-08T07:07:46.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.974 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.837933+0000", 2023-10-08T07:07:46.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7953000000000002e-05 2023-10-08T07:07:46.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.974 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.974 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:46.974 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.838085+0000", 2023-10-08T07:07:46.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000151965 2023-10-08T07:07:46.974 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.974 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.974 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.975 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172589 4.24 4:25ba01c5:::10000000004.00000035:head [write 2621440~4096 in=4096b,write 2666496~4096 in=4096b,write 2748416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.975 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.815882+0000", 2023-10-08T07:07:46.975 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.022861532, 2023-10-08T07:07:46.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024314671999999999, 2023-10-08T07:07:46.975 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.975 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:46.975 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.975 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.975 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.976 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172589 2023-10-08T07:07:46.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.976 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.815882+0000", 2023-10-08T07:07:46.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.815882+0000", 2023-10-08T07:07:46.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.815883+0000", 2023-10-08T07:07:46.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0100000000000003e-07 2023-10-08T07:07:46.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.815897+0000", 2023-10-08T07:07:46.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3818000000000001e-05 2023-10-08T07:07:46.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.815912+0000", 2023-10-08T07:07:46.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4932e-05 2023-10-08T07:07:46.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.815921+0000", 2023-10-08T07:07:46.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8259999999999999e-06 2023-10-08T07:07:46.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.831768+0000", 2023-10-08T07:07:46.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015846902 2023-10-08T07:07:46.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.831819+0000", 2023-10-08T07:07:46.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0971999999999999e-05 2023-10-08T07:07:46.980 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.980 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.980 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.980 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.980 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172631 4.20 4.34f20020 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.980 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.827393+0000", 2023-10-08T07:07:46.980 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.011351073999999999, 2023-10-08T07:07:46.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012870369, 2023-10-08T07:07:46.980 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.981 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:46.981 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.981 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.981 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.981 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172631 2023-10-08T07:07:46.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.981 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.981 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.981 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.981 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827393+0000", 2023-10-08T07:07:46.981 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827393+0000", 2023-10-08T07:07:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827394+0000", 2023-10-08T07:07:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.85e-07 2023-10-08T07:07:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.982 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827409+0000", 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5681000000000001e-05 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827423+0000", 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.322e-05 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827431+0000", 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2530000000000004e-06 2023-10-08T07:07:46.983 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172467 4.20 4:05b3915c:::10000000004.00000016:head [write 1130496~4096 in=4096b,write 1138688~4096 in=4096b,write 1187840~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.780347+0000", 2023-10-08T07:07:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.058396917999999999, 2023-10-08T07:07:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.059963483999999997, 2023-10-08T07:07:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.985 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.985 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172467 2023-10-08T07:07:46.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.985 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.985 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.985 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.780347+0000", 2023-10-08T07:07:46.985 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.780347+0000", 2023-10-08T07:07:46.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.780348+0000", 2023-10-08T07:07:46.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6099999999999999e-07 2023-10-08T07:07:46.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.987 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.987 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.987 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.780360+0000", 2023-10-08T07:07:46.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2383e-05 2023-10-08T07:07:46.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.987 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.987 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.987 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.780373+0000", 2023-10-08T07:07:46.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2926e-05 2023-10-08T07:07:46.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.987 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.780382+0000", 2023-10-08T07:07:46.988 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6589999999999996e-06 2023-10-08T07:07:46.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805737+0000", 2023-10-08T07:07:46.988 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.025354923000000001 2023-10-08T07:07:46.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805842+0000", 2023-10-08T07:07:46.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000105406 2023-10-08T07:07:46.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:46.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805986+0000", 2023-10-08T07:07:46.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0001439 2023-10-08T07:07:46.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:46.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826345+0000", 2023-10-08T07:07:46.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020358679000000001 2023-10-08T07:07:46.989 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.990 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.990 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.990 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172547 4.2b 4:d7a77d67:::10000000004.00000029:head [write 1474560~4096 in=4096b,write 1503232~4096 in=4096b,write 1675264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.990 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.804331+0000", 2023-10-08T07:07:46.990 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.034412705000000002, 2023-10-08T07:07:46.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.036041391999999998, 2023-10-08T07:07:46.990 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.990 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:46.990 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.990 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172547 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804331+0000", 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804331+0000", 2023-10-08T07:07:46.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804332+0000", 2023-10-08T07:07:46.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5900000000000002e-07 2023-10-08T07:07:46.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804342+0000", 2023-10-08T07:07:46.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0390999999999999e-05 2023-10-08T07:07:46.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804350+0000", 2023-10-08T07:07:46.994 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5120000000000002e-06 2023-10-08T07:07:46.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:46.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.804357+0000", 2023-10-08T07:07:46.994 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.345e-06 2023-10-08T07:07:46.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.816451+0000", 2023-10-08T07:07:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012093757 2023-10-08T07:07:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.816504+0000", 2023-10-08T07:07:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2933999999999998e-05 2023-10-08T07:07:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.816606+0000", 2023-10-08T07:07:46.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00010244299999999999 2023-10-08T07:07:46.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.996 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:46.996 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.837774+0000", 2023-10-08T07:07:46.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021167957000000001 2023-10-08T07:07:46.996 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.996 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:46.996 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:46.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.996 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172590 4.2b 4:d7a77d67:::10000000004.00000029:head [write 3919872~4096 in=4096b,write 3944448~4096 in=4096b,write 4112384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:46.997 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.816214+0000", 2023-10-08T07:07:46.997 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.022530250000000002, 2023-10-08T07:07:46.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024283285000000002, 2023-10-08T07:07:46.997 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:46.997 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:46.997 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:46.997 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:46.997 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:46.997 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172590 2023-10-08T07:07:46.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.997 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:46.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.998 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:46.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.816214+0000", 2023-10-08T07:07:46.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.998 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.998 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:46.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.816214+0000", 2023-10-08T07:07:46.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:46.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.998 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.998 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:46.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.816215+0000", 2023-10-08T07:07:46.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2200000000000003e-07 2023-10-08T07:07:46.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:46.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.816226+0000", 2023-10-08T07:07:46.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1482e-05 2023-10-08T07:07:46.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:46.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:46.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:46.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.816237+0000", 2023-10-08T07:07:46.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.076e-05 2023-10-08T07:07:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.816244+0000", 2023-10-08T07:07:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4819999999999997e-06 2023-10-08T07:07:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821489+0000", 2023-10-08T07:07:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0052447149999999996 2023-10-08T07:07:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821574+0000", 2023-10-08T07:07:47.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4866999999999999e-05 2023-10-08T07:07:47.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821744+0000", 2023-10-08T07:07:47.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016992600000000001 2023-10-08T07:07:47.001 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.001 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.001 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.002 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172633 4.1a 4.5c1f9a5a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.002 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.827928+0000", 2023-10-08T07:07:47.002 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.010815938000000001, 2023-10-08T07:07:47.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012671160000000001, 2023-10-08T07:07:47.002 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.002 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.002 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.002 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.002 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.002 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172633 2023-10-08T07:07:47.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.003 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827928+0000", 2023-10-08T07:07:47.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827928+0000", 2023-10-08T07:07:47.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.004 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.004 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827929+0000", 2023-10-08T07:07:47.004 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7199999999999998e-07 2023-10-08T07:07:47.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.004 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.004 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827957+0000", 2023-10-08T07:07:47.004 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.8549999999999999e-05 2023-10-08T07:07:47.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827969+0000", 2023-10-08T07:07:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1277000000000001e-05 2023-10-08T07:07:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827975+0000", 2023-10-08T07:07:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8430000000000004e-06 2023-10-08T07:07:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.006 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172551 4.2b 4:d7a77d67:::10000000004.00000029:head [write 3072000~4096 in=4096b,write 3100672~4096 in=4096b,write 3190784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.006 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.805502+0000", 2023-10-08T07:07:47.006 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.033241604000000001, 2023-10-08T07:07:47.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035171454999999997, 2023-10-08T07:07:47.006 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.006 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.006 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.006 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.006 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.006 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172551 2023-10-08T07:07:47.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.007 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.007 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.007 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.007 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805502+0000", 2023-10-08T07:07:47.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.007 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.007 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.007 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805502+0000", 2023-10-08T07:07:47.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.008 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805503+0000", 2023-10-08T07:07:47.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3399999999999998e-07 2023-10-08T07:07:47.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.008 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805516+0000", 2023-10-08T07:07:47.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2547e-05 2023-10-08T07:07:47.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805529+0000", 2023-10-08T07:07:47.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.328e-05 2023-10-08T07:07:47.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805536+0000", 2023-10-08T07:07:47.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.469e-06 2023-10-08T07:07:47.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818584+0000", 2023-10-08T07:07:47.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013047491 2023-10-08T07:07:47.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818665+0000", 2023-10-08T07:07:47.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0861999999999999e-05 2023-10-08T07:07:47.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818861+0000", 2023-10-08T07:07:47.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000196369 2023-10-08T07:07:47.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.837906+0000", 2023-10-08T07:07:47.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019045164999999999 2023-10-08T07:07:47.011 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.011 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.011 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.011 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172634 4.30 4.44544cf0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.012 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.828196+0000", 2023-10-08T07:07:47.012 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.010547512, 2023-10-08T07:07:47.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012573318999999999, 2023-10-08T07:07:47.012 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.012 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.012 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.012 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.012 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.012 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172634 2023-10-08T07:07:47.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.012 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.828196+0000", 2023-10-08T07:07:47.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.828196+0000", 2023-10-08T07:07:47.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.828197+0000", 2023-10-08T07:07:47.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3099999999999997e-07 2023-10-08T07:07:47.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.828230+0000", 2023-10-08T07:07:47.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3404000000000001e-05 2023-10-08T07:07:47.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.828242+0000", 2023-10-08T07:07:47.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1497e-05 2023-10-08T07:07:47.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.015 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.015 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.828248+0000", 2023-10-08T07:07:47.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.409e-06 2023-10-08T07:07:47.015 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.015 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.015 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.015 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172470 4.20 4:05b3915c:::10000000004.00000016:head [write 1200128~4096 in=4096b,write 1552384~4096 in=4096b,write 1687552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.015 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.781147+0000", 2023-10-08T07:07:47.016 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.057596908000000002, 2023-10-08T07:07:47.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.059702053999999997, 2023-10-08T07:07:47.016 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.016 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.016 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.016 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.016 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.016 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172470 2023-10-08T07:07:47.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.017 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.781147+0000", 2023-10-08T07:07:47.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.781147+0000", 2023-10-08T07:07:47.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.781148+0000", 2023-10-08T07:07:47.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1500000000000003e-07 2023-10-08T07:07:47.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.781161+0000", 2023-10-08T07:07:47.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3050999999999999e-05 2023-10-08T07:07:47.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.781173+0000", 2023-10-08T07:07:47.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1729000000000001e-05 2023-10-08T07:07:47.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.781193+0000", 2023-10-08T07:07:47.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0369000000000001e-05 2023-10-08T07:07:47.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.810452+0000", 2023-10-08T07:07:47.021 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.029258703 2023-10-08T07:07:47.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.022 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.810539+0000", 2023-10-08T07:07:47.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7447000000000005e-05 2023-10-08T07:07:47.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.022 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.022 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.810729+0000", 2023-10-08T07:07:47.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018946300000000001 2023-10-08T07:07:47.022 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.022 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.022 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.023 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172552 4.32 4:4efc9492:::10000000004.00000032:head [write 1765376~4096 in=4096b,write 1777664~4096 in=4096b,write 1929216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.023 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.805766+0000", 2023-10-08T07:07:47.023 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.032978154000000003, 2023-10-08T07:07:47.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035178902999999997, 2023-10-08T07:07:47.023 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.023 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.023 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.023 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.023 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.023 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172552 2023-10-08T07:07:47.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.024 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805766+0000", 2023-10-08T07:07:47.024 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805766+0000", 2023-10-08T07:07:47.024 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805767+0000", 2023-10-08T07:07:47.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6599999999999995e-07 2023-10-08T07:07:47.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805782+0000", 2023-10-08T07:07:47.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.504e-05 2023-10-08T07:07:47.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805791+0000", 2023-10-08T07:07:47.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2639999999999997e-06 2023-10-08T07:07:47.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.026 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805798+0000", 2023-10-08T07:07:47.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2710000000000003e-06 2023-10-08T07:07:47.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.026 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.837945+0000", 2023-10-08T07:07:47.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032147215 2023-10-08T07:07:47.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.027 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.027 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.838038+0000", 2023-10-08T07:07:47.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2708999999999996e-05 2023-10-08T07:07:47.027 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.027 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.027 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.027 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172598 4.32 4.49293f72 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.027 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.818306+0000", 2023-10-08T07:07:47.028 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.020437904999999999, 2023-10-08T07:07:47.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022719203, 2023-10-08T07:07:47.028 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.028 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.028 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.028 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.028 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.028 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172598 2023-10-08T07:07:47.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.028 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818306+0000", 2023-10-08T07:07:47.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818306+0000", 2023-10-08T07:07:47.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.030 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818307+0000", 2023-10-08T07:07:47.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8200000000000008e-07 2023-10-08T07:07:47.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.030 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.030 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818320+0000", 2023-10-08T07:07:47.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3074999999999999e-05 2023-10-08T07:07:47.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.030 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.030 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818331+0000", 2023-10-08T07:07:47.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1123e-05 2023-10-08T07:07:47.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.031 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.031 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818339+0000", 2023-10-08T07:07:47.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3900000000000004e-06 2023-10-08T07:07:47.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.031 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.031 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172635 4.c 4.8681478c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.032 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.828480+0000", 2023-10-08T07:07:47.032 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.01026386, 2023-10-08T07:07:47.032 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012603375999999999, 2023-10-08T07:07:47.032 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.032 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.032 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.032 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.032 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.032 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172635 2023-10-08T07:07:47.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.032 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.828480+0000", 2023-10-08T07:07:47.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.828480+0000", 2023-10-08T07:07:47.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.828481+0000", 2023-10-08T07:07:47.034 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.06e-07 2023-10-08T07:07:47.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.034 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.828525+0000", 2023-10-08T07:07:47.034 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.456e-05 2023-10-08T07:07:47.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.034 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.828536+0000", 2023-10-08T07:07:47.034 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0631999999999999e-05 2023-10-08T07:07:47.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.828543+0000", 2023-10-08T07:07:47.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3590000000000002e-06 2023-10-08T07:07:47.035 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.035 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.035 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.035 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172599 4.30 4:0f322a22:::10000000004.00000014:head [write 266240~4096 in=4096b,write 286720~4096 in=4096b,write 335872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.818543+0000", 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.020200597000000001, 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022601944999999998, 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172599 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.036 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818543+0000", 2023-10-08T07:07:47.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.037 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.037 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818543+0000", 2023-10-08T07:07:47.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.037 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.037 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818544+0000", 2023-10-08T07:07:47.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2500000000000004e-07 2023-10-08T07:07:47.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.038 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.038 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818558+0000", 2023-10-08T07:07:47.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3404000000000001e-05 2023-10-08T07:07:47.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.038 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.038 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818569+0000", 2023-10-08T07:07:47.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1644000000000001e-05 2023-10-08T07:07:47.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.039 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.039 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818577+0000", 2023-10-08T07:07:47.039 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8909999999999995e-06 2023-10-08T07:07:47.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.039 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.039 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.839320+0000", 2023-10-08T07:07:47.039 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020743277000000001 2023-10-08T07:07:47.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.039 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.040 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.839396+0000", 2023-10-08T07:07:47.040 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5678000000000003e-05 2023-10-08T07:07:47.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.040 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.040 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.040 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.839540+0000", 2023-10-08T07:07:47.040 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014375499999999999 2023-10-08T07:07:47.040 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.040 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.040 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.040 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.041 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172553 4.1a 4:5a59f83a:::10000000004.00000002:head [write 1138688~4096 in=4096b,write 1146880~4096 in=4096b,write 1200128~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.041 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.806069+0000", 2023-10-08T07:07:47.041 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.032674781999999999, 2023-10-08T07:07:47.041 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.035162915000000003, 2023-10-08T07:07:47.042 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.042 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.042 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.042 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.042 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.042 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172553 2023-10-08T07:07:47.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.042 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.806069+0000", 2023-10-08T07:07:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.806069+0000", 2023-10-08T07:07:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.806070+0000", 2023-10-08T07:07:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.806081+0000", 2023-10-08T07:07:47.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1493e-05 2023-10-08T07:07:47.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.806091+0000", 2023-10-08T07:07:47.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8840000000000006e-06 2023-10-08T07:07:47.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.045 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.806099+0000", 2023-10-08T07:07:47.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3309999999999998e-06 2023-10-08T07:07:47.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.045 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.840503+0000", 2023-10-08T07:07:47.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.034403815999999997 2023-10-08T07:07:47.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.045 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.840587+0000", 2023-10-08T07:07:47.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4538999999999998e-05 2023-10-08T07:07:47.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.046 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.046 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.046 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.840744+0000", 2023-10-08T07:07:47.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015660199999999999 2023-10-08T07:07:47.046 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.046 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.046 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.046 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172559 4.32 4:4efc9492:::10000000004.00000032:head [write 3448832~4096 in=4096b,write 3592192~4096 in=4096b,write 3715072~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.807647+0000", 2023-10-08T07:07:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.031097046, 2023-10-08T07:07:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033668791000000003, 2023-10-08T07:07:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172559 2023-10-08T07:07:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.047 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.048 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.048 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.807647+0000", 2023-10-08T07:07:47.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.048 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.048 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.807647+0000", 2023-10-08T07:07:47.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.048 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.807648+0000", 2023-10-08T07:07:47.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.175e-06 2023-10-08T07:07:47.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.807665+0000", 2023-10-08T07:07:47.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7039000000000001e-05 2023-10-08T07:07:47.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.807680+0000", 2023-10-08T07:07:47.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.535e-05 2023-10-08T07:07:47.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.807690+0000", 2023-10-08T07:07:47.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0990000000000005e-06 2023-10-08T07:07:47.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.840707+0000", 2023-10-08T07:07:47.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033017765999999997 2023-10-08T07:07:47.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.840789+0000", 2023-10-08T07:07:47.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2154e-05 2023-10-08T07:07:47.052 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.052 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.052 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.052 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172503 4.c 4:31e28161:::10000000004.00000011:head [write 172032~4096 in=4096b,write 245760~4096 in=4096b,write 335872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.052 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.791255+0000", 2023-10-08T07:07:47.052 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.047488825999999998, 2023-10-08T07:07:47.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050138146000000001, 2023-10-08T07:07:47.052 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172503 2023-10-08T07:07:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.791255+0000", 2023-10-08T07:07:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.054 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.791255+0000", 2023-10-08T07:07:47.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.054 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.791256+0000", 2023-10-08T07:07:47.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8599999999999998e-07 2023-10-08T07:07:47.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.791264+0000", 2023-10-08T07:07:47.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2719999999999997e-06 2023-10-08T07:07:47.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.055 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.791273+0000", 2023-10-08T07:07:47.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.499e-06 2023-10-08T07:07:47.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.055 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.791279+0000", 2023-10-08T07:07:47.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3430000000000003e-06 2023-10-08T07:07:47.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.808044+0000", 2023-10-08T07:07:47.056 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016764955000000002 2023-10-08T07:07:47.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.808117+0000", 2023-10-08T07:07:47.056 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3674e-05 2023-10-08T07:07:47.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.808307+0000", 2023-10-08T07:07:47.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018954700000000001 2023-10-08T07:07:47.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.057 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822350+0000", 2023-10-08T07:07:47.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014043132 2023-10-08T07:07:47.057 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.057 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.057 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.058 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172602 4.3a 4.f030edfa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.058 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.819369+0000", 2023-10-08T07:07:47.058 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.019374855, 2023-10-08T07:07:47.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022104815999999999, 2023-10-08T07:07:47.058 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.058 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.058 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.058 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.058 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.059 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172602 2023-10-08T07:07:47.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.059 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819369+0000", 2023-10-08T07:07:47.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819369+0000", 2023-10-08T07:07:47.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.060 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.060 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819370+0000", 2023-10-08T07:07:47.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6300000000000004e-07 2023-10-08T07:07:47.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.060 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.060 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819381+0000", 2023-10-08T07:07:47.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.117e-05 2023-10-08T07:07:47.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819393+0000", 2023-10-08T07:07:47.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2452999999999999e-05 2023-10-08T07:07:47.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819402+0000", 2023-10-08T07:07:47.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.038e-06 2023-10-08T07:07:47.061 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.062 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.062 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.062 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172506 4.20 4:05b3915c:::10000000004.00000016:head [write 2973696~4096 in=4096b,write 3039232~12288 in=12288b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.062 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.792084+0000", 2023-10-08T07:07:47.062 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.046659881, 2023-10-08T07:07:47.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.049449580999999999, 2023-10-08T07:07:47.062 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.062 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.062 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.062 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.063 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.063 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172506 2023-10-08T07:07:47.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.063 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.792084+0000", 2023-10-08T07:07:47.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.792084+0000", 2023-10-08T07:07:47.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.064 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.792085+0000", 2023-10-08T07:07:47.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1399999999999997e-07 2023-10-08T07:07:47.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.064 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.792106+0000", 2023-10-08T07:07:47.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1114000000000001e-05 2023-10-08T07:07:47.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.065 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.065 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.792114+0000", 2023-10-08T07:07:47.065 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3000000000000002e-06 2023-10-08T07:07:47.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.065 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.065 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.792119+0000", 2023-10-08T07:07:47.065 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7330000000000003e-06 2023-10-08T07:07:47.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826389+0000", 2023-10-08T07:07:47.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.034270506999999999 2023-10-08T07:07:47.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826480+0000", 2023-10-08T07:07:47.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1071999999999998e-05 2023-10-08T07:07:47.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.067 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826649+0000", 2023-10-08T07:07:47.067 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000168472 2023-10-08T07:07:47.067 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.067 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.067 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.067 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.067 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172603 4.32 4.49293f72 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.067 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.819603+0000", 2023-10-08T07:07:47.067 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.019140893999999999, 2023-10-08T07:07:47.067 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022004280000000001, 2023-10-08T07:07:47.067 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.068 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.068 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.068 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.068 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.068 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172603 2023-10-08T07:07:47.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.068 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.068 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819603+0000", 2023-10-08T07:07:47.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819603+0000", 2023-10-08T07:07:47.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819604+0000", 2023-10-08T07:07:47.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9800000000000003e-07 2023-10-08T07:07:47.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819615+0000", 2023-10-08T07:07:47.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1822e-05 2023-10-08T07:07:47.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819626+0000", 2023-10-08T07:07:47.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0436e-05 2023-10-08T07:07:47.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819632+0000", 2023-10-08T07:07:47.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5520000000000001e-06 2023-10-08T07:07:47.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.071 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.071 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172605 4.2 4.508f73c2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.071 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.820117+0000", 2023-10-08T07:07:47.071 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.018627184000000001, 2023-10-08T07:07:47.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021544204000000001, 2023-10-08T07:07:47.072 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.072 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.072 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.072 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.072 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.072 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172605 2023-10-08T07:07:47.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.072 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.073 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.074 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.074 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820117+0000", 2023-10-08T07:07:47.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.074 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.074 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820117+0000", 2023-10-08T07:07:47.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820117+0000", 2023-10-08T07:07:47.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:07:47.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820131+0000", 2023-10-08T07:07:47.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3217999999999999e-05 2023-10-08T07:07:47.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820140+0000", 2023-10-08T07:07:47.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9380000000000004e-06 2023-10-08T07:07:47.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820147+0000", 2023-10-08T07:07:47.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:07:47.077 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.077 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.077 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.077 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:159190 4.16 e64/17 4:69eefec8:::10000000004.0000003a:head v 64'2443, mlcod=64'2440)", 2023-10-08T07:07:47.077 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.829298+0000", 2023-10-08T07:07:47.077 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0094458909999999997, 2023-10-08T07:07:47.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012422145000000001, 2023-10-08T07:07:47.077 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.829298+0000", 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.829298+0000", 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.829298+0000", 2023-10-08T07:07:47.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9600000000000001e-07 2023-10-08T07:07:47.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.080 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.081 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.829309+0000", 2023-10-08T07:07:47.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0513000000000001e-05 2023-10-08T07:07:47.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.081 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.081 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.829325+0000", 2023-10-08T07:07:47.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5945000000000001e-05 2023-10-08T07:07:47.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.081 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.081 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.829329+0000", 2023-10-08T07:07:47.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2640000000000002e-06 2023-10-08T07:07:47.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.829381+0000", 2023-10-08T07:07:47.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1578e-05 2023-10-08T07:07:47.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.829404+0000", 2023-10-08T07:07:47.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.3598999999999999e-05 2023-10-08T07:07:47.083 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.083 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.083 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.083 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172480 4.30 4:0f322a22:::10000000004.00000014:head [write 3366912~4096 in=4096b,write 3588096~4096 in=4096b,write 3661824~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.083 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.784336+0000", 2023-10-08T07:07:47.083 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.054408309000000002, 2023-10-08T07:07:47.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.057451015000000001, 2023-10-08T07:07:47.083 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.083 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.084 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.084 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.084 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.084 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172480 2023-10-08T07:07:47.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.084 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.784336+0000", 2023-10-08T07:07:47.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.784336+0000", 2023-10-08T07:07:47.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.784336+0000", 2023-10-08T07:07:47.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:07:47.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.784348+0000", 2023-10-08T07:07:47.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1225e-05 2023-10-08T07:07:47.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.784358+0000", 2023-10-08T07:07:47.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0135e-05 2023-10-08T07:07:47.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.087 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.784365+0000", 2023-10-08T07:07:47.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1829999999999997e-06 2023-10-08T07:07:47.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.087 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.087 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.087 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.812236+0000", 2023-10-08T07:07:47.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027871314000000001 2023-10-08T07:07:47.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.087 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.087 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.087 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.812311+0000", 2023-10-08T07:07:47.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4491000000000002e-05 2023-10-08T07:07:47.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.088 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.088 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.812410+0000", 2023-10-08T07:07:47.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9362000000000002e-05 2023-10-08T07:07:47.088 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.088 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.088 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.088 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172511 4.1a 4:5a59f83a:::10000000004.00000002:head [write 114688~4096 in=4096b,write 286720~4096 in=4096b,write 294912~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.089 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.793703+0000", 2023-10-08T07:07:47.089 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.045041171999999997, 2023-10-08T07:07:47.089 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.048161915, 2023-10-08T07:07:47.089 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.089 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.089 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.089 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.089 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.089 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172511 2023-10-08T07:07:47.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.089 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.793703+0000", 2023-10-08T07:07:47.090 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.090 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.793703+0000", 2023-10-08T07:07:47.090 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.090 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.091 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.793704+0000", 2023-10-08T07:07:47.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1820000000000001e-06 2023-10-08T07:07:47.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.091 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.091 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.793723+0000", 2023-10-08T07:07:47.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8626000000000001e-05 2023-10-08T07:07:47.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.091 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.091 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.793739+0000", 2023-10-08T07:07:47.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6201999999999998e-05 2023-10-08T07:07:47.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.793748+0000", 2023-10-08T07:07:47.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0860000000000008e-06 2023-10-08T07:07:47.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822470+0000", 2023-10-08T07:07:47.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.028722253 2023-10-08T07:07:47.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822561+0000", 2023-10-08T07:07:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1254000000000004e-05 2023-10-08T07:07:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822703+0000", 2023-10-08T07:07:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000141509 2023-10-08T07:07:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830131+0000", 2023-10-08T07:07:47.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0074277120000000004 2023-10-08T07:07:47.094 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.094 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.094 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.094 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172644 4.3a 4.7ab54aba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.094 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.832985+0000", 2023-10-08T07:07:47.094 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0057589390000000002, 2023-10-08T07:07:47.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089569230000000003, 2023-10-08T07:07:47.095 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.095 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.095 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.095 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.095 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.095 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172644 2023-10-08T07:07:47.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.095 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.832985+0000", 2023-10-08T07:07:47.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.832985+0000", 2023-10-08T07:07:47.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.832986+0000", 2023-10-08T07:07:47.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.243e-06 2023-10-08T07:07:47.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833001+0000", 2023-10-08T07:07:47.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.436e-05 2023-10-08T07:07:47.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833371+0000", 2023-10-08T07:07:47.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00037064200000000002 2023-10-08T07:07:47.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.098 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833382+0000", 2023-10-08T07:07:47.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0518e-05 2023-10-08T07:07:47.098 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.098 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.098 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.098 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172481 4.30 4:0f322a22:::10000000004.00000014:head [write 557056~4096 in=4096b,write 901120~4096 in=4096b,write 1032192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.098 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.784604+0000", 2023-10-08T07:07:47.098 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.054139897999999999, 2023-10-08T07:07:47.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.057398297000000001, 2023-10-08T07:07:47.098 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172481 2023-10-08T07:07:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.784604+0000", 2023-10-08T07:07:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.100 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.100 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.784604+0000", 2023-10-08T07:07:47.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.100 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.100 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.784605+0000", 2023-10-08T07:07:47.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9599999999999999e-07 2023-10-08T07:07:47.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.784618+0000", 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3118999999999999e-05 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.784625+0000", 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.542e-06 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.784630+0000", 2023-10-08T07:07:47.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7099999999999998e-06 2023-10-08T07:07:47.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818475+0000", 2023-10-08T07:07:47.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033845345999999998 2023-10-08T07:07:47.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818558+0000", 2023-10-08T07:07:47.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2803e-05 2023-10-08T07:07:47.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818652+0000", 2023-10-08T07:07:47.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4303999999999997e-05 2023-10-08T07:07:47.103 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.103 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.103 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.103 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172566 4.34 4:2dadb699:::10000000004.00000031:head [write 462848~4096 in=4096b,write 942080~4096 in=4096b,write 966656~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.103 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.809672+0000", 2023-10-08T07:07:47.103 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.029071474999999999, 2023-10-08T07:07:47.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032407283000000002, 2023-10-08T07:07:47.104 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.104 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.104 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.104 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.104 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.104 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172566 2023-10-08T07:07:47.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.104 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.809672+0000", 2023-10-08T07:07:47.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.809672+0000", 2023-10-08T07:07:47.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.809673+0000", 2023-10-08T07:07:47.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5199999999999997e-07 2023-10-08T07:07:47.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.809691+0000", 2023-10-08T07:07:47.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8420999999999999e-05 2023-10-08T07:07:47.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.809698+0000", 2023-10-08T07:07:47.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1029999999999998e-06 2023-10-08T07:07:47.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.107 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.107 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.809703+0000", 2023-10-08T07:07:47.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5230000000000003e-06 2023-10-08T07:07:47.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.107 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.107 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.824645+0000", 2023-10-08T07:07:47.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014941810999999999 2023-10-08T07:07:47.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.107 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.108 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.824735+0000", 2023-10-08T07:07:47.108 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9674999999999998e-05 2023-10-08T07:07:47.108 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.108 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.108 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.108 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.108 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172607 4.e 4:70352312:::10000000004.0000001a:head [write 1163264~4096 in=4096b,write 1187840~4096 in=4096b,write 1204224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.108 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.820604+0000", 2023-10-08T07:07:47.108 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.018139598, 2023-10-08T07:07:47.108 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021544891, 2023-10-08T07:07:47.109 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.109 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.109 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.109 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.109 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.109 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172607 2023-10-08T07:07:47.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.109 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.109 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820604+0000", 2023-10-08T07:07:47.109 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820604+0000", 2023-10-08T07:07:47.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820605+0000", 2023-10-08T07:07:47.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9599999999999998e-07 2023-10-08T07:07:47.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.111 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.111 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.111 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820622+0000", 2023-10-08T07:07:47.111 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6891000000000001e-05 2023-10-08T07:07:47.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.111 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.111 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.111 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820634+0000", 2023-10-08T07:07:47.111 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1664999999999999e-05 2023-10-08T07:07:47.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.111 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.111 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820640+0000", 2023-10-08T07:07:47.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7490000000000001e-06 2023-10-08T07:07:47.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823673+0000", 2023-10-08T07:07:47.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0030320529999999998 2023-10-08T07:07:47.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823763+0000", 2023-10-08T07:07:47.113 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0932000000000003e-05 2023-10-08T07:07:47.113 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.113 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.113 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.113 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172645 4.24 4.a3805da4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.113 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.833396+0000", 2023-10-08T07:07:47.113 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0053476749999999997, 2023-10-08T07:07:47.113 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.008827863, 2023-10-08T07:07:47.113 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.114 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.114 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.114 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.114 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.114 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172645 2023-10-08T07:07:47.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.114 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.114 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.114 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.114 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833396+0000", 2023-10-08T07:07:47.114 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.115 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.115 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.115 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833396+0000", 2023-10-08T07:07:47.115 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.115 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.115 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.115 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833397+0000", 2023-10-08T07:07:47.115 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0800000000000004e-07 2023-10-08T07:07:47.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.115 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.115 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833411+0000", 2023-10-08T07:07:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4396000000000001e-05 2023-10-08T07:07:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833420+0000", 2023-10-08T07:07:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4309999999999994e-06 2023-10-08T07:07:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833428+0000", 2023-10-08T07:07:47.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5259999999999993e-06 2023-10-08T07:07:47.117 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.117 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.117 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.117 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.117 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172608 4.1b 4:d97fb168:::10000000004.00000008:head [write 3092480~4096 in=4096b,write 3125248~4096 in=4096b,write 3158016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.117 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.820856+0000", 2023-10-08T07:07:47.117 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.017888399999999999, 2023-10-08T07:07:47.117 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021430892, 2023-10-08T07:07:47.117 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.117 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.118 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.118 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.118 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.118 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172608 2023-10-08T07:07:47.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.118 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.118 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.118 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.118 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820856+0000", 2023-10-08T07:07:47.118 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.118 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.119 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.119 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820856+0000", 2023-10-08T07:07:47.119 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.119 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.119 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.119 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820856+0000", 2023-10-08T07:07:47.119 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7599999999999997e-07 2023-10-08T07:07:47.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.119 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.119 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820869+0000", 2023-10-08T07:07:47.120 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2578999999999999e-05 2023-10-08T07:07:47.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.120 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820881+0000", 2023-10-08T07:07:47.120 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2084e-05 2023-10-08T07:07:47.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.120 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.820888+0000", 2023-10-08T07:07:47.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7880000000000001e-06 2023-10-08T07:07:47.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.121 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.121 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.121 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823906+0000", 2023-10-08T07:07:47.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0030180939999999998 2023-10-08T07:07:47.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.121 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.121 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.121 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823994+0000", 2023-10-08T07:07:47.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7839999999999999e-05 2023-10-08T07:07:47.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.122 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.122 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.122 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.824170+0000", 2023-10-08T07:07:47.122 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000176861 2023-10-08T07:07:47.122 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.122 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.122 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.122 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.122 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172646 4.3a 4.f030edfa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.123 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.833438+0000", 2023-10-08T07:07:47.123 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0053058669999999997, 2023-10-08T07:07:47.123 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0089213450000000007, 2023-10-08T07:07:47.123 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.123 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.123 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.123 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.123 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.123 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172646 2023-10-08T07:07:47.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.123 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.124 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.124 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.124 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833438+0000", 2023-10-08T07:07:47.124 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.124 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.124 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.124 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833438+0000", 2023-10-08T07:07:47.124 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.124 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.124 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.125 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833439+0000", 2023-10-08T07:07:47.125 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6000000000000004e-07 2023-10-08T07:07:47.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.125 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.125 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833450+0000", 2023-10-08T07:07:47.125 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1456e-05 2023-10-08T07:07:47.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.125 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.125 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833457+0000", 2023-10-08T07:07:47.125 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2060000000000001e-06 2023-10-08T07:07:47.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.126 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833463+0000", 2023-10-08T07:07:47.126 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7030000000000003e-06 2023-10-08T07:07:47.126 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.126 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.126 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.126 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172515 4.c 4:31e28161:::10000000004.00000011:head [write 8192~4096 in=4096b,write 81920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.126 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.796924+0000", 2023-10-08T07:07:47.127 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.041820379999999997, 2023-10-08T07:07:47.127 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045495995999999997, 2023-10-08T07:07:47.127 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.127 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.127 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.127 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.127 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.127 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172515 2023-10-08T07:07:47.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.127 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.127 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.128 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.796924+0000", 2023-10-08T07:07:47.128 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.128 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.128 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.128 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.796924+0000", 2023-10-08T07:07:47.128 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.128 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.128 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.128 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.796926+0000", 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9379999999999999e-06 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.796940+0000", 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4834999999999999e-05 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.796973+0000", 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2428999999999997e-05 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.796982+0000", 2023-10-08T07:07:47.130 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.149e-06 2023-10-08T07:07:47.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818930+0000", 2023-10-08T07:07:47.130 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021947793 2023-10-08T07:07:47.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.131 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.131 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819020+0000", 2023-10-08T07:07:47.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0545999999999997e-05 2023-10-08T07:07:47.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.131 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.131 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.819188+0000", 2023-10-08T07:07:47.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016733000000000001 2023-10-08T07:07:47.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.131 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.132 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.829964+0000", 2023-10-08T07:07:47.132 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010776727 2023-10-08T07:07:47.132 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.132 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.132 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.132 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172609 4.a 4.6e5df24a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.132 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.821112+0000", 2023-10-08T07:07:47.132 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.017632374999999999, 2023-10-08T07:07:47.132 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.02138572, 2023-10-08T07:07:47.132 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.133 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.133 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.133 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.133 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.133 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172609 2023-10-08T07:07:47.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.133 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.133 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.133 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821112+0000", 2023-10-08T07:07:47.133 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.134 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.134 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821112+0000", 2023-10-08T07:07:47.134 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.134 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.134 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821112+0000", 2023-10-08T07:07:47.134 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1200000000000001e-07 2023-10-08T07:07:47.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821127+0000", 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4728e-05 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821145+0000", 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8099999999999999e-05 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821154+0000", 2023-10-08T07:07:47.135 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7490000000000004e-06 2023-10-08T07:07:47.136 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.136 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.136 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.136 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.136 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172648 4.1a 4.5c1f9a5a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.136 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.833471+0000", 2023-10-08T07:07:47.136 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.005272606, 2023-10-08T07:07:47.136 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0091580470000000008, 2023-10-08T07:07:47.136 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.136 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.136 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172648 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833471+0000", 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.137 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833471+0000", 2023-10-08T07:07:47.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833472+0000", 2023-10-08T07:07:47.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6100000000000001e-07 2023-10-08T07:07:47.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833481+0000", 2023-10-08T07:07:47.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4080000000000004e-06 2023-10-08T07:07:47.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833488+0000", 2023-10-08T07:07:47.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1060000000000002e-06 2023-10-08T07:07:47.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833494+0000", 2023-10-08T07:07:47.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4049999999999999e-06 2023-10-08T07:07:47.139 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.139 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.139 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.140 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172518 4.1b 4:d97fb168:::10000000004.00000008:head [write 2363392~4096 in=4096b,write 2437120~4096 in=4096b,write 2449408~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.140 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.796998+0000", 2023-10-08T07:07:47.140 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.041746292999999997, 2023-10-08T07:07:47.140 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045702304999999999, 2023-10-08T07:07:47.140 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.140 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.140 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.140 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.140 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.141 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172518 2023-10-08T07:07:47.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.141 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.141 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.796998+0000", 2023-10-08T07:07:47.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.141 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.141 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.796998+0000", 2023-10-08T07:07:47.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.796998+0000", 2023-10-08T07:07:47.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7599999999999997e-07 2023-10-08T07:07:47.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797013+0000", 2023-10-08T07:07:47.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4589999999999999e-05 2023-10-08T07:07:47.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.143 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.143 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797022+0000", 2023-10-08T07:07:47.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3190000000000001e-06 2023-10-08T07:07:47.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.143 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.143 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797028+0000", 2023-10-08T07:07:47.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2439999999999998e-06 2023-10-08T07:07:47.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.144 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.144 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805756+0000", 2023-10-08T07:07:47.144 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0087278059999999994 2023-10-08T07:07:47.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.144 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.144 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.144 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.805844+0000", 2023-10-08T07:07:47.144 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7423999999999995e-05 2023-10-08T07:07:47.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.144 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.144 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.144 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.806013+0000", 2023-10-08T07:07:47.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016892400000000001 2023-10-08T07:07:47.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.145 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.145 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.837758+0000", 2023-10-08T07:07:47.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.031745400999999999 2023-10-08T07:07:47.145 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.145 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.145 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.145 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172569 4.c 4:31e28161:::10000000004.00000011:head [write 802816~4096 in=4096b,write 1196032~4096 in=4096b,write 1204224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.146 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.810861+0000", 2023-10-08T07:07:47.146 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027883071999999998, 2023-10-08T07:07:47.146 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.031937064000000001, 2023-10-08T07:07:47.146 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.146 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.146 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.146 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.146 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.146 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172569 2023-10-08T07:07:47.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.146 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.810861+0000", 2023-10-08T07:07:47.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.810861+0000", 2023-10-08T07:07:47.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.810862+0000", 2023-10-08T07:07:47.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5499999999999998e-07 2023-10-08T07:07:47.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.810871+0000", 2023-10-08T07:07:47.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5200000000000003e-06 2023-10-08T07:07:47.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.148 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.148 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.148 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.810882+0000", 2023-10-08T07:07:47.148 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1127999999999999e-05 2023-10-08T07:07:47.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.149 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.149 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.810888+0000", 2023-10-08T07:07:47.149 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.541e-06 2023-10-08T07:07:47.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.149 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.149 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830034+0000", 2023-10-08T07:07:47.149 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.019146716000000001 2023-10-08T07:07:47.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.149 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.150 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.150 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830117+0000", 2023-10-08T07:07:47.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2818000000000006e-05 2023-10-08T07:07:47.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.150 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.150 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.150 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830364+0000", 2023-10-08T07:07:47.150 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000246698 2023-10-08T07:07:47.150 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.150 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.150 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172610 4.c 4:3352c333:::10000000004.00000012:head [write 200704~4096 in=4096b,write 286720~4096 in=4096b,write 397312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.821396+0000", 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.01734757, 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021492312, 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172610 2023-10-08T07:07:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.152 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821396+0000", 2023-10-08T07:07:47.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.152 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.152 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821396+0000", 2023-10-08T07:07:47.152 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.153 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.153 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821397+0000", 2023-10-08T07:07:47.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8800000000000001e-07 2023-10-08T07:07:47.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.153 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.153 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821410+0000", 2023-10-08T07:07:47.153 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2699e-05 2023-10-08T07:07:47.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821420+0000", 2023-10-08T07:07:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5540000000000003e-06 2023-10-08T07:07:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.821427+0000", 2023-10-08T07:07:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3000000000000004e-06 2023-10-08T07:07:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833594+0000", 2023-10-08T07:07:47.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.012166712999999999 2023-10-08T07:07:47.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833673+0000", 2023-10-08T07:07:47.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9618999999999998e-05 2023-10-08T07:07:47.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.155 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.155 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.155 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833773+0000", 2023-10-08T07:07:47.155 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9636000000000006e-05 2023-10-08T07:07:47.156 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.156 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.156 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.156 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.156 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172649 4.5 4:a2ff1403:::10000000004.00000039:head [write 1720320~4096 in=4096b,write 2023424~4096 in=4096b,write 2088960~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.156 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.833502+0000", 2023-10-08T07:07:47.156 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0052416709999999998, 2023-10-08T07:07:47.156 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0094774409999999996, 2023-10-08T07:07:47.156 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.156 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.156 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.157 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.157 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.157 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172649 2023-10-08T07:07:47.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.157 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.157 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.157 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833502+0000", 2023-10-08T07:07:47.157 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.158 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.158 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833502+0000", 2023-10-08T07:07:47.158 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.158 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.158 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833503+0000", 2023-10-08T07:07:47.158 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4499999999999997e-07 2023-10-08T07:07:47.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.158 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.158 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.158 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833512+0000", 2023-10-08T07:07:47.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6879999999999994e-06 2023-10-08T07:07:47.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833519+0000", 2023-10-08T07:07:47.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9659999999999999e-06 2023-10-08T07:07:47.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.159 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.159 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833526+0000", 2023-10-08T07:07:47.159 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5699999999999998e-06 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833599+0000", 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3461999999999996e-05 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833666+0000", 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6983000000000006e-05 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.160 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.161 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.161 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172520 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 733184~4096 in=4096b,write 753664~4096 in=4096b,write 843776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.161 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.797039+0000", 2023-10-08T07:07:47.161 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.041705391000000001, 2023-10-08T07:07:47.161 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046028235000000001, 2023-10-08T07:07:47.161 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.161 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.161 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.161 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.161 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.161 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172520 2023-10-08T07:07:47.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.162 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.162 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797039+0000", 2023-10-08T07:07:47.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.162 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.162 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.162 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797039+0000", 2023-10-08T07:07:47.162 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.163 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.163 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.163 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797039+0000", 2023-10-08T07:07:47.163 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2200000000000004e-07 2023-10-08T07:07:47.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.163 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.163 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.163 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797051+0000", 2023-10-08T07:07:47.163 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1968e-05 2023-10-08T07:07:47.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.163 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.164 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797069+0000", 2023-10-08T07:07:47.164 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7450999999999999e-05 2023-10-08T07:07:47.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.164 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797079+0000", 2023-10-08T07:07:47.164 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0336999999999999e-05 2023-10-08T07:07:47.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.164 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.810364+0000", 2023-10-08T07:07:47.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013285579 2023-10-08T07:07:47.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.165 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.810437+0000", 2023-10-08T07:07:47.165 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2927000000000002e-05 2023-10-08T07:07:47.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.165 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.165 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.166 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.810586+0000", 2023-10-08T07:07:47.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000148818 2023-10-08T07:07:47.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.166 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.166 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.166 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.837765+0000", 2023-10-08T07:07:47.166 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.02717868 2023-10-08T07:07:47.166 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.166 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.166 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.167 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.167 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172652 4.5 4:a2ff1403:::10000000004.00000039:head [write 3944448~4096 in=4096b,write 3964928~4096 in=4096b,write 4067328~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.167 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.833556+0000", 2023-10-08T07:07:47.167 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0051884380000000001, 2023-10-08T07:07:47.167 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0096108719999999995, 2023-10-08T07:07:47.167 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.167 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.167 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.167 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.167 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.167 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172652 2023-10-08T07:07:47.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.168 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833556+0000", 2023-10-08T07:07:47.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.168 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.168 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.168 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833556+0000", 2023-10-08T07:07:47.168 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833556+0000", 2023-10-08T07:07:47.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4000000000000002e-07 2023-10-08T07:07:47.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.169 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.169 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833569+0000", 2023-10-08T07:07:47.169 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.308e-05 2023-10-08T07:07:47.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.170 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.170 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833577+0000", 2023-10-08T07:07:47.170 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1510000000000004e-06 2023-10-08T07:07:47.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.170 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.170 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.170 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833584+0000", 2023-10-08T07:07:47.170 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7479999999999996e-06 2023-10-08T07:07:47.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.170 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.170 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.171 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.838218+0000", 2023-10-08T07:07:47.171 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0046340340000000004 2023-10-08T07:07:47.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.171 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.171 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.171 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.838296+0000", 2023-10-08T07:07:47.171 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8118e-05 2023-10-08T07:07:47.171 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.171 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.171 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.172 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.172 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172521 4.32 4:4efc9492:::10000000004.00000032:head [write 2646016~12288 in=12288b,write 2674688~4096 in=4096b,write 2686976~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.172 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.797090+0000", 2023-10-08T07:07:47.172 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.041653519999999999, 2023-10-08T07:07:47.172 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046172981000000002, 2023-10-08T07:07:47.172 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.172 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.172 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.172 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.172 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.173 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172521 2023-10-08T07:07:47.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.173 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797090+0000", 2023-10-08T07:07:47.173 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.173 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.173 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.173 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797090+0000", 2023-10-08T07:07:47.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797091+0000", 2023-10-08T07:07:47.174 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5199999999999996e-07 2023-10-08T07:07:47.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.174 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.174 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.174 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797109+0000", 2023-10-08T07:07:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7666e-05 2023-10-08T07:07:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797117+0000", 2023-10-08T07:07:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6109999999999994e-06 2023-10-08T07:07:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797124+0000", 2023-10-08T07:07:47.175 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3659999999999997e-06 2023-10-08T07:07:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827065+0000", 2023-10-08T07:07:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.029941551 2023-10-08T07:07:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827145+0000", 2023-10-08T07:07:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9326999999999995e-05 2023-10-08T07:07:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.176 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172654 4.20 4.34f20020 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.833596+0000", 2023-10-08T07:07:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0051474590000000001, 2023-10-08T07:07:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0097106229999999998, 2023-10-08T07:07:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.177 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172654 2023-10-08T07:07:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833596+0000", 2023-10-08T07:07:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833596+0000", 2023-10-08T07:07:47.178 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833597+0000", 2023-10-08T07:07:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2e-07 2023-10-08T07:07:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833648+0000", 2023-10-08T07:07:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0968999999999999e-05 2023-10-08T07:07:47.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833657+0000", 2023-10-08T07:07:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0510000000000002e-06 2023-10-08T07:07:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.833664+0000", 2023-10-08T07:07:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9240000000000001e-06 2023-10-08T07:07:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.180 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172522 4.3a 4:5f183e4b:::10000000004.00000023:head [write 1486848~4096 in=4096b,write 1536000~4096 in=4096b,write 1552384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.797136+0000", 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.041607882999999998, 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046206682999999998, 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172522 2023-10-08T07:07:47.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797136+0000", 2023-10-08T07:07:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797136+0000", 2023-10-08T07:07:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797137+0000", 2023-10-08T07:07:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:07:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797148+0000", 2023-10-08T07:07:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1807999999999999e-05 2023-10-08T07:07:47.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797155+0000", 2023-10-08T07:07:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9539999999999998e-06 2023-10-08T07:07:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797165+0000", 2023-10-08T07:07:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.679e-06 2023-10-08T07:07:47.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827471+0000", 2023-10-08T07:07:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.030306380000000001 2023-10-08T07:07:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827566+0000", 2023-10-08T07:07:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5082999999999997e-05 2023-10-08T07:07:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.185 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.827753+0000", 2023-10-08T07:07:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000186689 2023-10-08T07:07:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172570 4.a 4.6e5df24a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.811102+0000", 2023-10-08T07:07:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027642084000000001, 2023-10-08T07:07:47.186 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032328177999999999, 2023-10-08T07:07:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172570 2023-10-08T07:07:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.187 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811102+0000", 2023-10-08T07:07:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811102+0000", 2023-10-08T07:07:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.188 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811102+0000", 2023-10-08T07:07:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9200000000000001e-07 2023-10-08T07:07:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811110+0000", 2023-10-08T07:07:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5170000000000002e-06 2023-10-08T07:07:47.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811119+0000", 2023-10-08T07:07:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8750000000000006e-06 2023-10-08T07:07:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811126+0000", 2023-10-08T07:07:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5660000000000001e-06 2023-10-08T07:07:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.190 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172655 4.20 4.1c14eae0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.834054+0000", 2023-10-08T07:07:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0046895050000000001, 2023-10-08T07:07:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0094400479999999995, 2023-10-08T07:07:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.191 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172655 2023-10-08T07:07:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834054+0000", 2023-10-08T07:07:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.192 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834054+0000", 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834055+0000", 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6599999999999995e-07 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834067+0000", 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1399e-05 2023-10-08T07:07:47.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834077+0000", 2023-10-08T07:07:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0397999999999999e-05 2023-10-08T07:07:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834084+0000", 2023-10-08T07:07:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9720000000000003e-06 2023-10-08T07:07:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.194 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172523 4.a 4:524fba76:::10000000004.0000001b:head [write 974848~4096 in=4096b,write 1159168~4096 in=4096b,write 1167360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.797174+0000", 2023-10-08T07:07:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.041569850999999998, 2023-10-08T07:07:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.046427049999999997, 2023-10-08T07:07:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.195 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172523 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797174+0000", 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797174+0000", 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797175+0000", 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7100000000000002e-07 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797190+0000", 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5209e-05 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797199+0000", 2023-10-08T07:07:47.197 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8720000000000008e-06 2023-10-08T07:07:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.797205+0000", 2023-10-08T07:07:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9159999999999998e-06 2023-10-08T07:07:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830169+0000", 2023-10-08T07:07:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032963985000000001 2023-10-08T07:07:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830258+0000", 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9930000000000001e-05 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830417+0000", 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00015820799999999999 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.840467+0000", 2023-10-08T07:07:47.199 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.010050424000000001 2023-10-08T07:07:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172658 4.1f 4:f9156152:::10000000004.00000036:head [write 528384~4096 in=4096b,write 565248~4096 in=4096b,write 638976~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.834844+0000", 2023-10-08T07:07:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0039000670000000001, 2023-10-08T07:07:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0088618849999999999, 2023-10-08T07:07:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.200 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172658 2023-10-08T07:07:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834844+0000", 2023-10-08T07:07:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834844+0000", 2023-10-08T07:07:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834844+0000", 2023-10-08T07:07:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9400000000000005e-07 2023-10-08T07:07:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834861+0000", 2023-10-08T07:07:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6528000000000002e-05 2023-10-08T07:07:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834877+0000", 2023-10-08T07:07:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5537e-05 2023-10-08T07:07:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.203 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834883+0000", 2023-10-08T07:07:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4659999999999996e-06 2023-10-08T07:07:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.834957+0000", 2023-10-08T07:07:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4085000000000006e-05 2023-10-08T07:07:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.204 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835054+0000", 2023-10-08T07:07:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6736000000000004e-05 2023-10-08T07:07:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172526 4.1b 4:dbb7dde6:::10000000004.0000002c:head [write 573440~4096 in=4096b,write 598016~4096 in=4096b,write 692224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.798115+0000", 2023-10-08T07:07:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.040628519000000002, 2023-10-08T07:07:47.205 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045653714999999997, 2023-10-08T07:07:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172526 2023-10-08T07:07:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.206 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798115+0000", 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798115+0000", 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798116+0000", 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7700000000000004e-07 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.207 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798128+0000", 2023-10-08T07:07:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2043e-05 2023-10-08T07:07:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798137+0000", 2023-10-08T07:07:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0229999999999998e-06 2023-10-08T07:07:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.208 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798144+0000", 2023-10-08T07:07:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0160000000000003e-06 2023-10-08T07:07:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813672+0000", 2023-10-08T07:07:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015527453 2023-10-08T07:07:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813760+0000", 2023-10-08T07:07:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8642999999999998e-05 2023-10-08T07:07:47.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.813935+0000", 2023-10-08T07:07:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000174971 2023-10-08T07:07:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.837779+0000", 2023-10-08T07:07:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023843455 2023-10-08T07:07:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.210 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:156301 4.0 e64/17 4:02bf98b6:::10000000004.0000000e:head v 64'2437, mlcod=64'2435)", 2023-10-08T07:07:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.822399+0000", 2023-10-08T07:07:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.016345044999999999, 2023-10-08T07:07:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021432310999999999, 2023-10-08T07:07:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.211 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822399+0000", 2023-10-08T07:07:47.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822399+0000", 2023-10-08T07:07:47.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.212 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.212 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822399+0000", 2023-10-08T07:07:47.212 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6300000000000001e-07 2023-10-08T07:07:47.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822410+0000", 2023-10-08T07:07:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0720000000000001e-05 2023-10-08T07:07:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822416+0000", 2023-10-08T07:07:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1750000000000002e-06 2023-10-08T07:07:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.213 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.822420+0000", 2023-10-08T07:07:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1779999999999996e-06 2023-10-08T07:07:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.824441+0000", 2023-10-08T07:07:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020210649999999998 2023-10-08T07:07:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.824464+0000", 2023-10-08T07:07:47.214 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2286999999999999e-05 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172659 4.1 4:8277d31e:::10000000004.00000013:head [write 589824~4096 in=4096b,write 618496~4096 in=4096b,write 684032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.835102+0000", 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.003642185, 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0087832569999999992, 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.215 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172659 2023-10-08T07:07:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835102+0000", 2023-10-08T07:07:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.216 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835102+0000", 2023-10-08T07:07:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835102+0000", 2023-10-08T07:07:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1699999999999997e-07 2023-10-08T07:07:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835113+0000", 2023-10-08T07:07:47.217 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0757999999999999e-05 2023-10-08T07:07:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835122+0000", 2023-10-08T07:07:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.619e-06 2023-10-08T07:07:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835128+0000", 2023-10-08T07:07:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2260000000000002e-06 2023-10-08T07:07:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835193+0000", 2023-10-08T07:07:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4974999999999994e-05 2023-10-08T07:07:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835285+0000", 2023-10-08T07:07:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2238999999999996e-05 2023-10-08T07:07:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172527 4.2 4:43cef10a:::10000000004.00000030:head [write 2940928~4096 in=4096b,write 3284992~4096 in=4096b,write 3338240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.798530+0000", 2023-10-08T07:07:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.040213551, 2023-10-08T07:07:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045402584000000003, 2023-10-08T07:07:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172527 2023-10-08T07:07:47.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798530+0000", 2023-10-08T07:07:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798530+0000", 2023-10-08T07:07:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798536+0000", 2023-10-08T07:07:47.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2480000000000004e-06 2023-10-08T07:07:47.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.222 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.222 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798549+0000", 2023-10-08T07:07:47.222 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.329e-05 2023-10-08T07:07:47.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798559+0000", 2023-10-08T07:07:47.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5719999999999992e-06 2023-10-08T07:07:47.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798566+0000", 2023-10-08T07:07:47.223 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1300000000000003e-06 2023-10-08T07:07:47.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.223 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.223 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.832280+0000", 2023-10-08T07:07:47.224 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.033714725000000001 2023-10-08T07:07:47.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.224 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.224 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.832359+0000", 2023-10-08T07:07:47.224 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8965e-05 2023-10-08T07:07:47.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.224 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.225 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172571 4.2a 4.3185202a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.225 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.811278+0000", 2023-10-08T07:07:47.225 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027465558000000001, 2023-10-08T07:07:47.225 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032711939000000002, 2023-10-08T07:07:47.225 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.225 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:47.225 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.225 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.225 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.225 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172571 2023-10-08T07:07:47.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.225 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.226 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.226 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811278+0000", 2023-10-08T07:07:47.226 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.226 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.226 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811278+0000", 2023-10-08T07:07:47.226 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811279+0000", 2023-10-08T07:07:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9599999999999999e-07 2023-10-08T07:07:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811310+0000", 2023-10-08T07:07:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1436999999999997e-05 2023-10-08T07:07:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811326+0000", 2023-10-08T07:07:47.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5897e-05 2023-10-08T07:07:47.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.228 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.228 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811335+0000", 2023-10-08T07:07:47.228 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9339999999999995e-06 2023-10-08T07:07:47.228 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.228 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.228 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.228 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172660 4.5 4:a2ff1403:::10000000004.00000039:head [write 73728~4096 in=4096b,write 114688~4096 in=4096b,write 352256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.229 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.835393+0000", 2023-10-08T07:07:47.229 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0033509740000000001, 2023-10-08T07:07:47.229 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0086335060000000009, 2023-10-08T07:07:47.229 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.229 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.229 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.229 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.229 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.229 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172660 2023-10-08T07:07:47.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.229 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.230 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835393+0000", 2023-10-08T07:07:47.230 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.230 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.230 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835393+0000", 2023-10-08T07:07:47.230 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.230 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.231 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835394+0000", 2023-10-08T07:07:47.231 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6000000000000003e-07 2023-10-08T07:07:47.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.231 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.231 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.231 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835406+0000", 2023-10-08T07:07:47.231 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2228999999999999e-05 2023-10-08T07:07:47.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.231 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.231 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.231 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835416+0000", 2023-10-08T07:07:47.232 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0316000000000001e-05 2023-10-08T07:07:47.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.232 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.232 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.232 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.835424+0000", 2023-10-08T07:07:47.232 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4440000000000002e-06 2023-10-08T07:07:47.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.232 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.232 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.232 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.840936+0000", 2023-10-08T07:07:47.232 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0055121060000000001 2023-10-08T07:07:47.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.233 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.233 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.841025+0000", 2023-10-08T07:07:47.233 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9095e-05 2023-10-08T07:07:47.233 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.233 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.233 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.233 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.233 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172485 4.20 4:07572838:::10000000004.00000010:head [write 249856~4096 in=4096b,write 692224~4096 in=4096b,write 700416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.234 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.789249+0000", 2023-10-08T07:07:47.234 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.049494870000000003, 2023-10-08T07:07:47.234 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.054860645999999999, 2023-10-08T07:07:47.234 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.234 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.234 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.234 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.234 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.234 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172485 2023-10-08T07:07:47.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.234 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789249+0000", 2023-10-08T07:07:47.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.235 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.235 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789249+0000", 2023-10-08T07:07:47.235 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789249+0000", 2023-10-08T07:07:47.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9299999999999999e-07 2023-10-08T07:07:47.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.236 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789259+0000", 2023-10-08T07:07:47.236 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2220000000000008e-06 2023-10-08T07:07:47.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.236 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.236 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789263+0000", 2023-10-08T07:07:47.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4839999999999998e-06 2023-10-08T07:07:47.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.789267+0000", 2023-10-08T07:07:47.237 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3550000000000001e-06 2023-10-08T07:07:47.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.237 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.237 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.237 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818648+0000", 2023-10-08T07:07:47.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.029381111000000001 2023-10-08T07:07:47.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.238 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818725+0000", 2023-10-08T07:07:47.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7055e-05 2023-10-08T07:07:47.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.238 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.238 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.238 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.818961+0000", 2023-10-08T07:07:47.238 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00023672400000000001 2023-10-08T07:07:47.238 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.239 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.239 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.239 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.239 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172528 4.c 4:3352c333:::10000000004.00000012:head [write 2531328~4096 in=4096b,write 2584576~4096 in=4096b,write 2748416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.239 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.798857+0000", 2023-10-08T07:07:47.239 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.039887273000000001, 2023-10-08T07:07:47.239 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045356583999999998, 2023-10-08T07:07:47.239 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.239 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.239 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.239 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.240 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.240 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172528 2023-10-08T07:07:47.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.240 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.240 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.240 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.240 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798857+0000", 2023-10-08T07:07:47.240 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.240 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.240 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798857+0000", 2023-10-08T07:07:47.241 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.241 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798857+0000", 2023-10-08T07:07:47.241 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0999999999999998e-07 2023-10-08T07:07:47.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.241 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798869+0000", 2023-10-08T07:07:47.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1423999999999999e-05 2023-10-08T07:07:47.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798879+0000", 2023-10-08T07:07:47.242 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8749999999999995e-06 2023-10-08T07:07:47.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.242 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.242 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.242 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.798886+0000", 2023-10-08T07:07:47.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3699999999999997e-06 2023-10-08T07:07:47.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.243 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.243 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.243 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826672+0000", 2023-10-08T07:07:47.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027786188 2023-10-08T07:07:47.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.243 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.243 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.243 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826771+0000", 2023-10-08T07:07:47.243 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.9077e-05 2023-10-08T07:07:47.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.244 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.244 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.826949+0000", 2023-10-08T07:07:47.244 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000178097 2023-10-08T07:07:47.244 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.244 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.244 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.244 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.244 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172572 4.24 4:25ba01c5:::10000000004.00000035:head [write 2228224~4096 in=4096b,write 2318336~4096 in=4096b,write 2387968~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.244 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.811587+0000", 2023-10-08T07:07:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.027156455999999999, 2023-10-08T07:07:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.032733616, 2023-10-08T07:07:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172572 2023-10-08T07:07:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.245 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.246 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811587+0000", 2023-10-08T07:07:47.246 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.246 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.246 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811587+0000", 2023-10-08T07:07:47.246 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.246 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.246 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811588+0000", 2023-10-08T07:07:47.247 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6899999999999996e-07 2023-10-08T07:07:47.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.247 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.247 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.247 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811601+0000", 2023-10-08T07:07:47.247 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2717e-05 2023-10-08T07:07:47.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.247 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.247 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.247 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811614+0000", 2023-10-08T07:07:47.247 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3258000000000001e-05 2023-10-08T07:07:47.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.248 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.811622+0000", 2023-10-08T07:07:47.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7430000000000002e-06 2023-10-08T07:07:47.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.248 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.248 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.829996+0000", 2023-10-08T07:07:47.248 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018373605000000001 2023-10-08T07:07:47.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.249 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.249 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830070+0000", 2023-10-08T07:07:47.249 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4587999999999998e-05 2023-10-08T07:07:47.249 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.249 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.249 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.249 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.249 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.249 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:172614 4.1b 4:d97fb168:::10000000004.00000008:head [write 3588096~4096 in=4096b,write 3665920~4096 in=4096b,write 3772416~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.249 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:46.823677+0000", 2023-10-08T07:07:47.250 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.015066589999999999, 2023-10-08T07:07:47.250 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020718382, 2023-10-08T07:07:47.250 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.250 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:47.250 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.250 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.250 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.250 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 172614 2023-10-08T07:07:47.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.250 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.250 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823677+0000", 2023-10-08T07:07:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823677+0000", 2023-10-08T07:07:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823678+0000", 2023-10-08T07:07:47.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.065e-06 2023-10-08T07:07:47.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823698+0000", 2023-10-08T07:07:47.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9582e-05 2023-10-08T07:07:47.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823709+0000", 2023-10-08T07:07:47.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.057e-05 2023-10-08T07:07:47.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.823718+0000", 2023-10-08T07:07:47.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5400000000000001e-06 2023-10-08T07:07:47.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830159+0000", 2023-10-08T07:07:47.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0064408449999999997 2023-10-08T07:07:47.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.254 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830216+0000", 2023-10-08T07:07:47.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7330000000000002e-05 2023-10-08T07:07:47.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.254 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:46.830393+0000", 2023-10-08T07:07:47.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017684999999999999 2023-10-08T07:07:47.254 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.254 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.254 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.255 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.255 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:07:47.255 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 81 2023-10-08T07:07:47.255 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:47.256 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:47.257 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:47.255+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:47.357 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:47.355+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:47.458 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:47.457+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:47.500 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:47.500 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:47.501 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:47.501 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:47.501 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:47.516 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:47.559 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:47.558+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:47.662 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:47.658+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:47.762 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:47.761+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:47.767 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:47.767 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:47.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174799 4.2 4:43cef10a:::10000000004.00000030:head [write 1536000~8192,write 1646592~4096,write 1757184~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.505968+0000", 2023-10-08T07:07:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.25866657700000001, 2023-10-08T07:07:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.175306198, 2023-10-08T07:07:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174799 2023-10-08T07:07:47.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.769 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.505968+0000", 2023-10-08T07:07:47.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.505968+0000", 2023-10-08T07:07:47.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.505969+0000", 2023-10-08T07:07:47.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1600000000000001e-07 2023-10-08T07:07:47.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.505994+0000", 2023-10-08T07:07:47.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4939999999999998e-05 2023-10-08T07:07:47.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.506004+0000", 2023-10-08T07:07:47.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0592e-05 2023-10-08T07:07:47.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.506011+0000", 2023-10-08T07:07:47.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7719999999999997e-06 2023-10-08T07:07:47.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.645352+0000", 2023-10-08T07:07:47.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.13934053699999999 2023-10-08T07:07:47.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.645447+0000", 2023-10-08T07:07:47.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5845000000000001e-05 2023-10-08T07:07:47.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.772 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.772 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.681139+0000", 2023-10-08T07:07:47.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.03569195 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.681195+0000", 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6084e-05 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.681274+0000", 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8862000000000005e-05 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.773 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.774 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174804 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 3751936~4096,write 3772416~4096,write 3805184~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.774 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.507550+0000", 2023-10-08T07:07:47.774 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.25708466899999999, 2023-10-08T07:07:47.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17393138, 2023-10-08T07:07:47.774 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.774 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.774 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.774 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.774 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.774 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174804 2023-10-08T07:07:47.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.775 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.507550+0000", 2023-10-08T07:07:47.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.507550+0000", 2023-10-08T07:07:47.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.507551+0000", 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6700000000000003e-07 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.507574+0000", 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.355e-05 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.507584+0000", 2023-10-08T07:07:47.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0023e-05 2023-10-08T07:07:47.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.507591+0000", 2023-10-08T07:07:47.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7649999999999996e-06 2023-10-08T07:07:47.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.649386+0000", 2023-10-08T07:07:47.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.14179514300000001 2023-10-08T07:07:47.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.649460+0000", 2023-10-08T07:07:47.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4078000000000005e-05 2023-10-08T07:07:47.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.649624+0000", 2023-10-08T07:07:47.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000163399 2023-10-08T07:07:47.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.667656+0000", 2023-10-08T07:07:47.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018032478000000001 2023-10-08T07:07:47.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.681407+0000", 2023-10-08T07:07:47.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013750640999999999 2023-10-08T07:07:47.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.779 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.779 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.681449+0000", 2023-10-08T07:07:47.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2401000000000003e-05 2023-10-08T07:07:47.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.681481+0000", 2023-10-08T07:07:47.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2234999999999999e-05 2023-10-08T07:07:47.780 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.780 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.780 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.780 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174807 4.2a 4:5404a18c:::10000000004.00000025:head [write 3805184~4096,write 3960832~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.780 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.508245+0000", 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.25639016100000001, 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17315351800000001, 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174807 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.508245+0000", 2023-10-08T07:07:47.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.508245+0000", 2023-10-08T07:07:47.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.508245+0000", 2023-10-08T07:07:47.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5000000000000002e-07 2023-10-08T07:07:47.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.508255+0000", 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5719999999999992e-06 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.508264+0000", 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0469999999999999e-06 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.508270+0000", 2023-10-08T07:07:47.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.2219999999999999e-06 2023-10-08T07:07:47.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.649490+0000", 2023-10-08T07:07:47.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.14122042500000001 2023-10-08T07:07:47.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.649564+0000", 2023-10-08T07:07:47.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3794000000000005e-05 2023-10-08T07:07:47.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.681284+0000", 2023-10-08T07:07:47.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.031719379999999998 2023-10-08T07:07:47.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.681326+0000", 2023-10-08T07:07:47.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2512999999999998e-05 2023-10-08T07:07:47.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.786 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.681398+0000", 2023-10-08T07:07:47.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1915000000000005e-05 2023-10-08T07:07:47.786 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.786 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.786 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.786 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174810 4.2a 4:5404a18c:::10000000004.00000025:head [write 3563520~4096,write 3739648~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.786 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.509149+0000", 2023-10-08T07:07:47.786 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.255486086, 2023-10-08T07:07:47.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17266621700000001, 2023-10-08T07:07:47.787 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.787 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.787 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.787 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.787 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.787 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174810 2023-10-08T07:07:47.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.787 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.509149+0000", 2023-10-08T07:07:47.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.509149+0000", 2023-10-08T07:07:47.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.509149+0000", 2023-10-08T07:07:47.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2900000000000002e-07 2023-10-08T07:07:47.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.509161+0000", 2023-10-08T07:07:47.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1759999999999999e-05 2023-10-08T07:07:47.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.509171+0000", 2023-10-08T07:07:47.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0229e-05 2023-10-08T07:07:47.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.509180+0000", 2023-10-08T07:07:47.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1699999999999997e-06 2023-10-08T07:07:47.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.652343+0000", 2023-10-08T07:07:47.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.14316346599999999 2023-10-08T07:07:47.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.652429+0000", 2023-10-08T07:07:47.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6113999999999996e-05 2023-10-08T07:07:47.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.681703+0000", 2023-10-08T07:07:47.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.029273504999999998 2023-10-08T07:07:47.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.681748+0000", 2023-10-08T07:07:47.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5039e-05 2023-10-08T07:07:47.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.681815+0000", 2023-10-08T07:07:47.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7105000000000002e-05 2023-10-08T07:07:47.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.792 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.792 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174886 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 344064~4096,write 528384~4096,write 724992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.792 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.533280+0000", 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.23135466800000001, 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17602625199999999, 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174886 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.533280+0000", 2023-10-08T07:07:47.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.533280+0000", 2023-10-08T07:07:47.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.533281+0000", 2023-10-08T07:07:47.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.026e-06 2023-10-08T07:07:47.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.533293+0000", 2023-10-08T07:07:47.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2291e-05 2023-10-08T07:07:47.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.533304+0000", 2023-10-08T07:07:47.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1053000000000001e-05 2023-10-08T07:07:47.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.533312+0000", 2023-10-08T07:07:47.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8250000000000005e-06 2023-10-08T07:07:47.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.688584+0000", 2023-10-08T07:07:47.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.15527168699999999 2023-10-08T07:07:47.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.688634+0000", 2023-10-08T07:07:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0272000000000003e-05 2023-10-08T07:07:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.688735+0000", 2023-10-08T07:07:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000100416 2023-10-08T07:07:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699855+0000", 2023-10-08T07:07:47.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.01112017 2023-10-08T07:07:47.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.709210+0000", 2023-10-08T07:07:47.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.009355749 2023-10-08T07:07:47.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.709266+0000", 2023-10-08T07:07:47.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5299e-05 2023-10-08T07:07:47.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.799 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.709306+0000", 2023-10-08T07:07:47.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0463999999999997e-05 2023-10-08T07:07:47.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.799 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.799 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174890 4.3a 4:5f183e4b:::10000000004.00000023:head [write 3768320~4096,write 3829760~4096,write 4001792~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.799 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.534601+0000", 2023-10-08T07:07:47.799 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.230033601, 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17479449699999999, 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174890 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.534601+0000", 2023-10-08T07:07:47.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.534601+0000", 2023-10-08T07:07:47.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.534602+0000", 2023-10-08T07:07:47.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4900000000000005e-07 2023-10-08T07:07:47.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.534616+0000", 2023-10-08T07:07:47.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4472e-05 2023-10-08T07:07:47.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.534630+0000", 2023-10-08T07:07:47.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3349999999999999e-05 2023-10-08T07:07:47.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.534637+0000", 2023-10-08T07:07:47.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3119999999999996e-06 2023-10-08T07:07:47.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.692289+0000", 2023-10-08T07:07:47.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.157652032 2023-10-08T07:07:47.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.692386+0000", 2023-10-08T07:07:47.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6835000000000004e-05 2023-10-08T07:07:47.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.692512+0000", 2023-10-08T07:07:47.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012570699999999999 2023-10-08T07:07:47.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.706213+0000", 2023-10-08T07:07:47.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013701634000000001 2023-10-08T07:07:47.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.709314+0000", 2023-10-08T07:07:47.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0031009940000000001 2023-10-08T07:07:47.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.709364+0000", 2023-10-08T07:07:47.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9356e-05 2023-10-08T07:07:47.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.806 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.806 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.709396+0000", 2023-10-08T07:07:47.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.2055999999999999e-05 2023-10-08T07:07:47.806 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.806 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.806 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.806 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174918 4.32 4:4efc9492:::10000000004.00000032:head [write 376832~4096,write 446464~4096,write 589824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.806 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.542679+0000", 2023-10-08T07:07:47.806 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.22195556599999999, 2023-10-08T07:07:47.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18477732999999999, 2023-10-08T07:07:47.807 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.807 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.807 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.807 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.807 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.807 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174918 2023-10-08T07:07:47.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.807 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.542679+0000", 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.542679+0000", 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.542680+0000", 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.542708+0000", 2023-10-08T07:07:47.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.845e-05 2023-10-08T07:07:47.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.542720+0000", 2023-10-08T07:07:47.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1491000000000001e-05 2023-10-08T07:07:47.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.542728+0000", 2023-10-08T07:07:47.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6529999999999994e-06 2023-10-08T07:07:47.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699890+0000", 2023-10-08T07:07:47.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.15716205699999999 2023-10-08T07:07:47.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699974+0000", 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4284999999999997e-05 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727345+0000", 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.027370724999999999 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727379+0000", 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4351999999999999e-05 2023-10-08T07:07:47.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727456+0000", 2023-10-08T07:07:47.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7405999999999997e-05 2023-10-08T07:07:47.812 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.812 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.812 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.813 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174922 4.1a 4:5a59f83a:::10000000004.00000002:head [write 2842624~4096,write 2850816~4096,write 2945024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.813 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.544269+0000", 2023-10-08T07:07:47.813 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.220366112, 2023-10-08T07:07:47.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.183404647, 2023-10-08T07:07:47.813 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.813 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.813 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.813 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.813 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.813 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174922 2023-10-08T07:07:47.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.814 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.544269+0000", 2023-10-08T07:07:47.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.544269+0000", 2023-10-08T07:07:47.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.544269+0000", 2023-10-08T07:07:47.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4300000000000002e-07 2023-10-08T07:07:47.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.544282+0000", 2023-10-08T07:07:47.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2169e-05 2023-10-08T07:07:47.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.544293+0000", 2023-10-08T07:07:47.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1327e-05 2023-10-08T07:07:47.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.544300+0000", 2023-10-08T07:07:47.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1600000000000001e-06 2023-10-08T07:07:47.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.700213+0000", 2023-10-08T07:07:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.155912463 2023-10-08T07:07:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.700299+0000", 2023-10-08T07:07:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6129000000000002e-05 2023-10-08T07:07:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.700448+0000", 2023-10-08T07:07:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000149717 2023-10-08T07:07:47.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727338+0000", 2023-10-08T07:07:47.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.026889799999999998 2023-10-08T07:07:47.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727579+0000", 2023-10-08T07:07:47.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00024068700000000001 2023-10-08T07:07:47.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727633+0000", 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3869000000000002e-05 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727673+0000", 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0482999999999998e-05 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.820 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174926 4.32 4:4efc9492:::10000000004.00000032:head [write 3026944~4096,write 3141632~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.820 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.545046+0000", 2023-10-08T07:07:47.820 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.219588379, 2023-10-08T07:07:47.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.182503261, 2023-10-08T07:07:47.820 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.820 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.821 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.821 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.821 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.821 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174926 2023-10-08T07:07:47.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.821 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.545046+0000", 2023-10-08T07:07:47.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.545046+0000", 2023-10-08T07:07:47.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.545047+0000", 2023-10-08T07:07:47.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.8700000000000005e-07 2023-10-08T07:07:47.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.545094+0000", 2023-10-08T07:07:47.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7200000000000002e-05 2023-10-08T07:07:47.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.545106+0000", 2023-10-08T07:07:47.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2224e-05 2023-10-08T07:07:47.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.545114+0000", 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1690000000000003e-06 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.704098+0000", 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.158984192 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.704181+0000", 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2890000000000001e-05 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727464+0000", 2023-10-08T07:07:47.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023283615000000001 2023-10-08T07:07:47.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727499+0000", 2023-10-08T07:07:47.825 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.4508999999999998e-05 2023-10-08T07:07:47.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727550+0000", 2023-10-08T07:07:47.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0674999999999998e-05 2023-10-08T07:07:47.826 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.826 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.826 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.828 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174930 4.2 4:40ea7945:::10000000004.0000003e:head [write 614400~4096,write 811008~4096,write 839680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.828 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.546171+0000", 2023-10-08T07:07:47.828 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.218464134, 2023-10-08T07:07:47.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.181691557, 2023-10-08T07:07:47.828 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.828 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.828 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.828 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.828 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.828 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174930 2023-10-08T07:07:47.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.829 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.546171+0000", 2023-10-08T07:07:47.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.546171+0000", 2023-10-08T07:07:47.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.546171+0000", 2023-10-08T07:07:47.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5600000000000005e-07 2023-10-08T07:07:47.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.546229+0000", 2023-10-08T07:07:47.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7839e-05 2023-10-08T07:07:47.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.546239+0000", 2023-10-08T07:07:47.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0409e-05 2023-10-08T07:07:47.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.546247+0000", 2023-10-08T07:07:47.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3520000000000001e-06 2023-10-08T07:07:47.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.704091+0000", 2023-10-08T07:07:47.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.157844176 2023-10-08T07:07:47.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.704181+0000", 2023-10-08T07:07:47.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0348999999999998e-05 2023-10-08T07:07:47.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.833 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727733+0000", 2023-10-08T07:07:47.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023551666999999998 2023-10-08T07:07:47.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.833 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727784+0000", 2023-10-08T07:07:47.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1378999999999997e-05 2023-10-08T07:07:47.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727862+0000", 2023-10-08T07:07:47.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7730000000000003e-05 2023-10-08T07:07:47.834 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.834 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.834 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.834 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174947 4.1a 4:5a59f83a:::10000000004.00000002:head [write 3227648~4096,write 3248128~4096,write 3284992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.834 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.551560+0000", 2023-10-08T07:07:47.834 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.21307463600000001, 2023-10-08T07:07:47.835 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18348916400000001, 2023-10-08T07:07:47.835 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.835 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.835 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.835 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.835 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.835 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174947 2023-10-08T07:07:47.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.835 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.551560+0000", 2023-10-08T07:07:47.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.551560+0000", 2023-10-08T07:07:47.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.551561+0000", 2023-10-08T07:07:47.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7100000000000001e-07 2023-10-08T07:07:47.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.551580+0000", 2023-10-08T07:07:47.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.9502999999999999e-05 2023-10-08T07:07:47.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.551592+0000", 2023-10-08T07:07:47.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1435e-05 2023-10-08T07:07:47.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.551598+0000", 2023-10-08T07:07:47.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0599999999999996e-06 2023-10-08T07:07:47.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.706244+0000", 2023-10-08T07:07:47.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.15464673000000001 2023-10-08T07:07:47.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.706319+0000", 2023-10-08T07:07:47.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4938999999999995e-05 2023-10-08T07:07:47.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.706483+0000", 2023-10-08T07:07:47.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016363799999999999 2023-10-08T07:07:47.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727718+0000", 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.021234980000000001 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.734955+0000", 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0072370350000000002 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.735014+0000", 2023-10-08T07:07:47.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.9101000000000002e-05 2023-10-08T07:07:47.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.841 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.841 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.735049+0000", 2023-10-08T07:07:47.842 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5071999999999999e-05 2023-10-08T07:07:47.842 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.842 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.842 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.842 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.842 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174952 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 208896~8192,write 659456~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.842 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.553121+0000", 2023-10-08T07:07:47.842 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.21151388300000001, 2023-10-08T07:07:47.842 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17623598500000001, 2023-10-08T07:07:47.843 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.843 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.843 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.843 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.843 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.843 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174952 2023-10-08T07:07:47.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.843 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.553121+0000", 2023-10-08T07:07:47.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.553121+0000", 2023-10-08T07:07:47.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.553122+0000", 2023-10-08T07:07:47.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2600000000000001e-07 2023-10-08T07:07:47.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.553148+0000", 2023-10-08T07:07:47.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.5936999999999999e-05 2023-10-08T07:07:47.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.553158+0000", 2023-10-08T07:07:47.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0380999999999999e-05 2023-10-08T07:07:47.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.553163+0000", 2023-10-08T07:07:47.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.95e-06 2023-10-08T07:07:47.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.847 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.709581+0000", 2023-10-08T07:07:47.847 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.156418162 2023-10-08T07:07:47.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.847 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.709670+0000", 2023-10-08T07:07:47.847 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9228999999999996e-05 2023-10-08T07:07:47.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.709833+0000", 2023-10-08T07:07:47.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016322099999999999 2023-10-08T07:07:47.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.848 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.848 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.727328+0000", 2023-10-08T07:07:47.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017494105999999999 2023-10-08T07:07:47.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.848 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.729258+0000", 2023-10-08T07:07:47.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.001930698 2023-10-08T07:07:47.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.729312+0000", 2023-10-08T07:07:47.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3720000000000001e-05 2023-10-08T07:07:47.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.729357+0000", 2023-10-08T07:07:47.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4755000000000001e-05 2023-10-08T07:07:47.850 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.850 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.850 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.850 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174956 4.2 4:40ea7945:::10000000004.0000003e:head [write 2412544~4096,write 2453504~4096,write 2617344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.850 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.554437+0000", 2023-10-08T07:07:47.850 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.210197776, 2023-10-08T07:07:47.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18069658299999999, 2023-10-08T07:07:47.851 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.851 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.851 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.851 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.851 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.851 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174956 2023-10-08T07:07:47.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.851 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.554437+0000", 2023-10-08T07:07:47.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.554437+0000", 2023-10-08T07:07:47.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.554438+0000", 2023-10-08T07:07:47.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1100000000000005e-07 2023-10-08T07:07:47.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.554450+0000", 2023-10-08T07:07:47.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2368000000000001e-05 2023-10-08T07:07:47.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.554462+0000", 2023-10-08T07:07:47.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1452e-05 2023-10-08T07:07:47.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.854 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.554468+0000", 2023-10-08T07:07:47.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9009999999999997e-06 2023-10-08T07:07:47.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.854 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.711764+0000", 2023-10-08T07:07:47.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.15729589899999999 2023-10-08T07:07:47.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.855 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.711854+0000", 2023-10-08T07:07:47.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0053e-05 2023-10-08T07:07:47.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.855 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.735058+0000", 2023-10-08T07:07:47.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.023203561000000001 2023-10-08T07:07:47.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.735086+0000", 2023-10-08T07:07:47.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7957e-05 2023-10-08T07:07:47.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.735133+0000", 2023-10-08T07:07:47.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7580999999999997e-05 2023-10-08T07:07:47.857 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.857 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.857 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.857 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.857 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:174972 4.2 4:43cef10a:::10000000004.00000030:head [write 2134016~4096,write 2187264~4096,write 2711552~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.857 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.559613+0000", 2023-10-08T07:07:47.858 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.205021869, 2023-10-08T07:07:47.858 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.1756009, 2023-10-08T07:07:47.858 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.858 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.858 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.858 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.858 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.858 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 174972 2023-10-08T07:07:47.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.859 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.559613+0000", 2023-10-08T07:07:47.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.559613+0000", 2023-10-08T07:07:47.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.559613+0000", 2023-10-08T07:07:47.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.82e-07 2023-10-08T07:07:47.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.559624+0000", 2023-10-08T07:07:47.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0607e-05 2023-10-08T07:07:47.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.861 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.559630+0000", 2023-10-08T07:07:47.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5370000000000003e-06 2023-10-08T07:07:47.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.861 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.559636+0000", 2023-10-08T07:07:47.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1189999999999996e-06 2023-10-08T07:07:47.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.862 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.862 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.714689+0000", 2023-10-08T07:07:47.862 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.15505382200000001 2023-10-08T07:07:47.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.862 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.862 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.714778+0000", 2023-10-08T07:07:47.862 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8261000000000001e-05 2023-10-08T07:07:47.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.735138+0000", 2023-10-08T07:07:47.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.020360189000000001 2023-10-08T07:07:47.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.735164+0000", 2023-10-08T07:07:47.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6310000000000001e-05 2023-10-08T07:07:47.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.864 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.864 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.735214+0000", 2023-10-08T07:07:47.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9573000000000001e-05 2023-10-08T07:07:47.864 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.864 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.864 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.865 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175024 4.2 4:40ea7945:::10000000004.0000003e:head [write 1970176~4096,write 2101248~4096,write 2162688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.865 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.575212+0000", 2023-10-08T07:07:47.865 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.18942255499999999, 2023-10-08T07:07:47.865 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18501955, 2023-10-08T07:07:47.865 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.865 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.865 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.865 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.865 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.865 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175024 2023-10-08T07:07:47.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.866 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.866 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.866 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.575212+0000", 2023-10-08T07:07:47.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.866 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.866 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.575212+0000", 2023-10-08T07:07:47.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.575213+0000", 2023-10-08T07:07:47.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5799999999999998e-07 2023-10-08T07:07:47.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.575228+0000", 2023-10-08T07:07:47.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4842e-05 2023-10-08T07:07:47.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.868 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.868 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.868 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.575241+0000", 2023-10-08T07:07:47.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2923e-05 2023-10-08T07:07:47.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.868 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.868 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.868 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.575248+0000", 2023-10-08T07:07:47.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9480000000000002e-06 2023-10-08T07:07:47.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.869 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.869 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.869 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.719695+0000", 2023-10-08T07:07:47.869 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.14444722099999999 2023-10-08T07:07:47.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.869 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.869 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.869 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.719771+0000", 2023-10-08T07:07:47.869 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.6520000000000006e-05 2023-10-08T07:07:47.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.870 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.870 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.870 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760056+0000", 2023-10-08T07:07:47.870 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.040285121 2023-10-08T07:07:47.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.870 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.870 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.870 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760114+0000", 2023-10-08T07:07:47.870 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7726000000000003e-05 2023-10-08T07:07:47.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.871 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.871 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.871 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760232+0000", 2023-10-08T07:07:47.871 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000117491 2023-10-08T07:07:47.871 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.871 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.871 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.871 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.871 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.871 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175027 4.a 4:524fba76:::10000000004.0000001b:head [write 1306624~4096,write 1318912~4096,write 1503232~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.871 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.575496+0000", 2023-10-08T07:07:47.872 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.189138467, 2023-10-08T07:07:47.872 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18480619000000001, 2023-10-08T07:07:47.872 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.872 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.872 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.872 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.872 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.872 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175027 2023-10-08T07:07:47.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.872 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.873 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.873 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.873 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.575496+0000", 2023-10-08T07:07:47.873 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.873 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.873 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.873 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.575496+0000", 2023-10-08T07:07:47.873 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.874 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.874 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.874 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.575497+0000", 2023-10-08T07:07:47.874 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8100000000000001e-07 2023-10-08T07:07:47.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.874 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.874 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.874 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.575509+0000", 2023-10-08T07:07:47.874 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1875999999999999e-05 2023-10-08T07:07:47.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.875 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.875 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.875 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.575520+0000", 2023-10-08T07:07:47.875 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1362000000000001e-05 2023-10-08T07:07:47.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.875 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.875 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.875 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.575528+0000", 2023-10-08T07:07:47.875 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.4259999999999997e-06 2023-10-08T07:07:47.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.876 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.876 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.876 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.720713+0000", 2023-10-08T07:07:47.876 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.14518535499999999 2023-10-08T07:07:47.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.876 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.876 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.876 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.720795+0000", 2023-10-08T07:07:47.876 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1576000000000006e-05 2023-10-08T07:07:47.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.877 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.877 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.720958+0000", 2023-10-08T07:07:47.877 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016368399999999999 2023-10-08T07:07:47.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.877 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.877 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.735387+0000", 2023-10-08T07:07:47.877 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014428511 2023-10-08T07:07:47.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.878 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.878 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760245+0000", 2023-10-08T07:07:47.878 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.024857647 2023-10-08T07:07:47.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.878 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.878 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760280+0000", 2023-10-08T07:07:47.878 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5185000000000003e-05 2023-10-08T07:07:47.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.879 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.879 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760302+0000", 2023-10-08T07:07:47.879 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2687000000000001e-05 2023-10-08T07:07:47.879 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.879 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.879 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.879 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.879 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175040 4.2 4:40ea7945:::10000000004.0000003e:head [write 3796992~4096,write 3891200~4096,write 3928064~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.879 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.579493+0000", 2023-10-08T07:07:47.880 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.185141424, 2023-10-08T07:07:47.880 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18087692799999999, 2023-10-08T07:07:47.880 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.880 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.880 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.880 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.880 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.880 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175040 2023-10-08T07:07:47.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.880 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.881 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.881 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.881 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.579493+0000", 2023-10-08T07:07:47.881 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.881 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.881 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.881 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.579493+0000", 2023-10-08T07:07:47.881 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.882 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.882 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.882 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.579494+0000", 2023-10-08T07:07:47.882 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.2099999999999996e-07 2023-10-08T07:07:47.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.882 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.882 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.882 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.579507+0000", 2023-10-08T07:07:47.882 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3284e-05 2023-10-08T07:07:47.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.883 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.883 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.883 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.579530+0000", 2023-10-08T07:07:47.883 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.2543000000000001e-05 2023-10-08T07:07:47.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.883 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.883 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.883 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.579539+0000", 2023-10-08T07:07:47.883 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7669999999999992e-06 2023-10-08T07:07:47.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.884 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.884 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.884 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.729530+0000", 2023-10-08T07:07:47.884 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.14999188599999999 2023-10-08T07:07:47.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.884 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.884 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.884 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.729617+0000", 2023-10-08T07:07:47.884 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6675999999999995e-05 2023-10-08T07:07:47.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.885 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.885 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.885 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760307+0000", 2023-10-08T07:07:47.885 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.030690176999999999 2023-10-08T07:07:47.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.885 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.885 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.885 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760332+0000", 2023-10-08T07:07:47.885 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4850000000000001e-05 2023-10-08T07:07:47.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.886 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.886 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.886 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760370+0000", 2023-10-08T07:07:47.886 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8024000000000001e-05 2023-10-08T07:07:47.886 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.886 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.886 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.886 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.886 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175044 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 3186688~4096,write 3203072~4096,write 3211264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.886 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.581333+0000", 2023-10-08T07:07:47.887 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.183301994, 2023-10-08T07:07:47.887 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17908802900000001, 2023-10-08T07:07:47.887 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.887 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.887 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.887 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.887 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.887 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175044 2023-10-08T07:07:47.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.887 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.888 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.888 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.888 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.581333+0000", 2023-10-08T07:07:47.888 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.888 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.888 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.888 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.581333+0000", 2023-10-08T07:07:47.888 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.889 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.889 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.889 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.581334+0000", 2023-10-08T07:07:47.889 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2800000000000005e-07 2023-10-08T07:07:47.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.889 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.889 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.889 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.581351+0000", 2023-10-08T07:07:47.889 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7153e-05 2023-10-08T07:07:47.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.890 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.890 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.890 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.581368+0000", 2023-10-08T07:07:47.891 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7187e-05 2023-10-08T07:07:47.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.891 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.891 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.891 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.581376+0000", 2023-10-08T07:07:47.891 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2349999999999999e-06 2023-10-08T07:07:47.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.891 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.891 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.891 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.735405+0000", 2023-10-08T07:07:47.892 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.15402911499999999 2023-10-08T07:07:47.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.892 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.892 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.892 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.735474+0000", 2023-10-08T07:07:47.892 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8312999999999995e-05 2023-10-08T07:07:47.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.892 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.892 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.892 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.735571+0000", 2023-10-08T07:07:47.893 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7831000000000006e-05 2023-10-08T07:07:47.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.893 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.893 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.893 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.743536+0000", 2023-10-08T07:07:47.893 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0079649999999999999 2023-10-08T07:07:47.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.893 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.893 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.893 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760375+0000", 2023-10-08T07:07:47.894 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016838155 2023-10-08T07:07:47.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.894 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.894 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.894 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760399+0000", 2023-10-08T07:07:47.894 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4912000000000001e-05 2023-10-08T07:07:47.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.894 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.894 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.894 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760421+0000", 2023-10-08T07:07:47.895 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.12e-05 2023-10-08T07:07:47.895 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.895 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.895 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.895 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.895 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175046 4.2 4:40ea7945:::10000000004.0000003e:head [write 2260992~4096,write 2273280~4096,write 2760704~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.895 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.581957+0000", 2023-10-08T07:07:47.895 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.18267775, 2023-10-08T07:07:47.895 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17852879399999999, 2023-10-08T07:07:47.896 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.896 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.896 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.896 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.896 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.896 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175046 2023-10-08T07:07:47.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.896 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.896 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.896 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.897 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.581957+0000", 2023-10-08T07:07:47.897 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.897 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.897 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.897 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.581957+0000", 2023-10-08T07:07:47.897 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.897 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.897 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.898 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.581958+0000", 2023-10-08T07:07:47.898 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7199999999999998e-07 2023-10-08T07:07:47.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.898 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.898 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.898 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.581969+0000", 2023-10-08T07:07:47.898 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0968000000000001e-05 2023-10-08T07:07:47.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.898 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.898 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.899 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.581977+0000", 2023-10-08T07:07:47.899 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6770000000000001e-06 2023-10-08T07:07:47.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.899 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.899 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.899 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.581983+0000", 2023-10-08T07:07:47.899 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4280000000000004e-06 2023-10-08T07:07:47.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.899 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.899 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.900 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.737671+0000", 2023-10-08T07:07:47.900 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.15568789199999999 2023-10-08T07:07:47.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.900 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.900 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.900 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.737729+0000", 2023-10-08T07:07:47.900 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8081000000000002e-05 2023-10-08T07:07:47.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.900 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.900 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.901 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760425+0000", 2023-10-08T07:07:47.901 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.022696187 2023-10-08T07:07:47.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.901 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.901 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760450+0000", 2023-10-08T07:07:47.901 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.482e-05 2023-10-08T07:07:47.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.901 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.902 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760486+0000", 2023-10-08T07:07:47.902 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6069000000000003e-05 2023-10-08T07:07:47.902 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.902 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.902 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.902 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.902 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175056 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1159168~8192,write 1310720~4096,write 1384448~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:47.902 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.585132+0000", 2023-10-08T07:07:47.902 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.17950280800000001, 2023-10-08T07:07:47.903 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.175403067, 2023-10-08T07:07:47.903 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:47.903 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:47.903 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:47.903 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:47.903 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:47.903 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175056 2023-10-08T07:07:47.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.903 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:47.903 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.904 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:47.904 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.585132+0000", 2023-10-08T07:07:47.904 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.904 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.904 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:47.904 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.585132+0000", 2023-10-08T07:07:47.904 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:47.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.904 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.904 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:47.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.585133+0000", 2023-10-08T07:07:47.905 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1299999999999998e-07 2023-10-08T07:07:47.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.905 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:47.905 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.585148+0000", 2023-10-08T07:07:47.905 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5245000000000001e-05 2023-10-08T07:07:47.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.905 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.905 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:47.906 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.585160+0000", 2023-10-08T07:07:47.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2299e-05 2023-10-08T07:07:47.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.906 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.906 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:47.906 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.585168+0000", 2023-10-08T07:07:47.906 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3769999999999998e-06 2023-10-08T07:07:47.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.906 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.906 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:47.907 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.739693+0000", 2023-10-08T07:07:47.907 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.154524932 2023-10-08T07:07:47.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.907 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.907 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:47.907 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.739743+0000", 2023-10-08T07:07:47.907 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0492999999999999e-05 2023-10-08T07:07:47.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.907 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.907 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:47.907 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.739840+0000", 2023-10-08T07:07:47.908 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.7009000000000006e-05 2023-10-08T07:07:47.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.908 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.908 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:47.908 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.743567+0000", 2023-10-08T07:07:47.908 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0037272170000000001 2023-10-08T07:07:47.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.908 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.908 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:47.908 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760490+0000", 2023-10-08T07:07:47.909 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016922887000000001 2023-10-08T07:07:47.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.909 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.909 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:47.909 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760515+0000", 2023-10-08T07:07:47.909 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.4510000000000001e-05 2023-10-08T07:07:47.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:47.909 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:47.909 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:47.909 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.760535+0000", 2023-10-08T07:07:47.909 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0185000000000001e-05 2023-10-08T07:07:47.910 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.910 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.910 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.910 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:47.910 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:47.910 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:47.912 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:47.912 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:47.910+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:47.962 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:48.013 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:48.012+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:48.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T07:07:48.116 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:48.115+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:48.132 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159371 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.932340+0000", 2023-10-08T07:07:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.173882646, 2023-10-08T07:07:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.173900647, 2023-10-08T07:07:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159371 2023-10-08T07:07:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.932340+0000", 2023-10-08T07:07:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.932340+0000", 2023-10-08T07:07:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.934295+0000", 2023-10-08T07:07:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001955282 2023-10-08T07:07:48.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.934317+0000", 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1691e-05 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.934333+0000", 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6121e-05 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.934341+0000", 2023-10-08T07:07:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8180000000000004e-06 2023-10-08T07:07:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159500 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.991344+0000", 2023-10-08T07:07:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.114877897, 2023-10-08T07:07:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1149351649999999, 2023-10-08T07:07:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.137 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159500 2023-10-08T07:07:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.991344+0000", 2023-10-08T07:07:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.991344+0000", 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.991345+0000", 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3000000000000001e-07 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.991357+0000", 2023-10-08T07:07:48.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2379e-05 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.991364+0000", 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5420000000000002e-06 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.991368+0000", 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.369e-06 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.141 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159538 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.141 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.005537+0000", 2023-10-08T07:07:48.141 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.100685055, 2023-10-08T07:07:48.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.100794424, 2023-10-08T07:07:48.141 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.141 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.141 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159538 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005537+0000", 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005537+0000", 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005538+0000", 2023-10-08T07:07:48.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2023-10-08T07:07:48.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005556+0000", 2023-10-08T07:07:48.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7669e-05 2023-10-08T07:07:48.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005562+0000", 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7920000000000004e-06 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005570+0000", 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3329999999999999e-06 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159660 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.144 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.063600+0000", 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.04262206, 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.042782206, 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159660 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.063600+0000", 2023-10-08T07:07:48.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.063600+0000", 2023-10-08T07:07:48.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.063601+0000", 2023-10-08T07:07:48.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9100000000000004e-07 2023-10-08T07:07:48.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.063621+0000", 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0171000000000001e-05 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.063629+0000", 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8550000000000002e-06 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.063634+0000", 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5550000000000002e-06 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159841 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.145491+0000", 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.96073170399999996, 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96095633199999997, 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.149 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159841 2023-10-08T07:07:48.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.149 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.145491+0000", 2023-10-08T07:07:48.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.145491+0000", 2023-10-08T07:07:48.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.145491+0000", 2023-10-08T07:07:48.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2100000000000002e-07 2023-10-08T07:07:48.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.145503+0000", 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1578e-05 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.145509+0000", 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6320000000000002e-06 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.145515+0000", 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2920000000000003e-06 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.151 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159873 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.161386+0000", 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.94483650100000005, 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94512825899999997, 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.152 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159873 2023-10-08T07:07:48.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.153 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161386+0000", 2023-10-08T07:07:48.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161386+0000", 2023-10-08T07:07:48.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161386+0000", 2023-10-08T07:07:48.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.32e-07 2023-10-08T07:07:48.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161404+0000", 2023-10-08T07:07:48.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7343999999999999e-05 2023-10-08T07:07:48.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161411+0000", 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4560000000000003e-06 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161416+0000", 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0329999999999999e-06 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.155 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160311 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.156 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.359182+0000", 2023-10-08T07:07:48.156 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74704050200000005, 2023-10-08T07:07:48.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.74739498000000004, 2023-10-08T07:07:48.156 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.156 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.156 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.156 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.156 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.156 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160311 2023-10-08T07:07:48.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.156 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.359182+0000", 2023-10-08T07:07:48.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.359182+0000", 2023-10-08T07:07:48.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.359182+0000", 2023-10-08T07:07:48.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2300000000000001e-07 2023-10-08T07:07:48.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.359199+0000", 2023-10-08T07:07:48.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6433999999999999e-05 2023-10-08T07:07:48.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.359206+0000", 2023-10-08T07:07:48.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3220000000000004e-06 2023-10-08T07:07:48.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.359211+0000", 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5569999999999997e-06 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161203 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.724940+0000", 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38128279399999998, 2023-10-08T07:07:48.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.38169915500000001, 2023-10-08T07:07:48.160 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.160 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.160 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.160 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.160 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.160 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161203 2023-10-08T07:07:48.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.160 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724940+0000", 2023-10-08T07:07:48.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724940+0000", 2023-10-08T07:07:48.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724940+0000", 2023-10-08T07:07:48.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2023-10-08T07:07:48.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724952+0000", 2023-10-08T07:07:48.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2288e-05 2023-10-08T07:07:48.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724958+0000", 2023-10-08T07:07:48.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7899999999999996e-06 2023-10-08T07:07:48.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724963+0000", 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5040000000000004e-06 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161429 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.820375+0000", 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28584701299999998, 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.28633287699999999, 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.165 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.165 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.165 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161429 2023-10-08T07:07:48.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.165 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.820375+0000", 2023-10-08T07:07:48.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.820375+0000", 2023-10-08T07:07:48.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.822296+0000", 2023-10-08T07:07:48.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019203289999999999 2023-10-08T07:07:48.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.822322+0000", 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6794000000000001e-05 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.822336+0000", 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3619e-05 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.822343+0000", 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2139999999999999e-06 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.167 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.168 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176090 4.3a e64/17 4:5f183e4b:::10000000004.00000023:head v 64'8091, mlcod=64'8075)", 2023-10-08T07:07:48.168 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.067378+0000", 2023-10-08T07:07:48.168 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.038844086999999999, 2023-10-08T07:07:48.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039392848000000001, 2023-10-08T07:07:48.168 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.168 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.168 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.067378+0000", 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.067378+0000", 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.067379+0000", 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8100000000000003e-07 2023-10-08T07:07:48.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.067392+0000", 2023-10-08T07:07:48.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3519999999999999e-05 2023-10-08T07:07:48.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.067404+0000", 2023-10-08T07:07:48.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1445e-05 2023-10-08T07:07:48.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.067410+0000", 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5350000000000001e-06 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.098342+0000", 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.030931589999999998 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.098360+0000", 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7654000000000001e-05 2023-10-08T07:07:48.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.172 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.172 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.172 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161941 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.172 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.083381+0000", 2023-10-08T07:07:48.172 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.022840928999999999, 2023-10-08T07:07:48.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023449384, 2023-10-08T07:07:48.172 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.172 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.172 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.172 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161941 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083381+0000", 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083381+0000", 2023-10-08T07:07:48.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.085297+0000", 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019151890000000001 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.085313+0000", 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6453999999999999e-05 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.085327+0000", 2023-10-08T07:07:48.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4243999999999999e-05 2023-10-08T07:07:48.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.085337+0000", 2023-10-08T07:07:48.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8300000000000008e-06 2023-10-08T07:07:48.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.175 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.176 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161966 4.15 4:aaa619cf:::10000000004.00000004:head [write 3276800~8192 in=8192b,write 3461120~4096 in=4096b,write 4153344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.176 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.101410+0000", 2023-10-08T07:07:48.176 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0048128060000000002, 2023-10-08T07:07:48.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054944759999999999, 2023-10-08T07:07:48.176 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.176 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.176 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161966 2023-10-08T07:07:48.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.176 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101410+0000", 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101410+0000", 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101410+0000", 2023-10-08T07:07:48.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7e-07 2023-10-08T07:07:48.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101424+0000", 2023-10-08T07:07:48.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.375e-05 2023-10-08T07:07:48.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101430+0000", 2023-10-08T07:07:48.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6229999999999999e-06 2023-10-08T07:07:48.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101436+0000", 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101484+0000", 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8566000000000002e-05 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101564+0000", 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9474999999999994e-05 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159116 4.10 4:08d50e0e:::10000000004.0000003f:head [write 1982464~4096 in=4096b,write 2146304~4096 in=4096b,write 2359296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.799353+0000", 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.306869624, 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.307623177, 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.181 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159116 2023-10-08T07:07:48.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.799353+0000", 2023-10-08T07:07:48.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.799353+0000", 2023-10-08T07:07:48.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.803296+0000", 2023-10-08T07:07:48.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039430330000000003 2023-10-08T07:07:48.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.803316+0000", 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9956999999999999e-05 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.803328+0000", 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2755000000000001e-05 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.803336+0000", 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5820000000000004e-06 2023-10-08T07:07:48.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091796+0000", 2023-10-08T07:07:48.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2884599480000001 2023-10-08T07:07:48.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091884+0000", 2023-10-08T07:07:48.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8438999999999998e-05 2023-10-08T07:07:48.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.184 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159209 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.845379+0000", 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2608429489999999, 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2616623300000001, 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159209 2023-10-08T07:07:48.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.186 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.845379+0000", 2023-10-08T07:07:48.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.845379+0000", 2023-10-08T07:07:48.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.845380+0000", 2023-10-08T07:07:48.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0499999999999999e-07 2023-10-08T07:07:48.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.845396+0000", 2023-10-08T07:07:48.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6558999999999998e-05 2023-10-08T07:07:48.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.845403+0000", 2023-10-08T07:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8929999999999999e-06 2023-10-08T07:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.845408+0000", 2023-10-08T07:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000001e-06 2023-10-08T07:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.189 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159501 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.189 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.991375+0000", 2023-10-08T07:07:48.189 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.114847495, 2023-10-08T07:07:48.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.115720872, 2023-10-08T07:07:48.189 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.189 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.189 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.189 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.189 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.190 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159501 2023-10-08T07:07:48.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.190 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.991375+0000", 2023-10-08T07:07:48.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.991375+0000", 2023-10-08T07:07:48.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.991375+0000", 2023-10-08T07:07:48.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.27e-07 2023-10-08T07:07:48.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.991390+0000", 2023-10-08T07:07:48.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4399999999999999e-05 2023-10-08T07:07:48.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.991394+0000", 2023-10-08T07:07:48.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9940000000000002e-06 2023-10-08T07:07:48.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.991396+0000", 2023-10-08T07:07:48.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.864e-06 2023-10-08T07:07:48.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.194 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.194 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159615 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.194 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.031274+0000", 2023-10-08T07:07:48.195 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.074948676, 2023-10-08T07:07:48.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0758761130000001, 2023-10-08T07:07:48.195 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.195 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.195 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159615 2023-10-08T07:07:48.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.195 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.031274+0000", 2023-10-08T07:07:48.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.031274+0000", 2023-10-08T07:07:48.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.031276+0000", 2023-10-08T07:07:48.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0020000000000001e-06 2023-10-08T07:07:48.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.031293+0000", 2023-10-08T07:07:48.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7010000000000001e-05 2023-10-08T07:07:48.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.031298+0000", 2023-10-08T07:07:48.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7370000000000003e-06 2023-10-08T07:07:48.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.031305+0000", 2023-10-08T07:07:48.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.939e-06 2023-10-08T07:07:48.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.199 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160125 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.285405+0000", 2023-10-08T07:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.820817609, 2023-10-08T07:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82179965300000002, 2023-10-08T07:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160125 2023-10-08T07:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.285405+0000", 2023-10-08T07:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.285405+0000", 2023-10-08T07:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.285405+0000", 2023-10-08T07:07:48.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0299999999999999e-07 2023-10-08T07:07:48.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.285417+0000", 2023-10-08T07:07:48.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1297999999999999e-05 2023-10-08T07:07:48.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.285423+0000", 2023-10-08T07:07:48.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2580000000000001e-06 2023-10-08T07:07:48.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.285428+0000", 2023-10-08T07:07:48.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1050000000000003e-06 2023-10-08T07:07:48.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.203 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.203 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160165 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.204 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.295352+0000", 2023-10-08T07:07:48.204 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.81087021199999998, 2023-10-08T07:07:48.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.81191416699999996, 2023-10-08T07:07:48.204 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.204 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.205 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160165 2023-10-08T07:07:48.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.205 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.295352+0000", 2023-10-08T07:07:48.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.295352+0000", 2023-10-08T07:07:48.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.297296+0000", 2023-10-08T07:07:48.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019434350000000001 2023-10-08T07:07:48.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.297314+0000", 2023-10-08T07:07:48.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8711000000000001e-05 2023-10-08T07:07:48.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.297328+0000", 2023-10-08T07:07:48.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3661e-05 2023-10-08T07:07:48.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.297335+0000", 2023-10-08T07:07:48.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4889999999999998e-06 2023-10-08T07:07:48.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.209 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.210 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160212 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.210 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.313370+0000", 2023-10-08T07:07:48.211 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.79285281500000004, 2023-10-08T07:07:48.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.79395472899999997, 2023-10-08T07:07:48.211 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.211 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.211 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160212 2023-10-08T07:07:48.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.212 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.313370+0000", 2023-10-08T07:07:48.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.313370+0000", 2023-10-08T07:07:48.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.315296+0000", 2023-10-08T07:07:48.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001925993 2023-10-08T07:07:48.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.315312+0000", 2023-10-08T07:07:48.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6625000000000001e-05 2023-10-08T07:07:48.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.315320+0000", 2023-10-08T07:07:48.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2660000000000001e-06 2023-10-08T07:07:48.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.315326+0000", 2023-10-08T07:07:48.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3979999999999998e-06 2023-10-08T07:07:48.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.216 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.217 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160521 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.217 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.426426+0000", 2023-10-08T07:07:48.217 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67979591500000003, 2023-10-08T07:07:48.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.680950057, 2023-10-08T07:07:48.217 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.217 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.217 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.218 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160521 2023-10-08T07:07:48.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.218 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426426+0000", 2023-10-08T07:07:48.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426426+0000", 2023-10-08T07:07:48.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426427+0000", 2023-10-08T07:07:48.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.39e-07 2023-10-08T07:07:48.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426437+0000", 2023-10-08T07:07:48.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0552e-05 2023-10-08T07:07:48.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426443+0000", 2023-10-08T07:07:48.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.728e-06 2023-10-08T07:07:48.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426448+0000", 2023-10-08T07:07:48.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5940000000000004e-06 2023-10-08T07:07:48.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.224 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.225 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160976 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.225 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.610158+0000", 2023-10-08T07:07:48.225 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.49606460699999999, 2023-10-08T07:07:48.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.49727135, 2023-10-08T07:07:48.225 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.225 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.225 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.226 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.226 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.226 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160976 2023-10-08T07:07:48.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.226 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610158+0000", 2023-10-08T07:07:48.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610158+0000", 2023-10-08T07:07:48.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610158+0000", 2023-10-08T07:07:48.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5999999999999999e-07 2023-10-08T07:07:48.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610171+0000", 2023-10-08T07:07:48.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2388000000000001e-05 2023-10-08T07:07:48.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610177+0000", 2023-10-08T07:07:48.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0530000000000003e-06 2023-10-08T07:07:48.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610181+0000", 2023-10-08T07:07:48.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8099999999999997e-06 2023-10-08T07:07:48.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.230 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.231 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161550 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.231 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.869377+0000", 2023-10-08T07:07:48.231 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.23684539499999999, 2023-10-08T07:07:48.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.2381056, 2023-10-08T07:07:48.231 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.231 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.231 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161550 2023-10-08T07:07:48.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.232 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.869377+0000", 2023-10-08T07:07:48.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.869377+0000", 2023-10-08T07:07:48.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.871362+0000", 2023-10-08T07:07:48.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019849139999999999 2023-10-08T07:07:48.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.871376+0000", 2023-10-08T07:07:48.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3816e-05 2023-10-08T07:07:48.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.871386+0000", 2023-10-08T07:07:48.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242e-05 2023-10-08T07:07:48.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.871393+0000", 2023-10-08T07:07:48.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2790000000000001e-06 2023-10-08T07:07:48.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.235 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.235 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161944 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.235 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.085350+0000", 2023-10-08T07:07:48.236 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.020872522000000001, 2023-10-08T07:07:48.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022185785999999999, 2023-10-08T07:07:48.236 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.236 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.236 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.236 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.237 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161944 2023-10-08T07:07:48.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.237 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.085350+0000", 2023-10-08T07:07:48.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.085350+0000", 2023-10-08T07:07:48.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.085350+0000", 2023-10-08T07:07:48.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2023-10-08T07:07:48.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.085364+0000", 2023-10-08T07:07:48.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3509000000000001e-05 2023-10-08T07:07:48.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.085370+0000", 2023-10-08T07:07:48.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.64e-06 2023-10-08T07:07:48.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.085376+0000", 2023-10-08T07:07:48.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2229999999999998e-06 2023-10-08T07:07:48.242 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.242 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.242 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.243 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161970 4.3e 4:7cb83261:::10000000004.0000003b:head [write 3321856~4096 in=4096b,write 3629056~4096 in=4096b,write 3694592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.243 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.101449+0000", 2023-10-08T07:07:48.243 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0047738570000000003, 2023-10-08T07:07:48.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061480399999999996, 2023-10-08T07:07:48.243 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.243 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.244 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161970 2023-10-08T07:07:48.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.244 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101449+0000", 2023-10-08T07:07:48.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101449+0000", 2023-10-08T07:07:48.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101449+0000", 2023-10-08T07:07:48.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1099999999999995e-07 2023-10-08T07:07:48.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101466+0000", 2023-10-08T07:07:48.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6901999999999998e-05 2023-10-08T07:07:48.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101473+0000", 2023-10-08T07:07:48.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9369999999999998e-06 2023-10-08T07:07:48.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101478+0000", 2023-10-08T07:07:48.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1599999999999997e-06 2023-10-08T07:07:48.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102816+0000", 2023-10-08T07:07:48.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013379900000000001 2023-10-08T07:07:48.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102898+0000", 2023-10-08T07:07:48.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1966999999999996e-05 2023-10-08T07:07:48.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.250 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.251 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.251 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159541 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.251 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.005609+0000", 2023-10-08T07:07:48.251 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.100613402, 2023-10-08T07:07:48.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1020543620000001, 2023-10-08T07:07:48.252 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.252 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.252 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.252 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.252 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.252 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159541 2023-10-08T07:07:48.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.253 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005609+0000", 2023-10-08T07:07:48.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005609+0000", 2023-10-08T07:07:48.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005609+0000", 2023-10-08T07:07:48.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4099999999999999e-07 2023-10-08T07:07:48.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005629+0000", 2023-10-08T07:07:48.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9598000000000001e-05 2023-10-08T07:07:48.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005637+0000", 2023-10-08T07:07:48.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8310000000000001e-06 2023-10-08T07:07:48.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005643+0000", 2023-10-08T07:07:48.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.959e-06 2023-10-08T07:07:48.257 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.257 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.258 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.258 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160659 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.258 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.482339+0000", 2023-10-08T07:07:48.259 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.62388340099999995, 2023-10-08T07:07:48.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.62539075099999997, 2023-10-08T07:07:48.259 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.259 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.259 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.259 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.259 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.259 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160659 2023-10-08T07:07:48.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.259 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.482339+0000", 2023-10-08T07:07:48.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.482339+0000", 2023-10-08T07:07:48.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.484639+0000", 2023-10-08T07:07:48.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023004980000000002 2023-10-08T07:07:48.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.484654+0000", 2023-10-08T07:07:48.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4980000000000001e-05 2023-10-08T07:07:48.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.484664+0000", 2023-10-08T07:07:48.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9890000000000004e-06 2023-10-08T07:07:48.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.484672+0000", 2023-10-08T07:07:48.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1149999999999996e-06 2023-10-08T07:07:48.262 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.262 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.262 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.263 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160690 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.263 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.497428+0000", 2023-10-08T07:07:48.263 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.60879396799999996, 2023-10-08T07:07:48.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61035570400000005, 2023-10-08T07:07:48.263 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.263 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.263 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160690 2023-10-08T07:07:48.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.264 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.497428+0000", 2023-10-08T07:07:48.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.497428+0000", 2023-10-08T07:07:48.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.497429+0000", 2023-10-08T07:07:48.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1800000000000005e-07 2023-10-08T07:07:48.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.497448+0000", 2023-10-08T07:07:48.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8505e-05 2023-10-08T07:07:48.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.497457+0000", 2023-10-08T07:07:48.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3950000000000007e-06 2023-10-08T07:07:48.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.497465+0000", 2023-10-08T07:07:48.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9689999999999994e-06 2023-10-08T07:07:48.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.267 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.268 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.268 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161007 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.268 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.624393+0000", 2023-10-08T07:07:48.268 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48182925599999998, 2023-10-08T07:07:48.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48344628299999998, 2023-10-08T07:07:48.269 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.269 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.270 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161007 2023-10-08T07:07:48.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.270 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.624393+0000", 2023-10-08T07:07:48.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.624393+0000", 2023-10-08T07:07:48.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.624394+0000", 2023-10-08T07:07:48.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2023-10-08T07:07:48.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.624410+0000", 2023-10-08T07:07:48.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6478e-05 2023-10-08T07:07:48.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.624419+0000", 2023-10-08T07:07:48.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5450000000000003e-06 2023-10-08T07:07:48.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.624422+0000", 2023-10-08T07:07:48.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5870000000000001e-06 2023-10-08T07:07:48.275 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.275 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.275 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.276 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161147 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.276 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.692445+0000", 2023-10-08T07:07:48.276 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.41377771699999999, 2023-10-08T07:07:48.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41545526999999999, 2023-10-08T07:07:48.277 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.277 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.277 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.277 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.277 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.277 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161147 2023-10-08T07:07:48.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.278 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.692445+0000", 2023-10-08T07:07:48.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.692445+0000", 2023-10-08T07:07:48.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.696297+0000", 2023-10-08T07:07:48.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038520300000000002 2023-10-08T07:07:48.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.696317+0000", 2023-10-08T07:07:48.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0302999999999999e-05 2023-10-08T07:07:48.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.696328+0000", 2023-10-08T07:07:48.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1361e-05 2023-10-08T07:07:48.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.696337+0000", 2023-10-08T07:07:48.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2260000000000005e-06 2023-10-08T07:07:48.281 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.281 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.282 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161381 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.282 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.803338+0000", 2023-10-08T07:07:48.282 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.30288429700000002, 2023-10-08T07:07:48.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.304616255, 2023-10-08T07:07:48.282 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.282 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.283 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161381 2023-10-08T07:07:48.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.283 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.803338+0000", 2023-10-08T07:07:48.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.803338+0000", 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.803338+0000", 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6399999999999998e-07 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.803351+0000", 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2170999999999999e-05 2023-10-08T07:07:48.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.803358+0000", 2023-10-08T07:07:48.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2180000000000002e-06 2023-10-08T07:07:48.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.803363+0000", 2023-10-08T07:07:48.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4639999999999997e-06 2023-10-08T07:07:48.285 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.285 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.285 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176027 4.3a e64/17 4:5d52ad5e:::10000000004.00000026:head v 64'8087, mlcod=64'8074)", 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.051008+0000", 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.055214271000000002, 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056980812999999998, 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.051008+0000", 2023-10-08T07:07:48.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.051008+0000", 2023-10-08T07:07:48.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.051009+0000", 2023-10-08T07:07:48.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6599999999999996e-07 2023-10-08T07:07:48.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.051020+0000", 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1722000000000001e-05 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.051032+0000", 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1522000000000001e-05 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.051039+0000", 2023-10-08T07:07:48.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6159999999999998e-06 2023-10-08T07:07:48.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083911+0000", 2023-10-08T07:07:48.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.032872489999999997 2023-10-08T07:07:48.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083931+0000", 2023-10-08T07:07:48.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9944000000000001e-05 2023-10-08T07:07:48.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:48.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.107563+0000", 2023-10-08T07:07:48.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023631672999999999 2023-10-08T07:07:48.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:48.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.107989+0000", 2023-10-08T07:07:48.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042618000000000002 2023-10-08T07:07:48.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.291 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.291 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.291 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176150 4.3a e64/17)", 2023-10-08T07:07:48.291 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.086045+0000", 2023-10-08T07:07:48.291 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.020177197000000001, 2023-10-08T07:07:48.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022032739999999999, 2023-10-08T07:07:48.291 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.291 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.291 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.086045+0000", 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.086045+0000", 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.086046+0000", 2023-10-08T07:07:48.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9800000000000003e-07 2023-10-08T07:07:48.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.086061+0000", 2023-10-08T07:07:48.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4990999999999999e-05 2023-10-08T07:07:48.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.086070+0000", 2023-10-08T07:07:48.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1870000000000003e-06 2023-10-08T07:07:48.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.086077+0000", 2023-10-08T07:07:48.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0539999999999997e-06 2023-10-08T07:07:48.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.294 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.294 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161980 4.19 4:9b26afe3:::10000000004.00000005:head [write 1617920~4096 in=4096b,write 1990656~4096 in=4096b,write 2252800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.294 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.101491+0000", 2023-10-08T07:07:48.294 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0047316279999999999, 2023-10-08T07:07:48.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066415900000000002, 2023-10-08T07:07:48.295 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.295 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.295 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161980 2023-10-08T07:07:48.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.295 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101491+0000", 2023-10-08T07:07:48.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101491+0000", 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101491+0000", 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.82e-07 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101504+0000", 2023-10-08T07:07:48.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3123e-05 2023-10-08T07:07:48.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101511+0000", 2023-10-08T07:07:48.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4239999999999998e-06 2023-10-08T07:07:48.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101516+0000", 2023-10-08T07:07:48.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:07:48.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.107518+0000", 2023-10-08T07:07:48.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060021930000000003 2023-10-08T07:07:48.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.107611+0000", 2023-10-08T07:07:48.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2447000000000004e-05 2023-10-08T07:07:48.298 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.299 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.299 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159263 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.299 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.874357+0000", 2023-10-08T07:07:48.299 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2318655350000001, 2023-10-08T07:07:48.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.233843668, 2023-10-08T07:07:48.299 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.299 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.299 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159263 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.874357+0000", 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.874357+0000", 2023-10-08T07:07:48.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.874357+0000", 2023-10-08T07:07:48.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:07:48.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.874372+0000", 2023-10-08T07:07:48.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4901e-05 2023-10-08T07:07:48.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.874381+0000", 2023-10-08T07:07:48.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9940000000000006e-06 2023-10-08T07:07:48.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.874387+0000", 2023-10-08T07:07:48.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4199999999999998e-06 2023-10-08T07:07:48.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.302 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.303 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159786 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.303 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.115388+0000", 2023-10-08T07:07:48.303 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.99083484200000005, 2023-10-08T07:07:48.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.99287463099999995, 2023-10-08T07:07:48.303 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.303 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.303 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159786 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.115388+0000", 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.115388+0000", 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.117294+0000", 2023-10-08T07:07:48.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001906219 2023-10-08T07:07:48.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.117309+0000", 2023-10-08T07:07:48.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5412000000000001e-05 2023-10-08T07:07:48.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.117319+0000", 2023-10-08T07:07:48.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4380000000000001e-06 2023-10-08T07:07:48.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.117326+0000", 2023-10-08T07:07:48.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9120000000000001e-06 2023-10-08T07:07:48.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.306 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.306 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160216 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.315362+0000", 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.79086009400000001, 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.792959882, 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160216 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.315362+0000", 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.315362+0000", 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.315363+0000", 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8999999999999998e-07 2023-10-08T07:07:48.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.315378+0000", 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.52e-05 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.315384+0000", 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1720000000000004e-06 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.315387+0000", 2023-10-08T07:07:48.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0960000000000001e-06 2023-10-08T07:07:48.310 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.310 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.310 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.310 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160474 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.310 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.414342+0000", 2023-10-08T07:07:48.310 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.69188085300000002, 2023-10-08T07:07:48.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.69403532400000001, 2023-10-08T07:07:48.310 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.310 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.311 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160474 2023-10-08T07:07:48.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.311 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.414342+0000", 2023-10-08T07:07:48.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.414342+0000", 2023-10-08T07:07:48.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.418294+0000", 2023-10-08T07:07:48.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039523650000000002 2023-10-08T07:07:48.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.418312+0000", 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7876e-05 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.418322+0000", 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0668e-05 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.418330+0000", 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8909999999999995e-06 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.313 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.314 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.314 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176648 4.2b e64/17 4:d7a77d67:::10000000004.00000029:head v 64'5562, mlcod=64'5559)", 2023-10-08T07:07:48.314 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.086089+0000", 2023-10-08T07:07:48.314 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.020132891, 2023-10-08T07:07:48.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022344190999999999, 2023-10-08T07:07:48.314 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.314 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.314 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.086089+0000", 2023-10-08T07:07:48.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.086089+0000", 2023-10-08T07:07:48.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.086090+0000", 2023-10-08T07:07:48.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000002e-07 2023-10-08T07:07:48.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.086104+0000", 2023-10-08T07:07:48.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4245e-05 2023-10-08T07:07:48.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.086110+0000", 2023-10-08T07:07:48.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2280000000000003e-06 2023-10-08T07:07:48.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.086115+0000", 2023-10-08T07:07:48.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7829999999999998e-06 2023-10-08T07:07:48.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094477+0000", 2023-10-08T07:07:48.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083622260000000004 2023-10-08T07:07:48.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094490+0000", 2023-10-08T07:07:48.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2864000000000001e-05 2023-10-08T07:07:48.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.318 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.318 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161982 4.3e 4.864c1d3e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.318 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.101524+0000", 2023-10-08T07:07:48.318 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.004698837, 2023-10-08T07:07:48.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069689230000000001, 2023-10-08T07:07:48.318 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161982 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101524+0000", 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101524+0000", 2023-10-08T07:07:48.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101524+0000", 2023-10-08T07:07:48.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0999999999999999e-07 2023-10-08T07:07:48.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101540+0000", 2023-10-08T07:07:48.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6189e-05 2023-10-08T07:07:48.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101547+0000", 2023-10-08T07:07:48.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6800000000000004e-06 2023-10-08T07:07:48.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101552+0000", 2023-10-08T07:07:48.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1939999999999997e-06 2023-10-08T07:07:48.321 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.322 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.322 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159120 4.10 4:0b5763e1:::10000000004.00000015:head [write 3117056~4096 in=4096b,write 3149824~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.322 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.803392+0000", 2023-10-08T07:07:48.322 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.302830479, 2023-10-08T07:07:48.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3051580860000001, 2023-10-08T07:07:48.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.323 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159120 2023-10-08T07:07:48.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.323 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.803392+0000", 2023-10-08T07:07:48.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.803392+0000", 2023-10-08T07:07:48.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.805294+0000", 2023-10-08T07:07:48.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001902125 2023-10-08T07:07:48.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.805310+0000", 2023-10-08T07:07:48.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6354999999999998e-05 2023-10-08T07:07:48.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.805324+0000", 2023-10-08T07:07:48.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3841e-05 2023-10-08T07:07:48.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.805333+0000", 2023-10-08T07:07:48.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9530000000000005e-06 2023-10-08T07:07:48.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097453+0000", 2023-10-08T07:07:48.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.292120323 2023-10-08T07:07:48.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097523+0000", 2023-10-08T07:07:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9465e-05 2023-10-08T07:07:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159166 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.816011+0000", 2023-10-08T07:07:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.290211649, 2023-10-08T07:07:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.292602652, 2023-10-08T07:07:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.327 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159166 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.816011+0000", 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.816011+0000", 2023-10-08T07:07:48.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.819294+0000", 2023-10-08T07:07:48.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032831739999999998 2023-10-08T07:07:48.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.819315+0000", 2023-10-08T07:07:48.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0682999999999998e-05 2023-10-08T07:07:48.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.819326+0000", 2023-10-08T07:07:48.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1457000000000001e-05 2023-10-08T07:07:48.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.819338+0000", 2023-10-08T07:07:48.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2074e-05 2023-10-08T07:07:48.330 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.331 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.331 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160005 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.331 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.222563+0000", 2023-10-08T07:07:48.331 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.88365956800000001, 2023-10-08T07:07:48.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88610331899999994, 2023-10-08T07:07:48.331 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.331 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160005 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.222563+0000", 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.222563+0000", 2023-10-08T07:07:48.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225307+0000", 2023-10-08T07:07:48.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027438639999999999 2023-10-08T07:07:48.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225326+0000", 2023-10-08T07:07:48.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9258000000000001e-05 2023-10-08T07:07:48.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225339+0000", 2023-10-08T07:07:48.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3239e-05 2023-10-08T07:07:48.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225346+0000", 2023-10-08T07:07:48.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2790000000000001e-06 2023-10-08T07:07:48.334 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.335 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.335 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160475 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.335 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.418344+0000", 2023-10-08T07:07:48.335 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.687878498, 2023-10-08T07:07:48.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.69037380999999998, 2023-10-08T07:07:48.335 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.335 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.336 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160475 2023-10-08T07:07:48.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.336 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.418344+0000", 2023-10-08T07:07:48.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.418344+0000", 2023-10-08T07:07:48.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.418344+0000", 2023-10-08T07:07:48.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2023-10-08T07:07:48.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.418360+0000", 2023-10-08T07:07:48.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5696999999999999e-05 2023-10-08T07:07:48.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.418366+0000", 2023-10-08T07:07:48.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4709999999999998e-06 2023-10-08T07:07:48.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.418385+0000", 2023-10-08T07:07:48.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9106999999999998e-05 2023-10-08T07:07:48.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.338 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.339 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160927 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.339 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.584324+0000", 2023-10-08T07:07:48.339 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.52189845400000001, 2023-10-08T07:07:48.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.52444890300000002, 2023-10-08T07:07:48.339 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.339 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.339 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.340 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160927 2023-10-08T07:07:48.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.340 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.584324+0000", 2023-10-08T07:07:48.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.584324+0000", 2023-10-08T07:07:48.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.584325+0000", 2023-10-08T07:07:48.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8100000000000002e-07 2023-10-08T07:07:48.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.584344+0000", 2023-10-08T07:07:48.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9419000000000002e-05 2023-10-08T07:07:48.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.584351+0000", 2023-10-08T07:07:48.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8719999999999996e-06 2023-10-08T07:07:48.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.584357+0000", 2023-10-08T07:07:48.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8089999999999998e-06 2023-10-08T07:07:48.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.342 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161179 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.710349+0000", 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39587314299999998, 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39848318700000002, 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161179 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.343 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.710349+0000", 2023-10-08T07:07:48.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.710349+0000", 2023-10-08T07:07:48.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.710350+0000", 2023-10-08T07:07:48.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6199999999999998e-07 2023-10-08T07:07:48.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.710363+0000", 2023-10-08T07:07:48.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2763e-05 2023-10-08T07:07:48.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.710369+0000", 2023-10-08T07:07:48.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3459999999999999e-06 2023-10-08T07:07:48.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.710374+0000", 2023-10-08T07:07:48.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000004e-06 2023-10-08T07:07:48.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.346 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.346 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161984 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.346 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.101559+0000", 2023-10-08T07:07:48.347 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0046629460000000003, 2023-10-08T07:07:48.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007332748, 2023-10-08T07:07:48.347 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.347 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.347 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161984 2023-10-08T07:07:48.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.347 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101559+0000", 2023-10-08T07:07:48.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101559+0000", 2023-10-08T07:07:48.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101560+0000", 2023-10-08T07:07:48.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3500000000000002e-07 2023-10-08T07:07:48.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101574+0000", 2023-10-08T07:07:48.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4467000000000001e-05 2023-10-08T07:07:48.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101582+0000", 2023-10-08T07:07:48.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0269999999999995e-06 2023-10-08T07:07:48.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101588+0000", 2023-10-08T07:07:48.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9120000000000003e-06 2023-10-08T07:07:48.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.350 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.350 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159374 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.350 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.938367+0000", 2023-10-08T07:07:48.350 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.167855573, 2023-10-08T07:07:48.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.170585701, 2023-10-08T07:07:48.351 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.351 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.351 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.351 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159374 2023-10-08T07:07:48.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.351 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.938367+0000", 2023-10-08T07:07:48.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.938367+0000", 2023-10-08T07:07:48.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.938367+0000", 2023-10-08T07:07:48.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3000000000000001e-07 2023-10-08T07:07:48.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.938382+0000", 2023-10-08T07:07:48.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4929000000000001e-05 2023-10-08T07:07:48.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.938389+0000", 2023-10-08T07:07:48.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1910000000000003e-06 2023-10-08T07:07:48.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.938396+0000", 2023-10-08T07:07:48.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4300000000000003e-06 2023-10-08T07:07:48.354 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.354 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.354 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.354 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159620 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.354 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.031445+0000", 2023-10-08T07:07:48.354 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0747771159999999, 2023-10-08T07:07:48.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0775674550000001, 2023-10-08T07:07:48.354 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.355 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.355 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159620 2023-10-08T07:07:48.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.355 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.031445+0000", 2023-10-08T07:07:48.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.031445+0000", 2023-10-08T07:07:48.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.031447+0000", 2023-10-08T07:07:48.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.187e-06 2023-10-08T07:07:48.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.031470+0000", 2023-10-08T07:07:48.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2832000000000001e-05 2023-10-08T07:07:48.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.031476+0000", 2023-10-08T07:07:48.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1890000000000004e-06 2023-10-08T07:07:48.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.031483+0000", 2023-10-08T07:07:48.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7449999999999998e-06 2023-10-08T07:07:48.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.358 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.358 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159765 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.358 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.103349+0000", 2023-10-08T07:07:48.358 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.002873366, 2023-10-08T07:07:48.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0057244169999999, 2023-10-08T07:07:48.358 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.358 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.359 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159765 2023-10-08T07:07:48.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.359 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.103349+0000", 2023-10-08T07:07:48.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.103349+0000", 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.103349+0000", 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3700000000000001e-07 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.103364+0000", 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4447000000000001e-05 2023-10-08T07:07:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.103371+0000", 2023-10-08T07:07:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8329999999999996e-06 2023-10-08T07:07:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.103376+0000", 2023-10-08T07:07:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1109999999999999e-06 2023-10-08T07:07:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.362 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159886 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.362 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.161557+0000", 2023-10-08T07:07:48.362 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.94466566200000002, 2023-10-08T07:07:48.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.94757669700000002, 2023-10-08T07:07:48.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.362 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159886 2023-10-08T07:07:48.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.363 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161557+0000", 2023-10-08T07:07:48.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161557+0000", 2023-10-08T07:07:48.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161557+0000", 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4199999999999996e-07 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161571+0000", 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3305999999999999e-05 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161576+0000", 2023-10-08T07:07:48.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6799999999999998e-06 2023-10-08T07:07:48.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161581+0000", 2023-10-08T07:07:48.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6020000000000002e-06 2023-10-08T07:07:48.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.365 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.366 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159938 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.366 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.186473+0000", 2023-10-08T07:07:48.366 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.91974891199999997, 2023-10-08T07:07:48.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.92272309699999999, 2023-10-08T07:07:48.366 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.366 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.366 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159938 2023-10-08T07:07:48.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.186473+0000", 2023-10-08T07:07:48.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.186473+0000", 2023-10-08T07:07:48.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.186474+0000", 2023-10-08T07:07:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3700000000000001e-07 2023-10-08T07:07:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.186484+0000", 2023-10-08T07:07:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7259999999999997e-06 2023-10-08T07:07:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.186490+0000", 2023-10-08T07:07:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3369999999999996e-06 2023-10-08T07:07:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.186495+0000", 2023-10-08T07:07:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3170000000000001e-06 2023-10-08T07:07:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160008 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.225360+0000", 2023-10-08T07:07:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.88086192500000005, 2023-10-08T07:07:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88389540700000002, 2023-10-08T07:07:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160008 2023-10-08T07:07:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225360+0000", 2023-10-08T07:07:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225360+0000", 2023-10-08T07:07:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225361+0000", 2023-10-08T07:07:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2023-10-08T07:07:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225373+0000", 2023-10-08T07:07:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2417e-05 2023-10-08T07:07:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225382+0000", 2023-10-08T07:07:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3590000000000008e-06 2023-10-08T07:07:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225388+0000", 2023-10-08T07:07:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5119999999999997e-06 2023-10-08T07:07:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161119 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.682685+0000", 2023-10-08T07:07:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42353732599999999, 2023-10-08T07:07:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.42663899, 2023-10-08T07:07:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161119 2023-10-08T07:07:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.682685+0000", 2023-10-08T07:07:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.682685+0000", 2023-10-08T07:07:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.682686+0000", 2023-10-08T07:07:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.89e-07 2023-10-08T07:07:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.682698+0000", 2023-10-08T07:07:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2554e-05 2023-10-08T07:07:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.682705+0000", 2023-10-08T07:07:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5359999999999998e-06 2023-10-08T07:07:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.682710+0000", 2023-10-08T07:07:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.412e-06 2023-10-08T07:07:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161707 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.931354+0000", 2023-10-08T07:07:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.17486886900000001, 2023-10-08T07:07:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17802831999999999, 2023-10-08T07:07:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161707 2023-10-08T07:07:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.931354+0000", 2023-10-08T07:07:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.931354+0000", 2023-10-08T07:07:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.931354+0000", 2023-10-08T07:07:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7400000000000003e-07 2023-10-08T07:07:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.931372+0000", 2023-10-08T07:07:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8281999999999999e-05 2023-10-08T07:07:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.931380+0000", 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7919999999999993e-06 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.931387+0000", 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3589999999999996e-06 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161782 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.977429+0000", 2023-10-08T07:07:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.12879374399999999, 2023-10-08T07:07:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13200583299999999, 2023-10-08T07:07:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161782 2023-10-08T07:07:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.977429+0000", 2023-10-08T07:07:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.977429+0000", 2023-10-08T07:07:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.979293+0000", 2023-10-08T07:07:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018648 2023-10-08T07:07:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.979309+0000", 2023-10-08T07:07:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5838999999999999e-05 2023-10-08T07:07:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.979349+0000", 2023-10-08T07:07:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.994e-05 2023-10-08T07:07:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.979357+0000", 2023-10-08T07:07:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5290000000000003e-06 2023-10-08T07:07:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161805 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.995356+0000", 2023-10-08T07:07:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.11086617999999999, 2023-10-08T07:07:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.114131102, 2023-10-08T07:07:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161805 2023-10-08T07:07:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.995356+0000", 2023-10-08T07:07:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.995356+0000", 2023-10-08T07:07:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.997698+0000", 2023-10-08T07:07:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023417550000000001 2023-10-08T07:07:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.997723+0000", 2023-10-08T07:07:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5320000000000002e-05 2023-10-08T07:07:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.997753+0000", 2023-10-08T07:07:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9643000000000001e-05 2023-10-08T07:07:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.997768+0000", 2023-10-08T07:07:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4942e-05 2023-10-08T07:07:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176094 4.3a e64/17 4:5d52ad5e:::10000000004.00000026:head v 64'8092, mlcod=64'8077)", 2023-10-08T07:07:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.070803+0000", 2023-10-08T07:07:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.035419154000000001, 2023-10-08T07:07:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038738823999999998, 2023-10-08T07:07:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.070803+0000", 2023-10-08T07:07:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.070803+0000", 2023-10-08T07:07:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.070804+0000", 2023-10-08T07:07:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3499999999999996e-07 2023-10-08T07:07:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.070819+0000", 2023-10-08T07:07:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5325e-05 2023-10-08T07:07:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.070829+0000", 2023-10-08T07:07:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0047999999999999e-05 2023-10-08T07:07:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.070836+0000", 2023-10-08T07:07:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9009999999999997e-06 2023-10-08T07:07:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.100710+0000", 2023-10-08T07:07:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.029873571000000002 2023-10-08T07:07:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.100730+0000", 2023-10-08T07:07:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0477000000000001e-05 2023-10-08T07:07:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161947 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.085383+0000", 2023-10-08T07:07:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.020839399000000002, 2023-10-08T07:07:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024217849999999999, 2023-10-08T07:07:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161947 2023-10-08T07:07:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.085383+0000", 2023-10-08T07:07:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.085383+0000", 2023-10-08T07:07:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.087296+0000", 2023-10-08T07:07:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019127770000000001 2023-10-08T07:07:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.087315+0000", 2023-10-08T07:07:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8984e-05 2023-10-08T07:07:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.087325+0000", 2023-10-08T07:07:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0465000000000001e-05 2023-10-08T07:07:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.087332+0000", 2023-10-08T07:07:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.25e-06 2023-10-08T07:07:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161985 4.14 4:2b72a8af:::10000000004.0000000c:head [write 4157440~4096 in=4096b,write 4182016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.101596+0000", 2023-10-08T07:07:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0046262600000000001, 2023-10-08T07:07:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080633949999999992, 2023-10-08T07:07:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161985 2023-10-08T07:07:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101596+0000", 2023-10-08T07:07:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101596+0000", 2023-10-08T07:07:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101597+0000", 2023-10-08T07:07:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2023-10-08T07:07:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101606+0000", 2023-10-08T07:07:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7699999999999996e-06 2023-10-08T07:07:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101613+0000", 2023-10-08T07:07:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7710000000000001e-06 2023-10-08T07:07:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101618+0000", 2023-10-08T07:07:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3569999999999997e-06 2023-10-08T07:07:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104753+0000", 2023-10-08T07:07:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031345610000000001 2023-10-08T07:07:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104838+0000", 2023-10-08T07:07:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5360999999999998e-05 2023-10-08T07:07:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159096 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3952640~4096 in=4096b,write 3973120~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.788428+0000", 2023-10-08T07:07:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.3177946030000001, 2023-10-08T07:07:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3213017200000001, 2023-10-08T07:07:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159096 2023-10-08T07:07:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.788428+0000", 2023-10-08T07:07:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.788428+0000", 2023-10-08T07:07:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.792064+0000", 2023-10-08T07:07:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036365690000000001 2023-10-08T07:07:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.792080+0000", 2023-10-08T07:07:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5461e-05 2023-10-08T07:07:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.792090+0000", 2023-10-08T07:07:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0341e-05 2023-10-08T07:07:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.792098+0000", 2023-10-08T07:07:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.824e-06 2023-10-08T07:07:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.089526+0000", 2023-10-08T07:07:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2974275739999999 2023-10-08T07:07:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.089643+0000", 2023-10-08T07:07:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0001172 2023-10-08T07:07:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.089831+0000", 2023-10-08T07:07:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018835299999999999 2023-10-08T07:07:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.100442+0000", 2023-10-08T07:07:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010611218 2023-10-08T07:07:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159631 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.051425+0000", 2023-10-08T07:07:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.054797158, 2023-10-08T07:07:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0583812720000001, 2023-10-08T07:07:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159631 2023-10-08T07:07:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.051425+0000", 2023-10-08T07:07:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.051425+0000", 2023-10-08T07:07:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.051426+0000", 2023-10-08T07:07:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2023-10-08T07:07:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.051439+0000", 2023-10-08T07:07:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.293e-05 2023-10-08T07:07:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.051445+0000", 2023-10-08T07:07:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9900000000000002e-06 2023-10-08T07:07:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.051450+0000", 2023-10-08T07:07:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5620000000000003e-06 2023-10-08T07:07:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.413 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.413 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159811 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.413 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.132342+0000", 2023-10-08T07:07:48.413 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.973880305, 2023-10-08T07:07:48.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.97751749200000004, 2023-10-08T07:07:48.413 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.413 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.414 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159811 2023-10-08T07:07:48.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.414 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.132342+0000", 2023-10-08T07:07:48.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.132342+0000", 2023-10-08T07:07:48.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.134296+0000", 2023-10-08T07:07:48.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019543350000000002 2023-10-08T07:07:48.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.134324+0000", 2023-10-08T07:07:48.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7229999999999998e-05 2023-10-08T07:07:48.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.134334+0000", 2023-10-08T07:07:48.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0175e-05 2023-10-08T07:07:48.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.134342+0000", 2023-10-08T07:07:48.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7020000000000001e-06 2023-10-08T07:07:48.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.417 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.418 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160315 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.360355+0000", 2023-10-08T07:07:48.418 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74586745200000004, 2023-10-08T07:07:48.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.74955782299999996, 2023-10-08T07:07:48.418 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.418 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.418 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160315 2023-10-08T07:07:48.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.419 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360355+0000", 2023-10-08T07:07:48.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360355+0000", 2023-10-08T07:07:48.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360355+0000", 2023-10-08T07:07:48.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1500000000000005e-07 2023-10-08T07:07:48.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360367+0000", 2023-10-08T07:07:48.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1080999999999999e-05 2023-10-08T07:07:48.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360374+0000", 2023-10-08T07:07:48.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.153e-06 2023-10-08T07:07:48.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360379+0000", 2023-10-08T07:07:48.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1680000000000003e-06 2023-10-08T07:07:48.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.422 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.422 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161987 4.3b 4:df82de1b:::10000000004.0000000f:head [write 3756032~8192 in=8192b,write 3825664~4096 in=4096b,write 3993600~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.422 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.101631+0000", 2023-10-08T07:07:48.423 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045917689999999999, 2023-10-08T07:07:48.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083404740000000005, 2023-10-08T07:07:48.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.423 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.423 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161987 2023-10-08T07:07:48.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.423 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101631+0000", 2023-10-08T07:07:48.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101631+0000", 2023-10-08T07:07:48.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101631+0000", 2023-10-08T07:07:48.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7300000000000001e-07 2023-10-08T07:07:48.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101648+0000", 2023-10-08T07:07:48.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7275999999999999e-05 2023-10-08T07:07:48.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101655+0000", 2023-10-08T07:07:48.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9179999999999997e-06 2023-10-08T07:07:48.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101661+0000", 2023-10-08T07:07:48.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8000000000000004e-06 2023-10-08T07:07:48.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.107800+0000", 2023-10-08T07:07:48.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00613848 2023-10-08T07:07:48.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.107876+0000", 2023-10-08T07:07:48.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6198999999999993e-05 2023-10-08T07:07:48.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.427 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.428 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159582 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.428 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.022402+0000", 2023-10-08T07:07:48.428 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0838199909999999, 2023-10-08T07:07:48.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0876429830000001, 2023-10-08T07:07:48.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.429 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159582 2023-10-08T07:07:48.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.429 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.022402+0000", 2023-10-08T07:07:48.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.022402+0000", 2023-10-08T07:07:48.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.022403+0000", 2023-10-08T07:07:48.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8800000000000002e-07 2023-10-08T07:07:48.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.022419+0000", 2023-10-08T07:07:48.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6396e-05 2023-10-08T07:07:48.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.022427+0000", 2023-10-08T07:07:48.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4270000000000002e-06 2023-10-08T07:07:48.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.022432+0000", 2023-10-08T07:07:48.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4920000000000001e-06 2023-10-08T07:07:48.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.432 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.432 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159844 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.432 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.147348+0000", 2023-10-08T07:07:48.433 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.95887401500000002, 2023-10-08T07:07:48.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96274893299999997, 2023-10-08T07:07:48.433 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.433 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.433 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.433 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159844 2023-10-08T07:07:48.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.433 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.147348+0000", 2023-10-08T07:07:48.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.147348+0000", 2023-10-08T07:07:48.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151295+0000", 2023-10-08T07:07:48.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039465430000000003 2023-10-08T07:07:48.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151310+0000", 2023-10-08T07:07:48.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5345e-05 2023-10-08T07:07:48.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151319+0000", 2023-10-08T07:07:48.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9509999999999995e-06 2023-10-08T07:07:48.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151325+0000", 2023-10-08T07:07:48.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4559999999999999e-06 2023-10-08T07:07:48.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.436 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.437 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160100 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.437 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.272354+0000", 2023-10-08T07:07:48.437 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.83386814499999995, 2023-10-08T07:07:48.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.83779471299999997, 2023-10-08T07:07:48.437 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.437 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.438 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.438 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160100 2023-10-08T07:07:48.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.438 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.272354+0000", 2023-10-08T07:07:48.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.272354+0000", 2023-10-08T07:07:48.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.272355+0000", 2023-10-08T07:07:48.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4200000000000001e-07 2023-10-08T07:07:48.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.272371+0000", 2023-10-08T07:07:48.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6359e-05 2023-10-08T07:07:48.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.272377+0000", 2023-10-08T07:07:48.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5890000000000002e-06 2023-10-08T07:07:48.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.272380+0000", 2023-10-08T07:07:48.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3869999999999999e-06 2023-10-08T07:07:48.441 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.441 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.441 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.441 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160132 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.442 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.287350+0000", 2023-10-08T07:07:48.442 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.81887188700000002, 2023-10-08T07:07:48.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82292078599999996, 2023-10-08T07:07:48.442 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.442 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.442 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.442 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160132 2023-10-08T07:07:48.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.443 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.287350+0000", 2023-10-08T07:07:48.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.287350+0000", 2023-10-08T07:07:48.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.287351+0000", 2023-10-08T07:07:48.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.99e-07 2023-10-08T07:07:48.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.287363+0000", 2023-10-08T07:07:48.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1985e-05 2023-10-08T07:07:48.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.287370+0000", 2023-10-08T07:07:48.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5649999999999998e-06 2023-10-08T07:07:48.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.287376+0000", 2023-10-08T07:07:48.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0050000000000001e-06 2023-10-08T07:07:48.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.446 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.446 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160316 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.446 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.360386+0000", 2023-10-08T07:07:48.446 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74583636600000003, 2023-10-08T07:07:48.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.74994528699999996, 2023-10-08T07:07:48.446 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.447 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.447 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160316 2023-10-08T07:07:48.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.447 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360386+0000", 2023-10-08T07:07:48.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360386+0000", 2023-10-08T07:07:48.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360386+0000", 2023-10-08T07:07:48.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4400000000000001e-07 2023-10-08T07:07:48.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360406+0000", 2023-10-08T07:07:48.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9830000000000002e-05 2023-10-08T07:07:48.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360413+0000", 2023-10-08T07:07:48.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3910000000000003e-06 2023-10-08T07:07:48.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360418+0000", 2023-10-08T07:07:48.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1649999999999997e-06 2023-10-08T07:07:48.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.450 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.451 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160596 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.451 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.458637+0000", 2023-10-08T07:07:48.451 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.647585827, 2023-10-08T07:07:48.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65175225299999995, 2023-10-08T07:07:48.451 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.451 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160596 2023-10-08T07:07:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.458637+0000", 2023-10-08T07:07:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.458637+0000", 2023-10-08T07:07:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.458637+0000", 2023-10-08T07:07:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2023-10-08T07:07:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.458650+0000", 2023-10-08T07:07:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2847000000000001e-05 2023-10-08T07:07:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.458666+0000", 2023-10-08T07:07:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5690000000000001e-05 2023-10-08T07:07:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.458675+0000", 2023-10-08T07:07:48.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8519999999999999e-06 2023-10-08T07:07:48.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.455 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.455 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159698 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.456 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.081402+0000", 2023-10-08T07:07:48.456 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0248204169999999, 2023-10-08T07:07:48.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0290417839999999, 2023-10-08T07:07:48.456 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.456 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.456 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159698 2023-10-08T07:07:48.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.457 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.081402+0000", 2023-10-08T07:07:48.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.081402+0000", 2023-10-08T07:07:48.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.081402+0000", 2023-10-08T07:07:48.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2023-10-08T07:07:48.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.081421+0000", 2023-10-08T07:07:48.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8359000000000002e-05 2023-10-08T07:07:48.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.081428+0000", 2023-10-08T07:07:48.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1210000000000001e-06 2023-10-08T07:07:48.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.081434+0000", 2023-10-08T07:07:48.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1399999999999997e-06 2023-10-08T07:07:48.460 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.460 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.460 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.460 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160011 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.461 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.225460+0000", 2023-10-08T07:07:48.461 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.88076246899999999, 2023-10-08T07:07:48.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.88505186599999996, 2023-10-08T07:07:48.461 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.461 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.461 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160011 2023-10-08T07:07:48.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.462 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225460+0000", 2023-10-08T07:07:48.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225460+0000", 2023-10-08T07:07:48.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225460+0000", 2023-10-08T07:07:48.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4400000000000001e-07 2023-10-08T07:07:48.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225480+0000", 2023-10-08T07:07:48.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9639e-05 2023-10-08T07:07:48.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225487+0000", 2023-10-08T07:07:48.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5560000000000002e-06 2023-10-08T07:07:48.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.225492+0000", 2023-10-08T07:07:48.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7740000000000004e-06 2023-10-08T07:07:48.465 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.465 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.465 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.465 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160318 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.465 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.360425+0000", 2023-10-08T07:07:48.465 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74579785200000004, 2023-10-08T07:07:48.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.75014027999999999, 2023-10-08T07:07:48.466 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.466 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.466 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.466 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.466 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.466 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160318 2023-10-08T07:07:48.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.466 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360425+0000", 2023-10-08T07:07:48.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.360425+0000", 2023-10-08T07:07:48.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.362293+0000", 2023-10-08T07:07:48.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018688579999999999 2023-10-08T07:07:48.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.362310+0000", 2023-10-08T07:07:48.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6373999999999999e-05 2023-10-08T07:07:48.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.362321+0000", 2023-10-08T07:07:48.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0906e-05 2023-10-08T07:07:48.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.362329+0000", 2023-10-08T07:07:48.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0739999999999993e-06 2023-10-08T07:07:48.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.469 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.470 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160597 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.470 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.458689+0000", 2023-10-08T07:07:48.470 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64753325100000003, 2023-10-08T07:07:48.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.651931857, 2023-10-08T07:07:48.470 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.470 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.471 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160597 2023-10-08T07:07:48.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.471 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.458689+0000", 2023-10-08T07:07:48.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.458689+0000", 2023-10-08T07:07:48.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.458690+0000", 2023-10-08T07:07:48.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.75e-07 2023-10-08T07:07:48.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.458716+0000", 2023-10-08T07:07:48.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6285e-05 2023-10-08T07:07:48.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.458723+0000", 2023-10-08T07:07:48.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6320000000000002e-06 2023-10-08T07:07:48.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.458728+0000", 2023-10-08T07:07:48.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2580000000000003e-06 2023-10-08T07:07:48.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.474 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.474 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160989 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.474 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.610794+0000", 2023-10-08T07:07:48.474 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.49542833600000002, 2023-10-08T07:07:48.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.49988393599999997, 2023-10-08T07:07:48.475 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160989 2023-10-08T07:07:48.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.475 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610794+0000", 2023-10-08T07:07:48.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610794+0000", 2023-10-08T07:07:48.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610795+0000", 2023-10-08T07:07:48.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9100000000000003e-07 2023-10-08T07:07:48.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610815+0000", 2023-10-08T07:07:48.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0058e-05 2023-10-08T07:07:48.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610825+0000", 2023-10-08T07:07:48.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8830000000000001e-06 2023-10-08T07:07:48.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610832+0000", 2023-10-08T07:07:48.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6669999999999996e-06 2023-10-08T07:07:48.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.479 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.479 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161213 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.479 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.730347+0000", 2023-10-08T07:07:48.479 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37587573299999999, 2023-10-08T07:07:48.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.38039591499999997, 2023-10-08T07:07:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161213 2023-10-08T07:07:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.730347+0000", 2023-10-08T07:07:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.730347+0000", 2023-10-08T07:07:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.732295+0000", 2023-10-08T07:07:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00194801 2023-10-08T07:07:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.732311+0000", 2023-10-08T07:07:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6438000000000001e-05 2023-10-08T07:07:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.732322+0000", 2023-10-08T07:07:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1046000000000001e-05 2023-10-08T07:07:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.732330+0000", 2023-10-08T07:07:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6529999999999994e-06 2023-10-08T07:07:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161710 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.931433+0000", 2023-10-08T07:07:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.174789374, 2023-10-08T07:07:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.179368268, 2023-10-08T07:07:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161710 2023-10-08T07:07:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.931433+0000", 2023-10-08T07:07:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.931433+0000", 2023-10-08T07:07:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.933296+0000", 2023-10-08T07:07:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001863359 2023-10-08T07:07:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.933315+0000", 2023-10-08T07:07:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8581999999999999e-05 2023-10-08T07:07:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.933325+0000", 2023-10-08T07:07:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0407e-05 2023-10-08T07:07:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.933333+0000", 2023-10-08T07:07:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8169999999999999e-06 2023-10-08T07:07:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161816 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.997882+0000", 2023-10-08T07:07:48.488 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.10834032, 2023-10-08T07:07:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.11297976799999999, 2023-10-08T07:07:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161816 2023-10-08T07:07:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.997882+0000", 2023-10-08T07:07:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.997882+0000", 2023-10-08T07:07:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.997883+0000", 2023-10-08T07:07:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2e-07 2023-10-08T07:07:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.997897+0000", 2023-10-08T07:07:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3976e-05 2023-10-08T07:07:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.997903+0000", 2023-10-08T07:07:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5849999999999996e-06 2023-10-08T07:07:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.997909+0000", 2023-10-08T07:07:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2060000000000004e-06 2023-10-08T07:07:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176695 4.c e64/17 4:3352c333:::10000000004.00000012:head v 64'5591, mlcod=64'5588)", 2023-10-08T07:07:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.101932+0000", 2023-10-08T07:07:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0042908149999999999, 2023-10-08T07:07:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089876980000000006, 2023-10-08T07:07:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101932+0000", 2023-10-08T07:07:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101932+0000", 2023-10-08T07:07:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101932+0000", 2023-10-08T07:07:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2000000000000001e-07 2023-10-08T07:07:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101944+0000", 2023-10-08T07:07:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2334000000000001e-05 2023-10-08T07:07:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101950+0000", 2023-10-08T07:07:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2550000000000003e-06 2023-10-08T07:07:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101955+0000", 2023-10-08T07:07:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9099999999999996e-06 2023-10-08T07:07:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102209+0000", 2023-10-08T07:07:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00025387899999999999 2023-10-08T07:07:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102226+0000", 2023-10-08T07:07:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7141000000000001e-05 2023-10-08T07:07:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159433 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.971614+0000", 2023-10-08T07:07:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1346079769999999, 2023-10-08T07:07:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1393666330000001, 2023-10-08T07:07:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159433 2023-10-08T07:07:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971614+0000", 2023-10-08T07:07:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971614+0000", 2023-10-08T07:07:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971615+0000", 2023-10-08T07:07:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.75e-07 2023-10-08T07:07:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971627+0000", 2023-10-08T07:07:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1987999999999999e-05 2023-10-08T07:07:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971634+0000", 2023-10-08T07:07:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0740000000000004e-06 2023-10-08T07:07:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971639+0000", 2023-10-08T07:07:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1059999999999999e-06 2023-10-08T07:07:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159674 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.502 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.069352+0000", 2023-10-08T07:07:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.036870706, 2023-10-08T07:07:48.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.041687823, 2023-10-08T07:07:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.505 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159674 2023-10-08T07:07:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.069352+0000", 2023-10-08T07:07:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.069352+0000", 2023-10-08T07:07:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.069352+0000", 2023-10-08T07:07:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:07:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.069364+0000", 2023-10-08T07:07:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1996e-05 2023-10-08T07:07:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.069372+0000", 2023-10-08T07:07:48.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9149999999999996e-06 2023-10-08T07:07:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.069377+0000", 2023-10-08T07:07:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1540000000000001e-06 2023-10-08T07:07:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.509 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159798 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.118419+0000", 2023-10-08T07:07:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.98780366900000005, 2023-10-08T07:07:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.992673319, 2023-10-08T07:07:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159798 2023-10-08T07:07:48.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.118419+0000", 2023-10-08T07:07:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.118419+0000", 2023-10-08T07:07:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.118419+0000", 2023-10-08T07:07:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2600000000000002e-07 2023-10-08T07:07:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.118431+0000", 2023-10-08T07:07:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2170999999999999e-05 2023-10-08T07:07:48.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.118438+0000", 2023-10-08T07:07:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8839999999999997e-06 2023-10-08T07:07:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.118444+0000", 2023-10-08T07:07:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2569999999999998e-06 2023-10-08T07:07:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.513 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159848 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.151362+0000", 2023-10-08T07:07:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.95486043600000003, 2023-10-08T07:07:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.95978631800000003, 2023-10-08T07:07:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.514 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159848 2023-10-08T07:07:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151362+0000", 2023-10-08T07:07:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151362+0000", 2023-10-08T07:07:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151362+0000", 2023-10-08T07:07:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.03e-07 2023-10-08T07:07:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151375+0000", 2023-10-08T07:07:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2941e-05 2023-10-08T07:07:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151382+0000", 2023-10-08T07:07:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9040000000000003e-06 2023-10-08T07:07:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151388+0000", 2023-10-08T07:07:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4759999999999997e-06 2023-10-08T07:07:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.518 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159912 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.174357+0000", 2023-10-08T07:07:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.93186491900000001, 2023-10-08T07:07:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93684449199999997, 2023-10-08T07:07:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159912 2023-10-08T07:07:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.519 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.174357+0000", 2023-10-08T07:07:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.174357+0000", 2023-10-08T07:07:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.176295+0000", 2023-10-08T07:07:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019376930000000001 2023-10-08T07:07:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.176311+0000", 2023-10-08T07:07:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5486e-05 2023-10-08T07:07:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.176321+0000", 2023-10-08T07:07:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0400999999999999e-05 2023-10-08T07:07:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.176328+0000", 2023-10-08T07:07:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2239999999999998e-06 2023-10-08T07:07:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160026 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.245395+0000", 2023-10-08T07:07:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.86082754699999997, 2023-10-08T07:07:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.86586278299999997, 2023-10-08T07:07:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.523 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160026 2023-10-08T07:07:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.245395+0000", 2023-10-08T07:07:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.245395+0000", 2023-10-08T07:07:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.247293+0000", 2023-10-08T07:07:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001898472 2023-10-08T07:07:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.247318+0000", 2023-10-08T07:07:48.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4562999999999998e-05 2023-10-08T07:07:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.247332+0000", 2023-10-08T07:07:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3835000000000001e-05 2023-10-08T07:07:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.247341+0000", 2023-10-08T07:07:48.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8910000000000001e-06 2023-10-08T07:07:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160557 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.448396+0000", 2023-10-08T07:07:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.65782668099999997, 2023-10-08T07:07:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.66292113500000005, 2023-10-08T07:07:48.527 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160557 2023-10-08T07:07:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.448396+0000", 2023-10-08T07:07:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.448396+0000", 2023-10-08T07:07:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.448396+0000", 2023-10-08T07:07:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2900000000000004e-07 2023-10-08T07:07:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.448409+0000", 2023-10-08T07:07:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2490999999999999e-05 2023-10-08T07:07:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.448416+0000", 2023-10-08T07:07:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3499999999999999e-06 2023-10-08T07:07:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.448422+0000", 2023-10-08T07:07:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.507e-06 2023-10-08T07:07:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160617 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.476425+0000", 2023-10-08T07:07:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.62979697099999998, 2023-10-08T07:07:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.63495423399999995, 2023-10-08T07:07:48.531 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160617 2023-10-08T07:07:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.476425+0000", 2023-10-08T07:07:48.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.476425+0000", 2023-10-08T07:07:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.476426+0000", 2023-10-08T07:07:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.63e-07 2023-10-08T07:07:48.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.476438+0000", 2023-10-08T07:07:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1945e-05 2023-10-08T07:07:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.476444+0000", 2023-10-08T07:07:48.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2023-10-08T07:07:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.476450+0000", 2023-10-08T07:07:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8109999999999999e-06 2023-10-08T07:07:48.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160662 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.486956+0000", 2023-10-08T07:07:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61926658999999995, 2023-10-08T07:07:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.62446184999999998, 2023-10-08T07:07:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.537 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160662 2023-10-08T07:07:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.486956+0000", 2023-10-08T07:07:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.486956+0000", 2023-10-08T07:07:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.487576+0000", 2023-10-08T07:07:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00062057300000000002 2023-10-08T07:07:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.487600+0000", 2023-10-08T07:07:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3444000000000001e-05 2023-10-08T07:07:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.487608+0000", 2023-10-08T07:07:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6649999999999992e-06 2023-10-08T07:07:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.487616+0000", 2023-10-08T07:07:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2289999999999997e-06 2023-10-08T07:07:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160895 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.575425+0000", 2023-10-08T07:07:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.530797403, 2023-10-08T07:07:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.53604943500000002, 2023-10-08T07:07:48.541 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160895 2023-10-08T07:07:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.575425+0000", 2023-10-08T07:07:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.575425+0000", 2023-10-08T07:07:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.575426+0000", 2023-10-08T07:07:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2900000000000004e-07 2023-10-08T07:07:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.575438+0000", 2023-10-08T07:07:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2011000000000001e-05 2023-10-08T07:07:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.575448+0000", 2023-10-08T07:07:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.057e-05 2023-10-08T07:07:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.575453+0000", 2023-10-08T07:07:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7489999999999998e-06 2023-10-08T07:07:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161785 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.979409+0000", 2023-10-08T07:07:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.12681314799999999, 2023-10-08T07:07:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13212458599999999, 2023-10-08T07:07:48.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161785 2023-10-08T07:07:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.979409+0000", 2023-10-08T07:07:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.979409+0000", 2023-10-08T07:07:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.981294+0000", 2023-10-08T07:07:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018843239999999999 2023-10-08T07:07:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.981312+0000", 2023-10-08T07:07:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8797999999999999e-05 2023-10-08T07:07:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.981329+0000", 2023-10-08T07:07:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6668e-05 2023-10-08T07:07:48.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.981341+0000", 2023-10-08T07:07:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2062000000000001e-05 2023-10-08T07:07:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176151 4.3a e64/17)", 2023-10-08T07:07:48.549 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.088885+0000", 2023-10-08T07:07:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.017337222999999999, 2023-10-08T07:07:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022709235000000001, 2023-10-08T07:07:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.088885+0000", 2023-10-08T07:07:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.088885+0000", 2023-10-08T07:07:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.088886+0000", 2023-10-08T07:07:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.82e-07 2023-10-08T07:07:48.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.088899+0000", 2023-10-08T07:07:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2867000000000001e-05 2023-10-08T07:07:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.088907+0000", 2023-10-08T07:07:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5019999999999992e-06 2023-10-08T07:07:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.088916+0000", 2023-10-08T07:07:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8389999999999996e-06 2023-10-08T07:07:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159175 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.819523+0000", 2023-10-08T07:07:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2866997979999999, 2023-10-08T07:07:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2921296440000001, 2023-10-08T07:07:48.553 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159175 2023-10-08T07:07:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.819523+0000", 2023-10-08T07:07:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.819523+0000", 2023-10-08T07:07:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.819523+0000", 2023-10-08T07:07:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3299999999999998e-07 2023-10-08T07:07:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.819534+0000", 2023-10-08T07:07:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1588e-05 2023-10-08T07:07:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.819540+0000", 2023-10-08T07:07:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2023-10-08T07:07:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.819545+0000", 2023-10-08T07:07:48.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8189999999999999e-06 2023-10-08T07:07:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159379 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.938512+0000", 2023-10-08T07:07:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1677099929999999, 2023-10-08T07:07:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1732025880000001, 2023-10-08T07:07:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.557 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159379 2023-10-08T07:07:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.938512+0000", 2023-10-08T07:07:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.938512+0000", 2023-10-08T07:07:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.940295+0000", 2023-10-08T07:07:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001782992 2023-10-08T07:07:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.940312+0000", 2023-10-08T07:07:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6348e-05 2023-10-08T07:07:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.940321+0000", 2023-10-08T07:07:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5189999999999998e-06 2023-10-08T07:07:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.940329+0000", 2023-10-08T07:07:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.328e-06 2023-10-08T07:07:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159700 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.081729+0000", 2023-10-08T07:07:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.02449309, 2023-10-08T07:07:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0300274549999999, 2023-10-08T07:07:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.561 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159700 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.081729+0000", 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.081729+0000", 2023-10-08T07:07:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.083294+0000", 2023-10-08T07:07:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00156499 2023-10-08T07:07:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.083313+0000", 2023-10-08T07:07:48.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9167000000000001e-05 2023-10-08T07:07:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.083324+0000", 2023-10-08T07:07:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0147e-05 2023-10-08T07:07:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.083331+0000", 2023-10-08T07:07:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7510000000000008e-06 2023-10-08T07:07:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.564 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159914 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.176340+0000", 2023-10-08T07:07:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.92988201500000001, 2023-10-08T07:07:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.93545477399999999, 2023-10-08T07:07:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.565 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159914 2023-10-08T07:07:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.176340+0000", 2023-10-08T07:07:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.176340+0000", 2023-10-08T07:07:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.176341+0000", 2023-10-08T07:07:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7800000000000002e-07 2023-10-08T07:07:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.176354+0000", 2023-10-08T07:07:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.289e-05 2023-10-08T07:07:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.176360+0000", 2023-10-08T07:07:48.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6789999999999999e-06 2023-10-08T07:07:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.176365+0000", 2023-10-08T07:07:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0490000000000003e-06 2023-10-08T07:07:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160133 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.569 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.287384+0000", 2023-10-08T07:07:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.81883790899999997, 2023-10-08T07:07:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82448029599999995, 2023-10-08T07:07:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160133 2023-10-08T07:07:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.287384+0000", 2023-10-08T07:07:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.287384+0000", 2023-10-08T07:07:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289293+0000", 2023-10-08T07:07:48.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019086610000000001 2023-10-08T07:07:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289313+0000", 2023-10-08T07:07:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0254e-05 2023-10-08T07:07:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289322+0000", 2023-10-08T07:07:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6680000000000007e-06 2023-10-08T07:07:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289328+0000", 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4670000000000003e-06 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160526 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.426483+0000", 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67973931799999998, 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.68544129099999995, 2023-10-08T07:07:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160526 2023-10-08T07:07:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426483+0000", 2023-10-08T07:07:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426483+0000", 2023-10-08T07:07:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.432298+0000", 2023-10-08T07:07:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058149919999999997 2023-10-08T07:07:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.432320+0000", 2023-10-08T07:07:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1642999999999999e-05 2023-10-08T07:07:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.432332+0000", 2023-10-08T07:07:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.259e-05 2023-10-08T07:07:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.432341+0000", 2023-10-08T07:07:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0289999999999994e-06 2023-10-08T07:07:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160794 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.530353+0000", 2023-10-08T07:07:48.577 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.57586906199999999, 2023-10-08T07:07:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.581635546, 2023-10-08T07:07:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160794 2023-10-08T07:07:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.530353+0000", 2023-10-08T07:07:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.530353+0000", 2023-10-08T07:07:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533274+0000", 2023-10-08T07:07:48.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029204510000000001 2023-10-08T07:07:48.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533297+0000", 2023-10-08T07:07:48.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2809000000000001e-05 2023-10-08T07:07:48.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533308+0000", 2023-10-08T07:07:48.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1552999999999999e-05 2023-10-08T07:07:48.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533316+0000", 2023-10-08T07:07:48.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0660000000000004e-06 2023-10-08T07:07:48.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.581 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.582 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161092 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.582 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.672350+0000", 2023-10-08T07:07:48.582 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43387238700000003, 2023-10-08T07:07:48.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43969833699999999, 2023-10-08T07:07:48.582 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.582 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161092 2023-10-08T07:07:48.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.583 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.672350+0000", 2023-10-08T07:07:48.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.672350+0000", 2023-10-08T07:07:48.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.672350+0000", 2023-10-08T07:07:48.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3799999999999998e-07 2023-10-08T07:07:48.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.672362+0000", 2023-10-08T07:07:48.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1892000000000001e-05 2023-10-08T07:07:48.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.672370+0000", 2023-10-08T07:07:48.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2749999999999998e-06 2023-10-08T07:07:48.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.672376+0000", 2023-10-08T07:07:48.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0220000000000001e-06 2023-10-08T07:07:48.585 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.585 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.586 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161129 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.586 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.682824+0000", 2023-10-08T07:07:48.586 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42339819899999998, 2023-10-08T07:07:48.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.429297186, 2023-10-08T07:07:48.586 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.586 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.586 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.586 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161129 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.682824+0000", 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.682824+0000", 2023-10-08T07:07:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.685094+0000", 2023-10-08T07:07:48.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022699019999999999 2023-10-08T07:07:48.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.685113+0000", 2023-10-08T07:07:48.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8581999999999999e-05 2023-10-08T07:07:48.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.685123+0000", 2023-10-08T07:07:48.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8490000000000001e-06 2023-10-08T07:07:48.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.685130+0000", 2023-10-08T07:07:48.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5610000000000001e-06 2023-10-08T07:07:48.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.589 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.590 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161258 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.590 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.748352+0000", 2023-10-08T07:07:48.590 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.35787046, 2023-10-08T07:07:48.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.36383043100000001, 2023-10-08T07:07:48.590 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.590 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.590 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.590 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.590 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.590 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161258 2023-10-08T07:07:48.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.591 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.748352+0000", 2023-10-08T07:07:48.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.748352+0000", 2023-10-08T07:07:48.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.748352+0000", 2023-10-08T07:07:48.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0800000000000005e-07 2023-10-08T07:07:48.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.748365+0000", 2023-10-08T07:07:48.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2964e-05 2023-10-08T07:07:48.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.748373+0000", 2023-10-08T07:07:48.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5959999999999998e-06 2023-10-08T07:07:48.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.748378+0000", 2023-10-08T07:07:48.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3029999999999999e-06 2023-10-08T07:07:48.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.593 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.593 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161559 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.873404+0000", 2023-10-08T07:07:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.232818308, 2023-10-08T07:07:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23883615699999999, 2023-10-08T07:07:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161559 2023-10-08T07:07:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.595 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.873404+0000", 2023-10-08T07:07:48.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.873404+0000", 2023-10-08T07:07:48.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.875294+0000", 2023-10-08T07:07:48.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001889794 2023-10-08T07:07:48.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.875318+0000", 2023-10-08T07:07:48.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3825999999999999e-05 2023-10-08T07:07:48.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.875330+0000", 2023-10-08T07:07:48.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2204999999999999e-05 2023-10-08T07:07:48.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.875337+0000", 2023-10-08T07:07:48.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1060000000000002e-06 2023-10-08T07:07:48.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.598 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.598 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161680 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.598 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.914253+0000", 2023-10-08T07:07:48.598 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.19196977000000001, 2023-10-08T07:07:48.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19804708500000001, 2023-10-08T07:07:48.598 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.598 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.599 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161680 2023-10-08T07:07:48.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.599 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.914253+0000", 2023-10-08T07:07:48.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.914253+0000", 2023-10-08T07:07:48.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.915297+0000", 2023-10-08T07:07:48.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001044272 2023-10-08T07:07:48.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.915313+0000", 2023-10-08T07:07:48.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6458999999999999e-05 2023-10-08T07:07:48.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.915328+0000", 2023-10-08T07:07:48.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4385e-05 2023-10-08T07:07:48.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.915336+0000", 2023-10-08T07:07:48.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8679999999999999e-06 2023-10-08T07:07:48.601 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.602 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.602 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176691 4.20 e64/17 4:07572838:::10000000004.00000010:head v 64'8332, mlcod=64'8326)", 2023-10-08T07:07:48.602 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.102460+0000", 2023-10-08T07:07:48.602 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0037621009999999999, 2023-10-08T07:07:48.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0098945249999999995, 2023-10-08T07:07:48.602 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.602 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.602 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102460+0000", 2023-10-08T07:07:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102460+0000", 2023-10-08T07:07:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102461+0000", 2023-10-08T07:07:48.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2023-10-08T07:07:48.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102472+0000", 2023-10-08T07:07:48.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1348999999999999e-05 2023-10-08T07:07:48.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102482+0000", 2023-10-08T07:07:48.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4679999999999998e-06 2023-10-08T07:07:48.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102488+0000", 2023-10-08T07:07:48.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7610000000000002e-06 2023-10-08T07:07:48.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102932+0000", 2023-10-08T07:07:48.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000443194 2023-10-08T07:07:48.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102947+0000", 2023-10-08T07:07:48.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5537e-05 2023-10-08T07:07:48.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.606 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.606 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159135 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3031040~4096 in=4096b,write 3063808~4096 in=4096b,write 3076096~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.606 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.805464+0000", 2023-10-08T07:07:48.606 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.3007586039999999, 2023-10-08T07:07:48.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3069603029999999, 2023-10-08T07:07:48.607 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.607 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:48.607 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.607 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.607 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.607 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159135 2023-10-08T07:07:48.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.607 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.805464+0000", 2023-10-08T07:07:48.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.805464+0000", 2023-10-08T07:07:48.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.809296+0000", 2023-10-08T07:07:48.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003832083 2023-10-08T07:07:48.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.809315+0000", 2023-10-08T07:07:48.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9581000000000001e-05 2023-10-08T07:07:48.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.809326+0000", 2023-10-08T07:07:48.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0093e-05 2023-10-08T07:07:48.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.809331+0000", 2023-10-08T07:07:48.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.288e-06 2023-10-08T07:07:48.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097616+0000", 2023-10-08T07:07:48.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2882856309999999 2023-10-08T07:07:48.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097693+0000", 2023-10-08T07:07:48.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.627e-05 2023-10-08T07:07:48.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:48.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097832+0000", 2023-10-08T07:07:48.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013893600000000001 2023-10-08T07:07:48.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:48.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102904+0000", 2023-10-08T07:07:48.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050725859999999996 2023-10-08T07:07:48.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.612 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.613 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160134 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.613 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.289338+0000", 2023-10-08T07:07:48.613 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.81688475900000002, 2023-10-08T07:07:48.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82316712400000003, 2023-10-08T07:07:48.613 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.613 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.614 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160134 2023-10-08T07:07:48.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.614 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289338+0000", 2023-10-08T07:07:48.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289338+0000", 2023-10-08T07:07:48.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289338+0000", 2023-10-08T07:07:48.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0200000000000003e-07 2023-10-08T07:07:48.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289347+0000", 2023-10-08T07:07:48.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2990000000000002e-06 2023-10-08T07:07:48.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289351+0000", 2023-10-08T07:07:48.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1099999999999996e-06 2023-10-08T07:07:48.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289354+0000", 2023-10-08T07:07:48.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.004e-06 2023-10-08T07:07:48.616 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.617 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.617 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160993 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.617 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.610882+0000", 2023-10-08T07:07:48.617 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.49534027400000002, 2023-10-08T07:07:48.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.50175222900000005, 2023-10-08T07:07:48.617 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.617 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.618 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160993 2023-10-08T07:07:48.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.618 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610882+0000", 2023-10-08T07:07:48.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.610882+0000", 2023-10-08T07:07:48.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.614298+0000", 2023-10-08T07:07:48.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003415558 2023-10-08T07:07:48.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.614316+0000", 2023-10-08T07:07:48.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8834e-05 2023-10-08T07:07:48.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.614328+0000", 2023-10-08T07:07:48.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1615e-05 2023-10-08T07:07:48.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.614336+0000", 2023-10-08T07:07:48.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0139999999999998e-06 2023-10-08T07:07:48.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.621 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.621 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161151 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.621 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.700353+0000", 2023-10-08T07:07:48.621 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.40586951900000001, 2023-10-08T07:07:48.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.412366974, 2023-10-08T07:07:48.621 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161151 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.700353+0000", 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.700353+0000", 2023-10-08T07:07:48.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.700353+0000", 2023-10-08T07:07:48.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9299999999999998e-07 2023-10-08T07:07:48.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.700366+0000", 2023-10-08T07:07:48.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2867999999999999e-05 2023-10-08T07:07:48.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.700374+0000", 2023-10-08T07:07:48.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0830000000000004e-06 2023-10-08T07:07:48.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.700379+0000", 2023-10-08T07:07:48.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0989999999999998e-06 2023-10-08T07:07:48.624 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.625 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.625 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161259 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.625 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.748386+0000", 2023-10-08T07:07:48.625 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.35783606000000001, 2023-10-08T07:07:48.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.364385707, 2023-10-08T07:07:48.625 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.625 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.625 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.625 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.626 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161259 2023-10-08T07:07:48.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.626 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.748386+0000", 2023-10-08T07:07:48.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.748386+0000", 2023-10-08T07:07:48.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.748387+0000", 2023-10-08T07:07:48.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1399999999999997e-07 2023-10-08T07:07:48.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.748398+0000", 2023-10-08T07:07:48.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1202999999999999e-05 2023-10-08T07:07:48.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.748404+0000", 2023-10-08T07:07:48.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1210000000000003e-06 2023-10-08T07:07:48.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.748409+0000", 2023-10-08T07:07:48.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9060000000000001e-06 2023-10-08T07:07:48.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.630 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.630 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161733 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.631 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.948433+0000", 2023-10-08T07:07:48.631 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.157789232, 2023-10-08T07:07:48.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.16439073900000001, 2023-10-08T07:07:48.631 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.631 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.631 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161733 2023-10-08T07:07:48.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.632 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.948433+0000", 2023-10-08T07:07:48.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.948433+0000", 2023-10-08T07:07:48.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.952300+0000", 2023-10-08T07:07:48.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038665790000000002 2023-10-08T07:07:48.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.952320+0000", 2023-10-08T07:07:48.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0616999999999999e-05 2023-10-08T07:07:48.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.952331+0000", 2023-10-08T07:07:48.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0375e-05 2023-10-08T07:07:48.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.952338+0000", 2023-10-08T07:07:48.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1960000000000002e-06 2023-10-08T07:07:48.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.634 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.635 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.635 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161918 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.635 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.072469+0000", 2023-10-08T07:07:48.635 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.033752919999999999, 2023-10-08T07:07:48.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.040408446000000001, 2023-10-08T07:07:48.635 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.635 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.636 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.636 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161918 2023-10-08T07:07:48.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.636 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.072469+0000", 2023-10-08T07:07:48.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.072469+0000", 2023-10-08T07:07:48.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.072470+0000", 2023-10-08T07:07:48.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9000000000000002e-07 2023-10-08T07:07:48.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.072482+0000", 2023-10-08T07:07:48.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2114e-05 2023-10-08T07:07:48.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.072489+0000", 2023-10-08T07:07:48.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7159999999999997e-06 2023-10-08T07:07:48.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.072494+0000", 2023-10-08T07:07:48.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2839999999999997e-06 2023-10-08T07:07:48.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.640 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.640 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176697 4.2b e64/17 4:d7a77d67:::10000000004.00000029:head v 64'5565, mlcod=64'5559)", 2023-10-08T07:07:48.640 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.104888+0000", 2023-10-08T07:07:48.640 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0013341449999999999, 2023-10-08T07:07:48.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080427750000000003, 2023-10-08T07:07:48.640 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.640 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.640 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104888+0000", 2023-10-08T07:07:48.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104888+0000", 2023-10-08T07:07:48.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104889+0000", 2023-10-08T07:07:48.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3600000000000003e-07 2023-10-08T07:07:48.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104927+0000", 2023-10-08T07:07:48.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8532999999999999e-05 2023-10-08T07:07:48.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104937+0000", 2023-10-08T07:07:48.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1989999999999995e-06 2023-10-08T07:07:48.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104945+0000", 2023-10-08T07:07:48.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5140000000000001e-06 2023-10-08T07:07:48.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104987+0000", 2023-10-08T07:07:48.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2283000000000002e-05 2023-10-08T07:07:48.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.105005+0000", 2023-10-08T07:07:48.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7842999999999998e-05 2023-10-08T07:07:48.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.644 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.644 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159345 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.644 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.916540+0000", 2023-10-08T07:07:48.645 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.18968228, 2023-10-08T07:07:48.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.196450024, 2023-10-08T07:07:48.645 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.645 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.645 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.645 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.645 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.645 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159345 2023-10-08T07:07:48.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.645 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.916540+0000", 2023-10-08T07:07:48.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.916540+0000", 2023-10-08T07:07:48.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.920294+0000", 2023-10-08T07:07:48.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003753709 2023-10-08T07:07:48.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.920314+0000", 2023-10-08T07:07:48.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9709000000000001e-05 2023-10-08T07:07:48.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.920324+0000", 2023-10-08T07:07:48.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0366999999999999e-05 2023-10-08T07:07:48.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.920330+0000", 2023-10-08T07:07:48.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7049999999999996e-06 2023-10-08T07:07:48.648 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.648 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.648 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.648 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159437 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.648 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.971723+0000", 2023-10-08T07:07:48.648 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1344990960000001, 2023-10-08T07:07:48.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.141319245, 2023-10-08T07:07:48.649 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.649 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.649 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.649 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.649 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.649 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159437 2023-10-08T07:07:48.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.649 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971723+0000", 2023-10-08T07:07:48.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971723+0000", 2023-10-08T07:07:48.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971724+0000", 2023-10-08T07:07:48.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7e-07 2023-10-08T07:07:48.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971739+0000", 2023-10-08T07:07:48.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5457000000000001e-05 2023-10-08T07:07:48.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971746+0000", 2023-10-08T07:07:48.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6730000000000003e-06 2023-10-08T07:07:48.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971751+0000", 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469999999999997e-06 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159851 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.151471+0000", 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.95475172900000005, 2023-10-08T07:07:48.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96162642799999998, 2023-10-08T07:07:48.653 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.653 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.653 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159851 2023-10-08T07:07:48.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.653 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151471+0000", 2023-10-08T07:07:48.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151471+0000", 2023-10-08T07:07:48.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151471+0000", 2023-10-08T07:07:48.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151484+0000", 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2757e-05 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151491+0000", 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.002e-06 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.151496+0000", 2023-10-08T07:07:48.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6180000000000003e-06 2023-10-08T07:07:48.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.656 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.656 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161738 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.656 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.952351+0000", 2023-10-08T07:07:48.656 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15387108599999999, 2023-10-08T07:07:48.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.16079671300000001, 2023-10-08T07:07:48.657 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.657 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.657 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161738 2023-10-08T07:07:48.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.657 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.952351+0000", 2023-10-08T07:07:48.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.952351+0000", 2023-10-08T07:07:48.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.952352+0000", 2023-10-08T07:07:48.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7300000000000001e-07 2023-10-08T07:07:48.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.952366+0000", 2023-10-08T07:07:48.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4725e-05 2023-10-08T07:07:48.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.952373+0000", 2023-10-08T07:07:48.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.63e-06 2023-10-08T07:07:48.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.952378+0000", 2023-10-08T07:07:48.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8640000000000004e-06 2023-10-08T07:07:48.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.660 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.660 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161840 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.660 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.019968+0000", 2023-10-08T07:07:48.660 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.086254285, 2023-10-08T07:07:48.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.093235099000000002, 2023-10-08T07:07:48.661 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.661 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.661 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161840 2023-10-08T07:07:48.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.661 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.019968+0000", 2023-10-08T07:07:48.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.019968+0000", 2023-10-08T07:07:48.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.019969+0000", 2023-10-08T07:07:48.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2023-10-08T07:07:48.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.019980+0000", 2023-10-08T07:07:48.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1789e-05 2023-10-08T07:07:48.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.019988+0000", 2023-10-08T07:07:48.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1489999999999997e-06 2023-10-08T07:07:48.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.019993+0000", 2023-10-08T07:07:48.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.288e-06 2023-10-08T07:07:48.664 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.664 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.664 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.664 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176095 4.3a e64/17 4:5d52ad5e:::10000000004.00000026:head v 64'8093, mlcod=64'8077)", 2023-10-08T07:07:48.664 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.074260+0000", 2023-10-08T07:07:48.664 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.031962606999999997, 2023-10-08T07:07:48.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038997834000000002, 2023-10-08T07:07:48.664 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.665 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.665 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.074260+0000", 2023-10-08T07:07:48.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.074260+0000", 2023-10-08T07:07:48.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.074261+0000", 2023-10-08T07:07:48.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1039999999999999e-06 2023-10-08T07:07:48.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.074278+0000", 2023-10-08T07:07:48.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7452000000000002e-05 2023-10-08T07:07:48.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.074295+0000", 2023-10-08T07:07:48.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6351999999999999e-05 2023-10-08T07:07:48.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.074302+0000", 2023-10-08T07:07:48.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0389999999999999e-06 2023-10-08T07:07:48.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102806+0000", 2023-10-08T07:07:48.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028504754 2023-10-08T07:07:48.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.102825+0000", 2023-10-08T07:07:48.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8861000000000001e-05 2023-10-08T07:07:48.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.669 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.669 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176210 4.3a e64/17)", 2023-10-08T07:07:48.669 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.104960+0000", 2023-10-08T07:07:48.669 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0012623669999999999, 2023-10-08T07:07:48.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083659600000000004, 2023-10-08T07:07:48.669 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.669 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.669 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104960+0000", 2023-10-08T07:07:48.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104960+0000", 2023-10-08T07:07:48.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104960+0000", 2023-10-08T07:07:48.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7599999999999998e-07 2023-10-08T07:07:48.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104973+0000", 2023-10-08T07:07:48.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.291e-05 2023-10-08T07:07:48.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104980+0000", 2023-10-08T07:07:48.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1740000000000003e-06 2023-10-08T07:07:48.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104985+0000", 2023-10-08T07:07:48.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8199999999999996e-06 2023-10-08T07:07:48.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.672 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159137 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.809371+0000", 2023-10-08T07:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.296851553, 2023-10-08T07:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3040067040000001, 2023-10-08T07:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159137 2023-10-08T07:07:48.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.674 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.809371+0000", 2023-10-08T07:07:48.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.809371+0000", 2023-10-08T07:07:48.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.809371+0000", 2023-10-08T07:07:48.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3000000000000001e-07 2023-10-08T07:07:48.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.809389+0000", 2023-10-08T07:07:48.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7493999999999999e-05 2023-10-08T07:07:48.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.809396+0000", 2023-10-08T07:07:48.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5789999999999998e-06 2023-10-08T07:07:48.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.809402+0000", 2023-10-08T07:07:48.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2989999999999996e-06 2023-10-08T07:07:48.676 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.676 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.676 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.677 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159438 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.677 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.971760+0000", 2023-10-08T07:07:48.677 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.134462372, 2023-10-08T07:07:48.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.141680526, 2023-10-08T07:07:48.677 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.677 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.677 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159438 2023-10-08T07:07:48.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.678 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971760+0000", 2023-10-08T07:07:48.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971760+0000", 2023-10-08T07:07:48.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971760+0000", 2023-10-08T07:07:48.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5600000000000001e-07 2023-10-08T07:07:48.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971773+0000", 2023-10-08T07:07:48.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2648e-05 2023-10-08T07:07:48.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971778+0000", 2023-10-08T07:07:48.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5929999999999999e-06 2023-10-08T07:07:48.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971781+0000", 2023-10-08T07:07:48.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5080000000000001e-06 2023-10-08T07:07:48.680 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.680 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.680 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160483 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.418559+0000", 2023-10-08T07:07:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.68766360699999995, 2023-10-08T07:07:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.69494019399999996, 2023-10-08T07:07:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160483 2023-10-08T07:07:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.681 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.418559+0000", 2023-10-08T07:07:48.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.418559+0000", 2023-10-08T07:07:48.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.422294+0000", 2023-10-08T07:07:48.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037349240000000001 2023-10-08T07:07:48.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.422311+0000", 2023-10-08T07:07:48.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6872e-05 2023-10-08T07:07:48.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.422321+0000", 2023-10-08T07:07:48.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0506000000000001e-05 2023-10-08T07:07:48.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.422329+0000", 2023-10-08T07:07:48.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4549999999999998e-06 2023-10-08T07:07:48.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.684 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.685 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160666 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.685 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.487747+0000", 2023-10-08T07:07:48.685 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.61847542099999997, 2023-10-08T07:07:48.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.625813591, 2023-10-08T07:07:48.685 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.685 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.686 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160666 2023-10-08T07:07:48.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.686 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.487747+0000", 2023-10-08T07:07:48.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.487747+0000", 2023-10-08T07:07:48.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.487747+0000", 2023-10-08T07:07:48.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.06e-07 2023-10-08T07:07:48.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.487762+0000", 2023-10-08T07:07:48.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4791e-05 2023-10-08T07:07:48.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.487769+0000", 2023-10-08T07:07:48.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5899999999999996e-06 2023-10-08T07:07:48.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.487773+0000", 2023-10-08T07:07:48.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5979999999999999e-06 2023-10-08T07:07:48.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.689 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.689 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.689 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160825 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.689 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.550224+0000", 2023-10-08T07:07:48.689 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.55599854199999998, 2023-10-08T07:07:48.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56340684100000005, 2023-10-08T07:07:48.689 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.689 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.689 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.690 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.690 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.690 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160825 2023-10-08T07:07:48.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.690 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.550224+0000", 2023-10-08T07:07:48.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.550224+0000", 2023-10-08T07:07:48.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.550225+0000", 2023-10-08T07:07:48.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.92e-07 2023-10-08T07:07:48.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.550245+0000", 2023-10-08T07:07:48.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0319999999999999e-05 2023-10-08T07:07:48.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.550255+0000", 2023-10-08T07:07:48.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5999999999999996e-06 2023-10-08T07:07:48.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.550263+0000", 2023-10-08T07:07:48.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9640000000000003e-06 2023-10-08T07:07:48.693 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.693 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.693 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.693 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160900 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.693 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.575552+0000", 2023-10-08T07:07:48.693 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.53067026799999995, 2023-10-08T07:07:48.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.53812147799999999, 2023-10-08T07:07:48.693 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.693 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.694 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160900 2023-10-08T07:07:48.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.694 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.575552+0000", 2023-10-08T07:07:48.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.575552+0000", 2023-10-08T07:07:48.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.577296+0000", 2023-10-08T07:07:48.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001743407 2023-10-08T07:07:48.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.577313+0000", 2023-10-08T07:07:48.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7606000000000001e-05 2023-10-08T07:07:48.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.577327+0000", 2023-10-08T07:07:48.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3994e-05 2023-10-08T07:07:48.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.577335+0000", 2023-10-08T07:07:48.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4699999999999996e-06 2023-10-08T07:07:48.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.697 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.697 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161291 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.697 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.764098+0000", 2023-10-08T07:07:48.697 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.34212427299999998, 2023-10-08T07:07:48.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.34962876199999998, 2023-10-08T07:07:48.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.698 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.698 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.698 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161291 2023-10-08T07:07:48.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.698 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.764098+0000", 2023-10-08T07:07:48.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.764098+0000", 2023-10-08T07:07:48.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.769297+0000", 2023-10-08T07:07:48.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051984819999999999 2023-10-08T07:07:48.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.769315+0000", 2023-10-08T07:07:48.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8487000000000001e-05 2023-10-08T07:07:48.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.769327+0000", 2023-10-08T07:07:48.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2320999999999999e-05 2023-10-08T07:07:48.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.769335+0000", 2023-10-08T07:07:48.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4900000000000003e-06 2023-10-08T07:07:48.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.701 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.701 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161357 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.701 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.793935+0000", 2023-10-08T07:07:48.701 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.31228740799999999, 2023-10-08T07:07:48.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.31986067499999998, 2023-10-08T07:07:48.702 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.702 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.702 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161357 2023-10-08T07:07:48.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.702 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.793935+0000", 2023-10-08T07:07:48.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.793935+0000", 2023-10-08T07:07:48.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.793935+0000", 2023-10-08T07:07:48.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8500000000000002e-07 2023-10-08T07:07:48.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.793953+0000", 2023-10-08T07:07:48.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7393000000000001e-05 2023-10-08T07:07:48.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.793959+0000", 2023-10-08T07:07:48.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5239999999999997e-06 2023-10-08T07:07:48.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.793965+0000", 2023-10-08T07:07:48.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6300000000000003e-06 2023-10-08T07:07:48.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.705 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.705 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176700 4.c e64/17 4:3352c333:::10000000004.00000012:head v 64'5592, mlcod=64'5588)", 2023-10-08T07:07:48.705 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.104993+0000", 2023-10-08T07:07:48.706 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001228893, 2023-10-08T07:07:48.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088640639999999996, 2023-10-08T07:07:48.706 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.706 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.706 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104993+0000", 2023-10-08T07:07:48.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104993+0000", 2023-10-08T07:07:48.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104994+0000", 2023-10-08T07:07:48.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2023-10-08T07:07:48.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.105005+0000", 2023-10-08T07:07:48.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.096e-05 2023-10-08T07:07:48.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.105011+0000", 2023-10-08T07:07:48.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0599999999999996e-06 2023-10-08T07:07:48.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.105015+0000", 2023-10-08T07:07:48.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3050000000000003e-06 2023-10-08T07:07:48.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106771+0000", 2023-10-08T07:07:48.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017554879999999999 2023-10-08T07:07:48.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106800+0000", 2023-10-08T07:07:48.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9479999999999999e-05 2023-10-08T07:07:48.709 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.710 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.710 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159349 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.710 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.920341+0000", 2023-10-08T07:07:48.710 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1858816510000001, 2023-10-08T07:07:48.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.193578993, 2023-10-08T07:07:48.710 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.710 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.710 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.711 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159349 2023-10-08T07:07:48.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.711 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.920341+0000", 2023-10-08T07:07:48.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.920341+0000", 2023-10-08T07:07:48.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.922295+0000", 2023-10-08T07:07:48.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019538429999999998 2023-10-08T07:07:48.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.922309+0000", 2023-10-08T07:07:48.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4119e-05 2023-10-08T07:07:48.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.922319+0000", 2023-10-08T07:07:48.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9399999999999997e-06 2023-10-08T07:07:48.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.922324+0000", 2023-10-08T07:07:48.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.57e-06 2023-10-08T07:07:48.715 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.715 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.715 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.715 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160268 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.715 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.334374+0000", 2023-10-08T07:07:48.715 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.77184885400000003, 2023-10-08T07:07:48.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.77961323900000001, 2023-10-08T07:07:48.716 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.716 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.716 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160268 2023-10-08T07:07:48.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.716 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.334374+0000", 2023-10-08T07:07:48.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.334374+0000", 2023-10-08T07:07:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.336294+0000", 2023-10-08T07:07:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001920242 2023-10-08T07:07:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.336318+0000", 2023-10-08T07:07:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3917000000000002e-05 2023-10-08T07:07:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.336328+0000", 2023-10-08T07:07:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.039e-05 2023-10-08T07:07:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.336343+0000", 2023-10-08T07:07:48.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5353e-05 2023-10-08T07:07:48.719 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.719 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.719 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.719 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160370 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.719 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.376967+0000", 2023-10-08T07:07:48.719 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.72925543999999998, 2023-10-08T07:07:48.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.73708060200000003, 2023-10-08T07:07:48.719 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.719 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160370 2023-10-08T07:07:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.376967+0000", 2023-10-08T07:07:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.376967+0000", 2023-10-08T07:07:48.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.376968+0000", 2023-10-08T07:07:48.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8500000000000001e-07 2023-10-08T07:07:48.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.376987+0000", 2023-10-08T07:07:48.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9847000000000002e-05 2023-10-08T07:07:48.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.376996+0000", 2023-10-08T07:07:48.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7839999999999992e-06 2023-10-08T07:07:48.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.377003+0000", 2023-10-08T07:07:48.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4069999999999998e-06 2023-10-08T07:07:48.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.723 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.723 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.723 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160802 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.723 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.533439+0000", 2023-10-08T07:07:48.723 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.57278342000000004, 2023-10-08T07:07:48.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.58066533799999998, 2023-10-08T07:07:48.723 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.723 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160802 2023-10-08T07:07:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533439+0000", 2023-10-08T07:07:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533439+0000", 2023-10-08T07:07:48.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533439+0000", 2023-10-08T07:07:48.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9000000000000002e-07 2023-10-08T07:07:48.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533452+0000", 2023-10-08T07:07:48.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3006999999999999e-05 2023-10-08T07:07:48.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533460+0000", 2023-10-08T07:07:48.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2919999999999998e-06 2023-10-08T07:07:48.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533466+0000", 2023-10-08T07:07:48.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9020000000000004e-06 2023-10-08T07:07:48.727 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.727 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.727 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.727 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160827 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.727 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.550274+0000", 2023-10-08T07:07:48.727 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.555947992, 2023-10-08T07:07:48.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.56388379399999999, 2023-10-08T07:07:48.727 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.727 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.728 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160827 2023-10-08T07:07:48.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.728 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.550274+0000", 2023-10-08T07:07:48.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.550274+0000", 2023-10-08T07:07:48.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.550275+0000", 2023-10-08T07:07:48.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4499999999999997e-07 2023-10-08T07:07:48.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.550293+0000", 2023-10-08T07:07:48.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7516e-05 2023-10-08T07:07:48.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.550300+0000", 2023-10-08T07:07:48.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4719999999999998e-06 2023-10-08T07:07:48.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.550305+0000", 2023-10-08T07:07:48.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4110000000000004e-06 2023-10-08T07:07:48.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.731 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.731 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161683 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.731 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.915351+0000", 2023-10-08T07:07:48.731 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.19087132000000001, 2023-10-08T07:07:48.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.198862816, 2023-10-08T07:07:48.732 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.732 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.732 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.732 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.732 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.732 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161683 2023-10-08T07:07:48.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.732 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.915351+0000", 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.915351+0000", 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.917300+0000", 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019485800000000001 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.917317+0000", 2023-10-08T07:07:48.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7638999999999998e-05 2023-10-08T07:07:48.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.917338+0000", 2023-10-08T07:07:48.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0523999999999999e-05 2023-10-08T07:07:48.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.917346+0000", 2023-10-08T07:07:48.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1659999999999994e-06 2023-10-08T07:07:48.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.735 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.735 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161956 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.735 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.089737+0000", 2023-10-08T07:07:48.735 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016485804999999999, 2023-10-08T07:07:48.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024532579999999998, 2023-10-08T07:07:48.735 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161956 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.089737+0000", 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.089737+0000", 2023-10-08T07:07:48.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.089737+0000", 2023-10-08T07:07:48.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5700000000000002e-07 2023-10-08T07:07:48.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.089750+0000", 2023-10-08T07:07:48.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3139000000000001e-05 2023-10-08T07:07:48.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.089757+0000", 2023-10-08T07:07:48.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.08e-06 2023-10-08T07:07:48.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.089764+0000", 2023-10-08T07:07:48.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7299999999999999e-06 2023-10-08T07:07:48.738 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.739 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.739 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.739 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176703 4.20 e64/17 4:04004f2c:::10000000004.0000000d:head v 64'8333, mlcod=64'8326)", 2023-10-08T07:07:48.739 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.105648+0000", 2023-10-08T07:07:48.739 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00057418400000000004, 2023-10-08T07:07:48.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087258400000000003, 2023-10-08T07:07:48.739 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.739 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.739 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.105648+0000", 2023-10-08T07:07:48.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.105648+0000", 2023-10-08T07:07:48.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.105649+0000", 2023-10-08T07:07:48.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9100000000000004e-07 2023-10-08T07:07:48.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.105661+0000", 2023-10-08T07:07:48.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2464e-05 2023-10-08T07:07:48.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.105673+0000", 2023-10-08T07:07:48.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2249000000000001e-05 2023-10-08T07:07:48.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.105682+0000", 2023-10-08T07:07:48.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6309999999999992e-06 2023-10-08T07:07:48.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109254+0000", 2023-10-08T07:07:48.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003571631 2023-10-08T07:07:48.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109274+0000", 2023-10-08T07:07:48.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0103999999999999e-05 2023-10-08T07:07:48.743 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.743 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.743 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.743 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159196 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.743 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.839339+0000", 2023-10-08T07:07:48.744 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2668835389999999, 2023-10-08T07:07:48.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2751036250000001, 2023-10-08T07:07:48.744 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.744 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.744 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.744 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.744 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.744 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159196 2023-10-08T07:07:48.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.744 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.839339+0000", 2023-10-08T07:07:48.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.839339+0000", 2023-10-08T07:07:48.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.839339+0000", 2023-10-08T07:07:48.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.08e-07 2023-10-08T07:07:48.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.839349+0000", 2023-10-08T07:07:48.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2750000000000001e-06 2023-10-08T07:07:48.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.839354+0000", 2023-10-08T07:07:48.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0440000000000003e-06 2023-10-08T07:07:48.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.839357+0000", 2023-10-08T07:07:48.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4450000000000001e-06 2023-10-08T07:07:48.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.747 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.747 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159246 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.747 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.866435+0000", 2023-10-08T07:07:48.748 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.239787566, 2023-10-08T07:07:48.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2480641290000001, 2023-10-08T07:07:48.748 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.748 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.748 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.748 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.748 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.748 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159246 2023-10-08T07:07:48.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.748 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.866435+0000", 2023-10-08T07:07:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.866435+0000", 2023-10-08T07:07:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.866435+0000", 2023-10-08T07:07:48.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9100000000000004e-07 2023-10-08T07:07:48.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.866457+0000", 2023-10-08T07:07:48.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1861e-05 2023-10-08T07:07:48.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.866466+0000", 2023-10-08T07:07:48.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1230000000000006e-06 2023-10-08T07:07:48.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.866472+0000", 2023-10-08T07:07:48.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7969999999999997e-06 2023-10-08T07:07:48.751 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.751 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.751 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.751 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159390 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.751 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.940489+0000", 2023-10-08T07:07:48.752 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.16573317, 2023-10-08T07:07:48.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1740507410000001, 2023-10-08T07:07:48.752 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.752 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.752 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159390 2023-10-08T07:07:48.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.752 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.940489+0000", 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.940489+0000", 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.942296+0000", 2023-10-08T07:07:48.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018072159999999999 2023-10-08T07:07:48.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.942312+0000", 2023-10-08T07:07:48.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5503e-05 2023-10-08T07:07:48.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.942321+0000", 2023-10-08T07:07:48.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9789999999999999e-06 2023-10-08T07:07:48.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.942327+0000", 2023-10-08T07:07:48.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3350000000000003e-06 2023-10-08T07:07:48.755 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.755 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.755 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.756 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159553 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.756 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.011899+0000", 2023-10-08T07:07:48.756 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0943237319999999, 2023-10-08T07:07:48.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.102688192, 2023-10-08T07:07:48.756 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.756 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.756 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159553 2023-10-08T07:07:48.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.757 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.011899+0000", 2023-10-08T07:07:48.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.011899+0000", 2023-10-08T07:07:48.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.011899+0000", 2023-10-08T07:07:48.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0299999999999999e-07 2023-10-08T07:07:48.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.011917+0000", 2023-10-08T07:07:48.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7691999999999999e-05 2023-10-08T07:07:48.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.011924+0000", 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6190000000000002e-06 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.011930+0000", 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8540000000000002e-06 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.759 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159636 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.760 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.055397+0000", 2023-10-08T07:07:48.760 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0508255019999999, 2023-10-08T07:07:48.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.059243505, 2023-10-08T07:07:48.760 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.760 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.760 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159636 2023-10-08T07:07:48.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.760 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.055397+0000", 2023-10-08T07:07:48.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.055397+0000", 2023-10-08T07:07:48.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.055397+0000", 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3500000000000002e-07 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.055408+0000", 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0698e-05 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.055415+0000", 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2119999999999997e-06 2023-10-08T07:07:48.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.055420+0000", 2023-10-08T07:07:48.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9089999999999999e-06 2023-10-08T07:07:48.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.763 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.763 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160145 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.763 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.289429+0000", 2023-10-08T07:07:48.764 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.81679379699999999, 2023-10-08T07:07:48.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82524563799999995, 2023-10-08T07:07:48.764 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.764 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.764 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160145 2023-10-08T07:07:48.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.764 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289429+0000", 2023-10-08T07:07:48.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289429+0000", 2023-10-08T07:07:48.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289429+0000", 2023-10-08T07:07:48.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7899999999999999e-07 2023-10-08T07:07:48.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289444+0000", 2023-10-08T07:07:48.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5478999999999999e-05 2023-10-08T07:07:48.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289451+0000", 2023-10-08T07:07:48.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2539999999999998e-06 2023-10-08T07:07:48.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289456+0000", 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7910000000000001e-06 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160528 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.432392+0000", 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67383004599999996, 2023-10-08T07:07:48.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.68231948499999995, 2023-10-08T07:07:48.768 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.768 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.768 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160528 2023-10-08T07:07:48.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.768 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.432392+0000", 2023-10-08T07:07:48.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.432392+0000", 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.434294+0000", 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019017579999999999 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.434315+0000", 2023-10-08T07:07:48.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1399e-05 2023-10-08T07:07:48.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.434328+0000", 2023-10-08T07:07:48.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2451e-05 2023-10-08T07:07:48.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.434336+0000", 2023-10-08T07:07:48.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8939999999999993e-06 2023-10-08T07:07:48.771 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.771 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.771 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.771 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160938 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.771 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.588380+0000", 2023-10-08T07:07:48.771 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.51784224099999998, 2023-10-08T07:07:48.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.526364312, 2023-10-08T07:07:48.771 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.771 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.771 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.772 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.772 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.772 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160938 2023-10-08T07:07:48.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.772 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.588380+0000", 2023-10-08T07:07:48.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.588380+0000", 2023-10-08T07:07:48.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.588380+0000", 2023-10-08T07:07:48.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5400000000000002e-07 2023-10-08T07:07:48.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.588396+0000", 2023-10-08T07:07:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.525e-05 2023-10-08T07:07:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.588402+0000", 2023-10-08T07:07:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699999999999997e-06 2023-10-08T07:07:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.588406+0000", 2023-10-08T07:07:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7010000000000004e-06 2023-10-08T07:07:48.774 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.775 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.775 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161422 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.775 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.818397+0000", 2023-10-08T07:07:48.775 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28782553500000002, 2023-10-08T07:07:48.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29637935900000001, 2023-10-08T07:07:48.775 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.775 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.775 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.775 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.776 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161422 2023-10-08T07:07:48.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.776 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.818397+0000", 2023-10-08T07:07:48.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.818397+0000", 2023-10-08T07:07:48.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.818397+0000", 2023-10-08T07:07:48.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4000000000000002e-07 2023-10-08T07:07:48.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.818417+0000", 2023-10-08T07:07:48.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9388000000000001e-05 2023-10-08T07:07:48.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.818423+0000", 2023-10-08T07:07:48.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6699999999999997e-06 2023-10-08T07:07:48.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.818428+0000", 2023-10-08T07:07:48.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.87e-06 2023-10-08T07:07:48.778 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.779 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.779 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.779 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161500 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.779 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.849345+0000", 2023-10-08T07:07:48.779 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.25687759999999998, 2023-10-08T07:07:48.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.26546346799999998, 2023-10-08T07:07:48.779 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.779 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.779 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.779 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.780 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.780 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161500 2023-10-08T07:07:48.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.780 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.849345+0000", 2023-10-08T07:07:48.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.849345+0000", 2023-10-08T07:07:48.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.853307+0000", 2023-10-08T07:07:48.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039622839999999999 2023-10-08T07:07:48.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.853326+0000", 2023-10-08T07:07:48.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8836000000000001e-05 2023-10-08T07:07:48.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.853336+0000", 2023-10-08T07:07:48.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7429999999999997e-06 2023-10-08T07:07:48.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.853343+0000", 2023-10-08T07:07:48.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.046e-06 2023-10-08T07:07:48.782 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.782 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.783 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.783 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176661 4.20 e64/17 4:05b3915c:::10000000004.00000016:head v 64'8330, mlcod=64'8325)", 2023-10-08T07:07:48.783 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.091208+0000", 2023-10-08T07:07:48.783 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.015014768, 2023-10-08T07:07:48.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023631599999999999, 2023-10-08T07:07:48.783 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.783 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.783 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091208+0000", 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091208+0000", 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091208+0000", 2023-10-08T07:07:48.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4099999999999998e-07 2023-10-08T07:07:48.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091228+0000", 2023-10-08T07:07:48.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9347999999999998e-05 2023-10-08T07:07:48.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091237+0000", 2023-10-08T07:07:48.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9400000000000008e-06 2023-10-08T07:07:48.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091244+0000", 2023-10-08T07:07:48.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2420000000000003e-06 2023-10-08T07:07:48.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091344+0000", 2023-10-08T07:07:48.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9814000000000004e-05 2023-10-08T07:07:48.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091363+0000", 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9502999999999999e-05 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161988 4.7 4:e2479c46:::10000000004.00000024:head [write 3420160~4096 in=4096b,write 3452928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.101670+0000", 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.004552426, 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013205596, 2023-10-08T07:07:48.787 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.788 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.788 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161988 2023-10-08T07:07:48.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.788 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101670+0000", 2023-10-08T07:07:48.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.101670+0000", 2023-10-08T07:07:48.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106294+0000", 2023-10-08T07:07:48.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046244290000000002 2023-10-08T07:07:48.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106318+0000", 2023-10-08T07:07:48.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3295e-05 2023-10-08T07:07:48.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106328+0000", 2023-10-08T07:07:48.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0648e-05 2023-10-08T07:07:48.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106336+0000", 2023-10-08T07:07:48.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.824e-06 2023-10-08T07:07:48.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106393+0000", 2023-10-08T07:07:48.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6641000000000002e-05 2023-10-08T07:07:48.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106487+0000", 2023-10-08T07:07:48.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4585000000000003e-05 2023-10-08T07:07:48.792 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.792 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.792 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.793 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159247 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.793 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.866480+0000", 2023-10-08T07:07:48.793 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2397419119999999, 2023-10-08T07:07:48.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.248432443, 2023-10-08T07:07:48.793 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.793 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.793 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.793 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.793 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.794 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159247 2023-10-08T07:07:48.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.794 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.866480+0000", 2023-10-08T07:07:48.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.866480+0000", 2023-10-08T07:07:48.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.866481+0000", 2023-10-08T07:07:48.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2023-10-08T07:07:48.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.866500+0000", 2023-10-08T07:07:48.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9247000000000001e-05 2023-10-08T07:07:48.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.866507+0000", 2023-10-08T07:07:48.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5220000000000004e-06 2023-10-08T07:07:48.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.866513+0000", 2023-10-08T07:07:48.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0959999999999997e-06 2023-10-08T07:07:48.796 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.796 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.797 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.797 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160149 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.797 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.289465+0000", 2023-10-08T07:07:48.797 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.81675747499999996, 2023-10-08T07:07:48.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82547756000000005, 2023-10-08T07:07:48.797 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.797 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.797 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.798 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.798 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.798 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160149 2023-10-08T07:07:48.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.798 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289465+0000", 2023-10-08T07:07:48.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289465+0000", 2023-10-08T07:07:48.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289465+0000", 2023-10-08T07:07:48.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:07:48.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289481+0000", 2023-10-08T07:07:48.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5549999999999999e-05 2023-10-08T07:07:48.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289487+0000", 2023-10-08T07:07:48.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1149999999999999e-06 2023-10-08T07:07:48.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289493+0000", 2023-10-08T07:07:48.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5820000000000001e-06 2023-10-08T07:07:48.800 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.801 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.801 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.801 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160704 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.801 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.501340+0000", 2023-10-08T07:07:48.801 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.60488287299999999, 2023-10-08T07:07:48.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.61363212199999995, 2023-10-08T07:07:48.801 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.801 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.802 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.802 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160704 2023-10-08T07:07:48.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.802 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.501340+0000", 2023-10-08T07:07:48.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.501340+0000", 2023-10-08T07:07:48.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.503928+0000", 2023-10-08T07:07:48.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025883859999999998 2023-10-08T07:07:48.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.503950+0000", 2023-10-08T07:07:48.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2563000000000001e-05 2023-10-08T07:07:48.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.503962+0000", 2023-10-08T07:07:48.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1752e-05 2023-10-08T07:07:48.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.503969+0000", 2023-10-08T07:07:48.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2309999999999999e-06 2023-10-08T07:07:48.804 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.804 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.804 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.805 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160804 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.805 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.533509+0000", 2023-10-08T07:07:48.805 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.57271359399999999, 2023-10-08T07:07:48.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.58149208200000002, 2023-10-08T07:07:48.805 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.805 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.805 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160804 2023-10-08T07:07:48.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.806 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533509+0000", 2023-10-08T07:07:48.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533509+0000", 2023-10-08T07:07:48.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533509+0000", 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8400000000000005e-07 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533532+0000", 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2266e-05 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533539+0000", 2023-10-08T07:07:48.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5700000000000004e-06 2023-10-08T07:07:48.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.533545+0000", 2023-10-08T07:07:48.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3679999999999998e-06 2023-10-08T07:07:48.808 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.808 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.808 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.809 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161265 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.809 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.750975+0000", 2023-10-08T07:07:48.809 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.35524769499999997, 2023-10-08T07:07:48.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.36405580900000001, 2023-10-08T07:07:48.809 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.809 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.809 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.809 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.809 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.809 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161265 2023-10-08T07:07:48.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.810 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.750975+0000", 2023-10-08T07:07:48.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.750975+0000", 2023-10-08T07:07:48.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.750975+0000", 2023-10-08T07:07:48.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3099999999999997e-07 2023-10-08T07:07:48.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.750994+0000", 2023-10-08T07:07:48.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8399000000000001e-05 2023-10-08T07:07:48.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.751003+0000", 2023-10-08T07:07:48.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9320000000000002e-06 2023-10-08T07:07:48.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.751009+0000", 2023-10-08T07:07:48.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4489999999999996e-06 2023-10-08T07:07:48.812 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.812 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.812 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.813 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161453 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.813 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.825994+0000", 2023-10-08T07:07:48.813 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28022835099999999, 2023-10-08T07:07:48.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.289066818, 2023-10-08T07:07:48.813 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.813 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.814 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.814 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161453 2023-10-08T07:07:48.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.814 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.825994+0000", 2023-10-08T07:07:48.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.825994+0000", 2023-10-08T07:07:48.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.825994+0000", 2023-10-08T07:07:48.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5199999999999998e-07 2023-10-08T07:07:48.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.826010+0000", 2023-10-08T07:07:48.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5970000000000001e-05 2023-10-08T07:07:48.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.826238+0000", 2023-10-08T07:07:48.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022750900000000001 2023-10-08T07:07:48.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.826245+0000", 2023-10-08T07:07:48.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0199999999999997e-06 2023-10-08T07:07:48.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.816 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176662 4.1b e64/17 4:d97fb168:::10000000004.00000008:head v 64'5559, mlcod=64'5557)", 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.091257+0000", 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014965727, 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023835025999999999, 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091257+0000", 2023-10-08T07:07:48.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091257+0000", 2023-10-08T07:07:48.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091257+0000", 2023-10-08T07:07:48.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9900000000000001e-07 2023-10-08T07:07:48.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091274+0000", 2023-10-08T07:07:48.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6691e-05 2023-10-08T07:07:48.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091283+0000", 2023-10-08T07:07:48.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8230000000000001e-06 2023-10-08T07:07:48.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091293+0000", 2023-10-08T07:07:48.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0363999999999999e-05 2023-10-08T07:07:48.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094472+0000", 2023-10-08T07:07:48.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003179327 2023-10-08T07:07:48.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094485+0000", 2023-10-08T07:07:48.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2825e-05 2023-10-08T07:07:48.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.821 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.821 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161989 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 798720~4096 in=4096b,write 1015808~4096 in=4096b,write 1040384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.821 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.106354+0000", 2023-10-08T07:07:48.821 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9998679, 2023-10-08T07:07:48.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087758639999999995, 2023-10-08T07:07:48.821 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.821 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.822 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161989 2023-10-08T07:07:48.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.822 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106354+0000", 2023-10-08T07:07:48.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106354+0000", 2023-10-08T07:07:48.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106355+0000", 2023-10-08T07:07:48.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1699999999999998e-07 2023-10-08T07:07:48.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106367+0000", 2023-10-08T07:07:48.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1922e-05 2023-10-08T07:07:48.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106374+0000", 2023-10-08T07:07:48.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7700000000000004e-06 2023-10-08T07:07:48.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106379+0000", 2023-10-08T07:07:48.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5679999999999999e-06 2023-10-08T07:07:48.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106426+0000", 2023-10-08T07:07:48.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6828e-05 2023-10-08T07:07:48.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106514+0000", 2023-10-08T07:07:48.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8245999999999995e-05 2023-10-08T07:07:48.825 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.826 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.826 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159480 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.826 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.987226+0000", 2023-10-08T07:07:48.826 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1189965900000001, 2023-10-08T07:07:48.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1279413759999999, 2023-10-08T07:07:48.826 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.826 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.827 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.827 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.827 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.827 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159480 2023-10-08T07:07:48.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.827 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987226+0000", 2023-10-08T07:07:48.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987226+0000", 2023-10-08T07:07:48.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987226+0000", 2023-10-08T07:07:48.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0999999999999998e-07 2023-10-08T07:07:48.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987244+0000", 2023-10-08T07:07:48.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7181e-05 2023-10-08T07:07:48.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987253+0000", 2023-10-08T07:07:48.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6630000000000005e-06 2023-10-08T07:07:48.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987260+0000", 2023-10-08T07:07:48.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1149999999999996e-06 2023-10-08T07:07:48.830 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.830 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.830 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.830 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160110 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.830 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.274472+0000", 2023-10-08T07:07:48.830 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.83174997699999997, 2023-10-08T07:07:48.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84072479300000003, 2023-10-08T07:07:48.830 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.830 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.831 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.831 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.831 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.831 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160110 2023-10-08T07:07:48.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.831 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.274472+0000", 2023-10-08T07:07:48.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.274472+0000", 2023-10-08T07:07:48.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.274473+0000", 2023-10-08T07:07:48.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1200000000000003e-07 2023-10-08T07:07:48.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.274489+0000", 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5718000000000001e-05 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.274497+0000", 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1680000000000004e-06 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.274503+0000", 2023-10-08T07:07:48.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8259999999999998e-06 2023-10-08T07:07:48.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.834 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.834 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160150 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.834 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.289500+0000", 2023-10-08T07:07:48.834 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.81672212799999999, 2023-10-08T07:07:48.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.82572716800000001, 2023-10-08T07:07:48.834 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.834 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160150 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289500+0000", 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289500+0000", 2023-10-08T07:07:48.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289501+0000", 2023-10-08T07:07:48.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3000000000000001e-07 2023-10-08T07:07:48.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289512+0000", 2023-10-08T07:07:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1559999999999999e-05 2023-10-08T07:07:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289524+0000", 2023-10-08T07:07:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1891e-05 2023-10-08T07:07:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.289529+0000", 2023-10-08T07:07:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3489999999999999e-06 2023-10-08T07:07:48.839 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.839 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.839 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.839 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160190 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.839 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.305461+0000", 2023-10-08T07:07:48.839 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.80076122299999997, 2023-10-08T07:07:48.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.80979690599999998, 2023-10-08T07:07:48.839 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.840 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.840 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.840 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.840 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.840 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160190 2023-10-08T07:07:48.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.840 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.305461+0000", 2023-10-08T07:07:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.305461+0000", 2023-10-08T07:07:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.305462+0000", 2023-10-08T07:07:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2023-10-08T07:07:48.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.305473+0000", 2023-10-08T07:07:48.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1755e-05 2023-10-08T07:07:48.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.305481+0000", 2023-10-08T07:07:48.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1259999999999998e-06 2023-10-08T07:07:48.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.305495+0000", 2023-10-08T07:07:48.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3403e-05 2023-10-08T07:07:48.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.843 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.843 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160300 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.843 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.348506+0000", 2023-10-08T07:07:48.843 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.75771657000000003, 2023-10-08T07:07:48.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.76678901600000005, 2023-10-08T07:07:48.844 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.844 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.844 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160300 2023-10-08T07:07:48.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.844 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.348506+0000", 2023-10-08T07:07:48.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.348506+0000", 2023-10-08T07:07:48.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.348506+0000", 2023-10-08T07:07:48.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.96e-07 2023-10-08T07:07:48.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.348519+0000", 2023-10-08T07:07:48.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2602000000000001e-05 2023-10-08T07:07:48.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.348525+0000", 2023-10-08T07:07:48.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7479999999999999e-06 2023-10-08T07:07:48.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.348529+0000", 2023-10-08T07:07:48.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5009999999999998e-06 2023-10-08T07:07:48.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.847 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.847 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160333 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.847 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.364522+0000", 2023-10-08T07:07:48.848 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74169993899999997, 2023-10-08T07:07:48.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.75083246999999997, 2023-10-08T07:07:48.848 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.848 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.848 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160333 2023-10-08T07:07:48.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.848 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.364522+0000", 2023-10-08T07:07:48.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.364522+0000", 2023-10-08T07:07:48.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.364523+0000", 2023-10-08T07:07:48.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5100000000000001e-07 2023-10-08T07:07:48.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.364535+0000", 2023-10-08T07:07:48.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2234e-05 2023-10-08T07:07:48.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.364541+0000", 2023-10-08T07:07:48.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8100000000000003e-06 2023-10-08T07:07:48.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.364546+0000", 2023-10-08T07:07:48.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0000000000000004e-06 2023-10-08T07:07:48.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.851 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.851 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160751 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.851 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.518372+0000", 2023-10-08T07:07:48.851 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.58784995399999995, 2023-10-08T07:07:48.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.59704372500000003, 2023-10-08T07:07:48.852 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.852 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.852 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.852 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.852 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.852 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160751 2023-10-08T07:07:48.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.852 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.518372+0000", 2023-10-08T07:07:48.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.518372+0000", 2023-10-08T07:07:48.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.518373+0000", 2023-10-08T07:07:48.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1600000000000002e-07 2023-10-08T07:07:48.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.518385+0000", 2023-10-08T07:07:48.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2489e-05 2023-10-08T07:07:48.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.518390+0000", 2023-10-08T07:07:48.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7500000000000003e-06 2023-10-08T07:07:48.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.518393+0000", 2023-10-08T07:07:48.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.23e-06 2023-10-08T07:07:48.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.855 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.855 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160901 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.855 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.577350+0000", 2023-10-08T07:07:48.855 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.52887267299999996, 2023-10-08T07:07:48.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.53812595900000004, 2023-10-08T07:07:48.856 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.856 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.856 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.856 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160901 2023-10-08T07:07:48.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.856 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.577350+0000", 2023-10-08T07:07:48.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.577350+0000", 2023-10-08T07:07:48.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.579308+0000", 2023-10-08T07:07:48.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019587620000000002 2023-10-08T07:07:48.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.579329+0000", 2023-10-08T07:07:48.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0364e-05 2023-10-08T07:07:48.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.579339+0000", 2023-10-08T07:07:48.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.063e-05 2023-10-08T07:07:48.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.579347+0000", 2023-10-08T07:07:48.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6650000000000003e-06 2023-10-08T07:07:48.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.859 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.860 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161013 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.860 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.633605+0000", 2023-10-08T07:07:48.860 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47261739699999999, 2023-10-08T07:07:48.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48192876600000001, 2023-10-08T07:07:48.860 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.861 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.862 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.862 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161013 2023-10-08T07:07:48.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.862 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.633605+0000", 2023-10-08T07:07:48.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.633605+0000", 2023-10-08T07:07:48.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.633606+0000", 2023-10-08T07:07:48.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0200000000000001e-07 2023-10-08T07:07:48.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.633634+0000", 2023-10-08T07:07:48.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8002999999999999e-05 2023-10-08T07:07:48.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.633644+0000", 2023-10-08T07:07:48.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9089999999999995e-06 2023-10-08T07:07:48.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.633650+0000", 2023-10-08T07:07:48.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2539999999999998e-06 2023-10-08T07:07:48.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.866 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.866 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161041 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.866 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.644346+0000", 2023-10-08T07:07:48.866 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.46187671299999999, 2023-10-08T07:07:48.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47122277299999998, 2023-10-08T07:07:48.866 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.867 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.867 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161041 2023-10-08T07:07:48.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.867 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.644346+0000", 2023-10-08T07:07:48.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.644346+0000", 2023-10-08T07:07:48.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.650303+0000", 2023-10-08T07:07:48.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059571729999999996 2023-10-08T07:07:48.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.650330+0000", 2023-10-08T07:07:48.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6687999999999999e-05 2023-10-08T07:07:48.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.650340+0000", 2023-10-08T07:07:48.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0183999999999999e-05 2023-10-08T07:07:48.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.650349+0000", 2023-10-08T07:07:48.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8449999999999992e-06 2023-10-08T07:07:48.870 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.870 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.870 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.870 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161565 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.870 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.875390+0000", 2023-10-08T07:07:48.871 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.23083189900000001, 2023-10-08T07:07:48.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.24020878500000001, 2023-10-08T07:07:48.871 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.871 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.871 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161565 2023-10-08T07:07:48.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.871 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.875390+0000", 2023-10-08T07:07:48.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.875390+0000", 2023-10-08T07:07:48.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.877295+0000", 2023-10-08T07:07:48.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019042060000000001 2023-10-08T07:07:48.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.877311+0000", 2023-10-08T07:07:48.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6688999999999999e-05 2023-10-08T07:07:48.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.877321+0000", 2023-10-08T07:07:48.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3300000000000005e-06 2023-10-08T07:07:48.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.877327+0000", 2023-10-08T07:07:48.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.545e-06 2023-10-08T07:07:48.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.874 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.874 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176154 4.3a e64/17)", 2023-10-08T07:07:48.874 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.091302+0000", 2023-10-08T07:07:48.875 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014920354, 2023-10-08T07:07:48.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024326832999999999, 2023-10-08T07:07:48.875 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.875 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.875 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091302+0000", 2023-10-08T07:07:48.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091302+0000", 2023-10-08T07:07:48.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091302+0000", 2023-10-08T07:07:48.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4499999999999998e-07 2023-10-08T07:07:48.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091314+0000", 2023-10-08T07:07:48.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.186e-05 2023-10-08T07:07:48.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091320+0000", 2023-10-08T07:07:48.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2210000000000002e-06 2023-10-08T07:07:48.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091325+0000", 2023-10-08T07:07:48.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.04e-06 2023-10-08T07:07:48.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.878 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.878 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159481 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.878 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.987272+0000", 2023-10-08T07:07:48.878 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1189502950000001, 2023-10-08T07:07:48.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1283839280000001, 2023-10-08T07:07:48.879 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.879 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.879 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159481 2023-10-08T07:07:48.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.879 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987272+0000", 2023-10-08T07:07:48.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987272+0000", 2023-10-08T07:07:48.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987273+0000", 2023-10-08T07:07:48.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8100000000000003e-07 2023-10-08T07:07:48.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987287+0000", 2023-10-08T07:07:48.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3954000000000001e-05 2023-10-08T07:07:48.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987298+0000", 2023-10-08T07:07:48.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1904e-05 2023-10-08T07:07:48.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987303+0000", 2023-10-08T07:07:48.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9030000000000003e-06 2023-10-08T07:07:48.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.882 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.882 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160192 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.883 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.305512+0000", 2023-10-08T07:07:48.883 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.80071044700000005, 2023-10-08T07:07:48.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.81017430199999996, 2023-10-08T07:07:48.883 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.883 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.883 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.883 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160192 2023-10-08T07:07:48.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.883 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.305512+0000", 2023-10-08T07:07:48.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.305512+0000", 2023-10-08T07:07:48.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.305513+0000", 2023-10-08T07:07:48.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4000000000000001e-07 2023-10-08T07:07:48.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.305538+0000", 2023-10-08T07:07:48.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5001e-05 2023-10-08T07:07:48.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.305547+0000", 2023-10-08T07:07:48.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6509999999999996e-06 2023-10-08T07:07:48.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.305555+0000", 2023-10-08T07:07:48.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3529999999999997e-06 2023-10-08T07:07:48.886 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.886 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.886 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.887 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160416 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.887 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.394379+0000", 2023-10-08T07:07:48.887 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.71184381600000002, 2023-10-08T07:07:48.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.72133803100000005, 2023-10-08T07:07:48.887 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.887 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.887 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160416 2023-10-08T07:07:48.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.888 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.394379+0000", 2023-10-08T07:07:48.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.394379+0000", 2023-10-08T07:07:48.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.394379+0000", 2023-10-08T07:07:48.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0999999999999999e-07 2023-10-08T07:07:48.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.394394+0000", 2023-10-08T07:07:48.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4817999999999999e-05 2023-10-08T07:07:48.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.394400+0000", 2023-10-08T07:07:48.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4320000000000004e-06 2023-10-08T07:07:48.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.394406+0000", 2023-10-08T07:07:48.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4319999999999998e-06 2023-10-08T07:07:48.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.890 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.890 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.891 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160459 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.891 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.408428+0000", 2023-10-08T07:07:48.891 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.69779446599999995, 2023-10-08T07:07:48.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.70731932900000005, 2023-10-08T07:07:48.891 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.891 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.891 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160459 2023-10-08T07:07:48.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.892 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.408428+0000", 2023-10-08T07:07:48.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.408428+0000", 2023-10-08T07:07:48.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.410294+0000", 2023-10-08T07:07:48.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001866007 2023-10-08T07:07:48.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.410311+0000", 2023-10-08T07:07:48.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7153e-05 2023-10-08T07:07:48.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.410322+0000", 2023-10-08T07:07:48.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1422e-05 2023-10-08T07:07:48.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.410331+0000", 2023-10-08T07:07:48.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4060000000000005e-06 2023-10-08T07:07:48.894 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.894 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.895 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160566 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.895 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.450426+0000", 2023-10-08T07:07:48.895 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.65579646199999997, 2023-10-08T07:07:48.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.66535134299999998, 2023-10-08T07:07:48.895 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.895 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.896 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160566 2023-10-08T07:07:48.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.896 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.450426+0000", 2023-10-08T07:07:48.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.450426+0000", 2023-10-08T07:07:48.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.450426+0000", 2023-10-08T07:07:48.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2023-10-08T07:07:48.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.450443+0000", 2023-10-08T07:07:48.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6226999999999999e-05 2023-10-08T07:07:48.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.450452+0000", 2023-10-08T07:07:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7860000000000002e-06 2023-10-08T07:07:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.450458+0000", 2023-10-08T07:07:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3579999999999999e-06 2023-10-08T07:07:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.898 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.899 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160602 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.899 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.462407+0000", 2023-10-08T07:07:48.899 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.64381552600000003, 2023-10-08T07:07:48.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.65339959000000003, 2023-10-08T07:07:48.899 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.899 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.899 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.899 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.899 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.900 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160602 2023-10-08T07:07:48.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.900 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.462407+0000", 2023-10-08T07:07:48.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.462407+0000", 2023-10-08T07:07:48.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.462407+0000", 2023-10-08T07:07:48.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9800000000000004e-07 2023-10-08T07:07:48.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.462419+0000", 2023-10-08T07:07:48.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1436e-05 2023-10-08T07:07:48.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.462425+0000", 2023-10-08T07:07:48.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3980000000000004e-06 2023-10-08T07:07:48.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.462430+0000", 2023-10-08T07:07:48.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8559999999999998e-06 2023-10-08T07:07:48.902 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.903 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.903 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160708 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.903 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.504015+0000", 2023-10-08T07:07:48.903 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.60220696500000004, 2023-10-08T07:07:48.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.611820366, 2023-10-08T07:07:48.903 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.903 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.903 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160708 2023-10-08T07:07:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.504015+0000", 2023-10-08T07:07:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.504015+0000", 2023-10-08T07:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.504016+0000", 2023-10-08T07:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8200000000000001e-07 2023-10-08T07:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.504028+0000", 2023-10-08T07:07:48.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2140999999999999e-05 2023-10-08T07:07:48.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.504034+0000", 2023-10-08T07:07:48.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7660000000000004e-06 2023-10-08T07:07:48.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.504038+0000", 2023-10-08T07:07:48.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7230000000000004e-06 2023-10-08T07:07:48.906 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.907 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.907 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.907 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160999 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.907 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.618386+0000", 2023-10-08T07:07:48.907 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48783610199999999, 2023-10-08T07:07:48.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.497490506, 2023-10-08T07:07:48.907 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.907 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.907 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.907 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.908 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160999 2023-10-08T07:07:48.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.908 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.618386+0000", 2023-10-08T07:07:48.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.618386+0000", 2023-10-08T07:07:48.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.618387+0000", 2023-10-08T07:07:48.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.96e-07 2023-10-08T07:07:48.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.618397+0000", 2023-10-08T07:07:48.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0806e-05 2023-10-08T07:07:48.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.618405+0000", 2023-10-08T07:07:48.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7039999999999994e-06 2023-10-08T07:07:48.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.618410+0000", 2023-10-08T07:07:48.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0719999999999999e-06 2023-10-08T07:07:48.910 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.911 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.911 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161222 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.911 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.736345+0000", 2023-10-08T07:07:48.911 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.36987756500000002, 2023-10-08T07:07:48.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.379578898, 2023-10-08T07:07:48.911 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.911 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.911 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.911 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.912 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.912 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161222 2023-10-08T07:07:48.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.912 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.736345+0000", 2023-10-08T07:07:48.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.736345+0000", 2023-10-08T07:07:48.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.736345+0000", 2023-10-08T07:07:48.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:07:48.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.736358+0000", 2023-10-08T07:07:48.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3013000000000001e-05 2023-10-08T07:07:48.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.736365+0000", 2023-10-08T07:07:48.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0940000000000002e-06 2023-10-08T07:07:48.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.736371+0000", 2023-10-08T07:07:48.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1749999999999996e-06 2023-10-08T07:07:48.915 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.915 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.915 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.915 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161531 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.915 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.865336+0000", 2023-10-08T07:07:48.915 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.240886769, 2023-10-08T07:07:48.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.25064867800000001, 2023-10-08T07:07:48.915 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.915 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.916 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.916 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.916 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.916 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161531 2023-10-08T07:07:48.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.916 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.865336+0000", 2023-10-08T07:07:48.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.865336+0000", 2023-10-08T07:07:48.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.865336+0000", 2023-10-08T07:07:48.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8000000000000001e-07 2023-10-08T07:07:48.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.865346+0000", 2023-10-08T07:07:48.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0427e-05 2023-10-08T07:07:48.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.865350+0000", 2023-10-08T07:07:48.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0180000000000003e-06 2023-10-08T07:07:48.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.865354+0000", 2023-10-08T07:07:48.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0939999999999999e-06 2023-10-08T07:07:48.919 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.919 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.919 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.919 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161612 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.920 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.889387+0000", 2023-10-08T07:07:48.920 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.216835211, 2023-10-08T07:07:48.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.226658582, 2023-10-08T07:07:48.920 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.920 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.920 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.920 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.920 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.920 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161612 2023-10-08T07:07:48.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.920 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.889387+0000", 2023-10-08T07:07:48.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.889387+0000", 2023-10-08T07:07:48.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.889388+0000", 2023-10-08T07:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1800000000000001e-07 2023-10-08T07:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.889402+0000", 2023-10-08T07:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.431e-05 2023-10-08T07:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.889409+0000", 2023-10-08T07:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.272e-06 2023-10-08T07:07:48.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.889414+0000", 2023-10-08T07:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8420000000000004e-06 2023-10-08T07:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176664 4.2b e64/17 4:d7a77d67:::10000000004.00000029:head v 64'5563, mlcod=64'5559)", 2023-10-08T07:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.091333+0000", 2023-10-08T07:07:48.923 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014889374, 2023-10-08T07:07:48.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024782164999999998, 2023-10-08T07:07:48.924 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.924 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.924 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091333+0000", 2023-10-08T07:07:48.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091333+0000", 2023-10-08T07:07:48.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091333+0000", 2023-10-08T07:07:48.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8999999999999998e-07 2023-10-08T07:07:48.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091345+0000", 2023-10-08T07:07:48.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.137e-05 2023-10-08T07:07:48.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091350+0000", 2023-10-08T07:07:48.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8340000000000004e-06 2023-10-08T07:07:48.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091355+0000", 2023-10-08T07:07:48.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1649999999999999e-06 2023-10-08T07:07:48.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097660+0000", 2023-10-08T07:07:48.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063052749999999999 2023-10-08T07:07:48.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097678+0000", 2023-10-08T07:07:48.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8403e-05 2023-10-08T07:07:48.927 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.927 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.927 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.928 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176220 4.3a e64/17)", 2023-10-08T07:07:48.928 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.106860+0000", 2023-10-08T07:07:48.928 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999362, 2023-10-08T07:07:48.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0093239340000000007, 2023-10-08T07:07:48.928 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.928 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.928 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106860+0000", 2023-10-08T07:07:48.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106860+0000", 2023-10-08T07:07:48.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106861+0000", 2023-10-08T07:07:48.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.15e-07 2023-10-08T07:07:48.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106876+0000", 2023-10-08T07:07:48.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5577999999999999e-05 2023-10-08T07:07:48.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106883+0000", 2023-10-08T07:07:48.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8050000000000001e-06 2023-10-08T07:07:48.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106889+0000", 2023-10-08T07:07:48.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6010000000000002e-06 2023-10-08T07:07:48.931 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.931 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.931 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.931 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159483 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.932 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.987310+0000", 2023-10-08T07:07:48.932 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.118911891, 2023-10-08T07:07:48.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1289320860000001, 2023-10-08T07:07:48.932 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.932 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.932 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.932 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.932 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.932 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159483 2023-10-08T07:07:48.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.932 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987310+0000", 2023-10-08T07:07:48.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987310+0000", 2023-10-08T07:07:48.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987311+0000", 2023-10-08T07:07:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.58e-07 2023-10-08T07:07:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987325+0000", 2023-10-08T07:07:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3969e-05 2023-10-08T07:07:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987331+0000", 2023-10-08T07:07:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9519999999999999e-06 2023-10-08T07:07:48.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987336+0000", 2023-10-08T07:07:48.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3310000000000003e-06 2023-10-08T07:07:48.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.935 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.935 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159992 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.936 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.221963+0000", 2023-10-08T07:07:48.936 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.88425949299999995, 2023-10-08T07:07:48.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.89434917700000005, 2023-10-08T07:07:48.936 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.936 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.936 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159992 2023-10-08T07:07:48.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.936 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.221963+0000", 2023-10-08T07:07:48.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.221963+0000", 2023-10-08T07:07:48.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.221964+0000", 2023-10-08T07:07:48.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1099999999999995e-07 2023-10-08T07:07:48.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.221979+0000", 2023-10-08T07:07:48.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5336999999999999e-05 2023-10-08T07:07:48.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.221988+0000", 2023-10-08T07:07:48.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8559999999999996e-06 2023-10-08T07:07:48.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.221994+0000", 2023-10-08T07:07:48.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3749999999999999e-06 2023-10-08T07:07:48.939 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.939 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.939 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.940 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160115 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.940 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.274547+0000", 2023-10-08T07:07:48.940 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.83167523099999996, 2023-10-08T07:07:48.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.84182254499999998, 2023-10-08T07:07:48.940 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.940 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.940 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160115 2023-10-08T07:07:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.274547+0000", 2023-10-08T07:07:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.274547+0000", 2023-10-08T07:07:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.274548+0000", 2023-10-08T07:07:48.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000005e-07 2023-10-08T07:07:48.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.274559+0000", 2023-10-08T07:07:48.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1766999999999999e-05 2023-10-08T07:07:48.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.274566+0000", 2023-10-08T07:07:48.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.686e-06 2023-10-08T07:07:48.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.274571+0000", 2023-10-08T07:07:48.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9080000000000003e-06 2023-10-08T07:07:48.943 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.943 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.943 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.944 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160464 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.944 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.410345+0000", 2023-10-08T07:07:48.944 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.695877776, 2023-10-08T07:07:48.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.70608174800000001, 2023-10-08T07:07:48.944 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.944 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.944 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.944 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.944 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.944 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160464 2023-10-08T07:07:48.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.945 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.410345+0000", 2023-10-08T07:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.410345+0000", 2023-10-08T07:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.410345+0000", 2023-10-08T07:07:48.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9699999999999996e-07 2023-10-08T07:07:48.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.410363+0000", 2023-10-08T07:07:48.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7864e-05 2023-10-08T07:07:48.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.410371+0000", 2023-10-08T07:07:48.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8059999999999995e-06 2023-10-08T07:07:48.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.410377+0000", 2023-10-08T07:07:48.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2219999999999999e-06 2023-10-08T07:07:48.948 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.948 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.948 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.948 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161001 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.948 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.618421+0000", 2023-10-08T07:07:48.948 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.48780181099999997, 2023-10-08T07:07:48.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.49805937500000003, 2023-10-08T07:07:48.949 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.949 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.949 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.949 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.949 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.949 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161001 2023-10-08T07:07:48.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.949 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.618421+0000", 2023-10-08T07:07:48.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.618421+0000", 2023-10-08T07:07:48.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.618421+0000", 2023-10-08T07:07:48.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.65e-07 2023-10-08T07:07:48.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.618432+0000", 2023-10-08T07:07:48.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0685e-05 2023-10-08T07:07:48.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.618445+0000", 2023-10-08T07:07:48.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3818000000000001e-05 2023-10-08T07:07:48.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.618454+0000", 2023-10-08T07:07:48.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0909999999999993e-06 2023-10-08T07:07:48.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.952 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.952 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161015 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.952 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.633883+0000", 2023-10-08T07:07:48.953 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47233956999999999, 2023-10-08T07:07:48.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.48265280300000002, 2023-10-08T07:07:48.953 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.953 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.953 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161015 2023-10-08T07:07:48.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.953 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.633883+0000", 2023-10-08T07:07:48.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.633883+0000", 2023-10-08T07:07:48.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.633883+0000", 2023-10-08T07:07:48.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4000000000000001e-07 2023-10-08T07:07:48.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.633901+0000", 2023-10-08T07:07:48.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7793999999999999e-05 2023-10-08T07:07:48.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.633913+0000", 2023-10-08T07:07:48.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1483e-05 2023-10-08T07:07:48.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.633918+0000", 2023-10-08T07:07:48.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5219999999999998e-06 2023-10-08T07:07:48.956 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.956 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.956 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.957 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161072 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.957 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.664458+0000", 2023-10-08T07:07:48.957 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.44176425000000002, 2023-10-08T07:07:48.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.45212978199999998, 2023-10-08T07:07:48.957 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.957 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.957 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.957 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.957 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.957 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161072 2023-10-08T07:07:48.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.958 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.664458+0000", 2023-10-08T07:07:48.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.664458+0000", 2023-10-08T07:07:48.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.664459+0000", 2023-10-08T07:07:48.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6599999999999996e-07 2023-10-08T07:07:48.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.664478+0000", 2023-10-08T07:07:48.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8904000000000001e-05 2023-10-08T07:07:48.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.664485+0000", 2023-10-08T07:07:48.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6299999999999998e-06 2023-10-08T07:07:48.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.664491+0000", 2023-10-08T07:07:48.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2049999999999999e-06 2023-10-08T07:07:48.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.960 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.961 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161642 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.961 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.904389+0000", 2023-10-08T07:07:48.961 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.201833231, 2023-10-08T07:07:48.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.21226631400000001, 2023-10-08T07:07:48.961 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.961 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.961 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161642 2023-10-08T07:07:48.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.962 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.904389+0000", 2023-10-08T07:07:48.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.904389+0000", 2023-10-08T07:07:48.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.904390+0000", 2023-10-08T07:07:48.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2799999999999996e-07 2023-10-08T07:07:48.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.904410+0000", 2023-10-08T07:07:48.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9905999999999999e-05 2023-10-08T07:07:48.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.904417+0000", 2023-10-08T07:07:48.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1389999999999998e-06 2023-10-08T07:07:48.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.904423+0000", 2023-10-08T07:07:48.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7089999999999999e-06 2023-10-08T07:07:48.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.964 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.965 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161957 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.965 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.089773+0000", 2023-10-08T07:07:48.965 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016449848999999999, 2023-10-08T07:07:48.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026938653, 2023-10-08T07:07:48.965 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.965 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.966 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161957 2023-10-08T07:07:48.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.966 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.089773+0000", 2023-10-08T07:07:48.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.089773+0000", 2023-10-08T07:07:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091591+0000", 2023-10-08T07:07:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018185670000000001 2023-10-08T07:07:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091609+0000", 2023-10-08T07:07:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7699000000000001e-05 2023-10-08T07:07:48.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091619+0000", 2023-10-08T07:07:48.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0555e-05 2023-10-08T07:07:48.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091627+0000", 2023-10-08T07:07:48.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6930000000000007e-06 2023-10-08T07:07:48.968 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.968 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.969 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161991 4.7 4:e2479c46:::10000000004.00000024:head [write 319488~4096 in=4096b,write 684032~4096 in=4096b,write 778240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.969 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.106392+0000", 2023-10-08T07:07:48.969 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9998302, 2023-10-08T07:07:48.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010384806, 2023-10-08T07:07:48.969 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.969 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:48.969 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.970 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161991 2023-10-08T07:07:48.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.970 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106392+0000", 2023-10-08T07:07:48.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106392+0000", 2023-10-08T07:07:48.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.108306+0000", 2023-10-08T07:07:48.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019134600000000001 2023-10-08T07:07:48.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.108325+0000", 2023-10-08T07:07:48.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9474e-05 2023-10-08T07:07:48.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.108335+0000", 2023-10-08T07:07:48.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0040999999999999e-05 2023-10-08T07:07:48.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.108342+0000", 2023-10-08T07:07:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0870000000000001e-06 2023-10-08T07:07:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111826+0000", 2023-10-08T07:07:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034840560000000001 2023-10-08T07:07:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111919+0000", 2023-10-08T07:07:48.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2499999999999999e-05 2023-10-08T07:07:48.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.974 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.974 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159415 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.974 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.962417+0000", 2023-10-08T07:07:48.974 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1438055119999999, 2023-10-08T07:07:48.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.154428437, 2023-10-08T07:07:48.975 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.975 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.975 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159415 2023-10-08T07:07:48.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.975 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.962417+0000", 2023-10-08T07:07:48.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.962417+0000", 2023-10-08T07:07:48.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.962417+0000", 2023-10-08T07:07:48.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2023-10-08T07:07:48.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.962428+0000", 2023-10-08T07:07:48.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1117999999999999e-05 2023-10-08T07:07:48.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.962434+0000", 2023-10-08T07:07:48.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9229999999999999e-06 2023-10-08T07:07:48.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.962439+0000", 2023-10-08T07:07:48.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6260000000000003e-06 2023-10-08T07:07:48.978 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.978 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.978 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.978 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159447 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.978 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.971967+0000", 2023-10-08T07:07:48.978 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.134255418, 2023-10-08T07:07:48.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.144944518, 2023-10-08T07:07:48.979 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.979 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.979 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159447 2023-10-08T07:07:48.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.979 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971967+0000", 2023-10-08T07:07:48.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971967+0000", 2023-10-08T07:07:48.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971967+0000", 2023-10-08T07:07:48.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5600000000000001e-07 2023-10-08T07:07:48.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971988+0000", 2023-10-08T07:07:48.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0775999999999999e-05 2023-10-08T07:07:48.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.971995+0000", 2023-10-08T07:07:48.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5359999999999998e-06 2023-10-08T07:07:48.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.972000+0000", 2023-10-08T07:07:48.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0170000000000004e-06 2023-10-08T07:07:48.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.982 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.982 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159710 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.982 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.083463+0000", 2023-10-08T07:07:48.982 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.022759017, 2023-10-08T07:07:48.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033514306, 2023-10-08T07:07:48.983 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.983 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159710 2023-10-08T07:07:48.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.983 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.083463+0000", 2023-10-08T07:07:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.083463+0000", 2023-10-08T07:07:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.085294+0000", 2023-10-08T07:07:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001830361 2023-10-08T07:07:48.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.085307+0000", 2023-10-08T07:07:48.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2931e-05 2023-10-08T07:07:48.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.085315+0000", 2023-10-08T07:07:48.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6419999999999996e-06 2023-10-08T07:07:48.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.085321+0000", 2023-10-08T07:07:48.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4809999999999997e-06 2023-10-08T07:07:48.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.986 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.986 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160623 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.986 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.480343+0000", 2023-10-08T07:07:48.986 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.625879827, 2023-10-08T07:07:48.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.63669027199999995, 2023-10-08T07:07:48.987 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.987 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.987 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.987 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160623 2023-10-08T07:07:48.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.987 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.480343+0000", 2023-10-08T07:07:48.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.480343+0000", 2023-10-08T07:07:48.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.480343+0000", 2023-10-08T07:07:48.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1600000000000001e-07 2023-10-08T07:07:48.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.480362+0000", 2023-10-08T07:07:48.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8853000000000001e-05 2023-10-08T07:07:48.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.480369+0000", 2023-10-08T07:07:48.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8079999999999999e-06 2023-10-08T07:07:48.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.480375+0000", 2023-10-08T07:07:48.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.302e-06 2023-10-08T07:07:48.990 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.990 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.990 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.990 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161328 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.785397+0000", 2023-10-08T07:07:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.32082555600000001, 2023-10-08T07:07:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.33168769199999998, 2023-10-08T07:07:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161328 2023-10-08T07:07:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.785397+0000", 2023-10-08T07:07:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.785397+0000", 2023-10-08T07:07:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.785397+0000", 2023-10-08T07:07:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8400000000000005e-07 2023-10-08T07:07:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.785412+0000", 2023-10-08T07:07:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4703e-05 2023-10-08T07:07:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.785420+0000", 2023-10-08T07:07:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1820000000000006e-06 2023-10-08T07:07:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.785426+0000", 2023-10-08T07:07:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6169999999999998e-06 2023-10-08T07:07:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161427 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.818534+0000", 2023-10-08T07:07:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28768795699999999, 2023-10-08T07:07:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29860115199999998, 2023-10-08T07:07:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161427 2023-10-08T07:07:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.818534+0000", 2023-10-08T07:07:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.818534+0000", 2023-10-08T07:07:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.818535+0000", 2023-10-08T07:07:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2023-10-08T07:07:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.818546+0000", 2023-10-08T07:07:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0814e-05 2023-10-08T07:07:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.818552+0000", 2023-10-08T07:07:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9179999999999999e-06 2023-10-08T07:07:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.818558+0000", 2023-10-08T07:07:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9689999999999999e-06 2023-10-08T07:07:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159176 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.819551+0000", 2023-10-08T07:07:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.286671406, 2023-10-08T07:07:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2976361279999999, 2023-10-08T07:07:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159176 2023-10-08T07:07:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.819551+0000", 2023-10-08T07:07:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.819551+0000", 2023-10-08T07:07:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.827295+0000", 2023-10-08T07:07:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0077437549999999997 2023-10-08T07:07:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.827313+0000", 2023-10-08T07:07:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8267e-05 2023-10-08T07:07:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.827324+0000", 2023-10-08T07:07:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0541e-05 2023-10-08T07:07:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.827331+0000", 2023-10-08T07:07:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9170000000000006e-06 2023-10-08T07:07:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159335 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.912362+0000", 2023-10-08T07:07:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.193860275, 2023-10-08T07:07:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.204876244, 2023-10-08T07:07:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159335 2023-10-08T07:07:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.912362+0000", 2023-10-08T07:07:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.912362+0000", 2023-10-08T07:07:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.912363+0000", 2023-10-08T07:07:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7000000000000005e-07 2023-10-08T07:07:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.912375+0000", 2023-10-08T07:07:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2777e-05 2023-10-08T07:07:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.912383+0000", 2023-10-08T07:07:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0849999999999999e-06 2023-10-08T07:07:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.912389+0000", 2023-10-08T07:07:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.127e-06 2023-10-08T07:07:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159641 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.058869+0000", 2023-10-08T07:07:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0473532699999999, 2023-10-08T07:07:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.058424662, 2023-10-08T07:07:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159641 2023-10-08T07:07:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.058869+0000", 2023-10-08T07:07:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.058869+0000", 2023-10-08T07:07:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.058870+0000", 2023-10-08T07:07:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1900000000000003e-07 2023-10-08T07:07:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.058882+0000", 2023-10-08T07:07:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2092999999999999e-05 2023-10-08T07:07:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.058889+0000", 2023-10-08T07:07:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8809999999999998e-06 2023-10-08T07:07:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.058894+0000", 2023-10-08T07:07:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1540000000000001e-06 2023-10-08T07:07:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161765 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.971127+0000", 2023-10-08T07:07:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.13509549900000001, 2023-10-08T07:07:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.14621930999999999, 2023-10-08T07:07:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161765 2023-10-08T07:07:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971127+0000", 2023-10-08T07:07:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971127+0000", 2023-10-08T07:07:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971128+0000", 2023-10-08T07:07:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1540000000000001e-06 2023-10-08T07:07:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971148+0000", 2023-10-08T07:07:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0142000000000001e-05 2023-10-08T07:07:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971158+0000", 2023-10-08T07:07:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0009e-05 2023-10-08T07:07:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971166+0000", 2023-10-08T07:07:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3420000000000002e-06 2023-10-08T07:07:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161791 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.987396+0000", 2023-10-08T07:07:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.118826667, 2023-10-08T07:07:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13000144699999999, 2023-10-08T07:07:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161791 2023-10-08T07:07:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.987396+0000", 2023-10-08T07:07:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.987396+0000", 2023-10-08T07:07:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.989297+0000", 2023-10-08T07:07:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019015390000000001 2023-10-08T07:07:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.989309+0000", 2023-10-08T07:07:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1861999999999999e-05 2023-10-08T07:07:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.989320+0000", 2023-10-08T07:07:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0515e-05 2023-10-08T07:07:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.989325+0000", 2023-10-08T07:07:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.874e-06 2023-10-08T07:07:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161873 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.039400+0000", 2023-10-08T07:07:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.066822454000000003, 2023-10-08T07:07:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.078048954000000004, 2023-10-08T07:07:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161873 2023-10-08T07:07:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.039400+0000", 2023-10-08T07:07:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.039400+0000", 2023-10-08T07:07:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.041295+0000", 2023-10-08T07:07:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018947949999999999 2023-10-08T07:07:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.041317+0000", 2023-10-08T07:07:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.215e-05 2023-10-08T07:07:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.041328+0000", 2023-10-08T07:07:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1025e-05 2023-10-08T07:07:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.041334+0000", 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9359999999999996e-06 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176709 4.2c e64/17 4:352c144c:::10000000004.00000003:head v 64'2768, mlcod=64'2766)", 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.109448+0000", 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9967747, 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008054393, 2023-10-08T07:07:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109448+0000", 2023-10-08T07:07:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109448+0000", 2023-10-08T07:07:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109448+0000", 2023-10-08T07:07:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.67e-07 2023-10-08T07:07:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109461+0000", 2023-10-08T07:07:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3242e-05 2023-10-08T07:07:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109468+0000", 2023-10-08T07:07:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3439999999999997e-06 2023-10-08T07:07:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109472+0000", 2023-10-08T07:07:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5970000000000002e-06 2023-10-08T07:07:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109972+0000", 2023-10-08T07:07:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00049938200000000004 2023-10-08T07:07:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109990+0000", 2023-10-08T07:07:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8352e-05 2023-10-08T07:07:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159228 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.854375+0000", 2023-10-08T07:07:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.251847291, 2023-10-08T07:07:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2631842760000001, 2023-10-08T07:07:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159228 2023-10-08T07:07:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.854375+0000", 2023-10-08T07:07:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.854375+0000", 2023-10-08T07:07:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.854376+0000", 2023-10-08T07:07:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8500000000000001e-07 2023-10-08T07:07:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.854391+0000", 2023-10-08T07:07:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4837e-05 2023-10-08T07:07:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.854399+0000", 2023-10-08T07:07:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3180000000000007e-06 2023-10-08T07:07:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.854406+0000", 2023-10-08T07:07:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.481e-06 2023-10-08T07:07:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159563 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.015024+0000", 2023-10-08T07:07:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0911982650000001, 2023-10-08T07:07:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1025867730000001, 2023-10-08T07:07:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159563 2023-10-08T07:07:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.015024+0000", 2023-10-08T07:07:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.015024+0000", 2023-10-08T07:07:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.015025+0000", 2023-10-08T07:07:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9400000000000001e-07 2023-10-08T07:07:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.015037+0000", 2023-10-08T07:07:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2601e-05 2023-10-08T07:07:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.015043+0000", 2023-10-08T07:07:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2023-10-08T07:07:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.015047+0000", 2023-10-08T07:07:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0709999999999996e-06 2023-10-08T07:07:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161720 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.942398+0000", 2023-10-08T07:07:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.163824108, 2023-10-08T07:07:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17526446600000001, 2023-10-08T07:07:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161720 2023-10-08T07:07:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.942398+0000", 2023-10-08T07:07:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.942398+0000", 2023-10-08T07:07:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.942399+0000", 2023-10-08T07:07:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4299999999999998e-07 2023-10-08T07:07:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.942411+0000", 2023-10-08T07:07:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2755000000000001e-05 2023-10-08T07:07:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.942419+0000", 2023-10-08T07:07:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4819999999999997e-06 2023-10-08T07:07:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.942425+0000", 2023-10-08T07:07:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1079999999999998e-06 2023-10-08T07:07:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176160 4.1a e64/17)", 2023-10-08T07:07:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.094140+0000", 2023-10-08T07:07:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012082657, 2023-10-08T07:07:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023572884999999998, 2023-10-08T07:07:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094140+0000", 2023-10-08T07:07:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094140+0000", 2023-10-08T07:07:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094140+0000", 2023-10-08T07:07:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0600000000000001e-07 2023-10-08T07:07:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094152+0000", 2023-10-08T07:07:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2138e-05 2023-10-08T07:07:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094160+0000", 2023-10-08T07:07:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6869999999999994e-06 2023-10-08T07:07:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094165+0000", 2023-10-08T07:07:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1399999999999999e-06 2023-10-08T07:07:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176707 4.38 e64/46 4:1e0977c7:::10000000004.00000022:head v 64'2791, mlcod=64'2789)", 2023-10-08T07:07:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.109483+0000", 2023-10-08T07:07:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9967394, 2023-10-08T07:07:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082777969999999999, 2023-10-08T07:07:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109483+0000", 2023-10-08T07:07:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109483+0000", 2023-10-08T07:07:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109483+0000", 2023-10-08T07:07:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0899999999999997e-07 2023-10-08T07:07:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109495+0000", 2023-10-08T07:07:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1270999999999999e-05 2023-10-08T07:07:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109501+0000", 2023-10-08T07:07:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1979999999999998e-06 2023-10-08T07:07:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109505+0000", 2023-10-08T07:07:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3109999999999999e-06 2023-10-08T07:07:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.113562+0000", 2023-10-08T07:07:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040566459999999997 2023-10-08T07:07:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.113583+0000", 2023-10-08T07:07:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0992000000000002e-05 2023-10-08T07:07:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159497 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.987440+0000", 2023-10-08T07:07:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1187827029999999, 2023-10-08T07:07:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.130377958, 2023-10-08T07:07:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159497 2023-10-08T07:07:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987440+0000", 2023-10-08T07:07:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987440+0000", 2023-10-08T07:07:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987440+0000", 2023-10-08T07:07:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2023-10-08T07:07:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987451+0000", 2023-10-08T07:07:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1388e-05 2023-10-08T07:07:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987457+0000", 2023-10-08T07:07:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5639999999999996e-06 2023-10-08T07:07:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.987461+0000", 2023-10-08T07:07:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3250000000000001e-06 2023-10-08T07:07:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159525 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.001349+0000", 2023-10-08T07:07:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1048731460000001, 2023-10-08T07:07:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.116519931, 2023-10-08T07:07:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159525 2023-10-08T07:07:49.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.001349+0000", 2023-10-08T07:07:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.001349+0000", 2023-10-08T07:07:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.001350+0000", 2023-10-08T07:07:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7999999999999995e-07 2023-10-08T07:07:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.001364+0000", 2023-10-08T07:07:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3974999999999999e-05 2023-10-08T07:07:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.001403+0000", 2023-10-08T07:07:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8874000000000001e-05 2023-10-08T07:07:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.001410+0000", 2023-10-08T07:07:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1579999999999999e-06 2023-10-08T07:07:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161195 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.718341+0000", 2023-10-08T07:07:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38788178499999998, 2023-10-08T07:07:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39958015000000002, 2023-10-08T07:07:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161195 2023-10-08T07:07:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.718341+0000", 2023-10-08T07:07:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.718341+0000", 2023-10-08T07:07:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724294+0000", 2023-10-08T07:07:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059537690000000002 2023-10-08T07:07:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724315+0000", 2023-10-08T07:07:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1064e-05 2023-10-08T07:07:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724327+0000", 2023-10-08T07:07:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1275e-05 2023-10-08T07:07:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724334+0000", 2023-10-08T07:07:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7800000000000001e-06 2023-10-08T07:07:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161507 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.857375+0000", 2023-10-08T07:07:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.24884710099999999, 2023-10-08T07:07:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.260596779, 2023-10-08T07:07:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161507 2023-10-08T07:07:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857375+0000", 2023-10-08T07:07:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857375+0000", 2023-10-08T07:07:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857376+0000", 2023-10-08T07:07:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5200000000000002e-07 2023-10-08T07:07:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857388+0000", 2023-10-08T07:07:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1800999999999999e-05 2023-10-08T07:07:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857394+0000", 2023-10-08T07:07:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6270000000000002e-06 2023-10-08T07:07:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857400+0000", 2023-10-08T07:07:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3909999999999997e-06 2023-10-08T07:07:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161649 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.906351+0000", 2023-10-08T07:07:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.199871523, 2023-10-08T07:07:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.21167325300000001, 2023-10-08T07:07:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161649 2023-10-08T07:07:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.906351+0000", 2023-10-08T07:07:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.906351+0000", 2023-10-08T07:07:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.906351+0000", 2023-10-08T07:07:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4299999999999998e-07 2023-10-08T07:07:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.906364+0000", 2023-10-08T07:07:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2452e-05 2023-10-08T07:07:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.906369+0000", 2023-10-08T07:07:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2299999999999999e-06 2023-10-08T07:07:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.906372+0000", 2023-10-08T07:07:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3890000000000001e-06 2023-10-08T07:07:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176672 4.2b e64/17 4:d776c1c9:::10000000004.0000003d:head v 64'5564, mlcod=64'5559)", 2023-10-08T07:07:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.094173+0000", 2023-10-08T07:07:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012049148000000001, 2023-10-08T07:07:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023905439000000001, 2023-10-08T07:07:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094173+0000", 2023-10-08T07:07:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094173+0000", 2023-10-08T07:07:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094174+0000", 2023-10-08T07:07:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8200000000000001e-07 2023-10-08T07:07:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094184+0000", 2023-10-08T07:07:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0711e-05 2023-10-08T07:07:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094191+0000", 2023-10-08T07:07:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8299999999999998e-06 2023-10-08T07:07:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.094196+0000", 2023-10-08T07:07:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5369999999999999e-06 2023-10-08T07:07:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.099837+0000", 2023-10-08T07:07:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056416929999999997 2023-10-08T07:07:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.099857+0000", 2023-10-08T07:07:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9527000000000001e-05 2023-10-08T07:07:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176706 4.20 e64/17 4:04004f2c:::10000000004.0000000d:head v 64'8334, mlcod=64'8326)", 2023-10-08T07:07:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.109511+0000", 2023-10-08T07:07:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9967113, 2023-10-08T07:07:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086281780000000002, 2023-10-08T07:07:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109511+0000", 2023-10-08T07:07:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109511+0000", 2023-10-08T07:07:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109511+0000", 2023-10-08T07:07:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.22e-07 2023-10-08T07:07:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109521+0000", 2023-10-08T07:07:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025e-05 2023-10-08T07:07:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109527+0000", 2023-10-08T07:07:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6250000000000004e-06 2023-10-08T07:07:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109531+0000", 2023-10-08T07:07:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0949999999999998e-06 2023-10-08T07:07:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.113973+0000", 2023-10-08T07:07:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044420659999999997 2023-10-08T07:07:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.113991+0000", 2023-10-08T07:07:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7411e-05 2023-10-08T07:07:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160234 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.319786+0000", 2023-10-08T07:07:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.78643597499999995, 2023-10-08T07:07:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.79841122899999994, 2023-10-08T07:07:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160234 2023-10-08T07:07:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.319786+0000", 2023-10-08T07:07:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.319786+0000", 2023-10-08T07:07:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.327294+0000", 2023-10-08T07:07:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0075073969999999999 2023-10-08T07:07:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.327312+0000", 2023-10-08T07:07:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7971000000000001e-05 2023-10-08T07:07:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.327322+0000", 2023-10-08T07:07:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0560000000000001e-05 2023-10-08T07:07:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.327330+0000", 2023-10-08T07:07:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5270000000000001e-06 2023-10-08T07:07:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160278 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.340430+0000", 2023-10-08T07:07:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.76579277099999998, 2023-10-08T07:07:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.77782174900000001, 2023-10-08T07:07:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160278 2023-10-08T07:07:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.340430+0000", 2023-10-08T07:07:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.340430+0000", 2023-10-08T07:07:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.340430+0000", 2023-10-08T07:07:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2499999999999995e-07 2023-10-08T07:07:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.340442+0000", 2023-10-08T07:07:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.186e-05 2023-10-08T07:07:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.340448+0000", 2023-10-08T07:07:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.314e-06 2023-10-08T07:07:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.340454+0000", 2023-10-08T07:07:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8619999999999999e-06 2023-10-08T07:07:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161196 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.724346+0000", 2023-10-08T07:07:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.381876616, 2023-10-08T07:07:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39396538399999997, 2023-10-08T07:07:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161196 2023-10-08T07:07:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724346+0000", 2023-10-08T07:07:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724346+0000", 2023-10-08T07:07:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724346+0000", 2023-10-08T07:07:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1199999999999998e-07 2023-10-08T07:07:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724359+0000", 2023-10-08T07:07:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3261000000000001e-05 2023-10-08T07:07:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724367+0000", 2023-10-08T07:07:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4050000000000003e-06 2023-10-08T07:07:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724373+0000", 2023-10-08T07:07:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4099999999999996e-06 2023-10-08T07:07:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161510 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.857408+0000", 2023-10-08T07:07:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.248814333, 2023-10-08T07:07:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.26096041599999997, 2023-10-08T07:07:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161510 2023-10-08T07:07:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857408+0000", 2023-10-08T07:07:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857408+0000", 2023-10-08T07:07:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857408+0000", 2023-10-08T07:07:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7099999999999997e-07 2023-10-08T07:07:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857420+0000", 2023-10-08T07:07:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1613999999999999e-05 2023-10-08T07:07:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857426+0000", 2023-10-08T07:07:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4139999999999999e-06 2023-10-08T07:07:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857433+0000", 2023-10-08T07:07:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2199999999999997e-06 2023-10-08T07:07:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161694 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.923294+0000", 2023-10-08T07:07:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18292856299999999, 2023-10-08T07:07:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19513762900000001, 2023-10-08T07:07:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161694 2023-10-08T07:07:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.923294+0000", 2023-10-08T07:07:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.923294+0000", 2023-10-08T07:07:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.923294+0000", 2023-10-08T07:07:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6199999999999997e-07 2023-10-08T07:07:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.923317+0000", 2023-10-08T07:07:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2622000000000001e-05 2023-10-08T07:07:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.923327+0000", 2023-10-08T07:07:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6320000000000003e-06 2023-10-08T07:07:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.923334+0000", 2023-10-08T07:07:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.888e-06 2023-10-08T07:07:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161961 4.b 4:d0c991e0:::10000000004.0000002d:head [write 1859584~4096 in=4096b,write 2023424~4096 in=4096b,write 2293760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.091683+0000", 2023-10-08T07:07:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014538956, 2023-10-08T07:07:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026816616000000001, 2023-10-08T07:07:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161961 2023-10-08T07:07:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091683+0000", 2023-10-08T07:07:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.091683+0000", 2023-10-08T07:07:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097296+0000", 2023-10-08T07:07:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056126020000000004 2023-10-08T07:07:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097315+0000", 2023-10-08T07:07:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8732999999999998e-05 2023-10-08T07:07:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097325+0000", 2023-10-08T07:07:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0712e-05 2023-10-08T07:07:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097334+0000", 2023-10-08T07:07:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4470000000000006e-06 2023-10-08T07:07:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104785+0000", 2023-10-08T07:07:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074512429999999998 2023-10-08T07:07:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.104871+0000", 2023-10-08T07:07:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5382000000000003e-05 2023-10-08T07:07:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.105042+0000", 2023-10-08T07:07:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000171533 2023-10-08T07:07:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.110574+0000", 2023-10-08T07:07:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055321199999999997 2023-10-08T07:07:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176247 4.a e64/17)", 2023-10-08T07:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.109537+0000", 2023-10-08T07:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9966855, 2023-10-08T07:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0090599530000000008, 2023-10-08T07:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109537+0000", 2023-10-08T07:07:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109537+0000", 2023-10-08T07:07:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109537+0000", 2023-10-08T07:07:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.04e-07 2023-10-08T07:07:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109549+0000", 2023-10-08T07:07:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1445e-05 2023-10-08T07:07:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109555+0000", 2023-10-08T07:07:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7240000000000003e-06 2023-10-08T07:07:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109560+0000", 2023-10-08T07:07:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2359999999999998e-06 2023-10-08T07:07:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159255 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.868385+0000", 2023-10-08T07:07:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.23783782, 2023-10-08T07:07:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2502755539999999, 2023-10-08T07:07:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159255 2023-10-08T07:07:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.868385+0000", 2023-10-08T07:07:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.868385+0000", 2023-10-08T07:07:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.870295+0000", 2023-10-08T07:07:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019100670000000001 2023-10-08T07:07:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.870313+0000", 2023-10-08T07:07:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7988000000000001e-05 2023-10-08T07:07:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.870322+0000", 2023-10-08T07:07:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2739999999999996e-06 2023-10-08T07:07:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.870329+0000", 2023-10-08T07:07:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0010000000000004e-06 2023-10-08T07:07:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160352 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.366755+0000", 2023-10-08T07:07:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.73946715500000004, 2023-10-08T07:07:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.75198337199999998, 2023-10-08T07:07:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160352 2023-10-08T07:07:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.366755+0000", 2023-10-08T07:07:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.366755+0000", 2023-10-08T07:07:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.366756+0000", 2023-10-08T07:07:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3000000000000001e-07 2023-10-08T07:07:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.366768+0000", 2023-10-08T07:07:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1955e-05 2023-10-08T07:07:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.366774+0000", 2023-10-08T07:07:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.319e-06 2023-10-08T07:07:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.366780+0000", 2023-10-08T07:07:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6910000000000002e-06 2023-10-08T07:07:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161173 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.704450+0000", 2023-10-08T07:07:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.40177215199999999, 2023-10-08T07:07:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41435379, 2023-10-08T07:07:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.122 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161173 2023-10-08T07:07:49.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.122 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.704450+0000", 2023-10-08T07:07:49.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.704450+0000", 2023-10-08T07:07:49.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.704451+0000", 2023-10-08T07:07:49.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9599999999999999e-07 2023-10-08T07:07:49.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.704461+0000", 2023-10-08T07:07:49.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0740000000000001e-05 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.704468+0000", 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7939999999999997e-06 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.704474+0000", 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2989999999999996e-06 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.125 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161237 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.125 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.738525+0000", 2023-10-08T07:07:49.125 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.36769743900000001, 2023-10-08T07:07:49.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.38033489300000001, 2023-10-08T07:07:49.125 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.125 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.126 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161237 2023-10-08T07:07:49.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.126 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.738525+0000", 2023-10-08T07:07:49.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.738525+0000", 2023-10-08T07:07:49.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.740295+0000", 2023-10-08T07:07:49.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017700420000000001 2023-10-08T07:07:49.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.740310+0000", 2023-10-08T07:07:49.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5328e-05 2023-10-08T07:07:49.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.740320+0000", 2023-10-08T07:07:49.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0192e-05 2023-10-08T07:07:49.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.740328+0000", 2023-10-08T07:07:49.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0049999999999998e-06 2023-10-08T07:07:49.128 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.128 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.128 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.129 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161541 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.129 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.867348+0000", 2023-10-08T07:07:49.129 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.238874049, 2023-10-08T07:07:49.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.25156358499999998, 2023-10-08T07:07:49.129 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.129 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.129 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.129 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.129 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.130 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161541 2023-10-08T07:07:49.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.130 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.867348+0000", 2023-10-08T07:07:49.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.867348+0000", 2023-10-08T07:07:49.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.867349+0000", 2023-10-08T07:07:49.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0800000000000005e-07 2023-10-08T07:07:49.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.867370+0000", 2023-10-08T07:07:49.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1007000000000001e-05 2023-10-08T07:07:49.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.867377+0000", 2023-10-08T07:07:49.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8020000000000003e-06 2023-10-08T07:07:49.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.867382+0000", 2023-10-08T07:07:49.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2390000000000002e-06 2023-10-08T07:07:49.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.132 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.133 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161773 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.133 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.971380+0000", 2023-10-08T07:07:49.133 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.13484249300000001, 2023-10-08T07:07:49.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.14758542799999999, 2023-10-08T07:07:49.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.133 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161773 2023-10-08T07:07:49.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.134 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971380+0000", 2023-10-08T07:07:49.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971380+0000", 2023-10-08T07:07:49.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971381+0000", 2023-10-08T07:07:49.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6400000000000001e-07 2023-10-08T07:07:49.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971399+0000", 2023-10-08T07:07:49.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8236e-05 2023-10-08T07:07:49.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971410+0000", 2023-10-08T07:07:49.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1450999999999999e-05 2023-10-08T07:07:49.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971418+0000", 2023-10-08T07:07:49.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0590000000000003e-06 2023-10-08T07:07:49.136 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.136 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.136 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.137 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161797 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.137 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.989440+0000", 2023-10-08T07:07:49.137 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.116782861, 2023-10-08T07:07:49.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12957761400000001, 2023-10-08T07:07:49.137 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.137 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.137 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.137 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161797 2023-10-08T07:07:49.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.138 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.989440+0000", 2023-10-08T07:07:49.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.989440+0000", 2023-10-08T07:07:49.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.989440+0000", 2023-10-08T07:07:49.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:07:49.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.989454+0000", 2023-10-08T07:07:49.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4044e-05 2023-10-08T07:07:49.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.989466+0000", 2023-10-08T07:07:49.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1766000000000001e-05 2023-10-08T07:07:49.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.989472+0000", 2023-10-08T07:07:49.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9399999999999999e-06 2023-10-08T07:07:49.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.140 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.140 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176059 4.3a e64/17 4:5d52ad5e:::10000000004.00000026:head v 64'8090, mlcod=64'8074)", 2023-10-08T07:07:49.141 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.061357+0000", 2023-10-08T07:07:49.141 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.044865163999999999, 2023-10-08T07:07:49.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057712856999999999, 2023-10-08T07:07:49.141 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.141 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:49.141 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.061357+0000", 2023-10-08T07:07:49.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.061357+0000", 2023-10-08T07:07:49.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.061358+0000", 2023-10-08T07:07:49.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9500000000000003e-07 2023-10-08T07:07:49.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.061368+0000", 2023-10-08T07:07:49.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.026e-05 2023-10-08T07:07:49.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.061377+0000", 2023-10-08T07:07:49.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0750000000000004e-06 2023-10-08T07:07:49.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.061383+0000", 2023-10-08T07:07:49.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.173e-06 2023-10-08T07:07:49.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.096127+0000", 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.034743389 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.096146+0000", 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9255000000000001e-05 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.145 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161933 4.b 4:d0c991e0:::10000000004.0000002d:head [write 2875392~4096 in=4096b,write 2990080~4096 in=4096b,write 3002368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.145 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.079541+0000", 2023-10-08T07:07:49.145 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026681258999999999, 2023-10-08T07:07:49.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039591840000000003, 2023-10-08T07:07:49.145 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.145 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:49.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.145 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161933 2023-10-08T07:07:49.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.146 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.079541+0000", 2023-10-08T07:07:49.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.079541+0000", 2023-10-08T07:07:49.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.081293+0000", 2023-10-08T07:07:49.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017523619999999999 2023-10-08T07:07:49.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.081310+0000", 2023-10-08T07:07:49.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6311999999999999e-05 2023-10-08T07:07:49.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.081320+0000", 2023-10-08T07:07:49.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9969999999999993e-06 2023-10-08T07:07:49.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.081328+0000", 2023-10-08T07:07:49.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8339999999999999e-06 2023-10-08T07:07:49.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:49.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.100127+0000", 2023-10-08T07:07:49.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.018799808000000001 2023-10-08T07:07:49.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:49.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.100185+0000", 2023-10-08T07:07:49.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7451999999999998e-05 2023-10-08T07:07:49.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:49.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.100319+0000", 2023-10-08T07:07:49.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013443299999999999 2023-10-08T07:07:49.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:49.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.110357+0000", 2023-10-08T07:07:49.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010037432000000001 2023-10-08T07:07:49.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.150 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.150 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161962 4.b 4:d0c991e0:::10000000004.0000002d:head [write 2818048~4096 in=4096b,write 2834432~4096 in=4096b,write 3043328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.150 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.097348+0000", 2023-10-08T07:07:49.150 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0088739160000000008, 2023-10-08T07:07:49.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021864962000000002, 2023-10-08T07:07:49.151 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.151 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:49.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.151 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161962 2023-10-08T07:07:49.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.151 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097348+0000", 2023-10-08T07:07:49.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097348+0000", 2023-10-08T07:07:49.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097349+0000", 2023-10-08T07:07:49.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6499999999999999e-07 2023-10-08T07:07:49.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097369+0000", 2023-10-08T07:07:49.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0275000000000002e-05 2023-10-08T07:07:49.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097377+0000", 2023-10-08T07:07:49.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2740000000000007e-06 2023-10-08T07:07:49.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097383+0000", 2023-10-08T07:07:49.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5470000000000004e-06 2023-10-08T07:07:49.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:49.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106932+0000", 2023-10-08T07:07:49.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095490060000000005 2023-10-08T07:07:49.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:49.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.106999+0000", 2023-10-08T07:07:49.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2023-10-08T07:07:49.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:49.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.107140+0000", 2023-10-08T07:07:49.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000141526 2023-10-08T07:07:49.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:49.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.110614+0000", 2023-10-08T07:07:49.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034738159999999998 2023-10-08T07:07:49.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.155 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.156 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176240 4.3a e64/17)", 2023-10-08T07:07:49.156 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.109565+0000", 2023-10-08T07:07:49.156 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9966574, 2023-10-08T07:07:49.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097220789999999998, 2023-10-08T07:07:49.156 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.156 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.156 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109565+0000", 2023-10-08T07:07:49.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109565+0000", 2023-10-08T07:07:49.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109565+0000", 2023-10-08T07:07:49.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.11e-07 2023-10-08T07:07:49.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109574+0000", 2023-10-08T07:07:49.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0250000000000008e-06 2023-10-08T07:07:49.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109580+0000", 2023-10-08T07:07:49.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4940000000000003e-06 2023-10-08T07:07:49.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.109584+0000", 2023-10-08T07:07:49.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8410000000000002e-06 2023-10-08T07:07:49.159 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.159 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.159 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.159 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159256 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.159 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.870342+0000", 2023-10-08T07:07:49.159 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2358799819999999, 2023-10-08T07:07:49.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.248998576, 2023-10-08T07:07:49.160 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.160 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.160 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.160 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.160 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.160 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159256 2023-10-08T07:07:49.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.160 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.870342+0000", 2023-10-08T07:07:49.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.870342+0000", 2023-10-08T07:07:49.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.870343+0000", 2023-10-08T07:07:49.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-07 2023-10-08T07:07:49.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.870359+0000", 2023-10-08T07:07:49.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5628999999999999e-05 2023-10-08T07:07:49.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.870367+0000", 2023-10-08T07:07:49.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5299999999999996e-06 2023-10-08T07:07:49.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.870373+0000", 2023-10-08T07:07:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0299999999999999e-06 2023-10-08T07:07:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159722 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.087470+0000", 2023-10-08T07:07:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0187522440000001, 2023-10-08T07:07:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.031923122, 2023-10-08T07:07:49.163 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159722 2023-10-08T07:07:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.087470+0000", 2023-10-08T07:07:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.087470+0000", 2023-10-08T07:07:49.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.087471+0000", 2023-10-08T07:07:49.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4799999999999999e-07 2023-10-08T07:07:49.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.087483+0000", 2023-10-08T07:07:49.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.257e-05 2023-10-08T07:07:49.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.087489+0000", 2023-10-08T07:07:49.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3199999999999996e-06 2023-10-08T07:07:49.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.087495+0000", 2023-10-08T07:07:49.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:07:49.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.167 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.167 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161054 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.167 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.652351+0000", 2023-10-08T07:07:49.167 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.45387131200000003, 2023-10-08T07:07:49.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.467096501, 2023-10-08T07:07:49.167 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.167 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.167 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.168 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161054 2023-10-08T07:07:49.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.168 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.652351+0000", 2023-10-08T07:07:49.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.652351+0000", 2023-10-08T07:07:49.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.652352+0000", 2023-10-08T07:07:49.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5600000000000005e-07 2023-10-08T07:07:49.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.652373+0000", 2023-10-08T07:07:49.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0891e-05 2023-10-08T07:07:49.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.652380+0000", 2023-10-08T07:07:49.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6699999999999994e-06 2023-10-08T07:07:49.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.652386+0000", 2023-10-08T07:07:49.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1809999999999998e-06 2023-10-08T07:07:49.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.171 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.171 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161197 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.171 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.724383+0000", 2023-10-08T07:07:49.171 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38183935499999999, 2023-10-08T07:07:49.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39511924599999998, 2023-10-08T07:07:49.171 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.171 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.172 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.172 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161197 2023-10-08T07:07:49.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.172 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724383+0000", 2023-10-08T07:07:49.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724383+0000", 2023-10-08T07:07:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724384+0000", 2023-10-08T07:07:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2e-07 2023-10-08T07:07:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724401+0000", 2023-10-08T07:07:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7377e-05 2023-10-08T07:07:49.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724408+0000", 2023-10-08T07:07:49.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1430000000000001e-06 2023-10-08T07:07:49.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.724413+0000", 2023-10-08T07:07:49.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4330000000000003e-06 2023-10-08T07:07:49.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.174 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.175 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161512 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.175 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.857480+0000", 2023-10-08T07:07:49.175 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.248742668, 2023-10-08T07:07:49.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.26208580100000001, 2023-10-08T07:07:49.175 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.175 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.176 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161512 2023-10-08T07:07:49.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.176 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857480+0000", 2023-10-08T07:07:49.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857480+0000", 2023-10-08T07:07:49.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857480+0000", 2023-10-08T07:07:49.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8400000000000005e-07 2023-10-08T07:07:49.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857492+0000", 2023-10-08T07:07:49.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1384e-05 2023-10-08T07:07:49.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857499+0000", 2023-10-08T07:07:49.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8310000000000001e-06 2023-10-08T07:07:49.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.857505+0000", 2023-10-08T07:07:49.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2580000000000003e-06 2023-10-08T07:07:49.178 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.178 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.178 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.179 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161723 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.179 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.942467+0000", 2023-10-08T07:07:49.179 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.16375524599999999, 2023-10-08T07:07:49.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17715303099999999, 2023-10-08T07:07:49.179 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.179 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.179 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.179 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.179 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.179 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161723 2023-10-08T07:07:49.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.942467+0000", 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.942467+0000", 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.946296+0000", 2023-10-08T07:07:49.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003828812 2023-10-08T07:07:49.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.946316+0000", 2023-10-08T07:07:49.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0392000000000001e-05 2023-10-08T07:07:49.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.946328+0000", 2023-10-08T07:07:49.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1353e-05 2023-10-08T07:07:49.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.946336+0000", 2023-10-08T07:07:49.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1170000000000004e-06 2023-10-08T07:07:49.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.182 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.182 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161775 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.182 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.971431+0000", 2023-10-08T07:07:49.183 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.13479137899999999, 2023-10-08T07:07:49.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.14824975100000001, 2023-10-08T07:07:49.183 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.183 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.183 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161775 2023-10-08T07:07:49.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.183 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971431+0000", 2023-10-08T07:07:49.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971431+0000", 2023-10-08T07:07:49.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971432+0000", 2023-10-08T07:07:49.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:07:49.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971449+0000", 2023-10-08T07:07:49.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7022999999999999e-05 2023-10-08T07:07:49.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971456+0000", 2023-10-08T07:07:49.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4059999999999999e-06 2023-10-08T07:07:49.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.971462+0000", 2023-10-08T07:07:49.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6899999999999997e-06 2023-10-08T07:07:49.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.186 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.186 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161847 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.186 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.025405+0000", 2023-10-08T07:07:49.187 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.080817054999999999, 2023-10-08T07:07:49.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.094327803000000002, 2023-10-08T07:07:49.187 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.187 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.187 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161847 2023-10-08T07:07:49.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.187 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.025405+0000", 2023-10-08T07:07:49.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.025405+0000", 2023-10-08T07:07:49.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.027296+0000", 2023-10-08T07:07:49.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018909809999999999 2023-10-08T07:07:49.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.027312+0000", 2023-10-08T07:07:49.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5668999999999999e-05 2023-10-08T07:07:49.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.027324+0000", 2023-10-08T07:07:49.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2063e-05 2023-10-08T07:07:49.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.027331+0000", 2023-10-08T07:07:49.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0670000000000003e-06 2023-10-08T07:07:49.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.191 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176188 4.3a e64/17)", 2023-10-08T07:07:49.191 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.097904+0000", 2023-10-08T07:07:49.191 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0083187509999999992, 2023-10-08T07:07:49.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021879821000000001, 2023-10-08T07:07:49.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.191 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097904+0000", 2023-10-08T07:07:49.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097904+0000", 2023-10-08T07:07:49.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097904+0000", 2023-10-08T07:07:49.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.68e-07 2023-10-08T07:07:49.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097917+0000", 2023-10-08T07:07:49.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2351000000000001e-05 2023-10-08T07:07:49.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097927+0000", 2023-10-08T07:07:49.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0507e-05 2023-10-08T07:07:49.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.097934+0000", 2023-10-08T07:07:49.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9399999999999996e-06 2023-10-08T07:07:49.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.194 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.194 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159290 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.194 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.886339+0000", 2023-10-08T07:07:49.194 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.2198835990000001, 2023-10-08T07:07:49.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2334917430000001, 2023-10-08T07:07:49.194 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.194 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.195 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159290 2023-10-08T07:07:49.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.195 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.886339+0000", 2023-10-08T07:07:49.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.886339+0000", 2023-10-08T07:07:49.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.886339+0000", 2023-10-08T07:07:49.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2e-07 2023-10-08T07:07:49.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.886350+0000", 2023-10-08T07:07:49.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1250000000000001e-05 2023-10-08T07:07:49.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.886373+0000", 2023-10-08T07:07:49.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2480000000000002e-05 2023-10-08T07:07:49.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.886379+0000", 2023-10-08T07:07:49.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1589999999999998e-06 2023-10-08T07:07:49.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.198 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.198 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159339 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.198 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.914459+0000", 2023-10-08T07:07:49.198 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1917636709999999, 2023-10-08T07:07:49.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.205425424, 2023-10-08T07:07:49.198 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.198 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.199 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159339 2023-10-08T07:07:49.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.199 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.914459+0000", 2023-10-08T07:07:49.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.914459+0000", 2023-10-08T07:07:49.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.914459+0000", 2023-10-08T07:07:49.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.15e-07 2023-10-08T07:07:49.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.914469+0000", 2023-10-08T07:07:49.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4790000000000002e-06 2023-10-08T07:07:49.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.914473+0000", 2023-10-08T07:07:49.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.792e-06 2023-10-08T07:07:49.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.914477+0000", 2023-10-08T07:07:49.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2040000000000002e-06 2023-10-08T07:07:49.202 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.202 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.202 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.202 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159624 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.202 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.047245+0000", 2023-10-08T07:07:49.202 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0589777339999999, 2023-10-08T07:07:49.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.072691692, 2023-10-08T07:07:49.202 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.202 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.203 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.203 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.203 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.203 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159624 2023-10-08T07:07:49.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.203 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.047245+0000", 2023-10-08T07:07:49.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.047245+0000", 2023-10-08T07:07:49.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.047246+0000", 2023-10-08T07:07:49.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1100000000000004e-07 2023-10-08T07:07:49.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.047270+0000", 2023-10-08T07:07:49.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4397999999999999e-05 2023-10-08T07:07:49.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.047279+0000", 2023-10-08T07:07:49.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7860000000000002e-06 2023-10-08T07:07:49.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.047285+0000", 2023-10-08T07:07:49.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9009999999999999e-06 2023-10-08T07:07:49.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.206 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.206 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159968 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.206 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.210275+0000", 2023-10-08T07:07:49.206 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.89594724599999997, 2023-10-08T07:07:49.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.90971438500000001, 2023-10-08T07:07:49.206 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.206 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.207 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159968 2023-10-08T07:07:49.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.207 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.210275+0000", 2023-10-08T07:07:49.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.210275+0000", 2023-10-08T07:07:49.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.213295+0000", 2023-10-08T07:07:49.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030194570000000001 2023-10-08T07:07:49.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.213314+0000", 2023-10-08T07:07:49.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8927e-05 2023-10-08T07:07:49.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.213324+0000", 2023-10-08T07:07:49.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0370000000000001e-05 2023-10-08T07:07:49.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.213331+0000", 2023-10-08T07:07:49.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3819999999999998e-06 2023-10-08T07:07:49.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.211 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.211 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160090 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.211 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.268428+0000", 2023-10-08T07:07:49.211 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.83779418699999997, 2023-10-08T07:07:49.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.85161282599999999, 2023-10-08T07:07:49.211 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.211 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.212 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160090 2023-10-08T07:07:49.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.212 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.268428+0000", 2023-10-08T07:07:49.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.268428+0000", 2023-10-08T07:07:49.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.268429+0000", 2023-10-08T07:07:49.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:07:49.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.268443+0000", 2023-10-08T07:07:49.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4416999999999999e-05 2023-10-08T07:07:49.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.268451+0000", 2023-10-08T07:07:49.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7389999999999999e-06 2023-10-08T07:07:49.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.268455+0000", 2023-10-08T07:07:49.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6500000000000004e-06 2023-10-08T07:07:49.215 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.215 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.215 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.215 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160245 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.215 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.327425+0000", 2023-10-08T07:07:49.215 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.77879719599999997, 2023-10-08T07:07:49.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.79267157399999999, 2023-10-08T07:07:49.215 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.216 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.216 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.216 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160245 2023-10-08T07:07:49.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.216 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.327425+0000", 2023-10-08T07:07:49.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.327425+0000", 2023-10-08T07:07:49.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.327426+0000", 2023-10-08T07:07:49.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.89e-07 2023-10-08T07:07:49.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.327440+0000", 2023-10-08T07:07:49.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4209000000000001e-05 2023-10-08T07:07:49.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.327446+0000", 2023-10-08T07:07:49.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2570000000000004e-06 2023-10-08T07:07:49.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.327452+0000", 2023-10-08T07:07:49.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.998e-06 2023-10-08T07:07:49.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.220 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.220 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160303 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.221 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.354363+0000", 2023-10-08T07:07:49.221 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.75185950899999998, 2023-10-08T07:07:49.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.76578970300000004, 2023-10-08T07:07:49.221 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.221 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.222 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.222 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.222 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.222 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160303 2023-10-08T07:07:49.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.222 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.354363+0000", 2023-10-08T07:07:49.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.354363+0000", 2023-10-08T07:07:49.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.356295+0000", 2023-10-08T07:07:49.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019318479999999999 2023-10-08T07:07:49.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.356312+0000", 2023-10-08T07:07:49.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6895999999999999e-05 2023-10-08T07:07:49.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.356322+0000", 2023-10-08T07:07:49.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0474e-05 2023-10-08T07:07:49.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.356330+0000", 2023-10-08T07:07:49.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4290000000000004e-06 2023-10-08T07:07:49.227 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.228 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.228 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.229 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160504 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.229 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.426233+0000", 2023-10-08T07:07:49.229 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67998890199999995, 2023-10-08T07:07:49.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.69397093200000004, 2023-10-08T07:07:49.229 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.229 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.229 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.229 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.230 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160504 2023-10-08T07:07:49.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.230 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426233+0000", 2023-10-08T07:07:49.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426233+0000", 2023-10-08T07:07:49.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426234+0000", 2023-10-08T07:07:49.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6000000000000004e-07 2023-10-08T07:07:49.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426246+0000", 2023-10-08T07:07:49.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2058999999999999e-05 2023-10-08T07:07:49.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426253+0000", 2023-10-08T07:07:49.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8929999999999999e-06 2023-10-08T07:07:49.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426260+0000", 2023-10-08T07:07:49.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6250000000000001e-06 2023-10-08T07:07:49.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.234 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.234 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160645 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.234 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.480583+0000", 2023-10-08T07:07:49.234 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.62563975000000005, 2023-10-08T07:07:49.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.63967349399999995, 2023-10-08T07:07:49.235 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.235 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.235 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.235 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160645 2023-10-08T07:07:49.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.235 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.480583+0000", 2023-10-08T07:07:49.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.480583+0000", 2023-10-08T07:07:49.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.480583+0000", 2023-10-08T07:07:49.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7300000000000002e-07 2023-10-08T07:07:49.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.480592+0000", 2023-10-08T07:07:49.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0440000000000001e-06 2023-10-08T07:07:49.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.480599+0000", 2023-10-08T07:07:49.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6080000000000001e-06 2023-10-08T07:07:49.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.480603+0000", 2023-10-08T07:07:49.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5340000000000001e-06 2023-10-08T07:07:49.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.240 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.240 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160772 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.241 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.522593+0000", 2023-10-08T07:07:49.241 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.583629124, 2023-10-08T07:07:49.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.59772173699999998, 2023-10-08T07:07:49.241 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.241 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.241 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.242 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160772 2023-10-08T07:07:49.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.242 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.522593+0000", 2023-10-08T07:07:49.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.522593+0000", 2023-10-08T07:07:49.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.522594+0000", 2023-10-08T07:07:49.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6699999999999999e-07 2023-10-08T07:07:49.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.522608+0000", 2023-10-08T07:07:49.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3891e-05 2023-10-08T07:07:49.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.522614+0000", 2023-10-08T07:07:49.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4409999999999998e-06 2023-10-08T07:07:49.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.522619+0000", 2023-10-08T07:07:49.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9590000000000003e-06 2023-10-08T07:07:49.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.247 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.247 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161056 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.247 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.652396+0000", 2023-10-08T07:07:49.247 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.45382650299999999, 2023-10-08T07:07:49.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46797569100000003, 2023-10-08T07:07:49.248 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.248 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.248 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161056 2023-10-08T07:07:49.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.248 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.652396+0000", 2023-10-08T07:07:49.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.652396+0000", 2023-10-08T07:07:49.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.652396+0000", 2023-10-08T07:07:49.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7800000000000001e-07 2023-10-08T07:07:49.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.652412+0000", 2023-10-08T07:07:49.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5410999999999999e-05 2023-10-08T07:07:49.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.652419+0000", 2023-10-08T07:07:49.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3499999999999999e-06 2023-10-08T07:07:49.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.652425+0000", 2023-10-08T07:07:49.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2790000000000004e-06 2023-10-08T07:07:49.252 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.252 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.252 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.252 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161724 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.252 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.946350+0000", 2023-10-08T07:07:49.252 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15987194499999999, 2023-10-08T07:07:49.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.174075066, 2023-10-08T07:07:49.252 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.252 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.253 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.253 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.253 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.253 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161724 2023-10-08T07:07:49.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.253 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.946350+0000", 2023-10-08T07:07:49.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.946350+0000", 2023-10-08T07:07:49.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.946351+0000", 2023-10-08T07:07:49.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8500000000000001e-07 2023-10-08T07:07:49.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.946364+0000", 2023-10-08T07:07:49.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2918000000000001e-05 2023-10-08T07:07:49.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.946371+0000", 2023-10-08T07:07:49.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.452e-06 2023-10-08T07:07:49.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.946378+0000", 2023-10-08T07:07:49.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.579e-06 2023-10-08T07:07:49.256 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.256 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.256 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.257 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159752 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.257 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.099542+0000", 2023-10-08T07:07:49.257 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.006680743, 2023-10-08T07:07:49.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0209376160000001, 2023-10-08T07:07:49.257 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.257 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.257 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.258 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159752 2023-10-08T07:07:49.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.258 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.099542+0000", 2023-10-08T07:07:49.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.099542+0000", 2023-10-08T07:07:49.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.099542+0000", 2023-10-08T07:07:49.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.58e-07 2023-10-08T07:07:49.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.099558+0000", 2023-10-08T07:07:49.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6385999999999999e-05 2023-10-08T07:07:49.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.099566+0000", 2023-10-08T07:07:49.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999998e-06 2023-10-08T07:07:49.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.099571+0000", 2023-10-08T07:07:49.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4249999999999997e-06 2023-10-08T07:07:49.263 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.263 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.263 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159834 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.145377+0000", 2023-10-08T07:07:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.96084542100000003, 2023-10-08T07:07:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.97515779499999999, 2023-10-08T07:07:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.265 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159834 2023-10-08T07:07:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.145377+0000", 2023-10-08T07:07:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.145377+0000", 2023-10-08T07:07:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.145377+0000", 2023-10-08T07:07:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2023-10-08T07:07:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.145390+0000", 2023-10-08T07:07:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2366e-05 2023-10-08T07:07:49.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.145397+0000", 2023-10-08T07:07:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6020000000000002e-06 2023-10-08T07:07:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.145404+0000", 2023-10-08T07:07:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9129999999999997e-06 2023-10-08T07:07:49.269 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160003 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.222428+0000", 2023-10-08T07:07:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.88379403400000001, 2023-10-08T07:07:49.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.898159233, 2023-10-08T07:07:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160003 2023-10-08T07:07:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.222428+0000", 2023-10-08T07:07:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.222428+0000", 2023-10-08T07:07:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.222429+0000", 2023-10-08T07:07:49.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.15e-07 2023-10-08T07:07:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.222440+0000", 2023-10-08T07:07:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.131e-05 2023-10-08T07:07:49.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.222446+0000", 2023-10-08T07:07:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5990000000000001e-06 2023-10-08T07:07:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.222450+0000", 2023-10-08T07:07:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6299999999999997e-06 2023-10-08T07:07:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.274 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161938 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.083349+0000", 2023-10-08T07:07:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.022873291, 2023-10-08T07:07:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037291669999999999, 2023-10-08T07:07:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.276 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161938 2023-10-08T07:07:49.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.276 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083349+0000", 2023-10-08T07:07:49.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083349+0000", 2023-10-08T07:07:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083350+0000", 2023-10-08T07:07:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2023-10-08T07:07:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083362+0000", 2023-10-08T07:07:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2104e-05 2023-10-08T07:07:49.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083369+0000", 2023-10-08T07:07:49.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0249999999999997e-06 2023-10-08T07:07:49.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083374+0000", 2023-10-08T07:07:49.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1109999999999999e-06 2023-10-08T07:07:49.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.278 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.279 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.279 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176708 4.20 e64/17 4:05b3915c:::10000000004.00000016:head v 64'8335, mlcod=64'8326)", 2023-10-08T07:07:49.279 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.110710+0000", 2023-10-08T07:07:49.279 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9955125, 2023-10-08T07:07:49.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0099864729999999992, 2023-10-08T07:07:49.279 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.279 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:49.279 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.110710+0000", 2023-10-08T07:07:49.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.110710+0000", 2023-10-08T07:07:49.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.110710+0000", 2023-10-08T07:07:49.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.82e-07 2023-10-08T07:07:49.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.110749+0000", 2023-10-08T07:07:49.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8637000000000003e-05 2023-10-08T07:07:49.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.110757+0000", 2023-10-08T07:07:49.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6320000000000008e-06 2023-10-08T07:07:49.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.110761+0000", 2023-10-08T07:07:49.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5619999999999997e-06 2023-10-08T07:07:49.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:49.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.116921+0000", 2023-10-08T07:07:49.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0061600120000000003 2023-10-08T07:07:49.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.116940+0000", 2023-10-08T07:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9239999999999999e-05 2023-10-08T07:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159454 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.976836+0000", 2023-10-08T07:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1293860419999999, 2023-10-08T07:07:49.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.143923011, 2023-10-08T07:07:49.284 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.284 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.284 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159454 2023-10-08T07:07:49.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.284 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.976836+0000", 2023-10-08T07:07:49.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.976836+0000", 2023-10-08T07:07:49.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.978294+0000", 2023-10-08T07:07:49.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001457926 2023-10-08T07:07:49.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.978311+0000", 2023-10-08T07:07:49.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6790999999999999e-05 2023-10-08T07:07:49.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.978321+0000", 2023-10-08T07:07:49.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4800000000000007e-06 2023-10-08T07:07:49.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.978328+0000", 2023-10-08T07:07:49.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5410000000000003e-06 2023-10-08T07:07:49.289 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.289 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.289 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.289 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160207 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.289 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.309663+0000", 2023-10-08T07:07:49.289 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.79655906499999996, 2023-10-08T07:07:49.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.81115733400000001, 2023-10-08T07:07:49.289 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.290 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.290 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160207 2023-10-08T07:07:49.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.290 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.309663+0000", 2023-10-08T07:07:49.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.309663+0000", 2023-10-08T07:07:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.311295+0000", 2023-10-08T07:07:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016318630000000001 2023-10-08T07:07:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.311314+0000", 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9276e-05 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.311324+0000", 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1060000000000006e-06 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.311329+0000", 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1440000000000002e-06 2023-10-08T07:07:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160885 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.571692+0000", 2023-10-08T07:07:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.53452994899999995, 2023-10-08T07:07:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.54918825400000004, 2023-10-08T07:07:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160885 2023-10-08T07:07:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.571692+0000", 2023-10-08T07:07:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.571692+0000", 2023-10-08T07:07:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.573298+0000", 2023-10-08T07:07:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001605125 2023-10-08T07:07:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.573315+0000", 2023-10-08T07:07:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7303999999999999e-05 2023-10-08T07:07:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.573331+0000", 2023-10-08T07:07:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5736999999999999e-05 2023-10-08T07:07:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.573339+0000", 2023-10-08T07:07:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0919999999999998e-06 2023-10-08T07:07:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161373 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.801349+0000", 2023-10-08T07:07:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.30487345199999999, 2023-10-08T07:07:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.31959125999999999, 2023-10-08T07:07:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161373 2023-10-08T07:07:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.801349+0000", 2023-10-08T07:07:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.801349+0000", 2023-10-08T07:07:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.801349+0000", 2023-10-08T07:07:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0200000000000002e-07 2023-10-08T07:07:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.801375+0000", 2023-10-08T07:07:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5286000000000002e-05 2023-10-08T07:07:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.801384+0000", 2023-10-08T07:07:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6630000000000005e-06 2023-10-08T07:07:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.801389+0000", 2023-10-08T07:07:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1089999999999997e-06 2023-10-08T07:07:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161877 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.043382+0000", 2023-10-08T07:07:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.062840661000000006, 2023-10-08T07:07:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077619007000000004, 2023-10-08T07:07:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161877 2023-10-08T07:07:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.043382+0000", 2023-10-08T07:07:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.043382+0000", 2023-10-08T07:07:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.047294+0000", 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039122330000000002 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.047312+0000", 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8360999999999999e-05 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.047324+0000", 2023-10-08T07:07:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1216999999999999e-05 2023-10-08T07:07:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.047331+0000", 2023-10-08T07:07:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2899999999999997e-06 2023-10-08T07:07:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176137 4.3a e64/17 4:5fb70c0f:::10000000004.0000002e:head v 64'8094, mlcod=64'8081)", 2023-10-08T07:07:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.083361+0000", 2023-10-08T07:07:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.022861517000000001, 2023-10-08T07:07:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037701023, 2023-10-08T07:07:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083361+0000", 2023-10-08T07:07:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083361+0000", 2023-10-08T07:07:49.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083361+0000", 2023-10-08T07:07:49.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3900000000000001e-07 2023-10-08T07:07:49.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083373+0000", 2023-10-08T07:07:49.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1539000000000001e-05 2023-10-08T07:07:49.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083378+0000", 2023-10-08T07:07:49.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.48e-06 2023-10-08T07:07:49.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.083382+0000", 2023-10-08T07:07:49.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3420000000000001e-06 2023-10-08T07:07:49.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:49.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.108285+0000", 2023-10-08T07:07:49.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024902615999999999 2023-10-08T07:07:49.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:49.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.108308+0000", 2023-10-08T07:07:49.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2738000000000002e-05 2023-10-08T07:07:49.308 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.308 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.308 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176193 4.3a e64/17)", 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.100673+0000", 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0055498539999999999, 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020451517999999998, 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.100673+0000", 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.100673+0000", 2023-10-08T07:07:49.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.100673+0000", 2023-10-08T07:07:49.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5199999999999996e-07 2023-10-08T07:07:49.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.100686+0000", 2023-10-08T07:07:49.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2747e-05 2023-10-08T07:07:49.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.100695+0000", 2023-10-08T07:07:49.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9109999999999999e-06 2023-10-08T07:07:49.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.100701+0000", 2023-10-08T07:07:49.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4189999999999999e-06 2023-10-08T07:07:49.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.312 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.312 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176715 4.1b e64/17 4:dbb7dde6:::10000000004.0000002c:head v 64'5560, mlcod=64'5557)", 2023-10-08T07:07:49.312 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.111008+0000", 2023-10-08T07:07:49.312 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9952145, 2023-10-08T07:07:49.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010166725999999999, 2023-10-08T07:07:49.312 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.312 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:49.312 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111008+0000", 2023-10-08T07:07:49.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111008+0000", 2023-10-08T07:07:49.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111008+0000", 2023-10-08T07:07:49.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8200000000000001e-07 2023-10-08T07:07:49.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111068+0000", 2023-10-08T07:07:49.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9420999999999999e-05 2023-10-08T07:07:49.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111075+0000", 2023-10-08T07:07:49.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0079999999999996e-06 2023-10-08T07:07:49.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111080+0000", 2023-10-08T07:07:49.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.101e-06 2023-10-08T07:07:49.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:49.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111122+0000", 2023-10-08T07:07:49.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2268000000000003e-05 2023-10-08T07:07:49.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:49.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111141+0000", 2023-10-08T07:07:49.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9100999999999999e-05 2023-10-08T07:07:49.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.316 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.316 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159292 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.316 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:46.888357+0000", 2023-10-08T07:07:49.316 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.21786496, 2023-10-08T07:07:49.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2328512039999999, 2023-10-08T07:07:49.317 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.317 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.317 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159292 2023-10-08T07:07:49.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.317 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.888357+0000", 2023-10-08T07:07:49.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.888357+0000", 2023-10-08T07:07:49.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.888358+0000", 2023-10-08T07:07:49.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9299999999999998e-07 2023-10-08T07:07:49.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.888375+0000", 2023-10-08T07:07:49.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6908000000000001e-05 2023-10-08T07:07:49.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.888380+0000", 2023-10-08T07:07:49.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2460000000000003e-06 2023-10-08T07:07:49.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:46.888384+0000", 2023-10-08T07:07:49.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.783e-06 2023-10-08T07:07:49.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.320 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.320 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159532 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.320 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.005465+0000", 2023-10-08T07:07:49.320 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1007569909999999, 2023-10-08T07:07:49.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.115780583, 2023-10-08T07:07:49.321 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.321 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.321 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159532 2023-10-08T07:07:49.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.321 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005465+0000", 2023-10-08T07:07:49.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005465+0000", 2023-10-08T07:07:49.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005466+0000", 2023-10-08T07:07:49.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6899999999999998e-07 2023-10-08T07:07:49.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005476+0000", 2023-10-08T07:07:49.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0607e-05 2023-10-08T07:07:49.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005483+0000", 2023-10-08T07:07:49.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8650000000000003e-06 2023-10-08T07:07:49.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.005489+0000", 2023-10-08T07:07:49.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7370000000000003e-06 2023-10-08T07:07:49.324 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.324 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.324 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.324 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159973 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.213414+0000", 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.89280837400000002, 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.90786762499999996, 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159973 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.213414+0000", 2023-10-08T07:07:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.213414+0000", 2023-10-08T07:07:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.213415+0000", 2023-10-08T07:07:49.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.13e-07 2023-10-08T07:07:49.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.213424+0000", 2023-10-08T07:07:49.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8030000000000008e-06 2023-10-08T07:07:49.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.213430+0000", 2023-10-08T07:07:49.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0059999999999998e-06 2023-10-08T07:07:49.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.213435+0000", 2023-10-08T07:07:49.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6480000000000002e-06 2023-10-08T07:07:49.328 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.328 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.328 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.328 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160538 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.328 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.438441+0000", 2023-10-08T07:07:49.328 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.66778093500000002, 2023-10-08T07:07:49.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.68303032299999999, 2023-10-08T07:07:49.329 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.329 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.329 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.329 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160538 2023-10-08T07:07:49.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.329 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.438441+0000", 2023-10-08T07:07:49.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.438441+0000", 2023-10-08T07:07:49.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.444295+0000", 2023-10-08T07:07:49.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058532300000000001 2023-10-08T07:07:49.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.444309+0000", 2023-10-08T07:07:49.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3862999999999999e-05 2023-10-08T07:07:49.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.444318+0000", 2023-10-08T07:07:49.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0929999999999992e-06 2023-10-08T07:07:49.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.444332+0000", 2023-10-08T07:07:49.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4123e-05 2023-10-08T07:07:49.332 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.332 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.332 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.332 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160684 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.332 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.496504+0000", 2023-10-08T07:07:49.332 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.60971821599999998, 2023-10-08T07:07:49.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.62500983600000004, 2023-10-08T07:07:49.332 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.333 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.333 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.333 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.333 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.333 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160684 2023-10-08T07:07:49.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.333 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.496504+0000", 2023-10-08T07:07:49.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.496504+0000", 2023-10-08T07:07:49.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.496505+0000", 2023-10-08T07:07:49.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000005e-07 2023-10-08T07:07:49.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.496517+0000", 2023-10-08T07:07:49.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2276000000000001e-05 2023-10-08T07:07:49.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.496525+0000", 2023-10-08T07:07:49.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9189999999999999e-06 2023-10-08T07:07:49.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.496530+0000", 2023-10-08T07:07:49.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5419999999999996e-06 2023-10-08T07:07:49.336 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.336 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.336 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.336 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4556.0:176253 4.3a e64/17)", 2023-10-08T07:07:49.336 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.111813+0000", 2023-10-08T07:07:49.336 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.99441, 2023-10-08T07:07:49.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097332140000000004, 2023-10-08T07:07:49.336 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.336 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.336 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111813+0000", 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111813+0000", 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111813+0000", 2023-10-08T07:07:49.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.99e-07 2023-10-08T07:07:49.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111824+0000", 2023-10-08T07:07:49.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1056000000000001e-05 2023-10-08T07:07:49.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111833+0000", 2023-10-08T07:07:49.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4989999999999994e-06 2023-10-08T07:07:49.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.111839+0000", 2023-10-08T07:07:49.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2149999999999998e-06 2023-10-08T07:07:49.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.339 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.339 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:159871 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.339 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.161353+0000", 2023-10-08T07:07:49.339 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.94486907499999995, 2023-10-08T07:07:49.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.96023932199999995, 2023-10-08T07:07:49.340 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.340 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.340 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159871 2023-10-08T07:07:49.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.340 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161353+0000", 2023-10-08T07:07:49.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161353+0000", 2023-10-08T07:07:49.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161354+0000", 2023-10-08T07:07:49.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2099999999999997e-07 2023-10-08T07:07:49.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161366+0000", 2023-10-08T07:07:49.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2296999999999999e-05 2023-10-08T07:07:49.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161373+0000", 2023-10-08T07:07:49.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9709999999999998e-06 2023-10-08T07:07:49.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.161378+0000", 2023-10-08T07:07:49.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2050000000000001e-06 2023-10-08T07:07:49.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.343 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.343 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160517 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.426367+0000", 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67985502600000003, 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.69528970899999998, 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160517 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426367+0000", 2023-10-08T07:07:49.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426367+0000", 2023-10-08T07:07:49.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426368+0000", 2023-10-08T07:07:49.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6100000000000002e-07 2023-10-08T07:07:49.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426378+0000", 2023-10-08T07:07:49.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0715e-05 2023-10-08T07:07:49.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426384+0000", 2023-10-08T07:07:49.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8259999999999998e-06 2023-10-08T07:07:49.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.426389+0000", 2023-10-08T07:07:49.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1440000000000002e-06 2023-10-08T07:07:49.347 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.347 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.347 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.347 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:160913 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2023-10-08T07:07:49.347 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.581463+0000", 2023-10-08T07:07:49.347 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.52475969499999997, 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.54025662500000005, 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 160913 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.581463+0000", 2023-10-08T07:07:49.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.581463+0000", 2023-10-08T07:07:49.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.583296+0000", 2023-10-08T07:07:49.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018328629999999999 2023-10-08T07:07:49.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.583317+0000", 2023-10-08T07:07:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1415000000000001e-05 2023-10-08T07:07:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.583330+0000", 2023-10-08T07:07:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2571e-05 2023-10-08T07:07:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.583337+0000", 2023-10-08T07:07:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5569999999999998e-06 2023-10-08T07:07:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161244 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.744471+0000", 2023-10-08T07:07:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.36175099300000002, 2023-10-08T07:07:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.37730272599999998, 2023-10-08T07:07:49.351 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.352 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.352 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.352 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.352 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.352 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161244 2023-10-08T07:07:49.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.352 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.744471+0000", 2023-10-08T07:07:49.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.744471+0000", 2023-10-08T07:07:49.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.744472+0000", 2023-10-08T07:07:49.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7199999999999999e-07 2023-10-08T07:07:49.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.744486+0000", 2023-10-08T07:07:49.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4450999999999999e-05 2023-10-08T07:07:49.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.744492+0000", 2023-10-08T07:07:49.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0689999999999998e-06 2023-10-08T07:07:49.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.744497+0000", 2023-10-08T07:07:49.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.707e-06 2023-10-08T07:07:49.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.355 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.355 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.355 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161409 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.355 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.811348+0000", 2023-10-08T07:07:49.355 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29487467499999998, 2023-10-08T07:07:49.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.31048335500000002, 2023-10-08T07:07:49.355 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.355 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.356 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161409 2023-10-08T07:07:49.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.356 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.811348+0000", 2023-10-08T07:07:49.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.811348+0000", 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.811348+0000", 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8299999999999996e-07 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.811365+0000", 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6858e-05 2023-10-08T07:07:49.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.811373+0000", 2023-10-08T07:07:49.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3490000000000003e-06 2023-10-08T07:07:49.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.811378+0000", 2023-10-08T07:07:49.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3689999999999998e-06 2023-10-08T07:07:49.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.358 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161487 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.845554+0000", 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26066814599999999, 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27633255400000001, 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.359 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161487 2023-10-08T07:07:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.845554+0000", 2023-10-08T07:07:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.845554+0000", 2023-10-08T07:07:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.845555+0000", 2023-10-08T07:07:49.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.65e-07 2023-10-08T07:07:49.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.845566+0000", 2023-10-08T07:07:49.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1158000000000001e-05 2023-10-08T07:07:49.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.845573+0000", 2023-10-08T07:07:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8140000000000003e-06 2023-10-08T07:07:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.845577+0000", 2023-10-08T07:07:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6920000000000001e-06 2023-10-08T07:07:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.363 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161746 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.363 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:47.958390+0000", 2023-10-08T07:07:49.363 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14783274800000001, 2023-10-08T07:07:49.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.16355439499999999, 2023-10-08T07:07:49.363 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.363 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.363 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161746 2023-10-08T07:07:49.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.363 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.958390+0000", 2023-10-08T07:07:49.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.958390+0000", 2023-10-08T07:07:49.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.962295+0000", 2023-10-08T07:07:49.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003905412 2023-10-08T07:07:49.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.962313+0000", 2023-10-08T07:07:49.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8363e-05 2023-10-08T07:07:49.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.962325+0000", 2023-10-08T07:07:49.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1374e-05 2023-10-08T07:07:49.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:47.962332+0000", 2023-10-08T07:07:49.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4460000000000004e-06 2023-10-08T07:07:49.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.366 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.366 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:161992 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2023-10-08T07:07:49.366 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:48.108359+0000", 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9978628, 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013639572000000001, 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 161992 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:49.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.108359+0000", 2023-10-08T07:07:49.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:49.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.108359+0000", 2023-10-08T07:07:49.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:49.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:49.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.112294+0000", 2023-10-08T07:07:49.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039347690000000003 2023-10-08T07:07:49.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:49.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.112310+0000", 2023-10-08T07:07:49.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6115000000000001e-05 2023-10-08T07:07:49.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:49.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.112325+0000", 2023-10-08T07:07:49.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4973999999999999e-05 2023-10-08T07:07:49.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:49.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:49.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:49.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:48.112334+0000", 2023-10-08T07:07:49.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5969999999999992e-06 2023-10-08T07:07:49.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.370 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:49.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:49.370 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:49.370 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 282 2023-10-08T07:07:49.370 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:49.372 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:49.372 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:49.372 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:49.373 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:49.374 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:49.374 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:49.374 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2023-10-08T07:07:49.375 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:49.370+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:49.473 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:49.472+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:49.572 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:49.572 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:49.575 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:49.573+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:49.588 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:49.675 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:49.673+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:49.783 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:49.774+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:49.837 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:49.837 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:49.844 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:49.891 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:49.887+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:49.976 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:49.975+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:50.050 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:50.050 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:50.067 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:50.077 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:50.075+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:50.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~72s 2023-10-08T07:07:50.180 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:50.179+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:50.279 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:50.278+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:50.324 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:50.324 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:50.343 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:50.388 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:50.387+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:50.485 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:50.484+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:50.558 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:50.558 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:50.572 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:50.616 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:50.615+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:50.677 INFO:tasks.workunit.client.0.smithi017.stdout:setting up random write file 2023-10-08T07:07:50.677 INFO:tasks.workunit.client.0.smithi017.stdout:done setting up random write file 2023-10-08T07:07:50.678 INFO:tasks.workunit.client.0.smithi017.stdout:starting fsync run 2023-10-08T07:07:50.678 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0042s fsync time: 0.0074s 2023-10-08T07:07:50.678 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0012s fsync time: 0.0148s 2023-10-08T07:07:50.678 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0018s fsync time: 0.0063s 2023-10-08T07:07:50.678 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0014s fsync time: 0.0092s 2023-10-08T07:07:50.678 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0015s fsync time: 0.0088s 2023-10-08T07:07:50.678 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0014s fsync time: 0.0092s 2023-10-08T07:07:50.678 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0015s fsync time: 0.0140s 2023-10-08T07:07:50.678 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0012s fsync time: 0.0094s 2023-10-08T07:07:50.678 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0010s fsync time: 0.0109s 2023-10-08T07:07:50.678 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0014s fsync time: 0.0055s 2023-10-08T07:07:50.679 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0015s fsync time: 0.0107s 2023-10-08T07:07:50.679 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0011s fsync time: 0.0129s 2023-10-08T07:07:50.679 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0023s fsync time: 0.0182s 2023-10-08T07:07:50.679 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0015s fsync time: 0.0119s 2023-10-08T07:07:50.679 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0013s fsync time: 0.0210s 2023-10-08T07:07:50.679 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0012s fsync time: 0.1075s 2023-10-08T07:07:50.679 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0012s fsync time: 0.0142s 2023-10-08T07:07:50.679 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0012s fsync time: 0.0097s 2023-10-08T07:07:50.679 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0014s fsync time: 0.0128s 2023-10-08T07:07:50.679 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0011s fsync time: 0.0123s 2023-10-08T07:07:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0011s fsync time: 0.0060s 2023-10-08T07:07:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0013s fsync time: 0.0106s 2023-10-08T07:07:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0013s fsync time: 0.0051s 2023-10-08T07:07:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0015s fsync time: 0.0096s 2023-10-08T07:07:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0014s fsync time: 0.0146s 2023-10-08T07:07:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0010s fsync time: 0.0119s 2023-10-08T07:07:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0010s fsync time: 0.0122s 2023-10-08T07:07:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0011s fsync time: 0.0113s 2023-10-08T07:07:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0014s fsync time: 0.0082s 2023-10-08T07:07:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0021s fsync time: 0.0099s 2023-10-08T07:07:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0010s fsync time: 0.0100s 2023-10-08T07:07:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0015s fsync time: 0.0097s 2023-10-08T07:07:50.681 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0010s fsync time: 0.0101s 2023-10-08T07:07:50.681 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0010s fsync time: 0.0141s 2023-10-08T07:07:50.681 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0013s fsync time: 0.0343s 2023-10-08T07:07:50.681 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0012s fsync time: 0.1650s 2023-10-08T07:07:50.681 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0011s fsync time: 0.0161s 2023-10-08T07:07:50.681 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0010s fsync time: 0.0117s 2023-10-08T07:07:50.681 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0013s fsync time: 0.0180s 2023-10-08T07:07:50.681 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0015s fsync time: 0.0892s 2023-10-08T07:07:50.681 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0010s fsync time: 0.0472s 2023-10-08T07:07:50.681 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0011s fsync time: 0.0224s 2023-10-08T07:07:50.681 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0010s fsync time: 0.0389s 2023-10-08T07:07:50.682 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0011s fsync time: 0.0552s 2023-10-08T07:07:50.682 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0013s fsync time: 0.1037s 2023-10-08T07:07:50.682 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0011s fsync time: 0.4521s 2023-10-08T07:07:50.682 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0014s fsync time: 0.8472s 2023-10-08T07:07:50.682 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0013s fsync time: 1.5266s 2023-10-08T07:07:50.682 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0016s fsync time: 2.4553s 2023-10-08T07:07:50.682 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0014s fsync time: 3.6269s 2023-10-08T07:07:50.682 INFO:tasks.workunit.client.0.smithi017.stdout:write time: 0.0012s fsync time: 5.5736s 2023-10-08T07:07:50.682 INFO:tasks.workunit.client.0.smithi017.stdout:run done 51 fsyncs total, killing random writer 2023-10-08T07:07:50.685 INFO:tasks.workunit.client.0.smithi017.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-10-08T07:07:50.685 INFO:tasks.workunit.client.0.smithi017.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-10-08T07:07:50.686 INFO:tasks.workunit.client.0.smithi017.stderr:+ whereis lsof 2023-10-08T07:07:50.686 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:50.682+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:50.718 INFO:tasks.workunit.client.0.smithi017.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2023-10-08T07:07:50.719 INFO:tasks.workunit.client.0.smithi017.stderr:+ lsof 2023-10-08T07:07:50.775 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:50.775 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:50.782 INFO:tasks.workunit.client.0.smithi017.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-10-08T07:07:50.782 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2023-10-08T07:07:50.782 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2023-10-08T07:07:50.782 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2023-10-08T07:07:50.782 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2023-10-08T07:07:50.782 INFO:tasks.workunit.client.0.smithi017.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2023-10-08T07:07:50.782 INFO:tasks.workunit.client.0.smithi017.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2023-10-08T07:07:50.783 INFO:tasks.workunit.client.0.smithi017.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2023-10-08T07:07:50.783 INFO:tasks.workunit.client.0.smithi017.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2023-10-08T07:07:50.783 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_gp 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2023-10-08T07:07:50.784 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_gp 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2023-10-08T07:07:50.784 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_gp 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2023-10-08T07:07:50.784 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_gp 3 root NOFD /proc/3/fd (opendir: Permission denied) 2023-10-08T07:07:50.784 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_par_g 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2023-10-08T07:07:50.784 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_par_g 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2023-10-08T07:07:50.784 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_par_g 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2023-10-08T07:07:50.784 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_par_g 4 root NOFD /proc/4/fd (opendir: Permission denied) 2023-10-08T07:07:50.784 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2023-10-08T07:07:50.784 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2023-10-08T07:07:50.784 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2023-10-08T07:07:50.784 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 6 root NOFD /proc/6/fd (opendir: Permission denied) 2023-10-08T07:07:50.784 INFO:tasks.workunit.client.0.smithi017.stdout:mm_percpu 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:mm_percpu 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:mm_percpu 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:mm_percpu 9 root NOFD /proc/9/fd (opendir: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_tasks 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_tasks 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_tasks 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_tasks 10 root NOFD /proc/10/fd (opendir: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_tasks 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_tasks 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_tasks 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_tasks 11 root NOFD /proc/11/fd (opendir: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2023-10-08T07:07:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2023-10-08T07:07:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2023-10-08T07:07:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 12 root NOFD /proc/12/fd (opendir: Permission denied) 2023-10-08T07:07:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_sched 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2023-10-08T07:07:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_sched 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2023-10-08T07:07:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_sched 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2023-10-08T07:07:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:rcu_sched 13 root NOFD /proc/13/fd (opendir: Permission denied) 2023-10-08T07:07:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:migration 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2023-10-08T07:07:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:migration 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2023-10-08T07:07:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:migration 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2023-10-08T07:07:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:migration 14 root NOFD /proc/14/fd (opendir: Permission denied) 2023-10-08T07:07:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2023-10-08T07:07:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2023-10-08T07:07:50.787 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2023-10-08T07:07:50.787 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 15 root NOFD /proc/15/fd (opendir: Permission denied) 2023-10-08T07:07:50.787 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/0 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2023-10-08T07:07:50.787 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/0 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2023-10-08T07:07:50.787 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/0 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2023-10-08T07:07:50.787 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/0 16 root NOFD /proc/16/fd (opendir: Permission denied) 2023-10-08T07:07:50.787 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/1 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2023-10-08T07:07:50.787 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/1 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2023-10-08T07:07:50.787 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/1 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2023-10-08T07:07:50.787 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/1 17 root NOFD /proc/17/fd (opendir: Permission denied) 2023-10-08T07:07:50.787 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2023-10-08T07:07:50.787 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2023-10-08T07:07:50.788 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2023-10-08T07:07:50.788 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 18 root NOFD /proc/18/fd (opendir: Permission denied) 2023-10-08T07:07:50.788 INFO:tasks.workunit.client.0.smithi017.stdout:migration 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2023-10-08T07:07:50.788 INFO:tasks.workunit.client.0.smithi017.stdout:migration 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2023-10-08T07:07:50.788 INFO:tasks.workunit.client.0.smithi017.stdout:migration 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2023-10-08T07:07:50.788 INFO:tasks.workunit.client.0.smithi017.stdout:migration 19 root NOFD /proc/19/fd (opendir: Permission denied) 2023-10-08T07:07:50.788 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2023-10-08T07:07:50.788 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2023-10-08T07:07:50.788 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2023-10-08T07:07:50.788 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 20 root NOFD /proc/20/fd (opendir: Permission denied) 2023-10-08T07:07:50.788 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2023-10-08T07:07:50.788 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2023-10-08T07:07:50.789 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2023-10-08T07:07:50.789 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 22 root NOFD /proc/22/fd (opendir: Permission denied) 2023-10-08T07:07:50.789 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/2 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2023-10-08T07:07:50.789 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/2 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2023-10-08T07:07:50.789 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/2 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2023-10-08T07:07:50.789 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/2 23 root NOFD /proc/23/fd (opendir: Permission denied) 2023-10-08T07:07:50.789 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2023-10-08T07:07:50.789 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2023-10-08T07:07:50.789 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2023-10-08T07:07:50.789 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 24 root NOFD /proc/24/fd (opendir: Permission denied) 2023-10-08T07:07:50.789 INFO:tasks.workunit.client.0.smithi017.stdout:migration 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2023-10-08T07:07:50.790 INFO:tasks.workunit.client.0.smithi017.stdout:migration 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2023-10-08T07:07:50.790 INFO:tasks.workunit.client.0.smithi017.stdout:migration 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2023-10-08T07:07:50.790 INFO:tasks.workunit.client.0.smithi017.stdout:migration 25 root NOFD /proc/25/fd (opendir: Permission denied) 2023-10-08T07:07:50.790 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2023-10-08T07:07:50.790 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2023-10-08T07:07:50.790 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2023-10-08T07:07:50.790 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 26 root NOFD /proc/26/fd (opendir: Permission denied) 2023-10-08T07:07:50.790 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2023-10-08T07:07:50.790 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2023-10-08T07:07:50.790 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2023-10-08T07:07:50.790 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 28 root NOFD /proc/28/fd (opendir: Permission denied) 2023-10-08T07:07:50.790 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/3 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/3 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/3 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/3 29 root NOFD /proc/29/fd (opendir: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 30 root NOFD /proc/30/fd (opendir: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:migration 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:migration 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:migration 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:migration 31 root NOFD /proc/31/fd (opendir: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2023-10-08T07:07:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2023-10-08T07:07:50.792 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2023-10-08T07:07:50.792 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 32 root NOFD /proc/32/fd (opendir: Permission denied) 2023-10-08T07:07:50.792 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2023-10-08T07:07:50.792 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2023-10-08T07:07:50.792 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2023-10-08T07:07:50.792 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 34 root NOFD /proc/34/fd (opendir: Permission denied) 2023-10-08T07:07:50.792 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/4 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2023-10-08T07:07:50.792 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/4 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2023-10-08T07:07:50.792 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/4 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2023-10-08T07:07:50.792 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/4 35 root NOFD /proc/35/fd (opendir: Permission denied) 2023-10-08T07:07:50.792 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2023-10-08T07:07:50.792 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2023-10-08T07:07:50.793 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2023-10-08T07:07:50.793 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 36 root NOFD /proc/36/fd (opendir: Permission denied) 2023-10-08T07:07:50.793 INFO:tasks.workunit.client.0.smithi017.stdout:migration 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2023-10-08T07:07:50.793 INFO:tasks.workunit.client.0.smithi017.stdout:migration 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2023-10-08T07:07:50.793 INFO:tasks.workunit.client.0.smithi017.stdout:migration 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2023-10-08T07:07:50.793 INFO:tasks.workunit.client.0.smithi017.stdout:migration 37 root NOFD /proc/37/fd (opendir: Permission denied) 2023-10-08T07:07:50.794 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2023-10-08T07:07:50.794 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2023-10-08T07:07:50.794 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2023-10-08T07:07:50.794 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 38 root NOFD /proc/38/fd (opendir: Permission denied) 2023-10-08T07:07:50.794 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2023-10-08T07:07:50.795 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2023-10-08T07:07:50.795 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2023-10-08T07:07:50.795 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 40 root NOFD /proc/40/fd (opendir: Permission denied) 2023-10-08T07:07:50.795 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/5 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2023-10-08T07:07:50.795 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/5 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2023-10-08T07:07:50.795 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/5 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2023-10-08T07:07:50.795 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/5 41 root NOFD /proc/41/fd (opendir: Permission denied) 2023-10-08T07:07:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2023-10-08T07:07:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2023-10-08T07:07:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2023-10-08T07:07:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 42 root NOFD /proc/42/fd (opendir: Permission denied) 2023-10-08T07:07:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2023-10-08T07:07:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2023-10-08T07:07:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2023-10-08T07:07:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2023-10-08T07:07:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2023-10-08T07:07:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2023-10-08T07:07:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2023-10-08T07:07:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2023-10-08T07:07:50.797 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2023-10-08T07:07:50.797 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2023-10-08T07:07:50.797 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2023-10-08T07:07:50.797 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 46 root NOFD /proc/46/fd (opendir: Permission denied) 2023-10-08T07:07:50.797 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/6 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2023-10-08T07:07:50.797 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/6 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2023-10-08T07:07:50.797 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/6 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2023-10-08T07:07:50.797 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/6 47 root NOFD /proc/47/fd (opendir: Permission denied) 2023-10-08T07:07:50.797 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2023-10-08T07:07:50.797 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2023-10-08T07:07:50.797 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2023-10-08T07:07:50.797 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 48 root NOFD /proc/48/fd (opendir: Permission denied) 2023-10-08T07:07:50.798 INFO:tasks.workunit.client.0.smithi017.stdout:migration 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2023-10-08T07:07:50.798 INFO:tasks.workunit.client.0.smithi017.stdout:migration 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2023-10-08T07:07:50.798 INFO:tasks.workunit.client.0.smithi017.stdout:migration 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2023-10-08T07:07:50.798 INFO:tasks.workunit.client.0.smithi017.stdout:migration 49 root NOFD /proc/49/fd (opendir: Permission denied) 2023-10-08T07:07:50.798 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2023-10-08T07:07:50.798 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2023-10-08T07:07:50.798 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2023-10-08T07:07:50.798 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 50 root NOFD /proc/50/fd (opendir: Permission denied) 2023-10-08T07:07:50.798 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2023-10-08T07:07:50.798 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2023-10-08T07:07:50.798 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2023-10-08T07:07:50.799 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 52 root NOFD /proc/52/fd (opendir: Permission denied) 2023-10-08T07:07:50.799 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/7 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2023-10-08T07:07:50.799 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/7 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2023-10-08T07:07:50.799 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/7 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2023-10-08T07:07:50.799 INFO:tasks.workunit.client.0.smithi017.stdout:cpuhp/7 53 root NOFD /proc/53/fd (opendir: Permission denied) 2023-10-08T07:07:50.799 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2023-10-08T07:07:50.799 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2023-10-08T07:07:50.799 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2023-10-08T07:07:50.799 INFO:tasks.workunit.client.0.smithi017.stdout:watchdog/ 54 root NOFD /proc/54/fd (opendir: Permission denied) 2023-10-08T07:07:50.799 INFO:tasks.workunit.client.0.smithi017.stdout:migration 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2023-10-08T07:07:50.799 INFO:tasks.workunit.client.0.smithi017.stdout:migration 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2023-10-08T07:07:50.799 INFO:tasks.workunit.client.0.smithi017.stdout:migration 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2023-10-08T07:07:50.800 INFO:tasks.workunit.client.0.smithi017.stdout:migration 55 root NOFD /proc/55/fd (opendir: Permission denied) 2023-10-08T07:07:50.800 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2023-10-08T07:07:50.800 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2023-10-08T07:07:50.800 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2023-10-08T07:07:50.800 INFO:tasks.workunit.client.0.smithi017.stdout:ksoftirqd 56 root NOFD /proc/56/fd (opendir: Permission denied) 2023-10-08T07:07:50.800 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2023-10-08T07:07:50.800 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2023-10-08T07:07:50.800 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2023-10-08T07:07:50.800 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 58 root NOFD /proc/58/fd (opendir: Permission denied) 2023-10-08T07:07:50.800 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 62 root cwd unknown /proc/62/cwd (readlink: Permission denied) 2023-10-08T07:07:50.801 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 62 root rtd unknown /proc/62/root (readlink: Permission denied) 2023-10-08T07:07:50.801 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 62 root txt unknown /proc/62/exe (readlink: Permission denied) 2023-10-08T07:07:50.801 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 62 root NOFD /proc/62/fd (opendir: Permission denied) 2023-10-08T07:07:50.801 INFO:tasks.workunit.client.0.smithi017.stdout:kdevtmpfs 67 root cwd unknown /proc/67/cwd (readlink: Permission denied) 2023-10-08T07:07:50.801 INFO:tasks.workunit.client.0.smithi017.stdout:kdevtmpfs 67 root rtd unknown /proc/67/root (readlink: Permission denied) 2023-10-08T07:07:50.801 INFO:tasks.workunit.client.0.smithi017.stdout:kdevtmpfs 67 root txt unknown /proc/67/exe (readlink: Permission denied) 2023-10-08T07:07:50.801 INFO:tasks.workunit.client.0.smithi017.stdout:kdevtmpfs 67 root NOFD /proc/67/fd (opendir: Permission denied) 2023-10-08T07:07:50.801 INFO:tasks.workunit.client.0.smithi017.stdout:netns 68 root cwd unknown /proc/68/cwd (readlink: Permission denied) 2023-10-08T07:07:50.801 INFO:tasks.workunit.client.0.smithi017.stdout:netns 68 root rtd unknown /proc/68/root (readlink: Permission denied) 2023-10-08T07:07:50.801 INFO:tasks.workunit.client.0.smithi017.stdout:netns 68 root txt unknown /proc/68/exe (readlink: Permission denied) 2023-10-08T07:07:50.801 INFO:tasks.workunit.client.0.smithi017.stdout:netns 68 root NOFD /proc/68/fd (opendir: Permission denied) 2023-10-08T07:07:50.801 INFO:tasks.workunit.client.0.smithi017.stdout:kauditd 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2023-10-08T07:07:50.802 INFO:tasks.workunit.client.0.smithi017.stdout:kauditd 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2023-10-08T07:07:50.802 INFO:tasks.workunit.client.0.smithi017.stdout:kauditd 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2023-10-08T07:07:50.802 INFO:tasks.workunit.client.0.smithi017.stdout:kauditd 69 root NOFD /proc/69/fd (opendir: Permission denied) 2023-10-08T07:07:50.802 INFO:tasks.workunit.client.0.smithi017.stdout:khungtask 71 root cwd unknown /proc/71/cwd (readlink: Permission denied) 2023-10-08T07:07:50.802 INFO:tasks.workunit.client.0.smithi017.stdout:khungtask 71 root rtd unknown /proc/71/root (readlink: Permission denied) 2023-10-08T07:07:50.802 INFO:tasks.workunit.client.0.smithi017.stdout:khungtask 71 root txt unknown /proc/71/exe (readlink: Permission denied) 2023-10-08T07:07:50.802 INFO:tasks.workunit.client.0.smithi017.stdout:khungtask 71 root NOFD /proc/71/fd (opendir: Permission denied) 2023-10-08T07:07:50.802 INFO:tasks.workunit.client.0.smithi017.stdout:oom_reape 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2023-10-08T07:07:50.802 INFO:tasks.workunit.client.0.smithi017.stdout:oom_reape 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2023-10-08T07:07:50.802 INFO:tasks.workunit.client.0.smithi017.stdout:oom_reape 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2023-10-08T07:07:50.802 INFO:tasks.workunit.client.0.smithi017.stdout:oom_reape 72 root NOFD /proc/72/fd (opendir: Permission denied) 2023-10-08T07:07:50.803 INFO:tasks.workunit.client.0.smithi017.stdout:writeback 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2023-10-08T07:07:50.803 INFO:tasks.workunit.client.0.smithi017.stdout:writeback 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2023-10-08T07:07:50.803 INFO:tasks.workunit.client.0.smithi017.stdout:writeback 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2023-10-08T07:07:50.803 INFO:tasks.workunit.client.0.smithi017.stdout:writeback 73 root NOFD /proc/73/fd (opendir: Permission denied) 2023-10-08T07:07:50.803 INFO:tasks.workunit.client.0.smithi017.stdout:kcompactd 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2023-10-08T07:07:50.803 INFO:tasks.workunit.client.0.smithi017.stdout:kcompactd 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2023-10-08T07:07:50.803 INFO:tasks.workunit.client.0.smithi017.stdout:kcompactd 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2023-10-08T07:07:50.803 INFO:tasks.workunit.client.0.smithi017.stdout:kcompactd 74 root NOFD /proc/74/fd (opendir: Permission denied) 2023-10-08T07:07:50.803 INFO:tasks.workunit.client.0.smithi017.stdout:ksmd 75 root cwd unknown /proc/75/cwd (readlink: Permission denied) 2023-10-08T07:07:50.803 INFO:tasks.workunit.client.0.smithi017.stdout:ksmd 75 root rtd unknown /proc/75/root (readlink: Permission denied) 2023-10-08T07:07:50.803 INFO:tasks.workunit.client.0.smithi017.stdout:ksmd 75 root txt unknown /proc/75/exe (readlink: Permission denied) 2023-10-08T07:07:50.803 INFO:tasks.workunit.client.0.smithi017.stdout:ksmd 75 root NOFD /proc/75/fd (opendir: Permission denied) 2023-10-08T07:07:50.804 INFO:tasks.workunit.client.0.smithi017.stdout:khugepage 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2023-10-08T07:07:50.804 INFO:tasks.workunit.client.0.smithi017.stdout:khugepage 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2023-10-08T07:07:50.804 INFO:tasks.workunit.client.0.smithi017.stdout:khugepage 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2023-10-08T07:07:50.804 INFO:tasks.workunit.client.0.smithi017.stdout:khugepage 76 root NOFD /proc/76/fd (opendir: Permission denied) 2023-10-08T07:07:50.804 INFO:tasks.workunit.client.0.smithi017.stdout:crypto 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2023-10-08T07:07:50.804 INFO:tasks.workunit.client.0.smithi017.stdout:crypto 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2023-10-08T07:07:50.804 INFO:tasks.workunit.client.0.smithi017.stdout:crypto 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2023-10-08T07:07:50.804 INFO:tasks.workunit.client.0.smithi017.stdout:crypto 77 root NOFD /proc/77/fd (opendir: Permission denied) 2023-10-08T07:07:50.804 INFO:tasks.workunit.client.0.smithi017.stdout:kintegrit 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2023-10-08T07:07:50.804 INFO:tasks.workunit.client.0.smithi017.stdout:kintegrit 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2023-10-08T07:07:50.804 INFO:tasks.workunit.client.0.smithi017.stdout:kintegrit 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2023-10-08T07:07:50.805 INFO:tasks.workunit.client.0.smithi017.stdout:kintegrit 78 root NOFD /proc/78/fd (opendir: Permission denied) 2023-10-08T07:07:50.805 INFO:tasks.workunit.client.0.smithi017.stdout:kblockd 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2023-10-08T07:07:50.805 INFO:tasks.workunit.client.0.smithi017.stdout:kblockd 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2023-10-08T07:07:50.805 INFO:tasks.workunit.client.0.smithi017.stdout:kblockd 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2023-10-08T07:07:50.805 INFO:tasks.workunit.client.0.smithi017.stdout:kblockd 79 root NOFD /proc/79/fd (opendir: Permission denied) 2023-10-08T07:07:50.805 INFO:tasks.workunit.client.0.smithi017.stdout:blkcg_pun 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2023-10-08T07:07:50.805 INFO:tasks.workunit.client.0.smithi017.stdout:blkcg_pun 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2023-10-08T07:07:50.805 INFO:tasks.workunit.client.0.smithi017.stdout:blkcg_pun 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2023-10-08T07:07:50.805 INFO:tasks.workunit.client.0.smithi017.stdout:blkcg_pun 80 root NOFD /proc/80/fd (opendir: Permission denied) 2023-10-08T07:07:50.805 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2023-10-08T07:07:50.805 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2023-10-08T07:07:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2023-10-08T07:07:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 82 root NOFD /proc/82/fd (opendir: Permission denied) 2023-10-08T07:07:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2023-10-08T07:07:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2023-10-08T07:07:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2023-10-08T07:07:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 83 root NOFD /proc/83/fd (opendir: Permission denied) 2023-10-08T07:07:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2023-10-08T07:07:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2023-10-08T07:07:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2023-10-08T07:07:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 84 root NOFD /proc/84/fd (opendir: Permission denied) 2023-10-08T07:07:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:tpm_dev_w 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2023-10-08T07:07:50.806 INFO:tasks.workunit.client.0.smithi017.stdout:tpm_dev_w 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2023-10-08T07:07:50.807 INFO:tasks.workunit.client.0.smithi017.stdout:tpm_dev_w 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2023-10-08T07:07:50.807 INFO:tasks.workunit.client.0.smithi017.stdout:tpm_dev_w 87 root NOFD /proc/87/fd (opendir: Permission denied) 2023-10-08T07:07:50.807 INFO:tasks.workunit.client.0.smithi017.stdout:md 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2023-10-08T07:07:50.807 INFO:tasks.workunit.client.0.smithi017.stdout:md 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2023-10-08T07:07:50.807 INFO:tasks.workunit.client.0.smithi017.stdout:md 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2023-10-08T07:07:50.807 INFO:tasks.workunit.client.0.smithi017.stdout:md 88 root NOFD /proc/88/fd (opendir: Permission denied) 2023-10-08T07:07:50.807 INFO:tasks.workunit.client.0.smithi017.stdout:edac-poll 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2023-10-08T07:07:50.807 INFO:tasks.workunit.client.0.smithi017.stdout:edac-poll 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2023-10-08T07:07:50.807 INFO:tasks.workunit.client.0.smithi017.stdout:edac-poll 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2023-10-08T07:07:50.807 INFO:tasks.workunit.client.0.smithi017.stdout:edac-poll 89 root NOFD /proc/89/fd (opendir: Permission denied) 2023-10-08T07:07:50.807 INFO:tasks.workunit.client.0.smithi017.stdout:watchdogd 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2023-10-08T07:07:50.808 INFO:tasks.workunit.client.0.smithi017.stdout:watchdogd 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2023-10-08T07:07:50.808 INFO:tasks.workunit.client.0.smithi017.stdout:watchdogd 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2023-10-08T07:07:50.808 INFO:tasks.workunit.client.0.smithi017.stdout:watchdogd 90 root NOFD /proc/90/fd (opendir: Permission denied) 2023-10-08T07:07:50.808 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 91 root cwd unknown /proc/91/cwd (readlink: Permission denied) 2023-10-08T07:07:50.808 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 91 root rtd unknown /proc/91/root (readlink: Permission denied) 2023-10-08T07:07:50.808 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 91 root txt unknown /proc/91/exe (readlink: Permission denied) 2023-10-08T07:07:50.808 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 91 root NOFD /proc/91/fd (opendir: Permission denied) 2023-10-08T07:07:50.808 INFO:tasks.workunit.client.0.smithi017.stdout:kswapd0 124 root cwd unknown /proc/124/cwd (readlink: Permission denied) 2023-10-08T07:07:50.808 INFO:tasks.workunit.client.0.smithi017.stdout:kswapd0 124 root rtd unknown /proc/124/root (readlink: Permission denied) 2023-10-08T07:07:50.808 INFO:tasks.workunit.client.0.smithi017.stdout:kswapd0 124 root txt unknown /proc/124/exe (readlink: Permission denied) 2023-10-08T07:07:50.808 INFO:tasks.workunit.client.0.smithi017.stdout:kswapd0 124 root NOFD /proc/124/fd (opendir: Permission denied) 2023-10-08T07:07:50.808 INFO:tasks.workunit.client.0.smithi017.stdout:kthrotld 226 root cwd unknown /proc/226/cwd (readlink: Permission denied) 2023-10-08T07:07:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:kthrotld 226 root rtd unknown /proc/226/root (readlink: Permission denied) 2023-10-08T07:07:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:kthrotld 226 root txt unknown /proc/226/exe (readlink: Permission denied) 2023-10-08T07:07:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:kthrotld 226 root NOFD /proc/226/fd (opendir: Permission denied) 2023-10-08T07:07:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:acpi_ther 227 root cwd unknown /proc/227/cwd (readlink: Permission denied) 2023-10-08T07:07:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:acpi_ther 227 root rtd unknown /proc/227/root (readlink: Permission denied) 2023-10-08T07:07:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:acpi_ther 227 root txt unknown /proc/227/exe (readlink: Permission denied) 2023-10-08T07:07:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:acpi_ther 227 root NOFD /proc/227/fd (opendir: Permission denied) 2023-10-08T07:07:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:kmpath_rd 229 root cwd unknown /proc/229/cwd (readlink: Permission denied) 2023-10-08T07:07:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:kmpath_rd 229 root rtd unknown /proc/229/root (readlink: Permission denied) 2023-10-08T07:07:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:kmpath_rd 229 root txt unknown /proc/229/exe (readlink: Permission denied) 2023-10-08T07:07:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:kmpath_rd 229 root NOFD /proc/229/fd (opendir: Permission denied) 2023-10-08T07:07:50.809 INFO:tasks.workunit.client.0.smithi017.stdout:kaluad 230 root cwd unknown /proc/230/cwd (readlink: Permission denied) 2023-10-08T07:07:50.810 INFO:tasks.workunit.client.0.smithi017.stdout:kaluad 230 root rtd unknown /proc/230/root (readlink: Permission denied) 2023-10-08T07:07:50.810 INFO:tasks.workunit.client.0.smithi017.stdout:kaluad 230 root txt unknown /proc/230/exe (readlink: Permission denied) 2023-10-08T07:07:50.810 INFO:tasks.workunit.client.0.smithi017.stdout:kaluad 230 root NOFD /proc/230/fd (opendir: Permission denied) 2023-10-08T07:07:50.810 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 232 root cwd unknown /proc/232/cwd (readlink: Permission denied) 2023-10-08T07:07:50.810 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 232 root rtd unknown /proc/232/root (readlink: Permission denied) 2023-10-08T07:07:50.810 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 232 root txt unknown /proc/232/exe (readlink: Permission denied) 2023-10-08T07:07:50.810 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 232 root NOFD /proc/232/fd (opendir: Permission denied) 2023-10-08T07:07:50.810 INFO:tasks.workunit.client.0.smithi017.stdout:ipv6_addr 233 root cwd unknown /proc/233/cwd (readlink: Permission denied) 2023-10-08T07:07:50.810 INFO:tasks.workunit.client.0.smithi017.stdout:ipv6_addr 233 root rtd unknown /proc/233/root (readlink: Permission denied) 2023-10-08T07:07:50.810 INFO:tasks.workunit.client.0.smithi017.stdout:ipv6_addr 233 root txt unknown /proc/233/exe (readlink: Permission denied) 2023-10-08T07:07:50.810 INFO:tasks.workunit.client.0.smithi017.stdout:ipv6_addr 233 root NOFD /proc/233/fd (opendir: Permission denied) 2023-10-08T07:07:50.810 INFO:tasks.workunit.client.0.smithi017.stdout:kstrp 234 root cwd unknown /proc/234/cwd (readlink: Permission denied) 2023-10-08T07:07:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:kstrp 234 root rtd unknown /proc/234/root (readlink: Permission denied) 2023-10-08T07:07:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:kstrp 234 root txt unknown /proc/234/exe (readlink: Permission denied) 2023-10-08T07:07:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:kstrp 234 root NOFD /proc/234/fd (opendir: Permission denied) 2023-10-08T07:07:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 293 root cwd unknown /proc/293/cwd (readlink: Permission denied) 2023-10-08T07:07:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 293 root rtd unknown /proc/293/root (readlink: Permission denied) 2023-10-08T07:07:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 293 root txt unknown /proc/293/exe (readlink: Permission denied) 2023-10-08T07:07:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 293 root NOFD /proc/293/fd (opendir: Permission denied) 2023-10-08T07:07:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 315 root cwd unknown /proc/315/cwd (readlink: Permission denied) 2023-10-08T07:07:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 315 root rtd unknown /proc/315/root (readlink: Permission denied) 2023-10-08T07:07:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 315 root txt unknown /proc/315/exe (readlink: Permission denied) 2023-10-08T07:07:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 315 root NOFD /proc/315/fd (opendir: Permission denied) 2023-10-08T07:07:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 321 root cwd unknown /proc/321/cwd (readlink: Permission denied) 2023-10-08T07:07:50.812 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 321 root rtd unknown /proc/321/root (readlink: Permission denied) 2023-10-08T07:07:50.812 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 321 root txt unknown /proc/321/exe (readlink: Permission denied) 2023-10-08T07:07:50.812 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 321 root NOFD /proc/321/fd (opendir: Permission denied) 2023-10-08T07:07:50.812 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 349 root cwd unknown /proc/349/cwd (readlink: Permission denied) 2023-10-08T07:07:50.812 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 349 root rtd unknown /proc/349/root (readlink: Permission denied) 2023-10-08T07:07:50.812 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 349 root txt unknown /proc/349/exe (readlink: Permission denied) 2023-10-08T07:07:50.812 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 349 root NOFD /proc/349/fd (opendir: Permission denied) 2023-10-08T07:07:50.812 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 352 root cwd unknown /proc/352/cwd (readlink: Permission denied) 2023-10-08T07:07:50.812 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 352 root rtd unknown /proc/352/root (readlink: Permission denied) 2023-10-08T07:07:50.812 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 352 root txt unknown /proc/352/exe (readlink: Permission denied) 2023-10-08T07:07:50.812 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 352 root NOFD /proc/352/fd (opendir: Permission denied) 2023-10-08T07:07:50.813 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 354 root cwd unknown /proc/354/cwd (readlink: Permission denied) 2023-10-08T07:07:50.813 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 354 root rtd unknown /proc/354/root (readlink: Permission denied) 2023-10-08T07:07:50.813 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 354 root txt unknown /proc/354/exe (readlink: Permission denied) 2023-10-08T07:07:50.813 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 354 root NOFD /proc/354/fd (opendir: Permission denied) 2023-10-08T07:07:50.813 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 374 root cwd unknown /proc/374/cwd (readlink: Permission denied) 2023-10-08T07:07:50.813 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 374 root rtd unknown /proc/374/root (readlink: Permission denied) 2023-10-08T07:07:50.813 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 374 root txt unknown /proc/374/exe (readlink: Permission denied) 2023-10-08T07:07:50.813 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 374 root NOFD /proc/374/fd (opendir: Permission denied) 2023-10-08T07:07:50.813 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 378 root cwd unknown /proc/378/cwd (readlink: Permission denied) 2023-10-08T07:07:50.813 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 378 root rtd unknown /proc/378/root (readlink: Permission denied) 2023-10-08T07:07:50.813 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 378 root txt unknown /proc/378/exe (readlink: Permission denied) 2023-10-08T07:07:50.813 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 378 root NOFD /proc/378/fd (opendir: Permission denied) 2023-10-08T07:07:50.814 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 443 root cwd unknown /proc/443/cwd (readlink: Permission denied) 2023-10-08T07:07:50.814 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 443 root rtd unknown /proc/443/root (readlink: Permission denied) 2023-10-08T07:07:50.814 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 443 root txt unknown /proc/443/exe (readlink: Permission denied) 2023-10-08T07:07:50.814 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 443 root NOFD /proc/443/fd (opendir: Permission denied) 2023-10-08T07:07:50.814 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 493 root cwd unknown /proc/493/cwd (readlink: Permission denied) 2023-10-08T07:07:50.814 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 493 root rtd unknown /proc/493/root (readlink: Permission denied) 2023-10-08T07:07:50.814 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 493 root txt unknown /proc/493/exe (readlink: Permission denied) 2023-10-08T07:07:50.814 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 493 root NOFD /proc/493/fd (opendir: Permission denied) 2023-10-08T07:07:50.814 INFO:tasks.workunit.client.0.smithi017.stdout:nvme-wq 494 root cwd unknown /proc/494/cwd (readlink: Permission denied) 2023-10-08T07:07:50.814 INFO:tasks.workunit.client.0.smithi017.stdout:nvme-wq 494 root rtd unknown /proc/494/root (readlink: Permission denied) 2023-10-08T07:07:50.814 INFO:tasks.workunit.client.0.smithi017.stdout:nvme-wq 494 root txt unknown /proc/494/exe (readlink: Permission denied) 2023-10-08T07:07:50.815 INFO:tasks.workunit.client.0.smithi017.stdout:nvme-wq 494 root NOFD /proc/494/fd (opendir: Permission denied) 2023-10-08T07:07:50.815 INFO:tasks.workunit.client.0.smithi017.stdout:nvme-rese 495 root cwd unknown /proc/495/cwd (readlink: Permission denied) 2023-10-08T07:07:50.815 INFO:tasks.workunit.client.0.smithi017.stdout:nvme-rese 495 root rtd unknown /proc/495/root (readlink: Permission denied) 2023-10-08T07:07:50.815 INFO:tasks.workunit.client.0.smithi017.stdout:nvme-rese 495 root txt unknown /proc/495/exe (readlink: Permission denied) 2023-10-08T07:07:50.815 INFO:tasks.workunit.client.0.smithi017.stdout:nvme-rese 495 root NOFD /proc/495/fd (opendir: Permission denied) 2023-10-08T07:07:50.815 INFO:tasks.workunit.client.0.smithi017.stdout:nvme-dele 496 root cwd unknown /proc/496/cwd (readlink: Permission denied) 2023-10-08T07:07:50.815 INFO:tasks.workunit.client.0.smithi017.stdout:nvme-dele 496 root rtd unknown /proc/496/root (readlink: Permission denied) 2023-10-08T07:07:50.815 INFO:tasks.workunit.client.0.smithi017.stdout:nvme-dele 496 root txt unknown /proc/496/exe (readlink: Permission denied) 2023-10-08T07:07:50.815 INFO:tasks.workunit.client.0.smithi017.stdout:nvme-dele 496 root NOFD /proc/496/fd (opendir: Permission denied) 2023-10-08T07:07:50.815 INFO:tasks.workunit.client.0.smithi017.stdout:ata_sff 497 root cwd unknown /proc/497/cwd (readlink: Permission denied) 2023-10-08T07:07:50.815 INFO:tasks.workunit.client.0.smithi017.stdout:ata_sff 497 root rtd unknown /proc/497/root (readlink: Permission denied) 2023-10-08T07:07:50.815 INFO:tasks.workunit.client.0.smithi017.stdout:ata_sff 497 root txt unknown /proc/497/exe (readlink: Permission denied) 2023-10-08T07:07:50.816 INFO:tasks.workunit.client.0.smithi017.stdout:ata_sff 497 root NOFD /proc/497/fd (opendir: Permission denied) 2023-10-08T07:07:50.816 INFO:tasks.workunit.client.0.smithi017.stdout:ixgbe 508 root cwd unknown /proc/508/cwd (readlink: Permission denied) 2023-10-08T07:07:50.816 INFO:tasks.workunit.client.0.smithi017.stdout:ixgbe 508 root rtd unknown /proc/508/root (readlink: Permission denied) 2023-10-08T07:07:50.816 INFO:tasks.workunit.client.0.smithi017.stdout:ixgbe 508 root txt unknown /proc/508/exe (readlink: Permission denied) 2023-10-08T07:07:50.816 INFO:tasks.workunit.client.0.smithi017.stdout:ixgbe 508 root NOFD /proc/508/fd (opendir: Permission denied) 2023-10-08T07:07:50.816 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_0 510 root cwd unknown /proc/510/cwd (readlink: Permission denied) 2023-10-08T07:07:50.816 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_0 510 root rtd unknown /proc/510/root (readlink: Permission denied) 2023-10-08T07:07:50.816 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_0 510 root txt unknown /proc/510/exe (readlink: Permission denied) 2023-10-08T07:07:50.816 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_0 510 root NOFD /proc/510/fd (opendir: Permission denied) 2023-10-08T07:07:50.816 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 511 root cwd unknown /proc/511/cwd (readlink: Permission denied) 2023-10-08T07:07:50.816 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 511 root rtd unknown /proc/511/root (readlink: Permission denied) 2023-10-08T07:07:50.816 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 511 root txt unknown /proc/511/exe (readlink: Permission denied) 2023-10-08T07:07:50.817 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 511 root NOFD /proc/511/fd (opendir: Permission denied) 2023-10-08T07:07:50.817 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_1 512 root cwd unknown /proc/512/cwd (readlink: Permission denied) 2023-10-08T07:07:50.817 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_1 512 root rtd unknown /proc/512/root (readlink: Permission denied) 2023-10-08T07:07:50.817 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_1 512 root txt unknown /proc/512/exe (readlink: Permission denied) 2023-10-08T07:07:50.817 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_1 512 root NOFD /proc/512/fd (opendir: Permission denied) 2023-10-08T07:07:50.817 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 513 root cwd unknown /proc/513/cwd (readlink: Permission denied) 2023-10-08T07:07:50.817 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 513 root rtd unknown /proc/513/root (readlink: Permission denied) 2023-10-08T07:07:50.817 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 513 root txt unknown /proc/513/exe (readlink: Permission denied) 2023-10-08T07:07:50.817 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 513 root NOFD /proc/513/fd (opendir: Permission denied) 2023-10-08T07:07:50.817 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_2 516 root cwd unknown /proc/516/cwd (readlink: Permission denied) 2023-10-08T07:07:50.817 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_2 516 root rtd unknown /proc/516/root (readlink: Permission denied) 2023-10-08T07:07:50.818 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_2 516 root txt unknown /proc/516/exe (readlink: Permission denied) 2023-10-08T07:07:50.818 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_2 516 root NOFD /proc/516/fd (opendir: Permission denied) 2023-10-08T07:07:50.818 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 517 root cwd unknown /proc/517/cwd (readlink: Permission denied) 2023-10-08T07:07:50.818 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 517 root rtd unknown /proc/517/root (readlink: Permission denied) 2023-10-08T07:07:50.818 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 517 root txt unknown /proc/517/exe (readlink: Permission denied) 2023-10-08T07:07:50.818 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 517 root NOFD /proc/517/fd (opendir: Permission denied) 2023-10-08T07:07:50.818 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_3 518 root cwd unknown /proc/518/cwd (readlink: Permission denied) 2023-10-08T07:07:50.818 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_3 518 root rtd unknown /proc/518/root (readlink: Permission denied) 2023-10-08T07:07:50.818 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_3 518 root txt unknown /proc/518/exe (readlink: Permission denied) 2023-10-08T07:07:50.818 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_3 518 root NOFD /proc/518/fd (opendir: Permission denied) 2023-10-08T07:07:50.818 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 519 root cwd unknown /proc/519/cwd (readlink: Permission denied) 2023-10-08T07:07:50.818 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 519 root rtd unknown /proc/519/root (readlink: Permission denied) 2023-10-08T07:07:50.819 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 519 root txt unknown /proc/519/exe (readlink: Permission denied) 2023-10-08T07:07:50.819 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 519 root NOFD /proc/519/fd (opendir: Permission denied) 2023-10-08T07:07:50.819 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_4 520 root cwd unknown /proc/520/cwd (readlink: Permission denied) 2023-10-08T07:07:50.819 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_4 520 root rtd unknown /proc/520/root (readlink: Permission denied) 2023-10-08T07:07:50.819 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_4 520 root txt unknown /proc/520/exe (readlink: Permission denied) 2023-10-08T07:07:50.819 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_4 520 root NOFD /proc/520/fd (opendir: Permission denied) 2023-10-08T07:07:50.819 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 521 root cwd unknown /proc/521/cwd (readlink: Permission denied) 2023-10-08T07:07:50.819 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 521 root rtd unknown /proc/521/root (readlink: Permission denied) 2023-10-08T07:07:50.819 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 521 root txt unknown /proc/521/exe (readlink: Permission denied) 2023-10-08T07:07:50.819 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 521 root NOFD /proc/521/fd (opendir: Permission denied) 2023-10-08T07:07:50.819 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_5 522 root cwd unknown /proc/522/cwd (readlink: Permission denied) 2023-10-08T07:07:50.819 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_5 522 root rtd unknown /proc/522/root (readlink: Permission denied) 2023-10-08T07:07:50.820 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_5 522 root txt unknown /proc/522/exe (readlink: Permission denied) 2023-10-08T07:07:50.820 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_5 522 root NOFD /proc/522/fd (opendir: Permission denied) 2023-10-08T07:07:50.820 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 523 root cwd unknown /proc/523/cwd (readlink: Permission denied) 2023-10-08T07:07:50.820 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 523 root rtd unknown /proc/523/root (readlink: Permission denied) 2023-10-08T07:07:50.820 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 523 root txt unknown /proc/523/exe (readlink: Permission denied) 2023-10-08T07:07:50.820 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 523 root NOFD /proc/523/fd (opendir: Permission denied) 2023-10-08T07:07:50.820 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_6 524 root cwd unknown /proc/524/cwd (readlink: Permission denied) 2023-10-08T07:07:50.820 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_6 524 root rtd unknown /proc/524/root (readlink: Permission denied) 2023-10-08T07:07:50.820 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_6 524 root txt unknown /proc/524/exe (readlink: Permission denied) 2023-10-08T07:07:50.820 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_6 524 root NOFD /proc/524/fd (opendir: Permission denied) 2023-10-08T07:07:50.820 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 525 root cwd unknown /proc/525/cwd (readlink: Permission denied) 2023-10-08T07:07:50.820 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 525 root rtd unknown /proc/525/root (readlink: Permission denied) 2023-10-08T07:07:50.821 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 525 root txt unknown /proc/525/exe (readlink: Permission denied) 2023-10-08T07:07:50.821 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 525 root NOFD /proc/525/fd (opendir: Permission denied) 2023-10-08T07:07:50.821 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_7 526 root cwd unknown /proc/526/cwd (readlink: Permission denied) 2023-10-08T07:07:50.821 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_7 526 root rtd unknown /proc/526/root (readlink: Permission denied) 2023-10-08T07:07:50.821 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_7 526 root txt unknown /proc/526/exe (readlink: Permission denied) 2023-10-08T07:07:50.821 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_7 526 root NOFD /proc/526/fd (opendir: Permission denied) 2023-10-08T07:07:50.821 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 527 root cwd unknown /proc/527/cwd (readlink: Permission denied) 2023-10-08T07:07:50.821 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 527 root rtd unknown /proc/527/root (readlink: Permission denied) 2023-10-08T07:07:50.821 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 527 root txt unknown /proc/527/exe (readlink: Permission denied) 2023-10-08T07:07:50.821 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 527 root NOFD /proc/527/fd (opendir: Permission denied) 2023-10-08T07:07:50.821 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_8 528 root cwd unknown /proc/528/cwd (readlink: Permission denied) 2023-10-08T07:07:50.822 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_8 528 root rtd unknown /proc/528/root (readlink: Permission denied) 2023-10-08T07:07:50.822 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_8 528 root txt unknown /proc/528/exe (readlink: Permission denied) 2023-10-08T07:07:50.822 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_8 528 root NOFD /proc/528/fd (opendir: Permission denied) 2023-10-08T07:07:50.822 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 529 root cwd unknown /proc/529/cwd (readlink: Permission denied) 2023-10-08T07:07:50.822 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 529 root rtd unknown /proc/529/root (readlink: Permission denied) 2023-10-08T07:07:50.822 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 529 root txt unknown /proc/529/exe (readlink: Permission denied) 2023-10-08T07:07:50.822 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 529 root NOFD /proc/529/fd (opendir: Permission denied) 2023-10-08T07:07:50.822 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_9 530 root cwd unknown /proc/530/cwd (readlink: Permission denied) 2023-10-08T07:07:50.822 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_9 530 root rtd unknown /proc/530/root (readlink: Permission denied) 2023-10-08T07:07:50.822 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_9 530 root txt unknown /proc/530/exe (readlink: Permission denied) 2023-10-08T07:07:50.822 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_eh_9 530 root NOFD /proc/530/fd (opendir: Permission denied) 2023-10-08T07:07:50.823 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 531 root cwd unknown /proc/531/cwd (readlink: Permission denied) 2023-10-08T07:07:50.823 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 531 root rtd unknown /proc/531/root (readlink: Permission denied) 2023-10-08T07:07:50.823 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 531 root txt unknown /proc/531/exe (readlink: Permission denied) 2023-10-08T07:07:50.823 INFO:tasks.workunit.client.0.smithi017.stdout:scsi_tmf_ 531 root NOFD /proc/531/fd (opendir: Permission denied) 2023-10-08T07:07:50.823 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 533 root cwd unknown /proc/533/cwd (readlink: Permission denied) 2023-10-08T07:07:50.823 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 533 root rtd unknown /proc/533/root (readlink: Permission denied) 2023-10-08T07:07:50.823 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 533 root txt unknown /proc/533/exe (readlink: Permission denied) 2023-10-08T07:07:50.823 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 533 root NOFD /proc/533/fd (opendir: Permission denied) 2023-10-08T07:07:50.823 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 560 root cwd unknown /proc/560/cwd (readlink: Permission denied) 2023-10-08T07:07:50.823 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 560 root rtd unknown /proc/560/root (readlink: Permission denied) 2023-10-08T07:07:50.823 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 560 root txt unknown /proc/560/exe (readlink: Permission denied) 2023-10-08T07:07:50.823 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 560 root NOFD /proc/560/fd (opendir: Permission denied) 2023-10-08T07:07:50.824 INFO:tasks.workunit.client.0.smithi017.stdout:jbd2/sda1 562 root cwd unknown /proc/562/cwd (readlink: Permission denied) 2023-10-08T07:07:50.824 INFO:tasks.workunit.client.0.smithi017.stdout:jbd2/sda1 562 root rtd unknown /proc/562/root (readlink: Permission denied) 2023-10-08T07:07:50.824 INFO:tasks.workunit.client.0.smithi017.stdout:jbd2/sda1 562 root txt unknown /proc/562/exe (readlink: Permission denied) 2023-10-08T07:07:50.824 INFO:tasks.workunit.client.0.smithi017.stdout:jbd2/sda1 562 root NOFD /proc/562/fd (opendir: Permission denied) 2023-10-08T07:07:50.824 INFO:tasks.workunit.client.0.smithi017.stdout:ext4-rsv- 563 root cwd unknown /proc/563/cwd (readlink: Permission denied) 2023-10-08T07:07:50.824 INFO:tasks.workunit.client.0.smithi017.stdout:ext4-rsv- 563 root rtd unknown /proc/563/root (readlink: Permission denied) 2023-10-08T07:07:50.824 INFO:tasks.workunit.client.0.smithi017.stdout:ext4-rsv- 563 root txt unknown /proc/563/exe (readlink: Permission denied) 2023-10-08T07:07:50.824 INFO:tasks.workunit.client.0.smithi017.stdout:ext4-rsv- 563 root NOFD /proc/563/fd (opendir: Permission denied) 2023-10-08T07:07:50.824 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 634 root cwd unknown /proc/634/cwd (readlink: Permission denied) 2023-10-08T07:07:50.824 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 634 root rtd unknown /proc/634/root (readlink: Permission denied) 2023-10-08T07:07:50.824 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 634 root txt unknown /proc/634/exe (readlink: Permission denied) 2023-10-08T07:07:50.825 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 634 root NOFD /proc/634/fd (opendir: Permission denied) 2023-10-08T07:07:50.825 INFO:tasks.workunit.client.0.smithi017.stdout:systemd-j 659 root cwd unknown /proc/659/cwd (readlink: Permission denied) 2023-10-08T07:07:50.825 INFO:tasks.workunit.client.0.smithi017.stdout:systemd-j 659 root rtd unknown /proc/659/root (readlink: Permission denied) 2023-10-08T07:07:50.825 INFO:tasks.workunit.client.0.smithi017.stdout:systemd-j 659 root txt unknown /proc/659/exe (readlink: Permission denied) 2023-10-08T07:07:50.825 INFO:tasks.workunit.client.0.smithi017.stdout:systemd-j 659 root NOFD /proc/659/fd (opendir: Permission denied) 2023-10-08T07:07:50.825 INFO:tasks.workunit.client.0.smithi017.stdout:ext4lazyi 674 root cwd unknown /proc/674/cwd (readlink: Permission denied) 2023-10-08T07:07:50.825 INFO:tasks.workunit.client.0.smithi017.stdout:ext4lazyi 674 root rtd unknown /proc/674/root (readlink: Permission denied) 2023-10-08T07:07:50.825 INFO:tasks.workunit.client.0.smithi017.stdout:ext4lazyi 674 root txt unknown /proc/674/exe (readlink: Permission denied) 2023-10-08T07:07:50.825 INFO:tasks.workunit.client.0.smithi017.stdout:ext4lazyi 674 root NOFD /proc/674/fd (opendir: Permission denied) 2023-10-08T07:07:50.825 INFO:tasks.workunit.client.0.smithi017.stdout:systemd-u 703 root cwd unknown /proc/703/cwd (readlink: Permission denied) 2023-10-08T07:07:50.825 INFO:tasks.workunit.client.0.smithi017.stdout:systemd-u 703 root rtd unknown /proc/703/root (readlink: Permission denied) 2023-10-08T07:07:50.825 INFO:tasks.workunit.client.0.smithi017.stdout:systemd-u 703 root txt unknown /proc/703/exe (readlink: Permission denied) 2023-10-08T07:07:50.826 INFO:tasks.workunit.client.0.smithi017.stdout:systemd-u 703 root NOFD /proc/703/fd (opendir: Permission denied) 2023-10-08T07:07:50.826 INFO:tasks.workunit.client.0.smithi017.stdout:rpcbind 724 rpc cwd unknown /proc/724/cwd (readlink: Permission denied) 2023-10-08T07:07:50.826 INFO:tasks.workunit.client.0.smithi017.stdout:rpcbind 724 rpc rtd unknown /proc/724/root (readlink: Permission denied) 2023-10-08T07:07:50.826 INFO:tasks.workunit.client.0.smithi017.stdout:rpcbind 724 rpc txt unknown /proc/724/exe (readlink: Permission denied) 2023-10-08T07:07:50.826 INFO:tasks.workunit.client.0.smithi017.stdout:rpcbind 724 rpc NOFD /proc/724/fd (opendir: Permission denied) 2023-10-08T07:07:50.826 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 735 root cwd unknown /proc/735/cwd (readlink: Permission denied) 2023-10-08T07:07:50.826 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 735 root rtd unknown /proc/735/root (readlink: Permission denied) 2023-10-08T07:07:50.827 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 735 root txt unknown /proc/735/exe (readlink: Permission denied) 2023-10-08T07:07:50.827 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 735 root NOFD /proc/735/fd (opendir: Permission denied) 2023-10-08T07:07:50.827 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 736 root cwd unknown /proc/736/cwd (readlink: Permission denied) 2023-10-08T07:07:50.827 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 736 root rtd unknown /proc/736/root (readlink: Permission denied) 2023-10-08T07:07:50.827 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 736 root txt unknown /proc/736/exe (readlink: Permission denied) 2023-10-08T07:07:50.827 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/6 736 root NOFD /proc/736/fd (opendir: Permission denied) 2023-10-08T07:07:50.827 INFO:tasks.workunit.client.0.smithi017.stdout:auditd 739 root cwd unknown /proc/739/cwd (readlink: Permission denied) 2023-10-08T07:07:50.827 INFO:tasks.workunit.client.0.smithi017.stdout:auditd 739 root rtd unknown /proc/739/root (readlink: Permission denied) 2023-10-08T07:07:50.827 INFO:tasks.workunit.client.0.smithi017.stdout:auditd 739 root txt unknown /proc/739/exe (readlink: Permission denied) 2023-10-08T07:07:50.827 INFO:tasks.workunit.client.0.smithi017.stdout:auditd 739 root NOFD /proc/739/fd (opendir: Permission denied) 2023-10-08T07:07:50.827 INFO:tasks.workunit.client.0.smithi017.stdout:auditd 739 740 auditd root cwd unknown /proc/739/task/740/cwd (readlink: Permission denied) 2023-10-08T07:07:50.828 INFO:tasks.workunit.client.0.smithi017.stdout:auditd 739 740 auditd root rtd unknown /proc/739/task/740/root (readlink: Permission denied) 2023-10-08T07:07:50.828 INFO:tasks.workunit.client.0.smithi017.stdout:auditd 739 740 auditd root txt unknown /proc/739/task/740/exe (readlink: Permission denied) 2023-10-08T07:07:50.828 INFO:tasks.workunit.client.0.smithi017.stdout:auditd 739 740 auditd root NOFD /proc/739/task/740/fd (opendir: Permission denied) 2023-10-08T07:07:50.828 INFO:tasks.workunit.client.0.smithi017.stdout:auditd 739 751 auditd root cwd unknown /proc/739/task/751/cwd (readlink: Permission denied) 2023-10-08T07:07:50.828 INFO:tasks.workunit.client.0.smithi017.stdout:auditd 739 751 auditd root rtd unknown /proc/739/task/751/root (readlink: Permission denied) 2023-10-08T07:07:50.828 INFO:tasks.workunit.client.0.smithi017.stdout:auditd 739 751 auditd root txt unknown /proc/739/task/751/exe (readlink: Permission denied) 2023-10-08T07:07:50.828 INFO:tasks.workunit.client.0.smithi017.stdout:auditd 739 751 auditd root NOFD /proc/739/task/751/fd (opendir: Permission denied) 2023-10-08T07:07:50.828 INFO:tasks.workunit.client.0.smithi017.stdout:sedispatc 749 root cwd unknown /proc/749/cwd (readlink: Permission denied) 2023-10-08T07:07:50.828 INFO:tasks.workunit.client.0.smithi017.stdout:sedispatc 749 root rtd unknown /proc/749/root (readlink: Permission denied) 2023-10-08T07:07:50.828 INFO:tasks.workunit.client.0.smithi017.stdout:sedispatc 749 root txt unknown /proc/749/exe (readlink: Permission denied) 2023-10-08T07:07:50.828 INFO:tasks.workunit.client.0.smithi017.stdout:sedispatc 749 root NOFD /proc/749/fd (opendir: Permission denied) 2023-10-08T07:07:50.828 INFO:tasks.workunit.client.0.smithi017.stdout:rpciod 755 root cwd unknown /proc/755/cwd (readlink: Permission denied) 2023-10-08T07:07:50.829 INFO:tasks.workunit.client.0.smithi017.stdout:rpciod 755 root rtd unknown /proc/755/root (readlink: Permission denied) 2023-10-08T07:07:50.829 INFO:tasks.workunit.client.0.smithi017.stdout:rpciod 755 root txt unknown /proc/755/exe (readlink: Permission denied) 2023-10-08T07:07:50.829 INFO:tasks.workunit.client.0.smithi017.stdout:rpciod 755 root NOFD /proc/755/fd (opendir: Permission denied) 2023-10-08T07:07:50.829 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 756 root cwd unknown /proc/756/cwd (readlink: Permission denied) 2023-10-08T07:07:50.829 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 756 root rtd unknown /proc/756/root (readlink: Permission denied) 2023-10-08T07:07:50.829 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 756 root txt unknown /proc/756/exe (readlink: Permission denied) 2023-10-08T07:07:50.829 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 756 root NOFD /proc/756/fd (opendir: Permission denied) 2023-10-08T07:07:50.829 INFO:tasks.workunit.client.0.smithi017.stdout:xprtiod 757 root cwd unknown /proc/757/cwd (readlink: Permission denied) 2023-10-08T07:07:50.829 INFO:tasks.workunit.client.0.smithi017.stdout:xprtiod 757 root rtd unknown /proc/757/root (readlink: Permission denied) 2023-10-08T07:07:50.829 INFO:tasks.workunit.client.0.smithi017.stdout:xprtiod 757 root txt unknown /proc/757/exe (readlink: Permission denied) 2023-10-08T07:07:50.829 INFO:tasks.workunit.client.0.smithi017.stdout:xprtiod 757 root NOFD /proc/757/fd (opendir: Permission denied) 2023-10-08T07:07:50.829 INFO:tasks.workunit.client.0.smithi017.stdout:smartd 779 root cwd unknown /proc/779/cwd (readlink: Permission denied) 2023-10-08T07:07:50.830 INFO:tasks.workunit.client.0.smithi017.stdout:smartd 779 root rtd unknown /proc/779/root (readlink: Permission denied) 2023-10-08T07:07:50.830 INFO:tasks.workunit.client.0.smithi017.stdout:smartd 779 root txt unknown /proc/779/exe (readlink: Permission denied) 2023-10-08T07:07:50.830 INFO:tasks.workunit.client.0.smithi017.stdout:smartd 779 root NOFD /proc/779/fd (opendir: Permission denied) 2023-10-08T07:07:50.830 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 polkitd cwd unknown /proc/781/cwd (readlink: Permission denied) 2023-10-08T07:07:50.830 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 polkitd rtd unknown /proc/781/root (readlink: Permission denied) 2023-10-08T07:07:50.830 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 polkitd txt unknown /proc/781/exe (readlink: Permission denied) 2023-10-08T07:07:50.830 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 polkitd NOFD /proc/781/fd (opendir: Permission denied) 2023-10-08T07:07:50.830 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 862 gmain polkitd cwd unknown /proc/781/task/862/cwd (readlink: Permission denied) 2023-10-08T07:07:50.830 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 862 gmain polkitd rtd unknown /proc/781/task/862/root (readlink: Permission denied) 2023-10-08T07:07:50.830 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 862 gmain polkitd txt unknown /proc/781/task/862/exe (readlink: Permission denied) 2023-10-08T07:07:50.830 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 862 gmain polkitd NOFD /proc/781/task/862/fd (opendir: Permission denied) 2023-10-08T07:07:50.831 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 863 gdbus polkitd cwd unknown /proc/781/task/863/cwd (readlink: Permission denied) 2023-10-08T07:07:50.831 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 863 gdbus polkitd rtd unknown /proc/781/task/863/root (readlink: Permission denied) 2023-10-08T07:07:50.831 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 863 gdbus polkitd txt unknown /proc/781/task/863/exe (readlink: Permission denied) 2023-10-08T07:07:50.831 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 863 gdbus polkitd NOFD /proc/781/task/863/fd (opendir: Permission denied) 2023-10-08T07:07:50.831 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 865 JS\x20Hel polkitd cwd unknown /proc/781/task/865/cwd (readlink: Permission denied) 2023-10-08T07:07:50.831 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 865 JS\x20Hel polkitd rtd unknown /proc/781/task/865/root (readlink: Permission denied) 2023-10-08T07:07:50.831 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 865 JS\x20Hel polkitd txt unknown /proc/781/task/865/exe (readlink: Permission denied) 2023-10-08T07:07:50.831 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 865 JS\x20Hel polkitd NOFD /proc/781/task/865/fd (opendir: Permission denied) 2023-10-08T07:07:50.831 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 866 JS\x20Hel polkitd cwd unknown /proc/781/task/866/cwd (readlink: Permission denied) 2023-10-08T07:07:50.831 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 866 JS\x20Hel polkitd rtd unknown /proc/781/task/866/root (readlink: Permission denied) 2023-10-08T07:07:50.831 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 866 JS\x20Hel polkitd txt unknown /proc/781/task/866/exe (readlink: Permission denied) 2023-10-08T07:07:50.832 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 866 JS\x20Hel polkitd NOFD /proc/781/task/866/fd (opendir: Permission denied) 2023-10-08T07:07:50.832 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 867 JS\x20Hel polkitd cwd unknown /proc/781/task/867/cwd (readlink: Permission denied) 2023-10-08T07:07:50.832 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 867 JS\x20Hel polkitd rtd unknown /proc/781/task/867/root (readlink: Permission denied) 2023-10-08T07:07:50.832 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 867 JS\x20Hel polkitd txt unknown /proc/781/task/867/exe (readlink: Permission denied) 2023-10-08T07:07:50.832 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 867 JS\x20Hel polkitd NOFD /proc/781/task/867/fd (opendir: Permission denied) 2023-10-08T07:07:50.832 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 868 JS\x20Hel polkitd cwd unknown /proc/781/task/868/cwd (readlink: Permission denied) 2023-10-08T07:07:50.832 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 868 JS\x20Hel polkitd rtd unknown /proc/781/task/868/root (readlink: Permission denied) 2023-10-08T07:07:50.832 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 868 JS\x20Hel polkitd txt unknown /proc/781/task/868/exe (readlink: Permission denied) 2023-10-08T07:07:50.832 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 868 JS\x20Hel polkitd NOFD /proc/781/task/868/fd (opendir: Permission denied) 2023-10-08T07:07:50.832 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 869 JS\x20Hel polkitd cwd unknown /proc/781/task/869/cwd (readlink: Permission denied) 2023-10-08T07:07:50.832 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 869 JS\x20Hel polkitd rtd unknown /proc/781/task/869/root (readlink: Permission denied) 2023-10-08T07:07:50.832 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 869 JS\x20Hel polkitd txt unknown /proc/781/task/869/exe (readlink: Permission denied) 2023-10-08T07:07:50.833 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 869 JS\x20Hel polkitd NOFD /proc/781/task/869/fd (opendir: Permission denied) 2023-10-08T07:07:50.833 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 870 JS\x20Hel polkitd cwd unknown /proc/781/task/870/cwd (readlink: Permission denied) 2023-10-08T07:07:50.833 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 870 JS\x20Hel polkitd rtd unknown /proc/781/task/870/root (readlink: Permission denied) 2023-10-08T07:07:50.833 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 870 JS\x20Hel polkitd txt unknown /proc/781/task/870/exe (readlink: Permission denied) 2023-10-08T07:07:50.833 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 870 JS\x20Hel polkitd NOFD /proc/781/task/870/fd (opendir: Permission denied) 2023-10-08T07:07:50.833 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 871 JS\x20Hel polkitd cwd unknown /proc/781/task/871/cwd (readlink: Permission denied) 2023-10-08T07:07:50.833 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 871 JS\x20Hel polkitd rtd unknown /proc/781/task/871/root (readlink: Permission denied) 2023-10-08T07:07:50.833 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 871 JS\x20Hel polkitd txt unknown /proc/781/task/871/exe (readlink: Permission denied) 2023-10-08T07:07:50.833 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 871 JS\x20Hel polkitd NOFD /proc/781/task/871/fd (opendir: Permission denied) 2023-10-08T07:07:50.833 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 872 JS\x20Hel polkitd cwd unknown /proc/781/task/872/cwd (readlink: Permission denied) 2023-10-08T07:07:50.833 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 872 JS\x20Hel polkitd rtd unknown /proc/781/task/872/root (readlink: Permission denied) 2023-10-08T07:07:50.833 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 872 JS\x20Hel polkitd txt unknown /proc/781/task/872/exe (readlink: Permission denied) 2023-10-08T07:07:50.834 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 872 JS\x20Hel polkitd NOFD /proc/781/task/872/fd (opendir: Permission denied) 2023-10-08T07:07:50.834 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 894 polkitd polkitd cwd unknown /proc/781/task/894/cwd (readlink: Permission denied) 2023-10-08T07:07:50.834 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 894 polkitd polkitd rtd unknown /proc/781/task/894/root (readlink: Permission denied) 2023-10-08T07:07:50.834 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 894 polkitd polkitd txt unknown /proc/781/task/894/exe (readlink: Permission denied) 2023-10-08T07:07:50.834 INFO:tasks.workunit.client.0.smithi017.stdout:polkitd 781 894 polkitd polkitd NOFD /proc/781/task/894/fd (opendir: Permission denied) 2023-10-08T07:07:50.834 INFO:tasks.workunit.client.0.smithi017.stdout:mcelog 784 root cwd unknown /proc/784/cwd (readlink: Permission denied) 2023-10-08T07:07:50.834 INFO:tasks.workunit.client.0.smithi017.stdout:mcelog 784 root rtd unknown /proc/784/root (readlink: Permission denied) 2023-10-08T07:07:50.834 INFO:tasks.workunit.client.0.smithi017.stdout:mcelog 784 root txt unknown /proc/784/exe (readlink: Permission denied) 2023-10-08T07:07:50.834 INFO:tasks.workunit.client.0.smithi017.stdout:mcelog 784 root NOFD /proc/784/fd (opendir: Permission denied) 2023-10-08T07:07:50.834 INFO:tasks.workunit.client.0.smithi017.stdout:avahi-dae 786 avahi cwd unknown /proc/786/cwd (readlink: Permission denied) 2023-10-08T07:07:50.834 INFO:tasks.workunit.client.0.smithi017.stdout:avahi-dae 786 avahi rtd unknown /proc/786/root (readlink: Permission denied) 2023-10-08T07:07:50.835 INFO:tasks.workunit.client.0.smithi017.stdout:avahi-dae 786 avahi txt unknown /proc/786/exe (readlink: Permission denied) 2023-10-08T07:07:50.835 INFO:tasks.workunit.client.0.smithi017.stdout:avahi-dae 786 avahi NOFD /proc/786/fd (opendir: Permission denied) 2023-10-08T07:07:50.835 INFO:tasks.workunit.client.0.smithi017.stdout:lsmd 789 libstoragemgmt cwd unknown /proc/789/cwd (readlink: Permission denied) 2023-10-08T07:07:50.835 INFO:tasks.workunit.client.0.smithi017.stdout:lsmd 789 libstoragemgmt rtd unknown /proc/789/root (readlink: Permission denied) 2023-10-08T07:07:50.835 INFO:tasks.workunit.client.0.smithi017.stdout:lsmd 789 libstoragemgmt txt unknown /proc/789/exe (readlink: Permission denied) 2023-10-08T07:07:50.835 INFO:tasks.workunit.client.0.smithi017.stdout:lsmd 789 libstoragemgmt NOFD /proc/789/fd (opendir: Permission denied) 2023-10-08T07:07:50.835 INFO:tasks.workunit.client.0.smithi017.stdout:irqbalanc 790 root cwd unknown /proc/790/cwd (readlink: Permission denied) 2023-10-08T07:07:50.835 INFO:tasks.workunit.client.0.smithi017.stdout:irqbalanc 790 root rtd unknown /proc/790/root (readlink: Permission denied) 2023-10-08T07:07:50.835 INFO:tasks.workunit.client.0.smithi017.stdout:irqbalanc 790 root txt unknown /proc/790/exe (readlink: Permission denied) 2023-10-08T07:07:50.835 INFO:tasks.workunit.client.0.smithi017.stdout:irqbalanc 790 root NOFD /proc/790/fd (opendir: Permission denied) 2023-10-08T07:07:50.835 INFO:tasks.workunit.client.0.smithi017.stdout:irqbalanc 790 852 gmain root cwd unknown /proc/790/task/852/cwd (readlink: Permission denied) 2023-10-08T07:07:50.835 INFO:tasks.workunit.client.0.smithi017.stdout:irqbalanc 790 852 gmain root rtd unknown /proc/790/task/852/root (readlink: Permission denied) 2023-10-08T07:07:50.836 INFO:tasks.workunit.client.0.smithi017.stdout:irqbalanc 790 852 gmain root txt unknown /proc/790/task/852/exe (readlink: Permission denied) 2023-10-08T07:07:50.836 INFO:tasks.workunit.client.0.smithi017.stdout:irqbalanc 790 852 gmain root NOFD /proc/790/task/852/fd (opendir: Permission denied) 2023-10-08T07:07:50.836 INFO:tasks.workunit.client.0.smithi017.stdout:sssd 792 root cwd unknown /proc/792/cwd (readlink: Permission denied) 2023-10-08T07:07:50.836 INFO:tasks.workunit.client.0.smithi017.stdout:sssd 792 root rtd unknown /proc/792/root (readlink: Permission denied) 2023-10-08T07:07:50.836 INFO:tasks.workunit.client.0.smithi017.stdout:sssd 792 root txt unknown /proc/792/exe (readlink: Permission denied) 2023-10-08T07:07:50.836 INFO:tasks.workunit.client.0.smithi017.stdout:sssd 792 root NOFD /proc/792/fd (opendir: Permission denied) 2023-10-08T07:07:50.836 INFO:tasks.workunit.client.0.smithi017.stdout:dbus-daem 794 dbus cwd unknown /proc/794/cwd (readlink: Permission denied) 2023-10-08T07:07:50.836 INFO:tasks.workunit.client.0.smithi017.stdout:dbus-daem 794 dbus rtd unknown /proc/794/root (readlink: Permission denied) 2023-10-08T07:07:50.836 INFO:tasks.workunit.client.0.smithi017.stdout:dbus-daem 794 dbus txt unknown /proc/794/exe (readlink: Permission denied) 2023-10-08T07:07:50.836 INFO:tasks.workunit.client.0.smithi017.stdout:dbus-daem 794 dbus NOFD /proc/794/fd (opendir: Permission denied) 2023-10-08T07:07:50.836 INFO:tasks.workunit.client.0.smithi017.stdout:dbus-daem 794 857 dbus-daem dbus cwd unknown /proc/794/task/857/cwd (readlink: Permission denied) 2023-10-08T07:07:50.837 INFO:tasks.workunit.client.0.smithi017.stdout:dbus-daem 794 857 dbus-daem dbus rtd unknown /proc/794/task/857/root (readlink: Permission denied) 2023-10-08T07:07:50.837 INFO:tasks.workunit.client.0.smithi017.stdout:dbus-daem 794 857 dbus-daem dbus txt unknown /proc/794/task/857/exe (readlink: Permission denied) 2023-10-08T07:07:50.837 INFO:tasks.workunit.client.0.smithi017.stdout:dbus-daem 794 857 dbus-daem dbus NOFD /proc/794/task/857/fd (opendir: Permission denied) 2023-10-08T07:07:50.837 INFO:tasks.workunit.client.0.smithi017.stdout:NetworkMa 796 root cwd unknown /proc/796/cwd (readlink: Permission denied) 2023-10-08T07:07:50.837 INFO:tasks.workunit.client.0.smithi017.stdout:NetworkMa 796 root rtd unknown /proc/796/root (readlink: Permission denied) 2023-10-08T07:07:50.837 INFO:tasks.workunit.client.0.smithi017.stdout:NetworkMa 796 root txt unknown /proc/796/exe (readlink: Permission denied) 2023-10-08T07:07:50.837 INFO:tasks.workunit.client.0.smithi017.stdout:NetworkMa 796 root NOFD /proc/796/fd (opendir: Permission denied) 2023-10-08T07:07:50.837 INFO:tasks.workunit.client.0.smithi017.stdout:NetworkMa 796 864 gmain root cwd unknown /proc/796/task/864/cwd (readlink: Permission denied) 2023-10-08T07:07:50.837 INFO:tasks.workunit.client.0.smithi017.stdout:NetworkMa 796 864 gmain root rtd unknown /proc/796/task/864/root (readlink: Permission denied) 2023-10-08T07:07:50.837 INFO:tasks.workunit.client.0.smithi017.stdout:NetworkMa 796 864 gmain root txt unknown /proc/796/task/864/exe (readlink: Permission denied) 2023-10-08T07:07:50.837 INFO:tasks.workunit.client.0.smithi017.stdout:NetworkMa 796 864 gmain root NOFD /proc/796/task/864/fd (opendir: Permission denied) 2023-10-08T07:07:50.837 INFO:tasks.workunit.client.0.smithi017.stdout:NetworkMa 796 873 gdbus root cwd unknown /proc/796/task/873/cwd (readlink: Permission denied) 2023-10-08T07:07:50.838 INFO:tasks.workunit.client.0.smithi017.stdout:NetworkMa 796 873 gdbus root rtd unknown /proc/796/task/873/root (readlink: Permission denied) 2023-10-08T07:07:50.838 INFO:tasks.workunit.client.0.smithi017.stdout:NetworkMa 796 873 gdbus root txt unknown /proc/796/task/873/exe (readlink: Permission denied) 2023-10-08T07:07:50.838 INFO:tasks.workunit.client.0.smithi017.stdout:NetworkMa 796 873 gdbus root NOFD /proc/796/task/873/fd (opendir: Permission denied) 2023-10-08T07:07:50.838 INFO:tasks.workunit.client.0.smithi017.stdout:ksmtuned 804 root cwd unknown /proc/804/cwd (readlink: Permission denied) 2023-10-08T07:07:50.838 INFO:tasks.workunit.client.0.smithi017.stdout:ksmtuned 804 root rtd unknown /proc/804/root (readlink: Permission denied) 2023-10-08T07:07:50.838 INFO:tasks.workunit.client.0.smithi017.stdout:ksmtuned 804 root txt unknown /proc/804/exe (readlink: Permission denied) 2023-10-08T07:07:50.838 INFO:tasks.workunit.client.0.smithi017.stdout:ksmtuned 804 root NOFD /proc/804/fd (opendir: Permission denied) 2023-10-08T07:07:50.838 INFO:tasks.workunit.client.0.smithi017.stdout:avahi-dae 859 avahi cwd unknown /proc/859/cwd (readlink: Permission denied) 2023-10-08T07:07:50.838 INFO:tasks.workunit.client.0.smithi017.stdout:avahi-dae 859 avahi rtd unknown /proc/859/root (readlink: Permission denied) 2023-10-08T07:07:50.838 INFO:tasks.workunit.client.0.smithi017.stdout:avahi-dae 859 avahi txt unknown /proc/859/exe (readlink: Permission denied) 2023-10-08T07:07:50.838 INFO:tasks.workunit.client.0.smithi017.stdout:avahi-dae 859 avahi NOFD /proc/859/fd (opendir: Permission denied) 2023-10-08T07:07:50.838 INFO:tasks.workunit.client.0.smithi017.stdout:sshd 875 root cwd unknown /proc/875/cwd (readlink: Permission denied) 2023-10-08T07:07:50.839 INFO:tasks.workunit.client.0.smithi017.stdout:sshd 875 root rtd unknown /proc/875/root (readlink: Permission denied) 2023-10-08T07:07:50.839 INFO:tasks.workunit.client.0.smithi017.stdout:sshd 875 root txt unknown /proc/875/exe (readlink: Permission denied) 2023-10-08T07:07:50.839 INFO:tasks.workunit.client.0.smithi017.stdout:sshd 875 root NOFD /proc/875/fd (opendir: Permission denied) 2023-10-08T07:07:50.839 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 root cwd unknown /proc/879/cwd (readlink: Permission denied) 2023-10-08T07:07:50.839 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 root rtd unknown /proc/879/root (readlink: Permission denied) 2023-10-08T07:07:50.839 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 root txt unknown /proc/879/exe (readlink: Permission denied) 2023-10-08T07:07:50.839 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 root NOFD /proc/879/fd (opendir: Permission denied) 2023-10-08T07:07:50.839 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1129 tuned root cwd unknown /proc/879/task/1129/cwd (readlink: Permission denied) 2023-10-08T07:07:50.839 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1129 tuned root rtd unknown /proc/879/task/1129/root (readlink: Permission denied) 2023-10-08T07:07:50.839 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1129 tuned root txt unknown /proc/879/task/1129/exe (readlink: Permission denied) 2023-10-08T07:07:50.839 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1129 tuned root NOFD /proc/879/task/1129/fd (opendir: Permission denied) 2023-10-08T07:07:50.839 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1136 tuned root cwd unknown /proc/879/task/1136/cwd (readlink: Permission denied) 2023-10-08T07:07:50.840 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1136 tuned root rtd unknown /proc/879/task/1136/root (readlink: Permission denied) 2023-10-08T07:07:50.840 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1136 tuned root txt unknown /proc/879/task/1136/exe (readlink: Permission denied) 2023-10-08T07:07:50.840 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1136 tuned root NOFD /proc/879/task/1136/fd (opendir: Permission denied) 2023-10-08T07:07:50.840 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1157 tuned root cwd unknown /proc/879/task/1157/cwd (readlink: Permission denied) 2023-10-08T07:07:50.840 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1157 tuned root rtd unknown /proc/879/task/1157/root (readlink: Permission denied) 2023-10-08T07:07:50.840 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1157 tuned root txt unknown /proc/879/task/1157/exe (readlink: Permission denied) 2023-10-08T07:07:50.840 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1157 tuned root NOFD /proc/879/task/1157/fd (opendir: Permission denied) 2023-10-08T07:07:50.840 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1158 tuned root cwd unknown /proc/879/task/1158/cwd (readlink: Permission denied) 2023-10-08T07:07:50.840 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1158 tuned root rtd unknown /proc/879/task/1158/root (readlink: Permission denied) 2023-10-08T07:07:50.840 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1158 tuned root txt unknown /proc/879/task/1158/exe (readlink: Permission denied) 2023-10-08T07:07:50.840 INFO:tasks.workunit.client.0.smithi017.stdout:tuned 879 1158 tuned root NOFD /proc/879/task/1158/fd (opendir: Permission denied) 2023-10-08T07:07:50.840 INFO:tasks.workunit.client.0.smithi017.stdout:rhsmcertd 881 root cwd unknown /proc/881/cwd (readlink: Permission denied) 2023-10-08T07:07:50.841 INFO:tasks.workunit.client.0.smithi017.stdout:rhsmcertd 881 root rtd unknown /proc/881/root (readlink: Permission denied) 2023-10-08T07:07:50.841 INFO:tasks.workunit.client.0.smithi017.stdout:rhsmcertd 881 root txt unknown /proc/881/exe (readlink: Permission denied) 2023-10-08T07:07:50.841 INFO:tasks.workunit.client.0.smithi017.stdout:rhsmcertd 881 root NOFD /proc/881/fd (opendir: Permission denied) 2023-10-08T07:07:50.841 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 882 root cwd unknown /proc/882/cwd (readlink: Permission denied) 2023-10-08T07:07:50.841 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 882 root rtd unknown /proc/882/root (readlink: Permission denied) 2023-10-08T07:07:50.841 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 882 root txt unknown /proc/882/exe (readlink: Permission denied) 2023-10-08T07:07:50.841 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 882 root NOFD /proc/882/fd (opendir: Permission denied) 2023-10-08T07:07:50.841 INFO:tasks.workunit.client.0.smithi017.stdout:sssd_be 887 root cwd unknown /proc/887/cwd (readlink: Permission denied) 2023-10-08T07:07:50.841 INFO:tasks.workunit.client.0.smithi017.stdout:sssd_be 887 root rtd unknown /proc/887/root (readlink: Permission denied) 2023-10-08T07:07:50.841 INFO:tasks.workunit.client.0.smithi017.stdout:sssd_be 887 root txt unknown /proc/887/exe (readlink: Permission denied) 2023-10-08T07:07:50.841 INFO:tasks.workunit.client.0.smithi017.stdout:sssd_be 887 root NOFD /proc/887/fd (opendir: Permission denied) 2023-10-08T07:07:50.842 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 root cwd unknown /proc/888/cwd (readlink: Permission denied) 2023-10-08T07:07:50.842 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 root rtd unknown /proc/888/root (readlink: Permission denied) 2023-10-08T07:07:50.842 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 root txt unknown /proc/888/exe (readlink: Permission denied) 2023-10-08T07:07:50.842 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 root NOFD /proc/888/fd (opendir: Permission denied) 2023-10-08T07:07:50.842 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 889 gssproxy root cwd unknown /proc/888/task/889/cwd (readlink: Permission denied) 2023-10-08T07:07:50.842 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 889 gssproxy root rtd unknown /proc/888/task/889/root (readlink: Permission denied) 2023-10-08T07:07:50.842 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 889 gssproxy root txt unknown /proc/888/task/889/exe (readlink: Permission denied) 2023-10-08T07:07:50.842 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 889 gssproxy root NOFD /proc/888/task/889/fd (opendir: Permission denied) 2023-10-08T07:07:50.842 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 890 gssproxy root cwd unknown /proc/888/task/890/cwd (readlink: Permission denied) 2023-10-08T07:07:50.842 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 890 gssproxy root rtd unknown /proc/888/task/890/root (readlink: Permission denied) 2023-10-08T07:07:50.846 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 890 gssproxy root txt unknown /proc/888/task/890/exe (readlink: Permission denied) 2023-10-08T07:07:50.846 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 890 gssproxy root NOFD /proc/888/task/890/fd (opendir: Permission denied) 2023-10-08T07:07:50.846 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 891 gssproxy root cwd unknown /proc/888/task/891/cwd (readlink: Permission denied) 2023-10-08T07:07:50.846 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 891 gssproxy root rtd unknown /proc/888/task/891/root (readlink: Permission denied) 2023-10-08T07:07:50.846 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 891 gssproxy root txt unknown /proc/888/task/891/exe (readlink: Permission denied) 2023-10-08T07:07:50.846 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 891 gssproxy root NOFD /proc/888/task/891/fd (opendir: Permission denied) 2023-10-08T07:07:50.846 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 892 gssproxy root cwd unknown /proc/888/task/892/cwd (readlink: Permission denied) 2023-10-08T07:07:50.846 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 892 gssproxy root rtd unknown /proc/888/task/892/root (readlink: Permission denied) 2023-10-08T07:07:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 892 gssproxy root txt unknown /proc/888/task/892/exe (readlink: Permission denied) 2023-10-08T07:07:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 892 gssproxy root NOFD /proc/888/task/892/fd (opendir: Permission denied) 2023-10-08T07:07:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 893 gssproxy root cwd unknown /proc/888/task/893/cwd (readlink: Permission denied) 2023-10-08T07:07:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 893 gssproxy root rtd unknown /proc/888/task/893/root (readlink: Permission denied) 2023-10-08T07:07:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 893 gssproxy root txt unknown /proc/888/task/893/exe (readlink: Permission denied) 2023-10-08T07:07:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:gssproxy 888 893 gssproxy root NOFD /proc/888/task/893/fd (opendir: Permission denied) 2023-10-08T07:07:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:sssd_nss 902 root cwd unknown /proc/902/cwd (readlink: Permission denied) 2023-10-08T07:07:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:sssd_nss 902 root rtd unknown /proc/902/root (readlink: Permission denied) 2023-10-08T07:07:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:sssd_nss 902 root txt unknown /proc/902/exe (readlink: Permission denied) 2023-10-08T07:07:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:sssd_nss 902 root NOFD /proc/902/fd (opendir: Permission denied) 2023-10-08T07:07:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:kipmi0 904 root cwd unknown /proc/904/cwd (readlink: Permission denied) 2023-10-08T07:07:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:kipmi0 904 root rtd unknown /proc/904/root (readlink: Permission denied) 2023-10-08T07:07:50.848 INFO:tasks.workunit.client.0.smithi017.stdout:kipmi0 904 root txt unknown /proc/904/exe (readlink: Permission denied) 2023-10-08T07:07:50.848 INFO:tasks.workunit.client.0.smithi017.stdout:kipmi0 904 root NOFD /proc/904/fd (opendir: Permission denied) 2023-10-08T07:07:50.848 INFO:tasks.workunit.client.0.smithi017.stdout:cupsd 912 root cwd unknown /proc/912/cwd (readlink: Permission denied) 2023-10-08T07:07:50.848 INFO:tasks.workunit.client.0.smithi017.stdout:cupsd 912 root rtd unknown /proc/912/root (readlink: Permission denied) 2023-10-08T07:07:50.848 INFO:tasks.workunit.client.0.smithi017.stdout:cupsd 912 root txt unknown /proc/912/exe (readlink: Permission denied) 2023-10-08T07:07:50.848 INFO:tasks.workunit.client.0.smithi017.stdout:cupsd 912 root NOFD /proc/912/fd (opendir: Permission denied) 2023-10-08T07:07:50.848 INFO:tasks.workunit.client.0.smithi017.stdout:systemd-l 914 root cwd unknown /proc/914/cwd (readlink: Permission denied) 2023-10-08T07:07:50.850 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:50.855 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:50.848+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:50.856 INFO:tasks.workunit.client.0.smithi017.stdout:systemd-l 914 root rtd unknown /proc/914/root (readlink: Permission denied) 2023-10-08T07:07:50.857 INFO:tasks.workunit.client.0.smithi017.stdout:systemd-l 914 root txt unknown /proc/914/exe (readlink: Permission denied) 2023-10-08T07:07:50.857 INFO:tasks.workunit.client.0.smithi017.stdout:systemd-l 914 root NOFD /proc/914/fd (opendir: Permission denied) 2023-10-08T07:07:50.857 INFO:tasks.workunit.client.0.smithi017.stdout:atd 915 root cwd unknown /proc/915/cwd (readlink: Permission denied) 2023-10-08T07:07:50.857 INFO:tasks.workunit.client.0.smithi017.stdout:atd 915 root rtd unknown /proc/915/root (readlink: Permission denied) 2023-10-08T07:07:50.857 INFO:tasks.workunit.client.0.smithi017.stdout:atd 915 root txt unknown /proc/915/exe (readlink: Permission denied) 2023-10-08T07:07:50.857 INFO:tasks.workunit.client.0.smithi017.stdout:atd 915 root NOFD /proc/915/fd (opendir: Permission denied) 2023-10-08T07:07:50.857 INFO:tasks.workunit.client.0.smithi017.stdout:crond 925 root cwd unknown /proc/925/cwd (readlink: Permission denied) 2023-10-08T07:07:50.857 INFO:tasks.workunit.client.0.smithi017.stdout:crond 925 root rtd unknown /proc/925/root (readlink: Permission denied) 2023-10-08T07:07:50.857 INFO:tasks.workunit.client.0.smithi017.stdout:crond 925 root txt unknown /proc/925/exe (readlink: Permission denied) 2023-10-08T07:07:50.857 INFO:tasks.workunit.client.0.smithi017.stdout:crond 925 root NOFD /proc/925/fd (opendir: Permission denied) 2023-10-08T07:07:50.857 INFO:tasks.workunit.client.0.smithi017.stdout:nrpe 1198 nrpe cwd unknown /proc/1198/cwd (readlink: Permission denied) 2023-10-08T07:07:50.858 INFO:tasks.workunit.client.0.smithi017.stdout:nrpe 1198 nrpe rtd unknown /proc/1198/root (readlink: Permission denied) 2023-10-08T07:07:50.858 INFO:tasks.workunit.client.0.smithi017.stdout:nrpe 1198 nrpe txt unknown /proc/1198/exe (readlink: Permission denied) 2023-10-08T07:07:50.858 INFO:tasks.workunit.client.0.smithi017.stdout:nrpe 1198 nrpe NOFD /proc/1198/fd (opendir: Permission denied) 2023-10-08T07:07:50.858 INFO:tasks.workunit.client.0.smithi017.stdout:agetty 1590 root cwd unknown /proc/1590/cwd (readlink: Permission denied) 2023-10-08T07:07:50.858 INFO:tasks.workunit.client.0.smithi017.stdout:agetty 1590 root rtd unknown /proc/1590/root (readlink: Permission denied) 2023-10-08T07:07:50.858 INFO:tasks.workunit.client.0.smithi017.stdout:agetty 1590 root txt unknown /proc/1590/exe (readlink: Permission denied) 2023-10-08T07:07:50.858 INFO:tasks.workunit.client.0.smithi017.stdout:agetty 1590 root NOFD /proc/1590/fd (opendir: Permission denied) 2023-10-08T07:07:50.858 INFO:tasks.workunit.client.0.smithi017.stdout:agetty 1591 root cwd unknown /proc/1591/cwd (readlink: Permission denied) 2023-10-08T07:07:50.858 INFO:tasks.workunit.client.0.smithi017.stdout:agetty 1591 root rtd unknown /proc/1591/root (readlink: Permission denied) 2023-10-08T07:07:50.858 INFO:tasks.workunit.client.0.smithi017.stdout:agetty 1591 root txt unknown /proc/1591/exe (readlink: Permission denied) 2023-10-08T07:07:50.858 INFO:tasks.workunit.client.0.smithi017.stdout:agetty 1591 root NOFD /proc/1591/fd (opendir: Permission denied) 2023-10-08T07:07:50.858 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu cwd DIR 8,1 4096 2 / 2023-10-08T07:07:50.859 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu rtd DIR 8,1 4096 2 / 2023-10-08T07:07:50.859 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-10-08T07:07:50.859 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-10-08T07:07:50.859 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-10-08T07:07:50.859 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-10-08T07:07:50.859 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-10-08T07:07:50.859 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-10-08T07:07:50.859 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-10-08T07:07:50.859 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-10-08T07:07:50.859 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-10-08T07:07:50.859 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-10-08T07:07:50.860 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-10-08T07:07:50.861 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-10-08T07:07:50.861 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-08T07:07:50.861 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-08T07:07:50.861 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-10-08T07:07:50.861 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-10-08T07:07:50.861 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-10-08T07:07:50.861 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-10-08T07:07:50.861 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-10-08T07:07:50.861 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-08T07:07:50.861 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-10-08T07:07:50.861 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-08T07:07:50.862 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-10-08T07:07:50.862 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-08T07:07:50.862 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 0r CHR 1,3 0t0 2051 /dev/null 2023-10-08T07:07:50.862 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 1u unix 0x0000000000000000 0t0 33819 type=STREAM 2023-10-08T07:07:50.862 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 2u unix 0x0000000000000000 0t0 33819 type=STREAM 2023-10-08T07:07:50.862 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 3u unix 0x0000000000000000 0t0 29142 type=DGRAM 2023-10-08T07:07:50.862 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 4u a_inode 0,14 0 12459 [eventpoll] 2023-10-08T07:07:50.862 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 5u a_inode 0,14 0 12459 [signalfd] 2023-10-08T07:07:50.862 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 6r DIR 0,26 0 888 /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service 2023-10-08T07:07:50.862 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 7u a_inode 0,14 0 12459 [timerfd] 2023-10-08T07:07:50.862 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 8u netlink 0t0 29149 KOBJECT_UEVENT 2023-10-08T07:07:50.862 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 9u a_inode 0,14 0 12459 [eventpoll] 2023-10-08T07:07:50.863 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 10r a_inode 0,14 0 12459 inotify 2023-10-08T07:07:50.863 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 11u unix 0x0000000000000000 0t0 32416 /run/user/1000/bus type=STREAM 2023-10-08T07:07:50.863 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 12r REG 0,5 0 29154 /proc/1832/mountinfo 2023-10-08T07:07:50.863 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 13r a_inode 0,14 0 12459 inotify 2023-10-08T07:07:50.863 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 14r REG 0,5 0 4026532074 /proc/swaps 2023-10-08T07:07:50.863 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 15u unix 0x0000000000000000 0t0 32404 /run/user/1000/systemd/notify type=DGRAM 2023-10-08T07:07:50.863 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 16u unix 0x0000000000000000 0t0 32406 type=DGRAM 2023-10-08T07:07:50.863 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 17u unix 0x0000000000000000 0t0 32407 type=DGRAM 2023-10-08T07:07:50.863 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 18u unix 0x0000000000000000 0t0 32408 /run/user/1000/systemd/private type=STREAM 2023-10-08T07:07:50.863 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 19u unix 0x0000000000000000 0t0 32410 type=STREAM 2023-10-08T07:07:50.863 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 20u a_inode 0,14 0 12459 [timerfd] 2023-10-08T07:07:50.863 INFO:tasks.workunit.client.0.smithi017.stdout:systemd 1832 ubuntu 26u netlink 0t0 32419 SELINUX 2023-10-08T07:07:50.864 INFO:tasks.workunit.client.0.smithi017.stdout:(sd-pam) 1835 ubuntu cwd unknown /proc/1835/cwd (readlink: Permission denied) 2023-10-08T07:07:50.864 INFO:tasks.workunit.client.0.smithi017.stdout:(sd-pam) 1835 ubuntu rtd unknown /proc/1835/root (readlink: Permission denied) 2023-10-08T07:07:50.864 INFO:tasks.workunit.client.0.smithi017.stdout:(sd-pam) 1835 ubuntu txt unknown /proc/1835/exe (readlink: Permission denied) 2023-10-08T07:07:50.864 INFO:tasks.workunit.client.0.smithi017.stdout:(sd-pam) 1835 ubuntu NOFD /proc/1835/fd (opendir: Permission denied) 2023-10-08T07:07:50.864 INFO:tasks.workunit.client.0.smithi017.stdout:rsyslogd 2390 root cwd unknown /proc/2390/cwd (readlink: Permission denied) 2023-10-08T07:07:50.864 INFO:tasks.workunit.client.0.smithi017.stdout:rsyslogd 2390 root rtd unknown /proc/2390/root (readlink: Permission denied) 2023-10-08T07:07:50.864 INFO:tasks.workunit.client.0.smithi017.stdout:rsyslogd 2390 root txt unknown /proc/2390/exe (readlink: Permission denied) 2023-10-08T07:07:50.864 INFO:tasks.workunit.client.0.smithi017.stdout:rsyslogd 2390 root NOFD /proc/2390/fd (opendir: Permission denied) 2023-10-08T07:07:50.864 INFO:tasks.workunit.client.0.smithi017.stdout:rsyslogd 2390 2392 in:imjour root cwd unknown /proc/2390/task/2392/cwd (readlink: Permission denied) 2023-10-08T07:07:50.864 INFO:tasks.workunit.client.0.smithi017.stdout:rsyslogd 2390 2392 in:imjour root rtd unknown /proc/2390/task/2392/root (readlink: Permission denied) 2023-10-08T07:07:50.864 INFO:tasks.workunit.client.0.smithi017.stdout:rsyslogd 2390 2392 in:imjour root txt unknown /proc/2390/task/2392/exe (readlink: Permission denied) 2023-10-08T07:07:50.864 INFO:tasks.workunit.client.0.smithi017.stdout:rsyslogd 2390 2392 in:imjour root NOFD /proc/2390/task/2392/fd (opendir: Permission denied) 2023-10-08T07:07:50.865 INFO:tasks.workunit.client.0.smithi017.stdout:rsyslogd 2390 2393 rs:main root cwd unknown /proc/2390/task/2393/cwd (readlink: Permission denied) 2023-10-08T07:07:50.865 INFO:tasks.workunit.client.0.smithi017.stdout:rsyslogd 2390 2393 rs:main root rtd unknown /proc/2390/task/2393/root (readlink: Permission denied) 2023-10-08T07:07:50.865 INFO:tasks.workunit.client.0.smithi017.stdout:rsyslogd 2390 2393 rs:main root txt unknown /proc/2390/task/2393/exe (readlink: Permission denied) 2023-10-08T07:07:50.865 INFO:tasks.workunit.client.0.smithi017.stdout:rsyslogd 2390 2393 rs:main root NOFD /proc/2390/task/2393/fd (opendir: Permission denied) 2023-10-08T07:07:50.865 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 70806 root cwd unknown /proc/70806/cwd (readlink: Permission denied) 2023-10-08T07:07:50.865 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 70806 root rtd unknown /proc/70806/root (readlink: Permission denied) 2023-10-08T07:07:50.865 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 70806 root txt unknown /proc/70806/exe (readlink: Permission denied) 2023-10-08T07:07:50.865 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 70806 root NOFD /proc/70806/fd (opendir: Permission denied) 2023-10-08T07:07:50.865 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 70811 root cwd unknown /proc/70811/cwd (readlink: Permission denied) 2023-10-08T07:07:50.865 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 70811 root rtd unknown /proc/70811/root (readlink: Permission denied) 2023-10-08T07:07:50.865 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 70811 root txt unknown /proc/70811/exe (readlink: Permission denied) 2023-10-08T07:07:50.865 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 70811 root NOFD /proc/70811/fd (opendir: Permission denied) 2023-10-08T07:07:50.866 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 81099 root cwd unknown /proc/81099/cwd (readlink: Permission denied) 2023-10-08T07:07:50.866 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 81099 root rtd unknown /proc/81099/root (readlink: Permission denied) 2023-10-08T07:07:50.866 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 81099 root txt unknown /proc/81099/exe (readlink: Permission denied) 2023-10-08T07:07:50.866 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 81099 root NOFD /proc/81099/fd (opendir: Permission denied) 2023-10-08T07:07:50.866 INFO:tasks.workunit.client.0.smithi017.stdout:anacron 81243 root cwd unknown /proc/81243/cwd (readlink: Permission denied) 2023-10-08T07:07:50.866 INFO:tasks.workunit.client.0.smithi017.stdout:anacron 81243 root rtd unknown /proc/81243/root (readlink: Permission denied) 2023-10-08T07:07:50.866 INFO:tasks.workunit.client.0.smithi017.stdout:anacron 81243 root txt unknown /proc/81243/exe (readlink: Permission denied) 2023-10-08T07:07:50.866 INFO:tasks.workunit.client.0.smithi017.stdout:anacron 81243 root NOFD /proc/81243/fd (opendir: Permission denied) 2023-10-08T07:07:50.866 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 83095 root cwd unknown /proc/83095/cwd (readlink: Permission denied) 2023-10-08T07:07:50.866 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 83095 root rtd unknown /proc/83095/root (readlink: Permission denied) 2023-10-08T07:07:50.866 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 83095 root txt unknown /proc/83095/exe (readlink: Permission denied) 2023-10-08T07:07:50.867 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 83095 root NOFD /proc/83095/fd (opendir: Permission denied) 2023-10-08T07:07:50.867 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 84607 root cwd unknown /proc/84607/cwd (readlink: Permission denied) 2023-10-08T07:07:50.867 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 84607 root rtd unknown /proc/84607/root (readlink: Permission denied) 2023-10-08T07:07:50.867 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 84607 root txt unknown /proc/84607/exe (readlink: Permission denied) 2023-10-08T07:07:50.867 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 84607 root NOFD /proc/84607/fd (opendir: Permission denied) 2023-10-08T07:07:50.867 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 84753 root cwd unknown /proc/84753/cwd (readlink: Permission denied) 2023-10-08T07:07:50.867 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 84753 root rtd unknown /proc/84753/root (readlink: Permission denied) 2023-10-08T07:07:50.867 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 84753 root txt unknown /proc/84753/exe (readlink: Permission denied) 2023-10-08T07:07:50.867 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 84753 root NOFD /proc/84753/fd (opendir: Permission denied) 2023-10-08T07:07:50.867 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 84899 root cwd unknown /proc/84899/cwd (readlink: Permission denied) 2023-10-08T07:07:50.867 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 84899 root rtd unknown /proc/84899/root (readlink: Permission denied) 2023-10-08T07:07:50.867 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 84899 root txt unknown /proc/84899/exe (readlink: Permission denied) 2023-10-08T07:07:50.868 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 84899 root NOFD /proc/84899/fd (opendir: Permission denied) 2023-10-08T07:07:50.868 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 85053 root cwd unknown /proc/85053/cwd (readlink: Permission denied) 2023-10-08T07:07:50.868 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 85053 root rtd unknown /proc/85053/root (readlink: Permission denied) 2023-10-08T07:07:50.868 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 85053 root txt unknown /proc/85053/exe (readlink: Permission denied) 2023-10-08T07:07:50.868 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 85053 root NOFD /proc/85053/fd (opendir: Permission denied) 2023-10-08T07:07:50.868 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 85199 root cwd unknown /proc/85199/cwd (readlink: Permission denied) 2023-10-08T07:07:50.868 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 85199 root rtd unknown /proc/85199/root (readlink: Permission denied) 2023-10-08T07:07:50.868 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 85199 root txt unknown /proc/85199/exe (readlink: Permission denied) 2023-10-08T07:07:50.868 INFO:tasks.workunit.client.0.smithi017.stdout:kdmflush/ 85199 root NOFD /proc/85199/fd (opendir: Permission denied) 2023-10-08T07:07:50.868 INFO:tasks.workunit.client.0.smithi017.stdout:xfsalloc 86284 root cwd unknown /proc/86284/cwd (readlink: Permission denied) 2023-10-08T07:07:50.868 INFO:tasks.workunit.client.0.smithi017.stdout:xfsalloc 86284 root rtd unknown /proc/86284/root (readlink: Permission denied) 2023-10-08T07:07:50.868 INFO:tasks.workunit.client.0.smithi017.stdout:xfsalloc 86284 root txt unknown /proc/86284/exe (readlink: Permission denied) 2023-10-08T07:07:50.869 INFO:tasks.workunit.client.0.smithi017.stdout:xfsalloc 86284 root NOFD /proc/86284/fd (opendir: Permission denied) 2023-10-08T07:07:50.869 INFO:tasks.workunit.client.0.smithi017.stdout:xfs_mru_c 86285 root cwd unknown /proc/86285/cwd (readlink: Permission denied) 2023-10-08T07:07:50.869 INFO:tasks.workunit.client.0.smithi017.stdout:xfs_mru_c 86285 root rtd unknown /proc/86285/root (readlink: Permission denied) 2023-10-08T07:07:50.869 INFO:tasks.workunit.client.0.smithi017.stdout:xfs_mru_c 86285 root txt unknown /proc/86285/exe (readlink: Permission denied) 2023-10-08T07:07:50.869 INFO:tasks.workunit.client.0.smithi017.stdout:xfs_mru_c 86285 root NOFD /proc/86285/fd (opendir: Permission denied) 2023-10-08T07:07:50.869 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-buf/d 86286 root cwd unknown /proc/86286/cwd (readlink: Permission denied) 2023-10-08T07:07:50.869 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-buf/d 86286 root rtd unknown /proc/86286/root (readlink: Permission denied) 2023-10-08T07:07:50.869 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-buf/d 86286 root txt unknown /proc/86286/exe (readlink: Permission denied) 2023-10-08T07:07:50.869 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-buf/d 86286 root NOFD /proc/86286/fd (opendir: Permission denied) 2023-10-08T07:07:50.869 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-conv/ 86287 root cwd unknown /proc/86287/cwd (readlink: Permission denied) 2023-10-08T07:07:50.869 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-conv/ 86287 root rtd unknown /proc/86287/root (readlink: Permission denied) 2023-10-08T07:07:50.869 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-conv/ 86287 root txt unknown /proc/86287/exe (readlink: Permission denied) 2023-10-08T07:07:50.870 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-conv/ 86287 root NOFD /proc/86287/fd (opendir: Permission denied) 2023-10-08T07:07:50.870 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-cil/d 86288 root cwd unknown /proc/86288/cwd (readlink: Permission denied) 2023-10-08T07:07:50.870 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-cil/d 86288 root rtd unknown /proc/86288/root (readlink: Permission denied) 2023-10-08T07:07:50.870 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-cil/d 86288 root txt unknown /proc/86288/exe (readlink: Permission denied) 2023-10-08T07:07:50.870 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-cil/d 86288 root NOFD /proc/86288/fd (opendir: Permission denied) 2023-10-08T07:07:50.870 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-recla 86289 root cwd unknown /proc/86289/cwd (readlink: Permission denied) 2023-10-08T07:07:50.870 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-recla 86289 root rtd unknown /proc/86289/root (readlink: Permission denied) 2023-10-08T07:07:50.870 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-recla 86289 root txt unknown /proc/86289/exe (readlink: Permission denied) 2023-10-08T07:07:50.870 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-recla 86289 root NOFD /proc/86289/fd (opendir: Permission denied) 2023-10-08T07:07:50.870 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-block 86290 root cwd unknown /proc/86290/cwd (readlink: Permission denied) 2023-10-08T07:07:50.870 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-block 86290 root rtd unknown /proc/86290/root (readlink: Permission denied) 2023-10-08T07:07:50.870 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-block 86290 root txt unknown /proc/86290/exe (readlink: Permission denied) 2023-10-08T07:07:50.871 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-block 86290 root NOFD /proc/86290/fd (opendir: Permission denied) 2023-10-08T07:07:50.871 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-log/d 86292 root cwd unknown /proc/86292/cwd (readlink: Permission denied) 2023-10-08T07:07:50.871 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-log/d 86292 root rtd unknown /proc/86292/root (readlink: Permission denied) 2023-10-08T07:07:50.871 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-log/d 86292 root txt unknown /proc/86292/exe (readlink: Permission denied) 2023-10-08T07:07:50.871 INFO:tasks.workunit.client.0.smithi017.stdout:xfs-log/d 86292 root NOFD /proc/86292/fd (opendir: Permission denied) 2023-10-08T07:07:50.871 INFO:tasks.workunit.client.0.smithi017.stdout:xfsaild/d 86293 root cwd unknown /proc/86293/cwd (readlink: Permission denied) 2023-10-08T07:07:50.871 INFO:tasks.workunit.client.0.smithi017.stdout:xfsaild/d 86293 root rtd unknown /proc/86293/root (readlink: Permission denied) 2023-10-08T07:07:50.871 INFO:tasks.workunit.client.0.smithi017.stdout:xfsaild/d 86293 root txt unknown /proc/86293/exe (readlink: Permission denied) 2023-10-08T07:07:50.871 INFO:tasks.workunit.client.0.smithi017.stdout:xfsaild/d 86293 root NOFD /proc/86293/fd (opendir: Permission denied) 2023-10-08T07:07:50.871 INFO:tasks.workunit.client.0.smithi017.stdout:sshd 90089 root cwd unknown /proc/90089/cwd (readlink: Permission denied) 2023-10-08T07:07:50.871 INFO:tasks.workunit.client.0.smithi017.stdout:sshd 90089 root rtd unknown /proc/90089/root (readlink: Permission denied) 2023-10-08T07:07:50.872 INFO:tasks.workunit.client.0.smithi017.stdout:sshd 90089 root txt unknown /proc/90089/exe (readlink: Permission denied) 2023-10-08T07:07:50.872 INFO:tasks.workunit.client.0.smithi017.stdout:sshd 90089 root NOFD /proc/90089/fd (opendir: Permission denied) 2023-10-08T07:07:50.872 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 90092 root cwd unknown /proc/90092/cwd (readlink: Permission denied) 2023-10-08T07:07:50.872 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 90092 root rtd unknown /proc/90092/root (readlink: Permission denied) 2023-10-08T07:07:50.872 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 90092 root txt unknown /proc/90092/exe (readlink: Permission denied) 2023-10-08T07:07:50.872 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 90092 root NOFD /proc/90092/fd (opendir: Permission denied) 2023-10-08T07:07:50.872 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 90093 root cwd unknown /proc/90093/cwd (readlink: Permission denied) 2023-10-08T07:07:50.872 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 90093 root rtd unknown /proc/90093/root (readlink: Permission denied) 2023-10-08T07:07:50.872 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 90093 root txt unknown /proc/90093/exe (readlink: Permission denied) 2023-10-08T07:07:50.872 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 90093 root NOFD /proc/90093/fd (opendir: Permission denied) 2023-10-08T07:07:50.872 INFO:tasks.workunit.client.0.smithi017.stdout:sshd 90095 ubuntu cwd unknown /proc/90095/cwd (readlink: Permission denied) 2023-10-08T07:07:50.873 INFO:tasks.workunit.client.0.smithi017.stdout:sshd 90095 ubuntu rtd unknown /proc/90095/root (readlink: Permission denied) 2023-10-08T07:07:50.873 INFO:tasks.workunit.client.0.smithi017.stdout:sshd 90095 ubuntu txt unknown /proc/90095/exe (readlink: Permission denied) 2023-10-08T07:07:50.873 INFO:tasks.workunit.client.0.smithi017.stdout:sshd 90095 ubuntu NOFD /proc/90095/fd (opendir: Permission denied) 2023-10-08T07:07:50.873 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 90153 root cwd unknown /proc/90153/cwd (readlink: Permission denied) 2023-10-08T07:07:50.873 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 90153 root rtd unknown /proc/90153/root (readlink: Permission denied) 2023-10-08T07:07:50.873 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 90153 root txt unknown /proc/90153/exe (readlink: Permission denied) 2023-10-08T07:07:50.873 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/4 90153 root NOFD /proc/90153/fd (opendir: Permission denied) 2023-10-08T07:07:50.873 INFO:tasks.workunit.client.0.smithi017.stdout:chronyd 90166 chrony cwd unknown /proc/90166/cwd (readlink: Permission denied) 2023-10-08T07:07:50.873 INFO:tasks.workunit.client.0.smithi017.stdout:chronyd 90166 chrony rtd unknown /proc/90166/root (readlink: Permission denied) 2023-10-08T07:07:50.873 INFO:tasks.workunit.client.0.smithi017.stdout:chronyd 90166 chrony txt unknown /proc/90166/exe (readlink: Permission denied) 2023-10-08T07:07:50.873 INFO:tasks.workunit.client.0.smithi017.stdout:chronyd 90166 chrony NOFD /proc/90166/fd (opendir: Permission denied) 2023-10-08T07:07:50.873 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 90413 root cwd unknown /proc/90413/cwd (readlink: Permission denied) 2023-10-08T07:07:50.874 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 90413 root rtd unknown /proc/90413/root (readlink: Permission denied) 2023-10-08T07:07:50.874 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 90413 root txt unknown /proc/90413/exe (readlink: Permission denied) 2023-10-08T07:07:50.877 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/5 90413 root NOFD /proc/90413/fd (opendir: Permission denied) 2023-10-08T07:07:50.877 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-cras 90454 ceph cwd unknown /proc/90454/cwd (readlink: Permission denied) 2023-10-08T07:07:50.877 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-cras 90454 ceph rtd unknown /proc/90454/root (readlink: Permission denied) 2023-10-08T07:07:50.877 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-cras 90454 ceph txt unknown /proc/90454/exe (readlink: Permission denied) 2023-10-08T07:07:50.877 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-cras 90454 ceph NOFD /proc/90454/fd (opendir: Permission denied) 2023-10-08T07:07:50.877 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 95610 root cwd unknown /proc/95610/cwd (readlink: Permission denied) 2023-10-08T07:07:50.877 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 95610 root rtd unknown /proc/95610/root (readlink: Permission denied) 2023-10-08T07:07:50.877 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 95610 root txt unknown /proc/95610/exe (readlink: Permission denied) 2023-10-08T07:07:50.877 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/2 95610 root NOFD /proc/95610/fd (opendir: Permission denied) 2023-10-08T07:07:50.878 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 95614 root cwd unknown /proc/95614/cwd (readlink: Permission denied) 2023-10-08T07:07:50.878 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 95614 root rtd unknown /proc/95614/root (readlink: Permission denied) 2023-10-08T07:07:50.878 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 95614 root txt unknown /proc/95614/exe (readlink: Permission denied) 2023-10-08T07:07:50.878 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/3 95614 root NOFD /proc/95614/fd (opendir: Permission denied) 2023-10-08T07:07:50.878 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96833 root cwd unknown /proc/96833/cwd (readlink: Permission denied) 2023-10-08T07:07:50.878 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96833 root rtd unknown /proc/96833/root (readlink: Permission denied) 2023-10-08T07:07:50.878 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96833 root txt unknown /proc/96833/exe (readlink: Permission denied) 2023-10-08T07:07:50.878 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96833 root NOFD /proc/96833/fd (opendir: Permission denied) 2023-10-08T07:07:50.878 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96836 root cwd unknown /proc/96836/cwd (readlink: Permission denied) 2023-10-08T07:07:50.878 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96836 root rtd unknown /proc/96836/root (readlink: Permission denied) 2023-10-08T07:07:50.878 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96836 root txt unknown /proc/96836/exe (readlink: Permission denied) 2023-10-08T07:07:50.878 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96836 root NOFD /proc/96836/fd (opendir: Permission denied) 2023-10-08T07:07:50.879 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96842 root cwd unknown /proc/96842/cwd (readlink: Permission denied) 2023-10-08T07:07:50.879 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96842 root rtd unknown /proc/96842/root (readlink: Permission denied) 2023-10-08T07:07:50.879 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96842 root txt unknown /proc/96842/exe (readlink: Permission denied) 2023-10-08T07:07:50.879 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96842 root NOFD /proc/96842/fd (opendir: Permission denied) 2023-10-08T07:07:50.879 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96851 root cwd unknown /proc/96851/cwd (readlink: Permission denied) 2023-10-08T07:07:50.879 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96851 root rtd unknown /proc/96851/root (readlink: Permission denied) 2023-10-08T07:07:50.879 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96851 root txt unknown /proc/96851/exe (readlink: Permission denied) 2023-10-08T07:07:50.879 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96851 root NOFD /proc/96851/fd (opendir: Permission denied) 2023-10-08T07:07:50.879 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96861 root cwd unknown /proc/96861/cwd (readlink: Permission denied) 2023-10-08T07:07:50.879 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96861 root rtd unknown /proc/96861/root (readlink: Permission denied) 2023-10-08T07:07:50.879 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96861 root txt unknown /proc/96861/exe (readlink: Permission denied) 2023-10-08T07:07:50.880 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 96861 root NOFD /proc/96861/fd (opendir: Permission denied) 2023-10-08T07:07:50.880 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96949 root cwd unknown /proc/96949/cwd (readlink: Permission denied) 2023-10-08T07:07:50.880 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96949 root rtd unknown /proc/96949/root (readlink: Permission denied) 2023-10-08T07:07:50.880 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96949 root txt unknown /proc/96949/exe (readlink: Permission denied) 2023-10-08T07:07:50.880 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96949 root NOFD /proc/96949/fd (opendir: Permission denied) 2023-10-08T07:07:50.880 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96952 root cwd unknown /proc/96952/cwd (readlink: Permission denied) 2023-10-08T07:07:50.880 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96952 root rtd unknown /proc/96952/root (readlink: Permission denied) 2023-10-08T07:07:50.880 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96952 root txt unknown /proc/96952/exe (readlink: Permission denied) 2023-10-08T07:07:50.880 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96952 root NOFD /proc/96952/fd (opendir: Permission denied) 2023-10-08T07:07:50.880 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96955 root cwd unknown /proc/96955/cwd (readlink: Permission denied) 2023-10-08T07:07:50.880 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96955 root rtd unknown /proc/96955/root (readlink: Permission denied) 2023-10-08T07:07:50.880 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96955 root txt unknown /proc/96955/exe (readlink: Permission denied) 2023-10-08T07:07:50.881 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96955 root NOFD /proc/96955/fd (opendir: Permission denied) 2023-10-08T07:07:50.881 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96958 root cwd unknown /proc/96958/cwd (readlink: Permission denied) 2023-10-08T07:07:50.881 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96958 root rtd unknown /proc/96958/root (readlink: Permission denied) 2023-10-08T07:07:50.881 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96958 root txt unknown /proc/96958/exe (readlink: Permission denied) 2023-10-08T07:07:50.881 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96958 root NOFD /proc/96958/fd (opendir: Permission denied) 2023-10-08T07:07:50.881 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96961 root cwd unknown /proc/96961/cwd (readlink: Permission denied) 2023-10-08T07:07:50.881 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96961 root rtd unknown /proc/96961/root (readlink: Permission denied) 2023-10-08T07:07:50.881 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96961 root txt unknown /proc/96961/exe (readlink: Permission denied) 2023-10-08T07:07:50.881 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 96961 root NOFD /proc/96961/fd (opendir: Permission denied) 2023-10-08T07:07:50.881 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 root cwd unknown /proc/96964/cwd (readlink: Permission denied) 2023-10-08T07:07:50.881 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 root rtd unknown /proc/96964/root (readlink: Permission denied) 2023-10-08T07:07:50.881 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 root txt unknown /proc/96964/exe (readlink: Permission denied) 2023-10-08T07:07:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 root NOFD /proc/96964/fd (opendir: Permission denied) 2023-10-08T07:07:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96967 log root cwd unknown /proc/96964/task/96967/cwd (readlink: Permission denied) 2023-10-08T07:07:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96967 log root rtd unknown /proc/96964/task/96967/root (readlink: Permission denied) 2023-10-08T07:07:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96967 log root txt unknown /proc/96964/task/96967/exe (readlink: Permission denied) 2023-10-08T07:07:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96967 log root NOFD /proc/96964/task/96967/fd (opendir: Permission denied) 2023-10-08T07:07:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96969 service root cwd unknown /proc/96964/task/96969/cwd (readlink: Permission denied) 2023-10-08T07:07:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96969 service root rtd unknown /proc/96964/task/96969/root (readlink: Permission denied) 2023-10-08T07:07:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96969 service root txt unknown /proc/96964/task/96969/exe (readlink: Permission denied) 2023-10-08T07:07:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96969 service root NOFD /proc/96964/task/96969/fd (opendir: Permission denied) 2023-10-08T07:07:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96970 admin_soc root cwd unknown /proc/96964/task/96970/cwd (readlink: Permission denied) 2023-10-08T07:07:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96970 admin_soc root rtd unknown /proc/96964/task/96970/root (readlink: Permission denied) 2023-10-08T07:07:50.882 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96970 admin_soc root txt unknown /proc/96964/task/96970/exe (readlink: Permission denied) 2023-10-08T07:07:50.883 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96970 admin_soc root NOFD /proc/96964/task/96970/fd (opendir: Permission denied) 2023-10-08T07:07:50.883 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96980 signal_ha root cwd unknown /proc/96964/task/96980/cwd (readlink: Permission denied) 2023-10-08T07:07:50.883 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96980 signal_ha root rtd unknown /proc/96964/task/96980/root (readlink: Permission denied) 2023-10-08T07:07:50.883 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96980 signal_ha root txt unknown /proc/96964/task/96980/exe (readlink: Permission denied) 2023-10-08T07:07:50.883 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96980 signal_ha root NOFD /proc/96964/task/96980/fd (opendir: Permission denied) 2023-10-08T07:07:50.883 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96981 rocksdb:l root cwd unknown /proc/96964/task/96981/cwd (readlink: Permission denied) 2023-10-08T07:07:50.883 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96981 rocksdb:l root rtd unknown /proc/96964/task/96981/root (readlink: Permission denied) 2023-10-08T07:07:50.883 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96981 rocksdb:l root txt unknown /proc/96964/task/96981/exe (readlink: Permission denied) 2023-10-08T07:07:50.883 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96981 rocksdb:l root NOFD /proc/96964/task/96981/fd (opendir: Permission denied) 2023-10-08T07:07:50.883 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96982 rocksdb:h root cwd unknown /proc/96964/task/96982/cwd (readlink: Permission denied) 2023-10-08T07:07:50.883 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96982 rocksdb:h root rtd unknown /proc/96964/task/96982/root (readlink: Permission denied) 2023-10-08T07:07:50.883 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96982 rocksdb:h root txt unknown /proc/96964/task/96982/exe (readlink: Permission denied) 2023-10-08T07:07:50.884 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96982 rocksdb:h root NOFD /proc/96964/task/96982/fd (opendir: Permission denied) 2023-10-08T07:07:50.884 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96998 ceph-mon root cwd unknown /proc/96964/task/96998/cwd (readlink: Permission denied) 2023-10-08T07:07:50.884 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96998 ceph-mon root rtd unknown /proc/96964/task/96998/root (readlink: Permission denied) 2023-10-08T07:07:50.884 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96998 ceph-mon root txt unknown /proc/96964/task/96998/exe (readlink: Permission denied) 2023-10-08T07:07:50.884 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96998 ceph-mon root NOFD /proc/96964/task/96998/fd (opendir: Permission denied) 2023-10-08T07:07:50.884 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96999 fn_monsto root cwd unknown /proc/96964/task/96999/cwd (readlink: Permission denied) 2023-10-08T07:07:50.884 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96999 fn_monsto root rtd unknown /proc/96964/task/96999/root (readlink: Permission denied) 2023-10-08T07:07:50.884 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96999 fn_monsto root txt unknown /proc/96964/task/96999/exe (readlink: Permission denied) 2023-10-08T07:07:50.884 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 96999 fn_monsto root NOFD /proc/96964/task/96999/fd (opendir: Permission denied) 2023-10-08T07:07:50.884 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97000 msgr-work root cwd unknown /proc/96964/task/97000/cwd (readlink: Permission denied) 2023-10-08T07:07:50.884 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97000 msgr-work root rtd unknown /proc/96964/task/97000/root (readlink: Permission denied) 2023-10-08T07:07:50.884 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97000 msgr-work root txt unknown /proc/96964/task/97000/exe (readlink: Permission denied) 2023-10-08T07:07:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97000 msgr-work root NOFD /proc/96964/task/97000/fd (opendir: Permission denied) 2023-10-08T07:07:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97001 msgr-work root cwd unknown /proc/96964/task/97001/cwd (readlink: Permission denied) 2023-10-08T07:07:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97001 msgr-work root rtd unknown /proc/96964/task/97001/root (readlink: Permission denied) 2023-10-08T07:07:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97001 msgr-work root txt unknown /proc/96964/task/97001/exe (readlink: Permission denied) 2023-10-08T07:07:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97001 msgr-work root NOFD /proc/96964/task/97001/fd (opendir: Permission denied) 2023-10-08T07:07:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97002 msgr-work root cwd unknown /proc/96964/task/97002/cwd (readlink: Permission denied) 2023-10-08T07:07:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97002 msgr-work root rtd unknown /proc/96964/task/97002/root (readlink: Permission denied) 2023-10-08T07:07:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97002 msgr-work root txt unknown /proc/96964/task/97002/exe (readlink: Permission denied) 2023-10-08T07:07:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97002 msgr-work root NOFD /proc/96964/task/97002/fd (opendir: Permission denied) 2023-10-08T07:07:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97003 OpHistory root cwd unknown /proc/96964/task/97003/cwd (readlink: Permission denied) 2023-10-08T07:07:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97003 OpHistory root rtd unknown /proc/96964/task/97003/root (readlink: Permission denied) 2023-10-08T07:07:50.885 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97003 OpHistory root txt unknown /proc/96964/task/97003/exe (readlink: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97003 OpHistory root NOFD /proc/96964/task/97003/fd (opendir: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97004 fin root cwd unknown /proc/96964/task/97004/cwd (readlink: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97004 fin root rtd unknown /proc/96964/task/97004/root (readlink: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97004 fin root txt unknown /proc/96964/task/97004/exe (readlink: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97004 fin root NOFD /proc/96964/task/97004/fd (opendir: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97005 safe_time root cwd unknown /proc/96964/task/97005/cwd (readlink: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97005 safe_time root rtd unknown /proc/96964/task/97005/root (readlink: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97005 safe_time root txt unknown /proc/96964/task/97005/exe (readlink: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97005 safe_time root NOFD /proc/96964/task/97005/fd (opendir: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97006 cpu_tp root cwd unknown /proc/96964/task/97006/cwd (readlink: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97006 cpu_tp root rtd unknown /proc/96964/task/97006/root (readlink: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97006 cpu_tp root txt unknown /proc/96964/task/97006/exe (readlink: Permission denied) 2023-10-08T07:07:50.886 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97006 cpu_tp root NOFD /proc/96964/task/97006/fd (opendir: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97007 cpu_tp root cwd unknown /proc/96964/task/97007/cwd (readlink: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97007 cpu_tp root rtd unknown /proc/96964/task/97007/root (readlink: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97007 cpu_tp root txt unknown /proc/96964/task/97007/exe (readlink: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97007 cpu_tp root NOFD /proc/96964/task/97007/fd (opendir: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97008 cpu_tp root cwd unknown /proc/96964/task/97008/cwd (readlink: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97008 cpu_tp root rtd unknown /proc/96964/task/97008/root (readlink: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97008 cpu_tp root txt unknown /proc/96964/task/97008/exe (readlink: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97008 cpu_tp root NOFD /proc/96964/task/97008/fd (opendir: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97009 cpu_tp root cwd unknown /proc/96964/task/97009/cwd (readlink: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97009 cpu_tp root rtd unknown /proc/96964/task/97009/root (readlink: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97009 cpu_tp root txt unknown /proc/96964/task/97009/exe (readlink: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97009 cpu_tp root NOFD /proc/96964/task/97009/fd (opendir: Permission denied) 2023-10-08T07:07:50.887 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97010 ms_dispat root cwd unknown /proc/96964/task/97010/cwd (readlink: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97010 ms_dispat root rtd unknown /proc/96964/task/97010/root (readlink: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97010 ms_dispat root txt unknown /proc/96964/task/97010/exe (readlink: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97010 ms_dispat root NOFD /proc/96964/task/97010/fd (opendir: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97011 ms_local root cwd unknown /proc/96964/task/97011/cwd (readlink: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97011 ms_local root rtd unknown /proc/96964/task/97011/root (readlink: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97011 ms_local root txt unknown /proc/96964/task/97011/exe (readlink: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97011 ms_local root NOFD /proc/96964/task/97011/fd (opendir: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97012 safe_time root cwd unknown /proc/96964/task/97012/cwd (readlink: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97012 safe_time root rtd unknown /proc/96964/task/97012/root (readlink: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97012 safe_time root txt unknown /proc/96964/task/97012/exe (readlink: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97012 safe_time root NOFD /proc/96964/task/97012/fd (opendir: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97013 ms_dispat root cwd unknown /proc/96964/task/97013/cwd (readlink: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97013 ms_dispat root rtd unknown /proc/96964/task/97013/root (readlink: Permission denied) 2023-10-08T07:07:50.888 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97013 ms_dispat root txt unknown /proc/96964/task/97013/exe (readlink: Permission denied) 2023-10-08T07:07:50.889 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97013 ms_dispat root NOFD /proc/96964/task/97013/fd (opendir: Permission denied) 2023-10-08T07:07:50.889 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97014 ms_local root cwd unknown /proc/96964/task/97014/cwd (readlink: Permission denied) 2023-10-08T07:07:50.889 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97014 ms_local root rtd unknown /proc/96964/task/97014/root (readlink: Permission denied) 2023-10-08T07:07:50.889 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97014 ms_local root txt unknown /proc/96964/task/97014/exe (readlink: Permission denied) 2023-10-08T07:07:50.889 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96964 97014 ms_local root NOFD /proc/96964/task/97014/fd (opendir: Permission denied) 2023-10-08T07:07:50.889 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 root cwd unknown /proc/96965/cwd (readlink: Permission denied) 2023-10-08T07:07:50.889 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 root rtd unknown /proc/96965/root (readlink: Permission denied) 2023-10-08T07:07:50.889 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 root txt unknown /proc/96965/exe (readlink: Permission denied) 2023-10-08T07:07:50.889 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 root NOFD /proc/96965/fd (opendir: Permission denied) 2023-10-08T07:07:50.889 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96972 log root cwd unknown /proc/96965/task/96972/cwd (readlink: Permission denied) 2023-10-08T07:07:50.889 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96972 log root rtd unknown /proc/96965/task/96972/root (readlink: Permission denied) 2023-10-08T07:07:50.889 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96972 log root txt unknown /proc/96965/task/96972/exe (readlink: Permission denied) 2023-10-08T07:07:50.890 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96972 log root NOFD /proc/96965/task/96972/fd (opendir: Permission denied) 2023-10-08T07:07:50.890 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96974 msgr-work root cwd unknown /proc/96965/task/96974/cwd (readlink: Permission denied) 2023-10-08T07:07:50.890 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96974 msgr-work root rtd unknown /proc/96965/task/96974/root (readlink: Permission denied) 2023-10-08T07:07:50.890 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96974 msgr-work root txt unknown /proc/96965/task/96974/exe (readlink: Permission denied) 2023-10-08T07:07:50.890 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96974 msgr-work root NOFD /proc/96965/task/96974/fd (opendir: Permission denied) 2023-10-08T07:07:50.890 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96975 msgr-work root cwd unknown /proc/96965/task/96975/cwd (readlink: Permission denied) 2023-10-08T07:07:50.890 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96975 msgr-work root rtd unknown /proc/96965/task/96975/root (readlink: Permission denied) 2023-10-08T07:07:50.890 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96975 msgr-work root txt unknown /proc/96965/task/96975/exe (readlink: Permission denied) 2023-10-08T07:07:50.890 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96975 msgr-work root NOFD /proc/96965/task/96975/fd (opendir: Permission denied) 2023-10-08T07:07:50.890 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96976 msgr-work root cwd unknown /proc/96965/task/96976/cwd (readlink: Permission denied) 2023-10-08T07:07:50.890 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96976 msgr-work root rtd unknown /proc/96965/task/96976/root (readlink: Permission denied) 2023-10-08T07:07:50.890 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96976 msgr-work root txt unknown /proc/96965/task/96976/exe (readlink: Permission denied) 2023-10-08T07:07:50.891 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 96976 msgr-work root NOFD /proc/96965/task/96976/fd (opendir: Permission denied) 2023-10-08T07:07:50.891 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97113 service root cwd unknown /proc/96965/task/97113/cwd (readlink: Permission denied) 2023-10-08T07:07:50.891 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97113 service root rtd unknown /proc/96965/task/97113/root (readlink: Permission denied) 2023-10-08T07:07:50.891 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97113 service root txt unknown /proc/96965/task/97113/exe (readlink: Permission denied) 2023-10-08T07:07:50.891 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97113 service root NOFD /proc/96965/task/97113/fd (opendir: Permission denied) 2023-10-08T07:07:50.891 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97114 admin_soc root cwd unknown /proc/96965/task/97114/cwd (readlink: Permission denied) 2023-10-08T07:07:50.891 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97114 admin_soc root rtd unknown /proc/96965/task/97114/root (readlink: Permission denied) 2023-10-08T07:07:50.891 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97114 admin_soc root txt unknown /proc/96965/task/97114/exe (readlink: Permission denied) 2023-10-08T07:07:50.891 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97114 admin_soc root NOFD /proc/96965/task/97114/fd (opendir: Permission denied) 2023-10-08T07:07:50.891 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97115 ceph_time root cwd unknown /proc/96965/task/97115/cwd (readlink: Permission denied) 2023-10-08T07:07:50.891 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97115 ceph_time root rtd unknown /proc/96965/task/97115/root (readlink: Permission denied) 2023-10-08T07:07:50.892 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97115 ceph_time root txt unknown /proc/96965/task/97115/exe (readlink: Permission denied) 2023-10-08T07:07:50.892 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97115 ceph_time root NOFD /proc/96965/task/97115/fd (opendir: Permission denied) 2023-10-08T07:07:50.892 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97117 fn_anonym root cwd unknown /proc/96965/task/97117/cwd (readlink: Permission denied) 2023-10-08T07:07:50.892 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97117 fn_anonym root rtd unknown /proc/96965/task/97117/root (readlink: Permission denied) 2023-10-08T07:07:50.892 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97117 fn_anonym root txt unknown /proc/96965/task/97117/exe (readlink: Permission denied) 2023-10-08T07:07:50.892 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97117 fn_anonym root NOFD /proc/96965/task/97117/fd (opendir: Permission denied) 2023-10-08T07:07:50.892 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97118 signal_ha root cwd unknown /proc/96965/task/97118/cwd (readlink: Permission denied) 2023-10-08T07:07:50.892 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97118 signal_ha root rtd unknown /proc/96965/task/97118/root (readlink: Permission denied) 2023-10-08T07:07:50.892 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97118 signal_ha root txt unknown /proc/96965/task/97118/exe (readlink: Permission denied) 2023-10-08T07:07:50.892 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97118 signal_ha root NOFD /proc/96965/task/97118/fd (opendir: Permission denied) 2023-10-08T07:07:50.892 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97119 mgrsb-fin root cwd unknown /proc/96965/task/97119/cwd (readlink: Permission denied) 2023-10-08T07:07:50.892 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97119 mgrsb-fin root rtd unknown /proc/96965/task/97119/root (readlink: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97119 mgrsb-fin root txt unknown /proc/96965/task/97119/exe (readlink: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97119 mgrsb-fin root NOFD /proc/96965/task/97119/fd (opendir: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97120 ms_dispat root cwd unknown /proc/96965/task/97120/cwd (readlink: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97120 ms_dispat root rtd unknown /proc/96965/task/97120/root (readlink: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97120 ms_dispat root txt unknown /proc/96965/task/97120/exe (readlink: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97120 ms_dispat root NOFD /proc/96965/task/97120/fd (opendir: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97121 ms_local root cwd unknown /proc/96965/task/97121/cwd (readlink: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97121 ms_local root rtd unknown /proc/96965/task/97121/root (readlink: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97121 ms_local root txt unknown /proc/96965/task/97121/exe (readlink: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97121 ms_local root NOFD /proc/96965/task/97121/fd (opendir: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97123 io_contex root cwd unknown /proc/96965/task/97123/cwd (readlink: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97123 io_contex root rtd unknown /proc/96965/task/97123/root (readlink: Permission denied) 2023-10-08T07:07:50.893 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97123 io_contex root txt unknown /proc/96965/task/97123/exe (readlink: Permission denied) 2023-10-08T07:07:50.894 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97123 io_contex root NOFD /proc/96965/task/97123/fd (opendir: Permission denied) 2023-10-08T07:07:50.894 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97124 io_contex root cwd unknown /proc/96965/task/97124/cwd (readlink: Permission denied) 2023-10-08T07:07:50.894 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97124 io_contex root rtd unknown /proc/96965/task/97124/root (readlink: Permission denied) 2023-10-08T07:07:50.894 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97124 io_contex root txt unknown /proc/96965/task/97124/exe (readlink: Permission denied) 2023-10-08T07:07:50.894 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97124 io_contex root NOFD /proc/96965/task/97124/fd (opendir: Permission denied) 2023-10-08T07:07:50.894 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97126 safe_time root cwd unknown /proc/96965/task/97126/cwd (readlink: Permission denied) 2023-10-08T07:07:50.894 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97126 safe_time root rtd unknown /proc/96965/task/97126/root (readlink: Permission denied) 2023-10-08T07:07:50.894 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97126 safe_time root txt unknown /proc/96965/task/97126/exe (readlink: Permission denied) 2023-10-08T07:07:50.894 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97126 safe_time root NOFD /proc/96965/task/97126/fd (opendir: Permission denied) 2023-10-08T07:07:50.894 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97128 safe_time root cwd unknown /proc/96965/task/97128/cwd (readlink: Permission denied) 2023-10-08T07:07:50.894 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97128 safe_time root rtd unknown /proc/96965/task/97128/root (readlink: Permission denied) 2023-10-08T07:07:50.894 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97128 safe_time root txt unknown /proc/96965/task/97128/exe (readlink: Permission denied) 2023-10-08T07:07:50.895 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97128 safe_time root NOFD /proc/96965/task/97128/fd (opendir: Permission denied) 2023-10-08T07:07:50.895 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97131 safe_time root cwd unknown /proc/96965/task/97131/cwd (readlink: Permission denied) 2023-10-08T07:07:50.895 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97131 safe_time root rtd unknown /proc/96965/task/97131/root (readlink: Permission denied) 2023-10-08T07:07:50.895 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97131 safe_time root txt unknown /proc/96965/task/97131/exe (readlink: Permission denied) 2023-10-08T07:07:50.895 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97131 safe_time root NOFD /proc/96965/task/97131/fd (opendir: Permission denied) 2023-10-08T07:07:50.895 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97132 fn_anonym root cwd unknown /proc/96965/task/97132/cwd (readlink: Permission denied) 2023-10-08T07:07:50.895 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97132 fn_anonym root rtd unknown /proc/96965/task/97132/root (readlink: Permission denied) 2023-10-08T07:07:50.895 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97132 fn_anonym root txt unknown /proc/96965/task/97132/exe (readlink: Permission denied) 2023-10-08T07:07:50.895 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97132 fn_anonym root NOFD /proc/96965/task/97132/fd (opendir: Permission denied) 2023-10-08T07:07:50.895 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97133 flusher root cwd unknown /proc/96965/task/97133/cwd (readlink: Permission denied) 2023-10-08T07:07:50.895 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97133 flusher root rtd unknown /proc/96965/task/97133/root (readlink: Permission denied) 2023-10-08T07:07:50.895 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97133 flusher root txt unknown /proc/96965/task/97133/exe (readlink: Permission denied) 2023-10-08T07:07:50.896 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97133 flusher root NOFD /proc/96965/task/97133/fd (opendir: Permission denied) 2023-10-08T07:07:50.896 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97134 safe_time root cwd unknown /proc/96965/task/97134/cwd (readlink: Permission denied) 2023-10-08T07:07:50.896 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97134 safe_time root rtd unknown /proc/96965/task/97134/root (readlink: Permission denied) 2023-10-08T07:07:50.896 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97134 safe_time root txt unknown /proc/96965/task/97134/exe (readlink: Permission denied) 2023-10-08T07:07:50.896 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97134 safe_time root NOFD /proc/96965/task/97134/fd (opendir: Permission denied) 2023-10-08T07:07:50.896 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97365 mgr-fin root cwd unknown /proc/96965/task/97365/cwd (readlink: Permission denied) 2023-10-08T07:07:50.896 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97365 mgr-fin root rtd unknown /proc/96965/task/97365/root (readlink: Permission denied) 2023-10-08T07:07:50.896 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97365 mgr-fin root txt unknown /proc/96965/task/97365/exe (readlink: Permission denied) 2023-10-08T07:07:50.896 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97365 mgr-fin root NOFD /proc/96965/task/97365/fd (opendir: Permission denied) 2023-10-08T07:07:50.896 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97366 ms_dispat root cwd unknown /proc/96965/task/97366/cwd (readlink: Permission denied) 2023-10-08T07:07:50.896 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97366 ms_dispat root rtd unknown /proc/96965/task/97366/root (readlink: Permission denied) 2023-10-08T07:07:50.896 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97366 ms_dispat root txt unknown /proc/96965/task/97366/exe (readlink: Permission denied) 2023-10-08T07:07:50.897 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97366 ms_dispat root NOFD /proc/96965/task/97366/fd (opendir: Permission denied) 2023-10-08T07:07:50.897 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97367 ms_local root cwd unknown /proc/96965/task/97367/cwd (readlink: Permission denied) 2023-10-08T07:07:50.897 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97367 ms_local root rtd unknown /proc/96965/task/97367/root (readlink: Permission denied) 2023-10-08T07:07:50.897 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97367 ms_local root txt unknown /proc/96965/task/97367/exe (readlink: Permission denied) 2023-10-08T07:07:50.897 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97367 ms_local root NOFD /proc/96965/task/97367/fd (opendir: Permission denied) 2023-10-08T07:07:50.897 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97368 safe_time root cwd unknown /proc/96965/task/97368/cwd (readlink: Permission denied) 2023-10-08T07:07:50.897 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97368 safe_time root rtd unknown /proc/96965/task/97368/root (readlink: Permission denied) 2023-10-08T07:07:50.897 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97368 safe_time root txt unknown /proc/96965/task/97368/exe (readlink: Permission denied) 2023-10-08T07:07:50.897 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97368 safe_time root NOFD /proc/96965/task/97368/fd (opendir: Permission denied) 2023-10-08T07:07:50.897 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97369 cmdfin root cwd unknown /proc/96965/task/97369/cwd (readlink: Permission denied) 2023-10-08T07:07:50.897 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97369 cmdfin root rtd unknown /proc/96965/task/97369/root (readlink: Permission denied) 2023-10-08T07:07:50.897 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97369 cmdfin root txt unknown /proc/96965/task/97369/exe (readlink: Permission denied) 2023-10-08T07:07:50.898 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97369 cmdfin root NOFD /proc/96965/task/97369/fd (opendir: Permission denied) 2023-10-08T07:07:50.898 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97373 io_contex root cwd unknown /proc/96965/task/97373/cwd (readlink: Permission denied) 2023-10-08T07:07:50.898 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97373 io_contex root rtd unknown /proc/96965/task/97373/root (readlink: Permission denied) 2023-10-08T07:07:50.898 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97373 io_contex root txt unknown /proc/96965/task/97373/exe (readlink: Permission denied) 2023-10-08T07:07:50.898 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97373 io_contex root NOFD /proc/96965/task/97373/fd (opendir: Permission denied) 2023-10-08T07:07:50.898 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97374 io_contex root cwd unknown /proc/96965/task/97374/cwd (readlink: Permission denied) 2023-10-08T07:07:50.898 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97374 io_contex root rtd unknown /proc/96965/task/97374/root (readlink: Permission denied) 2023-10-08T07:07:50.898 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97374 io_contex root txt unknown /proc/96965/task/97374/exe (readlink: Permission denied) 2023-10-08T07:07:50.898 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97374 io_contex root NOFD /proc/96965/task/97374/fd (opendir: Permission denied) 2023-10-08T07:07:50.898 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97375 ceph_time root cwd unknown /proc/96965/task/97375/cwd (readlink: Permission denied) 2023-10-08T07:07:50.898 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97375 ceph_time root rtd unknown /proc/96965/task/97375/root (readlink: Permission denied) 2023-10-08T07:07:50.899 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97375 ceph_time root txt unknown /proc/96965/task/97375/exe (readlink: Permission denied) 2023-10-08T07:07:50.899 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97375 ceph_time root NOFD /proc/96965/task/97375/fd (opendir: Permission denied) 2023-10-08T07:07:50.899 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97376 ms_dispat root cwd unknown /proc/96965/task/97376/cwd (readlink: Permission denied) 2023-10-08T07:07:50.899 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97376 ms_dispat root rtd unknown /proc/96965/task/97376/root (readlink: Permission denied) 2023-10-08T07:07:50.899 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97376 ms_dispat root txt unknown /proc/96965/task/97376/exe (readlink: Permission denied) 2023-10-08T07:07:50.899 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97376 ms_dispat root NOFD /proc/96965/task/97376/fd (opendir: Permission denied) 2023-10-08T07:07:50.899 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97377 ms_local root cwd unknown /proc/96965/task/97377/cwd (readlink: Permission denied) 2023-10-08T07:07:50.899 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97377 ms_local root rtd unknown /proc/96965/task/97377/root (readlink: Permission denied) 2023-10-08T07:07:50.899 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97377 ms_local root txt unknown /proc/96965/task/97377/exe (readlink: Permission denied) 2023-10-08T07:07:50.899 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97377 ms_local root NOFD /proc/96965/task/97377/fd (opendir: Permission denied) 2023-10-08T07:07:50.899 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97378 safe_time root cwd unknown /proc/96965/task/97378/cwd (readlink: Permission denied) 2023-10-08T07:07:50.899 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97378 safe_time root rtd unknown /proc/96965/task/97378/root (readlink: Permission denied) 2023-10-08T07:07:50.900 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97378 safe_time root txt unknown /proc/96965/task/97378/exe (readlink: Permission denied) 2023-10-08T07:07:50.900 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97378 safe_time root NOFD /proc/96965/task/97378/fd (opendir: Permission denied) 2023-10-08T07:07:50.900 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97379 safe_time root cwd unknown /proc/96965/task/97379/cwd (readlink: Permission denied) 2023-10-08T07:07:50.900 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97379 safe_time root rtd unknown /proc/96965/task/97379/root (readlink: Permission denied) 2023-10-08T07:07:50.900 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97379 safe_time root txt unknown /proc/96965/task/97379/exe (readlink: Permission denied) 2023-10-08T07:07:50.900 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97379 safe_time root NOFD /proc/96965/task/97379/fd (opendir: Permission denied) 2023-10-08T07:07:50.900 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97380 balancer root cwd unknown /proc/96965/task/97380/cwd (readlink: Permission denied) 2023-10-08T07:07:50.900 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97380 balancer root rtd unknown /proc/96965/task/97380/root (readlink: Permission denied) 2023-10-08T07:07:50.900 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97380 balancer root txt unknown /proc/96965/task/97380/exe (readlink: Permission denied) 2023-10-08T07:07:50.900 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97380 balancer root NOFD /proc/96965/task/97380/fd (opendir: Permission denied) 2023-10-08T07:07:50.900 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97381 m-fin-bal root cwd unknown /proc/96965/task/97381/cwd (readlink: Permission denied) 2023-10-08T07:07:50.901 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97381 m-fin-bal root rtd unknown /proc/96965/task/97381/root (readlink: Permission denied) 2023-10-08T07:07:50.901 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97381 m-fin-bal root txt unknown /proc/96965/task/97381/exe (readlink: Permission denied) 2023-10-08T07:07:50.901 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97381 m-fin-bal root NOFD /proc/96965/task/97381/fd (opendir: Permission denied) 2023-10-08T07:07:50.901 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97382 crash root cwd unknown /proc/96965/task/97382/cwd (readlink: Permission denied) 2023-10-08T07:07:50.901 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97382 crash root rtd unknown /proc/96965/task/97382/root (readlink: Permission denied) 2023-10-08T07:07:50.901 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97382 crash root txt unknown /proc/96965/task/97382/exe (readlink: Permission denied) 2023-10-08T07:07:50.901 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97382 crash root NOFD /proc/96965/task/97382/fd (opendir: Permission denied) 2023-10-08T07:07:50.901 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97383 m-fin-cra root cwd unknown /proc/96965/task/97383/cwd (readlink: Permission denied) 2023-10-08T07:07:50.901 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97383 m-fin-cra root rtd unknown /proc/96965/task/97383/root (readlink: Permission denied) 2023-10-08T07:07:50.901 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97383 m-fin-cra root txt unknown /proc/96965/task/97383/exe (readlink: Permission denied) 2023-10-08T07:07:50.901 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97383 m-fin-cra root NOFD /proc/96965/task/97383/fd (opendir: Permission denied) 2023-10-08T07:07:50.901 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97384 devicehea root cwd unknown /proc/96965/task/97384/cwd (readlink: Permission denied) 2023-10-08T07:07:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97384 devicehea root rtd unknown /proc/96965/task/97384/root (readlink: Permission denied) 2023-10-08T07:07:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97384 devicehea root txt unknown /proc/96965/task/97384/exe (readlink: Permission denied) 2023-10-08T07:07:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97384 devicehea root NOFD /proc/96965/task/97384/fd (opendir: Permission denied) 2023-10-08T07:07:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97385 m-fin-dev root cwd unknown /proc/96965/task/97385/cwd (readlink: Permission denied) 2023-10-08T07:07:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97385 m-fin-dev root rtd unknown /proc/96965/task/97385/root (readlink: Permission denied) 2023-10-08T07:07:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97385 m-fin-dev root txt unknown /proc/96965/task/97385/exe (readlink: Permission denied) 2023-10-08T07:07:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97385 m-fin-dev root NOFD /proc/96965/task/97385/fd (opendir: Permission denied) 2023-10-08T07:07:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97387 m-fin-ios root cwd unknown /proc/96965/task/97387/cwd (readlink: Permission denied) 2023-10-08T07:07:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97387 m-fin-ios root rtd unknown /proc/96965/task/97387/root (readlink: Permission denied) 2023-10-08T07:07:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97387 m-fin-ios root txt unknown /proc/96965/task/97387/exe (readlink: Permission denied) 2023-10-08T07:07:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97387 m-fin-ios root NOFD /proc/96965/task/97387/fd (opendir: Permission denied) 2023-10-08T07:07:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97389 m-fin-nfs root cwd unknown /proc/96965/task/97389/cwd (readlink: Permission denied) 2023-10-08T07:07:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97389 m-fin-nfs root rtd unknown /proc/96965/task/97389/root (readlink: Permission denied) 2023-10-08T07:07:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97389 m-fin-nfs root txt unknown /proc/96965/task/97389/exe (readlink: Permission denied) 2023-10-08T07:07:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97389 m-fin-nfs root NOFD /proc/96965/task/97389/fd (opendir: Permission denied) 2023-10-08T07:07:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97391 m-fin-orc root cwd unknown /proc/96965/task/97391/cwd (readlink: Permission denied) 2023-10-08T07:07:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97391 m-fin-orc root rtd unknown /proc/96965/task/97391/root (readlink: Permission denied) 2023-10-08T07:07:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97391 m-fin-orc root txt unknown /proc/96965/task/97391/exe (readlink: Permission denied) 2023-10-08T07:07:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97391 m-fin-orc root NOFD /proc/96965/task/97391/fd (opendir: Permission denied) 2023-10-08T07:07:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97392 pg_autosc root cwd unknown /proc/96965/task/97392/cwd (readlink: Permission denied) 2023-10-08T07:07:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97392 pg_autosc root rtd unknown /proc/96965/task/97392/root (readlink: Permission denied) 2023-10-08T07:07:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97392 pg_autosc root txt unknown /proc/96965/task/97392/exe (readlink: Permission denied) 2023-10-08T07:07:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97392 pg_autosc root NOFD /proc/96965/task/97392/fd (opendir: Permission denied) 2023-10-08T07:07:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97393 m-fin-pg_ root cwd unknown /proc/96965/task/97393/cwd (readlink: Permission denied) 2023-10-08T07:07:50.904 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97393 m-fin-pg_ root rtd unknown /proc/96965/task/97393/root (readlink: Permission denied) 2023-10-08T07:07:50.904 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97393 m-fin-pg_ root txt unknown /proc/96965/task/97393/exe (readlink: Permission denied) 2023-10-08T07:07:50.904 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97393 m-fin-pg_ root NOFD /proc/96965/task/97393/fd (opendir: Permission denied) 2023-10-08T07:07:50.904 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97394 progress root cwd unknown /proc/96965/task/97394/cwd (readlink: Permission denied) 2023-10-08T07:07:50.904 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97394 progress root rtd unknown /proc/96965/task/97394/root (readlink: Permission denied) 2023-10-08T07:07:50.904 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97394 progress root txt unknown /proc/96965/task/97394/exe (readlink: Permission denied) 2023-10-08T07:07:50.904 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97394 progress root NOFD /proc/96965/task/97394/fd (opendir: Permission denied) 2023-10-08T07:07:50.904 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97395 m-fin-pro root cwd unknown /proc/96965/task/97395/cwd (readlink: Permission denied) 2023-10-08T07:07:50.904 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97395 m-fin-pro root rtd unknown /proc/96965/task/97395/root (readlink: Permission denied) 2023-10-08T07:07:50.904 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97395 m-fin-pro root txt unknown /proc/96965/task/97395/exe (readlink: Permission denied) 2023-10-08T07:07:50.904 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97395 m-fin-pro root NOFD /proc/96965/task/97395/fd (opendir: Permission denied) 2023-10-08T07:07:50.904 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97399 io_contex root cwd unknown /proc/96965/task/97399/cwd (readlink: Permission denied) 2023-10-08T07:07:50.905 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97399 io_contex root rtd unknown /proc/96965/task/97399/root (readlink: Permission denied) 2023-10-08T07:07:50.905 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97399 io_contex root txt unknown /proc/96965/task/97399/exe (readlink: Permission denied) 2023-10-08T07:07:50.905 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97399 io_contex root NOFD /proc/96965/task/97399/fd (opendir: Permission denied) 2023-10-08T07:07:50.905 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97400 io_contex root cwd unknown /proc/96965/task/97400/cwd (readlink: Permission denied) 2023-10-08T07:07:50.905 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97400 io_contex root rtd unknown /proc/96965/task/97400/root (readlink: Permission denied) 2023-10-08T07:07:50.905 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97400 io_contex root txt unknown /proc/96965/task/97400/exe (readlink: Permission denied) 2023-10-08T07:07:50.905 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97400 io_contex root NOFD /proc/96965/task/97400/fd (opendir: Permission denied) 2023-10-08T07:07:50.905 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97401 ceph_time root cwd unknown /proc/96965/task/97401/cwd (readlink: Permission denied) 2023-10-08T07:07:50.905 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97401 ceph_time root rtd unknown /proc/96965/task/97401/root (readlink: Permission denied) 2023-10-08T07:07:50.905 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97401 ceph_time root txt unknown /proc/96965/task/97401/exe (readlink: Permission denied) 2023-10-08T07:07:50.905 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97401 ceph_time root NOFD /proc/96965/task/97401/fd (opendir: Permission denied) 2023-10-08T07:07:50.905 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97402 ms_dispat root cwd unknown /proc/96965/task/97402/cwd (readlink: Permission denied) 2023-10-08T07:07:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97402 ms_dispat root rtd unknown /proc/96965/task/97402/root (readlink: Permission denied) 2023-10-08T07:07:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97402 ms_dispat root txt unknown /proc/96965/task/97402/exe (readlink: Permission denied) 2023-10-08T07:07:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97402 ms_dispat root NOFD /proc/96965/task/97402/fd (opendir: Permission denied) 2023-10-08T07:07:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97403 ms_local root cwd unknown /proc/96965/task/97403/cwd (readlink: Permission denied) 2023-10-08T07:07:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97403 ms_local root rtd unknown /proc/96965/task/97403/root (readlink: Permission denied) 2023-10-08T07:07:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97403 ms_local root txt unknown /proc/96965/task/97403/exe (readlink: Permission denied) 2023-10-08T07:07:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97403 ms_local root NOFD /proc/96965/task/97403/fd (opendir: Permission denied) 2023-10-08T07:07:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97404 safe_time root cwd unknown /proc/96965/task/97404/cwd (readlink: Permission denied) 2023-10-08T07:07:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97404 safe_time root rtd unknown /proc/96965/task/97404/root (readlink: Permission denied) 2023-10-08T07:07:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97404 safe_time root txt unknown /proc/96965/task/97404/exe (readlink: Permission denied) 2023-10-08T07:07:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97404 safe_time root NOFD /proc/96965/task/97404/fd (opendir: Permission denied) 2023-10-08T07:07:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97405 safe_time root cwd unknown /proc/96965/task/97405/cwd (readlink: Permission denied) 2023-10-08T07:07:50.907 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97405 safe_time root rtd unknown /proc/96965/task/97405/root (readlink: Permission denied) 2023-10-08T07:07:50.907 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97405 safe_time root txt unknown /proc/96965/task/97405/exe (readlink: Permission denied) 2023-10-08T07:07:50.907 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97405 safe_time root NOFD /proc/96965/task/97405/fd (opendir: Permission denied) 2023-10-08T07:07:50.907 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97406 mgr-fin root cwd unknown /proc/96965/task/97406/cwd (readlink: Permission denied) 2023-10-08T07:07:50.907 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97406 mgr-fin root rtd unknown /proc/96965/task/97406/root (readlink: Permission denied) 2023-10-08T07:07:50.907 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97406 mgr-fin root txt unknown /proc/96965/task/97406/exe (readlink: Permission denied) 2023-10-08T07:07:50.907 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97406 mgr-fin root NOFD /proc/96965/task/97406/fd (opendir: Permission denied) 2023-10-08T07:07:50.907 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97408 m-fin-rbd root cwd unknown /proc/96965/task/97408/cwd (readlink: Permission denied) 2023-10-08T07:07:50.907 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97408 m-fin-rbd root rtd unknown /proc/96965/task/97408/root (readlink: Permission denied) 2023-10-08T07:07:50.907 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97408 m-fin-rbd root txt unknown /proc/96965/task/97408/exe (readlink: Permission denied) 2023-10-08T07:07:50.907 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97408 m-fin-rbd root NOFD /proc/96965/task/97408/fd (opendir: Permission denied) 2023-10-08T07:07:50.907 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97409 restful root cwd unknown /proc/96965/task/97409/cwd (readlink: Permission denied) 2023-10-08T07:07:50.908 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97409 restful root rtd unknown /proc/96965/task/97409/root (readlink: Permission denied) 2023-10-08T07:07:50.908 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97409 restful root txt unknown /proc/96965/task/97409/exe (readlink: Permission denied) 2023-10-08T07:07:50.908 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97409 restful root NOFD /proc/96965/task/97409/fd (opendir: Permission denied) 2023-10-08T07:07:50.908 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97410 m-fin-res root cwd unknown /proc/96965/task/97410/cwd (readlink: Permission denied) 2023-10-08T07:07:50.908 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97410 m-fin-res root rtd unknown /proc/96965/task/97410/root (readlink: Permission denied) 2023-10-08T07:07:50.908 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97410 m-fin-res root txt unknown /proc/96965/task/97410/exe (readlink: Permission denied) 2023-10-08T07:07:50.908 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97410 m-fin-res root NOFD /proc/96965/task/97410/fd (opendir: Permission denied) 2023-10-08T07:07:50.908 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97412 m-fin-sta root cwd unknown /proc/96965/task/97412/cwd (readlink: Permission denied) 2023-10-08T07:07:50.908 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97412 m-fin-sta root rtd unknown /proc/96965/task/97412/root (readlink: Permission denied) 2023-10-08T07:07:50.908 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97412 m-fin-sta root txt unknown /proc/96965/task/97412/exe (readlink: Permission denied) 2023-10-08T07:07:50.908 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97412 m-fin-sta root NOFD /proc/96965/task/97412/fd (opendir: Permission denied) 2023-10-08T07:07:50.908 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97413 mgr-fin root cwd unknown /proc/96965/task/97413/cwd (readlink: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97413 mgr-fin root rtd unknown /proc/96965/task/97413/root (readlink: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97413 mgr-fin root txt unknown /proc/96965/task/97413/exe (readlink: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97413 mgr-fin root NOFD /proc/96965/task/97413/fd (opendir: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97414 mgr-fin root cwd unknown /proc/96965/task/97414/cwd (readlink: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97414 mgr-fin root rtd unknown /proc/96965/task/97414/root (readlink: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97414 mgr-fin root txt unknown /proc/96965/task/97414/exe (readlink: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97414 mgr-fin root NOFD /proc/96965/task/97414/fd (opendir: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97415 mgr-fin root cwd unknown /proc/96965/task/97415/cwd (readlink: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97415 mgr-fin root rtd unknown /proc/96965/task/97415/root (readlink: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97415 mgr-fin root txt unknown /proc/96965/task/97415/exe (readlink: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97415 mgr-fin root NOFD /proc/96965/task/97415/fd (opendir: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97416 telemetry root cwd unknown /proc/96965/task/97416/cwd (readlink: Permission denied) 2023-10-08T07:07:50.909 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97416 telemetry root rtd unknown /proc/96965/task/97416/root (readlink: Permission denied) 2023-10-08T07:07:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97416 telemetry root txt unknown /proc/96965/task/97416/exe (readlink: Permission denied) 2023-10-08T07:07:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97416 telemetry root NOFD /proc/96965/task/97416/fd (opendir: Permission denied) 2023-10-08T07:07:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97417 m-fin-tel root cwd unknown /proc/96965/task/97417/cwd (readlink: Permission denied) 2023-10-08T07:07:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97417 m-fin-tel root rtd unknown /proc/96965/task/97417/root (readlink: Permission denied) 2023-10-08T07:07:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97417 m-fin-tel root txt unknown /proc/96965/task/97417/exe (readlink: Permission denied) 2023-10-08T07:07:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97417 m-fin-tel root NOFD /proc/96965/task/97417/fd (opendir: Permission denied) 2023-10-08T07:07:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97418 mgr-fin root cwd unknown /proc/96965/task/97418/cwd (readlink: Permission denied) 2023-10-08T07:07:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97418 mgr-fin root rtd unknown /proc/96965/task/97418/root (readlink: Permission denied) 2023-10-08T07:07:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97418 mgr-fin root txt unknown /proc/96965/task/97418/exe (readlink: Permission denied) 2023-10-08T07:07:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97418 mgr-fin root NOFD /proc/96965/task/97418/fd (opendir: Permission denied) 2023-10-08T07:07:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97419 mgr-fin root cwd unknown /proc/96965/task/97419/cwd (readlink: Permission denied) 2023-10-08T07:07:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97419 mgr-fin root rtd unknown /proc/96965/task/97419/root (readlink: Permission denied) 2023-10-08T07:07:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97419 mgr-fin root txt unknown /proc/96965/task/97419/exe (readlink: Permission denied) 2023-10-08T07:07:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97419 mgr-fin root NOFD /proc/96965/task/97419/fd (opendir: Permission denied) 2023-10-08T07:07:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97423 io_contex root cwd unknown /proc/96965/task/97423/cwd (readlink: Permission denied) 2023-10-08T07:07:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97423 io_contex root rtd unknown /proc/96965/task/97423/root (readlink: Permission denied) 2023-10-08T07:07:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97423 io_contex root txt unknown /proc/96965/task/97423/exe (readlink: Permission denied) 2023-10-08T07:07:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97423 io_contex root NOFD /proc/96965/task/97423/fd (opendir: Permission denied) 2023-10-08T07:07:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97424 io_contex root cwd unknown /proc/96965/task/97424/cwd (readlink: Permission denied) 2023-10-08T07:07:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97424 io_contex root rtd unknown /proc/96965/task/97424/root (readlink: Permission denied) 2023-10-08T07:07:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97424 io_contex root txt unknown /proc/96965/task/97424/exe (readlink: Permission denied) 2023-10-08T07:07:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97424 io_contex root NOFD /proc/96965/task/97424/fd (opendir: Permission denied) 2023-10-08T07:07:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97425 ceph_time root cwd unknown /proc/96965/task/97425/cwd (readlink: Permission denied) 2023-10-08T07:07:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97425 ceph_time root rtd unknown /proc/96965/task/97425/root (readlink: Permission denied) 2023-10-08T07:07:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97425 ceph_time root txt unknown /proc/96965/task/97425/exe (readlink: Permission denied) 2023-10-08T07:07:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97425 ceph_time root NOFD /proc/96965/task/97425/fd (opendir: Permission denied) 2023-10-08T07:07:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97426 ms_dispat root cwd unknown /proc/96965/task/97426/cwd (readlink: Permission denied) 2023-10-08T07:07:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97426 ms_dispat root rtd unknown /proc/96965/task/97426/root (readlink: Permission denied) 2023-10-08T07:07:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97426 ms_dispat root txt unknown /proc/96965/task/97426/exe (readlink: Permission denied) 2023-10-08T07:07:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97426 ms_dispat root NOFD /proc/96965/task/97426/fd (opendir: Permission denied) 2023-10-08T07:07:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97427 ms_local root cwd unknown /proc/96965/task/97427/cwd (readlink: Permission denied) 2023-10-08T07:07:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97427 ms_local root rtd unknown /proc/96965/task/97427/root (readlink: Permission denied) 2023-10-08T07:07:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97427 ms_local root txt unknown /proc/96965/task/97427/exe (readlink: Permission denied) 2023-10-08T07:07:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97427 ms_local root NOFD /proc/96965/task/97427/fd (opendir: Permission denied) 2023-10-08T07:07:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97428 safe_time root cwd unknown /proc/96965/task/97428/cwd (readlink: Permission denied) 2023-10-08T07:07:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97428 safe_time root rtd unknown /proc/96965/task/97428/root (readlink: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97428 safe_time root txt unknown /proc/96965/task/97428/exe (readlink: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97428 safe_time root NOFD /proc/96965/task/97428/fd (opendir: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97429 safe_time root cwd unknown /proc/96965/task/97429/cwd (readlink: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97429 safe_time root rtd unknown /proc/96965/task/97429/root (readlink: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97429 safe_time root txt unknown /proc/96965/task/97429/exe (readlink: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97429 safe_time root NOFD /proc/96965/task/97429/fd (opendir: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97430 mgr-fin root cwd unknown /proc/96965/task/97430/cwd (readlink: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97430 mgr-fin root rtd unknown /proc/96965/task/97430/root (readlink: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97430 mgr-fin root txt unknown /proc/96965/task/97430/exe (readlink: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97430 mgr-fin root NOFD /proc/96965/task/97430/fd (opendir: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97431 mgr-fin root cwd unknown /proc/96965/task/97431/cwd (readlink: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97431 mgr-fin root rtd unknown /proc/96965/task/97431/root (readlink: Permission denied) 2023-10-08T07:07:50.913 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97431 mgr-fin root txt unknown /proc/96965/task/97431/exe (readlink: Permission denied) 2023-10-08T07:07:50.914 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97431 mgr-fin root NOFD /proc/96965/task/97431/fd (opendir: Permission denied) 2023-10-08T07:07:50.914 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97432 mgr-fin root cwd unknown /proc/96965/task/97432/cwd (readlink: Permission denied) 2023-10-08T07:07:50.914 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97432 mgr-fin root rtd unknown /proc/96965/task/97432/root (readlink: Permission denied) 2023-10-08T07:07:50.914 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97432 mgr-fin root txt unknown /proc/96965/task/97432/exe (readlink: Permission denied) 2023-10-08T07:07:50.914 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97432 mgr-fin root NOFD /proc/96965/task/97432/fd (opendir: Permission denied) 2023-10-08T07:07:50.914 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97433 mgr-fin root cwd unknown /proc/96965/task/97433/cwd (readlink: Permission denied) 2023-10-08T07:07:50.914 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97433 mgr-fin root rtd unknown /proc/96965/task/97433/root (readlink: Permission denied) 2023-10-08T07:07:50.914 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97433 mgr-fin root txt unknown /proc/96965/task/97433/exe (readlink: Permission denied) 2023-10-08T07:07:50.914 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97433 mgr-fin root NOFD /proc/96965/task/97433/fd (opendir: Permission denied) 2023-10-08T07:07:50.914 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97434 mgr-fin root cwd unknown /proc/96965/task/97434/cwd (readlink: Permission denied) 2023-10-08T07:07:50.914 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97434 mgr-fin root rtd unknown /proc/96965/task/97434/root (readlink: Permission denied) 2023-10-08T07:07:50.914 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97434 mgr-fin root txt unknown /proc/96965/task/97434/exe (readlink: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97434 mgr-fin root NOFD /proc/96965/task/97434/fd (opendir: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97435 mgr-fin root cwd unknown /proc/96965/task/97435/cwd (readlink: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97435 mgr-fin root rtd unknown /proc/96965/task/97435/root (readlink: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97435 mgr-fin root txt unknown /proc/96965/task/97435/exe (readlink: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97435 mgr-fin root NOFD /proc/96965/task/97435/fd (opendir: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97436 mgr-fin root cwd unknown /proc/96965/task/97436/cwd (readlink: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97436 mgr-fin root rtd unknown /proc/96965/task/97436/root (readlink: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97436 mgr-fin root txt unknown /proc/96965/task/97436/exe (readlink: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97436 mgr-fin root NOFD /proc/96965/task/97436/fd (opendir: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97437 mgr-fin root cwd unknown /proc/96965/task/97437/cwd (readlink: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97437 mgr-fin root rtd unknown /proc/96965/task/97437/root (readlink: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97437 mgr-fin root txt unknown /proc/96965/task/97437/exe (readlink: Permission denied) 2023-10-08T07:07:50.915 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97437 mgr-fin root NOFD /proc/96965/task/97437/fd (opendir: Permission denied) 2023-10-08T07:07:50.916 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97438 mgr-fin root cwd unknown /proc/96965/task/97438/cwd (readlink: Permission denied) 2023-10-08T07:07:50.916 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97438 mgr-fin root rtd unknown /proc/96965/task/97438/root (readlink: Permission denied) 2023-10-08T07:07:50.916 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97438 mgr-fin root txt unknown /proc/96965/task/97438/exe (readlink: Permission denied) 2023-10-08T07:07:50.916 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97438 mgr-fin root NOFD /proc/96965/task/97438/fd (opendir: Permission denied) 2023-10-08T07:07:50.916 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97439 mgr-fin root cwd unknown /proc/96965/task/97439/cwd (readlink: Permission denied) 2023-10-08T07:07:50.916 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97439 mgr-fin root rtd unknown /proc/96965/task/97439/root (readlink: Permission denied) 2023-10-08T07:07:50.916 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97439 mgr-fin root txt unknown /proc/96965/task/97439/exe (readlink: Permission denied) 2023-10-08T07:07:50.916 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97439 mgr-fin root NOFD /proc/96965/task/97439/fd (opendir: Permission denied) 2023-10-08T07:07:50.916 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97440 mgr-fin root cwd unknown /proc/96965/task/97440/cwd (readlink: Permission denied) 2023-10-08T07:07:50.916 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97440 mgr-fin root rtd unknown /proc/96965/task/97440/root (readlink: Permission denied) 2023-10-08T07:07:50.916 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97440 mgr-fin root txt unknown /proc/96965/task/97440/exe (readlink: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97440 mgr-fin root NOFD /proc/96965/task/97440/fd (opendir: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97441 mgr-fin root cwd unknown /proc/96965/task/97441/cwd (readlink: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97441 mgr-fin root rtd unknown /proc/96965/task/97441/root (readlink: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97441 mgr-fin root txt unknown /proc/96965/task/97441/exe (readlink: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97441 mgr-fin root NOFD /proc/96965/task/97441/fd (opendir: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97443 m-fin-vol root cwd unknown /proc/96965/task/97443/cwd (readlink: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97443 m-fin-vol root rtd unknown /proc/96965/task/97443/root (readlink: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97443 m-fin-vol root txt unknown /proc/96965/task/97443/exe (readlink: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97443 m-fin-vol root NOFD /proc/96965/task/97443/fd (opendir: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97489 devicehea root cwd unknown /proc/96965/task/97489/cwd (readlink: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97489 devicehea root rtd unknown /proc/96965/task/97489/root (readlink: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97489 devicehea root txt unknown /proc/96965/task/97489/exe (readlink: Permission denied) 2023-10-08T07:07:50.917 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97489 devicehea root NOFD /proc/96965/task/97489/fd (opendir: Permission denied) 2023-10-08T07:07:50.918 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97493 io_contex root cwd unknown /proc/96965/task/97493/cwd (readlink: Permission denied) 2023-10-08T07:07:50.918 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97493 io_contex root rtd unknown /proc/96965/task/97493/root (readlink: Permission denied) 2023-10-08T07:07:50.918 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97493 io_contex root txt unknown /proc/96965/task/97493/exe (readlink: Permission denied) 2023-10-08T07:07:50.918 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97493 io_contex root NOFD /proc/96965/task/97493/fd (opendir: Permission denied) 2023-10-08T07:07:50.918 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97494 io_contex root cwd unknown /proc/96965/task/97494/cwd (readlink: Permission denied) 2023-10-08T07:07:50.918 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97494 io_contex root rtd unknown /proc/96965/task/97494/root (readlink: Permission denied) 2023-10-08T07:07:50.918 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97494 io_contex root txt unknown /proc/96965/task/97494/exe (readlink: Permission denied) 2023-10-08T07:07:50.918 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97494 io_contex root NOFD /proc/96965/task/97494/fd (opendir: Permission denied) 2023-10-08T07:07:50.918 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97495 ceph_time root cwd unknown /proc/96965/task/97495/cwd (readlink: Permission denied) 2023-10-08T07:07:50.918 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97495 ceph_time root rtd unknown /proc/96965/task/97495/root (readlink: Permission denied) 2023-10-08T07:07:50.918 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97495 ceph_time root txt unknown /proc/96965/task/97495/exe (readlink: Permission denied) 2023-10-08T07:07:50.918 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97495 ceph_time root NOFD /proc/96965/task/97495/fd (opendir: Permission denied) 2023-10-08T07:07:50.919 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97496 ms_dispat root cwd unknown /proc/96965/task/97496/cwd (readlink: Permission denied) 2023-10-08T07:07:50.919 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97496 ms_dispat root rtd unknown /proc/96965/task/97496/root (readlink: Permission denied) 2023-10-08T07:07:50.919 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97496 ms_dispat root txt unknown /proc/96965/task/97496/exe (readlink: Permission denied) 2023-10-08T07:07:50.919 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97496 ms_dispat root NOFD /proc/96965/task/97496/fd (opendir: Permission denied) 2023-10-08T07:07:50.919 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97497 ms_local root cwd unknown /proc/96965/task/97497/cwd (readlink: Permission denied) 2023-10-08T07:07:50.919 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97497 ms_local root rtd unknown /proc/96965/task/97497/root (readlink: Permission denied) 2023-10-08T07:07:50.919 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97497 ms_local root txt unknown /proc/96965/task/97497/exe (readlink: Permission denied) 2023-10-08T07:07:50.919 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97497 ms_local root NOFD /proc/96965/task/97497/fd (opendir: Permission denied) 2023-10-08T07:07:50.919 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97498 safe_time root cwd unknown /proc/96965/task/97498/cwd (readlink: Permission denied) 2023-10-08T07:07:50.919 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97498 safe_time root rtd unknown /proc/96965/task/97498/root (readlink: Permission denied) 2023-10-08T07:07:50.919 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97498 safe_time root txt unknown /proc/96965/task/97498/exe (readlink: Permission denied) 2023-10-08T07:07:50.919 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97498 safe_time root NOFD /proc/96965/task/97498/fd (opendir: Permission denied) 2023-10-08T07:07:50.920 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97499 safe_time root cwd unknown /proc/96965/task/97499/cwd (readlink: Permission denied) 2023-10-08T07:07:50.920 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97499 safe_time root rtd unknown /proc/96965/task/97499/root (readlink: Permission denied) 2023-10-08T07:07:50.920 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97499 safe_time root txt unknown /proc/96965/task/97499/exe (readlink: Permission denied) 2023-10-08T07:07:50.920 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96965 97499 safe_time root NOFD /proc/96965/task/97499/fd (opendir: Permission denied) 2023-10-08T07:07:50.920 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 root cwd unknown /proc/96966/cwd (readlink: Permission denied) 2023-10-08T07:07:50.920 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 root rtd unknown /proc/96966/root (readlink: Permission denied) 2023-10-08T07:07:50.920 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 root txt unknown /proc/96966/exe (readlink: Permission denied) 2023-10-08T07:07:50.920 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 root NOFD /proc/96966/fd (opendir: Permission denied) 2023-10-08T07:07:50.920 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97015 log root cwd unknown /proc/96966/task/97015/cwd (readlink: Permission denied) 2023-10-08T07:07:50.920 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97015 log root rtd unknown /proc/96966/task/97015/root (readlink: Permission denied) 2023-10-08T07:07:50.920 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97015 log root txt unknown /proc/96966/task/97015/exe (readlink: Permission denied) 2023-10-08T07:07:50.920 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97015 log root NOFD /proc/96966/task/97015/fd (opendir: Permission denied) 2023-10-08T07:07:50.921 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97016 service root cwd unknown /proc/96966/task/97016/cwd (readlink: Permission denied) 2023-10-08T07:07:50.921 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97016 service root rtd unknown /proc/96966/task/97016/root (readlink: Permission denied) 2023-10-08T07:07:50.921 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97016 service root txt unknown /proc/96966/task/97016/exe (readlink: Permission denied) 2023-10-08T07:07:50.921 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97016 service root NOFD /proc/96966/task/97016/fd (opendir: Permission denied) 2023-10-08T07:07:50.921 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97017 admin_soc root cwd unknown /proc/96966/task/97017/cwd (readlink: Permission denied) 2023-10-08T07:07:50.921 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97017 admin_soc root rtd unknown /proc/96966/task/97017/root (readlink: Permission denied) 2023-10-08T07:07:50.921 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97017 admin_soc root txt unknown /proc/96966/task/97017/exe (readlink: Permission denied) 2023-10-08T07:07:50.921 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97017 admin_soc root NOFD /proc/96966/task/97017/fd (opendir: Permission denied) 2023-10-08T07:07:50.921 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97026 signal_ha root cwd unknown /proc/96966/task/97026/cwd (readlink: Permission denied) 2023-10-08T07:07:50.921 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97026 signal_ha root rtd unknown /proc/96966/task/97026/root (readlink: Permission denied) 2023-10-08T07:07:50.921 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97026 signal_ha root txt unknown /proc/96966/task/97026/exe (readlink: Permission denied) 2023-10-08T07:07:50.921 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97026 signal_ha root NOFD /proc/96966/task/97026/fd (opendir: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97027 rocksdb:l root cwd unknown /proc/96966/task/97027/cwd (readlink: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97027 rocksdb:l root rtd unknown /proc/96966/task/97027/root (readlink: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97027 rocksdb:l root txt unknown /proc/96966/task/97027/exe (readlink: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97027 rocksdb:l root NOFD /proc/96966/task/97027/fd (opendir: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97028 rocksdb:h root cwd unknown /proc/96966/task/97028/cwd (readlink: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97028 rocksdb:h root rtd unknown /proc/96966/task/97028/root (readlink: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97028 rocksdb:h root txt unknown /proc/96966/task/97028/exe (readlink: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97028 rocksdb:h root NOFD /proc/96966/task/97028/fd (opendir: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97044 ceph-mon root cwd unknown /proc/96966/task/97044/cwd (readlink: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97044 ceph-mon root rtd unknown /proc/96966/task/97044/root (readlink: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97044 ceph-mon root txt unknown /proc/96966/task/97044/exe (readlink: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97044 ceph-mon root NOFD /proc/96966/task/97044/fd (opendir: Permission denied) 2023-10-08T07:07:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97045 fn_monsto root cwd unknown /proc/96966/task/97045/cwd (readlink: Permission denied) 2023-10-08T07:07:50.923 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97045 fn_monsto root rtd unknown /proc/96966/task/97045/root (readlink: Permission denied) 2023-10-08T07:07:50.923 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97045 fn_monsto root txt unknown /proc/96966/task/97045/exe (readlink: Permission denied) 2023-10-08T07:07:50.923 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97045 fn_monsto root NOFD /proc/96966/task/97045/fd (opendir: Permission denied) 2023-10-08T07:07:50.923 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97046 msgr-work root cwd unknown /proc/96966/task/97046/cwd (readlink: Permission denied) 2023-10-08T07:07:50.923 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97046 msgr-work root rtd unknown /proc/96966/task/97046/root (readlink: Permission denied) 2023-10-08T07:07:50.923 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97046 msgr-work root txt unknown /proc/96966/task/97046/exe (readlink: Permission denied) 2023-10-08T07:07:50.923 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97046 msgr-work root NOFD /proc/96966/task/97046/fd (opendir: Permission denied) 2023-10-08T07:07:50.923 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97047 msgr-work root cwd unknown /proc/96966/task/97047/cwd (readlink: Permission denied) 2023-10-08T07:07:50.923 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97047 msgr-work root rtd unknown /proc/96966/task/97047/root (readlink: Permission denied) 2023-10-08T07:07:50.923 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97047 msgr-work root txt unknown /proc/96966/task/97047/exe (readlink: Permission denied) 2023-10-08T07:07:50.923 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97047 msgr-work root NOFD /proc/96966/task/97047/fd (opendir: Permission denied) 2023-10-08T07:07:50.923 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97048 msgr-work root cwd unknown /proc/96966/task/97048/cwd (readlink: Permission denied) 2023-10-08T07:07:50.924 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97048 msgr-work root rtd unknown /proc/96966/task/97048/root (readlink: Permission denied) 2023-10-08T07:07:50.924 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97048 msgr-work root txt unknown /proc/96966/task/97048/exe (readlink: Permission denied) 2023-10-08T07:07:50.924 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97048 msgr-work root NOFD /proc/96966/task/97048/fd (opendir: Permission denied) 2023-10-08T07:07:50.924 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97049 OpHistory root cwd unknown /proc/96966/task/97049/cwd (readlink: Permission denied) 2023-10-08T07:07:50.924 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97049 OpHistory root rtd unknown /proc/96966/task/97049/root (readlink: Permission denied) 2023-10-08T07:07:50.924 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97049 OpHistory root txt unknown /proc/96966/task/97049/exe (readlink: Permission denied) 2023-10-08T07:07:50.924 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97049 OpHistory root NOFD /proc/96966/task/97049/fd (opendir: Permission denied) 2023-10-08T07:07:50.924 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97053 fin root cwd unknown /proc/96966/task/97053/cwd (readlink: Permission denied) 2023-10-08T07:07:50.924 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97053 fin root rtd unknown /proc/96966/task/97053/root (readlink: Permission denied) 2023-10-08T07:07:50.924 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97053 fin root txt unknown /proc/96966/task/97053/exe (readlink: Permission denied) 2023-10-08T07:07:50.924 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97053 fin root NOFD /proc/96966/task/97053/fd (opendir: Permission denied) 2023-10-08T07:07:50.924 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97054 safe_time root cwd unknown /proc/96966/task/97054/cwd (readlink: Permission denied) 2023-10-08T07:07:50.925 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97054 safe_time root rtd unknown /proc/96966/task/97054/root (readlink: Permission denied) 2023-10-08T07:07:50.925 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97054 safe_time root txt unknown /proc/96966/task/97054/exe (readlink: Permission denied) 2023-10-08T07:07:50.925 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97054 safe_time root NOFD /proc/96966/task/97054/fd (opendir: Permission denied) 2023-10-08T07:07:50.925 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97055 cpu_tp root cwd unknown /proc/96966/task/97055/cwd (readlink: Permission denied) 2023-10-08T07:07:50.925 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97055 cpu_tp root rtd unknown /proc/96966/task/97055/root (readlink: Permission denied) 2023-10-08T07:07:50.925 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97055 cpu_tp root txt unknown /proc/96966/task/97055/exe (readlink: Permission denied) 2023-10-08T07:07:50.925 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97055 cpu_tp root NOFD /proc/96966/task/97055/fd (opendir: Permission denied) 2023-10-08T07:07:50.925 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97056 cpu_tp root cwd unknown /proc/96966/task/97056/cwd (readlink: Permission denied) 2023-10-08T07:07:50.925 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97056 cpu_tp root rtd unknown /proc/96966/task/97056/root (readlink: Permission denied) 2023-10-08T07:07:50.925 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97056 cpu_tp root txt unknown /proc/96966/task/97056/exe (readlink: Permission denied) 2023-10-08T07:07:50.925 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97056 cpu_tp root NOFD /proc/96966/task/97056/fd (opendir: Permission denied) 2023-10-08T07:07:50.925 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97057 cpu_tp root cwd unknown /proc/96966/task/97057/cwd (readlink: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97057 cpu_tp root rtd unknown /proc/96966/task/97057/root (readlink: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97057 cpu_tp root txt unknown /proc/96966/task/97057/exe (readlink: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97057 cpu_tp root NOFD /proc/96966/task/97057/fd (opendir: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97058 cpu_tp root cwd unknown /proc/96966/task/97058/cwd (readlink: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97058 cpu_tp root rtd unknown /proc/96966/task/97058/root (readlink: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97058 cpu_tp root txt unknown /proc/96966/task/97058/exe (readlink: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97058 cpu_tp root NOFD /proc/96966/task/97058/fd (opendir: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97059 ms_dispat root cwd unknown /proc/96966/task/97059/cwd (readlink: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97059 ms_dispat root rtd unknown /proc/96966/task/97059/root (readlink: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97059 ms_dispat root txt unknown /proc/96966/task/97059/exe (readlink: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97059 ms_dispat root NOFD /proc/96966/task/97059/fd (opendir: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97060 ms_local root cwd unknown /proc/96966/task/97060/cwd (readlink: Permission denied) 2023-10-08T07:07:50.926 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97060 ms_local root rtd unknown /proc/96966/task/97060/root (readlink: Permission denied) 2023-10-08T07:07:50.927 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97060 ms_local root txt unknown /proc/96966/task/97060/exe (readlink: Permission denied) 2023-10-08T07:07:50.927 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97060 ms_local root NOFD /proc/96966/task/97060/fd (opendir: Permission denied) 2023-10-08T07:07:50.927 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97061 safe_time root cwd unknown /proc/96966/task/97061/cwd (readlink: Permission denied) 2023-10-08T07:07:50.927 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97061 safe_time root rtd unknown /proc/96966/task/97061/root (readlink: Permission denied) 2023-10-08T07:07:50.927 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97061 safe_time root txt unknown /proc/96966/task/97061/exe (readlink: Permission denied) 2023-10-08T07:07:50.927 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97061 safe_time root NOFD /proc/96966/task/97061/fd (opendir: Permission denied) 2023-10-08T07:07:50.927 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97062 ms_dispat root cwd unknown /proc/96966/task/97062/cwd (readlink: Permission denied) 2023-10-08T07:07:50.927 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97062 ms_dispat root rtd unknown /proc/96966/task/97062/root (readlink: Permission denied) 2023-10-08T07:07:50.927 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97062 ms_dispat root txt unknown /proc/96966/task/97062/exe (readlink: Permission denied) 2023-10-08T07:07:50.928 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97062 ms_dispat root NOFD /proc/96966/task/97062/fd (opendir: Permission denied) 2023-10-08T07:07:50.928 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97063 ms_local root cwd unknown /proc/96966/task/97063/cwd (readlink: Permission denied) 2023-10-08T07:07:50.928 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97063 ms_local root rtd unknown /proc/96966/task/97063/root (readlink: Permission denied) 2023-10-08T07:07:50.928 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97063 ms_local root txt unknown /proc/96966/task/97063/exe (readlink: Permission denied) 2023-10-08T07:07:50.928 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96966 97063 ms_local root NOFD /proc/96966/task/97063/fd (opendir: Permission denied) 2023-10-08T07:07:50.928 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 root cwd unknown /proc/96968/cwd (readlink: Permission denied) 2023-10-08T07:07:50.928 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 root rtd unknown /proc/96968/root (readlink: Permission denied) 2023-10-08T07:07:50.928 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 root txt unknown /proc/96968/exe (readlink: Permission denied) 2023-10-08T07:07:50.928 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 root NOFD /proc/96968/fd (opendir: Permission denied) 2023-10-08T07:07:50.928 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97050 log root cwd unknown /proc/96968/task/97050/cwd (readlink: Permission denied) 2023-10-08T07:07:50.928 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97050 log root rtd unknown /proc/96968/task/97050/root (readlink: Permission denied) 2023-10-08T07:07:50.928 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97050 log root txt unknown /proc/96968/task/97050/exe (readlink: Permission denied) 2023-10-08T07:07:50.929 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97050 log root NOFD /proc/96968/task/97050/fd (opendir: Permission denied) 2023-10-08T07:07:50.929 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97051 service root cwd unknown /proc/96968/task/97051/cwd (readlink: Permission denied) 2023-10-08T07:07:50.929 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97051 service root rtd unknown /proc/96968/task/97051/root (readlink: Permission denied) 2023-10-08T07:07:50.929 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97051 service root txt unknown /proc/96968/task/97051/exe (readlink: Permission denied) 2023-10-08T07:07:50.929 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97051 service root NOFD /proc/96968/task/97051/fd (opendir: Permission denied) 2023-10-08T07:07:50.929 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97052 admin_soc root cwd unknown /proc/96968/task/97052/cwd (readlink: Permission denied) 2023-10-08T07:07:50.929 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97052 admin_soc root rtd unknown /proc/96968/task/97052/root (readlink: Permission denied) 2023-10-08T07:07:50.929 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97052 admin_soc root txt unknown /proc/96968/task/97052/exe (readlink: Permission denied) 2023-10-08T07:07:50.929 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97052 admin_soc root NOFD /proc/96968/task/97052/fd (opendir: Permission denied) 2023-10-08T07:07:50.929 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97064 signal_ha root cwd unknown /proc/96968/task/97064/cwd (readlink: Permission denied) 2023-10-08T07:07:50.929 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97064 signal_ha root rtd unknown /proc/96968/task/97064/root (readlink: Permission denied) 2023-10-08T07:07:50.930 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97064 signal_ha root txt unknown /proc/96968/task/97064/exe (readlink: Permission denied) 2023-10-08T07:07:50.930 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97064 signal_ha root NOFD /proc/96968/task/97064/fd (opendir: Permission denied) 2023-10-08T07:07:50.930 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97065 rocksdb:l root cwd unknown /proc/96968/task/97065/cwd (readlink: Permission denied) 2023-10-08T07:07:50.930 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97065 rocksdb:l root rtd unknown /proc/96968/task/97065/root (readlink: Permission denied) 2023-10-08T07:07:50.930 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97065 rocksdb:l root txt unknown /proc/96968/task/97065/exe (readlink: Permission denied) 2023-10-08T07:07:50.930 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97065 rocksdb:l root NOFD /proc/96968/task/97065/fd (opendir: Permission denied) 2023-10-08T07:07:50.930 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97066 rocksdb:h root cwd unknown /proc/96968/task/97066/cwd (readlink: Permission denied) 2023-10-08T07:07:50.930 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97066 rocksdb:h root rtd unknown /proc/96968/task/97066/root (readlink: Permission denied) 2023-10-08T07:07:50.930 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97066 rocksdb:h root txt unknown /proc/96968/task/97066/exe (readlink: Permission denied) 2023-10-08T07:07:50.930 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97066 rocksdb:h root NOFD /proc/96968/task/97066/fd (opendir: Permission denied) 2023-10-08T07:07:50.930 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97082 ceph-mon root cwd unknown /proc/96968/task/97082/cwd (readlink: Permission denied) 2023-10-08T07:07:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97082 ceph-mon root rtd unknown /proc/96968/task/97082/root (readlink: Permission denied) 2023-10-08T07:07:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97082 ceph-mon root txt unknown /proc/96968/task/97082/exe (readlink: Permission denied) 2023-10-08T07:07:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97082 ceph-mon root NOFD /proc/96968/task/97082/fd (opendir: Permission denied) 2023-10-08T07:07:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97083 fn_monsto root cwd unknown /proc/96968/task/97083/cwd (readlink: Permission denied) 2023-10-08T07:07:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97083 fn_monsto root rtd unknown /proc/96968/task/97083/root (readlink: Permission denied) 2023-10-08T07:07:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97083 fn_monsto root txt unknown /proc/96968/task/97083/exe (readlink: Permission denied) 2023-10-08T07:07:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97083 fn_monsto root NOFD /proc/96968/task/97083/fd (opendir: Permission denied) 2023-10-08T07:07:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97084 msgr-work root cwd unknown /proc/96968/task/97084/cwd (readlink: Permission denied) 2023-10-08T07:07:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97084 msgr-work root rtd unknown /proc/96968/task/97084/root (readlink: Permission denied) 2023-10-08T07:07:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97084 msgr-work root txt unknown /proc/96968/task/97084/exe (readlink: Permission denied) 2023-10-08T07:07:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97084 msgr-work root NOFD /proc/96968/task/97084/fd (opendir: Permission denied) 2023-10-08T07:07:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97085 msgr-work root cwd unknown /proc/96968/task/97085/cwd (readlink: Permission denied) 2023-10-08T07:07:50.932 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97085 msgr-work root rtd unknown /proc/96968/task/97085/root (readlink: Permission denied) 2023-10-08T07:07:50.932 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97085 msgr-work root txt unknown /proc/96968/task/97085/exe (readlink: Permission denied) 2023-10-08T07:07:50.932 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97085 msgr-work root NOFD /proc/96968/task/97085/fd (opendir: Permission denied) 2023-10-08T07:07:50.932 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97086 msgr-work root cwd unknown /proc/96968/task/97086/cwd (readlink: Permission denied) 2023-10-08T07:07:50.932 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97086 msgr-work root rtd unknown /proc/96968/task/97086/root (readlink: Permission denied) 2023-10-08T07:07:50.932 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97086 msgr-work root txt unknown /proc/96968/task/97086/exe (readlink: Permission denied) 2023-10-08T07:07:50.932 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97086 msgr-work root NOFD /proc/96968/task/97086/fd (opendir: Permission denied) 2023-10-08T07:07:50.932 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97087 OpHistory root cwd unknown /proc/96968/task/97087/cwd (readlink: Permission denied) 2023-10-08T07:07:50.932 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97087 OpHistory root rtd unknown /proc/96968/task/97087/root (readlink: Permission denied) 2023-10-08T07:07:50.932 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97087 OpHistory root txt unknown /proc/96968/task/97087/exe (readlink: Permission denied) 2023-10-08T07:07:50.932 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97087 OpHistory root NOFD /proc/96968/task/97087/fd (opendir: Permission denied) 2023-10-08T07:07:50.933 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97088 fin root cwd unknown /proc/96968/task/97088/cwd (readlink: Permission denied) 2023-10-08T07:07:50.933 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97088 fin root rtd unknown /proc/96968/task/97088/root (readlink: Permission denied) 2023-10-08T07:07:50.933 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97088 fin root txt unknown /proc/96968/task/97088/exe (readlink: Permission denied) 2023-10-08T07:07:50.933 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97088 fin root NOFD /proc/96968/task/97088/fd (opendir: Permission denied) 2023-10-08T07:07:50.933 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97089 safe_time root cwd unknown /proc/96968/task/97089/cwd (readlink: Permission denied) 2023-10-08T07:07:50.933 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97089 safe_time root rtd unknown /proc/96968/task/97089/root (readlink: Permission denied) 2023-10-08T07:07:50.933 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97089 safe_time root txt unknown /proc/96968/task/97089/exe (readlink: Permission denied) 2023-10-08T07:07:50.933 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97089 safe_time root NOFD /proc/96968/task/97089/fd (opendir: Permission denied) 2023-10-08T07:07:50.933 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97090 cpu_tp root cwd unknown /proc/96968/task/97090/cwd (readlink: Permission denied) 2023-10-08T07:07:50.933 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97090 cpu_tp root rtd unknown /proc/96968/task/97090/root (readlink: Permission denied) 2023-10-08T07:07:50.933 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97090 cpu_tp root txt unknown /proc/96968/task/97090/exe (readlink: Permission denied) 2023-10-08T07:07:50.934 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97090 cpu_tp root NOFD /proc/96968/task/97090/fd (opendir: Permission denied) 2023-10-08T07:07:50.934 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97091 cpu_tp root cwd unknown /proc/96968/task/97091/cwd (readlink: Permission denied) 2023-10-08T07:07:50.934 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97091 cpu_tp root rtd unknown /proc/96968/task/97091/root (readlink: Permission denied) 2023-10-08T07:07:50.934 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97091 cpu_tp root txt unknown /proc/96968/task/97091/exe (readlink: Permission denied) 2023-10-08T07:07:50.934 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97091 cpu_tp root NOFD /proc/96968/task/97091/fd (opendir: Permission denied) 2023-10-08T07:07:50.934 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97092 cpu_tp root cwd unknown /proc/96968/task/97092/cwd (readlink: Permission denied) 2023-10-08T07:07:50.934 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97092 cpu_tp root rtd unknown /proc/96968/task/97092/root (readlink: Permission denied) 2023-10-08T07:07:50.934 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97092 cpu_tp root txt unknown /proc/96968/task/97092/exe (readlink: Permission denied) 2023-10-08T07:07:50.934 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97092 cpu_tp root NOFD /proc/96968/task/97092/fd (opendir: Permission denied) 2023-10-08T07:07:50.934 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97093 cpu_tp root cwd unknown /proc/96968/task/97093/cwd (readlink: Permission denied) 2023-10-08T07:07:50.934 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97093 cpu_tp root rtd unknown /proc/96968/task/97093/root (readlink: Permission denied) 2023-10-08T07:07:50.935 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97093 cpu_tp root txt unknown /proc/96968/task/97093/exe (readlink: Permission denied) 2023-10-08T07:07:50.935 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97093 cpu_tp root NOFD /proc/96968/task/97093/fd (opendir: Permission denied) 2023-10-08T07:07:50.935 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97094 ms_dispat root cwd unknown /proc/96968/task/97094/cwd (readlink: Permission denied) 2023-10-08T07:07:50.935 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97094 ms_dispat root rtd unknown /proc/96968/task/97094/root (readlink: Permission denied) 2023-10-08T07:07:50.935 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97094 ms_dispat root txt unknown /proc/96968/task/97094/exe (readlink: Permission denied) 2023-10-08T07:07:50.935 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97094 ms_dispat root NOFD /proc/96968/task/97094/fd (opendir: Permission denied) 2023-10-08T07:07:50.935 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97095 ms_local root cwd unknown /proc/96968/task/97095/cwd (readlink: Permission denied) 2023-10-08T07:07:50.935 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97095 ms_local root rtd unknown /proc/96968/task/97095/root (readlink: Permission denied) 2023-10-08T07:07:50.935 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97095 ms_local root txt unknown /proc/96968/task/97095/exe (readlink: Permission denied) 2023-10-08T07:07:50.935 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97095 ms_local root NOFD /proc/96968/task/97095/fd (opendir: Permission denied) 2023-10-08T07:07:50.935 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97096 safe_time root cwd unknown /proc/96968/task/97096/cwd (readlink: Permission denied) 2023-10-08T07:07:50.935 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97096 safe_time root rtd unknown /proc/96968/task/97096/root (readlink: Permission denied) 2023-10-08T07:07:50.936 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97096 safe_time root txt unknown /proc/96968/task/97096/exe (readlink: Permission denied) 2023-10-08T07:07:50.936 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97096 safe_time root NOFD /proc/96968/task/97096/fd (opendir: Permission denied) 2023-10-08T07:07:50.936 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97097 ms_dispat root cwd unknown /proc/96968/task/97097/cwd (readlink: Permission denied) 2023-10-08T07:07:50.936 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97097 ms_dispat root rtd unknown /proc/96968/task/97097/root (readlink: Permission denied) 2023-10-08T07:07:50.936 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97097 ms_dispat root txt unknown /proc/96968/task/97097/exe (readlink: Permission denied) 2023-10-08T07:07:50.936 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97097 ms_dispat root NOFD /proc/96968/task/97097/fd (opendir: Permission denied) 2023-10-08T07:07:50.936 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97098 ms_local root cwd unknown /proc/96968/task/97098/cwd (readlink: Permission denied) 2023-10-08T07:07:50.936 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97098 ms_local root rtd unknown /proc/96968/task/97098/root (readlink: Permission denied) 2023-10-08T07:07:50.936 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97098 ms_local root txt unknown /proc/96968/task/97098/exe (readlink: Permission denied) 2023-10-08T07:07:50.936 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mon 96968 97098 ms_local root NOFD /proc/96968/task/97098/fd (opendir: Permission denied) 2023-10-08T07:07:50.936 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 root cwd unknown /proc/96971/cwd (readlink: Permission denied) 2023-10-08T07:07:50.936 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 root rtd unknown /proc/96971/root (readlink: Permission denied) 2023-10-08T07:07:50.937 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 root txt unknown /proc/96971/exe (readlink: Permission denied) 2023-10-08T07:07:50.937 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 root NOFD /proc/96971/fd (opendir: Permission denied) 2023-10-08T07:07:50.937 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97018 log root cwd unknown /proc/96971/task/97018/cwd (readlink: Permission denied) 2023-10-08T07:07:50.937 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97018 log root rtd unknown /proc/96971/task/97018/root (readlink: Permission denied) 2023-10-08T07:07:50.937 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97018 log root txt unknown /proc/96971/task/97018/exe (readlink: Permission denied) 2023-10-08T07:07:50.937 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97018 log root NOFD /proc/96971/task/97018/fd (opendir: Permission denied) 2023-10-08T07:07:50.937 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97020 msgr-work root cwd unknown /proc/96971/task/97020/cwd (readlink: Permission denied) 2023-10-08T07:07:50.937 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97020 msgr-work root rtd unknown /proc/96971/task/97020/root (readlink: Permission denied) 2023-10-08T07:07:50.937 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97020 msgr-work root txt unknown /proc/96971/task/97020/exe (readlink: Permission denied) 2023-10-08T07:07:50.937 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97020 msgr-work root NOFD /proc/96971/task/97020/fd (opendir: Permission denied) 2023-10-08T07:07:50.937 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97021 msgr-work root cwd unknown /proc/96971/task/97021/cwd (readlink: Permission denied) 2023-10-08T07:07:50.937 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97021 msgr-work root rtd unknown /proc/96971/task/97021/root (readlink: Permission denied) 2023-10-08T07:07:50.938 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97021 msgr-work root txt unknown /proc/96971/task/97021/exe (readlink: Permission denied) 2023-10-08T07:07:50.938 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97021 msgr-work root NOFD /proc/96971/task/97021/fd (opendir: Permission denied) 2023-10-08T07:07:50.938 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97022 msgr-work root cwd unknown /proc/96971/task/97022/cwd (readlink: Permission denied) 2023-10-08T07:07:50.938 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97022 msgr-work root rtd unknown /proc/96971/task/97022/root (readlink: Permission denied) 2023-10-08T07:07:50.938 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97022 msgr-work root txt unknown /proc/96971/task/97022/exe (readlink: Permission denied) 2023-10-08T07:07:50.938 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97022 msgr-work root NOFD /proc/96971/task/97022/fd (opendir: Permission denied) 2023-10-08T07:07:50.938 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97145 service root cwd unknown /proc/96971/task/97145/cwd (readlink: Permission denied) 2023-10-08T07:07:50.938 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97145 service root rtd unknown /proc/96971/task/97145/root (readlink: Permission denied) 2023-10-08T07:07:50.938 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97145 service root txt unknown /proc/96971/task/97145/exe (readlink: Permission denied) 2023-10-08T07:07:50.938 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97145 service root NOFD /proc/96971/task/97145/fd (opendir: Permission denied) 2023-10-08T07:07:50.938 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97146 admin_soc root cwd unknown /proc/96971/task/97146/cwd (readlink: Permission denied) 2023-10-08T07:07:50.938 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97146 admin_soc root rtd unknown /proc/96971/task/97146/root (readlink: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97146 admin_soc root txt unknown /proc/96971/task/97146/exe (readlink: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97146 admin_soc root NOFD /proc/96971/task/97146/fd (opendir: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97147 ceph_time root cwd unknown /proc/96971/task/97147/cwd (readlink: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97147 ceph_time root rtd unknown /proc/96971/task/97147/root (readlink: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97147 ceph_time root txt unknown /proc/96971/task/97147/exe (readlink: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97147 ceph_time root NOFD /proc/96971/task/97147/fd (opendir: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97148 fn_anonym root cwd unknown /proc/96971/task/97148/cwd (readlink: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97148 fn_anonym root rtd unknown /proc/96971/task/97148/root (readlink: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97148 fn_anonym root txt unknown /proc/96971/task/97148/exe (readlink: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97148 fn_anonym root NOFD /proc/96971/task/97148/fd (opendir: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97149 signal_ha root cwd unknown /proc/96971/task/97149/cwd (readlink: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97149 signal_ha root rtd unknown /proc/96971/task/97149/root (readlink: Permission denied) 2023-10-08T07:07:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97149 signal_ha root txt unknown /proc/96971/task/97149/exe (readlink: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97149 signal_ha root NOFD /proc/96971/task/97149/fd (opendir: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97150 mgrsb-fin root cwd unknown /proc/96971/task/97150/cwd (readlink: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97150 mgrsb-fin root rtd unknown /proc/96971/task/97150/root (readlink: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97150 mgrsb-fin root txt unknown /proc/96971/task/97150/exe (readlink: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97150 mgrsb-fin root NOFD /proc/96971/task/97150/fd (opendir: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97151 ms_dispat root cwd unknown /proc/96971/task/97151/cwd (readlink: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97151 ms_dispat root rtd unknown /proc/96971/task/97151/root (readlink: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97151 ms_dispat root txt unknown /proc/96971/task/97151/exe (readlink: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97151 ms_dispat root NOFD /proc/96971/task/97151/fd (opendir: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97152 ms_local root cwd unknown /proc/96971/task/97152/cwd (readlink: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97152 ms_local root rtd unknown /proc/96971/task/97152/root (readlink: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97152 ms_local root txt unknown /proc/96971/task/97152/exe (readlink: Permission denied) 2023-10-08T07:07:50.940 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97152 ms_local root NOFD /proc/96971/task/97152/fd (opendir: Permission denied) 2023-10-08T07:07:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97153 io_contex root cwd unknown /proc/96971/task/97153/cwd (readlink: Permission denied) 2023-10-08T07:07:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97153 io_contex root rtd unknown /proc/96971/task/97153/root (readlink: Permission denied) 2023-10-08T07:07:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97153 io_contex root txt unknown /proc/96971/task/97153/exe (readlink: Permission denied) 2023-10-08T07:07:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97153 io_contex root NOFD /proc/96971/task/97153/fd (opendir: Permission denied) 2023-10-08T07:07:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97154 io_contex root cwd unknown /proc/96971/task/97154/cwd (readlink: Permission denied) 2023-10-08T07:07:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97154 io_contex root rtd unknown /proc/96971/task/97154/root (readlink: Permission denied) 2023-10-08T07:07:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97154 io_contex root txt unknown /proc/96971/task/97154/exe (readlink: Permission denied) 2023-10-08T07:07:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97154 io_contex root NOFD /proc/96971/task/97154/fd (opendir: Permission denied) 2023-10-08T07:07:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97155 safe_time root cwd unknown /proc/96971/task/97155/cwd (readlink: Permission denied) 2023-10-08T07:07:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97155 safe_time root rtd unknown /proc/96971/task/97155/root (readlink: Permission denied) 2023-10-08T07:07:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97155 safe_time root txt unknown /proc/96971/task/97155/exe (readlink: Permission denied) 2023-10-08T07:07:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97155 safe_time root NOFD /proc/96971/task/97155/fd (opendir: Permission denied) 2023-10-08T07:07:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97156 safe_time root cwd unknown /proc/96971/task/97156/cwd (readlink: Permission denied) 2023-10-08T07:07:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97156 safe_time root rtd unknown /proc/96971/task/97156/root (readlink: Permission denied) 2023-10-08T07:07:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97156 safe_time root txt unknown /proc/96971/task/97156/exe (readlink: Permission denied) 2023-10-08T07:07:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97156 safe_time root NOFD /proc/96971/task/97156/fd (opendir: Permission denied) 2023-10-08T07:07:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97157 safe_time root cwd unknown /proc/96971/task/97157/cwd (readlink: Permission denied) 2023-10-08T07:07:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97157 safe_time root rtd unknown /proc/96971/task/97157/root (readlink: Permission denied) 2023-10-08T07:07:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97157 safe_time root txt unknown /proc/96971/task/97157/exe (readlink: Permission denied) 2023-10-08T07:07:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97157 safe_time root NOFD /proc/96971/task/97157/fd (opendir: Permission denied) 2023-10-08T07:07:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97158 fn_anonym root cwd unknown /proc/96971/task/97158/cwd (readlink: Permission denied) 2023-10-08T07:07:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97158 fn_anonym root rtd unknown /proc/96971/task/97158/root (readlink: Permission denied) 2023-10-08T07:07:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97158 fn_anonym root txt unknown /proc/96971/task/97158/exe (readlink: Permission denied) 2023-10-08T07:07:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97158 fn_anonym root NOFD /proc/96971/task/97158/fd (opendir: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97159 flusher root cwd unknown /proc/96971/task/97159/cwd (readlink: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97159 flusher root rtd unknown /proc/96971/task/97159/root (readlink: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97159 flusher root txt unknown /proc/96971/task/97159/exe (readlink: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97159 flusher root NOFD /proc/96971/task/97159/fd (opendir: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97160 safe_time root cwd unknown /proc/96971/task/97160/cwd (readlink: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97160 safe_time root rtd unknown /proc/96971/task/97160/root (readlink: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97160 safe_time root txt unknown /proc/96971/task/97160/exe (readlink: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mgr 96971 97160 safe_time root NOFD /proc/96971/task/97160/fd (opendir: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 97657 root cwd unknown /proc/97657/cwd (readlink: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 97657 root rtd unknown /proc/97657/root (readlink: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 97657 root txt unknown /proc/97657/exe (readlink: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 97657 root NOFD /proc/97657/fd (opendir: Permission denied) 2023-10-08T07:07:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 97697 root cwd unknown /proc/97697/cwd (readlink: Permission denied) 2023-10-08T07:07:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 97697 root rtd unknown /proc/97697/root (readlink: Permission denied) 2023-10-08T07:07:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 97697 root txt unknown /proc/97697/exe (readlink: Permission denied) 2023-10-08T07:07:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 97697 root NOFD /proc/97697/fd (opendir: Permission denied) 2023-10-08T07:07:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 root cwd unknown /proc/97702/cwd (readlink: Permission denied) 2023-10-08T07:07:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 root rtd unknown /proc/97702/root (readlink: Permission denied) 2023-10-08T07:07:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 root txt unknown /proc/97702/exe (readlink: Permission denied) 2023-10-08T07:07:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 root NOFD /proc/97702/fd (opendir: Permission denied) 2023-10-08T07:07:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97703 log root cwd unknown /proc/97702/task/97703/cwd (readlink: Permission denied) 2023-10-08T07:07:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97703 log root rtd unknown /proc/97702/task/97703/root (readlink: Permission denied) 2023-10-08T07:07:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97703 log root txt unknown /proc/97702/task/97703/exe (readlink: Permission denied) 2023-10-08T07:07:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97703 log root NOFD /proc/97702/task/97703/fd (opendir: Permission denied) 2023-10-08T07:07:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97705 msgr-work root cwd unknown /proc/97702/task/97705/cwd (readlink: Permission denied) 2023-10-08T07:07:50.945 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97705 msgr-work root rtd unknown /proc/97702/task/97705/root (readlink: Permission denied) 2023-10-08T07:07:50.945 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97705 msgr-work root txt unknown /proc/97702/task/97705/exe (readlink: Permission denied) 2023-10-08T07:07:50.945 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97705 msgr-work root NOFD /proc/97702/task/97705/fd (opendir: Permission denied) 2023-10-08T07:07:50.945 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97706 msgr-work root cwd unknown /proc/97702/task/97706/cwd (readlink: Permission denied) 2023-10-08T07:07:50.945 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97706 msgr-work root rtd unknown /proc/97702/task/97706/root (readlink: Permission denied) 2023-10-08T07:07:50.945 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97706 msgr-work root txt unknown /proc/97702/task/97706/exe (readlink: Permission denied) 2023-10-08T07:07:50.945 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97706 msgr-work root NOFD /proc/97702/task/97706/fd (opendir: Permission denied) 2023-10-08T07:07:50.945 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97707 msgr-work root cwd unknown /proc/97702/task/97707/cwd (readlink: Permission denied) 2023-10-08T07:07:50.945 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97707 msgr-work root rtd unknown /proc/97702/task/97707/root (readlink: Permission denied) 2023-10-08T07:07:50.945 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97707 msgr-work root txt unknown /proc/97702/task/97707/exe (readlink: Permission denied) 2023-10-08T07:07:50.945 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97707 msgr-work root NOFD /proc/97702/task/97707/fd (opendir: Permission denied) 2023-10-08T07:07:50.945 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97711 service root cwd unknown /proc/97702/task/97711/cwd (readlink: Permission denied) 2023-10-08T07:07:50.946 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97711 service root rtd unknown /proc/97702/task/97711/root (readlink: Permission denied) 2023-10-08T07:07:50.946 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97711 service root txt unknown /proc/97702/task/97711/exe (readlink: Permission denied) 2023-10-08T07:07:50.946 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97711 service root NOFD /proc/97702/task/97711/fd (opendir: Permission denied) 2023-10-08T07:07:50.946 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97712 admin_soc root cwd unknown /proc/97702/task/97712/cwd (readlink: Permission denied) 2023-10-08T07:07:50.946 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97712 admin_soc root rtd unknown /proc/97702/task/97712/root (readlink: Permission denied) 2023-10-08T07:07:50.946 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97712 admin_soc root txt unknown /proc/97702/task/97712/exe (readlink: Permission denied) 2023-10-08T07:07:50.946 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97712 admin_soc root NOFD /proc/97702/task/97712/fd (opendir: Permission denied) 2023-10-08T07:07:50.946 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97713 signal_ha root cwd unknown /proc/97702/task/97713/cwd (readlink: Permission denied) 2023-10-08T07:07:50.946 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97713 signal_ha root rtd unknown /proc/97702/task/97713/root (readlink: Permission denied) 2023-10-08T07:07:50.946 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97713 signal_ha root txt unknown /proc/97702/task/97713/exe (readlink: Permission denied) 2023-10-08T07:07:50.946 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97713 signal_ha root NOFD /proc/97702/task/97713/fd (opendir: Permission denied) 2023-10-08T07:07:50.946 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97714 io_contex root cwd unknown /proc/97702/task/97714/cwd (readlink: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97714 io_contex root rtd unknown /proc/97702/task/97714/root (readlink: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97714 io_contex root txt unknown /proc/97702/task/97714/exe (readlink: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97714 io_contex root NOFD /proc/97702/task/97714/fd (opendir: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97715 io_contex root cwd unknown /proc/97702/task/97715/cwd (readlink: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97715 io_contex root rtd unknown /proc/97702/task/97715/root (readlink: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97715 io_contex root txt unknown /proc/97702/task/97715/exe (readlink: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97715 io_contex root NOFD /proc/97702/task/97715/fd (opendir: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97716 ms_dispat root cwd unknown /proc/97702/task/97716/cwd (readlink: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97716 ms_dispat root rtd unknown /proc/97702/task/97716/root (readlink: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97716 ms_dispat root txt unknown /proc/97702/task/97716/exe (readlink: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97716 ms_dispat root NOFD /proc/97702/task/97716/fd (opendir: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97717 ms_local root cwd unknown /proc/97702/task/97717/cwd (readlink: Permission denied) 2023-10-08T07:07:50.947 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97717 ms_local root rtd unknown /proc/97702/task/97717/root (readlink: Permission denied) 2023-10-08T07:07:50.948 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97717 ms_local root txt unknown /proc/97702/task/97717/exe (readlink: Permission denied) 2023-10-08T07:07:50.948 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97717 ms_local root NOFD /proc/97702/task/97717/fd (opendir: Permission denied) 2023-10-08T07:07:50.948 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97718 safe_time root cwd unknown /proc/97702/task/97718/cwd (readlink: Permission denied) 2023-10-08T07:07:50.948 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97718 safe_time root rtd unknown /proc/97702/task/97718/root (readlink: Permission denied) 2023-10-08T07:07:50.948 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97718 safe_time root txt unknown /proc/97702/task/97718/exe (readlink: Permission denied) 2023-10-08T07:07:50.948 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97718 safe_time root NOFD /proc/97702/task/97718/fd (opendir: Permission denied) 2023-10-08T07:07:50.948 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97719 safe_time root cwd unknown /proc/97702/task/97719/cwd (readlink: Permission denied) 2023-10-08T07:07:50.948 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97719 safe_time root rtd unknown /proc/97702/task/97719/root (readlink: Permission denied) 2023-10-08T07:07:50.948 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97719 safe_time root txt unknown /proc/97702/task/97719/exe (readlink: Permission denied) 2023-10-08T07:07:50.948 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97719 safe_time root NOFD /proc/97702/task/97719/fd (opendir: Permission denied) 2023-10-08T07:07:50.948 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97720 ceph-mds root cwd unknown /proc/97702/task/97720/cwd (readlink: Permission denied) 2023-10-08T07:07:50.948 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97720 ceph-mds root rtd unknown /proc/97702/task/97720/root (readlink: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97720 ceph-mds root txt unknown /proc/97702/task/97720/exe (readlink: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97720 ceph-mds root NOFD /proc/97702/task/97720/fd (opendir: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97721 safe_time root cwd unknown /proc/97702/task/97721/cwd (readlink: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97721 safe_time root rtd unknown /proc/97702/task/97721/root (readlink: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97721 safe_time root txt unknown /proc/97702/task/97721/exe (readlink: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 97721 safe_time root NOFD /proc/97702/task/97721/fd (opendir: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98208 ceph_time root cwd unknown /proc/97702/task/98208/cwd (readlink: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98208 ceph_time root rtd unknown /proc/97702/task/98208/root (readlink: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98208 ceph_time root txt unknown /proc/97702/task/98208/exe (readlink: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98208 ceph_time root NOFD /proc/97702/task/98208/fd (opendir: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98209 OpHistory root cwd unknown /proc/97702/task/98209/cwd (readlink: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98209 OpHistory root rtd unknown /proc/97702/task/98209/root (readlink: Permission denied) 2023-10-08T07:07:50.949 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98209 OpHistory root txt unknown /proc/97702/task/98209/exe (readlink: Permission denied) 2023-10-08T07:07:50.950 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98209 OpHistory root NOFD /proc/97702/task/98209/fd (opendir: Permission denied) 2023-10-08T07:07:50.950 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98210 ms_dispat root cwd unknown /proc/97702/task/98210/cwd (readlink: Permission denied) 2023-10-08T07:07:50.950 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98210 ms_dispat root rtd unknown /proc/97702/task/98210/root (readlink: Permission denied) 2023-10-08T07:07:50.950 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98210 ms_dispat root txt unknown /proc/97702/task/98210/exe (readlink: Permission denied) 2023-10-08T07:07:50.950 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98210 ms_dispat root NOFD /proc/97702/task/98210/fd (opendir: Permission denied) 2023-10-08T07:07:50.950 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98211 mds_rank_ root cwd unknown /proc/97702/task/98211/cwd (readlink: Permission denied) 2023-10-08T07:07:50.950 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98211 mds_rank_ root rtd unknown /proc/97702/task/98211/root (readlink: Permission denied) 2023-10-08T07:07:50.950 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98211 mds_rank_ root txt unknown /proc/97702/task/98211/exe (readlink: Permission denied) 2023-10-08T07:07:50.950 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98211 mds_rank_ root NOFD /proc/97702/task/98211/fd (opendir: Permission denied) 2023-10-08T07:07:50.950 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98212 PQ_Finish root cwd unknown /proc/97702/task/98212/cwd (readlink: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98212 PQ_Finish root rtd unknown /proc/97702/task/98212/root (readlink: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98212 PQ_Finish root txt unknown /proc/97702/task/98212/exe (readlink: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98212 PQ_Finish root NOFD /proc/97702/task/98212/fd (opendir: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98213 safe_time root cwd unknown /proc/97702/task/98213/cwd (readlink: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98213 safe_time root rtd unknown /proc/97702/task/98213/root (readlink: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98213 safe_time root txt unknown /proc/97702/task/98213/exe (readlink: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98213 safe_time root NOFD /proc/97702/task/98213/fd (opendir: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98214 MR_Finish root cwd unknown /proc/97702/task/98214/cwd (readlink: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98214 MR_Finish root rtd unknown /proc/97702/task/98214/root (readlink: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98214 MR_Finish root txt unknown /proc/97702/task/98214/exe (readlink: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98214 MR_Finish root NOFD /proc/97702/task/98214/fd (opendir: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98215 md_submit root cwd unknown /proc/97702/task/98215/cwd (readlink: Permission denied) 2023-10-08T07:07:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98215 md_submit root rtd unknown /proc/97702/task/98215/root (readlink: Permission denied) 2023-10-08T07:07:50.952 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98215 md_submit root txt unknown /proc/97702/task/98215/exe (readlink: Permission denied) 2023-10-08T07:07:50.952 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98215 md_submit root NOFD /proc/97702/task/98215/fd (opendir: Permission denied) 2023-10-08T07:07:50.952 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98353 ms_dispat root cwd unknown /proc/97702/task/98353/cwd (readlink: Permission denied) 2023-10-08T07:07:50.952 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98353 ms_dispat root rtd unknown /proc/97702/task/98353/root (readlink: Permission denied) 2023-10-08T07:07:50.952 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98353 ms_dispat root txt unknown /proc/97702/task/98353/exe (readlink: Permission denied) 2023-10-08T07:07:50.952 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98353 ms_dispat root NOFD /proc/97702/task/98353/fd (opendir: Permission denied) 2023-10-08T07:07:50.952 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98354 ms_dispat root cwd unknown /proc/97702/task/98354/cwd (readlink: Permission denied) 2023-10-08T07:07:50.952 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98354 ms_dispat root rtd unknown /proc/97702/task/98354/root (readlink: Permission denied) 2023-10-08T07:07:50.952 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98354 ms_dispat root txt unknown /proc/97702/task/98354/exe (readlink: Permission denied) 2023-10-08T07:07:50.952 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-mds 97702 98354 ms_dispat root NOFD /proc/97702/task/98354/fd (opendir: Permission denied) 2023-10-08T07:07:50.952 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu cwd DIR 8,1 4096 1010 /home/ubuntu 2023-10-08T07:07:50.952 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu rtd DIR 8,1 4096 2 / 2023-10-08T07:07:50.953 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu txt REG 8,1 1150584 5025 /usr/bin/bash 2023-10-08T07:07:50.953 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-08T07:07:50.953 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-08T07:07:50.953 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-08T07:07:50.953 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-10-08T07:07:50.953 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-08T07:07:50.953 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-08T07:07:50.953 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-08T07:07:50.953 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-08T07:07:50.953 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-08T07:07:50.953 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-08T07:07:50.953 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-08T07:07:50.954 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-08T07:07:50.954 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-08T07:07:50.954 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-08T07:07:50.954 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-08T07:07:50.954 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-08T07:07:50.954 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-08T07:07:50.954 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu 0r FIFO 0,13 0t0 472070 pipe 2023-10-08T07:07:50.954 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu 1w FIFO 0,13 0t0 472071 pipe 2023-10-08T07:07:50.954 INFO:tasks.workunit.client.0.smithi017.stdout:bash 101233 ubuntu 2w FIFO 0,13 0t0 472072 pipe 2023-10-08T07:07:50.954 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 101270 root cwd unknown /proc/101270/cwd (readlink: Permission denied) 2023-10-08T07:07:50.954 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 101270 root rtd unknown /proc/101270/root (readlink: Permission denied) 2023-10-08T07:07:50.954 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 101270 root txt unknown /proc/101270/exe (readlink: Permission denied) 2023-10-08T07:07:50.955 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 101270 root NOFD /proc/101270/fd (opendir: Permission denied) 2023-10-08T07:07:50.955 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 101274 root cwd unknown /proc/101274/cwd (readlink: Permission denied) 2023-10-08T07:07:50.955 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 101274 root rtd unknown /proc/101274/root (readlink: Permission denied) 2023-10-08T07:07:50.955 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 101274 root txt unknown /proc/101274/exe (readlink: Permission denied) 2023-10-08T07:07:50.955 INFO:tasks.workunit.client.0.smithi017.stdout:sudo 101274 root NOFD /proc/101274/fd (opendir: Permission denied) 2023-10-08T07:07:50.955 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 101277 root cwd unknown /proc/101277/cwd (readlink: Permission denied) 2023-10-08T07:07:50.955 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 101277 root rtd unknown /proc/101277/root (readlink: Permission denied) 2023-10-08T07:07:50.955 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 101277 root txt unknown /proc/101277/exe (readlink: Permission denied) 2023-10-08T07:07:50.955 INFO:tasks.workunit.client.0.smithi017.stdout:daemon-he 101277 root NOFD /proc/101277/fd (opendir: Permission denied) 2023-10-08T07:07:50.955 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 root cwd unknown /proc/101284/cwd (readlink: Permission denied) 2023-10-08T07:07:50.955 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 root rtd unknown /proc/101284/root (readlink: Permission denied) 2023-10-08T07:07:50.955 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 root txt unknown /proc/101284/exe (readlink: Permission denied) 2023-10-08T07:07:50.956 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 root NOFD /proc/101284/fd (opendir: Permission denied) 2023-10-08T07:07:50.956 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101301 log root cwd unknown /proc/101284/task/101301/cwd (readlink: Permission denied) 2023-10-08T07:07:50.956 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101301 log root rtd unknown /proc/101284/task/101301/root (readlink: Permission denied) 2023-10-08T07:07:50.956 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101301 log root txt unknown /proc/101284/task/101301/exe (readlink: Permission denied) 2023-10-08T07:07:50.956 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101301 log root NOFD /proc/101284/task/101301/fd (opendir: Permission denied) 2023-10-08T07:07:50.956 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101303 msgr-work root cwd unknown /proc/101284/task/101303/cwd (readlink: Permission denied) 2023-10-08T07:07:50.956 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101303 msgr-work root rtd unknown /proc/101284/task/101303/root (readlink: Permission denied) 2023-10-08T07:07:50.956 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101303 msgr-work root txt unknown /proc/101284/task/101303/exe (readlink: Permission denied) 2023-10-08T07:07:50.956 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101303 msgr-work root NOFD /proc/101284/task/101303/fd (opendir: Permission denied) 2023-10-08T07:07:50.956 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101304 msgr-work root cwd unknown /proc/101284/task/101304/cwd (readlink: Permission denied) 2023-10-08T07:07:50.956 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101304 msgr-work root rtd unknown /proc/101284/task/101304/root (readlink: Permission denied) 2023-10-08T07:07:50.956 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101304 msgr-work root txt unknown /proc/101284/task/101304/exe (readlink: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101304 msgr-work root NOFD /proc/101284/task/101304/fd (opendir: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101305 msgr-work root cwd unknown /proc/101284/task/101305/cwd (readlink: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101305 msgr-work root rtd unknown /proc/101284/task/101305/root (readlink: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101305 msgr-work root txt unknown /proc/101284/task/101305/exe (readlink: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101305 msgr-work root NOFD /proc/101284/task/101305/fd (opendir: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101309 service root cwd unknown /proc/101284/task/101309/cwd (readlink: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101309 service root rtd unknown /proc/101284/task/101309/root (readlink: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101309 service root txt unknown /proc/101284/task/101309/exe (readlink: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101309 service root NOFD /proc/101284/task/101309/fd (opendir: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101310 admin_soc root cwd unknown /proc/101284/task/101310/cwd (readlink: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101310 admin_soc root rtd unknown /proc/101284/task/101310/root (readlink: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101310 admin_soc root txt unknown /proc/101284/task/101310/exe (readlink: Permission denied) 2023-10-08T07:07:50.957 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101310 admin_soc root NOFD /proc/101284/task/101310/fd (opendir: Permission denied) 2023-10-08T07:07:50.958 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101311 signal_ha root cwd unknown /proc/101284/task/101311/cwd (readlink: Permission denied) 2023-10-08T07:07:50.958 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101311 signal_ha root rtd unknown /proc/101284/task/101311/root (readlink: Permission denied) 2023-10-08T07:07:50.958 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101311 signal_ha root txt unknown /proc/101284/task/101311/exe (readlink: Permission denied) 2023-10-08T07:07:50.958 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101311 signal_ha root NOFD /proc/101284/task/101311/fd (opendir: Permission denied) 2023-10-08T07:07:50.958 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101312 io_contex root cwd unknown /proc/101284/task/101312/cwd (readlink: Permission denied) 2023-10-08T07:07:50.958 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101312 io_contex root rtd unknown /proc/101284/task/101312/root (readlink: Permission denied) 2023-10-08T07:07:50.958 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101312 io_contex root txt unknown /proc/101284/task/101312/exe (readlink: Permission denied) 2023-10-08T07:07:50.958 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101312 io_contex root NOFD /proc/101284/task/101312/fd (opendir: Permission denied) 2023-10-08T07:07:50.958 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101313 io_contex root cwd unknown /proc/101284/task/101313/cwd (readlink: Permission denied) 2023-10-08T07:07:50.958 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101313 io_contex root rtd unknown /proc/101284/task/101313/root (readlink: Permission denied) 2023-10-08T07:07:50.958 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101313 io_contex root txt unknown /proc/101284/task/101313/exe (readlink: Permission denied) 2023-10-08T07:07:50.959 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101313 io_contex root NOFD /proc/101284/task/101313/fd (opendir: Permission denied) 2023-10-08T07:07:50.959 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101314 ceph_time root cwd unknown /proc/101284/task/101314/cwd (readlink: Permission denied) 2023-10-08T07:07:50.959 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101314 ceph_time root rtd unknown /proc/101284/task/101314/root (readlink: Permission denied) 2023-10-08T07:07:50.959 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101314 ceph_time root txt unknown /proc/101284/task/101314/exe (readlink: Permission denied) 2023-10-08T07:07:50.959 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101314 ceph_time root NOFD /proc/101284/task/101314/fd (opendir: Permission denied) 2023-10-08T07:07:50.959 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101315 fn_anonym root cwd unknown /proc/101284/task/101315/cwd (readlink: Permission denied) 2023-10-08T07:07:50.959 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101315 fn_anonym root rtd unknown /proc/101284/task/101315/root (readlink: Permission denied) 2023-10-08T07:07:50.959 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101315 fn_anonym root txt unknown /proc/101284/task/101315/exe (readlink: Permission denied) 2023-10-08T07:07:50.959 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101315 fn_anonym root NOFD /proc/101284/task/101315/fd (opendir: Permission denied) 2023-10-08T07:07:50.959 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101316 fn_anonym root cwd unknown /proc/101284/task/101316/cwd (readlink: Permission denied) 2023-10-08T07:07:50.959 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101316 fn_anonym root rtd unknown /proc/101284/task/101316/root (readlink: Permission denied) 2023-10-08T07:07:50.959 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101316 fn_anonym root txt unknown /proc/101284/task/101316/exe (readlink: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101316 fn_anonym root NOFD /proc/101284/task/101316/fd (opendir: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101317 fn_anonym root cwd unknown /proc/101284/task/101317/cwd (readlink: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101317 fn_anonym root rtd unknown /proc/101284/task/101317/root (readlink: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101317 fn_anonym root txt unknown /proc/101284/task/101317/exe (readlink: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101317 fn_anonym root NOFD /proc/101284/task/101317/fd (opendir: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101318 fn_anonym root cwd unknown /proc/101284/task/101318/cwd (readlink: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101318 fn_anonym root rtd unknown /proc/101284/task/101318/root (readlink: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101318 fn_anonym root txt unknown /proc/101284/task/101318/exe (readlink: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101318 fn_anonym root NOFD /proc/101284/task/101318/fd (opendir: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101319 fn_anonym root cwd unknown /proc/101284/task/101319/cwd (readlink: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101319 fn_anonym root rtd unknown /proc/101284/task/101319/root (readlink: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101319 fn_anonym root txt unknown /proc/101284/task/101319/exe (readlink: Permission denied) 2023-10-08T07:07:50.960 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101319 fn_anonym root NOFD /proc/101284/task/101319/fd (opendir: Permission denied) 2023-10-08T07:07:50.961 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101320 safe_time root cwd unknown /proc/101284/task/101320/cwd (readlink: Permission denied) 2023-10-08T07:07:50.961 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101320 safe_time root rtd unknown /proc/101284/task/101320/root (readlink: Permission denied) 2023-10-08T07:07:50.961 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101320 safe_time root txt unknown /proc/101284/task/101320/exe (readlink: Permission denied) 2023-10-08T07:07:50.961 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101320 safe_time root NOFD /proc/101284/task/101320/fd (opendir: Permission denied) 2023-10-08T07:07:50.961 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101321 fn_anonym root cwd unknown /proc/101284/task/101321/cwd (readlink: Permission denied) 2023-10-08T07:07:50.961 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101321 fn_anonym root rtd unknown /proc/101284/task/101321/root (readlink: Permission denied) 2023-10-08T07:07:50.961 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101321 fn_anonym root txt unknown /proc/101284/task/101321/exe (readlink: Permission denied) 2023-10-08T07:07:50.961 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101321 fn_anonym root NOFD /proc/101284/task/101321/fd (opendir: Permission denied) 2023-10-08T07:07:50.961 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101322 flusher root cwd unknown /proc/101284/task/101322/cwd (readlink: Permission denied) 2023-10-08T07:07:50.961 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101322 flusher root rtd unknown /proc/101284/task/101322/root (readlink: Permission denied) 2023-10-08T07:07:50.961 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101322 flusher root txt unknown /proc/101284/task/101322/exe (readlink: Permission denied) 2023-10-08T07:07:50.961 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101322 flusher root NOFD /proc/101284/task/101322/fd (opendir: Permission denied) 2023-10-08T07:07:50.962 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101323 ms_dispat root cwd unknown /proc/101284/task/101323/cwd (readlink: Permission denied) 2023-10-08T07:07:50.962 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101323 ms_dispat root rtd unknown /proc/101284/task/101323/root (readlink: Permission denied) 2023-10-08T07:07:50.962 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101323 ms_dispat root txt unknown /proc/101284/task/101323/exe (readlink: Permission denied) 2023-10-08T07:07:50.962 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101323 ms_dispat root NOFD /proc/101284/task/101323/fd (opendir: Permission denied) 2023-10-08T07:07:50.962 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101324 ms_local root cwd unknown /proc/101284/task/101324/cwd (readlink: Permission denied) 2023-10-08T07:07:50.962 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101324 ms_local root rtd unknown /proc/101284/task/101324/root (readlink: Permission denied) 2023-10-08T07:07:50.962 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101324 ms_local root txt unknown /proc/101284/task/101324/exe (readlink: Permission denied) 2023-10-08T07:07:50.962 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101324 ms_local root NOFD /proc/101284/task/101324/fd (opendir: Permission denied) 2023-10-08T07:07:50.962 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101325 safe_time root cwd unknown /proc/101284/task/101325/cwd (readlink: Permission denied) 2023-10-08T07:07:50.962 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101325 safe_time root rtd unknown /proc/101284/task/101325/root (readlink: Permission denied) 2023-10-08T07:07:50.962 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101325 safe_time root txt unknown /proc/101284/task/101325/exe (readlink: Permission denied) 2023-10-08T07:07:50.962 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101325 safe_time root NOFD /proc/101284/task/101325/fd (opendir: Permission denied) 2023-10-08T07:07:50.963 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101326 ceph-fuse root cwd unknown /proc/101284/task/101326/cwd (readlink: Permission denied) 2023-10-08T07:07:50.963 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101326 ceph-fuse root rtd unknown /proc/101284/task/101326/root (readlink: Permission denied) 2023-10-08T07:07:50.963 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101326 ceph-fuse root txt unknown /proc/101284/task/101326/exe (readlink: Permission denied) 2023-10-08T07:07:50.963 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101326 ceph-fuse root NOFD /proc/101284/task/101326/fd (opendir: Permission denied) 2023-10-08T07:07:50.963 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101333 ceph-fuse root cwd unknown /proc/101284/task/101333/cwd (readlink: Permission denied) 2023-10-08T07:07:50.963 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101333 ceph-fuse root rtd unknown /proc/101284/task/101333/root (readlink: Permission denied) 2023-10-08T07:07:50.963 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101333 ceph-fuse root txt unknown /proc/101284/task/101333/exe (readlink: Permission denied) 2023-10-08T07:07:50.963 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101333 ceph-fuse root NOFD /proc/101284/task/101333/fd (opendir: Permission denied) 2023-10-08T07:07:50.963 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101336 ceph-fuse root cwd unknown /proc/101284/task/101336/cwd (readlink: Permission denied) 2023-10-08T07:07:50.963 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101336 ceph-fuse root rtd unknown /proc/101284/task/101336/root (readlink: Permission denied) 2023-10-08T07:07:50.963 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101336 ceph-fuse root txt unknown /proc/101284/task/101336/exe (readlink: Permission denied) 2023-10-08T07:07:50.963 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 101336 ceph-fuse root NOFD /proc/101284/task/101336/fd (opendir: Permission denied) 2023-10-08T07:07:50.964 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 103583 ceph-fuse root cwd unknown /proc/101284/task/103583/cwd (readlink: Permission denied) 2023-10-08T07:07:50.964 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 103583 ceph-fuse root rtd unknown /proc/101284/task/103583/root (readlink: Permission denied) 2023-10-08T07:07:50.964 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 103583 ceph-fuse root txt unknown /proc/101284/task/103583/exe (readlink: Permission denied) 2023-10-08T07:07:50.964 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 103583 ceph-fuse root NOFD /proc/101284/task/103583/fd (opendir: Permission denied) 2023-10-08T07:07:50.964 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 103833 ceph-fuse root cwd unknown /proc/101284/task/103833/cwd (readlink: Permission denied) 2023-10-08T07:07:50.964 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 103833 ceph-fuse root rtd unknown /proc/101284/task/103833/root (readlink: Permission denied) 2023-10-08T07:07:50.964 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 103833 ceph-fuse root txt unknown /proc/101284/task/103833/exe (readlink: Permission denied) 2023-10-08T07:07:50.964 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 103833 ceph-fuse root NOFD /proc/101284/task/103833/fd (opendir: Permission denied) 2023-10-08T07:07:50.964 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 103834 ceph-fuse root cwd unknown /proc/101284/task/103834/cwd (readlink: Permission denied) 2023-10-08T07:07:50.964 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 103834 ceph-fuse root rtd unknown /proc/101284/task/103834/root (readlink: Permission denied) 2023-10-08T07:07:50.964 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 103834 ceph-fuse root txt unknown /proc/101284/task/103834/exe (readlink: Permission denied) 2023-10-08T07:07:50.964 INFO:tasks.workunit.client.0.smithi017.stdout:ceph-fuse 101284 103834 ceph-fuse root NOFD /proc/101284/task/103834/fd (opendir: Permission denied) 2023-10-08T07:07:50.965 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 101844 root cwd unknown /proc/101844/cwd (readlink: Permission denied) 2023-10-08T07:07:50.965 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 101844 root rtd unknown /proc/101844/root (readlink: Permission denied) 2023-10-08T07:07:50.965 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 101844 root txt unknown /proc/101844/exe (readlink: Permission denied) 2023-10-08T07:07:50.965 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/0 101844 root NOFD /proc/101844/fd (opendir: Permission denied) 2023-10-08T07:07:50.965 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 103181 root cwd unknown /proc/103181/cwd (readlink: Permission denied) 2023-10-08T07:07:50.965 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 103181 root rtd unknown /proc/103181/root (readlink: Permission denied) 2023-10-08T07:07:50.965 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 103181 root txt unknown /proc/103181/exe (readlink: Permission denied) 2023-10-08T07:07:50.965 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/7 103181 root NOFD /proc/103181/fd (opendir: Permission denied) 2023-10-08T07:07:50.965 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 103182 root cwd unknown /proc/103182/cwd (readlink: Permission denied) 2023-10-08T07:07:50.965 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 103182 root rtd unknown /proc/103182/root (readlink: Permission denied) 2023-10-08T07:07:50.965 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 103182 root txt unknown /proc/103182/exe (readlink: Permission denied) 2023-10-08T07:07:50.965 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/1 103182 root NOFD /proc/103182/fd (opendir: Permission denied) 2023-10-08T07:07:50.966 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu cwd DIR 0,47 194249448 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-08T07:07:50.966 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu rtd DIR 8,1 4096 2 / 2023-10-08T07:07:50.966 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu txt REG 8,1 42840 7217 /usr/bin/timeout 2023-10-08T07:07:50.966 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-08T07:07:50.966 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-08T07:07:50.966 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-08T07:07:50.966 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-10-08T07:07:50.966 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-08T07:07:50.966 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-08T07:07:50.966 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-08T07:07:50.966 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-08T07:07:50.966 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-08T07:07:50.967 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-08T07:07:50.967 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-08T07:07:50.967 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-08T07:07:50.967 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-08T07:07:50.967 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-08T07:07:50.967 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-08T07:07:50.967 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-08T07:07:50.967 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-08T07:07:50.967 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu 0r FIFO 0,13 0t0 479761 pipe 2023-10-08T07:07:50.967 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu 1w FIFO 0,13 0t0 479762 pipe 2023-10-08T07:07:50.967 INFO:tasks.workunit.client.0.smithi017.stdout:timeout 103554 ubuntu 2w FIFO 0,13 0t0 479763 pipe 2023-10-08T07:07:50.967 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu cwd DIR 0,47 194249448 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-08T07:07:50.968 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu rtd DIR 8,1 4096 2 / 2023-10-08T07:07:50.968 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu txt REG 8,1 1150584 5025 /usr/bin/bash 2023-10-08T07:07:50.968 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-08T07:07:50.968 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-08T07:07:50.968 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-08T07:07:50.968 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-10-08T07:07:50.968 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-08T07:07:50.968 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-08T07:07:50.968 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-08T07:07:50.968 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-08T07:07:50.968 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-08T07:07:50.968 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-08T07:07:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-08T07:07:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-08T07:07:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-08T07:07:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-08T07:07:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-08T07:07:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-08T07:07:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-08T07:07:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu 0r FIFO 0,13 0t0 479761 pipe 2023-10-08T07:07:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu 1w FIFO 0,13 0t0 479762 pipe 2023-10-08T07:07:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu 2w FIFO 0,13 0t0 479763 pipe 2023-10-08T07:07:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:fsync-tes 103575 ubuntu 255r REG 8,1 207 1049045 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2023-10-08T07:07:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 105061 root cwd unknown /proc/105061/cwd (readlink: Permission denied) 2023-10-08T07:07:50.970 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 105061 root rtd unknown /proc/105061/root (readlink: Permission denied) 2023-10-08T07:07:50.970 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 105061 root txt unknown /proc/105061/exe (readlink: Permission denied) 2023-10-08T07:07:50.970 INFO:tasks.workunit.client.0.smithi017.stdout:kworker/u 105061 root NOFD /proc/105061/fd (opendir: Permission denied) 2023-10-08T07:07:50.970 INFO:tasks.workunit.client.0.smithi017.stdout:sleep 106310 root cwd unknown /proc/106310/cwd (readlink: Permission denied) 2023-10-08T07:07:50.970 INFO:tasks.workunit.client.0.smithi017.stdout:sleep 106310 root rtd unknown /proc/106310/root (readlink: Permission denied) 2023-10-08T07:07:50.970 INFO:tasks.workunit.client.0.smithi017.stdout:sleep 106310 root txt unknown /proc/106310/exe (readlink: Permission denied) 2023-10-08T07:07:50.970 INFO:tasks.workunit.client.0.smithi017.stdout:sleep 106310 root NOFD /proc/106310/fd (opendir: Permission denied) 2023-10-08T07:07:50.970 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu cwd DIR 0,47 194249448 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-08T07:07:50.970 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu rtd DIR 8,1 4096 2 / 2023-10-08T07:07:50.970 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu txt REG 8,1 179672 11398 /usr/bin/lsof 2023-10-08T07:07:50.970 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-08T07:07:50.970 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-08T07:07:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-08T07:07:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-08T07:07:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-08T07:07:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-08T07:07:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-08T07:07:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-08T07:07:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-08T07:07:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-08T07:07:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-08T07:07:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-08T07:07:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-08T07:07:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-08T07:07:50.972 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-08T07:07:50.972 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-08T07:07:50.972 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-08T07:07:50.972 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-08T07:07:50.972 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu 0r FIFO 0,13 0t0 479761 pipe 2023-10-08T07:07:50.972 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu 1w FIFO 0,13 0t0 479762 pipe 2023-10-08T07:07:50.972 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu 2w FIFO 0,13 0t0 479763 pipe 2023-10-08T07:07:50.972 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu 3r DIR 0,5 0 1 /proc 2023-10-08T07:07:50.972 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu 4r DIR 0,5 0 495936 /proc/106502/fd 2023-10-08T07:07:50.972 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu 5w FIFO 0,13 0t0 495941 pipe 2023-10-08T07:07:50.972 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106502 ubuntu 6r FIFO 0,13 0t0 495942 pipe 2023-10-08T07:07:50.972 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu cwd DIR 0,47 194249448 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu rtd DIR 8,1 4096 2 / 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu txt REG 8,1 179672 11398 /usr/bin/lsof 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-08T07:07:50.973 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-10-08T07:07:50.974 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-10-08T07:07:50.974 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-10-08T07:07:50.974 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-10-08T07:07:50.974 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-10-08T07:07:50.974 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-10-08T07:07:50.974 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-10-08T07:07:50.974 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-10-08T07:07:50.974 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu 4r FIFO 0,13 0t0 495941 pipe 2023-10-08T07:07:50.974 INFO:tasks.workunit.client.0.smithi017.stdout:lsof 106503 ubuntu 7w FIFO 0,13 0t0 495942 pipe 2023-10-08T07:07:50.974 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-08T07:07:50.975 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-08T07:07:50.976 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:50.975+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:51.024 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2023-10-08T07:07:51.024 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-08T07:07:51.079 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:51.076+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:51.178 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:51.177+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:51.185 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:51.185 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:51.198 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:51.279 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:51.278+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:51.305 DEBUG:teuthology.parallel:result is None 2023-10-08T07:07:51.306 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-08T07:07:51.337 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-08T07:07:51.337 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-08T07:07:51.347 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-08T07:07:51.347 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:07:51.347 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T07:07:51.375 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:07:51.375 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T07:07:51.381 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:51.379+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:51.396 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:07:51.396 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T07:07:51.445 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:51.445 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:51.456 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:07:51.462 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:51.505 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:51.504+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:51.545 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:51.569 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:51.570 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:07:51.570 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:51.570 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:07:51.573 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:51.574 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:51.582 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:51.581+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:51.617 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:170454 4.26 e65/17 4:672c55ca:::10000000004.00000006:head v 65'2672, mlcod=65'2670)", 2023-10-08T07:07:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:51.613817+0000", 2023-10-08T07:07:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0032602339999999999, 2023-10-08T07:07:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0032770469999999999, 2023-10-08T07:07:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.613817+0000", 2023-10-08T07:07:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.613817+0000", 2023-10-08T07:07:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.613818+0000", 2023-10-08T07:07:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.8699999999999995e-07 2023-10-08T07:07:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.613836+0000", 2023-10-08T07:07:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8023999999999999e-05 2023-10-08T07:07:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.613849+0000", 2023-10-08T07:07:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2686e-05 2023-10-08T07:07:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.613855+0000", 2023-10-08T07:07:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8399999999999997e-06 2023-10-08T07:07:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.613894+0000", 2023-10-08T07:07:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8447e-05 2023-10-08T07:07:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.613907+0000", 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2717e-05 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:170156 4.11 e65/17 4:8963efe6:::10000000004.00000009:head v 65'2623, mlcod=65'2620)", 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:51.615034+0000", 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0020437789999999999, 2023-10-08T07:07:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020992950000000002, 2023-10-08T07:07:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615034+0000", 2023-10-08T07:07:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615034+0000", 2023-10-08T07:07:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615034+0000", 2023-10-08T07:07:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7999999999999995e-07 2023-10-08T07:07:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615050+0000", 2023-10-08T07:07:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6055000000000001e-05 2023-10-08T07:07:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615060+0000", 2023-10-08T07:07:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1479999999999995e-06 2023-10-08T07:07:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615067+0000", 2023-10-08T07:07:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9990000000000002e-06 2023-10-08T07:07:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615105+0000", 2023-10-08T07:07:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8220000000000003e-05 2023-10-08T07:07:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615118+0000", 2023-10-08T07:07:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3155e-05 2023-10-08T07:07:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_repop(client.4556.0:170159 4.31 e65/48 4:8de29a03:::10000000004.00000001:head v 65'5268, mlcod=65'5264)", 2023-10-08T07:07:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:51.615141+0000", 2023-10-08T07:07:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.00193603, 2023-10-08T07:07:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0020258329999999999, 2023-10-08T07:07:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "started", 2023-10-08T07:07:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615141+0000", 2023-10-08T07:07:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615141+0000", 2023-10-08T07:07:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615142+0000", 2023-10-08T07:07:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7800000000000001e-07 2023-10-08T07:07:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615156+0000", 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.4273e-05 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615165+0000", 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9209999999999998e-06 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615172+0000", 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.0570000000000004e-06 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615208+0000", 2023-10-08T07:07:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5692999999999999e-05 2023-10-08T07:07:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:51.615221+0000", 2023-10-08T07:07:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2935999999999999e-05 2023-10-08T07:07:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-08T07:07:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 3 2023-10-08T07:07:51.635 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:51.636 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:51.683 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:51.682+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:51.786 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:51.783+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:51.819 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:51.819 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:51.830 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:51.858 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:07:51.859 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":65,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:07:49.042847+0000","last_up_change":"2023-10-08T07:06:38.117398+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5800000429153442,"score_stable":1.5800000429153442,"optimal_score":0.67000001668930054,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":0.95001220703125,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":37,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":0.95001220703125,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":36},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"3.1","osds":[0,2]},{"pgid":"3.1b","osds":[2,0]},{"pgid":"3.1c","osds":[2,0]},{"pgid":"4.1c","osds":[0,2]},{"pgid":"4.31","osds":[2,0]},{"pgid":"4.35","osds":[2,0]},{"pgid":"4.38","osds":[0,2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:07:51.873 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T07:05:20.557481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T07:05:25.624853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T07:05:30.549393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T07:05:31.693934+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T07:07:51.874 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T07:07:51.885 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:51.884+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:51.973 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175316 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 696320~4096,write 745472~4096,write 942080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:07:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.3080665529999997, 2023-10-08T07:07:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.239832828, 2023-10-08T07:07:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175316 2023-10-08T07:07:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:07:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:07:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662052+0000", 2023-10-08T07:07:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9599999999999998e-07 2023-10-08T07:07:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662064+0000", 2023-10-08T07:07:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.226e-05 2023-10-08T07:07:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662074+0000", 2023-10-08T07:07:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0057999999999999e-05 2023-10-08T07:07:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662082+0000", 2023-10-08T07:07:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.593e-06 2023-10-08T07:07:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.868775+0000", 2023-10-08T07:07:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.20669354700000001 2023-10-08T07:07:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.868864+0000", 2023-10-08T07:07:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9174999999999999e-05 2023-10-08T07:07:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.869012+0000", 2023-10-08T07:07:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014747 2023-10-08T07:07:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.885657+0000", 2023-10-08T07:07:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016645008999999999 2023-10-08T07:07:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901768+0000", 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016110721000000001 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901841+0000", 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3047999999999996e-05 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901884+0000", 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3050999999999998e-05 2023-10-08T07:07:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175432 4.1a 4:5a59f83a:::10000000004.00000002:head [write 196608~4096,write 245760~4096,write 270336~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:07:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.2709485779999996, 2023-10-08T07:07:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.23774203799999999, 2023-10-08T07:07:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175432 2023-10-08T07:07:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:07:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:07:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699170+0000", 2023-10-08T07:07:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:07:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699181+0000", 2023-10-08T07:07:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1581e-05 2023-10-08T07:07:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699199+0000", 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7376000000000001e-05 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699206+0000", 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7190000000000001e-06 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907275+0000", 2023-10-08T07:07:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.20806835700000001 2023-10-08T07:07:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907359+0000", 2023-10-08T07:07:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4320999999999994e-05 2023-10-08T07:07:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907546+0000", 2023-10-08T07:07:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018752299999999999 2023-10-08T07:07:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.925780+0000", 2023-10-08T07:07:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018233909999999999 2023-10-08T07:07:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936786+0000", 2023-10-08T07:07:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011005355 2023-10-08T07:07:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936868+0000", 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1917999999999997e-05 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936911+0000", 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3207999999999997e-05 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175676 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2719744~4096,write 2822144~4096,write 2945024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:07:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1988492199999996, 2023-10-08T07:07:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24978785000000001, 2023-10-08T07:07:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175676 2023-10-08T07:07:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:07:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:07:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771269+0000", 2023-10-08T07:07:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7100000000000002e-07 2023-10-08T07:07:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771287+0000", 2023-10-08T07:07:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8022000000000001e-05 2023-10-08T07:07:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771293+0000", 2023-10-08T07:07:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3029999999999996e-06 2023-10-08T07:07:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771297+0000", 2023-10-08T07:07:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2830000000000003e-06 2023-10-08T07:07:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.961848+0000", 2023-10-08T07:07:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.190550999 2023-10-08T07:07:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.961954+0000", 2023-10-08T07:07:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000105485 2023-10-08T07:07:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.962114+0000", 2023-10-08T07:07:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016024499999999999 2023-10-08T07:07:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.975848+0000", 2023-10-08T07:07:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013733886000000001 2023-10-08T07:07:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.020956+0000", 2023-10-08T07:07:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045108400999999999 2023-10-08T07:07:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021013+0000", 2023-10-08T07:07:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6277999999999999e-05 2023-10-08T07:07:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021056+0000", 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3377000000000002e-05 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175680 4.3a 4:5f183e4b:::10000000004.00000023:head [write 3502080~4096,write 3534848~4096,write 3608576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1969042869999997, 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24812537200000001, 2023-10-08T07:07:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175680 2023-10-08T07:07:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:07:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:07:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773214+0000", 2023-10-08T07:07:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.403e-06 2023-10-08T07:07:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773227+0000", 2023-10-08T07:07:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3001e-05 2023-10-08T07:07:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773240+0000", 2023-10-08T07:07:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2441e-05 2023-10-08T07:07:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773249+0000", 2023-10-08T07:07:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8890000000000008e-06 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964327+0000", 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19107864499999999 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964418+0000", 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0131999999999997e-05 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964602+0000", 2023-10-08T07:07:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000184711 2023-10-08T07:07:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976021+0000", 2023-10-08T07:07:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011418822 2023-10-08T07:07:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021236+0000", 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045214467000000001 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021303+0000", 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7210000000000002e-05 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021338+0000", 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5651000000000001e-05 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175690 4.1a 4:5a59f83a:::10000000004.00000002:head [write 405504~4096,write 811008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:07:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1943505209999996, 2023-10-08T07:07:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.245421262, 2023-10-08T07:07:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175690 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:07:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:07:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775774+0000", 2023-10-08T07:07:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9460000000000001e-06 2023-10-08T07:07:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775781+0000", 2023-10-08T07:07:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8349999999999998e-06 2023-10-08T07:07:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775785+0000", 2023-10-08T07:07:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7290000000000002e-06 2023-10-08T07:07:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967188+0000", 2023-10-08T07:07:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19140304299999999 2023-10-08T07:07:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967267+0000", 2023-10-08T07:07:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9154999999999997e-05 2023-10-08T07:07:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967405+0000", 2023-10-08T07:07:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000137618 2023-10-08T07:07:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976028+0000", 2023-10-08T07:07:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0086236869999999997 2023-10-08T07:07:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021096+0000", 2023-10-08T07:07:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045067928 2023-10-08T07:07:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021147+0000", 2023-10-08T07:07:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0399000000000003e-05 2023-10-08T07:07:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021188+0000", 2023-10-08T07:07:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1386e-05 2023-10-08T07:07:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175692 4.a 4:524fba76:::10000000004.0000001b:head [write 737280~4096,write 749568~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:07:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.193896799, 2023-10-08T07:07:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25024756399999998, 2023-10-08T07:07:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175692 2023-10-08T07:07:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:07:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:07:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:07:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1200000000000003e-07 2023-10-08T07:07:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776238+0000", 2023-10-08T07:07:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7269e-05 2023-10-08T07:07:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776247+0000", 2023-10-08T07:07:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5189999999999992e-06 2023-10-08T07:07:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776251+0000", 2023-10-08T07:07:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7910000000000002e-06 2023-10-08T07:07:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967925+0000", 2023-10-08T07:07:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19167456299999999 2023-10-08T07:07:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967997+0000", 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1666000000000001e-05 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.968122+0000", 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012469 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976268+0000", 2023-10-08T07:07:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0081468770000000003 2023-10-08T07:07:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026375+0000", 2023-10-08T07:07:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050106683999999999 2023-10-08T07:07:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026430+0000", 2023-10-08T07:07:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4506999999999998e-05 2023-10-08T07:07:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026468+0000", 2023-10-08T07:07:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8485999999999997e-05 2023-10-08T07:07:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175701 4.a 4:524fba76:::10000000004.0000001b:head [write 1503232~4096,write 1540096~4096,write 1560576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:07:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1910531210000004, 2023-10-08T07:07:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.257645717, 2023-10-08T07:07:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175701 2023-10-08T07:07:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:07:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:07:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779065+0000", 2023-10-08T07:07:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6300000000000005e-07 2023-10-08T07:07:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779074+0000", 2023-10-08T07:07:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7010000000000002e-06 2023-10-08T07:07:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779090+0000", 2023-10-08T07:07:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6171000000000002e-05 2023-10-08T07:07:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779095+0000", 2023-10-08T07:07:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9169999999999997e-06 2023-10-08T07:07:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971272+0000", 2023-10-08T07:07:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.192177024 2023-10-08T07:07:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971364+0000", 2023-10-08T07:07:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2102999999999996e-05 2023-10-08T07:07:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971480+0000", 2023-10-08T07:07:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000116307 2023-10-08T07:07:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.980645+0000", 2023-10-08T07:07:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0091647559999999996 2023-10-08T07:07:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036634+0000", 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055989555000000003 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036673+0000", 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8285999999999999e-05 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036710+0000", 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7234000000000003e-05 2023-10-08T07:07:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175733 4.a 4:524fba76:::10000000004.0000001b:head [write 2154496~4096,write 2281472~4096,write 2306048~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:07:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1802263550000003, 2023-10-08T07:07:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25628842600000001, 2023-10-08T07:07:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175733 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:07:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:07:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4900000000000001e-07 2023-10-08T07:07:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789903+0000", 2023-10-08T07:07:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1391e-05 2023-10-08T07:07:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789909+0000", 2023-10-08T07:07:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6460000000000004e-06 2023-10-08T07:07:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789916+0000", 2023-10-08T07:07:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.635e-06 2023-10-08T07:07:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976385+0000", 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18646858799999999 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976432+0000", 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6885000000000003e-05 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976521+0000", 2023-10-08T07:07:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9122999999999994e-05 2023-10-08T07:07:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.987479+0000", 2023-10-08T07:07:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0109579 2023-10-08T07:07:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046084+0000", 2023-10-08T07:07:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058605813999999999 2023-10-08T07:07:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046140+0000", 2023-10-08T07:07:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5770999999999998e-05 2023-10-08T07:07:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046179+0000", 2023-10-08T07:07:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9224000000000003e-05 2023-10-08T07:07:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175743 4.a 4:524fba76:::10000000004.0000001b:head [write 233472~4096,write 684032~4096,write 704512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:07:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1768480429999997, 2023-10-08T07:07:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25305127599999999, 2023-10-08T07:07:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175743 2023-10-08T07:07:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:07:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:07:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793270+0000", 2023-10-08T07:07:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8200000000000008e-07 2023-10-08T07:07:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793291+0000", 2023-10-08T07:07:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1058000000000001e-05 2023-10-08T07:07:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793303+0000", 2023-10-08T07:07:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1836e-05 2023-10-08T07:07:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793312+0000", 2023-10-08T07:07:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5809999999999997e-06 2023-10-08T07:07:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.978869+0000", 2023-10-08T07:07:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18555693400000001 2023-10-08T07:07:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.978955+0000", 2023-10-08T07:07:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6318999999999998e-05 2023-10-08T07:07:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.979104+0000", 2023-10-08T07:07:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014935 2023-10-08T07:07:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.987482+0000", 2023-10-08T07:07:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083776749999999994 2023-10-08T07:07:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046228+0000", 2023-10-08T07:07:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058745516999999997 2023-10-08T07:07:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046285+0000", 2023-10-08T07:07:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7358000000000002e-05 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046321+0000", 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5666e-05 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175759 4.a 4:524fba76:::10000000004.0000001b:head [write 2719744~4096,write 2756608~4096,write 2940928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:07:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.173077471, 2023-10-08T07:07:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24944019200000001, 2023-10-08T07:07:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175759 2023-10-08T07:07:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:07:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:07:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:07:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6600000000000003e-07 2023-10-08T07:07:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797047+0000", 2023-10-08T07:07:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3600000000000001e-06 2023-10-08T07:07:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797050+0000", 2023-10-08T07:07:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6990000000000001e-06 2023-10-08T07:07:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797054+0000", 2023-10-08T07:07:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3450000000000002e-06 2023-10-08T07:07:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981409+0000", 2023-10-08T07:07:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18435503 2023-10-08T07:07:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981491+0000", 2023-10-08T07:07:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2538000000000002e-05 2023-10-08T07:07:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981690+0000", 2023-10-08T07:07:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019896200000000001 2023-10-08T07:07:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989237+0000", 2023-10-08T07:07:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0075464410000000001 2023-10-08T07:07:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046393+0000", 2023-10-08T07:07:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.057156086000000002 2023-10-08T07:07:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046445+0000", 2023-10-08T07:07:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2437e-05 2023-10-08T07:07:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046480+0000", 2023-10-08T07:07:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5027999999999997e-05 2023-10-08T07:07:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175778 4.a 4:524fba76:::10000000004.0000001b:head [write 901120~4096,write 1118208~4096,write 1249280~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:07:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1680068940000004, 2023-10-08T07:07:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.26243437800000002, 2023-10-08T07:07:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175778 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:07:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802111+0000", 2023-10-08T07:07:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6000000000000003e-07 2023-10-08T07:07:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802131+0000", 2023-10-08T07:07:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0109999999999999e-05 2023-10-08T07:07:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802142+0000", 2023-10-08T07:07:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0549e-05 2023-10-08T07:07:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802149+0000", 2023-10-08T07:07:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5229999999999998e-06 2023-10-08T07:07:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983625+0000", 2023-10-08T07:07:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18147571200000001 2023-10-08T07:07:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983673+0000", 2023-10-08T07:07:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8007000000000003e-05 2023-10-08T07:07:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983764+0000", 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1242000000000005e-05 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989240+0000", 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054752689999999996 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064441+0000", 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.075201198999999996 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064504+0000", 2023-10-08T07:07:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3219999999999994e-05 2023-10-08T07:07:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064545+0000", 2023-10-08T07:07:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0886999999999997e-05 2023-10-08T07:07:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175787 4.3a 4:5f183e4b:::10000000004.00000023:head [write 884736~4096,write 958464~4096,write 1261568~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:07:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1654179410000003, 2023-10-08T07:07:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25984544300000001, 2023-10-08T07:07:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175787 2023-10-08T07:07:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:07:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:07:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804700+0000", 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1299999999999999e-07 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804723+0000", 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.304e-05 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804735+0000", 2023-10-08T07:07:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1693e-05 2023-10-08T07:07:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804742+0000", 2023-10-08T07:07:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5869999999999998e-06 2023-10-08T07:07:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983619+0000", 2023-10-08T07:07:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.178877123 2023-10-08T07:07:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983667+0000", 2023-10-08T07:07:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8510999999999997e-05 2023-10-08T07:07:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983763+0000", 2023-10-08T07:07:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5902000000000004e-05 2023-10-08T07:07:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989243+0000", 2023-10-08T07:07:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054799389999999996 2023-10-08T07:07:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064453+0000", 2023-10-08T07:07:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.075209837000000002 2023-10-08T07:07:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064506+0000", 2023-10-08T07:07:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2743e-05 2023-10-08T07:07:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064545+0000", 2023-10-08T07:07:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9255000000000003e-05 2023-10-08T07:07:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175801 4.a 4:524fba76:::10000000004.0000001b:head [write 2670592~4096,write 2695168~4096,write 2957312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:07:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1607183880000003, 2023-10-08T07:07:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25527491699999999, 2023-10-08T07:07:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175801 2023-10-08T07:07:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:07:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:07:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809400+0000", 2023-10-08T07:07:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8999999999999996e-07 2023-10-08T07:07:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809411+0000", 2023-10-08T07:07:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1275e-05 2023-10-08T07:07:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809418+0000", 2023-10-08T07:07:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6649999999999997e-06 2023-10-08T07:07:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809423+0000", 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1499999999999998e-06 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986111+0000", 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17668825299999999 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986176+0000", 2023-10-08T07:07:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5234999999999995e-05 2023-10-08T07:07:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986313+0000", 2023-10-08T07:07:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013663299999999999 2023-10-08T07:07:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.001765+0000", 2023-10-08T07:07:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015451833999999999 2023-10-08T07:07:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064588+0000", 2023-10-08T07:07:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062823646999999996 2023-10-08T07:07:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064639+0000", 2023-10-08T07:07:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0401000000000001e-05 2023-10-08T07:07:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064674+0000", 2023-10-08T07:07:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5133999999999999e-05 2023-10-08T07:07:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175835 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3133440~4096,write 3272704~4096,write 3280896~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:07:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1500804550000003, 2023-10-08T07:07:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25013609599999997, 2023-10-08T07:07:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175835 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:07:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820038+0000", 2023-10-08T07:07:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0699999999999997e-07 2023-10-08T07:07:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820049+0000", 2023-10-08T07:07:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1326e-05 2023-10-08T07:07:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820058+0000", 2023-10-08T07:07:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9460000000000004e-06 2023-10-08T07:07:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820065+0000", 2023-10-08T07:07:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.238e-06 2023-10-08T07:07:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990302+0000", 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17023707699999999 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990350+0000", 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7941000000000001e-05 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990447+0000", 2023-10-08T07:07:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6552999999999995e-05 2023-10-08T07:07:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002051+0000", 2023-10-08T07:07:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011604649 2023-10-08T07:07:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070103+0000", 2023-10-08T07:07:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.068051639999999997 2023-10-08T07:07:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070145+0000", 2023-10-08T07:07:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2154000000000003e-05 2023-10-08T07:07:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070173+0000", 2023-10-08T07:07:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7965000000000001e-05 2023-10-08T07:07:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175856 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2080768~4096,write 2191360~4096,write 2203648~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:07:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1447102649999996, 2023-10-08T07:07:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24491389, 2023-10-08T07:07:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175856 2023-10-08T07:07:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:07:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:07:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825408+0000", 2023-10-08T07:07:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5099999999999999e-07 2023-10-08T07:07:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825419+0000", 2023-10-08T07:07:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1369000000000001e-05 2023-10-08T07:07:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825430+0000", 2023-10-08T07:07:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1226000000000001e-05 2023-10-08T07:07:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825437+0000", 2023-10-08T07:07:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.156e-06 2023-10-08T07:07:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992529+0000", 2023-10-08T07:07:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.167092401 2023-10-08T07:07:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992594+0000", 2023-10-08T07:07:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4949000000000004e-05 2023-10-08T07:07:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992688+0000", 2023-10-08T07:07:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4011999999999994e-05 2023-10-08T07:07:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.007407+0000", 2023-10-08T07:07:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014718614 2023-10-08T07:07:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070226+0000", 2023-10-08T07:07:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062819551000000001 2023-10-08T07:07:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070283+0000", 2023-10-08T07:07:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7340000000000003e-05 2023-10-08T07:07:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070321+0000", 2023-10-08T07:07:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7521000000000002e-05 2023-10-08T07:07:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175864 4.1a 4:5a59f83a:::10000000004.00000002:head [write 4018176~4096,write 4067328~4096,write 4141056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:07:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1416773720000002, 2023-10-08T07:07:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24198245199999999, 2023-10-08T07:07:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175864 2023-10-08T07:07:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828441+0000", 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0100000000000005e-07 2023-10-08T07:07:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828450+0000", 2023-10-08T07:07:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1400000000000006e-06 2023-10-08T07:07:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828461+0000", 2023-10-08T07:07:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.099e-05 2023-10-08T07:07:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828468+0000", 2023-10-08T07:07:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3390000000000004e-06 2023-10-08T07:07:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992521+0000", 2023-10-08T07:07:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16405252400000001 2023-10-08T07:07:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992607+0000", 2023-10-08T07:07:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6086000000000002e-05 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992756+0000", 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014936100000000001 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002055+0000", 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0092994410000000003 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070359+0000", 2023-10-08T07:07:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.068303681000000005 2023-10-08T07:07:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070401+0000", 2023-10-08T07:07:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2138999999999998e-05 2023-10-08T07:07:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070422+0000", 2023-10-08T07:07:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1149999999999999e-05 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175882 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 258048~4096,write 282624~4096,write 446464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1363456579999998, 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.244805773, 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175882 2023-10-08T07:07:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:07:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:07:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833773+0000", 2023-10-08T07:07:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1800000000000005e-07 2023-10-08T07:07:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833799+0000", 2023-10-08T07:07:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6840000000000001e-05 2023-10-08T07:07:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833811+0000", 2023-10-08T07:07:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1982e-05 2023-10-08T07:07:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833819+0000", 2023-10-08T07:07:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7729999999999999e-06 2023-10-08T07:07:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998071+0000", 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16425203699999999 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998122+0000", 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0627999999999997e-05 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998301+0000", 2023-10-08T07:07:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017893 2023-10-08T07:07:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.016267+0000", 2023-10-08T07:07:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017966780000000002 2023-10-08T07:07:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078470+0000", 2023-10-08T07:07:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062202475 2023-10-08T07:07:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078532+0000", 2023-10-08T07:07:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1601999999999997e-05 2023-10-08T07:07:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078577+0000", 2023-10-08T07:07:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5908000000000002e-05 2023-10-08T07:07:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175885 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2940928~4096,write 3362816~4096,write 3371008~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:07:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1356471499999996, 2023-10-08T07:07:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.244295492, 2023-10-08T07:07:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175885 2023-10-08T07:07:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:07:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834471+0000", 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3399999999999998e-07 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834487+0000", 2023-10-08T07:07:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6209999999999999e-05 2023-10-08T07:07:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834500+0000", 2023-10-08T07:07:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2262999999999999e-05 2023-10-08T07:07:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834508+0000", 2023-10-08T07:07:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8459999999999997e-06 2023-10-08T07:07:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002339+0000", 2023-10-08T07:07:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16783030400000001 2023-10-08T07:07:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002426+0000", 2023-10-08T07:07:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6879999999999995e-05 2023-10-08T07:07:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002592+0000", 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000166071 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.016276+0000", 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013684392 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078657+0000", 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062380933 2023-10-08T07:07:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078721+0000", 2023-10-08T07:07:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3968999999999997e-05 2023-10-08T07:07:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078766+0000", 2023-10-08T07:07:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4790000000000003e-05 2023-10-08T07:07:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175982 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 1507328~4096,write 1556480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:07:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.1053069359999999, 2023-10-08T07:07:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24593904699999999, 2023-10-08T07:07:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175982 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864811+0000", 2023-10-08T07:07:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3099999999999996e-07 2023-10-08T07:07:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864827+0000", 2023-10-08T07:07:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5141e-05 2023-10-08T07:07:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864839+0000", 2023-10-08T07:07:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2343e-05 2023-10-08T07:07:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864847+0000", 2023-10-08T07:07:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1759999999999993e-06 2023-10-08T07:07:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.041996+0000", 2023-10-08T07:07:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17714919000000001 2023-10-08T07:07:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.042044+0000", 2023-10-08T07:07:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8056000000000002e-05 2023-10-08T07:07:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.042173+0000", 2023-10-08T07:07:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000128283 2023-10-08T07:07:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.058432+0000", 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016259431000000001 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110696+0000", 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.052264104999999998 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110728+0000", 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1578999999999997e-05 2023-10-08T07:07:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110749+0000", 2023-10-08T07:07:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1812000000000001e-05 2023-10-08T07:07:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:176059 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1564672~4096,write 1585152~4096,write 1708032~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:07:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 4.0824782150000001, 2023-10-08T07:07:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.23799429, 2023-10-08T07:07:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 176059 2023-10-08T07:07:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887640+0000", 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0699999999999997e-07 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887649+0000", 2023-10-08T07:07:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2439999999999999e-06 2023-10-08T07:07:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887657+0000", 2023-10-08T07:07:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0059999999999992e-06 2023-10-08T07:07:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887663+0000", 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7869999999999998e-06 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.060892+0000", 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17322955700000001 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.060978+0000", 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5358999999999994e-05 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.061180+0000", 2023-10-08T07:07:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020268400000000001 2023-10-08T07:07:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070342+0000", 2023-10-08T07:07:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0091617230000000001 2023-10-08T07:07:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125534+0000", 2023-10-08T07:07:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055191764999999997 2023-10-08T07:07:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125591+0000", 2023-10-08T07:07:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7606999999999999e-05 2023-10-08T07:07:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125633+0000", 2023-10-08T07:07:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1950999999999999e-05 2023-10-08T07:07:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:52.107 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:52.109 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2023-10-08T07:07:52.109 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:52.109 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:52.107+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:52.208 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:52.207+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-08T07:07:52.240 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-08T07:07:52.310 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:52.308+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:52.341 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:52.341 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:52.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.341 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171562 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.342 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.931517+0000", 2023-10-08T07:07:52.342 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38554358799999999, 2023-10-08T07:07:52.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.38556509, 2023-10-08T07:07:52.342 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.342 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.342 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.342 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171562 2023-10-08T07:07:52.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.343 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.931517+0000", 2023-10-08T07:07:52.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.931517+0000", 2023-10-08T07:07:52.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.931517+0000", 2023-10-08T07:07:52.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:07:52.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.931535+0000", 2023-10-08T07:07:52.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.738e-05 2023-10-08T07:07:52.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.931543+0000", 2023-10-08T07:07:52.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2840000000000006e-06 2023-10-08T07:07:52.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.931549+0000", 2023-10-08T07:07:52.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4389999999999997e-06 2023-10-08T07:07:52.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.346 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.346 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171707 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.347 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.969340+0000", 2023-10-08T07:07:52.347 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.34772017, 2023-10-08T07:07:52.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.34778094199999998, 2023-10-08T07:07:52.347 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.347 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.347 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.348 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171707 2023-10-08T07:07:52.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.348 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.969340+0000", 2023-10-08T07:07:52.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.969340+0000", 2023-10-08T07:07:52.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.969341+0000", 2023-10-08T07:07:52.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4400000000000001e-07 2023-10-08T07:07:52.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.969351+0000", 2023-10-08T07:07:52.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0020000000000001e-05 2023-10-08T07:07:52.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.969357+0000", 2023-10-08T07:07:52.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5270000000000004e-06 2023-10-08T07:07:52.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.969363+0000", 2023-10-08T07:07:52.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3020000000000002e-06 2023-10-08T07:07:52.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.351 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.352 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172583 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.352 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.198471+0000", 2023-10-08T07:07:52.352 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.11858975300000001, 2023-10-08T07:07:52.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.118684015, 2023-10-08T07:07:52.352 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.352 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.353 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.353 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172583 2023-10-08T07:07:52.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.353 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198471+0000", 2023-10-08T07:07:52.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198471+0000", 2023-10-08T07:07:52.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198471+0000", 2023-10-08T07:07:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.84e-07 2023-10-08T07:07:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198482+0000", 2023-10-08T07:07:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1409e-05 2023-10-08T07:07:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198501+0000", 2023-10-08T07:07:52.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8510000000000001e-05 2023-10-08T07:07:52.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198506+0000", 2023-10-08T07:07:52.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7190000000000001e-06 2023-10-08T07:07:52.356 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.356 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.356 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.356 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172630 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.357 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.212600+0000", 2023-10-08T07:07:52.357 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.10446058599999999, 2023-10-08T07:07:52.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.104587494, 2023-10-08T07:07:52.357 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.357 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.357 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172630 2023-10-08T07:07:52.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.358 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212600+0000", 2023-10-08T07:07:52.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212600+0000", 2023-10-08T07:07:52.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214296+0000", 2023-10-08T07:07:52.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001695954 2023-10-08T07:07:52.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214312+0000", 2023-10-08T07:07:52.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6189999999999999e-05 2023-10-08T07:07:52.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214323+0000", 2023-10-08T07:07:52.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0759e-05 2023-10-08T07:07:52.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214330+0000", 2023-10-08T07:07:52.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7190000000000001e-06 2023-10-08T07:07:52.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.361 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.361 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172678 4.21 4.5d9f5e61 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.361 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.226582+0000", 2023-10-08T07:07:52.361 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.090478413999999993, 2023-10-08T07:07:52.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.090636303000000001, 2023-10-08T07:07:52.361 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.361 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.361 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.362 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172678 2023-10-08T07:07:52.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.362 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226582+0000", 2023-10-08T07:07:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226582+0000", 2023-10-08T07:07:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226642+0000", 2023-10-08T07:07:52.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9923999999999998e-05 2023-10-08T07:07:52.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226661+0000", 2023-10-08T07:07:52.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8953999999999998e-05 2023-10-08T07:07:52.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226668+0000", 2023-10-08T07:07:52.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3150000000000003e-06 2023-10-08T07:07:52.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226674+0000", 2023-10-08T07:07:52.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2450000000000003e-06 2023-10-08T07:07:52.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.365 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.365 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172861 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.366 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.290573+0000", 2023-10-08T07:07:52.366 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026487732, 2023-10-08T07:07:52.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026676417000000001, 2023-10-08T07:07:52.366 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.366 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.366 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172861 2023-10-08T07:07:52.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290573+0000", 2023-10-08T07:07:52.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290573+0000", 2023-10-08T07:07:52.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290573+0000", 2023-10-08T07:07:52.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2023-10-08T07:07:52.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290586+0000", 2023-10-08T07:07:52.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2858e-05 2023-10-08T07:07:52.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290593+0000", 2023-10-08T07:07:52.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9970000000000001e-06 2023-10-08T07:07:52.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290599+0000", 2023-10-08T07:07:52.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6409999999999999e-06 2023-10-08T07:07:52.369 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.370 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.370 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172910 4.7 4.b7910b47 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.370 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.308364+0000", 2023-10-08T07:07:52.370 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0086961369999999996, 2023-10-08T07:07:52.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089150670000000005, 2023-10-08T07:07:52.370 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.370 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.370 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.371 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172910 2023-10-08T07:07:52.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.371 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308364+0000", 2023-10-08T07:07:52.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308364+0000", 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308365+0000", 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8800000000000002e-07 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308377+0000", 2023-10-08T07:07:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2320999999999999e-05 2023-10-08T07:07:52.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308385+0000", 2023-10-08T07:07:52.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9289999999999998e-06 2023-10-08T07:07:52.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308391+0000", 2023-10-08T07:07:52.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1650000000000003e-06 2023-10-08T07:07:52.373 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.374 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.374 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171618 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.374 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.941701+0000", 2023-10-08T07:07:52.374 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37535962299999998, 2023-10-08T07:07:52.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.37563353199999999, 2023-10-08T07:07:52.374 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.374 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.374 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.374 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.375 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171618 2023-10-08T07:07:52.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.375 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.941701+0000", 2023-10-08T07:07:52.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.941701+0000", 2023-10-08T07:07:52.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943294+0000", 2023-10-08T07:07:52.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015933659999999999 2023-10-08T07:07:52.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943309+0000", 2023-10-08T07:07:52.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5157000000000001e-05 2023-10-08T07:07:52.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943321+0000", 2023-10-08T07:07:52.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1668000000000001e-05 2023-10-08T07:07:52.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943328+0000", 2023-10-08T07:07:52.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:07:52.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.378 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.378 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171752 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.379 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.984350+0000", 2023-10-08T07:07:52.379 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.332710648, 2023-10-08T07:07:52.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.33304200699999997, 2023-10-08T07:07:52.379 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.379 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.379 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171752 2023-10-08T07:07:52.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.379 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.984350+0000", 2023-10-08T07:07:52.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.984350+0000", 2023-10-08T07:07:52.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.984350+0000", 2023-10-08T07:07:52.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0500000000000003e-07 2023-10-08T07:07:52.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.984365+0000", 2023-10-08T07:07:52.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4632e-05 2023-10-08T07:07:52.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.984372+0000", 2023-10-08T07:07:52.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3950000000000003e-06 2023-10-08T07:07:52.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.984379+0000", 2023-10-08T07:07:52.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5640000000000002e-06 2023-10-08T07:07:52.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.382 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.382 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172073 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.382 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.058504+0000", 2023-10-08T07:07:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.258556748, 2023-10-08T07:07:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.25895033099999998, 2023-10-08T07:07:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172073 2023-10-08T07:07:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.058504+0000", 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.058504+0000", 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.061835+0000", 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033312049999999998 2023-10-08T07:07:52.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.061856+0000", 2023-10-08T07:07:52.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1478999999999999e-05 2023-10-08T07:07:52.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.061865+0000", 2023-10-08T07:07:52.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.276e-06 2023-10-08T07:07:52.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.061870+0000", 2023-10-08T07:07:52.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.451e-06 2023-10-08T07:07:52.386 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.386 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.386 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.386 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172224 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.386 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.103418+0000", 2023-10-08T07:07:52.386 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.21364292800000001, 2023-10-08T07:07:52.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.21410032400000001, 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172224 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.103418+0000", 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.103418+0000", 2023-10-08T07:07:52.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.103418+0000", 2023-10-08T07:07:52.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.65e-07 2023-10-08T07:07:52.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.103432+0000", 2023-10-08T07:07:52.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3838e-05 2023-10-08T07:07:52.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.103438+0000", 2023-10-08T07:07:52.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8730000000000004e-06 2023-10-08T07:07:52.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.103442+0000", 2023-10-08T07:07:52.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7439999999999998e-06 2023-10-08T07:07:52.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.390 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.390 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172488 4.9 4.dc9bef09 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.390 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.169932+0000", 2023-10-08T07:07:52.390 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.147128757, 2023-10-08T07:07:52.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.14764640400000001, 2023-10-08T07:07:52.390 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.390 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.391 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172488 2023-10-08T07:07:52.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.391 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169932+0000", 2023-10-08T07:07:52.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169932+0000", 2023-10-08T07:07:52.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169932+0000", 2023-10-08T07:07:52.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.41e-07 2023-10-08T07:07:52.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169947+0000", 2023-10-08T07:07:52.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5014000000000001e-05 2023-10-08T07:07:52.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169953+0000", 2023-10-08T07:07:52.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5400000000000003e-06 2023-10-08T07:07:52.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169957+0000", 2023-10-08T07:07:52.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6369999999999998e-06 2023-10-08T07:07:52.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.394 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.394 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.394 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172730 4.19 4.8d5b859 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.394 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.244437+0000", 2023-10-08T07:07:52.394 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.072623559000000004, 2023-10-08T07:07:52.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.073206801000000002, 2023-10-08T07:07:52.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.394 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.394 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.395 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172730 2023-10-08T07:07:52.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.395 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244437+0000", 2023-10-08T07:07:52.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244437+0000", 2023-10-08T07:07:52.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244437+0000", 2023-10-08T07:07:52.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2200000000000004e-07 2023-10-08T07:07:52.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244451+0000", 2023-10-08T07:07:52.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3482999999999999e-05 2023-10-08T07:07:52.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244458+0000", 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7780000000000002e-06 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244463+0000", 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.468e-06 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.398 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172784 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.398 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.257404+0000", 2023-10-08T07:07:52.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.059656604000000002, 2023-10-08T07:07:52.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060302343000000001, 2023-10-08T07:07:52.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.398 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.399 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172784 2023-10-08T07:07:52.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.399 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.257404+0000", 2023-10-08T07:07:52.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.257404+0000", 2023-10-08T07:07:52.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.257404+0000", 2023-10-08T07:07:52.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5599999999999995e-07 2023-10-08T07:07:52.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.257416+0000", 2023-10-08T07:07:52.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2041999999999999e-05 2023-10-08T07:07:52.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.257430+0000", 2023-10-08T07:07:52.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3123e-05 2023-10-08T07:07:52.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.257437+0000", 2023-10-08T07:07:52.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2023-10-08T07:07:52.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.401 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.402 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172862 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.402 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.290606+0000", 2023-10-08T07:07:52.402 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026454043999999999, 2023-10-08T07:07:52.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.027173172999999998, 2023-10-08T07:07:52.402 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.402 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.402 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172862 2023-10-08T07:07:52.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.403 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290606+0000", 2023-10-08T07:07:52.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290606+0000", 2023-10-08T07:07:52.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290607+0000", 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0699999999999998e-07 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290628+0000", 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1155999999999999e-05 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290635+0000", 2023-10-08T07:07:52.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.498e-06 2023-10-08T07:07:52.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290641+0000", 2023-10-08T07:07:52.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5110000000000003e-06 2023-10-08T07:07:52.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.405 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.406 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172915 4.2d 4:b7d3e31e:::10000000004.0000001e:head [write 2727936~4096 in=4096b,write 2842624~4096 in=4096b,write 2850816~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.406 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.308401+0000", 2023-10-08T07:07:52.406 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0086591540000000005, 2023-10-08T07:07:52.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0094529899999999997, 2023-10-08T07:07:52.406 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.406 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.406 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172915 2023-10-08T07:07:52.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308401+0000", 2023-10-08T07:07:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308401+0000", 2023-10-08T07:07:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308402+0000", 2023-10-08T07:07:52.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2900000000000004e-07 2023-10-08T07:07:52.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308418+0000", 2023-10-08T07:07:52.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6586e-05 2023-10-08T07:07:52.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308429+0000", 2023-10-08T07:07:52.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2023-10-08T07:07:52.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308435+0000", 2023-10-08T07:07:52.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7200000000000003e-06 2023-10-08T07:07:52.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308634+0000", 2023-10-08T07:07:52.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019921899999999999 2023-10-08T07:07:52.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308724+0000", 2023-10-08T07:07:52.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9461000000000003e-05 2023-10-08T07:07:52.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.410 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.410 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171620 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.410 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.943340+0000", 2023-10-08T07:07:52.411 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37372031700000002, 2023-10-08T07:07:52.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.37458976700000002, 2023-10-08T07:07:52.411 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.411 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.411 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171620 2023-10-08T07:07:52.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.411 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943340+0000", 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943340+0000", 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943341+0000", 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1699999999999998e-07 2023-10-08T07:07:52.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943354+0000", 2023-10-08T07:07:52.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3257e-05 2023-10-08T07:07:52.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943362+0000", 2023-10-08T07:07:52.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1689999999999992e-06 2023-10-08T07:07:52.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943367+0000", 2023-10-08T07:07:52.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1510000000000003e-06 2023-10-08T07:07:52.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.414 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.414 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171967 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.414 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.036604+0000", 2023-10-08T07:07:52.414 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28045624400000002, 2023-10-08T07:07:52.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.281390262, 2023-10-08T07:07:52.415 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.415 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.415 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171967 2023-10-08T07:07:52.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.415 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036604+0000", 2023-10-08T07:07:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036604+0000", 2023-10-08T07:07:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036974+0000", 2023-10-08T07:07:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000369718 2023-10-08T07:07:52.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.037001+0000", 2023-10-08T07:07:52.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6797000000000001e-05 2023-10-08T07:07:52.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.037012+0000", 2023-10-08T07:07:52.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0875e-05 2023-10-08T07:07:52.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.037020+0000", 2023-10-08T07:07:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.106e-06 2023-10-08T07:07:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172023 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.048443+0000", 2023-10-08T07:07:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26861734999999998, 2023-10-08T07:07:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.26961271399999998, 2023-10-08T07:07:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.419 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.419 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.419 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172023 2023-10-08T07:07:52.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.419 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048443+0000", 2023-10-08T07:07:52.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048443+0000", 2023-10-08T07:07:52.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048444+0000", 2023-10-08T07:07:52.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000002e-07 2023-10-08T07:07:52.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048456+0000", 2023-10-08T07:07:52.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1936000000000001e-05 2023-10-08T07:07:52.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048462+0000", 2023-10-08T07:07:52.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.302e-06 2023-10-08T07:07:52.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048467+0000", 2023-10-08T07:07:52.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4249999999999997e-06 2023-10-08T07:07:52.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.422 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.422 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172124 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.422 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.075514+0000", 2023-10-08T07:07:52.422 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.241545974, 2023-10-08T07:07:52.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.242601228, 2023-10-08T07:07:52.422 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.422 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.423 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172124 2023-10-08T07:07:52.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.423 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.075514+0000", 2023-10-08T07:07:52.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.075514+0000", 2023-10-08T07:07:52.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.075515+0000", 2023-10-08T07:07:52.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6100000000000002e-07 2023-10-08T07:07:52.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.075528+0000", 2023-10-08T07:07:52.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3516000000000001e-05 2023-10-08T07:07:52.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.075534+0000", 2023-10-08T07:07:52.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8019999999999997e-06 2023-10-08T07:07:52.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.075539+0000", 2023-10-08T07:07:52.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4660000000000001e-06 2023-10-08T07:07:52.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.425 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.426 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172426 4.21 4.5d9f5e61 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.426 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.162729+0000", 2023-10-08T07:07:52.426 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15433127499999999, 2023-10-08T07:07:52.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.15544606899999999, 2023-10-08T07:07:52.426 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.426 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172426 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162729+0000", 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162729+0000", 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162730+0000", 2023-10-08T07:07:52.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.51e-07 2023-10-08T07:07:52.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162741+0000", 2023-10-08T07:07:52.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.136e-05 2023-10-08T07:07:52.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162748+0000", 2023-10-08T07:07:52.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5980000000000002e-06 2023-10-08T07:07:52.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162753+0000", 2023-10-08T07:07:52.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2850000000000002e-06 2023-10-08T07:07:52.429 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.429 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.429 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172636 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.214383+0000", 2023-10-08T07:07:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.102677608, 2023-10-08T07:07:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.103853678, 2023-10-08T07:07:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172636 2023-10-08T07:07:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.430 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214383+0000", 2023-10-08T07:07:52.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214383+0000", 2023-10-08T07:07:52.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214383+0000", 2023-10-08T07:07:52.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5400000000000002e-07 2023-10-08T07:07:52.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214395+0000", 2023-10-08T07:07:52.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868999999999999e-05 2023-10-08T07:07:52.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214402+0000", 2023-10-08T07:07:52.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4679999999999997e-06 2023-10-08T07:07:52.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214407+0000", 2023-10-08T07:07:52.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7620000000000001e-06 2023-10-08T07:07:52.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.433 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.434 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172863 4.37 4:efdd41ff:::10000000004.0000001c:head [write 1331200~4096 in=4096b,write 1347584~4096 in=4096b,write 1359872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.434 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.290649+0000", 2023-10-08T07:07:52.434 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026411311, 2023-10-08T07:07:52.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.02765103, 2023-10-08T07:07:52.434 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.434 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.434 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172863 2023-10-08T07:07:52.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.434 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290649+0000", 2023-10-08T07:07:52.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290649+0000", 2023-10-08T07:07:52.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290650+0000", 2023-10-08T07:07:52.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5299999999999999e-07 2023-10-08T07:07:52.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290663+0000", 2023-10-08T07:07:52.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3854e-05 2023-10-08T07:07:52.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290674+0000", 2023-10-08T07:07:52.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0142999999999999e-05 2023-10-08T07:07:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290680+0000", 2023-10-08T07:07:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9460000000000003e-06 2023-10-08T07:07:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.311799+0000", 2023-10-08T07:07:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021119737 2023-10-08T07:07:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.311872+0000", 2023-10-08T07:07:52.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2368999999999998e-05 2023-10-08T07:07:52.438 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.438 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.438 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.438 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171473 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.438 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.909384+0000", 2023-10-08T07:07:52.438 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.407676119, 2023-10-08T07:07:52.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.40897855900000002, 2023-10-08T07:07:52.439 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.439 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.439 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.439 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.439 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.439 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171473 2023-10-08T07:07:52.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.439 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.909384+0000", 2023-10-08T07:07:52.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.909384+0000", 2023-10-08T07:07:52.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.909385+0000", 2023-10-08T07:07:52.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2023-10-08T07:07:52.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.909398+0000", 2023-10-08T07:07:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2717999999999999e-05 2023-10-08T07:07:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.909405+0000", 2023-10-08T07:07:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.627e-06 2023-10-08T07:07:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.909411+0000", 2023-10-08T07:07:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000001e-06 2023-10-08T07:07:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171625 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.943374+0000", 2023-10-08T07:07:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37368674499999999, 2023-10-08T07:07:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.37504116399999998, 2023-10-08T07:07:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.443 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171625 2023-10-08T07:07:52.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.443 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943374+0000", 2023-10-08T07:07:52.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943374+0000", 2023-10-08T07:07:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943374+0000", 2023-10-08T07:07:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.84e-07 2023-10-08T07:07:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943385+0000", 2023-10-08T07:07:52.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0543000000000001e-05 2023-10-08T07:07:52.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943390+0000", 2023-10-08T07:07:52.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7699999999999998e-06 2023-10-08T07:07:52.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.943396+0000", 2023-10-08T07:07:52.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1540000000000001e-06 2023-10-08T07:07:52.445 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.446 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.446 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172025 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.446 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.048474+0000", 2023-10-08T07:07:52.446 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26858625200000003, 2023-10-08T07:07:52.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.26999352799999998, 2023-10-08T07:07:52.446 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.446 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172025 2023-10-08T07:07:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048474+0000", 2023-10-08T07:07:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048474+0000", 2023-10-08T07:07:52.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048475+0000", 2023-10-08T07:07:52.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3900000000000005e-07 2023-10-08T07:07:52.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048492+0000", 2023-10-08T07:07:52.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6867e-05 2023-10-08T07:07:52.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048499+0000", 2023-10-08T07:07:52.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6170000000000001e-06 2023-10-08T07:07:52.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048506+0000", 2023-10-08T07:07:52.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0999999999999998e-06 2023-10-08T07:07:52.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.450 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.450 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172493 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.450 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.169989+0000", 2023-10-08T07:07:52.450 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14707098299999999, 2023-10-08T07:07:52.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.14853043899999999, 2023-10-08T07:07:52.450 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.450 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.451 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.451 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172493 2023-10-08T07:07:52.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.451 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169989+0000", 2023-10-08T07:07:52.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169989+0000", 2023-10-08T07:07:52.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169990+0000", 2023-10-08T07:07:52.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1100000000000001e-07 2023-10-08T07:07:52.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169999+0000", 2023-10-08T07:07:52.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8559999999999996e-06 2023-10-08T07:07:52.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.170004+0000", 2023-10-08T07:07:52.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4349999999999996e-06 2023-10-08T07:07:52.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.170009+0000", 2023-10-08T07:07:52.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5839999999999996e-06 2023-10-08T07:07:52.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.453 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.454 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172540 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.454 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.182502+0000", 2023-10-08T07:07:52.454 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.134558017, 2023-10-08T07:07:52.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.136071105, 2023-10-08T07:07:52.454 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.454 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.455 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172540 2023-10-08T07:07:52.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.455 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.182502+0000", 2023-10-08T07:07:52.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.182502+0000", 2023-10-08T07:07:52.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.184294+0000", 2023-10-08T07:07:52.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017916360000000001 2023-10-08T07:07:52.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.184314+0000", 2023-10-08T07:07:52.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9703000000000001e-05 2023-10-08T07:07:52.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.184323+0000", 2023-10-08T07:07:52.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2539999999999998e-06 2023-10-08T07:07:52.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.184331+0000", 2023-10-08T07:07:52.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5320000000000001e-06 2023-10-08T07:07:52.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.457 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.458 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172916 4.15 4:a88808fa:::10000000004.0000001f:head [write 237568~4096 in=4096b,write 274432~4096 in=4096b,write 315392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.458 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.308448+0000", 2023-10-08T07:07:52.458 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0086119669999999999, 2023-10-08T07:07:52.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010183773, 2023-10-08T07:07:52.458 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.458 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.458 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172916 2023-10-08T07:07:52.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.459 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308448+0000", 2023-10-08T07:07:52.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308448+0000", 2023-10-08T07:07:52.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310294+0000", 2023-10-08T07:07:52.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018455609999999999 2023-10-08T07:07:52.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310310+0000", 2023-10-08T07:07:52.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6453e-05 2023-10-08T07:07:52.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310323+0000", 2023-10-08T07:07:52.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2537e-05 2023-10-08T07:07:52.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310330+0000", 2023-10-08T07:07:52.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4089999999999997e-06 2023-10-08T07:07:52.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310377+0000", 2023-10-08T07:07:52.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7009999999999999e-05 2023-10-08T07:07:52.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310457+0000", 2023-10-08T07:07:52.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9386000000000002e-05 2023-10-08T07:07:52.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.462 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.462 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172027 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.462 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.048514+0000", 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26854676500000002, 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27018274799999997, 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172027 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048514+0000", 2023-10-08T07:07:52.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048514+0000", 2023-10-08T07:07:52.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048514+0000", 2023-10-08T07:07:52.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4000000000000002e-07 2023-10-08T07:07:52.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048526+0000", 2023-10-08T07:07:52.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.182e-05 2023-10-08T07:07:52.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048532+0000", 2023-10-08T07:07:52.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3430000000000001e-06 2023-10-08T07:07:52.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048538+0000", 2023-10-08T07:07:52.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5060000000000003e-06 2023-10-08T07:07:52.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.466 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.466 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172176 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.466 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.085593+0000", 2023-10-08T07:07:52.467 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.231467272, 2023-10-08T07:07:52.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.233156737, 2023-10-08T07:07:52.467 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.467 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.467 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.467 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.467 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.467 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172176 2023-10-08T07:07:52.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.467 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.085593+0000", 2023-10-08T07:07:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.085593+0000", 2023-10-08T07:07:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.085594+0000", 2023-10-08T07:07:52.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2899999999999999e-07 2023-10-08T07:07:52.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.085606+0000", 2023-10-08T07:07:52.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1933000000000001e-05 2023-10-08T07:07:52.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.085611+0000", 2023-10-08T07:07:52.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7520000000000002e-06 2023-10-08T07:07:52.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.085616+0000", 2023-10-08T07:07:52.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4870000000000004e-06 2023-10-08T07:07:52.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.470 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.470 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172332 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.470 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.135360+0000", 2023-10-08T07:07:52.470 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.18170018600000001, 2023-10-08T07:07:52.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.183441308, 2023-10-08T07:07:52.471 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.471 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.471 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172332 2023-10-08T07:07:52.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.471 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.135360+0000", 2023-10-08T07:07:52.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.135360+0000", 2023-10-08T07:07:52.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.135361+0000", 2023-10-08T07:07:52.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.89e-07 2023-10-08T07:07:52.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.135376+0000", 2023-10-08T07:07:52.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4922999999999999e-05 2023-10-08T07:07:52.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.135385+0000", 2023-10-08T07:07:52.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2699999999999993e-06 2023-10-08T07:07:52.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.135390+0000", 2023-10-08T07:07:52.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1420000000000001e-06 2023-10-08T07:07:52.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.474 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.474 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172431 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.474 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.162794+0000", 2023-10-08T07:07:52.474 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15426605500000001, 2023-10-08T07:07:52.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.15605960599999999, 2023-10-08T07:07:52.474 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172431 2023-10-08T07:07:52.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.475 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162794+0000", 2023-10-08T07:07:52.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162794+0000", 2023-10-08T07:07:52.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162795+0000", 2023-10-08T07:07:52.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2300000000000001e-07 2023-10-08T07:07:52.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162810+0000", 2023-10-08T07:07:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.482e-05 2023-10-08T07:07:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162816+0000", 2023-10-08T07:07:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5649999999999998e-06 2023-10-08T07:07:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162822+0000", 2023-10-08T07:07:52.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2299999999999999e-06 2023-10-08T07:07:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172496 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.170014+0000", 2023-10-08T07:07:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.147046288, 2023-10-08T07:07:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.148891932, 2023-10-08T07:07:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.478 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.479 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172496 2023-10-08T07:07:52.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.479 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.170014+0000", 2023-10-08T07:07:52.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.170014+0000", 2023-10-08T07:07:52.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.170014+0000", 2023-10-08T07:07:52.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4400000000000001e-07 2023-10-08T07:07:52.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.170036+0000", 2023-10-08T07:07:52.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1861e-05 2023-10-08T07:07:52.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.170043+0000", 2023-10-08T07:07:52.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0600000000000002e-06 2023-10-08T07:07:52.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.170048+0000", 2023-10-08T07:07:52.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8509999999999998e-06 2023-10-08T07:07:52.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.482 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.482 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.482 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172638 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.482 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.214451+0000", 2023-10-08T07:07:52.482 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.10260936499999999, 2023-10-08T07:07:52.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.104516899, 2023-10-08T07:07:52.482 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.482 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.482 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.483 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172638 2023-10-08T07:07:52.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.483 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214451+0000", 2023-10-08T07:07:52.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214451+0000", 2023-10-08T07:07:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214452+0000", 2023-10-08T07:07:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7999999999999996e-07 2023-10-08T07:07:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214465+0000", 2023-10-08T07:07:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3067e-05 2023-10-08T07:07:52.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214471+0000", 2023-10-08T07:07:52.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1840000000000004e-06 2023-10-08T07:07:52.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.214476+0000", 2023-10-08T07:07:52.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2170000000000002e-06 2023-10-08T07:07:52.485 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.485 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.486 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.486 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172735 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.486 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.244589+0000", 2023-10-08T07:07:52.486 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.072471799000000003, 2023-10-08T07:07:52.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.074432698000000005, 2023-10-08T07:07:52.486 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.486 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.486 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.487 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.487 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172735 2023-10-08T07:07:52.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.487 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244589+0000", 2023-10-08T07:07:52.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244589+0000", 2023-10-08T07:07:52.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.248939+0000", 2023-10-08T07:07:52.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043498770000000003 2023-10-08T07:07:52.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.248962+0000", 2023-10-08T07:07:52.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2983999999999999e-05 2023-10-08T07:07:52.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.248974+0000", 2023-10-08T07:07:52.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2106000000000001e-05 2023-10-08T07:07:52.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.248984+0000", 2023-10-08T07:07:52.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9369999999999999e-06 2023-10-08T07:07:52.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.489 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.490 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172868 4.7 4:e2d089ed:::10000000004.00000033:head [write 544768~4096 in=4096b,write 794624~4096 in=4096b,write 880640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.490 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.290731+0000", 2023-10-08T07:07:52.490 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026329788999999999, 2023-10-08T07:07:52.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028348976000000001, 2023-10-08T07:07:52.490 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.490 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.490 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172868 2023-10-08T07:07:52.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.491 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290731+0000", 2023-10-08T07:07:52.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290731+0000", 2023-10-08T07:07:52.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290731+0000", 2023-10-08T07:07:52.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.63e-07 2023-10-08T07:07:52.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290747+0000", 2023-10-08T07:07:52.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5724000000000001e-05 2023-10-08T07:07:52.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290756+0000", 2023-10-08T07:07:52.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1239999999999994e-06 2023-10-08T07:07:52.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290762+0000", 2023-10-08T07:07:52.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0410000000000003e-06 2023-10-08T07:07:52.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.312513+0000", 2023-10-08T07:07:52.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021751054999999998 2023-10-08T07:07:52.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.312595+0000", 2023-10-08T07:07:52.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1489999999999994e-05 2023-10-08T07:07:52.494 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.494 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.494 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.495 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172917 4.3f 4.9eb4593f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.495 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.310346+0000", 2023-10-08T07:07:52.495 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0067142390000000003, 2023-10-08T07:07:52.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088202590000000004, 2023-10-08T07:07:52.495 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.495 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.495 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.495 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.495 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.495 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172917 2023-10-08T07:07:52.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.496 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310346+0000", 2023-10-08T07:07:52.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310346+0000", 2023-10-08T07:07:52.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310347+0000", 2023-10-08T07:07:52.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2600000000000002e-07 2023-10-08T07:07:52.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310364+0000", 2023-10-08T07:07:52.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7147e-05 2023-10-08T07:07:52.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310373+0000", 2023-10-08T07:07:52.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4679999999999998e-06 2023-10-08T07:07:52.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310379+0000", 2023-10-08T07:07:52.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5110000000000003e-06 2023-10-08T07:07:52.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.498 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.499 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171432 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.499 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.897328+0000", 2023-10-08T07:07:52.499 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.41973210799999999, 2023-10-08T07:07:52.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.421900736, 2023-10-08T07:07:52.499 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.499 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.499 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171432 2023-10-08T07:07:52.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.500 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.897328+0000", 2023-10-08T07:07:52.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.897328+0000", 2023-10-08T07:07:52.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.897329+0000", 2023-10-08T07:07:52.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9299999999999999e-07 2023-10-08T07:07:52.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.897343+0000", 2023-10-08T07:07:52.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4270000000000001e-05 2023-10-08T07:07:52.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.897350+0000", 2023-10-08T07:07:52.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5590000000000002e-06 2023-10-08T07:07:52.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.897354+0000", 2023-10-08T07:07:52.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8489999999999997e-06 2023-10-08T07:07:52.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.502 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.502 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171881 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.503 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.007333+0000", 2023-10-08T07:07:52.503 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.30972710199999998, 2023-10-08T07:07:52.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.31194883600000001, 2023-10-08T07:07:52.503 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.503 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.503 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171881 2023-10-08T07:07:52.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.503 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.007333+0000", 2023-10-08T07:07:52.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.007333+0000", 2023-10-08T07:07:52.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.009295+0000", 2023-10-08T07:07:52.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019612010000000001 2023-10-08T07:07:52.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.009311+0000", 2023-10-08T07:07:52.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6286e-05 2023-10-08T07:07:52.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.009324+0000", 2023-10-08T07:07:52.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.322e-05 2023-10-08T07:07:52.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.009332+0000", 2023-10-08T07:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4959999999999999e-06 2023-10-08T07:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172031 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.048545+0000", 2023-10-08T07:07:52.506 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26851560400000002, 2023-10-08T07:07:52.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.270800023, 2023-10-08T07:07:52.507 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.507 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.507 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172031 2023-10-08T07:07:52.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.507 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048545+0000", 2023-10-08T07:07:52.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048545+0000", 2023-10-08T07:07:52.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048545+0000", 2023-10-08T07:07:52.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8200000000000001e-07 2023-10-08T07:07:52.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048562+0000", 2023-10-08T07:07:52.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6578999999999998e-05 2023-10-08T07:07:52.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048568+0000", 2023-10-08T07:07:52.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0499999999999997e-06 2023-10-08T07:07:52.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048573+0000", 2023-10-08T07:07:52.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2279999999999998e-06 2023-10-08T07:07:52.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.510 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.510 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172432 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.510 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.162829+0000", 2023-10-08T07:07:52.511 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15423179100000001, 2023-10-08T07:07:52.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.156569707, 2023-10-08T07:07:52.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172432 2023-10-08T07:07:52.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.511 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162829+0000", 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162829+0000", 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162829+0000", 2023-10-08T07:07:52.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:07:52.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162847+0000", 2023-10-08T07:07:52.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7672e-05 2023-10-08T07:07:52.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162854+0000", 2023-10-08T07:07:52.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9439999999999999e-06 2023-10-08T07:07:52.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162859+0000", 2023-10-08T07:07:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4210000000000003e-06 2023-10-08T07:07:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172681 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.232341+0000", 2023-10-08T07:07:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.084719050000000004, 2023-10-08T07:07:52.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.087110910999999999, 2023-10-08T07:07:52.515 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.515 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.515 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172681 2023-10-08T07:07:52.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.515 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.232341+0000", 2023-10-08T07:07:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.232341+0000", 2023-10-08T07:07:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.234622+0000", 2023-10-08T07:07:52.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022808770000000002 2023-10-08T07:07:52.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.234639+0000", 2023-10-08T07:07:52.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6939000000000002e-05 2023-10-08T07:07:52.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.234647+0000", 2023-10-08T07:07:52.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2779999999999993e-06 2023-10-08T07:07:52.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.234653+0000", 2023-10-08T07:07:52.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5910000000000003e-06 2023-10-08T07:07:52.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.518 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.518 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172869 4.7 4:e2479c46:::10000000004.00000024:head [write 1392640~4096 in=4096b,write 1765376~4096 in=4096b,write 1806336~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.518 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.290770+0000", 2023-10-08T07:07:52.518 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026290607000000001, 2023-10-08T07:07:52.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028740901999999999, 2023-10-08T07:07:52.519 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.519 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.519 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172869 2023-10-08T07:07:52.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.519 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290770+0000", 2023-10-08T07:07:52.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290770+0000", 2023-10-08T07:07:52.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290770+0000", 2023-10-08T07:07:52.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3399999999999999e-07 2023-10-08T07:07:52.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290790+0000", 2023-10-08T07:07:52.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9649000000000001e-05 2023-10-08T07:07:52.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290798+0000", 2023-10-08T07:07:52.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5379999999999997e-06 2023-10-08T07:07:52.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290803+0000", 2023-10-08T07:07:52.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9320000000000001e-06 2023-10-08T07:07:52.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.316882+0000", 2023-10-08T07:07:52.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026078247999999998 2023-10-08T07:07:52.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.316966+0000", 2023-10-08T07:07:52.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4748999999999998e-05 2023-10-08T07:07:52.523 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.523 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.523 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.523 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172918 4.19 4.c7f564d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.523 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.310386+0000", 2023-10-08T07:07:52.523 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0066743230000000002, 2023-10-08T07:07:52.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091958290000000008, 2023-10-08T07:07:52.524 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.524 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.524 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172918 2023-10-08T07:07:52.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.524 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310386+0000", 2023-10-08T07:07:52.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310386+0000", 2023-10-08T07:07:52.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310387+0000", 2023-10-08T07:07:52.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2023-10-08T07:07:52.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310397+0000", 2023-10-08T07:07:52.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0807e-05 2023-10-08T07:07:52.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310404+0000", 2023-10-08T07:07:52.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6259999999999997e-06 2023-10-08T07:07:52.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310409+0000", 2023-10-08T07:07:52.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2549999999999997e-06 2023-10-08T07:07:52.527 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.527 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.527 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.529 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172230 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.529 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.103561+0000", 2023-10-08T07:07:52.529 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.213499455, 2023-10-08T07:07:52.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.21608079299999999, 2023-10-08T07:07:52.529 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.529 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.529 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.529 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172230 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.103561+0000", 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.103561+0000", 2023-10-08T07:07:52.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.103561+0000", 2023-10-08T07:07:52.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0900000000000002e-07 2023-10-08T07:07:52.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.103578+0000", 2023-10-08T07:07:52.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6189999999999999e-05 2023-10-08T07:07:52.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.103583+0000", 2023-10-08T07:07:52.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7069999999999997e-06 2023-10-08T07:07:52.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.103588+0000", 2023-10-08T07:07:52.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4410000000000003e-06 2023-10-08T07:07:52.532 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.532 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.532 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.533 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172383 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.533 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.149440+0000", 2023-10-08T07:07:52.533 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.16761995199999999, 2023-10-08T07:07:52.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.170266952, 2023-10-08T07:07:52.533 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.533 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.533 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.533 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.533 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.533 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172383 2023-10-08T07:07:52.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.534 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.149440+0000", 2023-10-08T07:07:52.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.149440+0000", 2023-10-08T07:07:52.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.149441+0000", 2023-10-08T07:07:52.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2023-10-08T07:07:52.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.149452+0000", 2023-10-08T07:07:52.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1083999999999999e-05 2023-10-08T07:07:52.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.149458+0000", 2023-10-08T07:07:52.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5820000000000001e-06 2023-10-08T07:07:52.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.149462+0000", 2023-10-08T07:07:52.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.566e-06 2023-10-08T07:07:52.536 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.536 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.536 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.537 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172827 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.537 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.283586+0000", 2023-10-08T07:07:52.537 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.033474324999999999, 2023-10-08T07:07:52.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.036186162000000001, 2023-10-08T07:07:52.537 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.537 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.537 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.537 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.537 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.537 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172827 2023-10-08T07:07:52.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.537 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283586+0000", 2023-10-08T07:07:52.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283586+0000", 2023-10-08T07:07:52.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283587+0000", 2023-10-08T07:07:52.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:07:52.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283601+0000", 2023-10-08T07:07:52.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4331999999999999e-05 2023-10-08T07:07:52.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283608+0000", 2023-10-08T07:07:52.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8329999999999996e-06 2023-10-08T07:07:52.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283615+0000", 2023-10-08T07:07:52.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4680000000000003e-06 2023-10-08T07:07:52.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.540 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.540 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172870 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.540 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.290811+0000", 2023-10-08T07:07:52.541 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026249018999999998, 2023-10-08T07:07:52.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.029026606999999999, 2023-10-08T07:07:52.541 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.541 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.541 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172870 2023-10-08T07:07:52.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.541 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290811+0000", 2023-10-08T07:07:52.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290811+0000", 2023-10-08T07:07:52.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290812+0000", 2023-10-08T07:07:52.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999996e-07 2023-10-08T07:07:52.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290832+0000", 2023-10-08T07:07:52.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0051000000000002e-05 2023-10-08T07:07:52.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290843+0000", 2023-10-08T07:07:52.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1083999999999999e-05 2023-10-08T07:07:52.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290849+0000", 2023-10-08T07:07:52.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0050000000000001e-06 2023-10-08T07:07:52.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.544 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.544 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172919 4.3e 4:7cb83261:::10000000004.0000003b:head [write 3694592~8192 in=8192b,write 3735552~4096 in=4096b,write 3772416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.544 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.310417+0000", 2023-10-08T07:07:52.544 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0066435690000000002, 2023-10-08T07:07:52.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0095136230000000006, 2023-10-08T07:07:52.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.545 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172919 2023-10-08T07:07:52.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.545 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310417+0000", 2023-10-08T07:07:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310417+0000", 2023-10-08T07:07:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310417+0000", 2023-10-08T07:07:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0500000000000003e-07 2023-10-08T07:07:52.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310438+0000", 2023-10-08T07:07:52.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0798e-05 2023-10-08T07:07:52.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310445+0000", 2023-10-08T07:07:52.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2023-10-08T07:07:52.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310451+0000", 2023-10-08T07:07:52.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.485e-06 2023-10-08T07:07:52.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.312194+0000", 2023-10-08T07:07:52.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001742682 2023-10-08T07:07:52.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.312280+0000", 2023-10-08T07:07:52.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6935999999999996e-05 2023-10-08T07:07:52.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.549 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.549 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171335 4.0 4:02bf98b6:::10000000004.0000000e:head [write 196608~4096 in=4096b,write 253952~4096 in=4096b,write 282624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.549 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.869767+0000", 2023-10-08T07:07:52.549 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.447293634, 2023-10-08T07:07:52.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.45025303100000003, 2023-10-08T07:07:52.549 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:52.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.550 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171335 2023-10-08T07:07:52.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.550 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.869767+0000", 2023-10-08T07:07:52.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.869767+0000", 2023-10-08T07:07:52.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.869767+0000", 2023-10-08T07:07:52.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4300000000000003e-07 2023-10-08T07:07:52.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.869780+0000", 2023-10-08T07:07:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2257e-05 2023-10-08T07:07:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.869786+0000", 2023-10-08T07:07:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5520000000000001e-06 2023-10-08T07:07:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.869792+0000", 2023-10-08T07:07:52.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4489999999999998e-06 2023-10-08T07:07:52.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310972+0000", 2023-10-08T07:07:52.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44118019600000002 2023-10-08T07:07:52.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.311047+0000", 2023-10-08T07:07:52.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4858999999999996e-05 2023-10-08T07:07:52.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:52.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.311188+0000", 2023-10-08T07:07:52.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014107900000000001 2023-10-08T07:07:52.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.554 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.554 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171381 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.554 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.891498+0000", 2023-10-08T07:07:52.555 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42556241, 2023-10-08T07:07:52.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.42860356700000002, 2023-10-08T07:07:52.555 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.555 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.555 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.555 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171381 2023-10-08T07:07:52.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.555 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.891498+0000", 2023-10-08T07:07:52.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.891498+0000", 2023-10-08T07:07:52.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.891498+0000", 2023-10-08T07:07:52.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6699999999999999e-07 2023-10-08T07:07:52.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.891510+0000", 2023-10-08T07:07:52.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1798e-05 2023-10-08T07:07:52.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.891516+0000", 2023-10-08T07:07:52.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7649999999999999e-06 2023-10-08T07:07:52.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.891521+0000", 2023-10-08T07:07:52.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1719999999999998e-06 2023-10-08T07:07:52.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.558 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.558 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171485 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.558 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.909521+0000", 2023-10-08T07:07:52.558 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.40753899399999999, 2023-10-08T07:07:52.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.410641547, 2023-10-08T07:07:52.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.559 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171485 2023-10-08T07:07:52.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.559 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.909521+0000", 2023-10-08T07:07:52.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.909521+0000", 2023-10-08T07:07:52.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.911295+0000", 2023-10-08T07:07:52.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001773791 2023-10-08T07:07:52.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.911310+0000", 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4397e-05 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.911358+0000", 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8043000000000001e-05 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.911366+0000", 2023-10-08T07:07:52.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5909999999999996e-06 2023-10-08T07:07:52.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.562 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171673 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.562 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.955539+0000", 2023-10-08T07:07:52.562 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.361521011, 2023-10-08T07:07:52.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.36465419500000001, 2023-10-08T07:07:52.562 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.562 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.563 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171673 2023-10-08T07:07:52.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.563 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.955539+0000", 2023-10-08T07:07:52.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.955539+0000", 2023-10-08T07:07:52.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.955540+0000", 2023-10-08T07:07:52.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8299999999999997e-07 2023-10-08T07:07:52.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.955562+0000", 2023-10-08T07:07:52.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1506999999999999e-05 2023-10-08T07:07:52.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.955569+0000", 2023-10-08T07:07:52.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1119999999999998e-06 2023-10-08T07:07:52.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.955575+0000", 2023-10-08T07:07:52.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6980000000000001e-06 2023-10-08T07:07:52.565 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.566 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.566 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.566 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171886 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.566 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.009388+0000", 2023-10-08T07:07:52.566 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.307672791, 2023-10-08T07:07:52.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.31083576299999999, 2023-10-08T07:07:52.566 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.566 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.566 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.567 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.567 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.567 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171886 2023-10-08T07:07:52.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.567 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.009388+0000", 2023-10-08T07:07:52.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.009388+0000", 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.009388+0000", 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8599999999999999e-07 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.009402+0000", 2023-10-08T07:07:52.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4209999999999999e-05 2023-10-08T07:07:52.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.009408+0000", 2023-10-08T07:07:52.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1510000000000001e-06 2023-10-08T07:07:52.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.009414+0000", 2023-10-08T07:07:52.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1490000000000002e-06 2023-10-08T07:07:52.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.570 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.570 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172085 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.570 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.062091+0000", 2023-10-08T07:07:52.570 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.25496938699999999, 2023-10-08T07:07:52.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.25816265599999999, 2023-10-08T07:07:52.570 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.570 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.571 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172085 2023-10-08T07:07:52.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.571 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.062091+0000", 2023-10-08T07:07:52.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.062091+0000", 2023-10-08T07:07:52.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.062091+0000", 2023-10-08T07:07:52.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.84e-07 2023-10-08T07:07:52.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.062100+0000", 2023-10-08T07:07:52.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9590000000000001e-06 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.062104+0000", 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.67e-06 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.062107+0000", 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7700000000000002e-06 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.574 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172334 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.574 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.137338+0000", 2023-10-08T07:07:52.574 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.17972275200000001, 2023-10-08T07:07:52.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.182946003, 2023-10-08T07:07:52.574 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.574 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.574 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172334 2023-10-08T07:07:52.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.575 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.137338+0000", 2023-10-08T07:07:52.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.137338+0000", 2023-10-08T07:07:52.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.139297+0000", 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019588470000000001 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.139315+0000", 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7983999999999999e-05 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.139326+0000", 2023-10-08T07:07:52.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1609e-05 2023-10-08T07:07:52.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.139335+0000", 2023-10-08T07:07:52.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8470000000000002e-06 2023-10-08T07:07:52.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.577 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.577 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172500 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.578 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.170085+0000", 2023-10-08T07:07:52.578 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.146975403, 2023-10-08T07:07:52.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.15023615200000001, 2023-10-08T07:07:52.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.578 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172500 2023-10-08T07:07:52.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.578 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.170085+0000", 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.170085+0000", 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.171296+0000", 2023-10-08T07:07:52.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00121105 2023-10-08T07:07:52.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.171314+0000", 2023-10-08T07:07:52.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7915e-05 2023-10-08T07:07:52.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.171324+0000", 2023-10-08T07:07:52.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9639999999999998e-06 2023-10-08T07:07:52.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.171331+0000", 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3390000000000004e-06 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172591 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.202879+0000", 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.114181386, 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.11747843500000001, 2023-10-08T07:07:52.581 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.582 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.582 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172591 2023-10-08T07:07:52.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.582 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.202879+0000", 2023-10-08T07:07:52.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.202879+0000", 2023-10-08T07:07:52.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.202880+0000", 2023-10-08T07:07:52.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5000000000000001e-07 2023-10-08T07:07:52.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.202898+0000", 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8368000000000001e-05 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.202909+0000", 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0964999999999999e-05 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.202916+0000", 2023-10-08T07:07:52.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7109999999999998e-06 2023-10-08T07:07:52.585 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.585 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.585 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.585 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172640 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.585 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.216352+0000", 2023-10-08T07:07:52.585 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.100708704, 2023-10-08T07:07:52.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.104048533, 2023-10-08T07:07:52.585 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.585 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.585 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172640 2023-10-08T07:07:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216352+0000", 2023-10-08T07:07:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216352+0000", 2023-10-08T07:07:52.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216352+0000", 2023-10-08T07:07:52.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3200000000000004e-07 2023-10-08T07:07:52.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216366+0000", 2023-10-08T07:07:52.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.344e-05 2023-10-08T07:07:52.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216374+0000", 2023-10-08T07:07:52.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3380000000000005e-06 2023-10-08T07:07:52.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216381+0000", 2023-10-08T07:07:52.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5479999999999998e-06 2023-10-08T07:07:52.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172741 4.19 4.c7f564d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.249094+0000", 2023-10-08T07:07:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.067965977999999996, 2023-10-08T07:07:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.071348121, 2023-10-08T07:07:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.590 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.590 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172741 2023-10-08T07:07:52.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.590 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249094+0000", 2023-10-08T07:07:52.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249094+0000", 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249095+0000", 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9400000000000005e-07 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249108+0000", 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3256e-05 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249115+0000", 2023-10-08T07:07:52.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0380000000000002e-06 2023-10-08T07:07:52.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249121+0000", 2023-10-08T07:07:52.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5729999999999998e-06 2023-10-08T07:07:52.592 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.592 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.592 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172796 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.259443+0000", 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.057617518, 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.061044953999999998, 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172796 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.593 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.259443+0000", 2023-10-08T07:07:52.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.259443+0000", 2023-10-08T07:07:52.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.261294+0000", 2023-10-08T07:07:52.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001851054 2023-10-08T07:07:52.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.261321+0000", 2023-10-08T07:07:52.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6866999999999999e-05 2023-10-08T07:07:52.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.261332+0000", 2023-10-08T07:07:52.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0664e-05 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.261337+0000", 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5160000000000002e-06 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172828 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.283625+0000", 2023-10-08T07:07:52.596 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.033435254999999997, 2023-10-08T07:07:52.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.036906644000000002, 2023-10-08T07:07:52.597 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.597 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.597 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.597 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.597 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.597 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172828 2023-10-08T07:07:52.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.597 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283625+0000", 2023-10-08T07:07:52.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283625+0000", 2023-10-08T07:07:52.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283626+0000", 2023-10-08T07:07:52.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1500000000000004e-07 2023-10-08T07:07:52.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283638+0000", 2023-10-08T07:07:52.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2011000000000001e-05 2023-10-08T07:07:52.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283646+0000", 2023-10-08T07:07:52.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7710000000000006e-06 2023-10-08T07:07:52.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283651+0000", 2023-10-08T07:07:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4330000000000003e-06 2023-10-08T07:07:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172920 4.14 4:2b72a8af:::10000000004.0000000c:head [write 2138112~4096 in=4096b,write 2306048~4096 in=4096b,write 2334720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.310465+0000", 2023-10-08T07:07:52.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0065959080000000002, 2023-10-08T07:07:52.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010118713999999999, 2023-10-08T07:07:52.601 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.601 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.601 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.601 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.601 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.601 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172920 2023-10-08T07:07:52.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.601 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310465+0000", 2023-10-08T07:07:52.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310465+0000", 2023-10-08T07:07:52.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310465+0000", 2023-10-08T07:07:52.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.82e-07 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310477+0000", 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1705999999999999e-05 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310484+0000", 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.832e-06 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310489+0000", 2023-10-08T07:07:52.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5319999999999997e-06 2023-10-08T07:07:52.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310708+0000", 2023-10-08T07:07:52.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000218593 2023-10-08T07:07:52.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310802+0000", 2023-10-08T07:07:52.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4106999999999999e-05 2023-10-08T07:07:52.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.605 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.605 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172034 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.605 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.048654+0000", 2023-10-08T07:07:52.605 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26840662399999998, 2023-10-08T07:07:52.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27199530799999999, 2023-10-08T07:07:52.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.605 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.606 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172034 2023-10-08T07:07:52.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.606 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048654+0000", 2023-10-08T07:07:52.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048654+0000", 2023-10-08T07:07:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048654+0000", 2023-10-08T07:07:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7899999999999999e-07 2023-10-08T07:07:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048665+0000", 2023-10-08T07:07:52.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.076e-05 2023-10-08T07:07:52.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048672+0000", 2023-10-08T07:07:52.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2409999999999998e-06 2023-10-08T07:07:52.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048678+0000", 2023-10-08T07:07:52.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4369999999999998e-06 2023-10-08T07:07:52.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.609 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.609 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172742 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.609 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.249129+0000", 2023-10-08T07:07:52.609 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.067931801, 2023-10-08T07:07:52.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.071581063, 2023-10-08T07:07:52.609 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.609 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.610 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172742 2023-10-08T07:07:52.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.610 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249129+0000", 2023-10-08T07:07:52.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249129+0000", 2023-10-08T07:07:52.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249129+0000", 2023-10-08T07:07:52.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3599999999999999e-07 2023-10-08T07:07:52.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249142+0000", 2023-10-08T07:07:52.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3318e-05 2023-10-08T07:07:52.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249149+0000", 2023-10-08T07:07:52.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.28e-06 2023-10-08T07:07:52.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249153+0000", 2023-10-08T07:07:52.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4719999999999997e-06 2023-10-08T07:07:52.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.612 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.613 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172921 4.16 4:69eefec8:::10000000004.0000003a:head [write 3641344~4096 in=4096b,write 3686400~4096 in=4096b,write 3702784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.613 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.310501+0000", 2023-10-08T07:07:52.613 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0065592080000000004, 2023-10-08T07:07:52.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010273809, 2023-10-08T07:07:52.613 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.613 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:52.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.613 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172921 2023-10-08T07:07:52.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.614 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310501+0000", 2023-10-08T07:07:52.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310501+0000", 2023-10-08T07:07:52.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310502+0000", 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310521+0000", 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9048000000000001e-05 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310528+0000", 2023-10-08T07:07:52.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6639999999999998e-06 2023-10-08T07:07:52.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310534+0000", 2023-10-08T07:07:52.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6740000000000002e-06 2023-10-08T07:07:52.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.312554+0000", 2023-10-08T07:07:52.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020196179999999999 2023-10-08T07:07:52.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.312600+0000", 2023-10-08T07:07:52.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6174999999999998e-05 2023-10-08T07:07:52.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:52.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.312687+0000", 2023-10-08T07:07:52.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6729000000000003e-05 2023-10-08T07:07:52.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:52.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317462+0000", 2023-10-08T07:07:52.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0047753969999999998 2023-10-08T07:07:52.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.618 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.618 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172642 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.618 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.216429+0000", 2023-10-08T07:07:52.618 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.100631454, 2023-10-08T07:07:52.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.10450654199999999, 2023-10-08T07:07:52.619 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.619 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.619 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.619 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172642 2023-10-08T07:07:52.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.619 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216429+0000", 2023-10-08T07:07:52.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216429+0000", 2023-10-08T07:07:52.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216430+0000", 2023-10-08T07:07:52.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7800000000000001e-07 2023-10-08T07:07:52.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216441+0000", 2023-10-08T07:07:52.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2023-10-08T07:07:52.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216450+0000", 2023-10-08T07:07:52.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5809999999999997e-06 2023-10-08T07:07:52.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216455+0000", 2023-10-08T07:07:52.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3619999999999997e-06 2023-10-08T07:07:52.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.622 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.622 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172831 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.622 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.283693+0000", 2023-10-08T07:07:52.622 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.033367154000000003, 2023-10-08T07:07:52.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037321725, 2023-10-08T07:07:52.622 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.623 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.623 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172831 2023-10-08T07:07:52.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.623 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283693+0000", 2023-10-08T07:07:52.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283693+0000", 2023-10-08T07:07:52.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283694+0000", 2023-10-08T07:07:52.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9799999999999999e-07 2023-10-08T07:07:52.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283704+0000", 2023-10-08T07:07:52.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0771000000000001e-05 2023-10-08T07:07:52.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283711+0000", 2023-10-08T07:07:52.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2750000000000001e-06 2023-10-08T07:07:52.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283717+0000", 2023-10-08T07:07:52.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6819999999999997e-06 2023-10-08T07:07:52.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.626 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.626 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172922 4.31 4.eecd8371 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.626 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.310542+0000", 2023-10-08T07:07:52.626 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0065181880000000003, 2023-10-08T07:07:52.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010541210000000001, 2023-10-08T07:07:52.626 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.627 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.627 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.627 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.627 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.627 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172922 2023-10-08T07:07:52.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.627 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310542+0000", 2023-10-08T07:07:52.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310542+0000", 2023-10-08T07:07:52.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310543+0000", 2023-10-08T07:07:52.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6199999999999998e-07 2023-10-08T07:07:52.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310554+0000", 2023-10-08T07:07:52.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1664e-05 2023-10-08T07:07:52.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310561+0000", 2023-10-08T07:07:52.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0609999999999998e-06 2023-10-08T07:07:52.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310567+0000", 2023-10-08T07:07:52.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3850000000000001e-06 2023-10-08T07:07:52.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.630 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.630 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.630 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171981 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.630 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.040462+0000", 2023-10-08T07:07:52.630 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.276598487, 2023-10-08T07:07:52.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.280683195, 2023-10-08T07:07:52.630 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.630 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.631 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.631 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171981 2023-10-08T07:07:52.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.631 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.040462+0000", 2023-10-08T07:07:52.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.040462+0000", 2023-10-08T07:07:52.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.040462+0000", 2023-10-08T07:07:52.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6800000000000001e-07 2023-10-08T07:07:52.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.040479+0000", 2023-10-08T07:07:52.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6741000000000001e-05 2023-10-08T07:07:52.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.040486+0000", 2023-10-08T07:07:52.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6449999999999999e-06 2023-10-08T07:07:52.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.040491+0000", 2023-10-08T07:07:52.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1760000000000001e-06 2023-10-08T07:07:52.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.634 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.634 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172290 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.634 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.118472+0000", 2023-10-08T07:07:52.634 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.19858838600000001, 2023-10-08T07:07:52.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.20275057099999999, 2023-10-08T07:07:52.634 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.634 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.635 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172290 2023-10-08T07:07:52.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.635 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118472+0000", 2023-10-08T07:07:52.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118472+0000", 2023-10-08T07:07:52.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118473+0000", 2023-10-08T07:07:52.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.82e-07 2023-10-08T07:07:52.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118485+0000", 2023-10-08T07:07:52.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2741e-05 2023-10-08T07:07:52.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118491+0000", 2023-10-08T07:07:52.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6210000000000001e-06 2023-10-08T07:07:52.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118495+0000", 2023-10-08T07:07:52.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5360000000000003e-06 2023-10-08T07:07:52.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.638 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.638 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172441 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.638 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.163016+0000", 2023-10-08T07:07:52.638 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.154044179, 2023-10-08T07:07:52.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.15827028800000001, 2023-10-08T07:07:52.638 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.638 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.638 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.638 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.639 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172441 2023-10-08T07:07:52.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.639 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163016+0000", 2023-10-08T07:07:52.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163016+0000", 2023-10-08T07:07:52.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163017+0000", 2023-10-08T07:07:52.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:07:52.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163033+0000", 2023-10-08T07:07:52.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5685e-05 2023-10-08T07:07:52.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163039+0000", 2023-10-08T07:07:52.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4989999999999999e-06 2023-10-08T07:07:52.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163045+0000", 2023-10-08T07:07:52.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.75e-06 2023-10-08T07:07:52.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.641 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.642 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172643 4.19 4.c7f564d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.642 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.216463+0000", 2023-10-08T07:07:52.642 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.100597799, 2023-10-08T07:07:52.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.104867895, 2023-10-08T07:07:52.642 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.642 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.643 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172643 2023-10-08T07:07:52.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.643 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216463+0000", 2023-10-08T07:07:52.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.216463+0000", 2023-10-08T07:07:52.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.218296+0000", 2023-10-08T07:07:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001833227 2023-10-08T07:07:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.218315+0000", 2023-10-08T07:07:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9043999999999999e-05 2023-10-08T07:07:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.218328+0000", 2023-10-08T07:07:52.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2652e-05 2023-10-08T07:07:52.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.218336+0000", 2023-10-08T07:07:52.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1289999999999996e-06 2023-10-08T07:07:52.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.645 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.646 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172798 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.646 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.261379+0000", 2023-10-08T07:07:52.646 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.055681685000000002, 2023-10-08T07:07:52.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060007852, 2023-10-08T07:07:52.646 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.646 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.646 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.646 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172798 2023-10-08T07:07:52.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.647 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.261379+0000", 2023-10-08T07:07:52.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.261379+0000", 2023-10-08T07:07:52.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.263294+0000", 2023-10-08T07:07:52.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001915028 2023-10-08T07:07:52.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.263308+0000", 2023-10-08T07:07:52.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4045e-05 2023-10-08T07:07:52.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.263318+0000", 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7990000000000005e-06 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.263323+0000", 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.254e-06 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172928 4.31 4.eecd8371 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.649 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.310574+0000", 2023-10-08T07:07:52.650 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0064865299999999999, 2023-10-08T07:07:52.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010871337, 2023-10-08T07:07:52.650 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.650 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.650 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.650 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.650 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.650 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172928 2023-10-08T07:07:52.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.650 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310574+0000", 2023-10-08T07:07:52.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310574+0000", 2023-10-08T07:07:52.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310574+0000", 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310587+0000", 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2909e-05 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310597+0000", 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0165e-05 2023-10-08T07:07:52.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310603+0000", 2023-10-08T07:07:52.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.728e-06 2023-10-08T07:07:52.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.653 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.653 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171438 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.653 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.899352+0000", 2023-10-08T07:07:52.653 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.41770882999999998, 2023-10-08T07:07:52.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.42215693199999998, 2023-10-08T07:07:52.654 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.654 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.654 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.654 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.654 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.654 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171438 2023-10-08T07:07:52.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.654 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.899352+0000", 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.899352+0000", 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.899352+0000", 2023-10-08T07:07:52.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:07:52.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.899367+0000", 2023-10-08T07:07:52.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4557e-05 2023-10-08T07:07:52.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.899374+0000", 2023-10-08T07:07:52.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2230000000000001e-06 2023-10-08T07:07:52.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.899379+0000", 2023-10-08T07:07:52.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2650000000000004e-06 2023-10-08T07:07:52.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.657 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.657 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171575 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.657 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.935376+0000", 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38168466000000001, 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.38619310899999998, 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171575 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.935376+0000", 2023-10-08T07:07:52.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.935376+0000", 2023-10-08T07:07:52.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.935376+0000", 2023-10-08T07:07:52.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1200000000000003e-07 2023-10-08T07:07:52.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.935387+0000", 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1113e-05 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.935394+0000", 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4629999999999998e-06 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.935399+0000", 2023-10-08T07:07:52.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8949999999999997e-06 2023-10-08T07:07:52.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.661 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.661 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171823 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.661 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.996414+0000", 2023-10-08T07:07:52.661 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.320646718, 2023-10-08T07:07:52.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32519789100000002, 2023-10-08T07:07:52.661 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.661 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.662 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.662 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.662 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.662 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171823 2023-10-08T07:07:52.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.662 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.996414+0000", 2023-10-08T07:07:52.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.996414+0000", 2023-10-08T07:07:52.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.996414+0000", 2023-10-08T07:07:52.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7999999999999996e-07 2023-10-08T07:07:52.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.996436+0000", 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1464e-05 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.996442+0000", 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7329999999999997e-06 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.996448+0000", 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3850000000000001e-06 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.664 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.665 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172142 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.665 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.075778+0000", 2023-10-08T07:07:52.665 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.24128208200000001, 2023-10-08T07:07:52.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.24586434500000001, 2023-10-08T07:07:52.665 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.665 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.665 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.665 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.665 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.666 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172142 2023-10-08T07:07:52.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.666 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.075778+0000", 2023-10-08T07:07:52.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.075778+0000", 2023-10-08T07:07:52.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.075779+0000", 2023-10-08T07:07:52.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4499999999999998e-07 2023-10-08T07:07:52.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.075795+0000", 2023-10-08T07:07:52.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6144e-05 2023-10-08T07:07:52.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.075801+0000", 2023-10-08T07:07:52.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7189999999999998e-06 2023-10-08T07:07:52.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.075805+0000", 2023-10-08T07:07:52.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3749999999999996e-06 2023-10-08T07:07:52.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.668 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.669 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172184 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.669 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.091377+0000", 2023-10-08T07:07:52.669 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.22568385299999999, 2023-10-08T07:07:52.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23029903299999999, 2023-10-08T07:07:52.669 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.669 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.669 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172184 2023-10-08T07:07:52.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.670 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.091377+0000", 2023-10-08T07:07:52.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.091377+0000", 2023-10-08T07:07:52.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093294+0000", 2023-10-08T07:07:52.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019178419999999999 2023-10-08T07:07:52.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093309+0000", 2023-10-08T07:07:52.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4878999999999999e-05 2023-10-08T07:07:52.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093319+0000", 2023-10-08T07:07:52.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9029999999999999e-06 2023-10-08T07:07:52.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093326+0000", 2023-10-08T07:07:52.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1520000000000003e-06 2023-10-08T07:07:52.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.672 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.673 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172549 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.673 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.190381+0000", 2023-10-08T07:07:52.673 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.126679764, 2023-10-08T07:07:52.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13132544600000001, 2023-10-08T07:07:52.673 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.673 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.673 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172549 2023-10-08T07:07:52.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.673 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190381+0000", 2023-10-08T07:07:52.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190381+0000", 2023-10-08T07:07:52.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190381+0000", 2023-10-08T07:07:52.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2023-10-08T07:07:52.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190393+0000", 2023-10-08T07:07:52.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1769e-05 2023-10-08T07:07:52.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190400+0000", 2023-10-08T07:07:52.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3839999999999999e-06 2023-10-08T07:07:52.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190405+0000", 2023-10-08T07:07:52.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0300000000000001e-06 2023-10-08T07:07:52.676 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.676 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.676 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.677 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172594 4.21 4.5d9f5e61 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.677 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.202987+0000", 2023-10-08T07:07:52.677 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.114072943, 2023-10-08T07:07:52.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.118750259, 2023-10-08T07:07:52.677 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.677 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.677 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172594 2023-10-08T07:07:52.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.678 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.202987+0000", 2023-10-08T07:07:52.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.202987+0000", 2023-10-08T07:07:52.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.202988+0000", 2023-10-08T07:07:52.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2300000000000002e-07 2023-10-08T07:07:52.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.202997+0000", 2023-10-08T07:07:52.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4779999999999997e-06 2023-10-08T07:07:52.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.203001+0000", 2023-10-08T07:07:52.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2023-10-08T07:07:52.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.203005+0000", 2023-10-08T07:07:52.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1360000000000001e-06 2023-10-08T07:07:52.680 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.680 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.680 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.680 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172687 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.681 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.235208+0000", 2023-10-08T07:07:52.681 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.081852071999999998, 2023-10-08T07:07:52.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.086560322999999995, 2023-10-08T07:07:52.681 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.681 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.681 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.681 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.681 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.681 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172687 2023-10-08T07:07:52.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.681 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235208+0000", 2023-10-08T07:07:52.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235208+0000", 2023-10-08T07:07:52.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235209+0000", 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235230+0000", 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0843999999999999e-05 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235236+0000", 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.703e-06 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235241+0000", 2023-10-08T07:07:52.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0000000000000004e-06 2023-10-08T07:07:52.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.684 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.684 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172746 4.9 4.dc9bef09 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.684 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.249226+0000", 2023-10-08T07:07:52.684 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.067834111000000002, 2023-10-08T07:07:52.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.072573891000000001, 2023-10-08T07:07:52.685 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.685 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.685 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.685 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172746 2023-10-08T07:07:52.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.685 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249226+0000", 2023-10-08T07:07:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249226+0000", 2023-10-08T07:07:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249227+0000", 2023-10-08T07:07:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4499999999999997e-07 2023-10-08T07:07:52.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249239+0000", 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2403e-05 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249245+0000", 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249251+0000", 2023-10-08T07:07:52.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7209999999999999e-06 2023-10-08T07:07:52.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.688 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.688 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172799 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.688 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.263334+0000", 2023-10-08T07:07:52.688 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.053726906999999997, 2023-10-08T07:07:52.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058497387999999997, 2023-10-08T07:07:52.688 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.688 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.689 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.689 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.689 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.689 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172799 2023-10-08T07:07:52.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.689 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.263334+0000", 2023-10-08T07:07:52.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.263334+0000", 2023-10-08T07:07:52.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.263334+0000", 2023-10-08T07:07:52.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8500000000000002e-07 2023-10-08T07:07:52.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.263349+0000", 2023-10-08T07:07:52.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5328999999999998e-05 2023-10-08T07:07:52.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.263357+0000", 2023-10-08T07:07:52.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6869999999999994e-06 2023-10-08T07:07:52.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.263362+0000", 2023-10-08T07:07:52.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0429999999999998e-06 2023-10-08T07:07:52.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172880 4.7 4:e2479c46:::10000000004.00000024:head [write 3977216~4096 in=4096b,write 3993600~4096 in=4096b,write 4063232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.293258+0000", 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.023802211, 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028607658000000001, 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.693 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172880 2023-10-08T07:07:52.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.693 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.293258+0000", 2023-10-08T07:07:52.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.293258+0000", 2023-10-08T07:07:52.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.296294+0000", 2023-10-08T07:07:52.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030361189999999999 2023-10-08T07:07:52.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.296312+0000", 2023-10-08T07:07:52.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7762999999999999e-05 2023-10-08T07:07:52.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.296324+0000", 2023-10-08T07:07:52.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1677e-05 2023-10-08T07:07:52.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.296331+0000", 2023-10-08T07:07:52.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4209999999999998e-06 2023-10-08T07:07:52.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.319723+0000", 2023-10-08T07:07:52.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023391820000000001 2023-10-08T07:07:52.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.319797+0000", 2023-10-08T07:07:52.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4282999999999993e-05 2023-10-08T07:07:52.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.696 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.696 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172930 4.f 4.e29eca4f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.697 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.310610+0000", 2023-10-08T07:07:52.697 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0064501419999999999, 2023-10-08T07:07:52.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011292399, 2023-10-08T07:07:52.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.697 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172930 2023-10-08T07:07:52.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.697 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310610+0000", 2023-10-08T07:07:52.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310610+0000", 2023-10-08T07:07:52.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310611+0000", 2023-10-08T07:07:52.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.51e-07 2023-10-08T07:07:52.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310624+0000", 2023-10-08T07:07:52.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2816999999999999e-05 2023-10-08T07:07:52.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310631+0000", 2023-10-08T07:07:52.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8669999999999994e-06 2023-10-08T07:07:52.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310637+0000", 2023-10-08T07:07:52.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4040000000000003e-06 2023-10-08T07:07:52.700 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.700 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.700 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.700 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172044 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.700 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.050404+0000", 2023-10-08T07:07:52.701 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26665613999999999, 2023-10-08T07:07:52.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27153021500000002, 2023-10-08T07:07:52.701 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.701 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.701 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172044 2023-10-08T07:07:52.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.701 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.050404+0000", 2023-10-08T07:07:52.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.050404+0000", 2023-10-08T07:07:52.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.050405+0000", 2023-10-08T07:07:52.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6800000000000001e-07 2023-10-08T07:07:52.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.050418+0000", 2023-10-08T07:07:52.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3037000000000001e-05 2023-10-08T07:07:52.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.050423+0000", 2023-10-08T07:07:52.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6999999999999996e-06 2023-10-08T07:07:52.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.050428+0000", 2023-10-08T07:07:52.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5029999999999999e-06 2023-10-08T07:07:52.704 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.704 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.704 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.704 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172186 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.704 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.093338+0000", 2023-10-08T07:07:52.704 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.22372202099999999, 2023-10-08T07:07:52.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.228626523, 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172186 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093338+0000", 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093338+0000", 2023-10-08T07:07:52.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093339+0000", 2023-10-08T07:07:52.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5400000000000001e-07 2023-10-08T07:07:52.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093352+0000", 2023-10-08T07:07:52.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2716e-05 2023-10-08T07:07:52.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093359+0000", 2023-10-08T07:07:52.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.323e-06 2023-10-08T07:07:52.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093365+0000", 2023-10-08T07:07:52.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7649999999999999e-06 2023-10-08T07:07:52.708 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.708 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.708 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.708 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172293 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.708 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.118530+0000", 2023-10-08T07:07:52.708 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.19853056299999999, 2023-10-08T07:07:52.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.203465497, 2023-10-08T07:07:52.708 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.708 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.709 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.709 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.709 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172293 2023-10-08T07:07:52.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.709 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118530+0000", 2023-10-08T07:07:52.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118530+0000", 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118530+0000", 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3399999999999999e-07 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118542+0000", 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1491999999999999e-05 2023-10-08T07:07:52.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118548+0000", 2023-10-08T07:07:52.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8819999999999998e-06 2023-10-08T07:07:52.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118552+0000", 2023-10-08T07:07:52.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.476e-06 2023-10-08T07:07:52.711 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.711 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.711 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.712 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172343 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.712 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.140650+0000", 2023-10-08T07:07:52.712 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.17641035499999999, 2023-10-08T07:07:52.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18137484300000001, 2023-10-08T07:07:52.712 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.712 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.712 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.712 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.712 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.712 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172343 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.140650+0000", 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.140650+0000", 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.140651+0000", 2023-10-08T07:07:52.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5300000000000003e-07 2023-10-08T07:07:52.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.140674+0000", 2023-10-08T07:07:52.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3306999999999999e-05 2023-10-08T07:07:52.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.142558+0000", 2023-10-08T07:07:52.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018836409999999999 2023-10-08T07:07:52.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.142569+0000", 2023-10-08T07:07:52.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1231e-05 2023-10-08T07:07:52.715 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.715 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.715 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.715 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172443 4.19 4.8d5b859 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.716 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.163093+0000", 2023-10-08T07:07:52.716 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.153967612, 2023-10-08T07:07:52.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.15899987400000001, 2023-10-08T07:07:52.716 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.716 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.716 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172443 2023-10-08T07:07:52.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.716 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163093+0000", 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163093+0000", 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163093+0000", 2023-10-08T07:07:52.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8100000000000003e-07 2023-10-08T07:07:52.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163109+0000", 2023-10-08T07:07:52.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5900999999999999e-05 2023-10-08T07:07:52.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163116+0000", 2023-10-08T07:07:52.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163122+0000", 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5929999999999996e-06 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172834 4.19 4.c7f564d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.283972+0000", 2023-10-08T07:07:52.719 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.033088539, 2023-10-08T07:07:52.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038171455, 2023-10-08T07:07:52.720 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.720 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.720 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.720 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.720 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.720 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172834 2023-10-08T07:07:52.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.720 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283972+0000", 2023-10-08T07:07:52.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283972+0000", 2023-10-08T07:07:52.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283973+0000", 2023-10-08T07:07:52.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2900000000000003e-07 2023-10-08T07:07:52.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.283995+0000", 2023-10-08T07:07:52.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.251e-05 2023-10-08T07:07:52.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.284004+0000", 2023-10-08T07:07:52.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.551e-06 2023-10-08T07:07:52.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.284010+0000", 2023-10-08T07:07:52.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3339999999999998e-06 2023-10-08T07:07:52.723 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.723 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.723 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.723 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4556.0:171335 4.0 e66/17)", 2023-10-08T07:07:52.723 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.313257+0000", 2023-10-08T07:07:52.723 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038030799999999999, 2023-10-08T07:07:52.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0089437990000000005, 2023-10-08T07:07:52.723 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.724 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.724 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313257+0000", 2023-10-08T07:07:52.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313257+0000", 2023-10-08T07:07:52.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313258+0000", 2023-10-08T07:07:52.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8700000000000004e-07 2023-10-08T07:07:52.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313263+0000", 2023-10-08T07:07:52.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6750000000000001e-06 2023-10-08T07:07:52.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313274+0000", 2023-10-08T07:07:52.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1045e-05 2023-10-08T07:07:52.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313281+0000", 2023-10-08T07:07:52.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3520000000000001e-06 2023-10-08T07:07:52.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.726 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.727 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171223 4.28 4:15b6682b:::10000000004.0000000b:head [write 2576384~4096 in=4096b,write 2859008~4096 in=4096b,write 3301376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.727 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.844347+0000", 2023-10-08T07:07:52.727 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47271380400000002, 2023-10-08T07:07:52.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47792352300000002, 2023-10-08T07:07:52.727 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.727 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.727 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.727 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.727 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.727 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171223 2023-10-08T07:07:52.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.728 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.844347+0000", 2023-10-08T07:07:52.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.844347+0000", 2023-10-08T07:07:52.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846295+0000", 2023-10-08T07:07:52.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001948721 2023-10-08T07:07:52.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846311+0000", 2023-10-08T07:07:52.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5336e-05 2023-10-08T07:07:52.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846320+0000", 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.003e-06 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846327+0000", 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2069999999999998e-06 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.281203+0000", 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43487598399999999 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.281280+0000", 2023-10-08T07:07:52.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7180000000000003e-05 2023-10-08T07:07:52.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.731 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.731 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172554 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.731 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.190447+0000", 2023-10-08T07:07:52.731 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.126613589, 2023-10-08T07:07:52.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13191913699999999, 2023-10-08T07:07:52.733 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.733 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.733 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.733 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.733 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.733 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172554 2023-10-08T07:07:52.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.733 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190447+0000", 2023-10-08T07:07:52.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190447+0000", 2023-10-08T07:07:52.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190447+0000", 2023-10-08T07:07:52.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2300000000000002e-07 2023-10-08T07:07:52.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190460+0000", 2023-10-08T07:07:52.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2398999999999999e-05 2023-10-08T07:07:52.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190473+0000", 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3395e-05 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190478+0000", 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0710000000000002e-06 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172651 4.31 4.eecd8371 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.736 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.218444+0000", 2023-10-08T07:07:52.737 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.098616077999999996, 2023-10-08T07:07:52.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.103992296, 2023-10-08T07:07:52.737 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.737 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.737 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.737 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.737 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.737 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172651 2023-10-08T07:07:52.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.737 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.218444+0000", 2023-10-08T07:07:52.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.218444+0000", 2023-10-08T07:07:52.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220295+0000", 2023-10-08T07:07:52.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001850469 2023-10-08T07:07:52.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220314+0000", 2023-10-08T07:07:52.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9604999999999999e-05 2023-10-08T07:07:52.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220325+0000", 2023-10-08T07:07:52.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0131e-05 2023-10-08T07:07:52.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220333+0000", 2023-10-08T07:07:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0229999999999992e-06 2023-10-08T07:07:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172693 4.31 4.eecd8371 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.235278+0000", 2023-10-08T07:07:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.081782072999999997, 2023-10-08T07:07:52.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.087225708999999998, 2023-10-08T07:07:52.741 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.741 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.741 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.741 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.741 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.741 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172693 2023-10-08T07:07:52.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.741 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235278+0000", 2023-10-08T07:07:52.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235278+0000", 2023-10-08T07:07:52.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235279+0000", 2023-10-08T07:07:52.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6399999999999998e-07 2023-10-08T07:07:52.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235298+0000", 2023-10-08T07:07:52.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9692000000000001e-05 2023-10-08T07:07:52.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235305+0000", 2023-10-08T07:07:52.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1750000000000002e-06 2023-10-08T07:07:52.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235309+0000", 2023-10-08T07:07:52.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7759999999999997e-06 2023-10-08T07:07:52.744 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.744 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.744 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.744 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172752 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.744 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.249306+0000", 2023-10-08T07:07:52.744 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.067754797000000005, 2023-10-08T07:07:52.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.073268973000000001, 2023-10-08T07:07:52.744 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.745 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.745 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.745 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.745 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.745 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172752 2023-10-08T07:07:52.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.745 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249306+0000", 2023-10-08T07:07:52.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249306+0000", 2023-10-08T07:07:52.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249306+0000", 2023-10-08T07:07:52.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2023-10-08T07:07:52.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249318+0000", 2023-10-08T07:07:52.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2351000000000001e-05 2023-10-08T07:07:52.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249325+0000", 2023-10-08T07:07:52.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8029999999999999e-06 2023-10-08T07:07:52.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249330+0000", 2023-10-08T07:07:52.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0649999999999998e-06 2023-10-08T07:07:52.748 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.748 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.748 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.748 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172931 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.748 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.310645+0000", 2023-10-08T07:07:52.748 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0064153309999999998, 2023-10-08T07:07:52.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01198369, 2023-10-08T07:07:52.748 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.748 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.748 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172931 2023-10-08T07:07:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310645+0000", 2023-10-08T07:07:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310645+0000", 2023-10-08T07:07:52.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310646+0000", 2023-10-08T07:07:52.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000005e-07 2023-10-08T07:07:52.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.310660+0000", 2023-10-08T07:07:52.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4877e-05 2023-10-08T07:07:52.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313301+0000", 2023-10-08T07:07:52.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026403049999999999 2023-10-08T07:07:52.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313310+0000", 2023-10-08T07:07:52.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3989999999999993e-06 2023-10-08T07:07:52.752 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.752 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.752 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.752 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171832 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.752 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.996529+0000", 2023-10-08T07:07:52.752 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.32053103700000002, 2023-10-08T07:07:52.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32615356899999998, 2023-10-08T07:07:52.752 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.752 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.752 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.753 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171832 2023-10-08T07:07:52.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.753 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.996529+0000", 2023-10-08T07:07:52.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.996529+0000", 2023-10-08T07:07:52.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.996570+0000", 2023-10-08T07:07:52.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0571999999999997e-05 2023-10-08T07:07:52.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.996590+0000", 2023-10-08T07:07:52.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0210000000000001e-05 2023-10-08T07:07:52.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.996597+0000", 2023-10-08T07:07:52.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1500000000000002e-06 2023-10-08T07:07:52.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.996604+0000", 2023-10-08T07:07:52.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.601e-06 2023-10-08T07:07:52.755 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.756 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.756 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172505 4.19 4.c7f564d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.756 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.171434+0000", 2023-10-08T07:07:52.756 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14562676899999999, 2023-10-08T07:07:52.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.15130380099999999, 2023-10-08T07:07:52.756 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.756 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172505 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.171434+0000", 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.171434+0000", 2023-10-08T07:07:52.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.174006+0000", 2023-10-08T07:07:52.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025724540000000001 2023-10-08T07:07:52.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.174018+0000", 2023-10-08T07:07:52.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2225999999999999e-05 2023-10-08T07:07:52.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.174026+0000", 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.396e-06 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.174031+0000", 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1189999999999996e-06 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.760 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172597 4.9 4.dc9bef09 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.760 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.203065+0000", 2023-10-08T07:07:52.760 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.113995561, 2023-10-08T07:07:52.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.119726823, 2023-10-08T07:07:52.760 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.760 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.760 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.760 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172597 2023-10-08T07:07:52.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.761 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.203065+0000", 2023-10-08T07:07:52.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.203065+0000", 2023-10-08T07:07:52.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.203065+0000", 2023-10-08T07:07:52.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4299999999999999e-07 2023-10-08T07:07:52.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.203074+0000", 2023-10-08T07:07:52.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9900000000000003e-06 2023-10-08T07:07:52.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.203086+0000", 2023-10-08T07:07:52.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1637000000000001e-05 2023-10-08T07:07:52.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.203091+0000", 2023-10-08T07:07:52.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.091e-06 2023-10-08T07:07:52.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.763 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.763 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172698 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.764 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.235317+0000", 2023-10-08T07:07:52.764 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.081743556999999994, 2023-10-08T07:07:52.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.087542597, 2023-10-08T07:07:52.764 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.764 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.764 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172698 2023-10-08T07:07:52.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.764 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235317+0000", 2023-10-08T07:07:52.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235317+0000", 2023-10-08T07:07:52.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235317+0000", 2023-10-08T07:07:52.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7399999999999999e-07 2023-10-08T07:07:52.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.235340+0000", 2023-10-08T07:07:52.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3187e-05 2023-10-08T07:07:52.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237751+0000", 2023-10-08T07:07:52.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024110249999999998 2023-10-08T07:07:52.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237762+0000", 2023-10-08T07:07:52.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0271e-05 2023-10-08T07:07:52.767 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.767 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.767 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.767 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172754 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.767 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.249337+0000", 2023-10-08T07:07:52.767 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.067723242000000003, 2023-10-08T07:07:52.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.073581243000000005, 2023-10-08T07:07:52.768 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.768 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.768 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172754 2023-10-08T07:07:52.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.768 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249337+0000", 2023-10-08T07:07:52.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249337+0000", 2023-10-08T07:07:52.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249338+0000", 2023-10-08T07:07:52.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4000000000000002e-07 2023-10-08T07:07:52.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249351+0000", 2023-10-08T07:07:52.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3057000000000001e-05 2023-10-08T07:07:52.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249358+0000", 2023-10-08T07:07:52.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2300000000000002e-06 2023-10-08T07:07:52.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249363+0000", 2023-10-08T07:07:52.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1510000000000003e-06 2023-10-08T07:07:52.771 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.771 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.771 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172933 4.37 4.ff82bbf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.313327+0000", 2023-10-08T07:07:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0037331949999999999, 2023-10-08T07:07:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0096527120000000008, 2023-10-08T07:07:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172933 2023-10-08T07:07:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.772 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313327+0000", 2023-10-08T07:07:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313327+0000", 2023-10-08T07:07:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313328+0000", 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0100000000000003e-07 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313349+0000", 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0441e-05 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313358+0000", 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0399999999999998e-06 2023-10-08T07:07:52.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313363+0000", 2023-10-08T07:07:52.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1309999999999997e-06 2023-10-08T07:07:52.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.775 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.775 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171226 4.28 4:16edf4d3:::10000000004.00000027:head [write 356352~4096 in=4096b,write 417792~4096 in=4096b,write 442368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.775 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.846379+0000", 2023-10-08T07:07:52.775 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47068119200000003, 2023-10-08T07:07:52.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47666093399999998, 2023-10-08T07:07:52.776 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.776 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.776 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171226 2023-10-08T07:07:52.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.776 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846379+0000", 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846379+0000", 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846380+0000", 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0500000000000003e-07 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846392+0000", 2023-10-08T07:07:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1863e-05 2023-10-08T07:07:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846398+0000", 2023-10-08T07:07:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4829999999999996e-06 2023-10-08T07:07:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846403+0000", 2023-10-08T07:07:52.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2129999999999999e-06 2023-10-08T07:07:52.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.284527+0000", 2023-10-08T07:07:52.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43812361 2023-10-08T07:07:52.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.284600+0000", 2023-10-08T07:07:52.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3175000000000003e-05 2023-10-08T07:07:52.779 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.780 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.780 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.780 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171772 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.780 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.990141+0000", 2023-10-08T07:07:52.780 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.32691942699999998, 2023-10-08T07:07:52.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.33296493799999999, 2023-10-08T07:07:52.780 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.780 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.780 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.780 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171772 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990141+0000", 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990141+0000", 2023-10-08T07:07:52.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990142+0000", 2023-10-08T07:07:52.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7199999999999998e-07 2023-10-08T07:07:52.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990163+0000", 2023-10-08T07:07:52.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1157000000000001e-05 2023-10-08T07:07:52.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990174+0000", 2023-10-08T07:07:52.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0589e-05 2023-10-08T07:07:52.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990181+0000", 2023-10-08T07:07:52.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7190000000000001e-06 2023-10-08T07:07:52.783 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.783 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.784 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.784 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171891 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.784 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.015392+0000", 2023-10-08T07:07:52.784 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.30166838400000001, 2023-10-08T07:07:52.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.30776531299999998, 2023-10-08T07:07:52.784 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.784 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.784 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.784 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.785 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.785 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171891 2023-10-08T07:07:52.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.785 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.015392+0000", 2023-10-08T07:07:52.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.015392+0000", 2023-10-08T07:07:52.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.015393+0000", 2023-10-08T07:07:52.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6499999999999998e-07 2023-10-08T07:07:52.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.015408+0000", 2023-10-08T07:07:52.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5285e-05 2023-10-08T07:07:52.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.015415+0000", 2023-10-08T07:07:52.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7270000000000001e-06 2023-10-08T07:07:52.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.015420+0000", 2023-10-08T07:07:52.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5300000000000004e-06 2023-10-08T07:07:52.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.787 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.788 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171983 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.788 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.042339+0000", 2023-10-08T07:07:52.788 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.274721722, 2023-10-08T07:07:52.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.28087184799999998, 2023-10-08T07:07:52.788 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.788 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.788 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.788 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171983 2023-10-08T07:07:52.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.789 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.042339+0000", 2023-10-08T07:07:52.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.042339+0000", 2023-10-08T07:07:52.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.044293+0000", 2023-10-08T07:07:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001953995 2023-10-08T07:07:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.044309+0000", 2023-10-08T07:07:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6467999999999999e-05 2023-10-08T07:07:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.044319+0000", 2023-10-08T07:07:52.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9580000000000002e-06 2023-10-08T07:07:52.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.044327+0000", 2023-10-08T07:07:52.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8140000000000001e-06 2023-10-08T07:07:52.791 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.791 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.791 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172193 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.093437+0000", 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.22362330999999999, 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.22982486499999999, 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172193 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093437+0000", 2023-10-08T07:07:52.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093437+0000", 2023-10-08T07:07:52.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093438+0000", 2023-10-08T07:07:52.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8100000000000003e-07 2023-10-08T07:07:52.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093452+0000", 2023-10-08T07:07:52.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4687e-05 2023-10-08T07:07:52.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093459+0000", 2023-10-08T07:07:52.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4620000000000001e-06 2023-10-08T07:07:52.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093464+0000", 2023-10-08T07:07:52.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1989999999999997e-06 2023-10-08T07:07:52.795 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.795 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.795 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.795 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172389 4.31 4:8ec1b377:::10000000004.00000019:head [write 3723264~4096 in=4096b,write 3899392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.795 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.153369+0000", 2023-10-08T07:07:52.796 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.163691749, 2023-10-08T07:07:52.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.169955841, 2023-10-08T07:07:52.796 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.796 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:52.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.796 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172389 2023-10-08T07:07:52.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.796 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153369+0000", 2023-10-08T07:07:52.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153369+0000", 2023-10-08T07:07:52.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153369+0000", 2023-10-08T07:07:52.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8299999999999997e-07 2023-10-08T07:07:52.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153378+0000", 2023-10-08T07:07:52.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.636e-06 2023-10-08T07:07:52.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153384+0000", 2023-10-08T07:07:52.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3080000000000004e-06 2023-10-08T07:07:52.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153388+0000", 2023-10-08T07:07:52.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4640000000000002e-06 2023-10-08T07:07:52.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.322739+0000", 2023-10-08T07:07:52.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.169351854 2023-10-08T07:07:52.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.322819+0000", 2023-10-08T07:07:52.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9546e-05 2023-10-08T07:07:52.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:52.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.322967+0000", 2023-10-08T07:07:52.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014767900000000001 2023-10-08T07:07:52.800 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.800 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.800 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.801 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172656 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.801 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.220388+0000", 2023-10-08T07:07:52.801 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.096672684999999994, 2023-10-08T07:07:52.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.10300751599999999, 2023-10-08T07:07:52.801 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.801 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.801 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172656 2023-10-08T07:07:52.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.802 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220388+0000", 2023-10-08T07:07:52.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220388+0000", 2023-10-08T07:07:52.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220388+0000", 2023-10-08T07:07:52.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2399999999999998e-07 2023-10-08T07:07:52.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220401+0000", 2023-10-08T07:07:52.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2883e-05 2023-10-08T07:07:52.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220408+0000", 2023-10-08T07:07:52.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8199999999999999e-06 2023-10-08T07:07:52.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220414+0000", 2023-10-08T07:07:52.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7069999999999997e-06 2023-10-08T07:07:52.804 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.804 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.804 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.804 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172755 4.9 4.dc9bef09 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.805 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.249370+0000", 2023-10-08T07:07:52.805 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.067690581, 2023-10-08T07:07:52.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.074087586999999996, 2023-10-08T07:07:52.805 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.805 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.805 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.805 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172755 2023-10-08T07:07:52.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.805 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249370+0000", 2023-10-08T07:07:52.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249370+0000", 2023-10-08T07:07:52.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249370+0000", 2023-10-08T07:07:52.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8000000000000002e-07 2023-10-08T07:07:52.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249382+0000", 2023-10-08T07:07:52.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2157999999999999e-05 2023-10-08T07:07:52.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249387+0000", 2023-10-08T07:07:52.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3089999999999997e-06 2023-10-08T07:07:52.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249391+0000", 2023-10-08T07:07:52.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6410000000000001e-06 2023-10-08T07:07:52.808 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.808 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.808 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.808 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172803 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.808 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.266260+0000", 2023-10-08T07:07:52.809 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.050800904000000001, 2023-10-08T07:07:52.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057257216, 2023-10-08T07:07:52.809 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.809 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.809 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.809 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.809 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.809 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172803 2023-10-08T07:07:52.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.809 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266260+0000", 2023-10-08T07:07:52.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266260+0000", 2023-10-08T07:07:52.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266260+0000", 2023-10-08T07:07:52.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0400000000000005e-07 2023-10-08T07:07:52.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266279+0000", 2023-10-08T07:07:52.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8539999999999999e-05 2023-10-08T07:07:52.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266296+0000", 2023-10-08T07:07:52.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6728e-05 2023-10-08T07:07:52.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266304+0000", 2023-10-08T07:07:52.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6309999999999992e-06 2023-10-08T07:07:52.812 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.812 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.813 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172884 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.813 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.298389+0000", 2023-10-08T07:07:52.813 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018671485000000002, 2023-10-08T07:07:52.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025181632999999998, 2023-10-08T07:07:52.813 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.813 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.813 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.814 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172884 2023-10-08T07:07:52.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.814 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.298389+0000", 2023-10-08T07:07:52.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.298389+0000", 2023-10-08T07:07:52.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.298389+0000", 2023-10-08T07:07:52.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7e-07 2023-10-08T07:07:52.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.298402+0000", 2023-10-08T07:07:52.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2775999999999999e-05 2023-10-08T07:07:52.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.298409+0000", 2023-10-08T07:07:52.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3790000000000003e-06 2023-10-08T07:07:52.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.298414+0000", 2023-10-08T07:07:52.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.429e-06 2023-10-08T07:07:52.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.816 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.817 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172934 4.3b 4:df82de1b:::10000000004.0000000f:head [write 1798144~4096 in=4096b,write 2023424~4096 in=4096b,write 2064384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.817 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.313371+0000", 2023-10-08T07:07:52.817 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0036899400000000001, 2023-10-08T07:07:52.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010262949, 2023-10-08T07:07:52.817 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.817 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.817 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.818 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172934 2023-10-08T07:07:52.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.818 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313371+0000", 2023-10-08T07:07:52.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313371+0000", 2023-10-08T07:07:52.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313371+0000", 2023-10-08T07:07:52.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6499999999999999e-07 2023-10-08T07:07:52.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313384+0000", 2023-10-08T07:07:52.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2772000000000001e-05 2023-10-08T07:07:52.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313390+0000", 2023-10-08T07:07:52.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2020000000000001e-06 2023-10-08T07:07:52.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313395+0000", 2023-10-08T07:07:52.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5820000000000003e-06 2023-10-08T07:07:52.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313445+0000", 2023-10-08T07:07:52.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0416e-05 2023-10-08T07:07:52.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313518+0000", 2023-10-08T07:07:52.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3281000000000005e-05 2023-10-08T07:07:52.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.821 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.822 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171293 4.28 4:15b6682b:::10000000004.0000000b:head [write 2179072~4096 in=4096b,write 2187264~4096 in=4096b,write 2199552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.822 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.859354+0000", 2023-10-08T07:07:52.822 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.457706365, 2023-10-08T07:07:52.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46434990100000001, 2023-10-08T07:07:52.822 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.822 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.822 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.822 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171293 2023-10-08T07:07:52.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.822 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.859354+0000", 2023-10-08T07:07:52.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.859354+0000", 2023-10-08T07:07:52.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.859355+0000", 2023-10-08T07:07:52.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2e-07 2023-10-08T07:07:52.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.859368+0000", 2023-10-08T07:07:52.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3111e-05 2023-10-08T07:07:52.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.859375+0000", 2023-10-08T07:07:52.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2840000000000001e-06 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.859382+0000", 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5400000000000001e-06 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.295347+0000", 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43596576199999998 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.295432+0000", 2023-10-08T07:07:52.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4438999999999996e-05 2023-10-08T07:07:52.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.826 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.826 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171396 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.826 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.891813+0000", 2023-10-08T07:07:52.826 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.425247339, 2023-10-08T07:07:52.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43195465, 2023-10-08T07:07:52.826 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.827 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.827 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.827 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.827 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.827 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171396 2023-10-08T07:07:52.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.827 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.891813+0000", 2023-10-08T07:07:52.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.891813+0000", 2023-10-08T07:07:52.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.891814+0000", 2023-10-08T07:07:52.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8599999999999998e-07 2023-10-08T07:07:52.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.891824+0000", 2023-10-08T07:07:52.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0729e-05 2023-10-08T07:07:52.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.891831+0000", 2023-10-08T07:07:52.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2210000000000002e-06 2023-10-08T07:07:52.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.891836+0000", 2023-10-08T07:07:52.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1449999999999999e-06 2023-10-08T07:07:52.830 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.830 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.830 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.830 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171938 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.830 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.022860+0000", 2023-10-08T07:07:52.830 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.29420034699999997, 2023-10-08T07:07:52.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.30096783199999999, 2023-10-08T07:07:52.830 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.830 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.830 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.831 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.831 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.831 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171938 2023-10-08T07:07:52.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.831 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.022860+0000", 2023-10-08T07:07:52.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.022860+0000", 2023-10-08T07:07:52.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.026293+0000", 2023-10-08T07:07:52.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034325219999999999 2023-10-08T07:07:52.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.026305+0000", 2023-10-08T07:07:52.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2152e-05 2023-10-08T07:07:52.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.026314+0000", 2023-10-08T07:07:52.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.85e-06 2023-10-08T07:07:52.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.026319+0000", 2023-10-08T07:07:52.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3120000000000001e-06 2023-10-08T07:07:52.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.834 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.834 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172304 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.834 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.118738+0000", 2023-10-08T07:07:52.834 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.198322788, 2023-10-08T07:07:52.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.20514928800000001, 2023-10-08T07:07:52.834 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.834 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.835 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172304 2023-10-08T07:07:52.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.835 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118738+0000", 2023-10-08T07:07:52.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118738+0000", 2023-10-08T07:07:52.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118738+0000", 2023-10-08T07:07:52.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.82e-07 2023-10-08T07:07:52.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118751+0000", 2023-10-08T07:07:52.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2428e-05 2023-10-08T07:07:52.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118758+0000", 2023-10-08T07:07:52.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.029e-06 2023-10-08T07:07:52.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.118763+0000", 2023-10-08T07:07:52.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5690000000000004e-06 2023-10-08T07:07:52.839 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.839 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.839 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.839 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172390 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.839 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.153393+0000", 2023-10-08T07:07:52.839 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.163667069, 2023-10-08T07:07:52.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17055804199999999, 2023-10-08T07:07:52.839 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.840 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.840 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.840 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.840 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.840 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172390 2023-10-08T07:07:52.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.840 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153393+0000", 2023-10-08T07:07:52.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153393+0000", 2023-10-08T07:07:52.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153394+0000", 2023-10-08T07:07:52.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6600000000000003e-07 2023-10-08T07:07:52.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153407+0000", 2023-10-08T07:07:52.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3546e-05 2023-10-08T07:07:52.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153413+0000", 2023-10-08T07:07:52.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5559999999999998e-06 2023-10-08T07:07:52.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153416+0000", 2023-10-08T07:07:52.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0199999999999999e-06 2023-10-08T07:07:52.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.843 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.844 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.844 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172451 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.844 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.163232+0000", 2023-10-08T07:07:52.844 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.153828822, 2023-10-08T07:07:52.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.16078082399999999, 2023-10-08T07:07:52.844 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.844 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.845 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172451 2023-10-08T07:07:52.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.845 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163232+0000", 2023-10-08T07:07:52.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163232+0000", 2023-10-08T07:07:52.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163232+0000", 2023-10-08T07:07:52.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.03e-07 2023-10-08T07:07:52.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163250+0000", 2023-10-08T07:07:52.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7691000000000001e-05 2023-10-08T07:07:52.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163257+0000", 2023-10-08T07:07:52.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3969999999999997e-06 2023-10-08T07:07:52.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163262+0000", 2023-10-08T07:07:52.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3229999999999997e-06 2023-10-08T07:07:52.848 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.848 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.848 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.849 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172704 4.31 4.eecd8371 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.849 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.237844+0000", 2023-10-08T07:07:52.849 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.079216440999999999, 2023-10-08T07:07:52.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.086235884999999998, 2023-10-08T07:07:52.849 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.849 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.849 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172704 2023-10-08T07:07:52.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.850 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237844+0000", 2023-10-08T07:07:52.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237844+0000", 2023-10-08T07:07:52.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237845+0000", 2023-10-08T07:07:52.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3399999999999999e-07 2023-10-08T07:07:52.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237857+0000", 2023-10-08T07:07:52.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2588999999999999e-05 2023-10-08T07:07:52.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237864+0000", 2023-10-08T07:07:52.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1559999999999998e-06 2023-10-08T07:07:52.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237870+0000", 2023-10-08T07:07:52.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5280000000000003e-06 2023-10-08T07:07:52.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.853 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.853 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172756 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.853 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.249398+0000", 2023-10-08T07:07:52.853 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.067662445000000002, 2023-10-08T07:07:52.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.074751050999999999, 2023-10-08T07:07:52.854 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.854 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.854 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172756 2023-10-08T07:07:52.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.854 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249398+0000", 2023-10-08T07:07:52.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249398+0000", 2023-10-08T07:07:52.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249398+0000", 2023-10-08T07:07:52.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4000000000000002e-07 2023-10-08T07:07:52.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249414+0000", 2023-10-08T07:07:52.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.524e-05 2023-10-08T07:07:52.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249421+0000", 2023-10-08T07:07:52.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2760000000000003e-06 2023-10-08T07:07:52.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249427+0000", 2023-10-08T07:07:52.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2023-10-08T07:07:52.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.857 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.858 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.858 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172804 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.858 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.266320+0000", 2023-10-08T07:07:52.858 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.050740720000000003, 2023-10-08T07:07:52.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057893073000000003, 2023-10-08T07:07:52.858 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.858 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.859 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.859 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.859 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172804 2023-10-08T07:07:52.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.859 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266320+0000", 2023-10-08T07:07:52.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266320+0000", 2023-10-08T07:07:52.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266320+0000", 2023-10-08T07:07:52.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1900000000000002e-07 2023-10-08T07:07:52.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266339+0000", 2023-10-08T07:07:52.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8768999999999999e-05 2023-10-08T07:07:52.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266348+0000", 2023-10-08T07:07:52.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0100000000000001e-06 2023-10-08T07:07:52.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266355+0000", 2023-10-08T07:07:52.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9800000000000001e-06 2023-10-08T07:07:52.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.862 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.863 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172838 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.863 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.287343+0000", 2023-10-08T07:07:52.863 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.029717542, 2023-10-08T07:07:52.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.036930349000000001, 2023-10-08T07:07:52.863 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.863 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.863 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.863 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.863 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.863 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172838 2023-10-08T07:07:52.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.864 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.287343+0000", 2023-10-08T07:07:52.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.287343+0000", 2023-10-08T07:07:52.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.287343+0000", 2023-10-08T07:07:52.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-07 2023-10-08T07:07:52.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.287357+0000", 2023-10-08T07:07:52.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3396e-05 2023-10-08T07:07:52.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.287364+0000", 2023-10-08T07:07:52.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0949999999999998e-06 2023-10-08T07:07:52.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.287370+0000", 2023-10-08T07:07:52.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.964e-06 2023-10-08T07:07:52.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.867 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.867 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172888 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.867 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.298423+0000", 2023-10-08T07:07:52.867 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.018637473000000002, 2023-10-08T07:07:52.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025912602, 2023-10-08T07:07:52.867 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.868 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.868 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.868 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172888 2023-10-08T07:07:52.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.868 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.298423+0000", 2023-10-08T07:07:52.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.298423+0000", 2023-10-08T07:07:52.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300320+0000", 2023-10-08T07:07:52.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001897464 2023-10-08T07:07:52.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300344+0000", 2023-10-08T07:07:52.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3453999999999999e-05 2023-10-08T07:07:52.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300356+0000", 2023-10-08T07:07:52.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1864e-05 2023-10-08T07:07:52.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300363+0000", 2023-10-08T07:07:52.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4869999999999996e-06 2023-10-08T07:07:52.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.871 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.872 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172935 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.872 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.313408+0000", 2023-10-08T07:07:52.872 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0036525849999999999, 2023-10-08T07:07:52.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010980924, 2023-10-08T07:07:52.872 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.872 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.873 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172935 2023-10-08T07:07:52.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.873 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313408+0000", 2023-10-08T07:07:52.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313408+0000", 2023-10-08T07:07:52.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313408+0000", 2023-10-08T07:07:52.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.51e-07 2023-10-08T07:07:52.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313421+0000", 2023-10-08T07:07:52.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2312e-05 2023-10-08T07:07:52.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313427+0000", 2023-10-08T07:07:52.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0589999999999999e-06 2023-10-08T07:07:52.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313431+0000", 2023-10-08T07:07:52.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5229999999999997e-06 2023-10-08T07:07:52.876 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.876 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.876 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.876 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171294 4.28 4:15b6682b:::10000000004.0000000b:head [write 544768~4096 in=4096b,write 946176~4096 in=4096b,write 1146880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.876 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.859391+0000", 2023-10-08T07:07:52.876 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.45766991400000001, 2023-10-08T07:07:52.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46506451199999999, 2023-10-08T07:07:52.877 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.877 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.877 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171294 2023-10-08T07:07:52.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.877 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.859391+0000", 2023-10-08T07:07:52.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.859391+0000", 2023-10-08T07:07:52.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.859391+0000", 2023-10-08T07:07:52.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5300000000000004e-07 2023-10-08T07:07:52.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.859409+0000", 2023-10-08T07:07:52.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7949e-05 2023-10-08T07:07:52.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.859416+0000", 2023-10-08T07:07:52.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2150000000000004e-06 2023-10-08T07:07:52.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.859422+0000", 2023-10-08T07:07:52.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6420000000000004e-06 2023-10-08T07:07:52.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304343+0000", 2023-10-08T07:07:52.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44492063300000001 2023-10-08T07:07:52.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304399+0000", 2023-10-08T07:07:52.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6954999999999999e-05 2023-10-08T07:07:52.881 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.881 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.881 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.882 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172197 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.882 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.093503+0000", 2023-10-08T07:07:52.882 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.22355720300000001, 2023-10-08T07:07:52.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23103259900000001, 2023-10-08T07:07:52.882 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.882 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.883 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172197 2023-10-08T07:07:52.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.883 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093503+0000", 2023-10-08T07:07:52.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093503+0000", 2023-10-08T07:07:52.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093504+0000", 2023-10-08T07:07:52.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9999999999999998e-07 2023-10-08T07:07:52.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093516+0000", 2023-10-08T07:07:52.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2169e-05 2023-10-08T07:07:52.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093523+0000", 2023-10-08T07:07:52.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9709999999999998e-06 2023-10-08T07:07:52.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093528+0000", 2023-10-08T07:07:52.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4319999999999998e-06 2023-10-08T07:07:52.886 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.886 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.886 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.886 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172352 4.19 4:9b26afe3:::10000000004.00000005:head [write 3391488~4096 in=4096b,write 3715072~4096 in=4096b,write 3768320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.886 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.142734+0000", 2023-10-08T07:07:52.886 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.17432677399999999, 2023-10-08T07:07:52.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18187177099999999, 2023-10-08T07:07:52.887 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.887 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.887 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172352 2023-10-08T07:07:52.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.887 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.142734+0000", 2023-10-08T07:07:52.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.142734+0000", 2023-10-08T07:07:52.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.142734+0000", 2023-10-08T07:07:52.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8800000000000003e-07 2023-10-08T07:07:52.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.142747+0000", 2023-10-08T07:07:52.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2381000000000001e-05 2023-10-08T07:07:52.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.142753+0000", 2023-10-08T07:07:52.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1310000000000003e-06 2023-10-08T07:07:52.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.142758+0000", 2023-10-08T07:07:52.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0799999999999996e-06 2023-10-08T07:07:52.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.306909+0000", 2023-10-08T07:07:52.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.164151029 2023-10-08T07:07:52.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.306980+0000", 2023-10-08T07:07:52.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1192000000000005e-05 2023-10-08T07:07:52.891 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.891 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.891 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.892 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172606 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.892 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.203146+0000", 2023-10-08T07:07:52.892 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.113914775, 2023-10-08T07:07:52.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.121526589, 2023-10-08T07:07:52.892 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.892 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.892 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.892 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.892 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.893 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172606 2023-10-08T07:07:52.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.893 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.203146+0000", 2023-10-08T07:07:52.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.203146+0000", 2023-10-08T07:07:52.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.204296+0000", 2023-10-08T07:07:52.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001150765 2023-10-08T07:07:52.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.204311+0000", 2023-10-08T07:07:52.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.506e-05 2023-10-08T07:07:52.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.204321+0000", 2023-10-08T07:07:52.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2890000000000003e-06 2023-10-08T07:07:52.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.204328+0000", 2023-10-08T07:07:52.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0119999999999999e-06 2023-10-08T07:07:52.896 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.896 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.896 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.896 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172661 4.19 4.c7f564d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.896 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.220460+0000", 2023-10-08T07:07:52.897 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.096600375000000002, 2023-10-08T07:07:52.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.104311731, 2023-10-08T07:07:52.897 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.897 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.897 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172661 2023-10-08T07:07:52.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.897 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220460+0000", 2023-10-08T07:07:52.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220460+0000", 2023-10-08T07:07:52.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220461+0000", 2023-10-08T07:07:52.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3700000000000001e-07 2023-10-08T07:07:52.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.220474+0000", 2023-10-08T07:07:52.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3021e-05 2023-10-08T07:07:52.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.221333+0000", 2023-10-08T07:07:52.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00085922400000000001 2023-10-08T07:07:52.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.221342+0000", 2023-10-08T07:07:52.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8510000000000005e-06 2023-10-08T07:07:52.900 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.901 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.901 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172705 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.901 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.237878+0000", 2023-10-08T07:07:52.901 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.079182242999999999, 2023-10-08T07:07:52.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.086948302000000005, 2023-10-08T07:07:52.901 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.901 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.902 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172705 2023-10-08T07:07:52.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.902 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237878+0000", 2023-10-08T07:07:52.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237878+0000", 2023-10-08T07:07:52.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237879+0000", 2023-10-08T07:07:52.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5499999999999998e-07 2023-10-08T07:07:52.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237892+0000", 2023-10-08T07:07:52.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2751999999999999e-05 2023-10-08T07:07:52.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237899+0000", 2023-10-08T07:07:52.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1199999999999996e-06 2023-10-08T07:07:52.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.237904+0000", 2023-10-08T07:07:52.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0919999999999997e-06 2023-10-08T07:07:52.905 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.905 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.905 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.905 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172761 4.21 4.5d9f5e61 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.906 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.249434+0000", 2023-10-08T07:07:52.906 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.067626914999999996, 2023-10-08T07:07:52.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.075446765999999998, 2023-10-08T07:07:52.906 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.906 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.906 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.906 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.906 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.906 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172761 2023-10-08T07:07:52.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.907 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249434+0000", 2023-10-08T07:07:52.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249434+0000", 2023-10-08T07:07:52.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249434+0000", 2023-10-08T07:07:52.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3099999999999998e-07 2023-10-08T07:07:52.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249448+0000", 2023-10-08T07:07:52.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4355000000000001e-05 2023-10-08T07:07:52.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249455+0000", 2023-10-08T07:07:52.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.934e-06 2023-10-08T07:07:52.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249460+0000", 2023-10-08T07:07:52.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0329999999999999e-06 2023-10-08T07:07:52.910 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.910 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.910 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.910 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172805 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.910 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.266364+0000", 2023-10-08T07:07:52.910 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.050696162000000003, 2023-10-08T07:07:52.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058568980999999999, 2023-10-08T07:07:52.910 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.911 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.911 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.911 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.911 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.911 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172805 2023-10-08T07:07:52.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.911 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266364+0000", 2023-10-08T07:07:52.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266364+0000", 2023-10-08T07:07:52.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266365+0000", 2023-10-08T07:07:52.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:07:52.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266383+0000", 2023-10-08T07:07:52.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8238000000000001e-05 2023-10-08T07:07:52.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266391+0000", 2023-10-08T07:07:52.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2023-10-08T07:07:52.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266412+0000", 2023-10-08T07:07:52.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0729000000000001e-05 2023-10-08T07:07:52.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.914 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.915 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172936 4.15 4:aa4cb2c5:::10000000004.0000003c:head [write 3469312~4096 in=4096b,write 3768320~4096 in=4096b,write 3960832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.915 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.313438+0000", 2023-10-08T07:07:52.915 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0036224650000000001, 2023-10-08T07:07:52.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011554671000000001, 2023-10-08T07:07:52.915 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.915 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.915 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.915 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.915 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.916 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172936 2023-10-08T07:07:52.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.916 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313438+0000", 2023-10-08T07:07:52.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313438+0000", 2023-10-08T07:07:52.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313438+0000", 2023-10-08T07:07:52.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4900000000000001e-07 2023-10-08T07:07:52.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313450+0000", 2023-10-08T07:07:52.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1581e-05 2023-10-08T07:07:52.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313456+0000", 2023-10-08T07:07:52.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6319999999999996e-06 2023-10-08T07:07:52.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313460+0000", 2023-10-08T07:07:52.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6129999999999997e-06 2023-10-08T07:07:52.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.316211+0000", 2023-10-08T07:07:52.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027504069999999999 2023-10-08T07:07:52.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.316295+0000", 2023-10-08T07:07:52.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4095e-05 2023-10-08T07:07:52.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.920 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.920 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171235 4.28 4:16edf4d3:::10000000004.00000027:head [write 2777088~4096 in=4096b,write 2830336~4096 in=4096b,write 2883584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.920 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.846485+0000", 2023-10-08T07:07:52.920 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.47057507700000001, 2023-10-08T07:07:52.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.47857764800000002, 2023-10-08T07:07:52.921 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.921 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:52.921 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.921 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.921 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.921 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171235 2023-10-08T07:07:52.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.921 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846485+0000", 2023-10-08T07:07:52.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846485+0000", 2023-10-08T07:07:52.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846486+0000", 2023-10-08T07:07:52.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2023-10-08T07:07:52.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846506+0000", 2023-10-08T07:07:52.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9695999999999999e-05 2023-10-08T07:07:52.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846513+0000", 2023-10-08T07:07:52.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2023-10-08T07:07:52.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.846522+0000", 2023-10-08T07:07:52.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3400000000000004e-06 2023-10-08T07:07:52.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:52.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.291917+0000", 2023-10-08T07:07:52.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44539454299999998 2023-10-08T07:07:52.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:52.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.291995+0000", 2023-10-08T07:07:52.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7967999999999996e-05 2023-10-08T07:07:52.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.925 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.925 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.926 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171502 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.926 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.913505+0000", 2023-10-08T07:07:52.926 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.40355536600000003, 2023-10-08T07:07:52.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41163055500000001, 2023-10-08T07:07:52.926 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.926 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.926 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.926 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.927 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171502 2023-10-08T07:07:52.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.927 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.913505+0000", 2023-10-08T07:07:52.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.913505+0000", 2023-10-08T07:07:52.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.913506+0000", 2023-10-08T07:07:52.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9299999999999998e-07 2023-10-08T07:07:52.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.913525+0000", 2023-10-08T07:07:52.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9828999999999999e-05 2023-10-08T07:07:52.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.913532+0000", 2023-10-08T07:07:52.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.827e-06 2023-10-08T07:07:52.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.913543+0000", 2023-10-08T07:07:52.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0536e-05 2023-10-08T07:07:52.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.930 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.930 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171782 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.930 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.990285+0000", 2023-10-08T07:07:52.931 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.32677584399999998, 2023-10-08T07:07:52.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.33490494300000001, 2023-10-08T07:07:52.931 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.931 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.931 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171782 2023-10-08T07:07:52.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.931 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990285+0000", 2023-10-08T07:07:52.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990285+0000", 2023-10-08T07:07:52.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990285+0000", 2023-10-08T07:07:52.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.75e-07 2023-10-08T07:07:52.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990304+0000", 2023-10-08T07:07:52.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9247000000000001e-05 2023-10-08T07:07:52.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990313+0000", 2023-10-08T07:07:52.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2330000000000006e-06 2023-10-08T07:07:52.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990319+0000", 2023-10-08T07:07:52.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8989999999999998e-06 2023-10-08T07:07:52.934 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.935 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.935 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.935 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172054 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.935 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.052941+0000", 2023-10-08T07:07:52.935 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26411908699999997, 2023-10-08T07:07:52.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27230192600000003, 2023-10-08T07:07:52.935 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.937 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.937 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172054 2023-10-08T07:07:52.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.937 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.052941+0000", 2023-10-08T07:07:52.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.052941+0000", 2023-10-08T07:07:52.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.052942+0000", 2023-10-08T07:07:52.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4499999999999996e-07 2023-10-08T07:07:52.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.052955+0000", 2023-10-08T07:07:52.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2670999999999999e-05 2023-10-08T07:07:52.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.052963+0000", 2023-10-08T07:07:52.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5629999999999992e-06 2023-10-08T07:07:52.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.052986+0000", 2023-10-08T07:07:52.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2379999999999999e-05 2023-10-08T07:07:52.940 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.940 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.940 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.940 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172199 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.940 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.093535+0000", 2023-10-08T07:07:52.941 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.223524956, 2023-10-08T07:07:52.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.23176681299999999, 2023-10-08T07:07:52.941 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.941 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.941 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.941 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.941 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.941 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172199 2023-10-08T07:07:52.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.941 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093535+0000", 2023-10-08T07:07:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093535+0000", 2023-10-08T07:07:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093536+0000", 2023-10-08T07:07:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7999999999999996e-07 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093547+0000", 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1012999999999999e-05 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093553+0000", 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.093558+0000", 2023-10-08T07:07:52.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3870000000000003e-06 2023-10-08T07:07:52.944 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.944 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.944 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.944 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172457 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.944 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.163303+0000", 2023-10-08T07:07:52.944 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.153757699, 2023-10-08T07:07:52.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.162053792, 2023-10-08T07:07:52.944 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172457 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163303+0000", 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163303+0000", 2023-10-08T07:07:52.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163303+0000", 2023-10-08T07:07:52.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000005e-07 2023-10-08T07:07:52.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163317+0000", 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4061e-05 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163324+0000", 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7499999999999997e-06 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163330+0000", 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7769999999999999e-06 2023-10-08T07:07:52.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.948 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.948 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.948 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172762 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.948 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.249468+0000", 2023-10-08T07:07:52.948 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.067592534999999995, 2023-10-08T07:07:52.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.075942578999999996, 2023-10-08T07:07:52.948 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.948 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.949 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.949 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172762 2023-10-08T07:07:52.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.949 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249468+0000", 2023-10-08T07:07:52.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249468+0000", 2023-10-08T07:07:52.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249468+0000", 2023-10-08T07:07:52.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5299999999999999e-07 2023-10-08T07:07:52.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249482+0000", 2023-10-08T07:07:52.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3927999999999999e-05 2023-10-08T07:07:52.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249488+0000", 2023-10-08T07:07:52.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5489999999999997e-06 2023-10-08T07:07:52.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249493+0000", 2023-10-08T07:07:52.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7140000000000001e-06 2023-10-08T07:07:52.951 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.951 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.951 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172890 4.19 4.c7f564d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.300386+0000", 2023-10-08T07:07:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016674352999999999, 2023-10-08T07:07:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025079944, 2023-10-08T07:07:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.952 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172890 2023-10-08T07:07:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300386+0000", 2023-10-08T07:07:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300386+0000", 2023-10-08T07:07:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300387+0000", 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7100000000000002e-07 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300399+0000", 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2765999999999999e-05 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300406+0000", 2023-10-08T07:07:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8460000000000002e-06 2023-10-08T07:07:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300417+0000", 2023-10-08T07:07:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1136e-05 2023-10-08T07:07:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.955 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172939 4.19 4.8d5b859 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.313466+0000", 2023-10-08T07:07:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0035941620000000001, 2023-10-08T07:07:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012062852000000001, 2023-10-08T07:07:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172939 2023-10-08T07:07:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313466+0000", 2023-10-08T07:07:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313466+0000", 2023-10-08T07:07:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313467+0000", 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4999999999999998e-07 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313477+0000", 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0576e-05 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313483+0000", 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.711e-06 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313488+0000", 2023-10-08T07:07:52.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5689999999999998e-06 2023-10-08T07:07:52.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.959 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.959 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171544 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.959 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.925451+0000", 2023-10-08T07:07:52.959 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39160985399999998, 2023-10-08T07:07:52.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.400147523, 2023-10-08T07:07:52.960 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.960 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.960 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171544 2023-10-08T07:07:52.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.960 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.925451+0000", 2023-10-08T07:07:52.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.925451+0000", 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.925451+0000", 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.925463+0000", 2023-10-08T07:07:52.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1827e-05 2023-10-08T07:07:52.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.925469+0000", 2023-10-08T07:07:52.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3409999999999999e-06 2023-10-08T07:07:52.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.925474+0000", 2023-10-08T07:07:52.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1329999999999998e-06 2023-10-08T07:07:52.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.963 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.963 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.963 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171587 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.963 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.936074+0000", 2023-10-08T07:07:52.963 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38098647299999999, 2023-10-08T07:07:52.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.389601419, 2023-10-08T07:07:52.963 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.963 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.963 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171587 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.936074+0000", 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.936074+0000", 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.938315+0000", 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022406890000000001 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.938331+0000", 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6606999999999999e-05 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.938341+0000", 2023-10-08T07:07:52.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9510000000000001e-06 2023-10-08T07:07:52.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.938349+0000", 2023-10-08T07:07:52.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5639999999999999e-06 2023-10-08T07:07:52.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.966 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.967 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172404 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.967 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.153461+0000", 2023-10-08T07:07:52.967 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.16359977000000001, 2023-10-08T07:07:52.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.172276761, 2023-10-08T07:07:52.967 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.967 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.967 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172404 2023-10-08T07:07:52.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.968 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153461+0000", 2023-10-08T07:07:52.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153461+0000", 2023-10-08T07:07:52.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153461+0000", 2023-10-08T07:07:52.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1e-07 2023-10-08T07:07:52.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153474+0000", 2023-10-08T07:07:52.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2757e-05 2023-10-08T07:07:52.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153479+0000", 2023-10-08T07:07:52.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2023-10-08T07:07:52.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.153482+0000", 2023-10-08T07:07:52.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.977e-06 2023-10-08T07:07:52.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.970 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.970 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172458 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.163338+0000", 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15372292500000001, 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.16246472300000001, 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172458 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163338+0000", 2023-10-08T07:07:52.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163338+0000", 2023-10-08T07:07:52.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163338+0000", 2023-10-08T07:07:52.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8299999999999997e-07 2023-10-08T07:07:52.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163351+0000", 2023-10-08T07:07:52.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2807e-05 2023-10-08T07:07:52.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163358+0000", 2023-10-08T07:07:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7750000000000004e-06 2023-10-08T07:07:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163363+0000", 2023-10-08T07:07:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2789999999999998e-06 2023-10-08T07:07:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.975 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172560 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.975 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.190606+0000", 2023-10-08T07:07:52.975 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.12645485200000001, 2023-10-08T07:07:52.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13525936599999999, 2023-10-08T07:07:52.975 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.975 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.975 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172560 2023-10-08T07:07:52.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.975 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190606+0000", 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.190606+0000", 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.192296+0000", 2023-10-08T07:07:52.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001690053 2023-10-08T07:07:52.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.192311+0000", 2023-10-08T07:07:52.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5464999999999998e-05 2023-10-08T07:07:52.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.192319+0000", 2023-10-08T07:07:52.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8660000000000006e-06 2023-10-08T07:07:52.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.192325+0000", 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1840000000000004e-06 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172611 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.204339+0000", 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.11272096199999999, 2023-10-08T07:07:52.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.12159205100000001, 2023-10-08T07:07:52.979 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.979 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.979 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.979 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172611 2023-10-08T07:07:52.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.979 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.204339+0000", 2023-10-08T07:07:52.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.204339+0000", 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.206294+0000", 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019547319999999998 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.206311+0000", 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7016000000000001e-05 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.206324+0000", 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2874000000000001e-05 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.206331+0000", 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3599999999999998e-06 2023-10-08T07:07:52.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.982 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.982 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172806 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.982 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.266423+0000", 2023-10-08T07:07:52.982 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.050637371, 2023-10-08T07:07:52.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059572724000000001, 2023-10-08T07:07:52.982 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.982 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.982 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172806 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266423+0000", 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.266423+0000", 2023-10-08T07:07:52.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270298+0000", 2023-10-08T07:07:52.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038745989999999998 2023-10-08T07:07:52.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270315+0000", 2023-10-08T07:07:52.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7289e-05 2023-10-08T07:07:52.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270325+0000", 2023-10-08T07:07:52.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0529e-05 2023-10-08T07:07:52.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270336+0000", 2023-10-08T07:07:52.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0193e-05 2023-10-08T07:07:52.985 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.985 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.985 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172893 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.300425+0000", 2023-10-08T07:07:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016635262000000001, 2023-10-08T07:07:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025635412999999999, 2023-10-08T07:07:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172893 2023-10-08T07:07:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300425+0000", 2023-10-08T07:07:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300425+0000", 2023-10-08T07:07:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300426+0000", 2023-10-08T07:07:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8999999999999997e-07 2023-10-08T07:07:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300437+0000", 2023-10-08T07:07:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1711e-05 2023-10-08T07:07:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300447+0000", 2023-10-08T07:07:52.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3300000000000005e-06 2023-10-08T07:07:52.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300453+0000", 2023-10-08T07:07:52.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3640000000000004e-06 2023-10-08T07:07:52.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.989 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.990 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172941 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.990 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.313493+0000", 2023-10-08T07:07:52.990 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0035670929999999999, 2023-10-08T07:07:52.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012631897, 2023-10-08T07:07:52.990 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.990 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.990 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172941 2023-10-08T07:07:52.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.990 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313493+0000", 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313493+0000", 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313494+0000", 2023-10-08T07:07:52.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.46e-07 2023-10-08T07:07:52.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313506+0000", 2023-10-08T07:07:52.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1905999999999999e-05 2023-10-08T07:07:52.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313512+0000", 2023-10-08T07:07:52.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.178e-06 2023-10-08T07:07:52.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313516+0000", 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5159999999999996e-06 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171593 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.938362+0000", 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37869889499999998, 2023-10-08T07:07:52.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.38783992900000003, 2023-10-08T07:07:52.994 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.994 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.994 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171593 2023-10-08T07:07:52.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.994 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.938362+0000", 2023-10-08T07:07:52.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.938362+0000", 2023-10-08T07:07:52.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.938362+0000", 2023-10-08T07:07:52.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6899999999999998e-07 2023-10-08T07:07:52.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.938375+0000", 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2843999999999999e-05 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.938381+0000", 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5459999999999997e-06 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.938386+0000", 2023-10-08T07:07:52.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9699999999999998e-06 2023-10-08T07:07:52.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.997 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:52.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:52.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.997 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171849 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:52.997 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.999970+0000", 2023-10-08T07:07:52.997 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.31709037000000001, 2023-10-08T07:07:52.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.32630751800000002, 2023-10-08T07:07:52.997 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:52.997 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:52.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171849 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.999970+0000", 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:52.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.999970+0000", 2023-10-08T07:07:52.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:52.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:52.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.999971+0000", 2023-10-08T07:07:52.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5299999999999999e-07 2023-10-08T07:07:52.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:52.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:52.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:52.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.999981+0000", 2023-10-08T07:07:52.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0764999999999999e-05 2023-10-08T07:07:52.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.999988+0000", 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6930000000000001e-06 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.999993+0000", 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3329999999999996e-06 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.001 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172894 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.001 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.300461+0000", 2023-10-08T07:07:53.001 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.016599524000000001, 2023-10-08T07:07:53.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025897921000000001, 2023-10-08T07:07:53.001 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.001 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.002 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.002 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172894 2023-10-08T07:07:53.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.002 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300461+0000", 2023-10-08T07:07:53.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.300461+0000", 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.302296+0000", 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018351590000000001 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.302317+0000", 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1263999999999998e-05 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.302328+0000", 2023-10-08T07:07:53.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0181e-05 2023-10-08T07:07:53.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.302333+0000", 2023-10-08T07:07:53.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3360000000000002e-06 2023-10-08T07:07:53.004 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.004 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.005 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172942 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.005 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.313522+0000", 2023-10-08T07:07:53.005 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0035388170000000001, 2023-10-08T07:07:53.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012905504, 2023-10-08T07:07:53.005 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.005 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.006 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.006 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.006 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.006 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172942 2023-10-08T07:07:53.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.006 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313522+0000", 2023-10-08T07:07:53.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313522+0000", 2023-10-08T07:07:53.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313522+0000", 2023-10-08T07:07:53.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1e-07 2023-10-08T07:07:53.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313534+0000", 2023-10-08T07:07:53.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1615e-05 2023-10-08T07:07:53.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313539+0000", 2023-10-08T07:07:53.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4840000000000003e-06 2023-10-08T07:07:53.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313543+0000", 2023-10-08T07:07:53.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4530000000000004e-06 2023-10-08T07:07:53.009 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.009 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.009 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.010 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172409 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.010 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.155343+0000", 2023-10-08T07:07:53.010 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.161717747, 2023-10-08T07:07:53.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17113830699999999, 2023-10-08T07:07:53.010 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.010 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.010 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.010 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.010 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.010 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172409 2023-10-08T07:07:53.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.011 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155343+0000", 2023-10-08T07:07:53.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155343+0000", 2023-10-08T07:07:53.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155343+0000", 2023-10-08T07:07:53.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1699999999999998e-07 2023-10-08T07:07:53.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155356+0000", 2023-10-08T07:07:53.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2850999999999999e-05 2023-10-08T07:07:53.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155362+0000", 2023-10-08T07:07:53.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2380000000000002e-06 2023-10-08T07:07:53.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155367+0000", 2023-10-08T07:07:53.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9130000000000002e-06 2023-10-08T07:07:53.014 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.014 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.014 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.014 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172514 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.014 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.177526+0000", 2023-10-08T07:07:53.014 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.13953412900000001, 2023-10-08T07:07:53.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.149006375, 2023-10-08T07:07:53.015 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.015 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.015 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.015 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.015 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.015 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172514 2023-10-08T07:07:53.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.015 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177526+0000", 2023-10-08T07:07:53.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177526+0000", 2023-10-08T07:07:53.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177527+0000", 2023-10-08T07:07:53.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8699999999999995e-07 2023-10-08T07:07:53.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177543+0000", 2023-10-08T07:07:53.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6422999999999998e-05 2023-10-08T07:07:53.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177550+0000", 2023-10-08T07:07:53.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.781e-06 2023-10-08T07:07:53.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177557+0000", 2023-10-08T07:07:53.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0899999999999999e-06 2023-10-08T07:07:53.018 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.018 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.019 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172665 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.019 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.223381+0000", 2023-10-08T07:07:53.019 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.093679080999999997, 2023-10-08T07:07:53.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.103205374, 2023-10-08T07:07:53.019 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.019 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.020 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172665 2023-10-08T07:07:53.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.020 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.223381+0000", 2023-10-08T07:07:53.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.223381+0000", 2023-10-08T07:07:53.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.223382+0000", 2023-10-08T07:07:53.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7100000000000002e-07 2023-10-08T07:07:53.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.223398+0000", 2023-10-08T07:07:53.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6317e-05 2023-10-08T07:07:53.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.223406+0000", 2023-10-08T07:07:53.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4599999999999997e-06 2023-10-08T07:07:53.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.223411+0000", 2023-10-08T07:07:53.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6609999999999997e-06 2023-10-08T07:07:53.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.023 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.023 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172710 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.024 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.238026+0000", 2023-10-08T07:07:53.024 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.079034296000000004, 2023-10-08T07:07:53.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.088615548000000002, 2023-10-08T07:07:53.024 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.024 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.024 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172710 2023-10-08T07:07:53.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.025 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238026+0000", 2023-10-08T07:07:53.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238026+0000", 2023-10-08T07:07:53.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238027+0000", 2023-10-08T07:07:53.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.58e-07 2023-10-08T07:07:53.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238042+0000", 2023-10-08T07:07:53.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5892999999999998e-05 2023-10-08T07:07:53.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238049+0000", 2023-10-08T07:07:53.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6699999999999997e-06 2023-10-08T07:07:53.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238055+0000", 2023-10-08T07:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3700000000000003e-06 2023-10-08T07:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172768 4.19 4.c7f564d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.249613+0000", 2023-10-08T07:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.067447323000000003, 2023-10-08T07:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.077083578, 2023-10-08T07:07:53.028 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.029 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.029 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172768 2023-10-08T07:07:53.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.029 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249613+0000", 2023-10-08T07:07:53.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249613+0000", 2023-10-08T07:07:53.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249614+0000", 2023-10-08T07:07:53.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9999999999999998e-07 2023-10-08T07:07:53.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249623+0000", 2023-10-08T07:07:53.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4390000000000006e-06 2023-10-08T07:07:53.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249628+0000", 2023-10-08T07:07:53.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1599999999999997e-06 2023-10-08T07:07:53.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.249634+0000", 2023-10-08T07:07:53.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3689999999999998e-06 2023-10-08T07:07:53.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.032 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.033 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172809 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.033 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.270399+0000", 2023-10-08T07:07:53.033 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.046660979999999998, 2023-10-08T07:07:53.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056354420000000002, 2023-10-08T07:07:53.033 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.033 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.033 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.033 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.033 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.034 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172809 2023-10-08T07:07:53.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.034 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270399+0000", 2023-10-08T07:07:53.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270399+0000", 2023-10-08T07:07:53.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270400+0000", 2023-10-08T07:07:53.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8599999999999998e-07 2023-10-08T07:07:53.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270412+0000", 2023-10-08T07:07:53.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2140000000000001e-05 2023-10-08T07:07:53.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270419+0000", 2023-10-08T07:07:53.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0369999999999997e-06 2023-10-08T07:07:53.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270424+0000", 2023-10-08T07:07:53.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1610000000000002e-06 2023-10-08T07:07:53.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.037 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.037 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172895 4.f 4:f2537947:::10000000004.00000017:head [write 151552~4096 in=4096b,write 425984~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.037 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.302342+0000", 2023-10-08T07:07:53.038 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014717967, 2023-10-08T07:07:53.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024471641999999998, 2023-10-08T07:07:53.038 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.038 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:53.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.038 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172895 2023-10-08T07:07:53.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.039 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.302342+0000", 2023-10-08T07:07:53.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.302342+0000", 2023-10-08T07:07:53.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.302343+0000", 2023-10-08T07:07:53.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1399999999999997e-07 2023-10-08T07:07:53.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.302354+0000", 2023-10-08T07:07:53.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1409999999999999e-05 2023-10-08T07:07:53.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.302360+0000", 2023-10-08T07:07:53.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0430000000000004e-06 2023-10-08T07:07:53.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.302364+0000", 2023-10-08T07:07:53.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7639999999999999e-06 2023-10-08T07:07:53.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.322092+0000", 2023-10-08T07:07:53.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019728048000000001 2023-10-08T07:07:53.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.322171+0000", 2023-10-08T07:07:53.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9060999999999994e-05 2023-10-08T07:07:53.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.043 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.043 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172944 4.3b 4:df82de1b:::10000000004.0000000f:head [write 3268608~4096 in=4096b,write 3870720~4096 in=4096b,write 3899392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.043 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.313549+0000", 2023-10-08T07:07:53.043 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003511639, 2023-10-08T07:07:53.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013338691, 2023-10-08T07:07:53.044 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.044 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:53.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.044 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172944 2023-10-08T07:07:53.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.044 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313549+0000", 2023-10-08T07:07:53.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313549+0000", 2023-10-08T07:07:53.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313549+0000", 2023-10-08T07:07:53.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4400000000000001e-07 2023-10-08T07:07:53.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313560+0000", 2023-10-08T07:07:53.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0941000000000001e-05 2023-10-08T07:07:53.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313566+0000", 2023-10-08T07:07:53.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5149999999999997e-06 2023-10-08T07:07:53.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.313571+0000", 2023-10-08T07:07:53.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9470000000000002e-06 2023-10-08T07:07:53.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.322123+0000", 2023-10-08T07:07:53.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008552914 2023-10-08T07:07:53.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.322190+0000", 2023-10-08T07:07:53.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6150999999999997e-05 2023-10-08T07:07:53.048 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.048 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.049 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.049 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171401 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.049 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.893352+0000", 2023-10-08T07:07:53.049 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42370886299999999, 2023-10-08T07:07:53.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43360389300000002, 2023-10-08T07:07:53.049 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.049 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.049 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.050 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171401 2023-10-08T07:07:53.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.050 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.893352+0000", 2023-10-08T07:07:53.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.893352+0000", 2023-10-08T07:07:53.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.893352+0000", 2023-10-08T07:07:53.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9800000000000004e-07 2023-10-08T07:07:53.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.893366+0000", 2023-10-08T07:07:53.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3471e-05 2023-10-08T07:07:53.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.893371+0000", 2023-10-08T07:07:53.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9379999999999997e-06 2023-10-08T07:07:53.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.893376+0000", 2023-10-08T07:07:53.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9429999999999999e-06 2023-10-08T07:07:53.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.053 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.053 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171553 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.053 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.927358+0000", 2023-10-08T07:07:53.054 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38970233199999998, 2023-10-08T07:07:53.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.39965581300000003, 2023-10-08T07:07:53.054 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.054 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.054 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171553 2023-10-08T07:07:53.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.054 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.927358+0000", 2023-10-08T07:07:53.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.927358+0000", 2023-10-08T07:07:53.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.927359+0000", 2023-10-08T07:07:53.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0499999999999999e-07 2023-10-08T07:07:53.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.927371+0000", 2023-10-08T07:07:53.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2262000000000001e-05 2023-10-08T07:07:53.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.927377+0000", 2023-10-08T07:07:53.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6460000000000004e-06 2023-10-08T07:07:53.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.927383+0000", 2023-10-08T07:07:53.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2800000000000003e-06 2023-10-08T07:07:53.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.057 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.058 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.058 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171739 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.058 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.977859+0000", 2023-10-08T07:07:53.058 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.33920130100000001, 2023-10-08T07:07:53.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.34921079700000002, 2023-10-08T07:07:53.058 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.058 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.059 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.059 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.059 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.059 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171739 2023-10-08T07:07:53.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.059 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.977859+0000", 2023-10-08T07:07:53.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.977859+0000", 2023-10-08T07:07:53.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.981294+0000", 2023-10-08T07:07:53.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034352010000000001 2023-10-08T07:07:53.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.981314+0000", 2023-10-08T07:07:53.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9171e-05 2023-10-08T07:07:53.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.981324+0000", 2023-10-08T07:07:53.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0115999999999999e-05 2023-10-08T07:07:53.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.981332+0000", 2023-10-08T07:07:53.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1980000000000001e-06 2023-10-08T07:07:53.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.062 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.063 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172257 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.063 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.110428+0000", 2023-10-08T07:07:53.063 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.206632915, 2023-10-08T07:07:53.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.216696373, 2023-10-08T07:07:53.063 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.063 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.063 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172257 2023-10-08T07:07:53.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.064 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.110428+0000", 2023-10-08T07:07:53.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.110428+0000", 2023-10-08T07:07:53.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.110428+0000", 2023-10-08T07:07:53.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6000000000000004e-07 2023-10-08T07:07:53.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.110440+0000", 2023-10-08T07:07:53.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2387e-05 2023-10-08T07:07:53.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.110464+0000", 2023-10-08T07:07:53.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3777e-05 2023-10-08T07:07:53.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.110471+0000", 2023-10-08T07:07:53.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4219999999999997e-06 2023-10-08T07:07:53.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.067 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.067 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172314 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.067 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.122607+0000", 2023-10-08T07:07:53.068 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.19445363500000001, 2023-10-08T07:07:53.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.20457447200000001, 2023-10-08T07:07:53.068 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.068 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.068 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172314 2023-10-08T07:07:53.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.068 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.122607+0000", 2023-10-08T07:07:53.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.122607+0000", 2023-10-08T07:07:53.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.124295+0000", 2023-10-08T07:07:53.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016883410000000001 2023-10-08T07:07:53.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.124313+0000", 2023-10-08T07:07:53.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7405999999999999e-05 2023-10-08T07:07:53.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.124326+0000", 2023-10-08T07:07:53.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3841e-05 2023-10-08T07:07:53.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.124335+0000", 2023-10-08T07:07:53.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7220000000000005e-06 2023-10-08T07:07:53.071 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.072 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.072 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172415 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.072 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.155374+0000", 2023-10-08T07:07:53.072 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.16168647899999999, 2023-10-08T07:07:53.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17186558399999999, 2023-10-08T07:07:53.072 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.072 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.073 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172415 2023-10-08T07:07:53.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.073 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155374+0000", 2023-10-08T07:07:53.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155374+0000", 2023-10-08T07:07:53.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155374+0000", 2023-10-08T07:07:53.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2023-10-08T07:07:53.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155386+0000", 2023-10-08T07:07:53.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2109e-05 2023-10-08T07:07:53.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155392+0000", 2023-10-08T07:07:53.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.694e-06 2023-10-08T07:07:53.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155397+0000", 2023-10-08T07:07:53.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5639999999999998e-06 2023-10-08T07:07:53.076 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.076 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.076 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.077 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172896 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.077 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.302372+0000", 2023-10-08T07:07:53.077 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01468874, 2023-10-08T07:07:53.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024932436999999998, 2023-10-08T07:07:53.077 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.077 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.077 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.077 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.077 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.077 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172896 2023-10-08T07:07:53.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.078 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.302372+0000", 2023-10-08T07:07:53.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.302372+0000", 2023-10-08T07:07:53.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304295+0000", 2023-10-08T07:07:53.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001922918 2023-10-08T07:07:53.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304320+0000", 2023-10-08T07:07:53.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5876000000000001e-05 2023-10-08T07:07:53.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304330+0000", 2023-10-08T07:07:53.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.859e-06 2023-10-08T07:07:53.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304343+0000", 2023-10-08T07:07:53.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2583e-05 2023-10-08T07:07:53.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.081 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.081 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171601 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.081 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.940344+0000", 2023-10-08T07:07:53.081 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37671610799999999, 2023-10-08T07:07:53.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.38701793499999998, 2023-10-08T07:07:53.082 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.082 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.082 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171601 2023-10-08T07:07:53.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.082 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.940344+0000", 2023-10-08T07:07:53.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.940344+0000", 2023-10-08T07:07:53.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.940345+0000", 2023-10-08T07:07:53.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8100000000000003e-07 2023-10-08T07:07:53.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.940362+0000", 2023-10-08T07:07:53.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7309e-05 2023-10-08T07:07:53.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.940369+0000", 2023-10-08T07:07:53.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3000000000000004e-06 2023-10-08T07:07:53.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.940375+0000", 2023-10-08T07:07:53.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4040000000000003e-06 2023-10-08T07:07:53.085 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.086 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.086 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171740 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.086 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.981351+0000", 2023-10-08T07:07:53.086 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.335709337, 2023-10-08T07:07:53.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.34606493300000002, 2023-10-08T07:07:53.086 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.086 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.087 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171740 2023-10-08T07:07:53.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.087 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.981351+0000", 2023-10-08T07:07:53.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.981351+0000", 2023-10-08T07:07:53.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.981352+0000", 2023-10-08T07:07:53.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1500000000000005e-07 2023-10-08T07:07:53.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.981364+0000", 2023-10-08T07:07:53.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2167000000000001e-05 2023-10-08T07:07:53.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.981370+0000", 2023-10-08T07:07:53.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6529999999999997e-06 2023-10-08T07:07:53.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.981376+0000", 2023-10-08T07:07:53.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2700000000000004e-06 2023-10-08T07:07:53.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.090 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.091 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171900 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.091 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.020442+0000", 2023-10-08T07:07:53.091 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.296618669, 2023-10-08T07:07:53.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.30703207799999999, 2023-10-08T07:07:53.091 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.091 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.092 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171900 2023-10-08T07:07:53.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.092 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.020442+0000", 2023-10-08T07:07:53.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.020442+0000", 2023-10-08T07:07:53.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.020442+0000", 2023-10-08T07:07:53.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.46e-07 2023-10-08T07:07:53.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.020461+0000", 2023-10-08T07:07:53.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9247000000000001e-05 2023-10-08T07:07:53.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.020469+0000", 2023-10-08T07:07:53.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.306e-06 2023-10-08T07:07:53.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.020474+0000", 2023-10-08T07:07:53.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5890000000000002e-06 2023-10-08T07:07:53.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.095 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.095 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172060 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.095 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.054434+0000", 2023-10-08T07:07:53.095 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26262689700000003, 2023-10-08T07:07:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.27309736699999998, 2023-10-08T07:07:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172060 2023-10-08T07:07:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.054434+0000", 2023-10-08T07:07:53.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.054434+0000", 2023-10-08T07:07:53.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.054434+0000", 2023-10-08T07:07:53.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4299999999999999e-07 2023-10-08T07:07:53.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.054445+0000", 2023-10-08T07:07:53.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1317e-05 2023-10-08T07:07:53.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.054451+0000", 2023-10-08T07:07:53.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6949999999999997e-06 2023-10-08T07:07:53.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.054455+0000", 2023-10-08T07:07:53.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5159999999999996e-06 2023-10-08T07:07:53.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.099 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.100 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172416 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.100 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.155403+0000", 2023-10-08T07:07:53.100 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.161657569, 2023-10-08T07:07:53.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.17218455499999999, 2023-10-08T07:07:53.100 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.100 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.101 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172416 2023-10-08T07:07:53.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.101 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155403+0000", 2023-10-08T07:07:53.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155403+0000", 2023-10-08T07:07:53.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155403+0000", 2023-10-08T07:07:53.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8700000000000001e-07 2023-10-08T07:07:53.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155415+0000", 2023-10-08T07:07:53.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1433e-05 2023-10-08T07:07:53.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155421+0000", 2023-10-08T07:07:53.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2580000000000001e-06 2023-10-08T07:07:53.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.155427+0000", 2023-10-08T07:07:53.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5720000000000002e-06 2023-10-08T07:07:53.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.104 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.105 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172564 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.105 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.192405+0000", 2023-10-08T07:07:53.105 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.12465573100000001, 2023-10-08T07:07:53.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13523784999999999, 2023-10-08T07:07:53.105 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.105 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.105 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172564 2023-10-08T07:07:53.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.106 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.192405+0000", 2023-10-08T07:07:53.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.192405+0000", 2023-10-08T07:07:53.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.194295+0000", 2023-10-08T07:07:53.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001890634 2023-10-08T07:07:53.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.194318+0000", 2023-10-08T07:07:53.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2849000000000001e-05 2023-10-08T07:07:53.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.194330+0000", 2023-10-08T07:07:53.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1511e-05 2023-10-08T07:07:53.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.194337+0000", 2023-10-08T07:07:53.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5220000000000001e-06 2023-10-08T07:07:53.109 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.109 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.109 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.109 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172613 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.109 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.206405+0000", 2023-10-08T07:07:53.109 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.110655793, 2023-10-08T07:07:53.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.121300858, 2023-10-08T07:07:53.110 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.110 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.110 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172613 2023-10-08T07:07:53.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.110 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.206405+0000", 2023-10-08T07:07:53.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.206405+0000", 2023-10-08T07:07:53.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212313+0000", 2023-10-08T07:07:53.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059086260000000002 2023-10-08T07:07:53.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212334+0000", 2023-10-08T07:07:53.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1197000000000001e-05 2023-10-08T07:07:53.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212346+0000", 2023-10-08T07:07:53.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.137e-05 2023-10-08T07:07:53.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212354+0000", 2023-10-08T07:07:53.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7859999999999997e-06 2023-10-08T07:07:53.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.113 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.114 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172899 4.37 4:efdd41ff:::10000000004.0000001c:head [write 159744~4096 in=4096b,write 450560~4096 in=4096b,write 667648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.114 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.304355+0000", 2023-10-08T07:07:53.114 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012705742000000001, 2023-10-08T07:07:53.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023421595, 2023-10-08T07:07:53.114 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.114 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:53.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.115 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172899 2023-10-08T07:07:53.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.115 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304355+0000", 2023-10-08T07:07:53.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304355+0000", 2023-10-08T07:07:53.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304355+0000", 2023-10-08T07:07:53.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6400000000000002e-07 2023-10-08T07:07:53.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304370+0000", 2023-10-08T07:07:53.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4465e-05 2023-10-08T07:07:53.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304377+0000", 2023-10-08T07:07:53.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2579999999999998e-06 2023-10-08T07:07:53.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304383+0000", 2023-10-08T07:07:53.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5740000000000003e-06 2023-10-08T07:07:53.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.322253+0000", 2023-10-08T07:07:53.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017870003999999998 2023-10-08T07:07:53.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.322342+0000", 2023-10-08T07:07:53.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9027e-05 2023-10-08T07:07:53.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.119 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.119 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.119 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171360 4.28 4:16edf4d3:::10000000004.00000027:head [write 180224~4096 in=4096b,write 212992~4096 in=4096b,write 290816~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.119 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.884433+0000", 2023-10-08T07:07:53.120 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43262772100000002, 2023-10-08T07:07:53.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44342712400000001, 2023-10-08T07:07:53.120 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.120 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:53.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.120 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.120 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171360 2023-10-08T07:07:53.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.884433+0000", 2023-10-08T07:07:53.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.884433+0000", 2023-10-08T07:07:53.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.884433+0000", 2023-10-08T07:07:53.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6599999999999996e-07 2023-10-08T07:07:53.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.884448+0000", 2023-10-08T07:07:53.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5164000000000001e-05 2023-10-08T07:07:53.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.884456+0000", 2023-10-08T07:07:53.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2989999999999999e-06 2023-10-08T07:07:53.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.884461+0000", 2023-10-08T07:07:53.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3410000000000002e-06 2023-10-08T07:07:53.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.322331+0000", 2023-10-08T07:07:53.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43787021100000001 2023-10-08T07:07:53.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.322414+0000", 2023-10-08T07:07:53.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2876999999999999e-05 2023-10-08T07:07:53.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.125 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.125 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171406 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.125 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.893410+0000", 2023-10-08T07:07:53.125 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42365077499999998, 2023-10-08T07:07:53.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43452259999999998, 2023-10-08T07:07:53.126 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.126 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.126 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171406 2023-10-08T07:07:53.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.126 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.893410+0000", 2023-10-08T07:07:53.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.893410+0000", 2023-10-08T07:07:53.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.893410+0000", 2023-10-08T07:07:53.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.53e-07 2023-10-08T07:07:53.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.893428+0000", 2023-10-08T07:07:53.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7706999999999998e-05 2023-10-08T07:07:53.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.893433+0000", 2023-10-08T07:07:53.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7409999999999998e-06 2023-10-08T07:07:53.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.893438+0000", 2023-10-08T07:07:53.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.605e-06 2023-10-08T07:07:53.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.129 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.130 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171901 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.130 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.020483+0000", 2023-10-08T07:07:53.130 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.296577015, 2023-10-08T07:07:53.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.30751632000000001, 2023-10-08T07:07:53.130 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.130 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.130 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.131 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171901 2023-10-08T07:07:53.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.131 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.020483+0000", 2023-10-08T07:07:53.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.020483+0000", 2023-10-08T07:07:53.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.020484+0000", 2023-10-08T07:07:53.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9299999999999998e-07 2023-10-08T07:07:53.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.020494+0000", 2023-10-08T07:07:53.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9599999999999995e-06 2023-10-08T07:07:53.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.020500+0000", 2023-10-08T07:07:53.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4649999999999999e-06 2023-10-08T07:07:53.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.020505+0000", 2023-10-08T07:07:53.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0819999999999998e-06 2023-10-08T07:07:53.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.134 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.134 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172062 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.134 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.054461+0000", 2023-10-08T07:07:53.134 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26259934699999998, 2023-10-08T07:07:53.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.273599068, 2023-10-08T07:07:53.135 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.135 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.135 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172062 2023-10-08T07:07:53.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.135 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.054461+0000", 2023-10-08T07:07:53.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.054461+0000", 2023-10-08T07:07:53.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.054461+0000", 2023-10-08T07:07:53.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2023-10-08T07:07:53.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.054474+0000", 2023-10-08T07:07:53.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2067e-05 2023-10-08T07:07:53.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.054479+0000", 2023-10-08T07:07:53.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6629999999999998e-06 2023-10-08T07:07:53.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.054484+0000", 2023-10-08T07:07:53.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.566e-06 2023-10-08T07:07:53.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.139 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.139 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.139 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172519 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.139 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.177642+0000", 2023-10-08T07:07:53.139 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.13941816400000001, 2023-10-08T07:07:53.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.15047569299999999, 2023-10-08T07:07:53.139 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.139 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.140 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.140 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.140 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172519 2023-10-08T07:07:53.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.140 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177642+0000", 2023-10-08T07:07:53.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177642+0000", 2023-10-08T07:07:53.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177643+0000", 2023-10-08T07:07:53.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000005e-07 2023-10-08T07:07:53.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177654+0000", 2023-10-08T07:07:53.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1423999999999999e-05 2023-10-08T07:07:53.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177660+0000", 2023-10-08T07:07:53.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8069999999999996e-06 2023-10-08T07:07:53.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177664+0000", 2023-10-08T07:07:53.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4179999999999999e-06 2023-10-08T07:07:53.143 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.143 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.143 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.143 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172666 4.31 4.eecd8371 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.144 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.223420+0000", 2023-10-08T07:07:53.144 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.093640017000000006, 2023-10-08T07:07:53.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.104763467, 2023-10-08T07:07:53.144 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.144 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.144 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172666 2023-10-08T07:07:53.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.145 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.223420+0000", 2023-10-08T07:07:53.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.223420+0000", 2023-10-08T07:07:53.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226251+0000", 2023-10-08T07:07:53.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028301530000000002 2023-10-08T07:07:53.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226268+0000", 2023-10-08T07:07:53.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7745999999999999e-05 2023-10-08T07:07:53.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226276+0000", 2023-10-08T07:07:53.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7870000000000002e-06 2023-10-08T07:07:53.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226282+0000", 2023-10-08T07:07:53.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4110000000000004e-06 2023-10-08T07:07:53.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.148 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.148 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172814 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.148 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.270517+0000", 2023-10-08T07:07:53.148 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.046543372, 2023-10-08T07:07:53.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057728818000000001, 2023-10-08T07:07:53.148 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.148 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.149 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172814 2023-10-08T07:07:53.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.149 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270517+0000", 2023-10-08T07:07:53.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270517+0000", 2023-10-08T07:07:53.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270518+0000", 2023-10-08T07:07:53.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5600000000000001e-07 2023-10-08T07:07:53.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270535+0000", 2023-10-08T07:07:53.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7258999999999999e-05 2023-10-08T07:07:53.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270541+0000", 2023-10-08T07:07:53.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5989999999999998e-06 2023-10-08T07:07:53.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.270547+0000", 2023-10-08T07:07:53.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2789999999999998e-06 2023-10-08T07:07:53.152 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.152 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.152 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.152 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172950 4.9 4.dc9bef09 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.152 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.317483+0000", 2023-10-08T07:07:53.153 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9995775, 2023-10-08T07:07:53.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010831383999999999, 2023-10-08T07:07:53.153 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.153 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.153 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172950 2023-10-08T07:07:53.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.153 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317483+0000", 2023-10-08T07:07:53.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317483+0000", 2023-10-08T07:07:53.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317483+0000", 2023-10-08T07:07:53.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7299999999999996e-07 2023-10-08T07:07:53.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317498+0000", 2023-10-08T07:07:53.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5148e-05 2023-10-08T07:07:53.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317506+0000", 2023-10-08T07:07:53.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4909999999999999e-06 2023-10-08T07:07:53.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317512+0000", 2023-10-08T07:07:53.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.66e-06 2023-10-08T07:07:53.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.156 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.157 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171306 4.28 4:15b6682b:::10000000004.0000000b:head [write 1990656~4096 in=4096b,write 2088960~4096 in=4096b,write 2224128~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.157 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.863412+0000", 2023-10-08T07:07:53.157 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.453648039, 2023-10-08T07:07:53.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.46494116000000002, 2023-10-08T07:07:53.157 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.157 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:53.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.158 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171306 2023-10-08T07:07:53.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.158 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.863412+0000", 2023-10-08T07:07:53.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.863412+0000", 2023-10-08T07:07:53.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.863413+0000", 2023-10-08T07:07:53.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.53e-07 2023-10-08T07:07:53.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.863430+0000", 2023-10-08T07:07:53.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6997e-05 2023-10-08T07:07:53.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.863436+0000", 2023-10-08T07:07:53.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1360000000000002e-06 2023-10-08T07:07:53.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.863441+0000", 2023-10-08T07:07:53.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5990000000000001e-06 2023-10-08T07:07:53.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308768+0000", 2023-10-08T07:07:53.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44532630499999998 2023-10-08T07:07:53.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308828+0000", 2023-10-08T07:07:53.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0605e-05 2023-10-08T07:07:53.162 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.162 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.162 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.162 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171795 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.162 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.990543+0000", 2023-10-08T07:07:53.163 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.32651736599999998, 2023-10-08T07:07:53.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.337848694, 2023-10-08T07:07:53.163 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.163 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.163 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.163 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.163 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.163 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171795 2023-10-08T07:07:53.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.163 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990543+0000", 2023-10-08T07:07:53.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990543+0000", 2023-10-08T07:07:53.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990544+0000", 2023-10-08T07:07:53.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3799999999999997e-07 2023-10-08T07:07:53.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990557+0000", 2023-10-08T07:07:53.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3526999999999999e-05 2023-10-08T07:07:53.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990564+0000", 2023-10-08T07:07:53.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4829999999999996e-06 2023-10-08T07:07:53.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.990569+0000", 2023-10-08T07:07:53.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2719999999999997e-06 2023-10-08T07:07:53.166 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.166 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.167 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172209 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.167 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.099393+0000", 2023-10-08T07:07:53.167 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.21766793600000001, 2023-10-08T07:07:53.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.229050273, 2023-10-08T07:07:53.167 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.167 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.167 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.168 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172209 2023-10-08T07:07:53.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.168 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.099393+0000", 2023-10-08T07:07:53.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.099393+0000", 2023-10-08T07:07:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.099393+0000", 2023-10-08T07:07:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2300000000000001e-07 2023-10-08T07:07:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.099413+0000", 2023-10-08T07:07:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9593e-05 2023-10-08T07:07:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.099420+0000", 2023-10-08T07:07:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9290000000000001e-06 2023-10-08T07:07:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.099425+0000", 2023-10-08T07:07:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5890000000000002e-06 2023-10-08T07:07:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172474 4.19 4.8d5b859 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.163517+0000", 2023-10-08T07:07:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15354379300000001, 2023-10-08T07:07:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.164958992, 2023-10-08T07:07:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172474 2023-10-08T07:07:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163517+0000", 2023-10-08T07:07:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.163517+0000", 2023-10-08T07:07:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.165630+0000", 2023-10-08T07:07:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021132519999999999 2023-10-08T07:07:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.165654+0000", 2023-10-08T07:07:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4172000000000002e-05 2023-10-08T07:07:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.165664+0000", 2023-10-08T07:07:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8830000000000001e-06 2023-10-08T07:07:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.165671+0000", 2023-10-08T07:07:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7859999999999999e-06 2023-10-08T07:07:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172524 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.177670+0000", 2023-10-08T07:07:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.13939032200000001, 2023-10-08T07:07:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.15083700899999999, 2023-10-08T07:07:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172524 2023-10-08T07:07:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177670+0000", 2023-10-08T07:07:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177670+0000", 2023-10-08T07:07:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177671+0000", 2023-10-08T07:07:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3599999999999999e-07 2023-10-08T07:07:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177681+0000", 2023-10-08T07:07:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9499999999999996e-06 2023-10-08T07:07:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177686+0000", 2023-10-08T07:07:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4029999999999998e-06 2023-10-08T07:07:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.177690+0000", 2023-10-08T07:07:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2100000000000003e-06 2023-10-08T07:07:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172573 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.194393+0000", 2023-10-08T07:07:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.122667498, 2023-10-08T07:07:53.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13414463600000001, 2023-10-08T07:07:53.181 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.181 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.181 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172573 2023-10-08T07:07:53.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.194393+0000", 2023-10-08T07:07:53.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.194393+0000", 2023-10-08T07:07:53.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.194393+0000", 2023-10-08T07:07:53.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2899999999999999e-07 2023-10-08T07:07:53.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.194404+0000", 2023-10-08T07:07:53.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0524e-05 2023-10-08T07:07:53.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.194411+0000", 2023-10-08T07:07:53.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3080000000000002e-06 2023-10-08T07:07:53.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.194417+0000", 2023-10-08T07:07:53.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4099999999999999e-06 2023-10-08T07:07:53.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.184 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.185 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172620 4.31 4.c05947b1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.185 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.212406+0000", 2023-10-08T07:07:53.185 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.10465416600000001, 2023-10-08T07:07:53.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.116174233, 2023-10-08T07:07:53.185 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.185 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.186 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172620 2023-10-08T07:07:53.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.186 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212406+0000", 2023-10-08T07:07:53.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212406+0000", 2023-10-08T07:07:53.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212407+0000", 2023-10-08T07:07:53.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3300000000000003e-07 2023-10-08T07:07:53.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212419+0000", 2023-10-08T07:07:53.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2135e-05 2023-10-08T07:07:53.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212425+0000", 2023-10-08T07:07:53.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2910000000000004e-06 2023-10-08T07:07:53.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212430+0000", 2023-10-08T07:07:53.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9089999999999999e-06 2023-10-08T07:07:53.189 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.189 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.189 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.189 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172902 4.19 4.8d5b859 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.189 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.304438+0000", 2023-10-08T07:07:53.189 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012622473, 2023-10-08T07:07:53.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024204458000000002, 2023-10-08T07:07:53.190 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.190 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.190 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.190 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.190 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.190 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172902 2023-10-08T07:07:53.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.190 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304438+0000", 2023-10-08T07:07:53.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304438+0000", 2023-10-08T07:07:53.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304439+0000", 2023-10-08T07:07:53.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8500000000000001e-07 2023-10-08T07:07:53.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304459+0000", 2023-10-08T07:07:53.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0531999999999999e-05 2023-10-08T07:07:53.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304466+0000", 2023-10-08T07:07:53.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8480000000000003e-06 2023-10-08T07:07:53.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304473+0000", 2023-10-08T07:07:53.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2099999999999996e-06 2023-10-08T07:07:53.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.194 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.194 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171363 4.28 4:15b6682b:::10000000004.0000000b:head [write 1228800~4096 in=4096b,write 1421312~4096 in=4096b,write 1892352~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.194 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.884509+0000", 2023-10-08T07:07:53.194 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.43255149999999998, 2023-10-08T07:07:53.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44420715199999999, 2023-10-08T07:07:53.194 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.194 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:53.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.195 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.195 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171363 2023-10-08T07:07:53.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.195 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.884509+0000", 2023-10-08T07:07:53.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.884509+0000", 2023-10-08T07:07:53.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.884510+0000", 2023-10-08T07:07:53.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7800000000000001e-07 2023-10-08T07:07:53.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.884522+0000", 2023-10-08T07:07:53.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2462e-05 2023-10-08T07:07:53.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.884529+0000", 2023-10-08T07:07:53.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.737e-06 2023-10-08T07:07:53.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.884534+0000", 2023-10-08T07:07:53.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0300000000000001e-06 2023-10-08T07:07:53.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.326164+0000", 2023-10-08T07:07:53.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.44163008500000001 2023-10-08T07:07:53.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.326238+0000", 2023-10-08T07:07:53.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4581999999999998e-05 2023-10-08T07:07:53.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.200 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172320 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.200 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.124392+0000", 2023-10-08T07:07:53.200 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.19266840800000001, 2023-10-08T07:07:53.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.20440030300000001, 2023-10-08T07:07:53.200 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.201 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172320 2023-10-08T07:07:53.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.201 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.124392+0000", 2023-10-08T07:07:53.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.124392+0000", 2023-10-08T07:07:53.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.126321+0000", 2023-10-08T07:07:53.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019284759999999999 2023-10-08T07:07:53.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.126334+0000", 2023-10-08T07:07:53.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3474e-05 2023-10-08T07:07:53.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.126346+0000", 2023-10-08T07:07:53.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1749000000000001e-05 2023-10-08T07:07:53.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.126354+0000", 2023-10-08T07:07:53.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7840000000000004e-06 2023-10-08T07:07:53.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.204 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.204 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172475 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.204 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.165683+0000", 2023-10-08T07:07:53.204 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15137741900000001, 2023-10-08T07:07:53.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.16317590900000001, 2023-10-08T07:07:53.205 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.205 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.205 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172475 2023-10-08T07:07:53.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.205 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.165683+0000", 2023-10-08T07:07:53.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.165683+0000", 2023-10-08T07:07:53.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.165683+0000", 2023-10-08T07:07:53.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.63e-07 2023-10-08T07:07:53.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.165696+0000", 2023-10-08T07:07:53.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.205e-05 2023-10-08T07:07:53.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.165702+0000", 2023-10-08T07:07:53.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2979999999999997e-06 2023-10-08T07:07:53.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.165707+0000", 2023-10-08T07:07:53.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1220000000000003e-06 2023-10-08T07:07:53.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.208 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.209 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172668 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.209 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.226352+0000", 2023-10-08T07:07:53.209 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.090708439000000002, 2023-10-08T07:07:53.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.102575166, 2023-10-08T07:07:53.209 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.209 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.210 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172668 2023-10-08T07:07:53.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.210 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226352+0000", 2023-10-08T07:07:53.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226352+0000", 2023-10-08T07:07:53.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226353+0000", 2023-10-08T07:07:53.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4000000000000002e-07 2023-10-08T07:07:53.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226373+0000", 2023-10-08T07:07:53.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0381999999999999e-05 2023-10-08T07:07:53.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226383+0000", 2023-10-08T07:07:53.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0045e-05 2023-10-08T07:07:53.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226389+0000", 2023-10-08T07:07:53.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1319999999999999e-06 2023-10-08T07:07:53.213 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.213 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.213 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.213 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172721 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.213 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.238206+0000", 2023-10-08T07:07:53.213 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.078854579999999994, 2023-10-08T07:07:53.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.090781387000000005, 2023-10-08T07:07:53.214 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.214 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.214 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.214 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.214 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.214 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172721 2023-10-08T07:07:53.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.214 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238206+0000", 2023-10-08T07:07:53.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238206+0000", 2023-10-08T07:07:53.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238206+0000", 2023-10-08T07:07:53.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5299999999999999e-07 2023-10-08T07:07:53.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238221+0000", 2023-10-08T07:07:53.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4217e-05 2023-10-08T07:07:53.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238227+0000", 2023-10-08T07:07:53.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2023-10-08T07:07:53.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238232+0000", 2023-10-08T07:07:53.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1189999999999996e-06 2023-10-08T07:07:53.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.217 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.218 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172773 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.218 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.253349+0000", 2023-10-08T07:07:53.218 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.063711092999999996, 2023-10-08T07:07:53.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.075696431999999994, 2023-10-08T07:07:53.218 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.218 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.219 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.219 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172773 2023-10-08T07:07:53.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.219 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.253349+0000", 2023-10-08T07:07:53.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.253349+0000", 2023-10-08T07:07:53.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.253350+0000", 2023-10-08T07:07:53.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2023-10-08T07:07:53.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.253363+0000", 2023-10-08T07:07:53.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2955999999999999e-05 2023-10-08T07:07:53.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.253372+0000", 2023-10-08T07:07:53.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0739999999999999e-06 2023-10-08T07:07:53.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.253377+0000", 2023-10-08T07:07:53.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3489999999999999e-06 2023-10-08T07:07:53.222 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.222 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.222 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.222 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172956 4.3b 4:df82de1b:::10000000004.0000000f:head [write 159744~4096 in=4096b,write 176128~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.222 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.317554+0000", 2023-10-08T07:07:53.223 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999506, 2023-10-08T07:07:53.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011553808, 2023-10-08T07:07:53.223 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.223 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:53.223 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.223 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.223 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.223 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172956 2023-10-08T07:07:53.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.223 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317554+0000", 2023-10-08T07:07:53.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317554+0000", 2023-10-08T07:07:53.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317555+0000", 2023-10-08T07:07:53.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7599999999999997e-07 2023-10-08T07:07:53.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317574+0000", 2023-10-08T07:07:53.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9216999999999999e-05 2023-10-08T07:07:53.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317581+0000", 2023-10-08T07:07:53.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7800000000000003e-06 2023-10-08T07:07:53.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317586+0000", 2023-10-08T07:07:53.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3959999999999997e-06 2023-10-08T07:07:53.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.324971+0000", 2023-10-08T07:07:53.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073849809999999997 2023-10-08T07:07:53.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.325051+0000", 2023-10-08T07:07:53.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.949e-05 2023-10-08T07:07:53.227 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.227 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.228 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.228 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172669 4.21 4.5d9f5e61 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.228 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.226398+0000", 2023-10-08T07:07:53.228 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.090662312999999994, 2023-10-08T07:07:53.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.102778736, 2023-10-08T07:07:53.228 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.228 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.229 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.229 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.229 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172669 2023-10-08T07:07:53.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.229 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226398+0000", 2023-10-08T07:07:53.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226398+0000", 2023-10-08T07:07:53.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226399+0000", 2023-10-08T07:07:53.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8999999999999997e-07 2023-10-08T07:07:53.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226419+0000", 2023-10-08T07:07:53.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0295000000000001e-05 2023-10-08T07:07:53.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226428+0000", 2023-10-08T07:07:53.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7069999999999998e-06 2023-10-08T07:07:53.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226434+0000", 2023-10-08T07:07:53.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0109999999999997e-06 2023-10-08T07:07:53.232 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.232 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.232 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.232 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172722 4.9 4.dc9bef09 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.233 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.238240+0000", 2023-10-08T07:07:53.233 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.078820072000000005, 2023-10-08T07:07:53.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.090989127000000003, 2023-10-08T07:07:53.233 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.233 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.233 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.233 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.233 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.233 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172722 2023-10-08T07:07:53.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.233 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238240+0000", 2023-10-08T07:07:53.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238240+0000", 2023-10-08T07:07:53.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238241+0000", 2023-10-08T07:07:53.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0299999999999999e-07 2023-10-08T07:07:53.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238254+0000", 2023-10-08T07:07:53.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3295999999999999e-05 2023-10-08T07:07:53.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238260+0000", 2023-10-08T07:07:53.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7529999999999998e-06 2023-10-08T07:07:53.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.238265+0000", 2023-10-08T07:07:53.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0270000000000003e-06 2023-10-08T07:07:53.236 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.237 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.237 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172849 4.29 4.49c68429 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.237 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.290409+0000", 2023-10-08T07:07:53.237 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026651930000000001, 2023-10-08T07:07:53.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.038873841999999999, 2023-10-08T07:07:53.237 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.237 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.238 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172849 2023-10-08T07:07:53.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.238 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290409+0000", 2023-10-08T07:07:53.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290409+0000", 2023-10-08T07:07:53.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290409+0000", 2023-10-08T07:07:53.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.08e-07 2023-10-08T07:07:53.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290422+0000", 2023-10-08T07:07:53.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2925000000000001e-05 2023-10-08T07:07:53.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290429+0000", 2023-10-08T07:07:53.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0960000000000003e-06 2023-10-08T07:07:53.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290434+0000", 2023-10-08T07:07:53.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.198e-06 2023-10-08T07:07:53.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.241 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.241 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172905 4.19 4.c7f564d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.242 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.304526+0000", 2023-10-08T07:07:53.242 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012534429, 2023-10-08T07:07:53.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024819341000000002, 2023-10-08T07:07:53.242 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.242 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.242 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172905 2023-10-08T07:07:53.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.243 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304526+0000", 2023-10-08T07:07:53.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304526+0000", 2023-10-08T07:07:53.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304527+0000", 2023-10-08T07:07:53.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6400000000000002e-07 2023-10-08T07:07:53.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304541+0000", 2023-10-08T07:07:53.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4728e-05 2023-10-08T07:07:53.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304548+0000", 2023-10-08T07:07:53.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1400000000000002e-06 2023-10-08T07:07:53.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304554+0000", 2023-10-08T07:07:53.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5770000000000001e-06 2023-10-08T07:07:53.246 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.246 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.246 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.246 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172957 4.9 4.dc9bef09 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.246 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.317594+0000", 2023-10-08T07:07:53.246 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9994669, 2023-10-08T07:07:53.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011805952, 2023-10-08T07:07:53.246 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.247 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.247 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.247 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.247 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.247 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172957 2023-10-08T07:07:53.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.247 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317594+0000", 2023-10-08T07:07:53.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317594+0000", 2023-10-08T07:07:53.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317594+0000", 2023-10-08T07:07:53.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6400000000000003e-07 2023-10-08T07:07:53.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317612+0000", 2023-10-08T07:07:53.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7978e-05 2023-10-08T07:07:53.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317619+0000", 2023-10-08T07:07:53.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1289999999999998e-06 2023-10-08T07:07:53.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317625+0000", 2023-10-08T07:07:53.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4970000000000001e-06 2023-10-08T07:07:53.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.250 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.251 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171701 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.251 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.967491+0000", 2023-10-08T07:07:53.251 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.34956937799999999, 2023-10-08T07:07:53.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.361960858, 2023-10-08T07:07:53.251 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.251 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.251 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171701 2023-10-08T07:07:53.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.252 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.967491+0000", 2023-10-08T07:07:53.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.967491+0000", 2023-10-08T07:07:53.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.967491+0000", 2023-10-08T07:07:53.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.65e-07 2023-10-08T07:07:53.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.967506+0000", 2023-10-08T07:07:53.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4958e-05 2023-10-08T07:07:53.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.967513+0000", 2023-10-08T07:07:53.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1739999999999997e-06 2023-10-08T07:07:53.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.967518+0000", 2023-10-08T07:07:53.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0860000000000001e-06 2023-10-08T07:07:53.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.255 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.255 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172576 4.9 4.dc9bef09 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.255 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.194464+0000", 2023-10-08T07:07:53.255 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.122596621, 2023-10-08T07:07:53.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13503915999999999, 2023-10-08T07:07:53.255 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.255 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.256 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172576 2023-10-08T07:07:53.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.256 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.194464+0000", 2023-10-08T07:07:53.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.194464+0000", 2023-10-08T07:07:53.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198311+0000", 2023-10-08T07:07:53.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038472630000000001 2023-10-08T07:07:53.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198336+0000", 2023-10-08T07:07:53.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4535000000000001e-05 2023-10-08T07:07:53.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198346+0000", 2023-10-08T07:07:53.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0732e-05 2023-10-08T07:07:53.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198355+0000", 2023-10-08T07:07:53.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5620000000000004e-06 2023-10-08T07:07:53.259 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.259 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.259 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.260 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172623 4.19 4.8d5b859 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.260 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.212505+0000", 2023-10-08T07:07:53.260 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.104555893, 2023-10-08T07:07:53.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.117049889, 2023-10-08T07:07:53.260 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.260 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.260 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.260 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.261 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172623 2023-10-08T07:07:53.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.261 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212505+0000", 2023-10-08T07:07:53.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212505+0000", 2023-10-08T07:07:53.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212505+0000", 2023-10-08T07:07:53.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.65e-07 2023-10-08T07:07:53.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212518+0000", 2023-10-08T07:07:53.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3412e-05 2023-10-08T07:07:53.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212525+0000", 2023-10-08T07:07:53.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5200000000000003e-06 2023-10-08T07:07:53.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212530+0000", 2023-10-08T07:07:53.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1580000000000004e-06 2023-10-08T07:07:53.264 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.264 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.264 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.264 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172670 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.264 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.226442+0000", 2023-10-08T07:07:53.265 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.090618540999999997, 2023-10-08T07:07:53.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.10316518099999999, 2023-10-08T07:07:53.265 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.265 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.265 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172670 2023-10-08T07:07:53.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.265 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226442+0000", 2023-10-08T07:07:53.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226442+0000", 2023-10-08T07:07:53.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226442+0000", 2023-10-08T07:07:53.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8400000000000004e-07 2023-10-08T07:07:53.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226460+0000", 2023-10-08T07:07:53.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7275e-05 2023-10-08T07:07:53.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226468+0000", 2023-10-08T07:07:53.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9980000000000003e-06 2023-10-08T07:07:53.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226473+0000", 2023-10-08T07:07:53.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5509999999999999e-06 2023-10-08T07:07:53.268 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.268 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.269 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.269 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171957 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.269 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.034383+0000", 2023-10-08T07:07:53.269 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28267779399999998, 2023-10-08T07:07:53.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.29527680099999998, 2023-10-08T07:07:53.269 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.269 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.270 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171957 2023-10-08T07:07:53.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.270 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.034383+0000", 2023-10-08T07:07:53.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.034383+0000", 2023-10-08T07:07:53.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036404+0000", 2023-10-08T07:07:53.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020209640000000001 2023-10-08T07:07:53.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036419+0000", 2023-10-08T07:07:53.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5366000000000002e-05 2023-10-08T07:07:53.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036429+0000", 2023-10-08T07:07:53.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0256e-05 2023-10-08T07:07:53.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036436+0000", 2023-10-08T07:07:53.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9589999999999998e-06 2023-10-08T07:07:53.273 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.273 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.273 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.273 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172268 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.273 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.116032+0000", 2023-10-08T07:07:53.274 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.20102798, 2023-10-08T07:07:53.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.21367935900000001, 2023-10-08T07:07:53.274 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.274 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.274 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.274 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.274 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.274 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172268 2023-10-08T07:07:53.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.274 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.116032+0000", 2023-10-08T07:07:53.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.116032+0000", 2023-10-08T07:07:53.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.116033+0000", 2023-10-08T07:07:53.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.01e-07 2023-10-08T07:07:53.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.116045+0000", 2023-10-08T07:07:53.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2388999999999999e-05 2023-10-08T07:07:53.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.116052+0000", 2023-10-08T07:07:53.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.742e-06 2023-10-08T07:07:53.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.116058+0000", 2023-10-08T07:07:53.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5380000000000002e-06 2023-10-08T07:07:53.279 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.279 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.279 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.279 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172577 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.279 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.198369+0000", 2023-10-08T07:07:53.280 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.118691536, 2023-10-08T07:07:53.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13139514299999999, 2023-10-08T07:07:53.280 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.280 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.280 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.280 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.280 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.280 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172577 2023-10-08T07:07:53.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.280 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198369+0000", 2023-10-08T07:07:53.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198369+0000", 2023-10-08T07:07:53.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198369+0000", 2023-10-08T07:07:53.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6499999999999999e-07 2023-10-08T07:07:53.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198383+0000", 2023-10-08T07:07:53.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3281999999999999e-05 2023-10-08T07:07:53.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198390+0000", 2023-10-08T07:07:53.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3919999999999997e-06 2023-10-08T07:07:53.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198396+0000", 2023-10-08T07:07:53.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7200000000000003e-06 2023-10-08T07:07:53.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.284 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.284 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172625 4.21 4.5d9f5e61 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.284 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.212537+0000", 2023-10-08T07:07:53.284 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.104523914, 2023-10-08T07:07:53.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.11728040000000001, 2023-10-08T07:07:53.284 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.284 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.285 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172625 2023-10-08T07:07:53.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.285 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212537+0000", 2023-10-08T07:07:53.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212537+0000", 2023-10-08T07:07:53.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212537+0000", 2023-10-08T07:07:53.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0699999999999998e-07 2023-10-08T07:07:53.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212549+0000", 2023-10-08T07:07:53.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1756999999999999e-05 2023-10-08T07:07:53.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212554+0000", 2023-10-08T07:07:53.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5160000000000002e-06 2023-10-08T07:07:53.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.212559+0000", 2023-10-08T07:07:53.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8389999999999997e-06 2023-10-08T07:07:53.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.288 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.288 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172778 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.289 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.255350+0000", 2023-10-08T07:07:53.289 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.061710406000000002, 2023-10-08T07:07:53.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.074519919000000004, 2023-10-08T07:07:53.289 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.289 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.289 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172778 2023-10-08T07:07:53.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.290 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.255350+0000", 2023-10-08T07:07:53.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.255350+0000", 2023-10-08T07:07:53.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.255351+0000", 2023-10-08T07:07:53.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1500000000000005e-07 2023-10-08T07:07:53.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.255364+0000", 2023-10-08T07:07:53.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3346000000000001e-05 2023-10-08T07:07:53.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.255372+0000", 2023-10-08T07:07:53.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8720000000000002e-06 2023-10-08T07:07:53.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.255378+0000", 2023-10-08T07:07:53.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0569999999999998e-06 2023-10-08T07:07:53.292 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.293 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.293 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172959 4.19 4.c7f564d9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.293 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.317668+0000", 2023-10-08T07:07:53.293 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999393, 2023-10-08T07:07:53.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012257217000000001, 2023-10-08T07:07:53.293 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.293 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.294 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172959 2023-10-08T07:07:53.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.294 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317668+0000", 2023-10-08T07:07:53.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317668+0000", 2023-10-08T07:07:53.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317668+0000", 2023-10-08T07:07:53.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8500000000000002e-07 2023-10-08T07:07:53.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317681+0000", 2023-10-08T07:07:53.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2951e-05 2023-10-08T07:07:53.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317688+0000", 2023-10-08T07:07:53.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3860000000000001e-06 2023-10-08T07:07:53.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317694+0000", 2023-10-08T07:07:53.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5840000000000002e-06 2023-10-08T07:07:53.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.297 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.297 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171803 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.298 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.992380+0000", 2023-10-08T07:07:53.298 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.32468005500000002, 2023-10-08T07:07:53.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.33759558899999997, 2023-10-08T07:07:53.298 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.298 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171803 2023-10-08T07:07:53.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.299 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.992380+0000", 2023-10-08T07:07:53.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.992380+0000", 2023-10-08T07:07:53.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.992381+0000", 2023-10-08T07:07:53.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3000000000000001e-07 2023-10-08T07:07:53.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.992393+0000", 2023-10-08T07:07:53.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.19e-05 2023-10-08T07:07:53.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.992401+0000", 2023-10-08T07:07:53.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8320000000000006e-06 2023-10-08T07:07:53.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.992406+0000", 2023-10-08T07:07:53.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0089999999999998e-06 2023-10-08T07:07:53.301 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.302 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.302 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172419 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.302 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.159367+0000", 2023-10-08T07:07:53.302 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.15769382500000001, 2023-10-08T07:07:53.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.170660545, 2023-10-08T07:07:53.302 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.302 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.303 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172419 2023-10-08T07:07:53.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.303 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.159367+0000", 2023-10-08T07:07:53.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.159367+0000", 2023-10-08T07:07:53.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162550+0000", 2023-10-08T07:07:53.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031834810000000002 2023-10-08T07:07:53.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162569+0000", 2023-10-08T07:07:53.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8410000000000002e-05 2023-10-08T07:07:53.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162583+0000", 2023-10-08T07:07:53.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4372999999999999e-05 2023-10-08T07:07:53.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162592+0000", 2023-10-08T07:07:53.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2390000000000008e-06 2023-10-08T07:07:53.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.306 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.307 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172580 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.307 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.198404+0000", 2023-10-08T07:07:53.307 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.11865618, 2023-10-08T07:07:53.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.13167400200000001, 2023-10-08T07:07:53.307 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.307 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.307 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172580 2023-10-08T07:07:53.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.308 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198404+0000", 2023-10-08T07:07:53.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198404+0000", 2023-10-08T07:07:53.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198405+0000", 2023-10-08T07:07:53.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4099999999999999e-07 2023-10-08T07:07:53.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198417+0000", 2023-10-08T07:07:53.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1925e-05 2023-10-08T07:07:53.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198423+0000", 2023-10-08T07:07:53.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5030000000000002e-06 2023-10-08T07:07:53.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.198429+0000", 2023-10-08T07:07:53.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4319999999999998e-06 2023-10-08T07:07:53.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.311 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.311 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172674 4.19 4.8d5b859 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.311 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.226518+0000", 2023-10-08T07:07:53.311 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.090542511000000006, 2023-10-08T07:07:53.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.103611251, 2023-10-08T07:07:53.312 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.312 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.312 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172674 2023-10-08T07:07:53.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.312 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226518+0000", 2023-10-08T07:07:53.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226518+0000", 2023-10-08T07:07:53.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226518+0000", 2023-10-08T07:07:53.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1900000000000003e-07 2023-10-08T07:07:53.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226531+0000", 2023-10-08T07:07:53.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2172e-05 2023-10-08T07:07:53.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226535+0000", 2023-10-08T07:07:53.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6500000000000004e-06 2023-10-08T07:07:53.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.226538+0000", 2023-10-08T07:07:53.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1389999999999999e-06 2023-10-08T07:07:53.315 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.315 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.316 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172726 4.21 4.5d9f5e61 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.316 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.242356+0000", 2023-10-08T07:07:53.316 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.074704906000000001, 2023-10-08T07:07:53.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.087825773999999995, 2023-10-08T07:07:53.316 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.316 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.317 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.317 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172726 2023-10-08T07:07:53.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.317 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.242356+0000", 2023-10-08T07:07:53.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.242356+0000", 2023-10-08T07:07:53.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244293+0000", 2023-10-08T07:07:53.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019370730000000001 2023-10-08T07:07:53.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244310+0000", 2023-10-08T07:07:53.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7863000000000002e-05 2023-10-08T07:07:53.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244323+0000", 2023-10-08T07:07:53.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2063e-05 2023-10-08T07:07:53.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244331+0000", 2023-10-08T07:07:53.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6950000000000006e-06 2023-10-08T07:07:53.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.320 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.321 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172779 4.9 4.dc9bef09 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.321 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.255387+0000", 2023-10-08T07:07:53.321 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.061673316999999998, 2023-10-08T07:07:53.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.074849214999999997, 2023-10-08T07:07:53.321 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.321 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.321 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172779 2023-10-08T07:07:53.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.322 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.255387+0000", 2023-10-08T07:07:53.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.255387+0000", 2023-10-08T07:07:53.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.255388+0000", 2023-10-08T07:07:53.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5000000000000003e-07 2023-10-08T07:07:53.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.255402+0000", 2023-10-08T07:07:53.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4617000000000001e-05 2023-10-08T07:07:53.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.255410+0000", 2023-10-08T07:07:53.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2699999999999999e-06 2023-10-08T07:07:53.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.255420+0000", 2023-10-08T07:07:53.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0738e-05 2023-10-08T07:07:53.325 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.325 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.325 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.325 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172855 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.325 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.290506+0000", 2023-10-08T07:07:53.325 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.026554741, 2023-10-08T07:07:53.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.039787217, 2023-10-08T07:07:53.325 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.326 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.326 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.326 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.326 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.326 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172855 2023-10-08T07:07:53.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.326 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290506+0000", 2023-10-08T07:07:53.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290506+0000", 2023-10-08T07:07:53.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290506+0000", 2023-10-08T07:07:53.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2599999999999998e-07 2023-10-08T07:07:53.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290518+0000", 2023-10-08T07:07:53.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1985e-05 2023-10-08T07:07:53.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290526+0000", 2023-10-08T07:07:53.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1009999999999992e-06 2023-10-08T07:07:53.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.290532+0000", 2023-10-08T07:07:53.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.288e-06 2023-10-08T07:07:53.329 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.329 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.329 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.330 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172908 4.11 4.67f7c691 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.330 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.304647+0000", 2023-10-08T07:07:53.330 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012413749999999999, 2023-10-08T07:07:53.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025700120999999999, 2023-10-08T07:07:53.330 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.330 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.330 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.330 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.330 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.331 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172908 2023-10-08T07:07:53.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.331 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304647+0000", 2023-10-08T07:07:53.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304647+0000", 2023-10-08T07:07:53.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304647+0000", 2023-10-08T07:07:53.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2200000000000004e-07 2023-10-08T07:07:53.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304658+0000", 2023-10-08T07:07:53.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1068e-05 2023-10-08T07:07:53.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304665+0000", 2023-10-08T07:07:53.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5719999999999999e-06 2023-10-08T07:07:53.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304671+0000", 2023-10-08T07:07:53.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0220000000000001e-06 2023-10-08T07:07:53.334 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.334 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.334 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.334 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172960 4.7 4:e2d089ed:::10000000004.00000033:head [write 3334144~4096 in=4096b,write 3395584~4096 in=4096b,write 3432448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.334 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.317700+0000", 2023-10-08T07:07:53.334 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9993601, 2023-10-08T07:07:53.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012707232000000001, 2023-10-08T07:07:53.334 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.335 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2023-10-08T07:07:53.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.335 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172960 2023-10-08T07:07:53.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.335 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317700+0000", 2023-10-08T07:07:53.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317700+0000", 2023-10-08T07:07:53.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317701+0000", 2023-10-08T07:07:53.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3500000000000002e-07 2023-10-08T07:07:53.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317719+0000", 2023-10-08T07:07:53.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8019000000000001e-05 2023-10-08T07:07:53.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317726+0000", 2023-10-08T07:07:53.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0079999999999996e-06 2023-10-08T07:07:53.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317732+0000", 2023-10-08T07:07:53.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.852e-06 2023-10-08T07:07:53.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.328722+0000", 2023-10-08T07:07:53.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010989787000000001 2023-10-08T07:07:53.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.328806+0000", 2023-10-08T07:07:53.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4461000000000003e-05 2023-10-08T07:07:53.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.339 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.340 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171415 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.340 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.895426+0000", 2023-10-08T07:07:53.340 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.42163429499999999, 2023-10-08T07:07:53.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.43505473, 2023-10-08T07:07:53.340 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.340 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.340 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171415 2023-10-08T07:07:53.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.341 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.895426+0000", 2023-10-08T07:07:53.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.895426+0000", 2023-10-08T07:07:53.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.895427+0000", 2023-10-08T07:07:53.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9900000000000001e-07 2023-10-08T07:07:53.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.895442+0000", 2023-10-08T07:07:53.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5469999999999999e-05 2023-10-08T07:07:53.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.895449+0000", 2023-10-08T07:07:53.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0099999999999998e-06 2023-10-08T07:07:53.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.895454+0000", 2023-10-08T07:07:53.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1080000000000001e-06 2023-10-08T07:07:53.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.344 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.344 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171463 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.344 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.905582+0000", 2023-10-08T07:07:53.344 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.41147893400000002, 2023-10-08T07:07:53.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.42496108799999999, 2023-10-08T07:07:53.345 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.345 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.345 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171463 2023-10-08T07:07:53.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.345 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.905582+0000", 2023-10-08T07:07:53.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.905582+0000", 2023-10-08T07:07:53.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.907297+0000", 2023-10-08T07:07:53.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001715942 2023-10-08T07:07:53.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.907319+0000", 2023-10-08T07:07:53.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1835999999999999e-05 2023-10-08T07:07:53.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.907332+0000", 2023-10-08T07:07:53.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3057000000000001e-05 2023-10-08T07:07:53.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.907340+0000", 2023-10-08T07:07:53.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3069999999999997e-06 2023-10-08T07:07:53.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.348 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.349 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171513 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.349 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.919333+0000", 2023-10-08T07:07:53.349 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.39772750899999998, 2023-10-08T07:07:53.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.41126349400000001, 2023-10-08T07:07:53.349 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.349 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.350 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171513 2023-10-08T07:07:53.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.350 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.919333+0000", 2023-10-08T07:07:53.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.919333+0000", 2023-10-08T07:07:53.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.919333+0000", 2023-10-08T07:07:53.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6300000000000001e-07 2023-10-08T07:07:53.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.919348+0000", 2023-10-08T07:07:53.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4503e-05 2023-10-08T07:07:53.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.919352+0000", 2023-10-08T07:07:53.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.233e-06 2023-10-08T07:07:53.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.919355+0000", 2023-10-08T07:07:53.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1729999999999999e-06 2023-10-08T07:07:53.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.353 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.353 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171668 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.353 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:51.952149+0000", 2023-10-08T07:07:53.353 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.36491148299999998, 2023-10-08T07:07:53.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.37850165899999999, 2023-10-08T07:07:53.354 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.354 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.354 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.354 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.354 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.354 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171668 2023-10-08T07:07:53.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.354 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.952149+0000", 2023-10-08T07:07:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.952149+0000", 2023-10-08T07:07:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.952149+0000", 2023-10-08T07:07:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.46e-07 2023-10-08T07:07:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.952160+0000", 2023-10-08T07:07:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0971e-05 2023-10-08T07:07:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.952166+0000", 2023-10-08T07:07:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.519e-06 2023-10-08T07:07:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:51.952170+0000", 2023-10-08T07:07:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5839999999999996e-06 2023-10-08T07:07:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:171963 4.10 4.87c6ead0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.036499+0000", 2023-10-08T07:07:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.28056108499999999, 2023-10-08T07:07:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.294203565, 2023-10-08T07:07:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.358 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171963 2023-10-08T07:07:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036499+0000", 2023-10-08T07:07:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036499+0000", 2023-10-08T07:07:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036500+0000", 2023-10-08T07:07:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3499999999999996e-07 2023-10-08T07:07:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036514+0000", 2023-10-08T07:07:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4403000000000001e-05 2023-10-08T07:07:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036522+0000", 2023-10-08T07:07:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4549999999999998e-06 2023-10-08T07:07:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.036527+0000", 2023-10-08T07:07:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.361e-06 2023-10-08T07:07:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172021 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.048359+0000", 2023-10-08T07:07:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.26870187099999998, 2023-10-08T07:07:53.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.28239658299999998, 2023-10-08T07:07:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172021 2023-10-08T07:07:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048359+0000", 2023-10-08T07:07:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048359+0000", 2023-10-08T07:07:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048359+0000", 2023-10-08T07:07:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7700000000000004e-07 2023-10-08T07:07:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048373+0000", 2023-10-08T07:07:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3382e-05 2023-10-08T07:07:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048383+0000", 2023-10-08T07:07:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0149000000000001e-05 2023-10-08T07:07:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.048390+0000", 2023-10-08T07:07:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7319999999999998e-06 2023-10-08T07:07:53.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172270 4.10 4.7070ab10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.116100+0000", 2023-10-08T07:07:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.200960629, 2023-10-08T07:07:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.214708546, 2023-10-08T07:07:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.367 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.368 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.368 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.368 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172270 2023-10-08T07:07:53.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.368 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.116100+0000", 2023-10-08T07:07:53.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.116100+0000", 2023-10-08T07:07:53.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.116100+0000", 2023-10-08T07:07:53.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3799999999999998e-07 2023-10-08T07:07:53.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.116112+0000", 2023-10-08T07:07:53.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1722000000000001e-05 2023-10-08T07:07:53.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.116119+0000", 2023-10-08T07:07:53.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5540000000000003e-06 2023-10-08T07:07:53.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.116124+0000", 2023-10-08T07:07:53.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0950000000000003e-06 2023-10-08T07:07:53.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.371 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.371 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172371 4.11 4:8963efe6:::10000000004.00000009:head [write 753664~4096 in=4096b,write 835584~4096 in=4096b,write 843776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.372 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.145358+0000", 2023-10-08T07:07:53.372 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.17170244800000001, 2023-10-08T07:07:53.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18551293699999999, 2023-10-08T07:07:53.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.372 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2023-10-08T07:07:53.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.372 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172371 2023-10-08T07:07:53.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.373 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.145358+0000", 2023-10-08T07:07:53.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.145358+0000", 2023-10-08T07:07:53.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.145358+0000", 2023-10-08T07:07:53.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.84e-07 2023-10-08T07:07:53.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.145366+0000", 2023-10-08T07:07:53.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1280000000000008e-06 2023-10-08T07:07:53.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.145370+0000", 2023-10-08T07:07:53.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.839e-06 2023-10-08T07:07:53.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.145373+0000", 2023-10-08T07:07:53.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.163e-06 2023-10-08T07:07:53.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.320992+0000", 2023-10-08T07:07:53.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.175618791 2023-10-08T07:07:53.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.321041+0000", 2023-10-08T07:07:53.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8597000000000002e-05 2023-10-08T07:07:53.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:53.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.321127+0000", 2023-10-08T07:07:53.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6150999999999996e-05 2023-10-08T07:07:53.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:53.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.326028+0000", 2023-10-08T07:07:53.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049010190000000004 2023-10-08T07:07:53.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.378 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.378 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172422 4.0 4.6d19fd40 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.378 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.162608+0000", 2023-10-08T07:07:53.379 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.154452689, 2023-10-08T07:07:53.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.16836490700000001, 2023-10-08T07:07:53.379 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.379 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.379 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.379 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172422 2023-10-08T07:07:53.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.379 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162608+0000", 2023-10-08T07:07:53.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162608+0000", 2023-10-08T07:07:53.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162608+0000", 2023-10-08T07:07:53.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2099999999999996e-07 2023-10-08T07:07:53.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162625+0000", 2023-10-08T07:07:53.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6623e-05 2023-10-08T07:07:53.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162633+0000", 2023-10-08T07:07:53.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8450000000000003e-06 2023-10-08T07:07:53.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.162639+0000", 2023-10-08T07:07:53.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2090000000000002e-06 2023-10-08T07:07:53.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.382 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.383 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172478 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.383 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.169870+0000", 2023-10-08T07:07:53.383 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.14719025599999999, 2023-10-08T07:07:53.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.16118054100000001, 2023-10-08T07:07:53.383 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.383 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.384 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172478 2023-10-08T07:07:53.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.384 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169870+0000", 2023-10-08T07:07:53.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169870+0000", 2023-10-08T07:07:53.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169871+0000", 2023-10-08T07:07:53.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6100000000000001e-07 2023-10-08T07:07:53.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169884+0000", 2023-10-08T07:07:53.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3351e-05 2023-10-08T07:07:53.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169890+0000", 2023-10-08T07:07:53.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2369999999999997e-06 2023-10-08T07:07:53.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.169896+0000", 2023-10-08T07:07:53.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5430000000000001e-06 2023-10-08T07:07:53.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.387 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.387 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172534 4.28 4.cb2fb768 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.387 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.182402+0000", 2023-10-08T07:07:53.388 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.134658632, 2023-10-08T07:07:53.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.148711545, 2023-10-08T07:07:53.388 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.388 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172534 2023-10-08T07:07:53.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.388 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.182402+0000", 2023-10-08T07:07:53.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.182402+0000", 2023-10-08T07:07:53.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.182402+0000", 2023-10-08T07:07:53.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0999999999999999e-07 2023-10-08T07:07:53.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.182415+0000", 2023-10-08T07:07:53.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2748999999999999e-05 2023-10-08T07:07:53.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.182425+0000", 2023-10-08T07:07:53.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.499e-06 2023-10-08T07:07:53.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.182430+0000", 2023-10-08T07:07:53.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4260000000000002e-06 2023-10-08T07:07:53.391 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.391 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.392 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172727 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.392 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.244347+0000", 2023-10-08T07:07:53.392 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.072713194999999994, 2023-10-08T07:07:53.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.086836759999999999, 2023-10-08T07:07:53.392 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.392 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.392 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.393 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172727 2023-10-08T07:07:53.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.393 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244347+0000", 2023-10-08T07:07:53.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244347+0000", 2023-10-08T07:07:53.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244348+0000", 2023-10-08T07:07:53.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4700000000000001e-07 2023-10-08T07:07:53.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244364+0000", 2023-10-08T07:07:53.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6201e-05 2023-10-08T07:07:53.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244379+0000", 2023-10-08T07:07:53.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5299e-05 2023-10-08T07:07:53.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.244385+0000", 2023-10-08T07:07:53.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0599999999999996e-06 2023-10-08T07:07:53.396 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.396 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.396 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.396 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172909 4.28 4.d4166da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.397 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.304678+0000", 2023-10-08T07:07:53.397 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012382136, 2023-10-08T07:07:53.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026566185999999999, 2023-10-08T07:07:53.397 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.397 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2023-10-08T07:07:53.397 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.397 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.397 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.397 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172909 2023-10-08T07:07:53.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.398 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304678+0000", 2023-10-08T07:07:53.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.304678+0000", 2023-10-08T07:07:53.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308293+0000", 2023-10-08T07:07:53.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036147639999999999 2023-10-08T07:07:53.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308319+0000", 2023-10-08T07:07:53.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5955000000000001e-05 2023-10-08T07:07:53.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308337+0000", 2023-10-08T07:07:53.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.789e-05 2023-10-08T07:07:53.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.308347+0000", 2023-10-08T07:07:53.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5899999999999997e-06 2023-10-08T07:07:53.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.401 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.401 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:172962 4.3f 4:fc9a2d79:::10000000004.0000002f:head [write 1781760~4096 in=4096b,write 1810432~4096 in=4096b,write 2019328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:53.401 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:52.317739+0000", 2023-10-08T07:07:53.401 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9993219, 2023-10-08T07:07:53.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013580283, 2023-10-08T07:07:53.401 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.402 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2023-10-08T07:07:53.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.402 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.402 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 172962 2023-10-08T07:07:53.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.402 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317739+0000", 2023-10-08T07:07:53.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317739+0000", 2023-10-08T07:07:53.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317739+0000", 2023-10-08T07:07:53.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4000000000000002e-07 2023-10-08T07:07:53.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317756+0000", 2023-10-08T07:07:53.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6718000000000002e-05 2023-10-08T07:07:53.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317762+0000", 2023-10-08T07:07:53.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.618e-06 2023-10-08T07:07:53.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.317768+0000", 2023-10-08T07:07:53.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4369999999999998e-06 2023-10-08T07:07:53.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:52.331270+0000", 2023-10-08T07:07:53.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013501687 2023-10-08T07:07:53.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.406 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.406 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2023-10-08T07:07:53.406 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 245 2023-10-08T07:07:53.406 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:53.408 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:53.409 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-08T07:07:53.409 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T07:07:53.412 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:53.407+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:53.508 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:53.507+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:53.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:53.610 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:53.609+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:53.620 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:53.620 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:53.636 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:53.723 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:53.722+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:53.727 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:53.751 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-08T07:07:53.767 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T07:07:53.812 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:53.810+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:53.827 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:53.827 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:53.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:53.827 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:53.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.827 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147479 4.0 4:02bf98b6:::10000000004.0000000e:head [write 258048~4096,write 442368~4096,write 520192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.827 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:53.828 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.294849285, 2023-10-08T07:07:53.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.462729097, 2023-10-08T07:07:53.828 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.828 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.828 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147479 2023-10-08T07:07:53.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.828 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533313+0000", 2023-10-08T07:07:53.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002832841 2023-10-08T07:07:53.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533338+0000", 2023-10-08T07:07:53.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5052999999999999e-05 2023-10-08T07:07:53.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533350+0000", 2023-10-08T07:07:53.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2561000000000001e-05 2023-10-08T07:07:53.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533357+0000", 2023-10-08T07:07:53.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0870000000000001e-06 2023-10-08T07:07:53.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963719+0000", 2023-10-08T07:07:53.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4303612779999999 2023-10-08T07:07:53.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963788+0000", 2023-10-08T07:07:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9751000000000004e-05 2023-10-08T07:07:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963941+0000", 2023-10-08T07:07:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015224499999999999 2023-10-08T07:07:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.971897+0000", 2023-10-08T07:07:53.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079562769999999994 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993080+0000", 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021183400000000002 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993161+0000", 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1045999999999996e-05 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993209+0000", 2023-10-08T07:07:53.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7558000000000001e-05 2023-10-08T07:07:53.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.834 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.834 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.834 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147519 4.10 4:08d50e0e:::10000000004.0000003f:head [write 258048~4096,write 417792~4096,write 1318912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.834 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:53.834 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.283828247000001, 2023-10-08T07:07:53.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.467910235, 2023-10-08T07:07:53.835 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.835 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.835 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147519 2023-10-08T07:07:53.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.835 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:53.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5199999999999998e-07 2023-10-08T07:07:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541510+0000", 2023-10-08T07:07:53.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4690000000000003e-06 2023-10-08T07:07:53.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541515+0000", 2023-10-08T07:07:53.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7260000000000002e-06 2023-10-08T07:07:53.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541518+0000", 2023-10-08T07:07:53.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7329999999999999e-06 2023-10-08T07:07:53.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.977538+0000", 2023-10-08T07:07:53.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.436020313 2023-10-08T07:07:53.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.977630+0000", 2023-10-08T07:07:53.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1893999999999998e-05 2023-10-08T07:07:53.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009278+0000", 2023-10-08T07:07:53.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.031647661000000001 2023-10-08T07:07:53.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009334+0000", 2023-10-08T07:07:53.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6366999999999998e-05 2023-10-08T07:07:53.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009411+0000", 2023-10-08T07:07:53.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.682e-05 2023-10-08T07:07:53.840 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.840 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.840 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.840 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147523 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2183168~4096,write 2215936~4096,write 2228224~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.840 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:53.840 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.283787154000001, 2023-10-08T07:07:53.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4714357950000001, 2023-10-08T07:07:53.840 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147523 2023-10-08T07:07:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2023-10-08T07:07:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541554+0000", 2023-10-08T07:07:53.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1515000000000001e-05 2023-10-08T07:07:53.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541557+0000", 2023-10-08T07:07:53.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.675e-06 2023-10-08T07:07:53.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541560+0000", 2023-10-08T07:07:53.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.841e-06 2023-10-08T07:07:53.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980499+0000", 2023-10-08T07:07:53.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.43893866 2023-10-08T07:07:53.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980591+0000", 2023-10-08T07:07:53.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1970000000000002e-05 2023-10-08T07:07:53.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:53.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980759+0000", 2023-10-08T07:07:53.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016861099999999999 2023-10-08T07:07:53.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:53.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993040+0000", 2023-10-08T07:07:53.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012280798000000001 2023-10-08T07:07:53.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012884+0000", 2023-10-08T07:07:53.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019843573 2023-10-08T07:07:53.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012938+0000", 2023-10-08T07:07:53.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4462000000000001e-05 2023-10-08T07:07:53.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012978+0000", 2023-10-08T07:07:53.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9455000000000001e-05 2023-10-08T07:07:53.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.847 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.847 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147525 4.28 4:16edf4d3:::10000000004.00000027:head [write 1671168~4096,write 1994752~4096,write 2002944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.847 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:53.847 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.283508894000001, 2023-10-08T07:07:53.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4828482860000001, 2023-10-08T07:07:53.847 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.847 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.848 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.848 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147525 2023-10-08T07:07:53.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.848 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:53.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:53.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545293+0000", 2023-10-08T07:07:53.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034732809999999999 2023-10-08T07:07:53.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545312+0000", 2023-10-08T07:07:53.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8156999999999999e-05 2023-10-08T07:07:53.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545323+0000", 2023-10-08T07:07:53.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1215e-05 2023-10-08T07:07:53.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545331+0000", 2023-10-08T07:07:53.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2859999999999999e-06 2023-10-08T07:07:53.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.998284+0000", 2023-10-08T07:07:53.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4529525249999999 2023-10-08T07:07:53.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.998394+0000", 2023-10-08T07:07:53.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000110214 2023-10-08T07:07:53.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024519+0000", 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026125603000000001 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024578+0000", 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8779000000000001e-05 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024668+0000", 2023-10-08T07:07:53.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0226e-05 2023-10-08T07:07:53.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.853 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.853 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147529 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3813376~4096,write 3833856~4096,write 3846144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.853 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:53.853 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.279947583, 2023-10-08T07:07:53.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4795143450000001, 2023-10-08T07:07:53.853 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.853 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.853 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147529 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:53.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545382+0000", 2023-10-08T07:07:53.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2023-10-08T07:07:53.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545394+0000", 2023-10-08T07:07:53.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1969e-05 2023-10-08T07:07:53.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545403+0000", 2023-10-08T07:07:53.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7460000000000006e-06 2023-10-08T07:07:53.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545408+0000", 2023-10-08T07:07:53.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6749999999999999e-06 2023-10-08T07:07:53.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.999994+0000", 2023-10-08T07:07:53.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4545859759999999 2023-10-08T07:07:53.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.000091+0000", 2023-10-08T07:07:53.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6803000000000001e-05 2023-10-08T07:07:53.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024769+0000", 2023-10-08T07:07:53.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024677977 2023-10-08T07:07:53.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024819+0000", 2023-10-08T07:07:53.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.02e-05 2023-10-08T07:07:53.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024896+0000", 2023-10-08T07:07:53.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6447999999999997e-05 2023-10-08T07:07:53.858 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.858 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.859 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147541 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3600384~4096,write 3616768~4096,write 3747840~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.859 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:53.859 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.277943228, 2023-10-08T07:07:53.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478191619, 2023-10-08T07:07:53.859 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.859 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.859 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.859 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.859 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.860 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147541 2023-10-08T07:07:53.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.860 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:53.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:53.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1899999999999998e-07 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547397+0000", 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1263999999999999e-05 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547401+0000", 2023-10-08T07:07:53.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7409999999999998e-06 2023-10-08T07:07:53.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547404+0000", 2023-10-08T07:07:53.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9890000000000001e-06 2023-10-08T07:07:53.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.004793+0000", 2023-10-08T07:07:53.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.457389024 2023-10-08T07:07:53.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.004869+0000", 2023-10-08T07:07:53.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6027999999999998e-05 2023-10-08T07:07:53.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:53.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005024+0000", 2023-10-08T07:07:53.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015473799999999999 2023-10-08T07:07:53.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024718+0000", 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019694555999999998 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024905+0000", 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018695800000000001 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025500+0000", 2023-10-08T07:07:53.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00059492300000000002 2023-10-08T07:07:53.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025577+0000", 2023-10-08T07:07:53.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7078999999999998e-05 2023-10-08T07:07:53.865 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.865 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.865 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.865 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147542 4.28 4:15b6682b:::10000000004.0000000b:head [write 1032192~4096,write 1110016~4096,write 1138688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.865 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:53.866 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.277920499, 2023-10-08T07:07:53.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478297658, 2023-10-08T07:07:53.866 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.866 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.866 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.866 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147542 2023-10-08T07:07:53.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.866 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:53.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:53.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549299+0000", 2023-10-08T07:07:53.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018905650000000001 2023-10-08T07:07:53.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549316+0000", 2023-10-08T07:07:53.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7065999999999999e-05 2023-10-08T07:07:53.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549327+0000", 2023-10-08T07:07:53.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0573e-05 2023-10-08T07:07:53.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549335+0000", 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9410000000000007e-06 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005115+0000", 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.455780069 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005188+0000", 2023-10-08T07:07:53.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3668e-05 2023-10-08T07:07:53.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025587+0000", 2023-10-08T07:07:53.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020398199999999998 2023-10-08T07:07:53.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025640+0000", 2023-10-08T07:07:53.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2023-10-08T07:07:53.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025706+0000", 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6589999999999998e-05 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147545 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3223552~4096,write 3239936~4096,write 3317760~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.275931693, 2023-10-08T07:07:53.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.485135557, 2023-10-08T07:07:53.872 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.872 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.872 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.872 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147545 2023-10-08T07:07:53.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.872 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:53.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:53.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549407+0000", 2023-10-08T07:07:53.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103e-05 2023-10-08T07:07:53.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549421+0000", 2023-10-08T07:07:53.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3995999999999999e-05 2023-10-08T07:07:53.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549430+0000", 2023-10-08T07:07:53.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3329999999999997e-06 2023-10-08T07:07:53.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549443+0000", 2023-10-08T07:07:53.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3492000000000001e-05 2023-10-08T07:07:53.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009122+0000", 2023-10-08T07:07:53.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4596791790000001 2023-10-08T07:07:53.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009194+0000", 2023-10-08T07:07:53.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1960999999999998e-05 2023-10-08T07:07:53.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:53.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009336+0000", 2023-10-08T07:07:53.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014156999999999999 2023-10-08T07:07:53.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:53.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025872+0000", 2023-10-08T07:07:53.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016536417000000001 2023-10-08T07:07:53.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034437+0000", 2023-10-08T07:07:53.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085645029999999994 2023-10-08T07:07:53.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034492+0000", 2023-10-08T07:07:53.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4688999999999998e-05 2023-10-08T07:07:53.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034533+0000", 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1313999999999998e-05 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147579 4.28 4:15b6682b:::10000000004.0000000b:head [write 3035136~8192,write 3059712~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.261984656999999, 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.462488893, 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.878 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.879 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.879 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147579 2023-10-08T07:07:53.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.879 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:53.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:53.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563345+0000", 2023-10-08T07:07:53.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000005e-07 2023-10-08T07:07:53.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563359+0000", 2023-10-08T07:07:53.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4199000000000001e-05 2023-10-08T07:07:53.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563366+0000", 2023-10-08T07:07:53.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8619999999999997e-06 2023-10-08T07:07:53.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563371+0000", 2023-10-08T07:07:53.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4060000000000004e-06 2023-10-08T07:07:53.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009484+0000", 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4461131300000001 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009562+0000", 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8046999999999993e-05 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025714+0000", 2023-10-08T07:07:53.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016151327 2023-10-08T07:07:53.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025754+0000", 2023-10-08T07:07:53.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0049000000000002e-05 2023-10-08T07:07:53.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025833+0000", 2023-10-08T07:07:53.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9395999999999997e-05 2023-10-08T07:07:53.883 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.883 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.884 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.884 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147591 4.28 4:16edf4d3:::10000000004.00000027:head [write 684032~4096,write 741376~4096,write 765952~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.884 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:53.884 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.257885792, 2023-10-08T07:07:53.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4805182619999999, 2023-10-08T07:07:53.884 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.884 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.884 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.884 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.884 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147591 2023-10-08T07:07:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:53.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567444+0000", 2023-10-08T07:07:53.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8500000000000001e-07 2023-10-08T07:07:53.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567456+0000", 2023-10-08T07:07:53.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2221e-05 2023-10-08T07:07:53.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567463+0000", 2023-10-08T07:07:53.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.652e-06 2023-10-08T07:07:53.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567468+0000", 2023-10-08T07:07:53.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8500000000000002e-06 2023-10-08T07:07:53.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025908+0000", 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.458440948 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.026004+0000", 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5805999999999997e-05 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047842+0000", 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021837770999999999 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047894+0000", 2023-10-08T07:07:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2079000000000001e-05 2023-10-08T07:07:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047961+0000", 2023-10-08T07:07:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7349999999999997e-05 2023-10-08T07:07:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.890 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147596 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2379776~4096,write 2428928~4096,write 2531328~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.890 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:53.890 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.255974169, 2023-10-08T07:07:53.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478728255, 2023-10-08T07:07:53.890 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.890 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.890 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.890 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147596 2023-10-08T07:07:53.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.891 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:53.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:53.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571294+0000", 2023-10-08T07:07:53.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001939037 2023-10-08T07:07:53.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571314+0000", 2023-10-08T07:07:53.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9791000000000001e-05 2023-10-08T07:07:53.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571327+0000", 2023-10-08T07:07:53.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3078000000000001e-05 2023-10-08T07:07:53.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571334+0000", 2023-10-08T07:07:53.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2429999999999999e-06 2023-10-08T07:07:53.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.028808+0000", 2023-10-08T07:07:53.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4574743030000001 2023-10-08T07:07:53.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.028888+0000", 2023-10-08T07:07:53.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9818e-05 2023-10-08T07:07:53.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047970+0000", 2023-10-08T07:07:53.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019082359 2023-10-08T07:07:53.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048017+0000", 2023-10-08T07:07:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6943000000000001e-05 2023-10-08T07:07:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048083+0000", 2023-10-08T07:07:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5683000000000001e-05 2023-10-08T07:07:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.896 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147608 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3088384~4096,write 3145728~4096,write 3276800~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.896 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:53.896 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.247937883000001, 2023-10-08T07:07:53.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4708017579999999, 2023-10-08T07:07:53.896 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.896 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.896 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147608 2023-10-08T07:07:53.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.896 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577392+0000", 2023-10-08T07:07:53.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2023-10-08T07:07:53.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577404+0000", 2023-10-08T07:07:53.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2544999999999999e-05 2023-10-08T07:07:53.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577411+0000", 2023-10-08T07:07:53.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4219999999999997e-06 2023-10-08T07:07:53.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577416+0000", 2023-10-08T07:07:53.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9729999999999997e-06 2023-10-08T07:07:53.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031697+0000", 2023-10-08T07:07:53.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.454281656 2023-10-08T07:07:53.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031771+0000", 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3440000000000002e-05 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048095+0000", 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016324241999999999 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048134+0000", 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9558999999999999e-05 2023-10-08T07:07:53.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048193+0000", 2023-10-08T07:07:53.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8409999999999998e-05 2023-10-08T07:07:53.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.901 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.901 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.901 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147614 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2973696~4096,write 3149824~4096,write 3158016~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.901 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:53.901 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.245947485, 2023-10-08T07:07:53.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4709725659999999, 2023-10-08T07:07:53.902 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.902 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.902 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.902 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147614 2023-10-08T07:07:53.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.902 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.51e-07 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579394+0000", 2023-10-08T07:07:53.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.207e-05 2023-10-08T07:07:53.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579401+0000", 2023-10-08T07:07:53.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3900000000000004e-06 2023-10-08T07:07:53.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579406+0000", 2023-10-08T07:07:53.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9490000000000004e-06 2023-10-08T07:07:53.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031686+0000", 2023-10-08T07:07:53.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4522797299999999 2023-10-08T07:07:53.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031763+0000", 2023-10-08T07:07:53.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6432000000000003e-05 2023-10-08T07:07:53.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:53.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031910+0000", 2023-10-08T07:07:53.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014741900000000001 2023-10-08T07:07:53.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048090+0000", 2023-10-08T07:07:53.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016179948999999999 2023-10-08T07:07:53.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:53.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050261+0000", 2023-10-08T07:07:53.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021715860000000001 2023-10-08T07:07:53.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050320+0000", 2023-10-08T07:07:53.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8217999999999997e-05 2023-10-08T07:07:53.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050354+0000", 2023-10-08T07:07:53.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4372000000000002e-05 2023-10-08T07:07:53.908 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.908 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.908 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.908 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147623 4.28 4:16edf4d3:::10000000004.00000027:head [write 1306624~4096,write 1331200~4096,write 1429504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.908 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:53.908 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.245824299000001, 2023-10-08T07:07:53.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.497941188, 2023-10-08T07:07:53.908 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.908 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147623 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:53.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582310+0000", 2023-10-08T07:07:53.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028050800000000002 2023-10-08T07:07:53.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582327+0000", 2023-10-08T07:07:53.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6807e-05 2023-10-08T07:07:53.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582337+0000", 2023-10-08T07:07:53.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0454e-05 2023-10-08T07:07:53.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582344+0000", 2023-10-08T07:07:53.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2239999999999998e-06 2023-10-08T07:07:53.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.052947+0000", 2023-10-08T07:07:53.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4706025979999999 2023-10-08T07:07:53.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.053025+0000", 2023-10-08T07:07:53.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7985000000000006e-05 2023-10-08T07:07:53.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077312+0000", 2023-10-08T07:07:53.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024286855999999999 2023-10-08T07:07:53.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077368+0000", 2023-10-08T07:07:53.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5834000000000001e-05 2023-10-08T07:07:53.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077446+0000", 2023-10-08T07:07:53.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8349999999999994e-05 2023-10-08T07:07:53.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.914 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.914 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147645 4.0 4:02bf98b6:::10000000004.0000000e:head [write 1941504~4096,write 2043904~4096,write 2076672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.914 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:53.914 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.234972006, 2023-10-08T07:07:53.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4872246599999999, 2023-10-08T07:07:53.914 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.914 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.915 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.915 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147645 2023-10-08T07:07:53.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.915 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:53.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0100000000000001e-07 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590367+0000", 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2830000000000007e-06 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590372+0000", 2023-10-08T07:07:53.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0880000000000002e-06 2023-10-08T07:07:53.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590375+0000", 2023-10-08T07:07:53.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9869999999999999e-06 2023-10-08T07:07:53.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055521+0000", 2023-10-08T07:07:53.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4651462099999999 2023-10-08T07:07:53.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055589+0000", 2023-10-08T07:07:53.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7916999999999994e-05 2023-10-08T07:07:53.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:53.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055718+0000", 2023-10-08T07:07:53.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012877200000000001 2023-10-08T07:07:53.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:53.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.076842+0000", 2023-10-08T07:07:53.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021124074999999999 2023-10-08T07:07:53.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077494+0000", 2023-10-08T07:07:53.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00065233700000000001 2023-10-08T07:07:53.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077539+0000", 2023-10-08T07:07:53.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4829000000000001e-05 2023-10-08T07:07:53.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077582+0000", 2023-10-08T07:07:53.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2861000000000002e-05 2023-10-08T07:07:53.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.920 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.921 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147649 4.10 4:08d50e0e:::10000000004.0000003f:head [write 1347584~4096,write 1568768~4096,write 1728512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.921 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:53.921 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.234950282, 2023-10-08T07:07:53.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4873494039999999, 2023-10-08T07:07:53.921 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.921 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.921 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.921 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.921 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.921 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147649 2023-10-08T07:07:53.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.921 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:53.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:53.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7399999999999999e-07 2023-10-08T07:07:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590389+0000", 2023-10-08T07:07:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7019999999999996e-06 2023-10-08T07:07:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590394+0000", 2023-10-08T07:07:53.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1229999999999999e-06 2023-10-08T07:07:53.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590397+0000", 2023-10-08T07:07:53.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8480000000000001e-06 2023-10-08T07:07:53.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.056106+0000", 2023-10-08T07:07:53.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4657090159999999 2023-10-08T07:07:53.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.056177+0000", 2023-10-08T07:07:53.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1148000000000004e-05 2023-10-08T07:07:53.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077593+0000", 2023-10-08T07:07:53.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021416101 2023-10-08T07:07:53.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077652+0000", 2023-10-08T07:07:53.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9005999999999997e-05 2023-10-08T07:07:53.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077728+0000", 2023-10-08T07:07:53.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6186000000000005e-05 2023-10-08T07:07:53.926 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.926 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.926 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.926 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147667 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2600960~4096,write 2826240~4096,write 2871296~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.230789858, 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4900356029999999, 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147667 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:53.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:53.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596594+0000", 2023-10-08T07:07:53.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020548599999999999 2023-10-08T07:07:53.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596614+0000", 2023-10-08T07:07:53.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0228e-05 2023-10-08T07:07:53.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596625+0000", 2023-10-08T07:07:53.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0721e-05 2023-10-08T07:07:53.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596633+0000", 2023-10-08T07:07:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5900000000000002e-06 2023-10-08T07:07:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.059476+0000", 2023-10-08T07:07:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4628431820000001 2023-10-08T07:07:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.059555+0000", 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9192999999999999e-05 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084434+0000", 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024879571999999999 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084501+0000", 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6129000000000003e-05 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084575+0000", 2023-10-08T07:07:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4128000000000006e-05 2023-10-08T07:07:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147702 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3768320~4096,write 3788800~4096,write 3817472~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.207762578000001, 2023-10-08T07:07:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4668568, 2023-10-08T07:07:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147702 2023-10-08T07:07:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617567+0000", 2023-10-08T07:07:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2023-10-08T07:07:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617578+0000", 2023-10-08T07:07:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0922e-05 2023-10-08T07:07:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617584+0000", 2023-10-08T07:07:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7849999999999997e-06 2023-10-08T07:07:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617588+0000", 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6310000000000002e-06 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062218+0000", 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4446299810000001 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062303+0000", 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4648999999999995e-05 2023-10-08T07:07:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062425+0000", 2023-10-08T07:07:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012220899999999999 2023-10-08T07:07:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.076883+0000", 2023-10-08T07:07:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014458354 2023-10-08T07:07:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084302+0000", 2023-10-08T07:07:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074189310000000001 2023-10-08T07:07:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084374+0000", 2023-10-08T07:07:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1519000000000004e-05 2023-10-08T07:07:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084423+0000", 2023-10-08T07:07:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000003e-05 2023-10-08T07:07:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147713 4.28 4:15b6682b:::10000000004.0000000b:head [write 2990080~4096,write 3133440~4096,write 3362816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.207630054999999, 2023-10-08T07:07:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707889380000001, 2023-10-08T07:07:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147713 2023-10-08T07:07:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.89e-07 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617718+0000", 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8287e-05 2023-10-08T07:07:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617724+0000", 2023-10-08T07:07:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7939999999999997e-06 2023-10-08T07:07:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617730+0000", 2023-10-08T07:07:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1819999999999997e-06 2023-10-08T07:07:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062893+0000", 2023-10-08T07:07:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4451633429999999 2023-10-08T07:07:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062969+0000", 2023-10-08T07:07:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6119999999999996e-05 2023-10-08T07:07:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088335+0000", 2023-10-08T07:07:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025366289 2023-10-08T07:07:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088399+0000", 2023-10-08T07:07:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4067999999999997e-05 2023-10-08T07:07:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088488+0000", 2023-10-08T07:07:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8466000000000003e-05 2023-10-08T07:07:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147714 4.28 4:15b6682b:::10000000004.0000000b:head [write 1286144~4096,write 1372160~4096,write 1523712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 12.207591945000001, 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.471492757, 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147714 2023-10-08T07:07:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:07:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617751+0000", 2023-10-08T07:07:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3570000000000001e-05 2023-10-08T07:07:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617757+0000", 2023-10-08T07:07:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.229e-06 2023-10-08T07:07:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617762+0000", 2023-10-08T07:07:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7670000000000003e-06 2023-10-08T07:07:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.068000+0000", 2023-10-08T07:07:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4502380930000001 2023-10-08T07:07:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.068049+0000", 2023-10-08T07:07:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9051999999999997e-05 2023-10-08T07:07:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089117+0000", 2023-10-08T07:07:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021067536000000001 2023-10-08T07:07:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089164+0000", 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7178999999999997e-05 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089230+0000", 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5896999999999996e-05 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:53.951 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:53.952 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:53.952 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:53.953 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:53.953 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:53.953 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:53.954 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:53.954 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:53.954 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:53.952+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:54.052 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:54.051+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:54.101 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:54.102 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:54.110 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-10-08T07:07:54.113 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-08T07:07:54.114 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:54.130 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T07:07:54.157 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:54.154+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:54.256 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:54.254+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:54.302 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:54.302 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:54.315 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:54.358 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:54.357+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:54.456 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:54.455+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:54.463 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:54.463 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:54.475 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:54.552 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-10-08T07:07:54.557 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:54.556+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:54.563 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-08T07:07:54.563 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T07:07:54.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:07:54.657 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:54.656+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:54.680 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:54.680 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:54.693 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:54.758 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:54.757+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:54.859 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:54.858+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:54.902 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:54.902 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:54.915 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:54.959 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:54.958+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:54.966 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:07:54.966 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":66,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:07:52.048837+0000","last_up_change":"2023-10-08T07:06:38.117398+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5800000429153442,"score_stable":1.5800000429153442,"optimal_score":0.67000001668930054,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":0.95001220703125,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":37,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6801","nonce":1966312605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6803","nonce":1966312605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6807","nonce":1966312605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1966312605},{"type":"v1","addr":"172.21.15.86:6805","nonce":1966312605}]},"public_addr":"172.21.15.86:6801/1966312605","cluster_addr":"172.21.15.86:6803/1966312605","heartbeat_back_addr":"172.21.15.86:6807/1966312605","heartbeat_front_addr":"172.21.15.86:6805/1966312605","state":["exists"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":0.95001220703125,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":36},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"3.1","osds":[0,2]},{"pgid":"3.1b","osds":[2,0]},{"pgid":"3.1c","osds":[2,0]},{"pgid":"4.1c","osds":[0,2]},{"pgid":"4.31","osds":[2,0]},{"pgid":"4.35","osds":[2,0]},{"pgid":"4.38","osds":[0,2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:07:54.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T07:05:20.557481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-08T07:05:25.624853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T07:05:30.549393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T07:05:31.693934+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T07:07:54.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T07:07:55.062 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:55.059+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:55.064 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2023-10-08T07:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:55.134 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:55.149 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:55.194 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:55.193+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:55.263 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:55.262+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:55.290 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:55.290 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:55.301 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:55.342 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-08T07:07:55.357 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-08T07:07:55.364 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:55.362+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:55.464 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:55.463+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:55.491 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:55.491 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:55.504 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:55.564 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:55.563+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:55.654 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:55.654 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:55.665 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:55.664+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:55.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:55.699 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 8 2023-10-08T07:07:55.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T07:07:55.766 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:55.765+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:55.819 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:55.819 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:55.830 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:55.867 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:55.866+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:55.954 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:07:55.968 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:55.967+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:55.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~78s 2023-10-08T07:07:55.998 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:55.998 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:56.008 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:56.057 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-08T07:07:56.070 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:56.068+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:56.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T07:07:56.115 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:56.136 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:56.136 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:07:56.137 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:56.137 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:07:56.138 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:56.138 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147479 4.0 4:02bf98b6:::10000000004.0000000e:head [write 258048~4096,write 442368~4096,write 520192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.605629303000001, 2023-10-08T07:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.462729097, 2023-10-08T07:07:56.139 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.140 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.140 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.140 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.140 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.140 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147479 2023-10-08T07:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533313+0000", 2023-10-08T07:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002832841 2023-10-08T07:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533338+0000", 2023-10-08T07:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5052999999999999e-05 2023-10-08T07:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533350+0000", 2023-10-08T07:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2561000000000001e-05 2023-10-08T07:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533357+0000", 2023-10-08T07:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0870000000000001e-06 2023-10-08T07:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963719+0000", 2023-10-08T07:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4303612779999999 2023-10-08T07:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963788+0000", 2023-10-08T07:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9751000000000004e-05 2023-10-08T07:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963941+0000", 2023-10-08T07:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015224499999999999 2023-10-08T07:07:56.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.971897+0000", 2023-10-08T07:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079562769999999994 2023-10-08T07:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993080+0000", 2023-10-08T07:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021183400000000002 2023-10-08T07:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993161+0000", 2023-10-08T07:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1045999999999996e-05 2023-10-08T07:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993209+0000", 2023-10-08T07:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7558000000000001e-05 2023-10-08T07:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147519 4.10 4:08d50e0e:::10000000004.0000003f:head [write 258048~4096,write 417792~4096,write 1318912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.594608265, 2023-10-08T07:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.467910235, 2023-10-08T07:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147519 2023-10-08T07:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5199999999999998e-07 2023-10-08T07:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541510+0000", 2023-10-08T07:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4690000000000003e-06 2023-10-08T07:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541515+0000", 2023-10-08T07:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7260000000000002e-06 2023-10-08T07:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541518+0000", 2023-10-08T07:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7329999999999999e-06 2023-10-08T07:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.977538+0000", 2023-10-08T07:07:56.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.436020313 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.977630+0000", 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1893999999999998e-05 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009278+0000", 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.031647661000000001 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009334+0000", 2023-10-08T07:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6366999999999998e-05 2023-10-08T07:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009411+0000", 2023-10-08T07:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.682e-05 2023-10-08T07:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147523 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2183168~4096,write 2215936~4096,write 2228224~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.594567172, 2023-10-08T07:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4714357950000001, 2023-10-08T07:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147523 2023-10-08T07:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.154 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2023-10-08T07:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541554+0000", 2023-10-08T07:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1515000000000001e-05 2023-10-08T07:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541557+0000", 2023-10-08T07:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.675e-06 2023-10-08T07:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541560+0000", 2023-10-08T07:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.841e-06 2023-10-08T07:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980499+0000", 2023-10-08T07:07:56.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.43893866 2023-10-08T07:07:56.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980591+0000", 2023-10-08T07:07:56.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1970000000000002e-05 2023-10-08T07:07:56.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:56.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980759+0000", 2023-10-08T07:07:56.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016861099999999999 2023-10-08T07:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993040+0000", 2023-10-08T07:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012280798000000001 2023-10-08T07:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012884+0000", 2023-10-08T07:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019843573 2023-10-08T07:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012938+0000", 2023-10-08T07:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4462000000000001e-05 2023-10-08T07:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012978+0000", 2023-10-08T07:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9455000000000001e-05 2023-10-08T07:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147525 4.28 4:16edf4d3:::10000000004.00000027:head [write 1671168~4096,write 1994752~4096,write 2002944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.594288912, 2023-10-08T07:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4828482860000001, 2023-10-08T07:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.162 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147525 2023-10-08T07:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545293+0000", 2023-10-08T07:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034732809999999999 2023-10-08T07:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545312+0000", 2023-10-08T07:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8156999999999999e-05 2023-10-08T07:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545323+0000", 2023-10-08T07:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1215e-05 2023-10-08T07:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545331+0000", 2023-10-08T07:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2859999999999999e-06 2023-10-08T07:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.998284+0000", 2023-10-08T07:07:56.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4529525249999999 2023-10-08T07:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.998394+0000", 2023-10-08T07:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000110214 2023-10-08T07:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024519+0000", 2023-10-08T07:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026125603000000001 2023-10-08T07:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024578+0000", 2023-10-08T07:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8779000000000001e-05 2023-10-08T07:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024668+0000", 2023-10-08T07:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0226e-05 2023-10-08T07:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147529 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3813376~4096,write 3833856~4096,write 3846144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.590727600999999, 2023-10-08T07:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4795143450000001, 2023-10-08T07:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147529 2023-10-08T07:07:56.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545382+0000", 2023-10-08T07:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2023-10-08T07:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545394+0000", 2023-10-08T07:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1969e-05 2023-10-08T07:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545403+0000", 2023-10-08T07:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7460000000000006e-06 2023-10-08T07:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545408+0000", 2023-10-08T07:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6749999999999999e-06 2023-10-08T07:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.999994+0000", 2023-10-08T07:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4545859759999999 2023-10-08T07:07:56.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.000091+0000", 2023-10-08T07:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6803000000000001e-05 2023-10-08T07:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024769+0000", 2023-10-08T07:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024677977 2023-10-08T07:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024819+0000", 2023-10-08T07:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.02e-05 2023-10-08T07:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024896+0000", 2023-10-08T07:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6447999999999997e-05 2023-10-08T07:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147541 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3600384~4096,write 3616768~4096,write 3747840~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.588723246000001, 2023-10-08T07:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478191619, 2023-10-08T07:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.174 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147541 2023-10-08T07:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1899999999999998e-07 2023-10-08T07:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547397+0000", 2023-10-08T07:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1263999999999999e-05 2023-10-08T07:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547401+0000", 2023-10-08T07:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7409999999999998e-06 2023-10-08T07:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547404+0000", 2023-10-08T07:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9890000000000001e-06 2023-10-08T07:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.004793+0000", 2023-10-08T07:07:56.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.457389024 2023-10-08T07:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.004869+0000", 2023-10-08T07:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6027999999999998e-05 2023-10-08T07:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005024+0000", 2023-10-08T07:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015473799999999999 2023-10-08T07:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024718+0000", 2023-10-08T07:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019694555999999998 2023-10-08T07:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024905+0000", 2023-10-08T07:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018695800000000001 2023-10-08T07:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025500+0000", 2023-10-08T07:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00059492300000000002 2023-10-08T07:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025577+0000", 2023-10-08T07:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7078999999999998e-05 2023-10-08T07:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147542 4.28 4:15b6682b:::10000000004.0000000b:head [write 1032192~4096,write 1110016~4096,write 1138688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.588700516999999, 2023-10-08T07:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478297658, 2023-10-08T07:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147542 2023-10-08T07:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:56.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549299+0000", 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018905650000000001 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549316+0000", 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7065999999999999e-05 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549327+0000", 2023-10-08T07:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0573e-05 2023-10-08T07:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549335+0000", 2023-10-08T07:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9410000000000007e-06 2023-10-08T07:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005115+0000", 2023-10-08T07:07:56.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.455780069 2023-10-08T07:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005188+0000", 2023-10-08T07:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3668e-05 2023-10-08T07:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025587+0000", 2023-10-08T07:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020398199999999998 2023-10-08T07:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025640+0000", 2023-10-08T07:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2023-10-08T07:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025706+0000", 2023-10-08T07:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6589999999999998e-05 2023-10-08T07:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147545 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3223552~4096,write 3239936~4096,write 3317760~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.586711711, 2023-10-08T07:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.485135557, 2023-10-08T07:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147545 2023-10-08T07:07:56.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549407+0000", 2023-10-08T07:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103e-05 2023-10-08T07:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549421+0000", 2023-10-08T07:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3995999999999999e-05 2023-10-08T07:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549430+0000", 2023-10-08T07:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3329999999999997e-06 2023-10-08T07:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549443+0000", 2023-10-08T07:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3492000000000001e-05 2023-10-08T07:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009122+0000", 2023-10-08T07:07:56.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4596791790000001 2023-10-08T07:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009194+0000", 2023-10-08T07:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1960999999999998e-05 2023-10-08T07:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009336+0000", 2023-10-08T07:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014156999999999999 2023-10-08T07:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025872+0000", 2023-10-08T07:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016536417000000001 2023-10-08T07:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034437+0000", 2023-10-08T07:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085645029999999994 2023-10-08T07:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034492+0000", 2023-10-08T07:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4688999999999998e-05 2023-10-08T07:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034533+0000", 2023-10-08T07:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1313999999999998e-05 2023-10-08T07:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.193 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147579 4.28 4:15b6682b:::10000000004.0000000b:head [write 3035136~8192,write 3059712~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.572764675, 2023-10-08T07:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.462488893, 2023-10-08T07:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147579 2023-10-08T07:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.194 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563345+0000", 2023-10-08T07:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000005e-07 2023-10-08T07:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563359+0000", 2023-10-08T07:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4199000000000001e-05 2023-10-08T07:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563366+0000", 2023-10-08T07:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8619999999999997e-06 2023-10-08T07:07:56.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563371+0000", 2023-10-08T07:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4060000000000004e-06 2023-10-08T07:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009484+0000", 2023-10-08T07:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4461131300000001 2023-10-08T07:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009562+0000", 2023-10-08T07:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8046999999999993e-05 2023-10-08T07:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025714+0000", 2023-10-08T07:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016151327 2023-10-08T07:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025754+0000", 2023-10-08T07:07:56.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0049000000000002e-05 2023-10-08T07:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025833+0000", 2023-10-08T07:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9395999999999997e-05 2023-10-08T07:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147591 4.28 4:16edf4d3:::10000000004.00000027:head [write 684032~4096,write 741376~4096,write 765952~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.568665810000001, 2023-10-08T07:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4805182619999999, 2023-10-08T07:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147591 2023-10-08T07:07:56.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567444+0000", 2023-10-08T07:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8500000000000001e-07 2023-10-08T07:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567456+0000", 2023-10-08T07:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2221e-05 2023-10-08T07:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567463+0000", 2023-10-08T07:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.652e-06 2023-10-08T07:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567468+0000", 2023-10-08T07:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8500000000000002e-06 2023-10-08T07:07:56.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025908+0000", 2023-10-08T07:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.458440948 2023-10-08T07:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.026004+0000", 2023-10-08T07:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5805999999999997e-05 2023-10-08T07:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047842+0000", 2023-10-08T07:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021837770999999999 2023-10-08T07:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047894+0000", 2023-10-08T07:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2079000000000001e-05 2023-10-08T07:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047961+0000", 2023-10-08T07:07:56.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7349999999999997e-05 2023-10-08T07:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147596 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2379776~4096,write 2428928~4096,write 2531328~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.566754187000001, 2023-10-08T07:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478728255, 2023-10-08T07:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.206 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147596 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571294+0000", 2023-10-08T07:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001939037 2023-10-08T07:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571314+0000", 2023-10-08T07:07:56.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9791000000000001e-05 2023-10-08T07:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571327+0000", 2023-10-08T07:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3078000000000001e-05 2023-10-08T07:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571334+0000", 2023-10-08T07:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2429999999999999e-06 2023-10-08T07:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.028808+0000", 2023-10-08T07:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4574743030000001 2023-10-08T07:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.028888+0000", 2023-10-08T07:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9818e-05 2023-10-08T07:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047970+0000", 2023-10-08T07:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019082359 2023-10-08T07:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048017+0000", 2023-10-08T07:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6943000000000001e-05 2023-10-08T07:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048083+0000", 2023-10-08T07:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5683000000000001e-05 2023-10-08T07:07:56.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147608 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3088384~4096,write 3145728~4096,write 3276800~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.558717901, 2023-10-08T07:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4708017579999999, 2023-10-08T07:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147608 2023-10-08T07:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577392+0000", 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577404+0000", 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2544999999999999e-05 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577411+0000", 2023-10-08T07:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4219999999999997e-06 2023-10-08T07:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577416+0000", 2023-10-08T07:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9729999999999997e-06 2023-10-08T07:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031697+0000", 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.454281656 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031771+0000", 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3440000000000002e-05 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048095+0000", 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016324241999999999 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048134+0000", 2023-10-08T07:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9558999999999999e-05 2023-10-08T07:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048193+0000", 2023-10-08T07:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8409999999999998e-05 2023-10-08T07:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147614 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2973696~4096,write 3149824~4096,write 3158016~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.556727502999999, 2023-10-08T07:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4709725659999999, 2023-10-08T07:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147614 2023-10-08T07:07:56.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.51e-07 2023-10-08T07:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579394+0000", 2023-10-08T07:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.207e-05 2023-10-08T07:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579401+0000", 2023-10-08T07:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3900000000000004e-06 2023-10-08T07:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579406+0000", 2023-10-08T07:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9490000000000004e-06 2023-10-08T07:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031686+0000", 2023-10-08T07:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4522797299999999 2023-10-08T07:07:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031763+0000", 2023-10-08T07:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6432000000000003e-05 2023-10-08T07:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031910+0000", 2023-10-08T07:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014741900000000001 2023-10-08T07:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048090+0000", 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016179948999999999 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050261+0000", 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021715860000000001 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050320+0000", 2023-10-08T07:07:56.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8217999999999997e-05 2023-10-08T07:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050354+0000", 2023-10-08T07:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4372000000000002e-05 2023-10-08T07:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.224 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147623 4.28 4:16edf4d3:::10000000004.00000027:head [write 1306624~4096,write 1331200~4096,write 1429504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.556604317, 2023-10-08T07:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.497941188, 2023-10-08T07:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147623 2023-10-08T07:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582310+0000", 2023-10-08T07:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028050800000000002 2023-10-08T07:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582327+0000", 2023-10-08T07:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6807e-05 2023-10-08T07:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582337+0000", 2023-10-08T07:07:56.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0454e-05 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582344+0000", 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2239999999999998e-06 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.052947+0000", 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4706025979999999 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.053025+0000", 2023-10-08T07:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7985000000000006e-05 2023-10-08T07:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077312+0000", 2023-10-08T07:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024286855999999999 2023-10-08T07:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077368+0000", 2023-10-08T07:07:56.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5834000000000001e-05 2023-10-08T07:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077446+0000", 2023-10-08T07:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8349999999999994e-05 2023-10-08T07:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147645 4.0 4:02bf98b6:::10000000004.0000000e:head [write 1941504~4096,write 2043904~4096,write 2076672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.230 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.545752024, 2023-10-08T07:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4872246599999999, 2023-10-08T07:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147645 2023-10-08T07:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0100000000000001e-07 2023-10-08T07:07:56.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590367+0000", 2023-10-08T07:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2830000000000007e-06 2023-10-08T07:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590372+0000", 2023-10-08T07:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0880000000000002e-06 2023-10-08T07:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590375+0000", 2023-10-08T07:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9869999999999999e-06 2023-10-08T07:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055521+0000", 2023-10-08T07:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4651462099999999 2023-10-08T07:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055589+0000", 2023-10-08T07:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7916999999999994e-05 2023-10-08T07:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055718+0000", 2023-10-08T07:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012877200000000001 2023-10-08T07:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.076842+0000", 2023-10-08T07:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021124074999999999 2023-10-08T07:07:56.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077494+0000", 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00065233700000000001 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077539+0000", 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4829000000000001e-05 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077582+0000", 2023-10-08T07:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2861000000000002e-05 2023-10-08T07:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147649 4.10 4:08d50e0e:::10000000004.0000003f:head [write 1347584~4096,write 1568768~4096,write 1728512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.545730300000001, 2023-10-08T07:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4873494039999999, 2023-10-08T07:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.237 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147649 2023-10-08T07:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7399999999999999e-07 2023-10-08T07:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590389+0000", 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7019999999999996e-06 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590394+0000", 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1229999999999999e-06 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590397+0000", 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8480000000000001e-06 2023-10-08T07:07:56.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.056106+0000", 2023-10-08T07:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4657090159999999 2023-10-08T07:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.056177+0000", 2023-10-08T07:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1148000000000004e-05 2023-10-08T07:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077593+0000", 2023-10-08T07:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021416101 2023-10-08T07:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077652+0000", 2023-10-08T07:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9005999999999997e-05 2023-10-08T07:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077728+0000", 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6186000000000005e-05 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147667 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2600960~4096,write 2826240~4096,write 2871296~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.541569876000001, 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4900356029999999, 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.243 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147667 2023-10-08T07:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596594+0000", 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020548599999999999 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596614+0000", 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0228e-05 2023-10-08T07:07:56.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596625+0000", 2023-10-08T07:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0721e-05 2023-10-08T07:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596633+0000", 2023-10-08T07:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5900000000000002e-06 2023-10-08T07:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.059476+0000", 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4628431820000001 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.059555+0000", 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9192999999999999e-05 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084434+0000", 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024879571999999999 2023-10-08T07:07:56.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084501+0000", 2023-10-08T07:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6129000000000003e-05 2023-10-08T07:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084575+0000", 2023-10-08T07:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4128000000000006e-05 2023-10-08T07:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147702 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3768320~4096,write 3788800~4096,write 3817472~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.518542596, 2023-10-08T07:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4668568, 2023-10-08T07:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.249 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147702 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617567+0000", 2023-10-08T07:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2023-10-08T07:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617578+0000", 2023-10-08T07:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0922e-05 2023-10-08T07:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617584+0000", 2023-10-08T07:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7849999999999997e-06 2023-10-08T07:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617588+0000", 2023-10-08T07:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6310000000000002e-06 2023-10-08T07:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062218+0000", 2023-10-08T07:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4446299810000001 2023-10-08T07:07:56.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062303+0000", 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4648999999999995e-05 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062425+0000", 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012220899999999999 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.076883+0000", 2023-10-08T07:07:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014458354 2023-10-08T07:07:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084302+0000", 2023-10-08T07:07:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074189310000000001 2023-10-08T07:07:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084374+0000", 2023-10-08T07:07:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1519000000000004e-05 2023-10-08T07:07:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084423+0000", 2023-10-08T07:07:56.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000003e-05 2023-10-08T07:07:56.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.255 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.255 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147713 4.28 4:15b6682b:::10000000004.0000000b:head [write 2990080~4096,write 3133440~4096,write 3362816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.255 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:56.255 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.518410073, 2023-10-08T07:07:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707889380000001, 2023-10-08T07:07:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147713 2023-10-08T07:07:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.89e-07 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617718+0000", 2023-10-08T07:07:56.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8287e-05 2023-10-08T07:07:56.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617724+0000", 2023-10-08T07:07:56.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7939999999999997e-06 2023-10-08T07:07:56.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617730+0000", 2023-10-08T07:07:56.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1819999999999997e-06 2023-10-08T07:07:56.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062893+0000", 2023-10-08T07:07:56.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4451633429999999 2023-10-08T07:07:56.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062969+0000", 2023-10-08T07:07:56.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6119999999999996e-05 2023-10-08T07:07:56.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088335+0000", 2023-10-08T07:07:56.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025366289 2023-10-08T07:07:56.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088399+0000", 2023-10-08T07:07:56.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4067999999999997e-05 2023-10-08T07:07:56.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088488+0000", 2023-10-08T07:07:56.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8466000000000003e-05 2023-10-08T07:07:56.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.261 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.261 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147714 4.28 4:15b6682b:::10000000004.0000000b:head [write 1286144~4096,write 1372160~4096,write 1523712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:56.261 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:56.261 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.518371963, 2023-10-08T07:07:56.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.471492757, 2023-10-08T07:07:56.262 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:56.262 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:56.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:56.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.262 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147714 2023-10-08T07:07:56.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.262 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:56.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:56.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:56.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:56.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:56.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:56.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:56.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:56.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:07:56.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617751+0000", 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3570000000000001e-05 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617757+0000", 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.229e-06 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617762+0000", 2023-10-08T07:07:56.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7670000000000003e-06 2023-10-08T07:07:56.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:56.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.068000+0000", 2023-10-08T07:07:56.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4502380930000001 2023-10-08T07:07:56.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:56.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.068049+0000", 2023-10-08T07:07:56.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9051999999999997e-05 2023-10-08T07:07:56.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:56.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089117+0000", 2023-10-08T07:07:56.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021067536000000001 2023-10-08T07:07:56.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:56.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089164+0000", 2023-10-08T07:07:56.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7178999999999997e-05 2023-10-08T07:07:56.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:56.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:56.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:56.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089230+0000", 2023-10-08T07:07:56.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5896999999999996e-05 2023-10-08T07:07:56.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.267 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:56.267 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:56.267 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:56.268 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:56.269 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:56.269 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:56.267+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:56.270 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:56.369 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:56.368+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:56.416 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:56.416 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:56.416 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:07:56.417 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:56.418 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-08T07:07:56.427 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:56.432 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T07:07:56.470 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:56.468+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:56.571 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:56.570+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:56.599 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:56.600 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:56.600 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:56.600 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:56.600 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:56.610 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:56.671 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:56.670+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:56.744 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:56.744 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:56.744 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:56.745 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:56.745 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.745 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175316 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 696320~4096,write 745472~4096,write 942080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.745 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:07:56.745 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.0802093559999992, 2023-10-08T07:07:56.745 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.239832828, 2023-10-08T07:07:56.745 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.745 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.745 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.745 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.745 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.745 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175316 2023-10-08T07:07:56.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.746 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:07:56.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.746 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.746 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:07:56.746 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662052+0000", 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9599999999999998e-07 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662064+0000", 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.226e-05 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.747 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662074+0000", 2023-10-08T07:07:56.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0057999999999999e-05 2023-10-08T07:07:56.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662082+0000", 2023-10-08T07:07:56.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.593e-06 2023-10-08T07:07:56.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.748 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.748 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.868775+0000", 2023-10-08T07:07:56.748 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.20669354700000001 2023-10-08T07:07:56.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.868864+0000", 2023-10-08T07:07:56.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9174999999999999e-05 2023-10-08T07:07:56.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.749 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.749 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.869012+0000", 2023-10-08T07:07:56.749 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014747 2023-10-08T07:07:56.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.749 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.885657+0000", 2023-10-08T07:07:56.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016645008999999999 2023-10-08T07:07:56.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901768+0000", 2023-10-08T07:07:56.750 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016110721000000001 2023-10-08T07:07:56.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.750 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.750 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.750 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901841+0000", 2023-10-08T07:07:56.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3047999999999996e-05 2023-10-08T07:07:56.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.751 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.751 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901884+0000", 2023-10-08T07:07:56.751 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3050999999999998e-05 2023-10-08T07:07:56.751 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.751 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.751 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.751 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.751 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175432 4.1a 4:5a59f83a:::10000000004.00000002:head [write 196608~4096,write 245760~4096,write 270336~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:07:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 9.043091381, 2023-10-08T07:07:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.23774203799999999, 2023-10-08T07:07:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175432 2023-10-08T07:07:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:07:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:07:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.753 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699170+0000", 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699181+0000", 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1581e-05 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699199+0000", 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7376000000000001e-05 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699206+0000", 2023-10-08T07:07:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7190000000000001e-06 2023-10-08T07:07:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907275+0000", 2023-10-08T07:07:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.20806835700000001 2023-10-08T07:07:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.755 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907359+0000", 2023-10-08T07:07:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4320999999999994e-05 2023-10-08T07:07:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907546+0000", 2023-10-08T07:07:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018752299999999999 2023-10-08T07:07:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.925780+0000", 2023-10-08T07:07:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018233909999999999 2023-10-08T07:07:56.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936786+0000", 2023-10-08T07:07:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011005355 2023-10-08T07:07:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936868+0000", 2023-10-08T07:07:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1917999999999997e-05 2023-10-08T07:07:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.757 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936911+0000", 2023-10-08T07:07:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3207999999999997e-05 2023-10-08T07:07:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175676 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2719744~4096,write 2822144~4096,write 2945024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:07:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9709920230000009, 2023-10-08T07:07:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24978785000000001, 2023-10-08T07:07:56.758 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175676 2023-10-08T07:07:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:07:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:07:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771269+0000", 2023-10-08T07:07:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7100000000000002e-07 2023-10-08T07:07:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.760 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771287+0000", 2023-10-08T07:07:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8022000000000001e-05 2023-10-08T07:07:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771293+0000", 2023-10-08T07:07:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3029999999999996e-06 2023-10-08T07:07:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771297+0000", 2023-10-08T07:07:56.761 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2830000000000003e-06 2023-10-08T07:07:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.961848+0000", 2023-10-08T07:07:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.190550999 2023-10-08T07:07:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.961954+0000", 2023-10-08T07:07:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000105485 2023-10-08T07:07:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.962114+0000", 2023-10-08T07:07:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016024499999999999 2023-10-08T07:07:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.975848+0000", 2023-10-08T07:07:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013733886000000001 2023-10-08T07:07:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.763 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.020956+0000", 2023-10-08T07:07:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045108400999999999 2023-10-08T07:07:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021013+0000", 2023-10-08T07:07:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6277999999999999e-05 2023-10-08T07:07:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021056+0000", 2023-10-08T07:07:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3377000000000002e-05 2023-10-08T07:07:56.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175680 4.3a 4:5f183e4b:::10000000004.00000023:head [write 3502080~4096,write 3534848~4096,write 3608576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:07:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9690470900000001, 2023-10-08T07:07:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24812537200000001, 2023-10-08T07:07:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.765 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175680 2023-10-08T07:07:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:07:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.766 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773214+0000", 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.403e-06 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773227+0000", 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3001e-05 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773240+0000", 2023-10-08T07:07:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2441e-05 2023-10-08T07:07:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773249+0000", 2023-10-08T07:07:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8890000000000008e-06 2023-10-08T07:07:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.768 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964327+0000", 2023-10-08T07:07:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19107864499999999 2023-10-08T07:07:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964418+0000", 2023-10-08T07:07:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0131999999999997e-05 2023-10-08T07:07:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964602+0000", 2023-10-08T07:07:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000184711 2023-10-08T07:07:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976021+0000", 2023-10-08T07:07:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011418822 2023-10-08T07:07:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021236+0000", 2023-10-08T07:07:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045214467000000001 2023-10-08T07:07:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.770 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021303+0000", 2023-10-08T07:07:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7210000000000002e-05 2023-10-08T07:07:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021338+0000", 2023-10-08T07:07:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5651000000000001e-05 2023-10-08T07:07:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175690 4.1a 4:5a59f83a:::10000000004.00000002:head [write 405504~4096,write 811008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:07:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.966493324, 2023-10-08T07:07:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.245421262, 2023-10-08T07:07:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175690 2023-10-08T07:07:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.772 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:07:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:07:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:07:56.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:07:56.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.774 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775774+0000", 2023-10-08T07:07:56.774 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9460000000000001e-06 2023-10-08T07:07:56.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.774 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775781+0000", 2023-10-08T07:07:56.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8349999999999998e-06 2023-10-08T07:07:56.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775785+0000", 2023-10-08T07:07:56.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7290000000000002e-06 2023-10-08T07:07:56.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.775 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.775 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967188+0000", 2023-10-08T07:07:56.775 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19140304299999999 2023-10-08T07:07:56.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967267+0000", 2023-10-08T07:07:56.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9154999999999997e-05 2023-10-08T07:07:56.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.776 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.776 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967405+0000", 2023-10-08T07:07:56.776 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000137618 2023-10-08T07:07:56.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.776 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976028+0000", 2023-10-08T07:07:56.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0086236869999999997 2023-10-08T07:07:56.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.777 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021096+0000", 2023-10-08T07:07:56.777 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045067928 2023-10-08T07:07:56.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.777 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.777 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021147+0000", 2023-10-08T07:07:56.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0399000000000003e-05 2023-10-08T07:07:56.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.778 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.778 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021188+0000", 2023-10-08T07:07:56.778 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1386e-05 2023-10-08T07:07:56.778 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.778 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.778 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.778 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.779 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175692 4.a 4:524fba76:::10000000004.0000001b:head [write 737280~4096,write 749568~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.779 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:07:56.779 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9660396020000004, 2023-10-08T07:07:56.779 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25024756399999998, 2023-10-08T07:07:56.779 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.779 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.779 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.779 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.779 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.779 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175692 2023-10-08T07:07:56.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.780 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:07:56.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.780 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.780 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.780 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:07:56.780 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:07:56.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1200000000000003e-07 2023-10-08T07:07:56.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.781 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.781 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776238+0000", 2023-10-08T07:07:56.781 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7269e-05 2023-10-08T07:07:56.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776247+0000", 2023-10-08T07:07:56.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5189999999999992e-06 2023-10-08T07:07:56.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.782 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.782 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776251+0000", 2023-10-08T07:07:56.782 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7910000000000002e-06 2023-10-08T07:07:56.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967925+0000", 2023-10-08T07:07:56.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19167456299999999 2023-10-08T07:07:56.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967997+0000", 2023-10-08T07:07:56.783 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1666000000000001e-05 2023-10-08T07:07:56.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.783 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.783 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.783 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.968122+0000", 2023-10-08T07:07:56.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012469 2023-10-08T07:07:56.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976268+0000", 2023-10-08T07:07:56.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0081468770000000003 2023-10-08T07:07:56.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.784 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.784 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.784 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026375+0000", 2023-10-08T07:07:56.784 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050106683999999999 2023-10-08T07:07:56.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026430+0000", 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4506999999999998e-05 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026468+0000", 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8485999999999997e-05 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175701 4.a 4:524fba76:::10000000004.0000001b:head [write 1503232~4096,write 1540096~4096,write 1560576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:07:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9631959240000008, 2023-10-08T07:07:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.257645717, 2023-10-08T07:07:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175701 2023-10-08T07:07:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.787 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:07:56.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.787 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.787 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:07:56.787 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779065+0000", 2023-10-08T07:07:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6300000000000005e-07 2023-10-08T07:07:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779074+0000", 2023-10-08T07:07:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7010000000000002e-06 2023-10-08T07:07:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779090+0000", 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6171000000000002e-05 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779095+0000", 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9169999999999997e-06 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971272+0000", 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.192177024 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971364+0000", 2023-10-08T07:07:56.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2102999999999996e-05 2023-10-08T07:07:56.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971480+0000", 2023-10-08T07:07:56.790 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000116307 2023-10-08T07:07:56.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.790 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.790 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.790 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.980645+0000", 2023-10-08T07:07:56.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0091647559999999996 2023-10-08T07:07:56.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036634+0000", 2023-10-08T07:07:56.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055989555000000003 2023-10-08T07:07:56.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.791 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.791 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036673+0000", 2023-10-08T07:07:56.791 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8285999999999999e-05 2023-10-08T07:07:56.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.792 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.792 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036710+0000", 2023-10-08T07:07:56.792 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7234000000000003e-05 2023-10-08T07:07:56.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.792 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.792 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.792 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.792 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175733 4.a 4:524fba76:::10000000004.0000001b:head [write 2154496~4096,write 2281472~4096,write 2306048~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.792 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:07:56.792 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9523691579999998, 2023-10-08T07:07:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25628842600000001, 2023-10-08T07:07:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175733 2023-10-08T07:07:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.793 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:07:56.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:07:56.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.794 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.794 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:07:56.794 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4900000000000001e-07 2023-10-08T07:07:56.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789903+0000", 2023-10-08T07:07:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1391e-05 2023-10-08T07:07:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789909+0000", 2023-10-08T07:07:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6460000000000004e-06 2023-10-08T07:07:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.795 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789916+0000", 2023-10-08T07:07:56.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.635e-06 2023-10-08T07:07:56.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976385+0000", 2023-10-08T07:07:56.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18646858799999999 2023-10-08T07:07:56.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.796 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.796 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.796 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976432+0000", 2023-10-08T07:07:56.796 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6885000000000003e-05 2023-10-08T07:07:56.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976521+0000", 2023-10-08T07:07:56.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9122999999999994e-05 2023-10-08T07:07:56.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.797 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.797 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.987479+0000", 2023-10-08T07:07:56.797 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0109579 2023-10-08T07:07:56.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.797 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046084+0000", 2023-10-08T07:07:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058605813999999999 2023-10-08T07:07:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046140+0000", 2023-10-08T07:07:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5770999999999998e-05 2023-10-08T07:07:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.798 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046179+0000", 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9224000000000003e-05 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175743 4.a 4:524fba76:::10000000004.0000001b:head [write 233472~4096,write 684032~4096,write 704512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9489908460000009, 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25305127599999999, 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.799 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175743 2023-10-08T07:07:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:07:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.800 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:07:56.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793270+0000", 2023-10-08T07:07:56.801 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8200000000000008e-07 2023-10-08T07:07:56.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.801 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.801 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.801 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793291+0000", 2023-10-08T07:07:56.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1058000000000001e-05 2023-10-08T07:07:56.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793303+0000", 2023-10-08T07:07:56.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1836e-05 2023-10-08T07:07:56.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.802 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.802 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.802 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793312+0000", 2023-10-08T07:07:56.802 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5809999999999997e-06 2023-10-08T07:07:56.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.978869+0000", 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18555693400000001 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.978955+0000", 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6318999999999998e-05 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.803 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.979104+0000", 2023-10-08T07:07:56.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014935 2023-10-08T07:07:56.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.987482+0000", 2023-10-08T07:07:56.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083776749999999994 2023-10-08T07:07:56.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.804 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.804 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046228+0000", 2023-10-08T07:07:56.804 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058745516999999997 2023-10-08T07:07:56.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046285+0000", 2023-10-08T07:07:56.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7358000000000002e-05 2023-10-08T07:07:56.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.805 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.805 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046321+0000", 2023-10-08T07:07:56.805 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5666e-05 2023-10-08T07:07:56.805 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.805 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.805 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.806 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.806 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175759 4.a 4:524fba76:::10000000004.0000001b:head [write 2719744~4096,write 2756608~4096,write 2940928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.806 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:07:56.806 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9452202740000004, 2023-10-08T07:07:56.806 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24944019200000001, 2023-10-08T07:07:56.806 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.806 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.806 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.806 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.806 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.806 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175759 2023-10-08T07:07:56.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.807 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:07:56.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.807 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.807 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.807 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:07:56.807 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:07:56.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6600000000000003e-07 2023-10-08T07:07:56.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.808 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797047+0000", 2023-10-08T07:07:56.808 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3600000000000001e-06 2023-10-08T07:07:56.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.808 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797050+0000", 2023-10-08T07:07:56.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6990000000000001e-06 2023-10-08T07:07:56.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797054+0000", 2023-10-08T07:07:56.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3450000000000002e-06 2023-10-08T07:07:56.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.809 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.809 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981409+0000", 2023-10-08T07:07:56.809 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18435503 2023-10-08T07:07:56.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981491+0000", 2023-10-08T07:07:56.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2538000000000002e-05 2023-10-08T07:07:56.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.810 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.810 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981690+0000", 2023-10-08T07:07:56.810 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019896200000000001 2023-10-08T07:07:56.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989237+0000", 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0075464410000000001 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046393+0000", 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.057156086000000002 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.811 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046445+0000", 2023-10-08T07:07:56.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2437e-05 2023-10-08T07:07:56.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.812 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.812 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046480+0000", 2023-10-08T07:07:56.812 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5027999999999997e-05 2023-10-08T07:07:56.812 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.812 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.812 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.812 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175778 4.a 4:524fba76:::10000000004.0000001b:head [write 901120~4096,write 1118208~4096,write 1249280~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.813 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:07:56.813 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9401496970000007, 2023-10-08T07:07:56.813 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.26243437800000002, 2023-10-08T07:07:56.813 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.813 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.813 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.813 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.813 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.813 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175778 2023-10-08T07:07:56.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.813 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:07:56.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:07:56.814 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.814 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.814 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802111+0000", 2023-10-08T07:07:56.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6000000000000003e-07 2023-10-08T07:07:56.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802131+0000", 2023-10-08T07:07:56.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0109999999999999e-05 2023-10-08T07:07:56.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.815 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.815 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802142+0000", 2023-10-08T07:07:56.815 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0549e-05 2023-10-08T07:07:56.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802149+0000", 2023-10-08T07:07:56.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5229999999999998e-06 2023-10-08T07:07:56.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.816 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.816 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983625+0000", 2023-10-08T07:07:56.816 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18147571200000001 2023-10-08T07:07:56.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983673+0000", 2023-10-08T07:07:56.817 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8007000000000003e-05 2023-10-08T07:07:56.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.817 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.817 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983764+0000", 2023-10-08T07:07:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1242000000000005e-05 2023-10-08T07:07:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989240+0000", 2023-10-08T07:07:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054752689999999996 2023-10-08T07:07:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064441+0000", 2023-10-08T07:07:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.075201198999999996 2023-10-08T07:07:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064504+0000", 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3219999999999994e-05 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064545+0000", 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0886999999999997e-05 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.820 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175787 4.3a 4:5f183e4b:::10000000004.00000023:head [write 884736~4096,write 958464~4096,write 1261568~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.820 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:07:56.820 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9375607440000007, 2023-10-08T07:07:56.820 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25984544300000001, 2023-10-08T07:07:56.820 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.820 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.820 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.820 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.820 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.820 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175787 2023-10-08T07:07:56.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:07:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:07:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804700+0000", 2023-10-08T07:07:56.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1299999999999999e-07 2023-10-08T07:07:56.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.822 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804723+0000", 2023-10-08T07:07:56.822 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.304e-05 2023-10-08T07:07:56.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.822 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.822 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804735+0000", 2023-10-08T07:07:56.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1693e-05 2023-10-08T07:07:56.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804742+0000", 2023-10-08T07:07:56.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5869999999999998e-06 2023-10-08T07:07:56.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.823 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.823 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983619+0000", 2023-10-08T07:07:56.823 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.178877123 2023-10-08T07:07:56.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.824 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.824 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983667+0000", 2023-10-08T07:07:56.824 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8510999999999997e-05 2023-10-08T07:07:56.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.825 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.825 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.825 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983763+0000", 2023-10-08T07:07:56.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5902000000000004e-05 2023-10-08T07:07:56.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.826 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.826 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.826 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989243+0000", 2023-10-08T07:07:56.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054799389999999996 2023-10-08T07:07:56.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.826 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.826 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.826 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064453+0000", 2023-10-08T07:07:56.826 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.075209837000000002 2023-10-08T07:07:56.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064506+0000", 2023-10-08T07:07:56.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2743e-05 2023-10-08T07:07:56.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.827 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.827 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064545+0000", 2023-10-08T07:07:56.827 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9255000000000003e-05 2023-10-08T07:07:56.827 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175801 4.a 4:524fba76:::10000000004.0000001b:head [write 2670592~4096,write 2695168~4096,write 2957312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:07:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9328611910000006, 2023-10-08T07:07:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25527491699999999, 2023-10-08T07:07:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.829 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.829 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175801 2023-10-08T07:07:56.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.829 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:07:56.829 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.829 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.829 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.829 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:07:56.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809400+0000", 2023-10-08T07:07:56.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8999999999999996e-07 2023-10-08T07:07:56.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.830 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.830 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.830 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809411+0000", 2023-10-08T07:07:56.830 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1275e-05 2023-10-08T07:07:56.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809418+0000", 2023-10-08T07:07:56.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6649999999999997e-06 2023-10-08T07:07:56.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.831 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809423+0000", 2023-10-08T07:07:56.831 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1499999999999998e-06 2023-10-08T07:07:56.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.831 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986111+0000", 2023-10-08T07:07:56.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17668825299999999 2023-10-08T07:07:56.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986176+0000", 2023-10-08T07:07:56.832 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5234999999999995e-05 2023-10-08T07:07:56.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.832 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.832 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.832 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986313+0000", 2023-10-08T07:07:56.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013663299999999999 2023-10-08T07:07:56.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.833 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.001765+0000", 2023-10-08T07:07:56.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015451833999999999 2023-10-08T07:07:56.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.833 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.833 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064588+0000", 2023-10-08T07:07:56.833 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062823646999999996 2023-10-08T07:07:56.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064639+0000", 2023-10-08T07:07:56.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0401000000000001e-05 2023-10-08T07:07:56.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.834 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.834 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.834 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064674+0000", 2023-10-08T07:07:56.834 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5133999999999999e-05 2023-10-08T07:07:56.834 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.834 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.835 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.835 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.835 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175835 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3133440~4096,write 3272704~4096,write 3280896~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.835 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:07:56.835 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9222232580000007, 2023-10-08T07:07:56.835 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25013609599999997, 2023-10-08T07:07:56.835 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.835 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.835 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.835 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.835 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.836 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175835 2023-10-08T07:07:56.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.836 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:07:56.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.836 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.836 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.836 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:07:56.836 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820038+0000", 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0699999999999997e-07 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820049+0000", 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1326e-05 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.837 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820058+0000", 2023-10-08T07:07:56.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9460000000000004e-06 2023-10-08T07:07:56.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820065+0000", 2023-10-08T07:07:56.838 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.238e-06 2023-10-08T07:07:56.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.838 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.838 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990302+0000", 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17023707699999999 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990350+0000", 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7941000000000001e-05 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990447+0000", 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6552999999999995e-05 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.839 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002051+0000", 2023-10-08T07:07:56.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011604649 2023-10-08T07:07:56.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070103+0000", 2023-10-08T07:07:56.840 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.068051639999999997 2023-10-08T07:07:56.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.840 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.840 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070145+0000", 2023-10-08T07:07:56.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2154000000000003e-05 2023-10-08T07:07:56.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.841 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.841 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070173+0000", 2023-10-08T07:07:56.841 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7965000000000001e-05 2023-10-08T07:07:56.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.841 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.841 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175856 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2080768~4096,write 2191360~4096,write 2203648~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.842 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:07:56.842 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.916853068, 2023-10-08T07:07:56.842 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24491389, 2023-10-08T07:07:56.842 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.842 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.842 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.842 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.842 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.842 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175856 2023-10-08T07:07:56.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.842 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.842 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825408+0000", 2023-10-08T07:07:56.843 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5099999999999999e-07 2023-10-08T07:07:56.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825419+0000", 2023-10-08T07:07:56.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1369000000000001e-05 2023-10-08T07:07:56.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.844 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.844 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825430+0000", 2023-10-08T07:07:56.844 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1226000000000001e-05 2023-10-08T07:07:56.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.844 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825437+0000", 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.156e-06 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992529+0000", 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.167092401 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992594+0000", 2023-10-08T07:07:56.845 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4949000000000004e-05 2023-10-08T07:07:56.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992688+0000", 2023-10-08T07:07:56.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4011999999999994e-05 2023-10-08T07:07:56.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.846 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.846 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.007407+0000", 2023-10-08T07:07:56.846 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014718614 2023-10-08T07:07:56.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.846 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.847 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070226+0000", 2023-10-08T07:07:56.847 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062819551000000001 2023-10-08T07:07:56.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.847 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070283+0000", 2023-10-08T07:07:56.847 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7340000000000003e-05 2023-10-08T07:07:56.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.847 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.847 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.847 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070321+0000", 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7521000000000002e-05 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175864 4.1a 4:5a59f83a:::10000000004.00000002:head [write 4018176~4096,write 4067328~4096,write 4141056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9138201749999997, 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24198245199999999, 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.848 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.849 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.849 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.849 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175864 2023-10-08T07:07:56.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.849 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.849 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:07:56.849 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.849 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.849 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:07:56.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828441+0000", 2023-10-08T07:07:56.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0100000000000005e-07 2023-10-08T07:07:56.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.850 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.850 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.850 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828450+0000", 2023-10-08T07:07:56.850 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1400000000000006e-06 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828461+0000", 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.099e-05 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828468+0000", 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3390000000000004e-06 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.851 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992521+0000", 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16405252400000001 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992607+0000", 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6086000000000002e-05 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992756+0000", 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014936100000000001 2023-10-08T07:07:56.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002055+0000", 2023-10-08T07:07:56.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0092994410000000003 2023-10-08T07:07:56.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.853 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070359+0000", 2023-10-08T07:07:56.853 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.068303681000000005 2023-10-08T07:07:56.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.853 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.853 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070401+0000", 2023-10-08T07:07:56.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2138999999999998e-05 2023-10-08T07:07:56.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.854 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.854 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070422+0000", 2023-10-08T07:07:56.854 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1149999999999999e-05 2023-10-08T07:07:56.854 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.854 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.854 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175882 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 258048~4096,write 282624~4096,write 446464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.9084884609999992, 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.244805773, 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175882 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.855 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:07:56.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:07:56.856 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.856 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.856 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.856 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833773+0000", 2023-10-08T07:07:56.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1800000000000005e-07 2023-10-08T07:07:56.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.857 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.857 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.857 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833799+0000", 2023-10-08T07:07:56.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6840000000000001e-05 2023-10-08T07:07:56.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.857 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.857 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.857 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833811+0000", 2023-10-08T07:07:56.857 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1982e-05 2023-10-08T07:07:56.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.858 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.858 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833819+0000", 2023-10-08T07:07:56.858 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7729999999999999e-06 2023-10-08T07:07:56.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.858 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.858 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998071+0000", 2023-10-08T07:07:56.858 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16425203699999999 2023-10-08T07:07:56.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.858 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.858 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998122+0000", 2023-10-08T07:07:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0627999999999997e-05 2023-10-08T07:07:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998301+0000", 2023-10-08T07:07:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017893 2023-10-08T07:07:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.016267+0000", 2023-10-08T07:07:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017966780000000002 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078470+0000", 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062202475 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078532+0000", 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1601999999999997e-05 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.860 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078577+0000", 2023-10-08T07:07:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5908000000000002e-05 2023-10-08T07:07:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175885 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2940928~4096,write 3362816~4096,write 3371008~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:07:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.907789953, 2023-10-08T07:07:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.244295492, 2023-10-08T07:07:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.862 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.862 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.862 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.862 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.862 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175885 2023-10-08T07:07:56.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.862 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.862 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.862 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:07:56.862 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834471+0000", 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3399999999999998e-07 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.863 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834487+0000", 2023-10-08T07:07:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6209999999999999e-05 2023-10-08T07:07:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834500+0000", 2023-10-08T07:07:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2262999999999999e-05 2023-10-08T07:07:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834508+0000", 2023-10-08T07:07:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8459999999999997e-06 2023-10-08T07:07:56.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.865 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.865 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.865 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002339+0000", 2023-10-08T07:07:56.865 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16783030400000001 2023-10-08T07:07:56.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.865 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.865 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.865 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002426+0000", 2023-10-08T07:07:56.865 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6879999999999995e-05 2023-10-08T07:07:56.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.865 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.865 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002592+0000", 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000166071 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.016276+0000", 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013684392 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078657+0000", 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062380933 2023-10-08T07:07:56.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078721+0000", 2023-10-08T07:07:56.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3968999999999997e-05 2023-10-08T07:07:56.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.867 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.867 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.867 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078766+0000", 2023-10-08T07:07:56.867 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4790000000000003e-05 2023-10-08T07:07:56.867 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.867 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.867 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175982 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 1507328~4096,write 1556480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.8774497389999993, 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24593904699999999, 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175982 2023-10-08T07:07:56.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.869 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.869 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.869 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.869 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:07:56.869 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.869 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.869 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.869 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:07:56.869 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.869 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.870 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.870 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864811+0000", 2023-10-08T07:07:56.870 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3099999999999996e-07 2023-10-08T07:07:56.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.870 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.870 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.870 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864827+0000", 2023-10-08T07:07:56.870 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5141e-05 2023-10-08T07:07:56.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.870 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.870 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.870 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864839+0000", 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2343e-05 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864847+0000", 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1759999999999993e-06 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.041996+0000", 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17714919000000001 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.871 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.872 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.872 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.042044+0000", 2023-10-08T07:07:56.872 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8056000000000002e-05 2023-10-08T07:07:56.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.872 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.872 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.872 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.042173+0000", 2023-10-08T07:07:56.872 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000128283 2023-10-08T07:07:56.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.872 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.872 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.872 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.058432+0000", 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016259431000000001 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110696+0000", 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.052264104999999998 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110728+0000", 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1578999999999997e-05 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.873 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.874 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.874 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110749+0000", 2023-10-08T07:07:56.874 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1812000000000001e-05 2023-10-08T07:07:56.874 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.874 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.874 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.874 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.874 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:176059 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1564672~4096,write 1585152~4096,write 1708032~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:56.874 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:07:56.874 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 8.8546210179999996, 2023-10-08T07:07:56.874 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.23799429, 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 176059 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.876 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.876 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:56.876 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:07:56.876 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:56.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.876 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.876 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:56.876 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887640+0000", 2023-10-08T07:07:56.876 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0699999999999997e-07 2023-10-08T07:07:56.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.876 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.876 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887649+0000", 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2439999999999999e-06 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887657+0000", 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0059999999999992e-06 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887663+0000", 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7869999999999998e-06 2023-10-08T07:07:56.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.878 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:56.878 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.060892+0000", 2023-10-08T07:07:56.878 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17322955700000001 2023-10-08T07:07:56.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.878 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:56.878 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.060978+0000", 2023-10-08T07:07:56.878 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5358999999999994e-05 2023-10-08T07:07:56.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.878 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.878 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.061180+0000", 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020268400000000001 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070342+0000", 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0091617230000000001 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125534+0000", 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055191764999999997 2023-10-08T07:07:56.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125591+0000", 2023-10-08T07:07:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7606999999999999e-05 2023-10-08T07:07:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125633+0000", 2023-10-08T07:07:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1950999999999999e-05 2023-10-08T07:07:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.881 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:56.881 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:56.881 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2023-10-08T07:07:56.883 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:56.883 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:56.881+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:56.883 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2023-10-08T07:07:56.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:07:56.884 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-08T07:07:56.923 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:07:56.923 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[101284]: fuse finished with error 0 and tester_r 0 2023-10-08T07:07:56.982 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:56.982+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:57.011 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:57.011 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:57.011 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:07:57.011 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:57.021 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:57.082 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-10-08T07:07:57.083 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:57.082+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:57.148 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:57.148 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:57.148 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:57.148 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:57.148 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:57.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:57.184 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:57.183+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:57.285 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:57.284+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:57.329 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:57.329 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:07:57.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:07:57.329 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:07:57.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.330 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147479 4.0 4:02bf98b6:::10000000004.0000000e:head [write 258048~4096,write 442368~4096,write 520192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.330 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:57.330 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.796887157, 2023-10-08T07:07:57.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.462729097, 2023-10-08T07:07:57.330 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.330 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.330 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.331 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147479 2023-10-08T07:07:57.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.331 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:57.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:07:57.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533313+0000", 2023-10-08T07:07:57.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002832841 2023-10-08T07:07:57.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533338+0000", 2023-10-08T07:07:57.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5052999999999999e-05 2023-10-08T07:07:57.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533350+0000", 2023-10-08T07:07:57.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2561000000000001e-05 2023-10-08T07:07:57.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533357+0000", 2023-10-08T07:07:57.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0870000000000001e-06 2023-10-08T07:07:57.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963719+0000", 2023-10-08T07:07:57.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4303612779999999 2023-10-08T07:07:57.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963788+0000", 2023-10-08T07:07:57.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9751000000000004e-05 2023-10-08T07:07:57.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:57.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963941+0000", 2023-10-08T07:07:57.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015224499999999999 2023-10-08T07:07:57.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.971897+0000", 2023-10-08T07:07:57.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079562769999999994 2023-10-08T07:07:57.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993080+0000", 2023-10-08T07:07:57.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021183400000000002 2023-10-08T07:07:57.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993161+0000", 2023-10-08T07:07:57.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1045999999999996e-05 2023-10-08T07:07:57.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993209+0000", 2023-10-08T07:07:57.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7558000000000001e-05 2023-10-08T07:07:57.337 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.337 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.337 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.338 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147519 4.10 4:08d50e0e:::10000000004.0000003f:head [write 258048~4096,write 417792~4096,write 1318912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.338 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:57.338 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.785866119, 2023-10-08T07:07:57.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.467910235, 2023-10-08T07:07:57.338 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.338 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.338 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147519 2023-10-08T07:07:57.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.339 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:57.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:57.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:07:57.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5199999999999998e-07 2023-10-08T07:07:57.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541510+0000", 2023-10-08T07:07:57.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4690000000000003e-06 2023-10-08T07:07:57.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541515+0000", 2023-10-08T07:07:57.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7260000000000002e-06 2023-10-08T07:07:57.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541518+0000", 2023-10-08T07:07:57.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7329999999999999e-06 2023-10-08T07:07:57.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.977538+0000", 2023-10-08T07:07:57.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.436020313 2023-10-08T07:07:57.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.977630+0000", 2023-10-08T07:07:57.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1893999999999998e-05 2023-10-08T07:07:57.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009278+0000", 2023-10-08T07:07:57.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.031647661000000001 2023-10-08T07:07:57.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009334+0000", 2023-10-08T07:07:57.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6366999999999998e-05 2023-10-08T07:07:57.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009411+0000", 2023-10-08T07:07:57.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.682e-05 2023-10-08T07:07:57.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.344 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.345 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147523 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2183168~4096,write 2215936~4096,write 2228224~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.345 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:57.345 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.785825025999999, 2023-10-08T07:07:57.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4714357950000001, 2023-10-08T07:07:57.345 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.345 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.346 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.346 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147523 2023-10-08T07:07:57.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.346 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:57.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:57.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:07:57.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2023-10-08T07:07:57.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541554+0000", 2023-10-08T07:07:57.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1515000000000001e-05 2023-10-08T07:07:57.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541557+0000", 2023-10-08T07:07:57.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.675e-06 2023-10-08T07:07:57.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541560+0000", 2023-10-08T07:07:57.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.841e-06 2023-10-08T07:07:57.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980499+0000", 2023-10-08T07:07:57.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.43893866 2023-10-08T07:07:57.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980591+0000", 2023-10-08T07:07:57.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1970000000000002e-05 2023-10-08T07:07:57.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:57.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980759+0000", 2023-10-08T07:07:57.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016861099999999999 2023-10-08T07:07:57.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993040+0000", 2023-10-08T07:07:57.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012280798000000001 2023-10-08T07:07:57.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012884+0000", 2023-10-08T07:07:57.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019843573 2023-10-08T07:07:57.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012938+0000", 2023-10-08T07:07:57.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4462000000000001e-05 2023-10-08T07:07:57.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012978+0000", 2023-10-08T07:07:57.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9455000000000001e-05 2023-10-08T07:07:57.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.353 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.354 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147525 4.28 4:16edf4d3:::10000000004.00000027:head [write 1671168~4096,write 1994752~4096,write 2002944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.354 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:57.354 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.785546766, 2023-10-08T07:07:57.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4828482860000001, 2023-10-08T07:07:57.354 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.354 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.355 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.355 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147525 2023-10-08T07:07:57.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.355 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:57.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:07:57.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545293+0000", 2023-10-08T07:07:57.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034732809999999999 2023-10-08T07:07:57.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545312+0000", 2023-10-08T07:07:57.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8156999999999999e-05 2023-10-08T07:07:57.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545323+0000", 2023-10-08T07:07:57.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1215e-05 2023-10-08T07:07:57.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545331+0000", 2023-10-08T07:07:57.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2859999999999999e-06 2023-10-08T07:07:57.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.998284+0000", 2023-10-08T07:07:57.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4529525249999999 2023-10-08T07:07:57.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.998394+0000", 2023-10-08T07:07:57.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000110214 2023-10-08T07:07:57.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024519+0000", 2023-10-08T07:07:57.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026125603000000001 2023-10-08T07:07:57.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024578+0000", 2023-10-08T07:07:57.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8779000000000001e-05 2023-10-08T07:07:57.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024668+0000", 2023-10-08T07:07:57.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0226e-05 2023-10-08T07:07:57.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.361 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.361 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147529 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3813376~4096,write 3833856~4096,write 3846144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.362 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:57.362 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.781985455000001, 2023-10-08T07:07:57.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4795143450000001, 2023-10-08T07:07:57.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.362 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147529 2023-10-08T07:07:57.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.363 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:57.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:07:57.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545382+0000", 2023-10-08T07:07:57.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2023-10-08T07:07:57.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545394+0000", 2023-10-08T07:07:57.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1969e-05 2023-10-08T07:07:57.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545403+0000", 2023-10-08T07:07:57.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7460000000000006e-06 2023-10-08T07:07:57.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545408+0000", 2023-10-08T07:07:57.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6749999999999999e-06 2023-10-08T07:07:57.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.999994+0000", 2023-10-08T07:07:57.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4545859759999999 2023-10-08T07:07:57.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.000091+0000", 2023-10-08T07:07:57.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6803000000000001e-05 2023-10-08T07:07:57.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024769+0000", 2023-10-08T07:07:57.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024677977 2023-10-08T07:07:57.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024819+0000", 2023-10-08T07:07:57.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.02e-05 2023-10-08T07:07:57.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024896+0000", 2023-10-08T07:07:57.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6447999999999997e-05 2023-10-08T07:07:57.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.368 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.368 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147541 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3600384~4096,write 3616768~4096,write 3747840~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.368 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:57.368 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.779981100000001, 2023-10-08T07:07:57.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478191619, 2023-10-08T07:07:57.369 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.369 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.369 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147541 2023-10-08T07:07:57.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.369 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:57.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:57.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:07:57.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1899999999999998e-07 2023-10-08T07:07:57.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547397+0000", 2023-10-08T07:07:57.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1263999999999999e-05 2023-10-08T07:07:57.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547401+0000", 2023-10-08T07:07:57.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7409999999999998e-06 2023-10-08T07:07:57.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547404+0000", 2023-10-08T07:07:57.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9890000000000001e-06 2023-10-08T07:07:57.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.004793+0000", 2023-10-08T07:07:57.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.457389024 2023-10-08T07:07:57.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.004869+0000", 2023-10-08T07:07:57.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6027999999999998e-05 2023-10-08T07:07:57.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:57.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005024+0000", 2023-10-08T07:07:57.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015473799999999999 2023-10-08T07:07:57.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024718+0000", 2023-10-08T07:07:57.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019694555999999998 2023-10-08T07:07:57.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024905+0000", 2023-10-08T07:07:57.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018695800000000001 2023-10-08T07:07:57.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025500+0000", 2023-10-08T07:07:57.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00059492300000000002 2023-10-08T07:07:57.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025577+0000", 2023-10-08T07:07:57.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7078999999999998e-05 2023-10-08T07:07:57.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.376 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.377 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147542 4.28 4:15b6682b:::10000000004.0000000b:head [write 1032192~4096,write 1110016~4096,write 1138688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.377 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:57.377 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.779958370999999, 2023-10-08T07:07:57.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478297658, 2023-10-08T07:07:57.377 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.377 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.377 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147542 2023-10-08T07:07:57.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.378 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:57.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:07:57.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549299+0000", 2023-10-08T07:07:57.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018905650000000001 2023-10-08T07:07:57.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549316+0000", 2023-10-08T07:07:57.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7065999999999999e-05 2023-10-08T07:07:57.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549327+0000", 2023-10-08T07:07:57.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0573e-05 2023-10-08T07:07:57.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549335+0000", 2023-10-08T07:07:57.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9410000000000007e-06 2023-10-08T07:07:57.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005115+0000", 2023-10-08T07:07:57.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.455780069 2023-10-08T07:07:57.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005188+0000", 2023-10-08T07:07:57.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3668e-05 2023-10-08T07:07:57.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025587+0000", 2023-10-08T07:07:57.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020398199999999998 2023-10-08T07:07:57.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025640+0000", 2023-10-08T07:07:57.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2023-10-08T07:07:57.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025706+0000", 2023-10-08T07:07:57.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6589999999999998e-05 2023-10-08T07:07:57.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.383 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.383 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147545 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3223552~4096,write 3239936~4096,write 3317760~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.383 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:57.383 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.777969564999999, 2023-10-08T07:07:57.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.485135557, 2023-10-08T07:07:57.383 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.384 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.384 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.384 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147545 2023-10-08T07:07:57.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.384 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:57.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:07:57.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549407+0000", 2023-10-08T07:07:57.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103e-05 2023-10-08T07:07:57.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549421+0000", 2023-10-08T07:07:57.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3995999999999999e-05 2023-10-08T07:07:57.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549430+0000", 2023-10-08T07:07:57.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3329999999999997e-06 2023-10-08T07:07:57.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549443+0000", 2023-10-08T07:07:57.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3492000000000001e-05 2023-10-08T07:07:57.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009122+0000", 2023-10-08T07:07:57.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4596791790000001 2023-10-08T07:07:57.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009194+0000", 2023-10-08T07:07:57.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1960999999999998e-05 2023-10-08T07:07:57.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:57.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009336+0000", 2023-10-08T07:07:57.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014156999999999999 2023-10-08T07:07:57.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025872+0000", 2023-10-08T07:07:57.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016536417000000001 2023-10-08T07:07:57.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034437+0000", 2023-10-08T07:07:57.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085645029999999994 2023-10-08T07:07:57.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034492+0000", 2023-10-08T07:07:57.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4688999999999998e-05 2023-10-08T07:07:57.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034533+0000", 2023-10-08T07:07:57.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1313999999999998e-05 2023-10-08T07:07:57.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.390 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.390 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147579 4.28 4:15b6682b:::10000000004.0000000b:head [write 3035136~8192,write 3059712~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.390 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:57.390 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.764022529, 2023-10-08T07:07:57.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.462488893, 2023-10-08T07:07:57.391 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.391 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.391 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147579 2023-10-08T07:07:57.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.391 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:57.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:07:57.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563345+0000", 2023-10-08T07:07:57.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000005e-07 2023-10-08T07:07:57.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563359+0000", 2023-10-08T07:07:57.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4199000000000001e-05 2023-10-08T07:07:57.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563366+0000", 2023-10-08T07:07:57.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8619999999999997e-06 2023-10-08T07:07:57.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563371+0000", 2023-10-08T07:07:57.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4060000000000004e-06 2023-10-08T07:07:57.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009484+0000", 2023-10-08T07:07:57.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4461131300000001 2023-10-08T07:07:57.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009562+0000", 2023-10-08T07:07:57.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8046999999999993e-05 2023-10-08T07:07:57.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025714+0000", 2023-10-08T07:07:57.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016151327 2023-10-08T07:07:57.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025754+0000", 2023-10-08T07:07:57.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0049000000000002e-05 2023-10-08T07:07:57.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025833+0000", 2023-10-08T07:07:57.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9395999999999997e-05 2023-10-08T07:07:57.396 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.396 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.397 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147591 4.28 4:16edf4d3:::10000000004.00000027:head [write 684032~4096,write 741376~4096,write 765952~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.397 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:57.397 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.759923664, 2023-10-08T07:07:57.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4805182619999999, 2023-10-08T07:07:57.397 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.397 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.397 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.397 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.398 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147591 2023-10-08T07:07:57.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.398 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:57.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:07:57.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567444+0000", 2023-10-08T07:07:57.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8500000000000001e-07 2023-10-08T07:07:57.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567456+0000", 2023-10-08T07:07:57.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2221e-05 2023-10-08T07:07:57.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567463+0000", 2023-10-08T07:07:57.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.652e-06 2023-10-08T07:07:57.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567468+0000", 2023-10-08T07:07:57.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8500000000000002e-06 2023-10-08T07:07:57.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025908+0000", 2023-10-08T07:07:57.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.458440948 2023-10-08T07:07:57.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.026004+0000", 2023-10-08T07:07:57.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5805999999999997e-05 2023-10-08T07:07:57.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047842+0000", 2023-10-08T07:07:57.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021837770999999999 2023-10-08T07:07:57.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047894+0000", 2023-10-08T07:07:57.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2079000000000001e-05 2023-10-08T07:07:57.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047961+0000", 2023-10-08T07:07:57.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7349999999999997e-05 2023-10-08T07:07:57.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.404 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.404 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147596 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2379776~4096,write 2428928~4096,write 2531328~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.404 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:57.404 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.758012041000001, 2023-10-08T07:07:57.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478728255, 2023-10-08T07:07:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147596 2023-10-08T07:07:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:07:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571294+0000", 2023-10-08T07:07:57.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001939037 2023-10-08T07:07:57.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571314+0000", 2023-10-08T07:07:57.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9791000000000001e-05 2023-10-08T07:07:57.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571327+0000", 2023-10-08T07:07:57.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3078000000000001e-05 2023-10-08T07:07:57.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571334+0000", 2023-10-08T07:07:57.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2429999999999999e-06 2023-10-08T07:07:57.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.028808+0000", 2023-10-08T07:07:57.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4574743030000001 2023-10-08T07:07:57.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.028888+0000", 2023-10-08T07:07:57.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9818e-05 2023-10-08T07:07:57.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047970+0000", 2023-10-08T07:07:57.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019082359 2023-10-08T07:07:57.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048017+0000", 2023-10-08T07:07:57.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6943000000000001e-05 2023-10-08T07:07:57.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048083+0000", 2023-10-08T07:07:57.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5683000000000001e-05 2023-10-08T07:07:57.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.413 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.413 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147608 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3088384~4096,write 3145728~4096,write 3276800~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.413 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:57.413 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.749975754999999, 2023-10-08T07:07:57.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4708017579999999, 2023-10-08T07:07:57.414 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.414 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.414 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147608 2023-10-08T07:07:57.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.414 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:57.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:07:57.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577392+0000", 2023-10-08T07:07:57.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2023-10-08T07:07:57.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577404+0000", 2023-10-08T07:07:57.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2544999999999999e-05 2023-10-08T07:07:57.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577411+0000", 2023-10-08T07:07:57.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4219999999999997e-06 2023-10-08T07:07:57.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577416+0000", 2023-10-08T07:07:57.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9729999999999997e-06 2023-10-08T07:07:57.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031697+0000", 2023-10-08T07:07:57.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.454281656 2023-10-08T07:07:57.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031771+0000", 2023-10-08T07:07:57.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3440000000000002e-05 2023-10-08T07:07:57.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048095+0000", 2023-10-08T07:07:57.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016324241999999999 2023-10-08T07:07:57.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048134+0000", 2023-10-08T07:07:57.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9558999999999999e-05 2023-10-08T07:07:57.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048193+0000", 2023-10-08T07:07:57.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8409999999999998e-05 2023-10-08T07:07:57.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.420 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.420 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.420 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147614 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2973696~4096,write 3149824~4096,write 3158016~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.420 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:57.420 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.747985356999999, 2023-10-08T07:07:57.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4709725659999999, 2023-10-08T07:07:57.420 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.420 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.421 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.421 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147614 2023-10-08T07:07:57.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.421 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:57.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:57.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:07:57.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.51e-07 2023-10-08T07:07:57.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579394+0000", 2023-10-08T07:07:57.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.207e-05 2023-10-08T07:07:57.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579401+0000", 2023-10-08T07:07:57.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3900000000000004e-06 2023-10-08T07:07:57.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579406+0000", 2023-10-08T07:07:57.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9490000000000004e-06 2023-10-08T07:07:57.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031686+0000", 2023-10-08T07:07:57.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4522797299999999 2023-10-08T07:07:57.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031763+0000", 2023-10-08T07:07:57.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6432000000000003e-05 2023-10-08T07:07:57.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:57.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031910+0000", 2023-10-08T07:07:57.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014741900000000001 2023-10-08T07:07:57.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048090+0000", 2023-10-08T07:07:57.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016179948999999999 2023-10-08T07:07:57.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050261+0000", 2023-10-08T07:07:57.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021715860000000001 2023-10-08T07:07:57.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050320+0000", 2023-10-08T07:07:57.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8217999999999997e-05 2023-10-08T07:07:57.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050354+0000", 2023-10-08T07:07:57.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4372000000000002e-05 2023-10-08T07:07:57.426 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.427 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.427 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147623 4.28 4:16edf4d3:::10000000004.00000027:head [write 1306624~4096,write 1331200~4096,write 1429504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.427 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:57.427 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.747862171, 2023-10-08T07:07:57.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.497941188, 2023-10-08T07:07:57.427 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.427 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147623 2023-10-08T07:07:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:57.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:07:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582310+0000", 2023-10-08T07:07:57.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028050800000000002 2023-10-08T07:07:57.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582327+0000", 2023-10-08T07:07:57.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6807e-05 2023-10-08T07:07:57.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582337+0000", 2023-10-08T07:07:57.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0454e-05 2023-10-08T07:07:57.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582344+0000", 2023-10-08T07:07:57.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2239999999999998e-06 2023-10-08T07:07:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.052947+0000", 2023-10-08T07:07:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4706025979999999 2023-10-08T07:07:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.053025+0000", 2023-10-08T07:07:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7985000000000006e-05 2023-10-08T07:07:57.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077312+0000", 2023-10-08T07:07:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024286855999999999 2023-10-08T07:07:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077368+0000", 2023-10-08T07:07:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5834000000000001e-05 2023-10-08T07:07:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077446+0000", 2023-10-08T07:07:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8349999999999994e-05 2023-10-08T07:07:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147645 4.0 4:02bf98b6:::10000000004.0000000e:head [write 1941504~4096,write 2043904~4096,write 2076672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.737009878, 2023-10-08T07:07:57.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4872246599999999, 2023-10-08T07:07:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147645 2023-10-08T07:07:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:57.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:07:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0100000000000001e-07 2023-10-08T07:07:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590367+0000", 2023-10-08T07:07:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2830000000000007e-06 2023-10-08T07:07:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590372+0000", 2023-10-08T07:07:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0880000000000002e-06 2023-10-08T07:07:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590375+0000", 2023-10-08T07:07:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9869999999999999e-06 2023-10-08T07:07:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055521+0000", 2023-10-08T07:07:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4651462099999999 2023-10-08T07:07:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055589+0000", 2023-10-08T07:07:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7916999999999994e-05 2023-10-08T07:07:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055718+0000", 2023-10-08T07:07:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012877200000000001 2023-10-08T07:07:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.076842+0000", 2023-10-08T07:07:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021124074999999999 2023-10-08T07:07:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077494+0000", 2023-10-08T07:07:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00065233700000000001 2023-10-08T07:07:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077539+0000", 2023-10-08T07:07:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4829000000000001e-05 2023-10-08T07:07:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077582+0000", 2023-10-08T07:07:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2861000000000002e-05 2023-10-08T07:07:57.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147649 4.10 4:08d50e0e:::10000000004.0000003f:head [write 1347584~4096,write 1568768~4096,write 1728512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.736988154000001, 2023-10-08T07:07:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4873494039999999, 2023-10-08T07:07:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147649 2023-10-08T07:07:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:07:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7399999999999999e-07 2023-10-08T07:07:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590389+0000", 2023-10-08T07:07:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7019999999999996e-06 2023-10-08T07:07:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590394+0000", 2023-10-08T07:07:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1229999999999999e-06 2023-10-08T07:07:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590397+0000", 2023-10-08T07:07:57.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8480000000000001e-06 2023-10-08T07:07:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.056106+0000", 2023-10-08T07:07:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4657090159999999 2023-10-08T07:07:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.056177+0000", 2023-10-08T07:07:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1148000000000004e-05 2023-10-08T07:07:57.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077593+0000", 2023-10-08T07:07:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021416101 2023-10-08T07:07:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077652+0000", 2023-10-08T07:07:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9005999999999997e-05 2023-10-08T07:07:57.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077728+0000", 2023-10-08T07:07:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6186000000000005e-05 2023-10-08T07:07:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147667 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2600960~4096,write 2826240~4096,write 2871296~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:57.449 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.73282773, 2023-10-08T07:07:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4900356029999999, 2023-10-08T07:07:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147667 2023-10-08T07:07:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:07:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596594+0000", 2023-10-08T07:07:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020548599999999999 2023-10-08T07:07:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596614+0000", 2023-10-08T07:07:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0228e-05 2023-10-08T07:07:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596625+0000", 2023-10-08T07:07:57.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0721e-05 2023-10-08T07:07:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596633+0000", 2023-10-08T07:07:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5900000000000002e-06 2023-10-08T07:07:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.059476+0000", 2023-10-08T07:07:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4628431820000001 2023-10-08T07:07:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.059555+0000", 2023-10-08T07:07:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9192999999999999e-05 2023-10-08T07:07:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084434+0000", 2023-10-08T07:07:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024879571999999999 2023-10-08T07:07:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084501+0000", 2023-10-08T07:07:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6129000000000003e-05 2023-10-08T07:07:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084575+0000", 2023-10-08T07:07:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4128000000000006e-05 2023-10-08T07:07:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147702 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3768320~4096,write 3788800~4096,write 3817472~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.709800449999999, 2023-10-08T07:07:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4668568, 2023-10-08T07:07:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.456 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147702 2023-10-08T07:07:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:07:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617567+0000", 2023-10-08T07:07:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2023-10-08T07:07:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617578+0000", 2023-10-08T07:07:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0922e-05 2023-10-08T07:07:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617584+0000", 2023-10-08T07:07:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7849999999999997e-06 2023-10-08T07:07:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617588+0000", 2023-10-08T07:07:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6310000000000002e-06 2023-10-08T07:07:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062218+0000", 2023-10-08T07:07:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4446299810000001 2023-10-08T07:07:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062303+0000", 2023-10-08T07:07:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4648999999999995e-05 2023-10-08T07:07:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:07:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062425+0000", 2023-10-08T07:07:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012220899999999999 2023-10-08T07:07:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.076883+0000", 2023-10-08T07:07:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014458354 2023-10-08T07:07:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084302+0000", 2023-10-08T07:07:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074189310000000001 2023-10-08T07:07:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084374+0000", 2023-10-08T07:07:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1519000000000004e-05 2023-10-08T07:07:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084423+0000", 2023-10-08T07:07:57.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000003e-05 2023-10-08T07:07:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147713 4.28 4:15b6682b:::10000000004.0000000b:head [write 2990080~4096,write 3133440~4096,write 3362816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.709667927, 2023-10-08T07:07:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707889380000001, 2023-10-08T07:07:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147713 2023-10-08T07:07:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:07:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.89e-07 2023-10-08T07:07:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617718+0000", 2023-10-08T07:07:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8287e-05 2023-10-08T07:07:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617724+0000", 2023-10-08T07:07:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7939999999999997e-06 2023-10-08T07:07:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617730+0000", 2023-10-08T07:07:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1819999999999997e-06 2023-10-08T07:07:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062893+0000", 2023-10-08T07:07:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4451633429999999 2023-10-08T07:07:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062969+0000", 2023-10-08T07:07:57.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6119999999999996e-05 2023-10-08T07:07:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088335+0000", 2023-10-08T07:07:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025366289 2023-10-08T07:07:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088399+0000", 2023-10-08T07:07:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4067999999999997e-05 2023-10-08T07:07:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088488+0000", 2023-10-08T07:07:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8466000000000003e-05 2023-10-08T07:07:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147714 4.28 4:15b6682b:::10000000004.0000000b:head [write 1286144~4096,write 1372160~4096,write 1523712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:07:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 15.709629817, 2023-10-08T07:07:57.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.471492757, 2023-10-08T07:07:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:07:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:07:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:07:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147714 2023-10-08T07:07:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:07:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:07:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:57.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:07:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:07:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:07:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:07:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:07:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:07:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617751+0000", 2023-10-08T07:07:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3570000000000001e-05 2023-10-08T07:07:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:07:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617757+0000", 2023-10-08T07:07:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.229e-06 2023-10-08T07:07:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617762+0000", 2023-10-08T07:07:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7670000000000003e-06 2023-10-08T07:07:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:07:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.068000+0000", 2023-10-08T07:07:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4502380930000001 2023-10-08T07:07:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:07:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.068049+0000", 2023-10-08T07:07:57.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9051999999999997e-05 2023-10-08T07:07:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:07:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089117+0000", 2023-10-08T07:07:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021067536000000001 2023-10-08T07:07:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:07:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089164+0000", 2023-10-08T07:07:57.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7178999999999997e-05 2023-10-08T07:07:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:07:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:07:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:07:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089230+0000", 2023-10-08T07:07:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5896999999999996e-05 2023-10-08T07:07:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:07:57.475 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:07:57.475 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:57.477 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:57.475+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:57.477 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:57.578 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:57.577+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:57.614 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:57.614 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:57.614 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:07:57.614 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:57.624 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:57.678 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:57.677+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:57.756 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:57.757 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:07:57.757 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:07:57.757 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:07:57.757 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:57.767 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:57.779 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:57.779+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:57.881 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:57.880+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:57.941 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:07:57.942 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:07:57.942 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:07:57.942 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:07:57.942 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.942 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175316 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 696320~4096,write 745472~4096,write 942080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:57.942 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:07:57.943 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.277484962999999, 2023-10-08T07:07:57.943 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.239832828, 2023-10-08T07:07:57.943 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:57.943 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.943 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:57.943 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:57.943 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.943 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175316 2023-10-08T07:07:57.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.944 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:57.944 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.944 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:57.944 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:07:57.944 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.944 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.944 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:57.945 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:07:57.945 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.945 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.945 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:57.945 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662052+0000", 2023-10-08T07:07:57.945 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9599999999999998e-07 2023-10-08T07:07:57.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.946 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:57.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662064+0000", 2023-10-08T07:07:57.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.226e-05 2023-10-08T07:07:57.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.946 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.946 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:57.946 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662074+0000", 2023-10-08T07:07:57.946 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0057999999999999e-05 2023-10-08T07:07:57.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.947 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662082+0000", 2023-10-08T07:07:57.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.593e-06 2023-10-08T07:07:57.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.947 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.947 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:57.947 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.868775+0000", 2023-10-08T07:07:57.947 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.20669354700000001 2023-10-08T07:07:57.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.948 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.948 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:57.948 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.868864+0000", 2023-10-08T07:07:57.948 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9174999999999999e-05 2023-10-08T07:07:57.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.948 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.948 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:57.948 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.869012+0000", 2023-10-08T07:07:57.949 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014747 2023-10-08T07:07:57.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.949 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:57.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.885657+0000", 2023-10-08T07:07:57.949 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016645008999999999 2023-10-08T07:07:57.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.949 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.949 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.949 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901768+0000", 2023-10-08T07:07:57.950 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016110721000000001 2023-10-08T07:07:57.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.950 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.950 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:57.950 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901841+0000", 2023-10-08T07:07:57.950 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3047999999999996e-05 2023-10-08T07:07:57.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.950 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.950 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:57.950 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901884+0000", 2023-10-08T07:07:57.951 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3050999999999998e-05 2023-10-08T07:07:57.951 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.951 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:57.951 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.951 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.951 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175432 4.1a 4:5a59f83a:::10000000004.00000002:head [write 196608~4096,write 245760~4096,write 270336~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:57.952 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:07:57.952 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.240366988, 2023-10-08T07:07:57.952 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.23774203799999999, 2023-10-08T07:07:57.952 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:57.952 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.952 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:57.952 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:57.952 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.952 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175432 2023-10-08T07:07:57.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.953 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:57.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:57.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:07:57.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.953 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.953 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:57.953 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:07:57.953 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.954 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:57.954 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699170+0000", 2023-10-08T07:07:57.954 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:07:57.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.954 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.954 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:57.954 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699181+0000", 2023-10-08T07:07:57.954 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1581e-05 2023-10-08T07:07:57.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.955 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.955 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:57.955 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699199+0000", 2023-10-08T07:07:57.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7376000000000001e-05 2023-10-08T07:07:57.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.955 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.955 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.955 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699206+0000", 2023-10-08T07:07:57.955 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7190000000000001e-06 2023-10-08T07:07:57.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.956 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:57.956 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907275+0000", 2023-10-08T07:07:57.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.20806835700000001 2023-10-08T07:07:57.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.956 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.956 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:57.956 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907359+0000", 2023-10-08T07:07:57.956 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4320999999999994e-05 2023-10-08T07:07:57.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:57.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907546+0000", 2023-10-08T07:07:57.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018752299999999999 2023-10-08T07:07:57.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:57.957 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.925780+0000", 2023-10-08T07:07:57.957 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018233909999999999 2023-10-08T07:07:57.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.957 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.957 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.958 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936786+0000", 2023-10-08T07:07:57.958 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011005355 2023-10-08T07:07:57.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:57.958 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936868+0000", 2023-10-08T07:07:57.958 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1917999999999997e-05 2023-10-08T07:07:57.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.958 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.958 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:57.958 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936911+0000", 2023-10-08T07:07:57.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3207999999999997e-05 2023-10-08T07:07:57.959 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.959 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:57.959 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.959 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.959 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175676 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2719744~4096,write 2822144~4096,write 2945024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:57.959 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:07:57.959 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.168267630000001, 2023-10-08T07:07:57.959 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24978785000000001, 2023-10-08T07:07:57.959 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:57.960 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.960 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:57.960 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:57.960 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.960 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175676 2023-10-08T07:07:57.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.960 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:57.960 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.960 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:57.960 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:07:57.960 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:57.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:07:57.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:57.961 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771269+0000", 2023-10-08T07:07:57.961 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7100000000000002e-07 2023-10-08T07:07:57.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.961 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:57.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771287+0000", 2023-10-08T07:07:57.962 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8022000000000001e-05 2023-10-08T07:07:57.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.962 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.962 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:57.962 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771293+0000", 2023-10-08T07:07:57.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3029999999999996e-06 2023-10-08T07:07:57.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771297+0000", 2023-10-08T07:07:57.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2830000000000003e-06 2023-10-08T07:07:57.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.963 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.963 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:57.963 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.961848+0000", 2023-10-08T07:07:57.963 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.190550999 2023-10-08T07:07:57.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.964 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:57.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.961954+0000", 2023-10-08T07:07:57.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000105485 2023-10-08T07:07:57.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.964 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:57.964 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.962114+0000", 2023-10-08T07:07:57.964 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016024499999999999 2023-10-08T07:07:57.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:57.965 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.975848+0000", 2023-10-08T07:07:57.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013733886000000001 2023-10-08T07:07:57.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.965 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.020956+0000", 2023-10-08T07:07:57.965 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045108400999999999 2023-10-08T07:07:57.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.965 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.965 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:57.965 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021013+0000", 2023-10-08T07:07:57.966 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6277999999999999e-05 2023-10-08T07:07:57.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.966 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.966 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:57.966 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021056+0000", 2023-10-08T07:07:57.966 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3377000000000002e-05 2023-10-08T07:07:57.966 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.966 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:57.966 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175680 4.3a 4:5f183e4b:::10000000004.00000023:head [write 3502080~4096,write 3534848~4096,write 3608576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.166322697, 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24812537200000001, 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175680 2023-10-08T07:07:57.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.968 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:57.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.968 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:57.968 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:07:57.968 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.968 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:57.968 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:07:57.968 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.969 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:57.969 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773214+0000", 2023-10-08T07:07:57.969 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.403e-06 2023-10-08T07:07:57.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.969 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.969 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:57.969 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773227+0000", 2023-10-08T07:07:57.969 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3001e-05 2023-10-08T07:07:57.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.969 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.969 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:57.969 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773240+0000", 2023-10-08T07:07:57.970 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2441e-05 2023-10-08T07:07:57.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.970 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.970 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.970 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773249+0000", 2023-10-08T07:07:57.970 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8890000000000008e-06 2023-10-08T07:07:57.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:57.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964327+0000", 2023-10-08T07:07:57.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19107864499999999 2023-10-08T07:07:57.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:57.971 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964418+0000", 2023-10-08T07:07:57.971 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0131999999999997e-05 2023-10-08T07:07:57.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.971 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964602+0000", 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000184711 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976021+0000", 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011418822 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021236+0000", 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045214467000000001 2023-10-08T07:07:57.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:57.973 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021303+0000", 2023-10-08T07:07:57.973 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7210000000000002e-05 2023-10-08T07:07:57.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.973 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.973 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:57.973 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021338+0000", 2023-10-08T07:07:57.973 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5651000000000001e-05 2023-10-08T07:07:57.974 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.974 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:57.974 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.974 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.974 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175690 4.1a 4:5a59f83a:::10000000004.00000002:head [write 405504~4096,write 811008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:57.974 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:07:57.974 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.163768931, 2023-10-08T07:07:57.974 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.245421262, 2023-10-08T07:07:57.974 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:57.974 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.974 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:57.975 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:57.975 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.975 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175690 2023-10-08T07:07:57.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.975 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:57.975 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.975 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:57.975 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:07:57.975 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:57.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:07:57.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.976 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:57.976 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:07:57.976 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:07:57.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:57.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775774+0000", 2023-10-08T07:07:57.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9460000000000001e-06 2023-10-08T07:07:57.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:57.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775781+0000", 2023-10-08T07:07:57.977 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8349999999999998e-06 2023-10-08T07:07:57.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.977 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.977 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.977 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775785+0000", 2023-10-08T07:07:57.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7290000000000002e-06 2023-10-08T07:07:57.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:57.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967188+0000", 2023-10-08T07:07:57.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19140304299999999 2023-10-08T07:07:57.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.978 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:57.978 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967267+0000", 2023-10-08T07:07:57.978 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9154999999999997e-05 2023-10-08T07:07:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967405+0000", 2023-10-08T07:07:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000137618 2023-10-08T07:07:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976028+0000", 2023-10-08T07:07:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0086236869999999997 2023-10-08T07:07:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.980 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021096+0000", 2023-10-08T07:07:57.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045067928 2023-10-08T07:07:57.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.980 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.980 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:57.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021147+0000", 2023-10-08T07:07:57.980 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0399000000000003e-05 2023-10-08T07:07:57.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.980 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.980 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:57.980 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021188+0000", 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1386e-05 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175692 4.a 4:524fba76:::10000000004.0000001b:head [write 737280~4096,write 749568~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.163315209, 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25024756399999998, 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.981 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:57.982 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:57.982 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.982 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175692 2023-10-08T07:07:57.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.982 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:57.983 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.983 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:57.983 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:07:57.983 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.984 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:57.984 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:07:57.984 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.984 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:57.984 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:07:57.985 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1200000000000003e-07 2023-10-08T07:07:57.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.985 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:57.985 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776238+0000", 2023-10-08T07:07:57.985 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7269e-05 2023-10-08T07:07:57.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.985 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.985 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:57.985 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776247+0000", 2023-10-08T07:07:57.985 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5189999999999992e-06 2023-10-08T07:07:57.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.986 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.986 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.986 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776251+0000", 2023-10-08T07:07:57.986 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7910000000000002e-06 2023-10-08T07:07:57.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:57.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967925+0000", 2023-10-08T07:07:57.989 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19167456299999999 2023-10-08T07:07:57.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.989 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:57.989 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967997+0000", 2023-10-08T07:07:57.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1666000000000001e-05 2023-10-08T07:07:57.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.990 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:57.990 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.968122+0000", 2023-10-08T07:07:57.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012469 2023-10-08T07:07:57.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.990 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:57.990 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976268+0000", 2023-10-08T07:07:57.990 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0081468770000000003 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026375+0000", 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050106683999999999 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026430+0000", 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4506999999999998e-05 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.991 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:57.992 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026468+0000", 2023-10-08T07:07:57.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8485999999999997e-05 2023-10-08T07:07:57.992 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.992 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:57.992 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.992 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175701 4.a 4:524fba76:::10000000004.0000001b:head [write 1503232~4096,write 1540096~4096,write 1560576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:57.992 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:07:57.992 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.160471531000001, 2023-10-08T07:07:57.992 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.257645717, 2023-10-08T07:07:57.992 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:57.993 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.993 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:57.993 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:57.993 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:57.993 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175701 2023-10-08T07:07:57.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.993 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:57.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.993 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:57.993 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:07:57.993 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:07:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779065+0000", 2023-10-08T07:07:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6300000000000005e-07 2023-10-08T07:07:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.994 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:57.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779074+0000", 2023-10-08T07:07:57.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7010000000000002e-06 2023-10-08T07:07:57.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:57.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779090+0000", 2023-10-08T07:07:57.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6171000000000002e-05 2023-10-08T07:07:57.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.995 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:57.995 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779095+0000", 2023-10-08T07:07:57.995 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9169999999999997e-06 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971272+0000", 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.192177024 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971364+0000", 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2102999999999996e-05 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.996 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:57.997 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971480+0000", 2023-10-08T07:07:57.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000116307 2023-10-08T07:07:57.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.997 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:57.997 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.980645+0000", 2023-10-08T07:07:57.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0091647559999999996 2023-10-08T07:07:57.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.997 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:57.997 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036634+0000", 2023-10-08T07:07:57.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055989555000000003 2023-10-08T07:07:57.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.998 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.998 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:57.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036673+0000", 2023-10-08T07:07:57.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8285999999999999e-05 2023-10-08T07:07:57.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.998 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.998 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:57.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036710+0000", 2023-10-08T07:07:57.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7234000000000003e-05 2023-10-08T07:07:57.998 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.998 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:57.999 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:57.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:57.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:57.999 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175733 4.a 4:524fba76:::10000000004.0000001b:head [write 2154496~4096,write 2281472~4096,write 2306048~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:57.999 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:07:57.999 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.149644765, 2023-10-08T07:07:57.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25628842600000001, 2023-10-08T07:07:57.999 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:57.999 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:57.999 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:57.999 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.000 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.000 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175733 2023-10-08T07:07:58.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.000 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:07:58.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:07:58.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:07:58.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4900000000000001e-07 2023-10-08T07:07:58.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.002 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789903+0000", 2023-10-08T07:07:58.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1391e-05 2023-10-08T07:07:58.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789909+0000", 2023-10-08T07:07:58.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6460000000000004e-06 2023-10-08T07:07:58.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789916+0000", 2023-10-08T07:07:58.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.635e-06 2023-10-08T07:07:58.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976385+0000", 2023-10-08T07:07:58.005 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18646858799999999 2023-10-08T07:07:58.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.005 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976432+0000", 2023-10-08T07:07:58.005 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6885000000000003e-05 2023-10-08T07:07:58.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.005 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.005 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.005 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976521+0000", 2023-10-08T07:07:58.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9122999999999994e-05 2023-10-08T07:07:58.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.006 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.006 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.987479+0000", 2023-10-08T07:07:58.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0109579 2023-10-08T07:07:58.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.006 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.006 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046084+0000", 2023-10-08T07:07:58.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058605813999999999 2023-10-08T07:07:58.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.007 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.007 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.007 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046140+0000", 2023-10-08T07:07:58.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5770999999999998e-05 2023-10-08T07:07:58.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.007 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.007 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.007 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046179+0000", 2023-10-08T07:07:58.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9224000000000003e-05 2023-10-08T07:07:58.007 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.007 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175743 4.a 4:524fba76:::10000000004.0000001b:head [write 233472~4096,write 684032~4096,write 704512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.146266453000001, 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25305127599999999, 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.008 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175743 2023-10-08T07:07:58.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.009 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:07:58.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:07:58.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793270+0000", 2023-10-08T07:07:58.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8200000000000008e-07 2023-10-08T07:07:58.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793291+0000", 2023-10-08T07:07:58.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1058000000000001e-05 2023-10-08T07:07:58.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793303+0000", 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1836e-05 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793312+0000", 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5809999999999997e-06 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.978869+0000", 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18555693400000001 2023-10-08T07:07:58.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.012 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.012 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.978955+0000", 2023-10-08T07:07:58.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6318999999999998e-05 2023-10-08T07:07:58.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.012 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.012 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.979104+0000", 2023-10-08T07:07:58.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014935 2023-10-08T07:07:58.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.987482+0000", 2023-10-08T07:07:58.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083776749999999994 2023-10-08T07:07:58.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046228+0000", 2023-10-08T07:07:58.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058745516999999997 2023-10-08T07:07:58.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.013 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.013 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.013 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046285+0000", 2023-10-08T07:07:58.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7358000000000002e-05 2023-10-08T07:07:58.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.014 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046321+0000", 2023-10-08T07:07:58.014 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5666e-05 2023-10-08T07:07:58.014 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.014 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.014 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.015 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175759 4.a 4:524fba76:::10000000004.0000001b:head [write 2719744~4096,write 2756608~4096,write 2940928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:58.015 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:07:58.015 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.142495881, 2023-10-08T07:07:58.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24944019200000001, 2023-10-08T07:07:58.015 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:58.015 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:58.015 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:58.015 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.015 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.015 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175759 2023-10-08T07:07:58.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.016 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:07:58.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:07:58.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:07:58.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6600000000000003e-07 2023-10-08T07:07:58.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797047+0000", 2023-10-08T07:07:58.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3600000000000001e-06 2023-10-08T07:07:58.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797050+0000", 2023-10-08T07:07:58.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6990000000000001e-06 2023-10-08T07:07:58.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797054+0000", 2023-10-08T07:07:58.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3450000000000002e-06 2023-10-08T07:07:58.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981409+0000", 2023-10-08T07:07:58.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18435503 2023-10-08T07:07:58.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981491+0000", 2023-10-08T07:07:58.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2538000000000002e-05 2023-10-08T07:07:58.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981690+0000", 2023-10-08T07:07:58.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019896200000000001 2023-10-08T07:07:58.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989237+0000", 2023-10-08T07:07:58.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0075464410000000001 2023-10-08T07:07:58.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046393+0000", 2023-10-08T07:07:58.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.057156086000000002 2023-10-08T07:07:58.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046445+0000", 2023-10-08T07:07:58.021 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2437e-05 2023-10-08T07:07:58.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046480+0000", 2023-10-08T07:07:58.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5027999999999997e-05 2023-10-08T07:07:58.022 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.022 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.022 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.023 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175778 4.a 4:524fba76:::10000000004.0000001b:head [write 901120~4096,write 1118208~4096,write 1249280~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:58.023 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:07:58.023 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.137425304000001, 2023-10-08T07:07:58.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.26243437800000002, 2023-10-08T07:07:58.023 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:58.023 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:58.023 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:58.023 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.023 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.024 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175778 2023-10-08T07:07:58.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.024 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:07:58.024 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:07:58.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802111+0000", 2023-10-08T07:07:58.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6000000000000003e-07 2023-10-08T07:07:58.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.026 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802131+0000", 2023-10-08T07:07:58.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0109999999999999e-05 2023-10-08T07:07:58.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.026 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802142+0000", 2023-10-08T07:07:58.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0549e-05 2023-10-08T07:07:58.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.027 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.027 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802149+0000", 2023-10-08T07:07:58.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5229999999999998e-06 2023-10-08T07:07:58.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.027 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.027 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983625+0000", 2023-10-08T07:07:58.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18147571200000001 2023-10-08T07:07:58.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.028 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983673+0000", 2023-10-08T07:07:58.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8007000000000003e-05 2023-10-08T07:07:58.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.028 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983764+0000", 2023-10-08T07:07:58.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1242000000000005e-05 2023-10-08T07:07:58.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989240+0000", 2023-10-08T07:07:58.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054752689999999996 2023-10-08T07:07:58.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.030 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.030 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064441+0000", 2023-10-08T07:07:58.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.075201198999999996 2023-10-08T07:07:58.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.030 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.030 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064504+0000", 2023-10-08T07:07:58.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3219999999999994e-05 2023-10-08T07:07:58.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.031 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.031 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064545+0000", 2023-10-08T07:07:58.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0886999999999997e-05 2023-10-08T07:07:58.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.031 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.032 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175787 4.3a 4:5f183e4b:::10000000004.00000023:head [write 884736~4096,write 958464~4096,write 1261568~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:58.032 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:07:58.032 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.134836351000001, 2023-10-08T07:07:58.032 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25984544300000001, 2023-10-08T07:07:58.032 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:58.032 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:58.032 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:58.032 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.033 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.033 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175787 2023-10-08T07:07:58.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.033 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:07:58.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:07:58.034 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.034 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804700+0000", 2023-10-08T07:07:58.034 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1299999999999999e-07 2023-10-08T07:07:58.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804723+0000", 2023-10-08T07:07:58.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.304e-05 2023-10-08T07:07:58.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804735+0000", 2023-10-08T07:07:58.036 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1693e-05 2023-10-08T07:07:58.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.036 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.036 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804742+0000", 2023-10-08T07:07:58.036 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5869999999999998e-06 2023-10-08T07:07:58.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.036 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.036 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983619+0000", 2023-10-08T07:07:58.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.178877123 2023-10-08T07:07:58.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.037 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.037 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983667+0000", 2023-10-08T07:07:58.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8510999999999997e-05 2023-10-08T07:07:58.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.037 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.037 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.037 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983763+0000", 2023-10-08T07:07:58.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5902000000000004e-05 2023-10-08T07:07:58.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.038 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.038 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989243+0000", 2023-10-08T07:07:58.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054799389999999996 2023-10-08T07:07:58.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.038 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.038 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064453+0000", 2023-10-08T07:07:58.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.075209837000000002 2023-10-08T07:07:58.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.039 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.039 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064506+0000", 2023-10-08T07:07:58.039 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2743e-05 2023-10-08T07:07:58.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.039 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.039 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064545+0000", 2023-10-08T07:07:58.039 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9255000000000003e-05 2023-10-08T07:07:58.039 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.039 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.039 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.040 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.040 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175801 4.a 4:524fba76:::10000000004.0000001b:head [write 2670592~4096,write 2695168~4096,write 2957312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:58.040 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:07:58.041 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.130136798000001, 2023-10-08T07:07:58.041 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25527491699999999, 2023-10-08T07:07:58.041 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:58.041 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:58.041 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:58.041 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.041 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175801 2023-10-08T07:07:58.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.041 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.041 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:07:58.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:07:58.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809400+0000", 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8999999999999996e-07 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809411+0000", 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1275e-05 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809418+0000", 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6649999999999997e-06 2023-10-08T07:07:58.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809423+0000", 2023-10-08T07:07:58.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1499999999999998e-06 2023-10-08T07:07:58.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.044 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.044 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986111+0000", 2023-10-08T07:07:58.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17668825299999999 2023-10-08T07:07:58.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.045 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.045 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986176+0000", 2023-10-08T07:07:58.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5234999999999995e-05 2023-10-08T07:07:58.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.046 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.046 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986313+0000", 2023-10-08T07:07:58.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013663299999999999 2023-10-08T07:07:58.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.047 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.047 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.047 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.001765+0000", 2023-10-08T07:07:58.047 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015451833999999999 2023-10-08T07:07:58.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.047 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.047 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.048 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064588+0000", 2023-10-08T07:07:58.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062823646999999996 2023-10-08T07:07:58.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064639+0000", 2023-10-08T07:07:58.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0401000000000001e-05 2023-10-08T07:07:58.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064674+0000", 2023-10-08T07:07:58.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5133999999999999e-05 2023-10-08T07:07:58.050 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.050 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.050 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.050 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175835 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3133440~4096,write 3272704~4096,write 3280896~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:58.050 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:07:58.050 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.119498865000001, 2023-10-08T07:07:58.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25013609599999997, 2023-10-08T07:07:58.051 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:58.051 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:58.051 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:58.051 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.051 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.051 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175835 2023-10-08T07:07:58.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.051 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:07:58.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:07:58.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.052 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.052 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820038+0000", 2023-10-08T07:07:58.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0699999999999997e-07 2023-10-08T07:07:58.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820049+0000", 2023-10-08T07:07:58.053 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1326e-05 2023-10-08T07:07:58.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820058+0000", 2023-10-08T07:07:58.053 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9460000000000004e-06 2023-10-08T07:07:58.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.054 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820065+0000", 2023-10-08T07:07:58.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.238e-06 2023-10-08T07:07:58.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.054 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990302+0000", 2023-10-08T07:07:58.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17023707699999999 2023-10-08T07:07:58.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990350+0000", 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7941000000000001e-05 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990447+0000", 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6552999999999995e-05 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002051+0000", 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011604649 2023-10-08T07:07:58.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070103+0000", 2023-10-08T07:07:58.056 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.068051639999999997 2023-10-08T07:07:58.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070145+0000", 2023-10-08T07:07:58.056 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2154000000000003e-05 2023-10-08T07:07:58.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070173+0000", 2023-10-08T07:07:58.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7965000000000001e-05 2023-10-08T07:07:58.057 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.057 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.057 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.057 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.057 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175856 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2080768~4096,write 2191360~4096,write 2203648~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:58.057 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:07:58.057 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.114128675, 2023-10-08T07:07:58.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24491389, 2023-10-08T07:07:58.058 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:58.058 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:58.058 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:58.058 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.058 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.058 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175856 2023-10-08T07:07:58.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.058 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:07:58.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:07:58.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.060 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.060 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825408+0000", 2023-10-08T07:07:58.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5099999999999999e-07 2023-10-08T07:07:58.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.060 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.060 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825419+0000", 2023-10-08T07:07:58.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1369000000000001e-05 2023-10-08T07:07:58.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.060 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.060 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825430+0000", 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1226000000000001e-05 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825437+0000", 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.156e-06 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992529+0000", 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.167092401 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992594+0000", 2023-10-08T07:07:58.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4949000000000004e-05 2023-10-08T07:07:58.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992688+0000", 2023-10-08T07:07:58.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4011999999999994e-05 2023-10-08T07:07:58.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.007407+0000", 2023-10-08T07:07:58.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014718614 2023-10-08T07:07:58.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070226+0000", 2023-10-08T07:07:58.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062819551000000001 2023-10-08T07:07:58.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070283+0000", 2023-10-08T07:07:58.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7340000000000003e-05 2023-10-08T07:07:58.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.064 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070321+0000", 2023-10-08T07:07:58.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7521000000000002e-05 2023-10-08T07:07:58.064 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.064 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.064 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.064 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175864 4.1a 4:5a59f83a:::10000000004.00000002:head [write 4018176~4096,write 4067328~4096,write 4141056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:58.065 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:07:58.065 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.111095782, 2023-10-08T07:07:58.065 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24198245199999999, 2023-10-08T07:07:58.065 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:58.065 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:58.065 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:58.065 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.065 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.065 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175864 2023-10-08T07:07:58.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.065 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:07:58.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:07:58.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.067 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828441+0000", 2023-10-08T07:07:58.067 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0100000000000005e-07 2023-10-08T07:07:58.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.067 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.067 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.067 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828450+0000", 2023-10-08T07:07:58.067 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1400000000000006e-06 2023-10-08T07:07:58.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.067 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.067 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828461+0000", 2023-10-08T07:07:58.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.099e-05 2023-10-08T07:07:58.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.068 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828468+0000", 2023-10-08T07:07:58.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3390000000000004e-06 2023-10-08T07:07:58.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.068 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992521+0000", 2023-10-08T07:07:58.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16405252400000001 2023-10-08T07:07:58.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992607+0000", 2023-10-08T07:07:58.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6086000000000002e-05 2023-10-08T07:07:58.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992756+0000", 2023-10-08T07:07:58.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014936100000000001 2023-10-08T07:07:58.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002055+0000", 2023-10-08T07:07:58.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0092994410000000003 2023-10-08T07:07:58.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070359+0000", 2023-10-08T07:07:58.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.068303681000000005 2023-10-08T07:07:58.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070401+0000", 2023-10-08T07:07:58.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2138999999999998e-05 2023-10-08T07:07:58.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070422+0000", 2023-10-08T07:07:58.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1149999999999999e-05 2023-10-08T07:07:58.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.071 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.072 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.072 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175882 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 258048~4096,write 282624~4096,write 446464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:58.072 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:07:58.072 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.105764067999999, 2023-10-08T07:07:58.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.244805773, 2023-10-08T07:07:58.073 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:58.073 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:58.073 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:58.073 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.073 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.073 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175882 2023-10-08T07:07:58.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.073 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.073 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.073 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.073 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:07:58.073 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.074 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.074 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.074 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:07:58.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.074 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.074 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.074 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833773+0000", 2023-10-08T07:07:58.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1800000000000005e-07 2023-10-08T07:07:58.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833799+0000", 2023-10-08T07:07:58.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6840000000000001e-05 2023-10-08T07:07:58.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833811+0000", 2023-10-08T07:07:58.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1982e-05 2023-10-08T07:07:58.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833819+0000", 2023-10-08T07:07:58.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7729999999999999e-06 2023-10-08T07:07:58.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998071+0000", 2023-10-08T07:07:58.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16425203699999999 2023-10-08T07:07:58.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.077 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998122+0000", 2023-10-08T07:07:58.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0627999999999997e-05 2023-10-08T07:07:58.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.077 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998301+0000", 2023-10-08T07:07:58.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017893 2023-10-08T07:07:58.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.016267+0000", 2023-10-08T07:07:58.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017966780000000002 2023-10-08T07:07:58.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078470+0000", 2023-10-08T07:07:58.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062202475 2023-10-08T07:07:58.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078532+0000", 2023-10-08T07:07:58.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1601999999999997e-05 2023-10-08T07:07:58.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078577+0000", 2023-10-08T07:07:58.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5908000000000002e-05 2023-10-08T07:07:58.080 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.080 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.080 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.080 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175885 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2940928~4096,write 3362816~4096,write 3371008~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:58.080 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:07:58.081 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.10506556, 2023-10-08T07:07:58.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.244295492, 2023-10-08T07:07:58.081 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:58.081 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:58.081 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:58.081 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.081 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.081 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175885 2023-10-08T07:07:58.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.081 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:07:58.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:07:58.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834471+0000", 2023-10-08T07:07:58.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3399999999999998e-07 2023-10-08T07:07:58.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.083 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834487+0000", 2023-10-08T07:07:58.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6209999999999999e-05 2023-10-08T07:07:58.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.083 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834500+0000", 2023-10-08T07:07:58.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2262999999999999e-05 2023-10-08T07:07:58.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834508+0000", 2023-10-08T07:07:58.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8459999999999997e-06 2023-10-08T07:07:58.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002339+0000", 2023-10-08T07:07:58.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16783030400000001 2023-10-08T07:07:58.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002426+0000", 2023-10-08T07:07:58.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6879999999999995e-05 2023-10-08T07:07:58.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002592+0000", 2023-10-08T07:07:58.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000166071 2023-10-08T07:07:58.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.016276+0000", 2023-10-08T07:07:58.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013684392 2023-10-08T07:07:58.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078657+0000", 2023-10-08T07:07:58.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062380933 2023-10-08T07:07:58.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078721+0000", 2023-10-08T07:07:58.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3968999999999997e-05 2023-10-08T07:07:58.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.087 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.087 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.087 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078766+0000", 2023-10-08T07:07:58.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4790000000000003e-05 2023-10-08T07:07:58.087 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.087 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.087 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.087 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.087 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175982 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 1507328~4096,write 1556480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:58.088 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:07:58.088 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.074725345999999, 2023-10-08T07:07:58.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24593904699999999, 2023-10-08T07:07:58.088 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:58.088 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:58.088 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:58.088 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.088 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.088 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175982 2023-10-08T07:07:58.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.088 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.089 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.089 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:07:58.089 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.089 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.089 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:07:58.089 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.089 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864811+0000", 2023-10-08T07:07:58.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3099999999999996e-07 2023-10-08T07:07:58.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864827+0000", 2023-10-08T07:07:58.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5141e-05 2023-10-08T07:07:58.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864839+0000", 2023-10-08T07:07:58.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2343e-05 2023-10-08T07:07:58.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864847+0000", 2023-10-08T07:07:58.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1759999999999993e-06 2023-10-08T07:07:58.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.041996+0000", 2023-10-08T07:07:58.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17714919000000001 2023-10-08T07:07:58.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.042044+0000", 2023-10-08T07:07:58.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8056000000000002e-05 2023-10-08T07:07:58.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.042173+0000", 2023-10-08T07:07:58.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000128283 2023-10-08T07:07:58.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.058432+0000", 2023-10-08T07:07:58.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016259431000000001 2023-10-08T07:07:58.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110696+0000", 2023-10-08T07:07:58.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.052264104999999998 2023-10-08T07:07:58.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.096 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.096 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110728+0000", 2023-10-08T07:07:58.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1578999999999997e-05 2023-10-08T07:07:58.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110749+0000", 2023-10-08T07:07:58.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1812000000000001e-05 2023-10-08T07:07:58.097 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.097 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.097 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.097 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:176059 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1564672~4096,write 1585152~4096,write 1708032~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:07:58.097 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:07:58.097 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 10.051896624999999, 2023-10-08T07:07:58.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.23799429, 2023-10-08T07:07:58.098 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:07:58.098 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:07:58.098 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:07:58.098 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:07:58.098 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:07:58.098 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 176059 2023-10-08T07:07:58.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.098 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:07:58.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:07:58.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:07:58.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:07:58.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:07:58.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:07:58.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:07:58.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887640+0000", 2023-10-08T07:07:58.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0699999999999997e-07 2023-10-08T07:07:58.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.100 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:07:58.100 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887649+0000", 2023-10-08T07:07:58.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2439999999999999e-06 2023-10-08T07:07:58.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.100 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:07:58.100 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887657+0000", 2023-10-08T07:07:58.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0059999999999992e-06 2023-10-08T07:07:58.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:07:58.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887663+0000", 2023-10-08T07:07:58.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7869999999999998e-06 2023-10-08T07:07:58.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:07:58.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.060892+0000", 2023-10-08T07:07:58.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17322955700000001 2023-10-08T07:07:58.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:07:58.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.060978+0000", 2023-10-08T07:07:58.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5358999999999994e-05 2023-10-08T07:07:58.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:07:58.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.061180+0000", 2023-10-08T07:07:58.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020268400000000001 2023-10-08T07:07:58.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:07:58.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070342+0000", 2023-10-08T07:07:58.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0091617230000000001 2023-10-08T07:07:58.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:07:58.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125534+0000", 2023-10-08T07:07:58.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055191764999999997 2023-10-08T07:07:58.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.103 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:07:58.103 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125591+0000", 2023-10-08T07:07:58.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7606999999999999e-05 2023-10-08T07:07:58.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:07:58.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:07:58.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:07:58.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125633+0000", 2023-10-08T07:07:58.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1950999999999999e-05 2023-10-08T07:07:58.104 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.104 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.104 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.104 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:07:58.104 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:07:58.105 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:07:58.106 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2023-10-08T07:07:58.107 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:58.107 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:58.105+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:58.207 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:58.206+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:58.247 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:58.247 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:58.247 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:07:58.247 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:58.258 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:58.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:07:58.308 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:58.307+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:58.385 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:07:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:07:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:07:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:07:58.385 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:07:58.395 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:58.411 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:58.409+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:58.434 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:07:58.455 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:07:58.455 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:07:58.456 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:07:58.456 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:07:58.458 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:07:58.458 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:07:58.511 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:58.510+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:58.563 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:58.563 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:58.574 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:58.615 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:58.614+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:58.713 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:58.712+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:58.721 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:58.721 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:58.732 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:58.814 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:58.813+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:58.905 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:58.905 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:58.916 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:58.916 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:58.914+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:59.017 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:59.016+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:59.088 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:59.089 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:59.099 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:07:59.143 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:59.142+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:59.219 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:59.218+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:59.233 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:59.233 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:59.243 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:07:59.320 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:59.319+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:59.411 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:59.411 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:59.421 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:07:59.422 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:59.420+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:59.522 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:59.520+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:59.549 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:59.549 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:59.559 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:07:59.623 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:07:59.622+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:07:59.699 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:59.699 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:59.710 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:07:59.754 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:59.753+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:59.825 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:59.824+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:07:59.842 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:07:59.842 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:07:59.852 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:07:59.936 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:07:59.935+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:00.024 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:08:00.024 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:08:00.028 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:08:00.027+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:08:00.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:08:00.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T07:08:00.128 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:00.128+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:00.164 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:08:00.164 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:08:00.174 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:08:00.230 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:08:00.229+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:08:00.302 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:08:00.302 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:08:00.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:08:00.353 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:08:00.352+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:08:00.431 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:00.430+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:00.460 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-10-08T07:08:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:08:00.480 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:08:00.490 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:08:00.534 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:00.533+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:00.609 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:08:00.628 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:08:00.629 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:08:00.629 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:08:00.629 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:08:00.629 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:08:00.629 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-10-08T07:08:00.630 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:08:00.630 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-10-08T07:08:00.632 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:08:00.632 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:08:00.633 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:08:00.631+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:08:00.639 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:08:00.734 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:00.733+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:00.810 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:08:00.811 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:08:00.811 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:08:00.811 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:08:00.811 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:08:00.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:08:00.862 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:00.861+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:00.935 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:00.934+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:08:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:08:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:08:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:08:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175316 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 696320~4096,write 745472~4096,write 942080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:00.996 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:08:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.331628959, 2023-10-08T07:08:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.239832828, 2023-10-08T07:08:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175316 2023-10-08T07:08:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:00.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:08:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:08:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:00.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662052+0000", 2023-10-08T07:08:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9599999999999998e-07 2023-10-08T07:08:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662064+0000", 2023-10-08T07:08:00.999 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.226e-05 2023-10-08T07:08:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662074+0000", 2023-10-08T07:08:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0057999999999999e-05 2023-10-08T07:08:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662082+0000", 2023-10-08T07:08:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.593e-06 2023-10-08T07:08:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.868775+0000", 2023-10-08T07:08:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.20669354700000001 2023-10-08T07:08:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.868864+0000", 2023-10-08T07:08:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9174999999999999e-05 2023-10-08T07:08:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.869012+0000", 2023-10-08T07:08:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014747 2023-10-08T07:08:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.885657+0000", 2023-10-08T07:08:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016645008999999999 2023-10-08T07:08:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901768+0000", 2023-10-08T07:08:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016110721000000001 2023-10-08T07:08:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901841+0000", 2023-10-08T07:08:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3047999999999996e-05 2023-10-08T07:08:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.003 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901884+0000", 2023-10-08T07:08:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3050999999999998e-05 2023-10-08T07:08:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175432 4.1a 4:5a59f83a:::10000000004.00000002:head [write 196608~4096,write 245760~4096,write 270336~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:08:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.294510984, 2023-10-08T07:08:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.23774203799999999, 2023-10-08T07:08:01.004 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175432 2023-10-08T07:08:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.005 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:08:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:08:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699170+0000", 2023-10-08T07:08:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:08:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.007 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699181+0000", 2023-10-08T07:08:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1581e-05 2023-10-08T07:08:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699199+0000", 2023-10-08T07:08:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7376000000000001e-05 2023-10-08T07:08:01.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699206+0000", 2023-10-08T07:08:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7190000000000001e-06 2023-10-08T07:08:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907275+0000", 2023-10-08T07:08:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.20806835700000001 2023-10-08T07:08:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.009 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907359+0000", 2023-10-08T07:08:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4320999999999994e-05 2023-10-08T07:08:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907546+0000", 2023-10-08T07:08:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018752299999999999 2023-10-08T07:08:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.010 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.925780+0000", 2023-10-08T07:08:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018233909999999999 2023-10-08T07:08:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936786+0000", 2023-10-08T07:08:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011005355 2023-10-08T07:08:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936868+0000", 2023-10-08T07:08:01.011 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1917999999999997e-05 2023-10-08T07:08:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936911+0000", 2023-10-08T07:08:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3207999999999997e-05 2023-10-08T07:08:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.012 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175676 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2719744~4096,write 2822144~4096,write 2945024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:08:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.222411626, 2023-10-08T07:08:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24978785000000001, 2023-10-08T07:08:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.013 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175676 2023-10-08T07:08:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.014 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:08:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:08:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.015 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771269+0000", 2023-10-08T07:08:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7100000000000002e-07 2023-10-08T07:08:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771287+0000", 2023-10-08T07:08:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8022000000000001e-05 2023-10-08T07:08:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.016 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771293+0000", 2023-10-08T07:08:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3029999999999996e-06 2023-10-08T07:08:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771297+0000", 2023-10-08T07:08:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2830000000000003e-06 2023-10-08T07:08:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.017 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.961848+0000", 2023-10-08T07:08:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.190550999 2023-10-08T07:08:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.961954+0000", 2023-10-08T07:08:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000105485 2023-10-08T07:08:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.962114+0000", 2023-10-08T07:08:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016024499999999999 2023-10-08T07:08:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.019 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.975848+0000", 2023-10-08T07:08:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013733886000000001 2023-10-08T07:08:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.020956+0000", 2023-10-08T07:08:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045108400999999999 2023-10-08T07:08:01.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021013+0000", 2023-10-08T07:08:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6277999999999999e-05 2023-10-08T07:08:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021056+0000", 2023-10-08T07:08:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3377000000000002e-05 2023-10-08T07:08:01.021 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175680 4.3a 4:5f183e4b:::10000000004.00000023:head [write 3502080~4096,write 3534848~4096,write 3608576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:08:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.220466693000001, 2023-10-08T07:08:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24812537200000001, 2023-10-08T07:08:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.022 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175680 2023-10-08T07:08:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:08:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.023 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:08:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773214+0000", 2023-10-08T07:08:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.403e-06 2023-10-08T07:08:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.024 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773227+0000", 2023-10-08T07:08:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3001e-05 2023-10-08T07:08:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773240+0000", 2023-10-08T07:08:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2441e-05 2023-10-08T07:08:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.025 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773249+0000", 2023-10-08T07:08:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8890000000000008e-06 2023-10-08T07:08:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964327+0000", 2023-10-08T07:08:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19107864499999999 2023-10-08T07:08:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.026 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964418+0000", 2023-10-08T07:08:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0131999999999997e-05 2023-10-08T07:08:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964602+0000", 2023-10-08T07:08:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000184711 2023-10-08T07:08:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.027 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976021+0000", 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011418822 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021236+0000", 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045214467000000001 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021303+0000", 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7210000000000002e-05 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021338+0000", 2023-10-08T07:08:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5651000000000001e-05 2023-10-08T07:08:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175690 4.1a 4:5a59f83a:::10000000004.00000002:head [write 405504~4096,write 811008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:08:01.029 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.217912927, 2023-10-08T07:08:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.245421262, 2023-10-08T07:08:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175690 2023-10-08T07:08:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.030 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:08:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:08:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:08:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:08:01.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775774+0000", 2023-10-08T07:08:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9460000000000001e-06 2023-10-08T07:08:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775781+0000", 2023-10-08T07:08:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8349999999999998e-06 2023-10-08T07:08:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.032 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775785+0000", 2023-10-08T07:08:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7290000000000002e-06 2023-10-08T07:08:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967188+0000", 2023-10-08T07:08:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19140304299999999 2023-10-08T07:08:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967267+0000", 2023-10-08T07:08:01.033 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9154999999999997e-05 2023-10-08T07:08:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967405+0000", 2023-10-08T07:08:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000137618 2023-10-08T07:08:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.034 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976028+0000", 2023-10-08T07:08:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0086236869999999997 2023-10-08T07:08:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021096+0000", 2023-10-08T07:08:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045067928 2023-10-08T07:08:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.035 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021147+0000", 2023-10-08T07:08:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0399000000000003e-05 2023-10-08T07:08:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021188+0000", 2023-10-08T07:08:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1386e-05 2023-10-08T07:08:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175692 4.a 4:524fba76:::10000000004.0000001b:head [write 737280~4096,write 749568~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:08:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.217459205000001, 2023-10-08T07:08:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25024756399999998, 2023-10-08T07:08:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.037 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175692 2023-10-08T07:08:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:08:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:08:01.038 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:08:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1200000000000003e-07 2023-10-08T07:08:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776238+0000", 2023-10-08T07:08:01.039 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7269e-05 2023-10-08T07:08:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776247+0000", 2023-10-08T07:08:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5189999999999992e-06 2023-10-08T07:08:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776251+0000", 2023-10-08T07:08:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7910000000000002e-06 2023-10-08T07:08:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967925+0000", 2023-10-08T07:08:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19167456299999999 2023-10-08T07:08:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967997+0000", 2023-10-08T07:08:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1666000000000001e-05 2023-10-08T07:08:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.041 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.968122+0000", 2023-10-08T07:08:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012469 2023-10-08T07:08:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976268+0000", 2023-10-08T07:08:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0081468770000000003 2023-10-08T07:08:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.042 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026375+0000", 2023-10-08T07:08:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050106683999999999 2023-10-08T07:08:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026430+0000", 2023-10-08T07:08:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4506999999999998e-05 2023-10-08T07:08:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.043 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026468+0000", 2023-10-08T07:08:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8485999999999997e-05 2023-10-08T07:08:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175701 4.a 4:524fba76:::10000000004.0000001b:head [write 1503232~4096,write 1540096~4096,write 1560576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:08:01.044 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.214615526999999, 2023-10-08T07:08:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.257645717, 2023-10-08T07:08:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175701 2023-10-08T07:08:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.045 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:08:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:08:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.046 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779065+0000", 2023-10-08T07:08:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6300000000000005e-07 2023-10-08T07:08:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779074+0000", 2023-10-08T07:08:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7010000000000002e-06 2023-10-08T07:08:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.047 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779090+0000", 2023-10-08T07:08:01.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6171000000000002e-05 2023-10-08T07:08:01.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.048 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.048 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779095+0000", 2023-10-08T07:08:01.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9169999999999997e-06 2023-10-08T07:08:01.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.048 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.048 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971272+0000", 2023-10-08T07:08:01.048 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.192177024 2023-10-08T07:08:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971364+0000", 2023-10-08T07:08:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2102999999999996e-05 2023-10-08T07:08:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971480+0000", 2023-10-08T07:08:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000116307 2023-10-08T07:08:01.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.980645+0000", 2023-10-08T07:08:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0091647559999999996 2023-10-08T07:08:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036634+0000", 2023-10-08T07:08:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055989555000000003 2023-10-08T07:08:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.050 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036673+0000", 2023-10-08T07:08:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8285999999999999e-05 2023-10-08T07:08:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036710+0000", 2023-10-08T07:08:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7234000000000003e-05 2023-10-08T07:08:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175733 4.a 4:524fba76:::10000000004.0000001b:head [write 2154496~4096,write 2281472~4096,write 2306048~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:08:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.203788761, 2023-10-08T07:08:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25628842600000001, 2023-10-08T07:08:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.052 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175733 2023-10-08T07:08:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:08:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.053 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:08:01.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.054 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:08:01.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4900000000000001e-07 2023-10-08T07:08:01.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.054 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.054 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.054 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789903+0000", 2023-10-08T07:08:01.054 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1391e-05 2023-10-08T07:08:01.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.055 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789909+0000", 2023-10-08T07:08:01.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6460000000000004e-06 2023-10-08T07:08:01.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.055 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.055 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.055 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789916+0000", 2023-10-08T07:08:01.055 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.635e-06 2023-10-08T07:08:01.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976385+0000", 2023-10-08T07:08:01.056 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18646858799999999 2023-10-08T07:08:01.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.056 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.056 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.056 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976432+0000", 2023-10-08T07:08:01.056 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6885000000000003e-05 2023-10-08T07:08:01.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.057 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976521+0000", 2023-10-08T07:08:01.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9122999999999994e-05 2023-10-08T07:08:01.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.057 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.057 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.057 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.987479+0000", 2023-10-08T07:08:01.057 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0109579 2023-10-08T07:08:01.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.058 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.058 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046084+0000", 2023-10-08T07:08:01.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058605813999999999 2023-10-08T07:08:01.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.058 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.058 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046140+0000", 2023-10-08T07:08:01.058 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5770999999999998e-05 2023-10-08T07:08:01.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.059 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.059 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046179+0000", 2023-10-08T07:08:01.059 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9224000000000003e-05 2023-10-08T07:08:01.059 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.059 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.059 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.059 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.059 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175743 4.a 4:524fba76:::10000000004.0000001b:head [write 233472~4096,write 684032~4096,write 704512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.059 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:08:01.059 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.200410449, 2023-10-08T07:08:01.060 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25305127599999999, 2023-10-08T07:08:01.060 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.060 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.060 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.060 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.060 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.060 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175743 2023-10-08T07:08:01.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.060 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.060 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.060 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:08:01.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:08:01.061 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.061 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.061 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.061 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793270+0000", 2023-10-08T07:08:01.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8200000000000008e-07 2023-10-08T07:08:01.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793291+0000", 2023-10-08T07:08:01.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1058000000000001e-05 2023-10-08T07:08:01.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.062 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.062 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.062 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793303+0000", 2023-10-08T07:08:01.062 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1836e-05 2023-10-08T07:08:01.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793312+0000", 2023-10-08T07:08:01.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5809999999999997e-06 2023-10-08T07:08:01.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.063 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.063 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.063 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.978869+0000", 2023-10-08T07:08:01.063 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18555693400000001 2023-10-08T07:08:01.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.064 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.978955+0000", 2023-10-08T07:08:01.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6318999999999998e-05 2023-10-08T07:08:01.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.064 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.064 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.979104+0000", 2023-10-08T07:08:01.064 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014935 2023-10-08T07:08:01.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.064 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.065 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.065 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.987482+0000", 2023-10-08T07:08:01.065 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083776749999999994 2023-10-08T07:08:01.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.065 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.065 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046228+0000", 2023-10-08T07:08:01.065 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058745516999999997 2023-10-08T07:08:01.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.065 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046285+0000", 2023-10-08T07:08:01.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7358000000000002e-05 2023-10-08T07:08:01.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.066 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.066 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046321+0000", 2023-10-08T07:08:01.066 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5666e-05 2023-10-08T07:08:01.066 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.066 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.066 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.067 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.067 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175759 4.a 4:524fba76:::10000000004.0000001b:head [write 2719744~4096,write 2756608~4096,write 2940928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.067 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:08:01.067 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.196639877000001, 2023-10-08T07:08:01.067 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24944019200000001, 2023-10-08T07:08:01.067 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.067 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.067 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.067 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.067 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.068 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175759 2023-10-08T07:08:01.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.068 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.068 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:08:01.068 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.068 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.068 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.068 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:08:01.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:08:01.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6600000000000003e-07 2023-10-08T07:08:01.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.069 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.069 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.069 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797047+0000", 2023-10-08T07:08:01.069 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3600000000000001e-06 2023-10-08T07:08:01.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797050+0000", 2023-10-08T07:08:01.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6990000000000001e-06 2023-10-08T07:08:01.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.070 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.070 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.070 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797054+0000", 2023-10-08T07:08:01.070 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3450000000000002e-06 2023-10-08T07:08:01.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981409+0000", 2023-10-08T07:08:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18435503 2023-10-08T07:08:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981491+0000", 2023-10-08T07:08:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2538000000000002e-05 2023-10-08T07:08:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.071 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.072 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981690+0000", 2023-10-08T07:08:01.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019896200000000001 2023-10-08T07:08:01.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.072 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.072 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989237+0000", 2023-10-08T07:08:01.072 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0075464410000000001 2023-10-08T07:08:01.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.072 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.072 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.072 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046393+0000", 2023-10-08T07:08:01.073 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.057156086000000002 2023-10-08T07:08:01.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.073 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.073 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.073 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046445+0000", 2023-10-08T07:08:01.073 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2437e-05 2023-10-08T07:08:01.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.073 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.073 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.073 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046480+0000", 2023-10-08T07:08:01.073 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5027999999999997e-05 2023-10-08T07:08:01.073 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.074 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.074 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.074 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.074 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175778 4.a 4:524fba76:::10000000004.0000001b:head [write 901120~4096,write 1118208~4096,write 1249280~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.074 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:08:01.074 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.191569299999999, 2023-10-08T07:08:01.074 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.26243437800000002, 2023-10-08T07:08:01.074 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.074 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.074 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.075 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.075 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.075 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175778 2023-10-08T07:08:01.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.075 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.075 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:08:01.075 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.075 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.075 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:08:01.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802111+0000", 2023-10-08T07:08:01.076 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6000000000000003e-07 2023-10-08T07:08:01.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.076 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.076 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802131+0000", 2023-10-08T07:08:01.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0109999999999999e-05 2023-10-08T07:08:01.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.077 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802142+0000", 2023-10-08T07:08:01.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0549e-05 2023-10-08T07:08:01.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.077 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.077 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.077 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802149+0000", 2023-10-08T07:08:01.077 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5229999999999998e-06 2023-10-08T07:08:01.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983625+0000", 2023-10-08T07:08:01.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18147571200000001 2023-10-08T07:08:01.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.078 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.078 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.078 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983673+0000", 2023-10-08T07:08:01.078 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8007000000000003e-05 2023-10-08T07:08:01.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983764+0000", 2023-10-08T07:08:01.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1242000000000005e-05 2023-10-08T07:08:01.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.079 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989240+0000", 2023-10-08T07:08:01.079 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054752689999999996 2023-10-08T07:08:01.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.079 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.079 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064441+0000", 2023-10-08T07:08:01.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.075201198999999996 2023-10-08T07:08:01.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.080 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.080 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064504+0000", 2023-10-08T07:08:01.080 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3219999999999994e-05 2023-10-08T07:08:01.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.080 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.081 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.081 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064545+0000", 2023-10-08T07:08:01.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0886999999999997e-05 2023-10-08T07:08:01.081 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.081 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.081 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.081 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.081 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175787 4.3a 4:5f183e4b:::10000000004.00000023:head [write 884736~4096,write 958464~4096,write 1261568~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.081 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:08:01.081 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.188980346999999, 2023-10-08T07:08:01.081 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25984544300000001, 2023-10-08T07:08:01.082 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.082 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.082 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.082 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.082 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.082 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175787 2023-10-08T07:08:01.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.082 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.082 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.082 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.082 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:08:01.082 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.083 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:08:01.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.083 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.083 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804700+0000", 2023-10-08T07:08:01.083 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1299999999999999e-07 2023-10-08T07:08:01.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804723+0000", 2023-10-08T07:08:01.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.304e-05 2023-10-08T07:08:01.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804735+0000", 2023-10-08T07:08:01.084 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1693e-05 2023-10-08T07:08:01.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.084 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.084 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.084 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804742+0000", 2023-10-08T07:08:01.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5869999999999998e-06 2023-10-08T07:08:01.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983619+0000", 2023-10-08T07:08:01.085 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.178877123 2023-10-08T07:08:01.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.085 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.085 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.085 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983667+0000", 2023-10-08T07:08:01.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8510999999999997e-05 2023-10-08T07:08:01.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983763+0000", 2023-10-08T07:08:01.086 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5902000000000004e-05 2023-10-08T07:08:01.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.086 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.086 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.086 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989243+0000", 2023-10-08T07:08:01.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054799389999999996 2023-10-08T07:08:01.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.087 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.087 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.087 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064453+0000", 2023-10-08T07:08:01.087 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.075209837000000002 2023-10-08T07:08:01.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.087 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.087 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.088 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064506+0000", 2023-10-08T07:08:01.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2743e-05 2023-10-08T07:08:01.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.088 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.088 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064545+0000", 2023-10-08T07:08:01.088 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9255000000000003e-05 2023-10-08T07:08:01.088 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.088 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.088 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.089 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.089 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175801 4.a 4:524fba76:::10000000004.0000001b:head [write 2670592~4096,write 2695168~4096,write 2957312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.089 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:08:01.089 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.184280793999999, 2023-10-08T07:08:01.089 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25527491699999999, 2023-10-08T07:08:01.089 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.089 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.089 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.089 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.089 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.090 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175801 2023-10-08T07:08:01.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.090 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.090 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:08:01.090 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.090 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.090 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.090 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:08:01.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.091 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.091 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809400+0000", 2023-10-08T07:08:01.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8999999999999996e-07 2023-10-08T07:08:01.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.091 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.091 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.091 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809411+0000", 2023-10-08T07:08:01.091 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1275e-05 2023-10-08T07:08:01.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809418+0000", 2023-10-08T07:08:01.092 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6649999999999997e-06 2023-10-08T07:08:01.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.092 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.092 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809423+0000", 2023-10-08T07:08:01.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1499999999999998e-06 2023-10-08T07:08:01.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986111+0000", 2023-10-08T07:08:01.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17668825299999999 2023-10-08T07:08:01.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.093 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.093 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.093 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986176+0000", 2023-10-08T07:08:01.093 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5234999999999995e-05 2023-10-08T07:08:01.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986313+0000", 2023-10-08T07:08:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013663299999999999 2023-10-08T07:08:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.001765+0000", 2023-10-08T07:08:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015451833999999999 2023-10-08T07:08:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.094 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064588+0000", 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062823646999999996 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064639+0000", 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0401000000000001e-05 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064674+0000", 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5133999999999999e-05 2023-10-08T07:08:01.095 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.096 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.096 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.096 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.096 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175835 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3133440~4096,write 3272704~4096,write 3280896~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.096 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:08:01.096 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.173642860999999, 2023-10-08T07:08:01.096 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25013609599999997, 2023-10-08T07:08:01.096 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.096 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.097 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.097 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.097 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.097 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175835 2023-10-08T07:08:01.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.097 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.097 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.097 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.097 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:08:01.097 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.098 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:08:01.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.098 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820038+0000", 2023-10-08T07:08:01.098 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0699999999999997e-07 2023-10-08T07:08:01.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.098 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.098 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820049+0000", 2023-10-08T07:08:01.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1326e-05 2023-10-08T07:08:01.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820058+0000", 2023-10-08T07:08:01.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9460000000000004e-06 2023-10-08T07:08:01.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.099 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.099 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.099 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820065+0000", 2023-10-08T07:08:01.099 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.238e-06 2023-10-08T07:08:01.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.100 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.100 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990302+0000", 2023-10-08T07:08:01.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17023707699999999 2023-10-08T07:08:01.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.100 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.100 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990350+0000", 2023-10-08T07:08:01.100 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7941000000000001e-05 2023-10-08T07:08:01.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.100 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990447+0000", 2023-10-08T07:08:01.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6552999999999995e-05 2023-10-08T07:08:01.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002051+0000", 2023-10-08T07:08:01.101 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011604649 2023-10-08T07:08:01.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.101 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.101 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.101 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070103+0000", 2023-10-08T07:08:01.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.068051639999999997 2023-10-08T07:08:01.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070145+0000", 2023-10-08T07:08:01.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2154000000000003e-05 2023-10-08T07:08:01.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.102 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.102 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.102 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070173+0000", 2023-10-08T07:08:01.102 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7965000000000001e-05 2023-10-08T07:08:01.102 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.103 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.103 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.103 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175856 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2080768~4096,write 2191360~4096,write 2203648~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.103 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:08:01.103 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.168272671, 2023-10-08T07:08:01.103 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24491389, 2023-10-08T07:08:01.103 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.103 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.103 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175856 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.104 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:08:01.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.105 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825408+0000", 2023-10-08T07:08:01.105 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5099999999999999e-07 2023-10-08T07:08:01.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.105 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.105 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825419+0000", 2023-10-08T07:08:01.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1369000000000001e-05 2023-10-08T07:08:01.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825430+0000", 2023-10-08T07:08:01.106 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1226000000000001e-05 2023-10-08T07:08:01.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.106 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.106 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.106 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825437+0000", 2023-10-08T07:08:01.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.156e-06 2023-10-08T07:08:01.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.107 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.107 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992529+0000", 2023-10-08T07:08:01.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.167092401 2023-10-08T07:08:01.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.107 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.107 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992594+0000", 2023-10-08T07:08:01.107 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4949000000000004e-05 2023-10-08T07:08:01.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.108 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.108 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.108 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992688+0000", 2023-10-08T07:08:01.108 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4011999999999994e-05 2023-10-08T07:08:01.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.108 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.108 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.108 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.007407+0000", 2023-10-08T07:08:01.108 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014718614 2023-10-08T07:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070226+0000", 2023-10-08T07:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062819551000000001 2023-10-08T07:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070283+0000", 2023-10-08T07:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7340000000000003e-05 2023-10-08T07:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.110 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.110 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070321+0000", 2023-10-08T07:08:01.110 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7521000000000002e-05 2023-10-08T07:08:01.110 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.110 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.110 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.110 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.110 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175864 4.1a 4:5a59f83a:::10000000004.00000002:head [write 4018176~4096,write 4067328~4096,write 4141056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.111 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:08:01.111 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.165239778, 2023-10-08T07:08:01.111 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24198245199999999, 2023-10-08T07:08:01.111 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.111 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.111 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.111 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.111 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.111 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175864 2023-10-08T07:08:01.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.112 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:08:01.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.112 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.112 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.112 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:08:01.112 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.113 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.113 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828441+0000", 2023-10-08T07:08:01.113 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0100000000000005e-07 2023-10-08T07:08:01.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.113 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.113 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828450+0000", 2023-10-08T07:08:01.113 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1400000000000006e-06 2023-10-08T07:08:01.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.113 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.114 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.114 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828461+0000", 2023-10-08T07:08:01.114 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.099e-05 2023-10-08T07:08:01.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.114 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.114 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.114 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828468+0000", 2023-10-08T07:08:01.114 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3390000000000004e-06 2023-10-08T07:08:01.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.114 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.114 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.115 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992521+0000", 2023-10-08T07:08:01.115 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16405252400000001 2023-10-08T07:08:01.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.115 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.115 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.115 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992607+0000", 2023-10-08T07:08:01.115 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6086000000000002e-05 2023-10-08T07:08:01.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.115 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992756+0000", 2023-10-08T07:08:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014936100000000001 2023-10-08T07:08:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002055+0000", 2023-10-08T07:08:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0092994410000000003 2023-10-08T07:08:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.116 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.117 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070359+0000", 2023-10-08T07:08:01.117 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.068303681000000005 2023-10-08T07:08:01.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.117 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.117 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.117 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070401+0000", 2023-10-08T07:08:01.117 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2138999999999998e-05 2023-10-08T07:08:01.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.117 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.117 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.117 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070422+0000", 2023-10-08T07:08:01.117 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1149999999999999e-05 2023-10-08T07:08:01.118 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.118 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.118 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.118 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.118 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175882 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 258048~4096,write 282624~4096,write 446464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.118 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:08:01.118 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.159908064, 2023-10-08T07:08:01.118 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.244805773, 2023-10-08T07:08:01.118 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.119 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.119 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.119 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.119 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.119 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175882 2023-10-08T07:08:01.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.119 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.119 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.119 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.119 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:08:01.119 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.120 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:08:01.120 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.120 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.120 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.120 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833773+0000", 2023-10-08T07:08:01.120 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1800000000000005e-07 2023-10-08T07:08:01.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.121 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.121 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.121 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833799+0000", 2023-10-08T07:08:01.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6840000000000001e-05 2023-10-08T07:08:01.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.121 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.121 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.121 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833811+0000", 2023-10-08T07:08:01.121 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1982e-05 2023-10-08T07:08:01.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.121 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.121 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833819+0000", 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7729999999999999e-06 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998071+0000", 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16425203699999999 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998122+0000", 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0627999999999997e-05 2023-10-08T07:08:01.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.123 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.123 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.123 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998301+0000", 2023-10-08T07:08:01.123 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017893 2023-10-08T07:08:01.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.123 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.123 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.123 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.016267+0000", 2023-10-08T07:08:01.125 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017966780000000002 2023-10-08T07:08:01.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.125 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.125 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078470+0000", 2023-10-08T07:08:01.125 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062202475 2023-10-08T07:08:01.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.125 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.126 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078532+0000", 2023-10-08T07:08:01.126 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1601999999999997e-05 2023-10-08T07:08:01.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.126 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.126 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078577+0000", 2023-10-08T07:08:01.126 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5908000000000002e-05 2023-10-08T07:08:01.126 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.126 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.126 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.127 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175885 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2940928~4096,write 3362816~4096,write 3371008~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.127 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:08:01.127 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.159209556, 2023-10-08T07:08:01.127 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.244295492, 2023-10-08T07:08:01.127 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.127 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.127 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.127 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.127 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.127 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175885 2023-10-08T07:08:01.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.128 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.128 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.128 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.128 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:08:01.128 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.128 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.128 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.128 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:08:01.128 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.129 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.129 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834471+0000", 2023-10-08T07:08:01.129 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3399999999999998e-07 2023-10-08T07:08:01.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.129 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.129 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834487+0000", 2023-10-08T07:08:01.129 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6209999999999999e-05 2023-10-08T07:08:01.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834500+0000", 2023-10-08T07:08:01.130 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2262999999999999e-05 2023-10-08T07:08:01.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.130 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834508+0000", 2023-10-08T07:08:01.130 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8459999999999997e-06 2023-10-08T07:08:01.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.130 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.131 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002339+0000", 2023-10-08T07:08:01.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16783030400000001 2023-10-08T07:08:01.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.131 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.131 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002426+0000", 2023-10-08T07:08:01.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6879999999999995e-05 2023-10-08T07:08:01.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.131 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.131 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002592+0000", 2023-10-08T07:08:01.131 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000166071 2023-10-08T07:08:01.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.132 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.132 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.016276+0000", 2023-10-08T07:08:01.132 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013684392 2023-10-08T07:08:01.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.132 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.132 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078657+0000", 2023-10-08T07:08:01.132 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062380933 2023-10-08T07:08:01.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.133 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.133 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078721+0000", 2023-10-08T07:08:01.133 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3968999999999997e-05 2023-10-08T07:08:01.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.133 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.133 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078766+0000", 2023-10-08T07:08:01.133 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4790000000000003e-05 2023-10-08T07:08:01.133 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.133 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.134 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.134 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175982 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 1507328~4096,write 1556480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.134 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:08:01.134 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.128869342, 2023-10-08T07:08:01.134 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24593904699999999, 2023-10-08T07:08:01.134 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.134 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.134 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.134 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.134 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.135 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175982 2023-10-08T07:08:01.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.135 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.135 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.135 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:08:01.135 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.135 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.135 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:08:01.135 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.136 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.136 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.136 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864811+0000", 2023-10-08T07:08:01.136 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3099999999999996e-07 2023-10-08T07:08:01.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.136 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.136 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.136 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864827+0000", 2023-10-08T07:08:01.136 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5141e-05 2023-10-08T07:08:01.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.137 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.137 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864839+0000", 2023-10-08T07:08:01.137 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2343e-05 2023-10-08T07:08:01.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.137 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.137 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864847+0000", 2023-10-08T07:08:01.137 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1759999999999993e-06 2023-10-08T07:08:01.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.041996+0000", 2023-10-08T07:08:01.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17714919000000001 2023-10-08T07:08:01.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.138 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.042044+0000", 2023-10-08T07:08:01.138 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8056000000000002e-05 2023-10-08T07:08:01.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.138 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.042173+0000", 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000128283 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.058432+0000", 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016259431000000001 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110696+0000", 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.052264104999999998 2023-10-08T07:08:01.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.140 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.140 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110728+0000", 2023-10-08T07:08:01.140 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1578999999999997e-05 2023-10-08T07:08:01.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.140 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.140 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110749+0000", 2023-10-08T07:08:01.140 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1812000000000001e-05 2023-10-08T07:08:01.140 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:176059 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1564672~4096,write 1585152~4096,write 1708032~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 13.106040621, 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.23799429, 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:01.141 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.142 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 176059 2023-10-08T07:08:01.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.142 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:01.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:01.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:08:01.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.142 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.142 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:01.142 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:08:01.142 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887640+0000", 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0699999999999997e-07 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887649+0000", 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2439999999999999e-06 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.143 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:01.144 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887657+0000", 2023-10-08T07:08:01.144 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0059999999999992e-06 2023-10-08T07:08:01.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.144 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.144 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.144 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887663+0000", 2023-10-08T07:08:01.144 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7869999999999998e-06 2023-10-08T07:08:01.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.144 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.144 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:01.144 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.060892+0000", 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17322955700000001 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.060978+0000", 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5358999999999994e-05 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.061180+0000", 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020268400000000001 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.145 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:01.146 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070342+0000", 2023-10-08T07:08:01.146 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0091617230000000001 2023-10-08T07:08:01.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.146 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125534+0000", 2023-10-08T07:08:01.146 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055191764999999997 2023-10-08T07:08:01.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.146 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:01.146 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125591+0000", 2023-10-08T07:08:01.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7606999999999999e-05 2023-10-08T07:08:01.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:01.147 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:01.147 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:01.147 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125633+0000", 2023-10-08T07:08:01.147 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1950999999999999e-05 2023-10-08T07:08:01.147 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.147 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.147 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.147 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:01.147 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:01.148 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:08:01.149 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:08:01.148+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:08:01.150 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2023-10-08T07:08:01.150 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:08:01.250 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:08:01.249+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:08:01.282 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:08:01.282 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:08:01.282 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:08:01.282 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:08:01.291 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:08:01.351 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:01.350+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:01.451 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:01.450+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:01.458 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:08:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:08:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:08:01.458 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:08:01.458 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:08:01.469 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:08:01.553 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:01.552+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:01.597 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:08:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2023-10-08T07:08:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2023-10-08T07:08:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2023-10-08T07:08:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147479 4.0 4:02bf98b6:::10000000004.0000000e:head [write 258048~4096,write 442368~4096,write 520192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:08:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.065345459, 2023-10-08T07:08:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.462729097, 2023-10-08T07:08:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147479 2023-10-08T07:08:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:08:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.530480+0000", 2023-10-08T07:08:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533313+0000", 2023-10-08T07:08:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002832841 2023-10-08T07:08:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533338+0000", 2023-10-08T07:08:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5052999999999999e-05 2023-10-08T07:08:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533350+0000", 2023-10-08T07:08:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2561000000000001e-05 2023-10-08T07:08:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.533357+0000", 2023-10-08T07:08:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0870000000000001e-06 2023-10-08T07:08:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963719+0000", 2023-10-08T07:08:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4303612779999999 2023-10-08T07:08:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963788+0000", 2023-10-08T07:08:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9751000000000004e-05 2023-10-08T07:08:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:08:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.963941+0000", 2023-10-08T07:08:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015224499999999999 2023-10-08T07:08:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.971897+0000", 2023-10-08T07:08:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0079562769999999994 2023-10-08T07:08:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993080+0000", 2023-10-08T07:08:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021183400000000002 2023-10-08T07:08:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993161+0000", 2023-10-08T07:08:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1045999999999996e-05 2023-10-08T07:08:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993209+0000", 2023-10-08T07:08:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7558000000000001e-05 2023-10-08T07:08:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147519 4.10 4:08d50e0e:::10000000004.0000003f:head [write 258048~4096,write 417792~4096,write 1318912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:08:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.054324421, 2023-10-08T07:08:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.467910235, 2023-10-08T07:08:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147519 2023-10-08T07:08:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:08:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:08:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541501+0000", 2023-10-08T07:08:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5199999999999998e-07 2023-10-08T07:08:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541510+0000", 2023-10-08T07:08:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4690000000000003e-06 2023-10-08T07:08:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541515+0000", 2023-10-08T07:08:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7260000000000002e-06 2023-10-08T07:08:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541518+0000", 2023-10-08T07:08:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7329999999999999e-06 2023-10-08T07:08:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.977538+0000", 2023-10-08T07:08:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.436020313 2023-10-08T07:08:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.977630+0000", 2023-10-08T07:08:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1893999999999998e-05 2023-10-08T07:08:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009278+0000", 2023-10-08T07:08:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.031647661000000001 2023-10-08T07:08:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009334+0000", 2023-10-08T07:08:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6366999999999998e-05 2023-10-08T07:08:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009411+0000", 2023-10-08T07:08:01.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.682e-05 2023-10-08T07:08:01.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.611 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.611 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147523 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2183168~4096,write 2215936~4096,write 2228224~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.612 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:08:01.612 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.054283328, 2023-10-08T07:08:01.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4714357950000001, 2023-10-08T07:08:01.612 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.612 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.612 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147523 2023-10-08T07:08:01.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.612 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:08:01.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:08:01.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541542+0000", 2023-10-08T07:08:01.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.35e-07 2023-10-08T07:08:01.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541554+0000", 2023-10-08T07:08:01.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1515000000000001e-05 2023-10-08T07:08:01.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541557+0000", 2023-10-08T07:08:01.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.675e-06 2023-10-08T07:08:01.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541560+0000", 2023-10-08T07:08:01.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.841e-06 2023-10-08T07:08:01.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980499+0000", 2023-10-08T07:08:01.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.43893866 2023-10-08T07:08:01.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980591+0000", 2023-10-08T07:08:01.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1970000000000002e-05 2023-10-08T07:08:01.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:08:01.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.980759+0000", 2023-10-08T07:08:01.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016861099999999999 2023-10-08T07:08:01.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.993040+0000", 2023-10-08T07:08:01.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012280798000000001 2023-10-08T07:08:01.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012884+0000", 2023-10-08T07:08:01.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019843573 2023-10-08T07:08:01.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012938+0000", 2023-10-08T07:08:01.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4462000000000001e-05 2023-10-08T07:08:01.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.012978+0000", 2023-10-08T07:08:01.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9455000000000001e-05 2023-10-08T07:08:01.619 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.619 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.619 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.620 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147525 4.28 4:16edf4d3:::10000000004.00000027:head [write 1671168~4096,write 1994752~4096,write 2002944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.620 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:08:01.620 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.054005067999999, 2023-10-08T07:08:01.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4828482860000001, 2023-10-08T07:08:01.620 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.620 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.620 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.620 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.621 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147525 2023-10-08T07:08:01.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.621 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:08:01.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.541820+0000", 2023-10-08T07:08:01.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545293+0000", 2023-10-08T07:08:01.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034732809999999999 2023-10-08T07:08:01.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545312+0000", 2023-10-08T07:08:01.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8156999999999999e-05 2023-10-08T07:08:01.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545323+0000", 2023-10-08T07:08:01.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1215e-05 2023-10-08T07:08:01.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545331+0000", 2023-10-08T07:08:01.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2859999999999999e-06 2023-10-08T07:08:01.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.998284+0000", 2023-10-08T07:08:01.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4529525249999999 2023-10-08T07:08:01.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.998394+0000", 2023-10-08T07:08:01.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000110214 2023-10-08T07:08:01.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024519+0000", 2023-10-08T07:08:01.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026125603000000001 2023-10-08T07:08:01.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024578+0000", 2023-10-08T07:08:01.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8779000000000001e-05 2023-10-08T07:08:01.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024668+0000", 2023-10-08T07:08:01.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0226e-05 2023-10-08T07:08:01.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.627 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.628 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147529 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3813376~4096,write 3833856~4096,write 3846144~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.628 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:08:01.628 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.050443757, 2023-10-08T07:08:01.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4795143450000001, 2023-10-08T07:08:01.628 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.628 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.629 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147529 2023-10-08T07:08:01.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.629 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:08:01.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545381+0000", 2023-10-08T07:08:01.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545382+0000", 2023-10-08T07:08:01.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.51e-07 2023-10-08T07:08:01.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545394+0000", 2023-10-08T07:08:01.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1969e-05 2023-10-08T07:08:01.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545403+0000", 2023-10-08T07:08:01.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7460000000000006e-06 2023-10-08T07:08:01.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.545408+0000", 2023-10-08T07:08:01.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6749999999999999e-06 2023-10-08T07:08:01.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:42.999994+0000", 2023-10-08T07:08:01.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4545859759999999 2023-10-08T07:08:01.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.000091+0000", 2023-10-08T07:08:01.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6803000000000001e-05 2023-10-08T07:08:01.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024769+0000", 2023-10-08T07:08:01.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024677977 2023-10-08T07:08:01.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024819+0000", 2023-10-08T07:08:01.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.02e-05 2023-10-08T07:08:01.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024896+0000", 2023-10-08T07:08:01.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6447999999999997e-05 2023-10-08T07:08:01.635 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.635 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.635 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.635 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147541 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3600384~4096,write 3616768~4096,write 3747840~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.635 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:08:01.636 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.048439402, 2023-10-08T07:08:01.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478191619, 2023-10-08T07:08:01.636 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.636 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.636 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.636 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.636 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.636 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147541 2023-10-08T07:08:01.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.636 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:08:01.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:08:01.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547386+0000", 2023-10-08T07:08:01.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1899999999999998e-07 2023-10-08T07:08:01.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547397+0000", 2023-10-08T07:08:01.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1263999999999999e-05 2023-10-08T07:08:01.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547401+0000", 2023-10-08T07:08:01.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7409999999999998e-06 2023-10-08T07:08:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547404+0000", 2023-10-08T07:08:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9890000000000001e-06 2023-10-08T07:08:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.004793+0000", 2023-10-08T07:08:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.457389024 2023-10-08T07:08:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.004869+0000", 2023-10-08T07:08:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6027999999999998e-05 2023-10-08T07:08:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:08:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005024+0000", 2023-10-08T07:08:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015473799999999999 2023-10-08T07:08:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024718+0000", 2023-10-08T07:08:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019694555999999998 2023-10-08T07:08:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.024905+0000", 2023-10-08T07:08:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018695800000000001 2023-10-08T07:08:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025500+0000", 2023-10-08T07:08:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00059492300000000002 2023-10-08T07:08:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025577+0000", 2023-10-08T07:08:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7078999999999998e-05 2023-10-08T07:08:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147542 4.28 4:15b6682b:::10000000004.0000000b:head [write 1032192~4096,write 1110016~4096,write 1138688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:08:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.048416672999998, 2023-10-08T07:08:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478297658, 2023-10-08T07:08:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147542 2023-10-08T07:08:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:08:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.547409+0000", 2023-10-08T07:08:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549299+0000", 2023-10-08T07:08:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018905650000000001 2023-10-08T07:08:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549316+0000", 2023-10-08T07:08:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7065999999999999e-05 2023-10-08T07:08:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549327+0000", 2023-10-08T07:08:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0573e-05 2023-10-08T07:08:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549335+0000", 2023-10-08T07:08:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9410000000000007e-06 2023-10-08T07:08:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005115+0000", 2023-10-08T07:08:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.455780069 2023-10-08T07:08:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.005188+0000", 2023-10-08T07:08:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3668e-05 2023-10-08T07:08:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025587+0000", 2023-10-08T07:08:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020398199999999998 2023-10-08T07:08:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025640+0000", 2023-10-08T07:08:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2023-10-08T07:08:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025706+0000", 2023-10-08T07:08:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6589999999999998e-05 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147545 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3223552~4096,write 3239936~4096,write 3317760~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.046427866999998, 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.485135557, 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147545 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549397+0000", 2023-10-08T07:08:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549407+0000", 2023-10-08T07:08:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0103e-05 2023-10-08T07:08:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549421+0000", 2023-10-08T07:08:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3995999999999999e-05 2023-10-08T07:08:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549430+0000", 2023-10-08T07:08:01.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3329999999999997e-06 2023-10-08T07:08:01.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.549443+0000", 2023-10-08T07:08:01.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3492000000000001e-05 2023-10-08T07:08:01.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009122+0000", 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4596791790000001 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009194+0000", 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1960999999999998e-05 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009336+0000", 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014156999999999999 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025872+0000", 2023-10-08T07:08:01.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016536417000000001 2023-10-08T07:08:01.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034437+0000", 2023-10-08T07:08:01.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0085645029999999994 2023-10-08T07:08:01.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034492+0000", 2023-10-08T07:08:01.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4688999999999998e-05 2023-10-08T07:08:01.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.034533+0000", 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1313999999999998e-05 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147579 4.28 4:15b6682b:::10000000004.0000000b:head [write 3035136~8192,write 3059712~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.032480831000001, 2023-10-08T07:08:01.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.462488893, 2023-10-08T07:08:01.660 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.660 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.660 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.660 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.660 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.660 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147579 2023-10-08T07:08:01.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.660 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:08:01.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563344+0000", 2023-10-08T07:08:01.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563345+0000", 2023-10-08T07:08:01.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7700000000000005e-07 2023-10-08T07:08:01.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563359+0000", 2023-10-08T07:08:01.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4199000000000001e-05 2023-10-08T07:08:01.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563366+0000", 2023-10-08T07:08:01.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8619999999999997e-06 2023-10-08T07:08:01.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.563371+0000", 2023-10-08T07:08:01.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4060000000000004e-06 2023-10-08T07:08:01.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009484+0000", 2023-10-08T07:08:01.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4461131300000001 2023-10-08T07:08:01.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.009562+0000", 2023-10-08T07:08:01.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8046999999999993e-05 2023-10-08T07:08:01.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025714+0000", 2023-10-08T07:08:01.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016151327 2023-10-08T07:08:01.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025754+0000", 2023-10-08T07:08:01.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0049000000000002e-05 2023-10-08T07:08:01.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025833+0000", 2023-10-08T07:08:01.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9395999999999997e-05 2023-10-08T07:08:01.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.665 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.665 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147591 4.28 4:16edf4d3:::10000000004.00000027:head [write 684032~4096,write 741376~4096,write 765952~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.665 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:08:01.666 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.028381966000001, 2023-10-08T07:08:01.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4805182619999999, 2023-10-08T07:08:01.666 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.666 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.666 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.666 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.666 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.666 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147591 2023-10-08T07:08:01.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.666 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567443+0000", 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567444+0000", 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8500000000000001e-07 2023-10-08T07:08:01.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567456+0000", 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2221e-05 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567463+0000", 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.652e-06 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.567468+0000", 2023-10-08T07:08:01.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8500000000000002e-06 2023-10-08T07:08:01.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.025908+0000", 2023-10-08T07:08:01.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.458440948 2023-10-08T07:08:01.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.026004+0000", 2023-10-08T07:08:01.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5805999999999997e-05 2023-10-08T07:08:01.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047842+0000", 2023-10-08T07:08:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021837770999999999 2023-10-08T07:08:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047894+0000", 2023-10-08T07:08:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2079000000000001e-05 2023-10-08T07:08:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047961+0000", 2023-10-08T07:08:01.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7349999999999997e-05 2023-10-08T07:08:01.671 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.671 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.671 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.671 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147596 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2379776~4096,write 2428928~4096,write 2531328~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.671 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:08:01.671 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.026470343, 2023-10-08T07:08:01.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.478728255, 2023-10-08T07:08:01.671 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.672 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.672 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.672 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.672 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.672 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147596 2023-10-08T07:08:01.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.672 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:08:01.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.569355+0000", 2023-10-08T07:08:01.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571294+0000", 2023-10-08T07:08:01.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001939037 2023-10-08T07:08:01.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571314+0000", 2023-10-08T07:08:01.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9791000000000001e-05 2023-10-08T07:08:01.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571327+0000", 2023-10-08T07:08:01.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3078000000000001e-05 2023-10-08T07:08:01.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.571334+0000", 2023-10-08T07:08:01.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2429999999999999e-06 2023-10-08T07:08:01.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.028808+0000", 2023-10-08T07:08:01.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4574743030000001 2023-10-08T07:08:01.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.028888+0000", 2023-10-08T07:08:01.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9818e-05 2023-10-08T07:08:01.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.047970+0000", 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.019082359 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048017+0000", 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6943000000000001e-05 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048083+0000", 2023-10-08T07:08:01.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5683000000000001e-05 2023-10-08T07:08:01.677 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.677 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.677 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.677 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147608 4.10 4:08d50e0e:::10000000004.0000003f:head [write 3088384~4096,write 3145728~4096,write 3276800~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.677 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:08:01.677 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.018434057, 2023-10-08T07:08:01.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4708017579999999, 2023-10-08T07:08:01.677 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.677 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.678 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.678 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.678 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147608 2023-10-08T07:08:01.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.678 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:08:01.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577391+0000", 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577392+0000", 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1099999999999996e-07 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577404+0000", 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2544999999999999e-05 2023-10-08T07:08:01.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577411+0000", 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4219999999999997e-06 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.577416+0000", 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9729999999999997e-06 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031697+0000", 2023-10-08T07:08:01.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.454281656 2023-10-08T07:08:01.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031771+0000", 2023-10-08T07:08:01.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3440000000000002e-05 2023-10-08T07:08:01.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048095+0000", 2023-10-08T07:08:01.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016324241999999999 2023-10-08T07:08:01.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048134+0000", 2023-10-08T07:08:01.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9558999999999999e-05 2023-10-08T07:08:01.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048193+0000", 2023-10-08T07:08:01.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8409999999999998e-05 2023-10-08T07:08:01.682 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.682 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.682 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.683 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147614 4.0 4:02bf98b6:::10000000004.0000000e:head [write 2973696~4096,write 3149824~4096,write 3158016~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.683 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:08:01.683 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.016443659, 2023-10-08T07:08:01.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4709725659999999, 2023-10-08T07:08:01.683 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.683 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.683 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.683 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.683 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.683 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147614 2023-10-08T07:08:01.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.684 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:08:01.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:08:01.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579382+0000", 2023-10-08T07:08:01.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.51e-07 2023-10-08T07:08:01.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579394+0000", 2023-10-08T07:08:01.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.207e-05 2023-10-08T07:08:01.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579401+0000", 2023-10-08T07:08:01.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3900000000000004e-06 2023-10-08T07:08:01.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579406+0000", 2023-10-08T07:08:01.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9490000000000004e-06 2023-10-08T07:08:01.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031686+0000", 2023-10-08T07:08:01.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4522797299999999 2023-10-08T07:08:01.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031763+0000", 2023-10-08T07:08:01.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6432000000000003e-05 2023-10-08T07:08:01.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:08:01.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.031910+0000", 2023-10-08T07:08:01.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014741900000000001 2023-10-08T07:08:01.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.048090+0000", 2023-10-08T07:08:01.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016179948999999999 2023-10-08T07:08:01.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050261+0000", 2023-10-08T07:08:01.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021715860000000001 2023-10-08T07:08:01.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050320+0000", 2023-10-08T07:08:01.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8217999999999997e-05 2023-10-08T07:08:01.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.050354+0000", 2023-10-08T07:08:01.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4372000000000002e-05 2023-10-08T07:08:01.690 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.690 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.690 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.690 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147623 4.28 4:16edf4d3:::10000000004.00000027:head [write 1306624~4096,write 1331200~4096,write 1429504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.690 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:08:01.690 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.016320473, 2023-10-08T07:08:01.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.497941188, 2023-10-08T07:08:01.690 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.690 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.691 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.691 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.691 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.691 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147623 2023-10-08T07:08:01.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.691 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:08:01.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.579505+0000", 2023-10-08T07:08:01.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582310+0000", 2023-10-08T07:08:01.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028050800000000002 2023-10-08T07:08:01.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582327+0000", 2023-10-08T07:08:01.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6807e-05 2023-10-08T07:08:01.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582337+0000", 2023-10-08T07:08:01.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0454e-05 2023-10-08T07:08:01.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.582344+0000", 2023-10-08T07:08:01.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2239999999999998e-06 2023-10-08T07:08:01.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.052947+0000", 2023-10-08T07:08:01.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4706025979999999 2023-10-08T07:08:01.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.053025+0000", 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7985000000000006e-05 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077312+0000", 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024286855999999999 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077368+0000", 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5834000000000001e-05 2023-10-08T07:08:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077446+0000", 2023-10-08T07:08:01.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8349999999999994e-05 2023-10-08T07:08:01.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.696 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.696 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147645 4.0 4:02bf98b6:::10000000004.0000000e:head [write 1941504~4096,write 2043904~4096,write 2076672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.696 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:08:01.696 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.005468180000001, 2023-10-08T07:08:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4872246599999999, 2023-10-08T07:08:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147645 2023-10-08T07:08:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590357+0000", 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0100000000000001e-07 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590367+0000", 2023-10-08T07:08:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2830000000000007e-06 2023-10-08T07:08:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590372+0000", 2023-10-08T07:08:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0880000000000002e-06 2023-10-08T07:08:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590375+0000", 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9869999999999999e-06 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055521+0000", 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4651462099999999 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055589+0000", 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7916999999999994e-05 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:08:01.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.055718+0000", 2023-10-08T07:08:01.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012877200000000001 2023-10-08T07:08:01.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.076842+0000", 2023-10-08T07:08:01.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021124074999999999 2023-10-08T07:08:01.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077494+0000", 2023-10-08T07:08:01.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00065233700000000001 2023-10-08T07:08:01.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077539+0000", 2023-10-08T07:08:01.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4829000000000001e-05 2023-10-08T07:08:01.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077582+0000", 2023-10-08T07:08:01.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2861000000000002e-05 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147649 4.10 4:08d50e0e:::10000000004.0000003f:head [write 1347584~4096,write 1568768~4096,write 1728512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.005446456000001, 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4873494039999999, 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.703 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.704 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.704 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147649 2023-10-08T07:08:01.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.704 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:08:01.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:08:01.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590379+0000", 2023-10-08T07:08:01.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7399999999999999e-07 2023-10-08T07:08:01.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590389+0000", 2023-10-08T07:08:01.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7019999999999996e-06 2023-10-08T07:08:01.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590394+0000", 2023-10-08T07:08:01.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1229999999999999e-06 2023-10-08T07:08:01.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.590397+0000", 2023-10-08T07:08:01.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8480000000000001e-06 2023-10-08T07:08:01.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.056106+0000", 2023-10-08T07:08:01.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4657090159999999 2023-10-08T07:08:01.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.056177+0000", 2023-10-08T07:08:01.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1148000000000004e-05 2023-10-08T07:08:01.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077593+0000", 2023-10-08T07:08:01.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021416101 2023-10-08T07:08:01.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077652+0000", 2023-10-08T07:08:01.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9005999999999997e-05 2023-10-08T07:08:01.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.077728+0000", 2023-10-08T07:08:01.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6186000000000005e-05 2023-10-08T07:08:01.709 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.709 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.709 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.709 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147667 4.10 4:08d50e0e:::10000000004.0000003f:head [write 2600960~4096,write 2826240~4096,write 2871296~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.709 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:08:01.709 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 20.001286031999999, 2023-10-08T07:08:01.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4900356029999999, 2023-10-08T07:08:01.709 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.710 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.710 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.710 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.710 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.710 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147667 2023-10-08T07:08:01.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.710 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:08:01.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.594539+0000", 2023-10-08T07:08:01.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596594+0000", 2023-10-08T07:08:01.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020548599999999999 2023-10-08T07:08:01.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596614+0000", 2023-10-08T07:08:01.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0228e-05 2023-10-08T07:08:01.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596625+0000", 2023-10-08T07:08:01.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0721e-05 2023-10-08T07:08:01.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.596633+0000", 2023-10-08T07:08:01.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5900000000000002e-06 2023-10-08T07:08:01.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.059476+0000", 2023-10-08T07:08:01.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4628431820000001 2023-10-08T07:08:01.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.059555+0000", 2023-10-08T07:08:01.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9192999999999999e-05 2023-10-08T07:08:01.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084434+0000", 2023-10-08T07:08:01.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024879571999999999 2023-10-08T07:08:01.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084501+0000", 2023-10-08T07:08:01.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6129000000000003e-05 2023-10-08T07:08:01.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084575+0000", 2023-10-08T07:08:01.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4128000000000006e-05 2023-10-08T07:08:01.715 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.715 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.715 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.715 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147702 4.0 4:02bf98b6:::10000000004.0000000e:head [write 3768320~4096,write 3788800~4096,write 3817472~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.715 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:08:01.715 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.978258751999999, 2023-10-08T07:08:01.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4668568, 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147702 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617566+0000", 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617567+0000", 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6899999999999998e-07 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617578+0000", 2023-10-08T07:08:01.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0922e-05 2023-10-08T07:08:01.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617584+0000", 2023-10-08T07:08:01.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7849999999999997e-06 2023-10-08T07:08:01.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617588+0000", 2023-10-08T07:08:01.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6310000000000002e-06 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062218+0000", 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4446299810000001 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062303+0000", 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4648999999999995e-05 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2023-10-08T07:08:01.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062425+0000", 2023-10-08T07:08:01.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012220899999999999 2023-10-08T07:08:01.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:01.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.076883+0000", 2023-10-08T07:08:01.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014458354 2023-10-08T07:08:01.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084302+0000", 2023-10-08T07:08:01.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074189310000000001 2023-10-08T07:08:01.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084374+0000", 2023-10-08T07:08:01.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1519000000000004e-05 2023-10-08T07:08:01.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.084423+0000", 2023-10-08T07:08:01.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000003e-05 2023-10-08T07:08:01.721 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.722 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.722 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147713 4.28 4:15b6682b:::10000000004.0000000b:head [write 2990080~4096,write 3133440~4096,write 3362816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.722 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:08:01.722 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.978126229000001, 2023-10-08T07:08:01.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707889380000001, 2023-10-08T07:08:01.722 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.722 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.722 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.722 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.723 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.723 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147713 2023-10-08T07:08:01.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.723 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:08:01.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617699+0000", 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.89e-07 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617718+0000", 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8287e-05 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617724+0000", 2023-10-08T07:08:01.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7939999999999997e-06 2023-10-08T07:08:01.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617730+0000", 2023-10-08T07:08:01.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1819999999999997e-06 2023-10-08T07:08:01.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062893+0000", 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4451633429999999 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.062969+0000", 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6119999999999996e-05 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088335+0000", 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.025366289 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088399+0000", 2023-10-08T07:08:01.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4067999999999997e-05 2023-10-08T07:08:01.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.088488+0000", 2023-10-08T07:08:01.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8466000000000003e-05 2023-10-08T07:08:01.727 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.727 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.727 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.728 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4556.0:147714 4.28 4:15b6682b:::10000000004.0000000b:head [write 1286144~4096,write 1372160~4096,write 1523712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2023-10-08T07:08:01.728 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:08:01.728 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.978088118999999, 2023-10-08T07:08:01.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.471492757, 2023-10-08T07:08:01.728 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2023-10-08T07:08:01.728 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:01.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2023-10-08T07:08:01.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4556", 2023-10-08T07:08:01.728 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:01.728 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147714 2023-10-08T07:08:01.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2023-10-08T07:08:01.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617737+0000", 2023-10-08T07:08:01.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.34e-07 2023-10-08T07:08:01.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2023-10-08T07:08:01.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617751+0000", 2023-10-08T07:08:01.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3570000000000001e-05 2023-10-08T07:08:01.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2023-10-08T07:08:01.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617757+0000", 2023-10-08T07:08:01.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.229e-06 2023-10-08T07:08:01.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2023-10-08T07:08:01.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:41.617762+0000", 2023-10-08T07:08:01.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7670000000000003e-06 2023-10-08T07:08:01.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2023-10-08T07:08:01.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.068000+0000", 2023-10-08T07:08:01.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4502380930000001 2023-10-08T07:08:01.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2023-10-08T07:08:01.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.068049+0000", 2023-10-08T07:08:01.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9051999999999997e-05 2023-10-08T07:08:01.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2023-10-08T07:08:01.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089117+0000", 2023-10-08T07:08:01.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021067536000000001 2023-10-08T07:08:01.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2023-10-08T07:08:01.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089164+0000", 2023-10-08T07:08:01.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7178999999999997e-05 2023-10-08T07:08:01.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T07:08:01.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2023-10-08T07:08:01.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2023-10-08T07:08:01.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2023-10-08T07:07:43.089230+0000", 2023-10-08T07:08:01.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5896999999999996e-05 2023-10-08T07:08:01.734 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.734 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T07:08:01.735 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T07:08:01.735 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:08:01.736 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:01.735+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:01.737 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:08:01.837 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:01.836+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:01.883 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:08:01.883 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:08:01.883 INFO:teuthology.orchestra.run.smithi033.stdout: "num_ops": 0 2023-10-08T07:08:01.883 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:08:01.893 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:08:01.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~83s 2023-10-08T07:08:01.938 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:08:01.938+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:08:02.039 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:02.038+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:02.065 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:08:02.065 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [], 2023-10-08T07:08:02.065 INFO:teuthology.orchestra.run.smithi033.stdout: "complaint_time": 30, 2023-10-08T07:08:02.065 INFO:teuthology.orchestra.run.smithi033.stdout: "num_blocked_ops": 0 2023-10-08T07:08:02.066 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:08:02.075 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:08:02.140 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:08:02.139+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:08:02.240 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:02.240+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:02.250 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:08:02.251 INFO:teuthology.orchestra.run.smithi033.stdout: "size": 20, 2023-10-08T07:08:02.251 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 600, 2023-10-08T07:08:02.251 INFO:teuthology.orchestra.run.smithi033.stdout: "ops": [ 2023-10-08T07:08:02.251 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.251 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175316 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 696320~4096,write 745472~4096,write 942080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.251 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:08:02.251 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.586589399999999, 2023-10-08T07:08:02.251 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.239832828, 2023-10-08T07:08:02.251 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.251 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.251 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.252 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.252 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.252 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175316 2023-10-08T07:08:02.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.252 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.252 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.252 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:08:02.252 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.252 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662051+0000", 2023-10-08T07:08:02.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.253 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.253 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662052+0000", 2023-10-08T07:08:02.253 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9599999999999998e-07 2023-10-08T07:08:02.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.253 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.254 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662064+0000", 2023-10-08T07:08:02.254 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.226e-05 2023-10-08T07:08:02.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.254 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.254 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662074+0000", 2023-10-08T07:08:02.255 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0057999999999999e-05 2023-10-08T07:08:02.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.255 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.255 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.255 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.662082+0000", 2023-10-08T07:08:02.255 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.593e-06 2023-10-08T07:08:02.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.255 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.255 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.868775+0000", 2023-10-08T07:08:02.256 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.20669354700000001 2023-10-08T07:08:02.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.256 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.256 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.256 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.868864+0000", 2023-10-08T07:08:02.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9174999999999999e-05 2023-10-08T07:08:02.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.257 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.257 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.257 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.869012+0000", 2023-10-08T07:08:02.257 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014747 2023-10-08T07:08:02.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.258 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.258 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.885657+0000", 2023-10-08T07:08:02.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016645008999999999 2023-10-08T07:08:02.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.258 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.258 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.258 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901768+0000", 2023-10-08T07:08:02.258 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016110721000000001 2023-10-08T07:08:02.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.260 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901841+0000", 2023-10-08T07:08:02.260 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3047999999999996e-05 2023-10-08T07:08:02.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.260 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.260 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.260 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.901884+0000", 2023-10-08T07:08:02.261 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3050999999999998e-05 2023-10-08T07:08:02.261 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.261 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.261 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.261 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.261 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175432 4.1a 4:5a59f83a:::10000000004.00000002:head [write 196608~4096,write 245760~4096,write 270336~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.261 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:08:02.261 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.549471425, 2023-10-08T07:08:02.261 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.23774203799999999, 2023-10-08T07:08:02.261 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.261 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.262 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.262 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.262 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.262 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175432 2023-10-08T07:08:02.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.262 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.262 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.262 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.262 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:08:02.262 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.263 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699169+0000", 2023-10-08T07:08:02.263 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.263 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699170+0000", 2023-10-08T07:08:02.263 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7000000000000004e-07 2023-10-08T07:08:02.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.263 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.263 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.264 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699181+0000", 2023-10-08T07:08:02.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1581e-05 2023-10-08T07:08:02.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.264 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.264 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699199+0000", 2023-10-08T07:08:02.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7376000000000001e-05 2023-10-08T07:08:02.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.264 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.264 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.699206+0000", 2023-10-08T07:08:02.264 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7190000000000001e-06 2023-10-08T07:08:02.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.265 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.265 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907275+0000", 2023-10-08T07:08:02.265 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.20806835700000001 2023-10-08T07:08:02.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907359+0000", 2023-10-08T07:08:02.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.4320999999999994e-05 2023-10-08T07:08:02.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.266 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.907546+0000", 2023-10-08T07:08:02.266 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00018752299999999999 2023-10-08T07:08:02.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.266 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.267 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.925780+0000", 2023-10-08T07:08:02.267 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.018233909999999999 2023-10-08T07:08:02.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.267 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.267 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936786+0000", 2023-10-08T07:08:02.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011005355 2023-10-08T07:08:02.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936868+0000", 2023-10-08T07:08:02.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1917999999999997e-05 2023-10-08T07:08:02.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.268 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.268 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.268 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.936911+0000", 2023-10-08T07:08:02.268 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3207999999999997e-05 2023-10-08T07:08:02.269 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.269 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.269 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.269 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.269 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175676 4.3a 4:5f183e4b:::10000000004.00000023:head [write 2719744~4096,write 2822144~4096,write 2945024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.269 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:08:02.269 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.477372066999999, 2023-10-08T07:08:02.269 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24978785000000001, 2023-10-08T07:08:02.269 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.269 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.269 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.270 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.270 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.270 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175676 2023-10-08T07:08:02.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.270 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.270 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:08:02.270 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.270 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.270 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771268+0000", 2023-10-08T07:08:02.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771269+0000", 2023-10-08T07:08:02.271 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7100000000000002e-07 2023-10-08T07:08:02.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.271 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.271 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771287+0000", 2023-10-08T07:08:02.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.8022000000000001e-05 2023-10-08T07:08:02.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771293+0000", 2023-10-08T07:08:02.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3029999999999996e-06 2023-10-08T07:08:02.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.272 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.272 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.272 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.771297+0000", 2023-10-08T07:08:02.272 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2830000000000003e-06 2023-10-08T07:08:02.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.273 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.961848+0000", 2023-10-08T07:08:02.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.190550999 2023-10-08T07:08:02.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.273 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.273 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.961954+0000", 2023-10-08T07:08:02.273 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000105485 2023-10-08T07:08:02.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.274 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.274 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.962114+0000", 2023-10-08T07:08:02.274 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00016024499999999999 2023-10-08T07:08:02.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.274 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.274 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.975848+0000", 2023-10-08T07:08:02.274 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013733886000000001 2023-10-08T07:08:02.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.274 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.274 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.275 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.020956+0000", 2023-10-08T07:08:02.275 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045108400999999999 2023-10-08T07:08:02.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.275 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.275 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.275 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021013+0000", 2023-10-08T07:08:02.275 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.6277999999999999e-05 2023-10-08T07:08:02.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.275 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.275 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.275 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021056+0000", 2023-10-08T07:08:02.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.3377000000000002e-05 2023-10-08T07:08:02.276 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.276 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.276 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.276 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.276 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175680 4.3a 4:5f183e4b:::10000000004.00000023:head [write 3502080~4096,write 3534848~4096,write 3608576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.276 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:08:02.276 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.475427134, 2023-10-08T07:08:02.276 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24812537200000001, 2023-10-08T07:08:02.276 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.276 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.277 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.277 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.277 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.277 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175680 2023-10-08T07:08:02.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.277 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.277 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.277 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:08:02.277 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773213+0000", 2023-10-08T07:08:02.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.278 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773214+0000", 2023-10-08T07:08:02.278 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.403e-06 2023-10-08T07:08:02.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.278 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.278 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773227+0000", 2023-10-08T07:08:02.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.3001e-05 2023-10-08T07:08:02.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773240+0000", 2023-10-08T07:08:02.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2441e-05 2023-10-08T07:08:02.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.279 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.279 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.279 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.773249+0000", 2023-10-08T07:08:02.279 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8890000000000008e-06 2023-10-08T07:08:02.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.280 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964327+0000", 2023-10-08T07:08:02.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19107864499999999 2023-10-08T07:08:02.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.280 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.280 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964418+0000", 2023-10-08T07:08:02.280 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.0131999999999997e-05 2023-10-08T07:08:02.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.280 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.281 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.281 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.964602+0000", 2023-10-08T07:08:02.281 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000184711 2023-10-08T07:08:02.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.281 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.281 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.281 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976021+0000", 2023-10-08T07:08:02.281 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011418822 2023-10-08T07:08:02.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.281 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.281 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.281 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021236+0000", 2023-10-08T07:08:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045214467000000001 2023-10-08T07:08:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021303+0000", 2023-10-08T07:08:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.7210000000000002e-05 2023-10-08T07:08:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021338+0000", 2023-10-08T07:08:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5651000000000001e-05 2023-10-08T07:08:02.282 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.283 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.283 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.283 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175690 4.1a 4:5a59f83a:::10000000004.00000002:head [write 405504~4096,write 811008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.283 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:08:02.283 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.472873368, 2023-10-08T07:08:02.283 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.245421262, 2023-10-08T07:08:02.283 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.283 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.283 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.283 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.284 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.284 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175690 2023-10-08T07:08:02.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.284 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.284 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.284 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:08:02.284 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.284 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.284 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:08:02.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.285 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775767+0000", 2023-10-08T07:08:02.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.3600000000000004e-07 2023-10-08T07:08:02.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.285 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.285 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775774+0000", 2023-10-08T07:08:02.285 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.9460000000000001e-06 2023-10-08T07:08:02.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.286 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.286 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775781+0000", 2023-10-08T07:08:02.286 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8349999999999998e-06 2023-10-08T07:08:02.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.286 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.286 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.775785+0000", 2023-10-08T07:08:02.286 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7290000000000002e-06 2023-10-08T07:08:02.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.287 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.287 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967188+0000", 2023-10-08T07:08:02.287 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19140304299999999 2023-10-08T07:08:02.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.287 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.287 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.287 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967267+0000", 2023-10-08T07:08:02.287 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.9154999999999997e-05 2023-10-08T07:08:02.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.288 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967405+0000", 2023-10-08T07:08:02.288 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000137618 2023-10-08T07:08:02.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.288 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976028+0000", 2023-10-08T07:08:02.288 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0086236869999999997 2023-10-08T07:08:02.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.288 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021096+0000", 2023-10-08T07:08:02.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.045067928 2023-10-08T07:08:02.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.289 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.289 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021147+0000", 2023-10-08T07:08:02.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0399000000000003e-05 2023-10-08T07:08:02.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.289 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.289 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.289 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.021188+0000", 2023-10-08T07:08:02.289 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1386e-05 2023-10-08T07:08:02.290 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.290 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.290 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.290 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175692 4.a 4:524fba76:::10000000004.0000001b:head [write 737280~4096,write 749568~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.290 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:08:02.290 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.472419646000001, 2023-10-08T07:08:02.290 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25024756399999998, 2023-10-08T07:08:02.290 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.290 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.290 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.291 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.291 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.291 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175692 2023-10-08T07:08:02.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.291 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.291 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.291 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:08:02.291 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.291 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:08:02.292 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776221+0000", 2023-10-08T07:08:02.292 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1200000000000003e-07 2023-10-08T07:08:02.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.292 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.292 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776238+0000", 2023-10-08T07:08:02.292 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.7269e-05 2023-10-08T07:08:02.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.293 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776247+0000", 2023-10-08T07:08:02.293 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5189999999999992e-06 2023-10-08T07:08:02.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.293 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.293 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.776251+0000", 2023-10-08T07:08:02.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7910000000000002e-06 2023-10-08T07:08:02.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967925+0000", 2023-10-08T07:08:02.294 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.19167456299999999 2023-10-08T07:08:02.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.294 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.294 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.967997+0000", 2023-10-08T07:08:02.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.1666000000000001e-05 2023-10-08T07:08:02.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.968122+0000", 2023-10-08T07:08:02.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00012469 2023-10-08T07:08:02.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.295 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.295 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976268+0000", 2023-10-08T07:08:02.295 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0081468770000000003 2023-10-08T07:08:02.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026375+0000", 2023-10-08T07:08:02.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.050106683999999999 2023-10-08T07:08:02.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.296 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026430+0000", 2023-10-08T07:08:02.296 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.4506999999999998e-05 2023-10-08T07:08:02.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.296 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.297 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.026468+0000", 2023-10-08T07:08:02.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8485999999999997e-05 2023-10-08T07:08:02.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.297 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.297 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175701 4.a 4:524fba76:::10000000004.0000001b:head [write 1503232~4096,write 1540096~4096,write 1560576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.297 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:08:02.297 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.469575968000001, 2023-10-08T07:08:02.297 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.257645717, 2023-10-08T07:08:02.297 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.298 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.298 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.298 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.298 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.298 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175701 2023-10-08T07:08:02.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.298 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.298 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.298 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:08:02.298 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779064+0000", 2023-10-08T07:08:02.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.299 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779065+0000", 2023-10-08T07:08:02.299 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6300000000000005e-07 2023-10-08T07:08:02.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.299 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779074+0000", 2023-10-08T07:08:02.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.7010000000000002e-06 2023-10-08T07:08:02.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779090+0000", 2023-10-08T07:08:02.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6171000000000002e-05 2023-10-08T07:08:02.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.300 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.300 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.779095+0000", 2023-10-08T07:08:02.300 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.9169999999999997e-06 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971272+0000", 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.192177024 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971364+0000", 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2102999999999996e-05 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.301 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.971480+0000", 2023-10-08T07:08:02.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000116307 2023-10-08T07:08:02.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.980645+0000", 2023-10-08T07:08:02.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0091647559999999996 2023-10-08T07:08:02.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.302 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.302 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036634+0000", 2023-10-08T07:08:02.302 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055989555000000003 2023-10-08T07:08:02.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.303 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036673+0000", 2023-10-08T07:08:02.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.8285999999999999e-05 2023-10-08T07:08:02.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.303 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.303 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.036710+0000", 2023-10-08T07:08:02.303 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7234000000000003e-05 2023-10-08T07:08:02.303 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.303 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.304 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.304 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175733 4.a 4:524fba76:::10000000004.0000001b:head [write 2154496~4096,write 2281472~4096,write 2306048~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.304 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:08:02.304 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.458749202, 2023-10-08T07:08:02.304 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25628842600000001, 2023-10-08T07:08:02.304 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.304 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.304 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.304 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.305 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.305 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175733 2023-10-08T07:08:02.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.305 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:08:02.305 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.305 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.305 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:08:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789891+0000", 2023-10-08T07:08:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4900000000000001e-07 2023-10-08T07:08:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789903+0000", 2023-10-08T07:08:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1391e-05 2023-10-08T07:08:02.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789909+0000", 2023-10-08T07:08:02.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6460000000000004e-06 2023-10-08T07:08:02.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.307 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.789916+0000", 2023-10-08T07:08:02.307 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.635e-06 2023-10-08T07:08:02.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.307 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976385+0000", 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18646858799999999 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976432+0000", 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.6885000000000003e-05 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.976521+0000", 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9122999999999994e-05 2023-10-08T07:08:02.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.987479+0000", 2023-10-08T07:08:02.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0109579 2023-10-08T07:08:02.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.309 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046084+0000", 2023-10-08T07:08:02.309 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058605813999999999 2023-10-08T07:08:02.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.309 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.310 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046140+0000", 2023-10-08T07:08:02.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.5770999999999998e-05 2023-10-08T07:08:02.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.310 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.310 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046179+0000", 2023-10-08T07:08:02.310 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9224000000000003e-05 2023-10-08T07:08:02.310 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.310 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.310 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.311 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175743 4.a 4:524fba76:::10000000004.0000001b:head [write 233472~4096,write 684032~4096,write 704512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.311 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:08:02.311 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.455370889999999, 2023-10-08T07:08:02.311 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25305127599999999, 2023-10-08T07:08:02.311 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.311 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.311 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.311 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.311 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.311 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175743 2023-10-08T07:08:02.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.311 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:08:02.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.312 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793269+0000", 2023-10-08T07:08:02.312 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.312 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.312 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793270+0000", 2023-10-08T07:08:02.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.8200000000000008e-07 2023-10-08T07:08:02.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793291+0000", 2023-10-08T07:08:02.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1058000000000001e-05 2023-10-08T07:08:02.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.313 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.313 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.313 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793303+0000", 2023-10-08T07:08:02.313 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1836e-05 2023-10-08T07:08:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.793312+0000", 2023-10-08T07:08:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5809999999999997e-06 2023-10-08T07:08:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.978869+0000", 2023-10-08T07:08:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18555693400000001 2023-10-08T07:08:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.978955+0000", 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6318999999999998e-05 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.979104+0000", 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014935 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.987482+0000", 2023-10-08T07:08:02.315 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0083776749999999994 2023-10-08T07:08:02.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.316 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.316 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046228+0000", 2023-10-08T07:08:02.316 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.058745516999999997 2023-10-08T07:08:02.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.316 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.316 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046285+0000", 2023-10-08T07:08:02.316 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7358000000000002e-05 2023-10-08T07:08:02.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.317 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.317 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046321+0000", 2023-10-08T07:08:02.317 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5666e-05 2023-10-08T07:08:02.317 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.317 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.317 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.317 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.317 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175759 4.a 4:524fba76:::10000000004.0000001b:head [write 2719744~4096,write 2756608~4096,write 2940928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.317 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:08:02.317 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.451600318000001, 2023-10-08T07:08:02.317 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24944019200000001, 2023-10-08T07:08:02.318 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.318 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.318 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.318 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.318 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.318 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175759 2023-10-08T07:08:02.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.318 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.318 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.318 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.318 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:08:02.318 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.319 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:08:02.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.319 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.319 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797040+0000", 2023-10-08T07:08:02.319 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6600000000000003e-07 2023-10-08T07:08:02.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.319 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797047+0000", 2023-10-08T07:08:02.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3600000000000001e-06 2023-10-08T07:08:02.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.320 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797050+0000", 2023-10-08T07:08:02.320 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.6990000000000001e-06 2023-10-08T07:08:02.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.320 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.797054+0000", 2023-10-08T07:08:02.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.3450000000000002e-06 2023-10-08T07:08:02.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981409+0000", 2023-10-08T07:08:02.321 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18435503 2023-10-08T07:08:02.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.321 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.321 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981491+0000", 2023-10-08T07:08:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.2538000000000002e-05 2023-10-08T07:08:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.981690+0000", 2023-10-08T07:08:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00019896200000000001 2023-10-08T07:08:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989237+0000", 2023-10-08T07:08:02.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0075464410000000001 2023-10-08T07:08:02.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.323 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046393+0000", 2023-10-08T07:08:02.323 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.057156086000000002 2023-10-08T07:08:02.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.323 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.323 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.324 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046445+0000", 2023-10-08T07:08:02.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2437e-05 2023-10-08T07:08:02.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.324 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.324 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.046480+0000", 2023-10-08T07:08:02.324 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5027999999999997e-05 2023-10-08T07:08:02.324 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.324 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.324 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.325 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.325 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175778 4.a 4:524fba76:::10000000004.0000001b:head [write 901120~4096,write 1118208~4096,write 1249280~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.325 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:08:02.325 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.446529740999999, 2023-10-08T07:08:02.325 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.26243437800000002, 2023-10-08T07:08:02.325 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.325 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.325 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.325 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.326 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.326 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175778 2023-10-08T07:08:02.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.326 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.326 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.326 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:08:02.326 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.326 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.327 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802110+0000", 2023-10-08T07:08:02.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.327 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802111+0000", 2023-10-08T07:08:02.327 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6000000000000003e-07 2023-10-08T07:08:02.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.327 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.327 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802131+0000", 2023-10-08T07:08:02.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.0109999999999999e-05 2023-10-08T07:08:02.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.328 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802142+0000", 2023-10-08T07:08:02.328 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.0549e-05 2023-10-08T07:08:02.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.328 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.328 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.328 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.802149+0000", 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5229999999999998e-06 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983625+0000", 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.18147571200000001 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983673+0000", 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8007000000000003e-05 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.329 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983764+0000", 2023-10-08T07:08:02.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1242000000000005e-05 2023-10-08T07:08:02.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989240+0000", 2023-10-08T07:08:02.330 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054752689999999996 2023-10-08T07:08:02.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.330 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.330 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064441+0000", 2023-10-08T07:08:02.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.075201198999999996 2023-10-08T07:08:02.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064504+0000", 2023-10-08T07:08:02.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3219999999999994e-05 2023-10-08T07:08:02.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.331 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.331 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064545+0000", 2023-10-08T07:08:02.331 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.0886999999999997e-05 2023-10-08T07:08:02.331 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.332 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.332 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.332 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.332 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175787 4.3a 4:5f183e4b:::10000000004.00000023:head [write 884736~4096,write 958464~4096,write 1261568~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.332 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:08:02.332 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.443940788000001, 2023-10-08T07:08:02.332 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25984544300000001, 2023-10-08T07:08:02.332 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.332 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.332 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.332 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.333 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.333 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175787 2023-10-08T07:08:02.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.333 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.333 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:08:02.333 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.333 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.333 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.333 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804699+0000", 2023-10-08T07:08:02.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.334 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.334 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804700+0000", 2023-10-08T07:08:02.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1299999999999999e-07 2023-10-08T07:08:02.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.334 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.334 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.334 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804723+0000", 2023-10-08T07:08:02.334 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.304e-05 2023-10-08T07:08:02.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804735+0000", 2023-10-08T07:08:02.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1693e-05 2023-10-08T07:08:02.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.335 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.804742+0000", 2023-10-08T07:08:02.335 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5869999999999998e-06 2023-10-08T07:08:02.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.335 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.335 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983619+0000", 2023-10-08T07:08:02.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.178877123 2023-10-08T07:08:02.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983667+0000", 2023-10-08T07:08:02.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8510999999999997e-05 2023-10-08T07:08:02.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.336 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.336 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.336 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.983763+0000", 2023-10-08T07:08:02.336 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.5902000000000004e-05 2023-10-08T07:08:02.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.337 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.337 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.989243+0000", 2023-10-08T07:08:02.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0054799389999999996 2023-10-08T07:08:02.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.337 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.337 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064453+0000", 2023-10-08T07:08:02.337 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.075209837000000002 2023-10-08T07:08:02.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064506+0000", 2023-10-08T07:08:02.338 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.2743e-05 2023-10-08T07:08:02.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.338 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.338 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064545+0000", 2023-10-08T07:08:02.338 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.9255000000000003e-05 2023-10-08T07:08:02.338 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.339 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.339 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.339 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.339 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175801 4.a 4:524fba76:::10000000004.0000001b:head [write 2670592~4096,write 2695168~4096,write 2957312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.339 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:08:02.340 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.439241235000001, 2023-10-08T07:08:02.340 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25527491699999999, 2023-10-08T07:08:02.340 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.340 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.340 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.340 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.340 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.340 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175801 2023-10-08T07:08:02.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.340 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.340 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809399+0000", 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809400+0000", 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.8999999999999996e-07 2023-10-08T07:08:02.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.342 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.342 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809411+0000", 2023-10-08T07:08:02.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1275e-05 2023-10-08T07:08:02.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.342 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.342 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809418+0000", 2023-10-08T07:08:02.342 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.6649999999999997e-06 2023-10-08T07:08:02.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.342 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.809423+0000", 2023-10-08T07:08:02.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.1499999999999998e-06 2023-10-08T07:08:02.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986111+0000", 2023-10-08T07:08:02.343 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17668825299999999 2023-10-08T07:08:02.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.343 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.343 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.343 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986176+0000", 2023-10-08T07:08:02.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.5234999999999995e-05 2023-10-08T07:08:02.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.986313+0000", 2023-10-08T07:08:02.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00013663299999999999 2023-10-08T07:08:02.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.344 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.344 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.001765+0000", 2023-10-08T07:08:02.344 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.015451833999999999 2023-10-08T07:08:02.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064588+0000", 2023-10-08T07:08:02.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062823646999999996 2023-10-08T07:08:02.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.345 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064639+0000", 2023-10-08T07:08:02.345 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0401000000000001e-05 2023-10-08T07:08:02.345 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.345 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.345 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.346 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.064674+0000", 2023-10-08T07:08:02.346 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.5133999999999999e-05 2023-10-08T07:08:02.346 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.346 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.346 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.346 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.346 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175835 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 3133440~4096,write 3272704~4096,write 3280896~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.347 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:08:02.347 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.428603302000001, 2023-10-08T07:08:02.347 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.25013609599999997, 2023-10-08T07:08:02.347 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.347 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.347 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.347 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.347 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.347 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175835 2023-10-08T07:08:02.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.349 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.349 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.349 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:08:02.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820037+0000", 2023-10-08T07:08:02.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.350 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.350 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820038+0000", 2023-10-08T07:08:02.350 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0699999999999997e-07 2023-10-08T07:08:02.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.351 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.351 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820049+0000", 2023-10-08T07:08:02.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1326e-05 2023-10-08T07:08:02.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.351 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.351 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820058+0000", 2023-10-08T07:08:02.351 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.9460000000000004e-06 2023-10-08T07:08:02.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.351 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.820065+0000", 2023-10-08T07:08:02.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.238e-06 2023-10-08T07:08:02.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990302+0000", 2023-10-08T07:08:02.352 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17023707699999999 2023-10-08T07:08:02.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.352 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.352 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.352 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990350+0000", 2023-10-08T07:08:02.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.7941000000000001e-05 2023-10-08T07:08:02.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.353 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.990447+0000", 2023-10-08T07:08:02.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.6552999999999995e-05 2023-10-08T07:08:02.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.353 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.353 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.353 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002051+0000", 2023-10-08T07:08:02.353 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.011604649 2023-10-08T07:08:02.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.354 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.354 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070103+0000", 2023-10-08T07:08:02.354 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.068051639999999997 2023-10-08T07:08:02.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.354 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.354 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.354 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070145+0000", 2023-10-08T07:08:02.355 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2154000000000003e-05 2023-10-08T07:08:02.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.355 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.355 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070173+0000", 2023-10-08T07:08:02.355 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.7965000000000001e-05 2023-10-08T07:08:02.355 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.355 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.355 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.355 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175856 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 2080768~4096,write 2191360~4096,write 2203648~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.356 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:08:02.356 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.423233112, 2023-10-08T07:08:02.356 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24491389, 2023-10-08T07:08:02.356 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.356 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.356 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.356 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.356 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.356 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175856 2023-10-08T07:08:02.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.356 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.356 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:08:02.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.357 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825407+0000", 2023-10-08T07:08:02.357 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.357 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.357 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825408+0000", 2023-10-08T07:08:02.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.5099999999999999e-07 2023-10-08T07:08:02.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825419+0000", 2023-10-08T07:08:02.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1369000000000001e-05 2023-10-08T07:08:02.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.358 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.358 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.358 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825430+0000", 2023-10-08T07:08:02.358 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1226000000000001e-05 2023-10-08T07:08:02.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.359 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.359 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.825437+0000", 2023-10-08T07:08:02.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.156e-06 2023-10-08T07:08:02.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.359 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.359 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992529+0000", 2023-10-08T07:08:02.359 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.167092401 2023-10-08T07:08:02.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.359 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.360 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992594+0000", 2023-10-08T07:08:02.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.4949000000000004e-05 2023-10-08T07:08:02.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.360 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.360 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992688+0000", 2023-10-08T07:08:02.360 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.4011999999999994e-05 2023-10-08T07:08:02.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.360 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.007407+0000", 2023-10-08T07:08:02.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.014718614 2023-10-08T07:08:02.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.361 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070226+0000", 2023-10-08T07:08:02.361 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062819551000000001 2023-10-08T07:08:02.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.361 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.361 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070283+0000", 2023-10-08T07:08:02.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7340000000000003e-05 2023-10-08T07:08:02.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.362 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.362 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070321+0000", 2023-10-08T07:08:02.362 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.7521000000000002e-05 2023-10-08T07:08:02.362 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.362 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.362 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.363 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175864 4.1a 4:5a59f83a:::10000000004.00000002:head [write 4018176~4096,write 4067328~4096,write 4141056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.363 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:08:02.363 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.420200219, 2023-10-08T07:08:02.363 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24198245199999999, 2023-10-08T07:08:02.363 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.363 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.363 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.363 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.363 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.363 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175864 2023-10-08T07:08:02.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.364 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.364 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.364 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:08:02.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.364 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.364 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.364 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828440+0000", 2023-10-08T07:08:02.364 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828441+0000", 2023-10-08T07:08:02.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0100000000000005e-07 2023-10-08T07:08:02.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.365 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.365 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828450+0000", 2023-10-08T07:08:02.365 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.1400000000000006e-06 2023-10-08T07:08:02.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.365 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828461+0000", 2023-10-08T07:08:02.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.099e-05 2023-10-08T07:08:02.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.366 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.828468+0000", 2023-10-08T07:08:02.366 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.3390000000000004e-06 2023-10-08T07:08:02.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.366 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.366 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.367 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992521+0000", 2023-10-08T07:08:02.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16405252400000001 2023-10-08T07:08:02.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.367 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.367 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992607+0000", 2023-10-08T07:08:02.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6086000000000002e-05 2023-10-08T07:08:02.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.367 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.367 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.367 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.992756+0000", 2023-10-08T07:08:02.367 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00014936100000000001 2023-10-08T07:08:02.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002055+0000", 2023-10-08T07:08:02.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0092994410000000003 2023-10-08T07:08:02.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.368 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.368 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070359+0000", 2023-10-08T07:08:02.368 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.068303681000000005 2023-10-08T07:08:02.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.368 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.369 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.369 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070401+0000", 2023-10-08T07:08:02.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.2138999999999998e-05 2023-10-08T07:08:02.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.369 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.369 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.369 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070422+0000", 2023-10-08T07:08:02.369 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1149999999999999e-05 2023-10-08T07:08:02.369 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.369 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.369 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.370 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.370 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175882 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 258048~4096,write 282624~4096,write 446464~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.370 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:08:02.370 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.414868504999999, 2023-10-08T07:08:02.370 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.244805773, 2023-10-08T07:08:02.370 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.370 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.370 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.370 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.370 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.370 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175882 2023-10-08T07:08:02.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.371 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:08:02.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.371 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.371 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.371 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833772+0000", 2023-10-08T07:08:02.371 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.372 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833773+0000", 2023-10-08T07:08:02.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1800000000000005e-07 2023-10-08T07:08:02.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.372 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.372 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833799+0000", 2023-10-08T07:08:02.372 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.6840000000000001e-05 2023-10-08T07:08:02.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.372 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833811+0000", 2023-10-08T07:08:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.1982e-05 2023-10-08T07:08:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.833819+0000", 2023-10-08T07:08:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 7.7729999999999999e-06 2023-10-08T07:08:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998071+0000", 2023-10-08T07:08:02.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16425203699999999 2023-10-08T07:08:02.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998122+0000", 2023-10-08T07:08:02.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.0627999999999997e-05 2023-10-08T07:08:02.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.374 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.374 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.374 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.998301+0000", 2023-10-08T07:08:02.374 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00017893 2023-10-08T07:08:02.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.016267+0000", 2023-10-08T07:08:02.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.017966780000000002 2023-10-08T07:08:02.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.375 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.375 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078470+0000", 2023-10-08T07:08:02.375 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062202475 2023-10-08T07:08:02.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.375 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078532+0000", 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.1601999999999997e-05 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078577+0000", 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.5908000000000002e-05 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.376 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.377 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175885 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 2940928~4096,write 3362816~4096,write 3371008~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.377 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:08:02.377 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.414169997, 2023-10-08T07:08:02.377 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.244295492, 2023-10-08T07:08:02.377 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.377 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.377 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.377 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.377 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.378 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175885 2023-10-08T07:08:02.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.378 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.378 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.378 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:08:02.378 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.378 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834470+0000", 2023-10-08T07:08:02.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.379 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.379 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834471+0000", 2023-10-08T07:08:02.379 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.3399999999999998e-07 2023-10-08T07:08:02.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.379 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.380 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834487+0000", 2023-10-08T07:08:02.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.6209999999999999e-05 2023-10-08T07:08:02.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.380 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834500+0000", 2023-10-08T07:08:02.380 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2262999999999999e-05 2023-10-08T07:08:02.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.380 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.834508+0000", 2023-10-08T07:08:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.8459999999999997e-06 2023-10-08T07:08:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002339+0000", 2023-10-08T07:08:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.16783030400000001 2023-10-08T07:08:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002426+0000", 2023-10-08T07:08:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.6879999999999995e-05 2023-10-08T07:08:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.002592+0000", 2023-10-08T07:08:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000166071 2023-10-08T07:08:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.016276+0000", 2023-10-08T07:08:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.013684392 2023-10-08T07:08:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078657+0000", 2023-10-08T07:08:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.062380933 2023-10-08T07:08:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078721+0000", 2023-10-08T07:08:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.3968999999999997e-05 2023-10-08T07:08:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.078766+0000", 2023-10-08T07:08:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.4790000000000003e-05 2023-10-08T07:08:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:175982 4.3a 4:5fb70c0f:::10000000004.0000002e:head [write 1507328~4096,write 1556480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:08:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.383829782999999, 2023-10-08T07:08:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.24593904699999999, 2023-10-08T07:08:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 175982 2023-10-08T07:08:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:08:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864810+0000", 2023-10-08T07:08:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864811+0000", 2023-10-08T07:08:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.3099999999999996e-07 2023-10-08T07:08:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864827+0000", 2023-10-08T07:08:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.5141e-05 2023-10-08T07:08:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864839+0000", 2023-10-08T07:08:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 1.2343e-05 2023-10-08T07:08:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.864847+0000", 2023-10-08T07:08:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.1759999999999993e-06 2023-10-08T07:08:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.041996+0000", 2023-10-08T07:08:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17714919000000001 2023-10-08T07:08:02.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.042044+0000", 2023-10-08T07:08:02.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.8056000000000002e-05 2023-10-08T07:08:02.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.389 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.389 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.042173+0000", 2023-10-08T07:08:02.389 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.000128283 2023-10-08T07:08:02.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.058432+0000", 2023-10-08T07:08:02.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.016259431000000001 2023-10-08T07:08:02.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.390 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110696+0000", 2023-10-08T07:08:02.390 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.052264104999999998 2023-10-08T07:08:02.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.390 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.390 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110728+0000", 2023-10-08T07:08:02.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 3.1578999999999997e-05 2023-10-08T07:08:02.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.391 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.391 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.110749+0000", 2023-10-08T07:08:02.391 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 2.1812000000000001e-05 2023-10-08T07:08:02.391 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.391 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.391 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.391 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.392 INFO:teuthology.orchestra.run.smithi033.stdout: "description": "osd_op(client.4556.0:176059 4.3a 4:5d52ad5e:::10000000004.00000026:head [write 1564672~4096,write 1585152~4096,write 1708032~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2023-10-08T07:08:02.392 INFO:teuthology.orchestra.run.smithi033.stdout: "initiated_at": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:08:02.392 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 14.361001062, 2023-10-08T07:08:02.392 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.23799429, 2023-10-08T07:08:02.392 INFO:teuthology.orchestra.run.smithi033.stdout: "type_data": { 2023-10-08T07:08:02.392 INFO:teuthology.orchestra.run.smithi033.stdout: "flag_point": "commit sent; apply or cleanup", 2023-10-08T07:08:02.392 INFO:teuthology.orchestra.run.smithi033.stdout: "client_info": { 2023-10-08T07:08:02.392 INFO:teuthology.orchestra.run.smithi033.stdout: "client": "client.4556", 2023-10-08T07:08:02.392 INFO:teuthology.orchestra.run.smithi033.stdout: "client_addr": "192.168.0.1:0/2314322374", 2023-10-08T07:08:02.392 INFO:teuthology.orchestra.run.smithi033.stdout: "tid": 176059 2023-10-08T07:08:02.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.392 INFO:teuthology.orchestra.run.smithi033.stdout: "events": [ 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "initiated", 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "header_read", 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887639+0000", 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "throttled", 2023-10-08T07:08:02.393 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887640+0000", 2023-10-08T07:08:02.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 6.0699999999999997e-07 2023-10-08T07:08:02.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.394 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "all_read", 2023-10-08T07:08:02.394 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887649+0000", 2023-10-08T07:08:02.394 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 9.2439999999999999e-06 2023-10-08T07:08:02.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.394 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "dispatched", 2023-10-08T07:08:02.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887657+0000", 2023-10-08T07:08:02.395 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.0059999999999992e-06 2023-10-08T07:08:02.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.395 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "queued_for_pg", 2023-10-08T07:08:02.395 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:47.887663+0000", 2023-10-08T07:08:02.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7869999999999998e-06 2023-10-08T07:08:02.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "reached_pg", 2023-10-08T07:08:02.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.060892+0000", 2023-10-08T07:08:02.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.17322955700000001 2023-10-08T07:08:02.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.396 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.396 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "started", 2023-10-08T07:08:02.396 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.060978+0000", 2023-10-08T07:08:02.396 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 8.5358999999999994e-05 2023-10-08T07:08:02.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "waiting for subops from 2", 2023-10-08T07:08:02.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.061180+0000", 2023-10-08T07:08:02.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.00020268400000000001 2023-10-08T07:08:02.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "op_commit", 2023-10-08T07:08:02.397 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.070342+0000", 2023-10-08T07:08:02.397 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.0091617230000000001 2023-10-08T07:08:02.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.397 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "sub_op_commit_rec", 2023-10-08T07:08:02.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125534+0000", 2023-10-08T07:08:02.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 0.055191764999999997 2023-10-08T07:08:02.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "commit_sent", 2023-10-08T07:08:02.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125591+0000", 2023-10-08T07:08:02.398 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 5.7606999999999999e-05 2023-10-08T07:08:02.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-08T07:08:02.398 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-08T07:08:02.398 INFO:teuthology.orchestra.run.smithi033.stdout: "event": "done", 2023-10-08T07:08:02.398 INFO:teuthology.orchestra.run.smithi033.stdout: "time": "2023-10-08T07:07:48.125633+0000", 2023-10-08T07:08:02.399 INFO:teuthology.orchestra.run.smithi033.stdout: "duration": 4.1950999999999999e-05 2023-10-08T07:08:02.399 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.399 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.399 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.399 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-08T07:08:02.399 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-08T07:08:02.399 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:08:02.400 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:08:02.401 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:08:02.399+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:08:02.501 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:08:02.500+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:08:02.534 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:08:02.534 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:08:02.534 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2023-10-08T07:08:02.534 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:08:02.545 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:08:02.630 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:08:02.629+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:08:02.633 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-10-08T07:08:02.703 INFO:tasks.ceph.osd.2.smithi144.stderr:2023-10-08T07:08:02.702+0000 7efe6e0b7700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 97752) UID: 0 2023-10-08T07:08:02.712 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T07:08:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2023-10-08T07:08:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2023-10-08T07:08:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2023-10-08T07:08:02.712 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T07:08:02.722 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:08:02.798 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2023-10-08T07:08:02.804 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:02.803+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:02.818 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2023-10-08T07:08:02.819 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-10-08T07:08:02.819 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENXIO: problem getting command descriptions from osd.1 2023-10-08T07:08:02.819 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-10-08T07:08:02.821 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T07:08:02.822 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-10-08T07:08:02.889 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:08:02.889 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:08:02.899 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-08T07:08:02.943 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:02.942+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:03.006 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:03.005+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:03.024 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-10-08T07:08:03.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:08:03.024 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T07:08:03.042 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:08:03.043 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:08:03.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:08:03.050 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-08T07:08:03.053 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-10-08T07:08:03.108 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T07:08:03.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:08:03.109 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T07:08:03.137 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:03.136+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:03.151 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T07:08:03.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T07:08:03.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-10-08T07:08:03.208 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-08T07:08:03.207+0000 7f11e1363700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 97714) UID: 0 2023-10-08T07:08:03.225 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:08:03.225 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:08:03.235 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-10-08T07:08:03.299 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2023-10-08T07:08:03.307 INFO:tasks.thrashosds:joining thrashosds 2023-10-08T07:08:03.408 INFO:teuthology.orchestra.run.smithi033.stdout:ERROR: (22) Invalid argument 2023-10-08T07:08:03.408 INFO:teuthology.orchestra.run.smithi033.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:08:03.418 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-10-08T07:08:03.549 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:08:03.549 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:08:03.558 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-10-08T07:08:03.686 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:08:03.686 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:08:03.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-10-08T07:08:03.822 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2023-10-08T07:08:03.822 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-10-08T07:08:04.089 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2023-10-08T07:08:06.105 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-10-08T07:08:07.097 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2023-10-08T07:08:07.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-10-08T07:08:07.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~89s 2023-10-08T07:08:08.099 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2023-10-08T07:08:13.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~95s 2023-10-08T07:08:19.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~101s 2023-10-08T07:08:25.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~107s 2023-10-08T07:08:30.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~113s 2023-10-08T07:08:36.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~118s 2023-10-08T07:08:42.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~124s 2023-10-08T07:08:48.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~130s 2023-10-08T07:08:54.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~136s 2023-10-08T07:09:00.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~142s 2023-10-08T07:09:05.809 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~147s 2023-10-08T07:09:08.525 DEBUG:teuthology.orchestra.console.smithi086:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Age t GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D8 09 GUID: 00000000 0000 0000 0000 0CC47AD8DAF6 DHCP.|                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| CLIENT IP: 172.21.15.86 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d8:09)... Configuring (net0 0c:c4:7a:8f:d8:09).... Configuring (net0 0c:c4:7a:8f:d8:09)..... Configuring (net0 0c:c4:7a:8f:d8:09)...... ok    [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-5a84457b7b52416e95d47d02e2e4a60f) 8.6>               The selected entry will be started automatically in 5s.  Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)   Red Hat Enterprise Linux (0-rescue-5a84457b7b52416e95d47d02e2e4a60f) 8.6*           The selected entry will be started automatically in 4s.    Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h     [ 0.000000] Lion 4.18.0-372.9ckbuild@x86-vm-09.build.eng.bos.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-10) (GCC)) #1 SMP Fri Apr 15 22:12:19 EDT 2022 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-372.9.1.el8.x86_64 root=UUID=78886b72-f581-4b1d-8578-0d8161fd4ca1 ro crashkernel=auto console=ttyS1,115200 console=tty0 console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec1fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f74000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.969 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78ec2 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x3484f000-0x3641ffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 192MB of memory at 1728MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078ec1fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29108 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78ec2000-0x78f73fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f74000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 55 pages/cpu s188416 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228742 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-372.9.1.el8.x86_64 root=UUID=78886b72-f581-4b1d-8578-0d8161fd4ca1 ro crashkernel=auto console=ttyS1,115200 console=tty0 console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] Memory: 1820612K/33438000K available (12293K kernel code, 5865K rwdata, 8292K rodata, 2520K init, 14348K bss, 869504K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 39999 entries in 157 pages [ 0.000000] ftrace: allocated 157 pages with 5 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [tty0] enabled [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20210604 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005001] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013095] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014454] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327333a6725, max_idle_ns: 440795319410 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.93 BogoMIPS (lpj=3499969) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022020] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024003] SELinux: Initializing. [ 0.026004] LSM support for eBPF active [ 0.032116] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.035478] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.036075] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.037071] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.038226] CPU0: Thermal monitoring enabled (TM1) [ 0.039041] process: using mwait in idle threads [ 0.040001] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.041000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.042000] FEATURE SPEC_CTRL Not Present [ 0.043000] FEATURE IBPB_SUPPORT Not Present [ 0.044000] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.045001] Spectre V2 : Mitigation: Retpolines [ 0.046000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.047000] Speculative Store Bypass: Vulnerable [ 0.048003] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.049000] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.050229] Freeing SMP alternatives memory: 36K [ 0.052606] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.155675] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.156099] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.157001] ... version: 3 [ 0.158000] ... bit width: 48 [ 0.159000] ... generic registers: 4 [ 0.160000] ... value mask: 0000ffffffffffff [ 0.161000] ... max period: 00007fffffffffff [ 0.162000] ... fixed-purpose events: 3 [ 0.163000] ... event mask: 000000070000000f [ 0.164027] rcu: Hierarchical SRCU implementation. [ 0.165835] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.166016] smp: Bringing up secondary CPUs ... [ 0.167067] x86: Booting SMP configuration: [ 0.168002] .... node #0, CPUs: #1 #2 #3 #4 [ 0.171254] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.173000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.174089] #5 #6 #7 [ 0.176553] smp: Brought up 1 node, 8 CPUs [ 0.178001] smpboot: Max logical packages: 1 [ 0.179000] smpboot: Total of 8 processors activated (55999.50 BogoMIPS) [ 0.215108] node 0 deferred pages initialised in 34ms [ 0.221591] devtmpfs: initialized [ 0.222039] x86/mm: Memory block size: 128MB [ 0.224946] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.225091] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.226007] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.227061] pinctrl core: initialized pinctrl subsystem [ 0.228119] NET: Registered protocol family 16 [ 0.229078] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.230009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.231009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.240019] audit: initializing netlink subsys (disabled) [ 0.245008] audit: type=2000 audit(1696748918.245:1): state=initialized audit_enabled=0 res=1 [ 0.254002] cpuidle: using governor menu [ 0.258023] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.265001] ACPI: bus type PCI registered [ 0.270001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.276044] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.286002] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.292010] PCI: Using configuration type 1 for base access [ 0.299466] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.306002] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.313023] cryptd: max_cpu_qlen set to 1000 [ 0.317058] ACPI: Added _OSI(Module Device) [ 0.322002] ACPI: Added _OSI(Processor Device) [ 0.326003] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.331000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.336000] ACPI: Added _OSI(Linux-Dell-Video) [ 0.341000] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.346000] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 0.378969] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.387980] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.397052] ACPI: Dynamic OEM Table Load: [ 0.415774] ACPI: Interpreter enabled [ 0.419011] ACPI: PM: (supports S0 S4 S5) [ 0.423000] ACPI: Using IOAPIC for interrupt routing [ 0.428016] HEST: Enabling Firmware First mode for corrected errors. [ 0.435070] HEST: Table parsing has been initialized. [ 0.440002] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.450091] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.477505] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.483003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.494420] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.503022] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.511000] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.519028] PCI host bridge to bus 0000:ff [ 0.523001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.528009] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.534041] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.541031] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.547030] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.553031] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.559029] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.565029] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.571031] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.577031] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.583029] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.590031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.596029] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.602022] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.608030] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.614029] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.620031] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.626029] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.632029] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.638030] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.645021] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.651036] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.657058] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.663042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.669043] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.675041] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.681042] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.687040] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.694034] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.700031] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.706044] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.712041] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.718041] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.724040] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.730031] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.736032] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.743036] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.749033] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.755042] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.761044] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.767042] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.773044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.779036] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.785031] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.792032] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.798034] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.804031] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.810032] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.816033] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.822034] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.828030] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.834030] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.841031] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.847022] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.853032] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.859030] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.867710] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.874002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.883144] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.891270] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.899000] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.908186] PCI host bridge to bus 0000:00 [ 0.912001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.927000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.933000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.941000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.949000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.956000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.964000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.969011] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 0.975126] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 0.982042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 0.988106] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 0.994042] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.000104] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.007041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.013089] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.019008] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.026107] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.032007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.039106] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.045007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.052109] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.058008] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.065106] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.071007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.078107] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.084007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.091106] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.097007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.104108] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.110007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.117105] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.124091] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.130069] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.136090] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.142005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.148105] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.155147] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.161011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.167007] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.172006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.178006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.184006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.189006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.196035] pci 0000:00:11.4: PME# supported from D3hot [ 1.201093] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.207014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.214050] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.220088] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.226013] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.233052] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.239084] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.245013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.252051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.258098] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.265013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.271072] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.277094] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.283066] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.290061] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.296067] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.302103] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.308066] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.315107] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.321010] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.327072] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.333094] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.340173] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.346009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.351005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.357005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.363005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.368005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.374005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.380029] pci 0000:00:1f.2: PME# supported from D3hot [ 1.386084] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.392013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.399016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.405193] acpiphp: Slot [1] registered [ 1.409014] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.414116] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.420008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.427016] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.434003] pci 0000:02:00.0: enabling Extended Tags [ 1.439056] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.444002] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.451071] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.457009] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.464004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.470009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.477004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.484037] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.490017] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.498000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.508008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.515000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.526142] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.532010] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.539004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.545009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.552004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.559038] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.565015] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.573000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.583008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.591000] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.601132] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.606001] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.612001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.619002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.627029] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.632059] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.638065] pci 0000:05:00.0: enabling Extended Tags [ 1.643070] pci 0000:05:00.0: supports D1 D2 [ 1.648000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.654087] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.660002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.666002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.673047] pci_bus 0000:06: extended config space not accessible [ 1.679027] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.685022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.692012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.698012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.704095] pci 0000:06:00.0: supports D1 D2 [ 1.708000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.715091] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.720006] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.726003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.733080] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.739017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.745018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.751009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.758121] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.764038] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.771000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.782021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.789001] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.799160] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.805017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.812017] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.818009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.824115] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.830034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.838000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.848021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.855000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.866145] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.871002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.877002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.884003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.891441] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.897035] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.903033] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.909033] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.916033] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.922000] ACPI: PCI: Interrupt link LNKE disabled [ 1.927032] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.940000] ACPI: PCI: Interrupt link LNKF disabled [ 1.945033] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.951000] ACPI: PCI: Interrupt link LNKG disabled [ 1.956033] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.962000] ACPI: PCI: Interrupt link LNKH disabled [ 1.967134] iommu: Default domain type: Passthrough [ 1.972022] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.973000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.987001] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.993000] vgaarb: loaded [ 1.996065] SCSI subsystem initialized [ 2.000015] ACPI: bus type USB registered [ 2.004010] usbcore: registered new interface driver usbfs [ 2.009004] usbcore: registered new interface driver hub [ 2.015016] usbcore: registered new device driver usb [ 2.020016] pps_core: LinuxPPS API ver. 1 registered [ 2.025002] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.034003] PTP clock support registered [ 2.038021] EDAC MC: Ver: 3.0.0 [ 2.042115] PCI: Using ACPI for IRQ routing [ 2.051354] NetLabel: Initializing [ 2.055000] NetLabel: domain hash size = 128 [ 2.059000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.065011] NetLabel: unlabeled traffic allowed by default [ 2.071045] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.077001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.085023] clocksource: Switched to clocksource tsc-early [ 2.099761] VFS: Disk quotas dquot_6.6.0 [ 2.103775] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.110787] pnp: PnP ACPI init [ 2.114272] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.120272] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.126277] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.132272] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.138271] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.144268] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.150265] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.156958] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.163660] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.170357] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.177056] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.183747] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.190440] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.197300] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.203301] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.209305] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.215303] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.221300] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.228028] pnp: PnP ACPI: found 5 devices [ 2.237565] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.246568] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.258154] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.266086] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.271137] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.276186] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.283058] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.290726] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.298745] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.306498] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.314603] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.322273] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.330291] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.338047] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.346153] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.353820] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.361839] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.369596] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.377700] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.385367] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.393388] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.401143] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.409247] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.414292] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.420468] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.427341] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.435190] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.440240] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.445287] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.451463] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.458341] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.463645] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.469818] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.476695] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.484539] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.492470] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.500313] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.508244] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.513287] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.519462] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.526335] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.534184] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.543327] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.549587] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.555844] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.562796] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.569747] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.576698] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.583656] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.589999] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.595649] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.601996] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.609322] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.614976] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.621324] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.626981] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.633326] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.638975] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.645322] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.652734] NET: Registered protocol family 2 [ 2.657371] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.666738] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.675716] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.684237] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.691934] TCP: Hash tables configured (established 262144 bind 65536) [ 2.698737] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.706593] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.713703] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.721278] NET: Registered protocol family 1 [ 2.725716] NET: Registered protocol family 44 [ 2.730325] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.754130] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x61f took 16036 usecs [ 2.778126] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x61f took 16094 usecs [ 2.785636] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.792169] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.800657] Unpacking initramfs... [ 3.083937] Freeing initrd memory: 28484K [ 3.088106] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.094625] software IO TLB: mapped [mem 0x0000000068000000-0x000000006c000000] (64MB) [ 3.102654] ACPI: bus type thunderbolt registered [ 3.120592] Initialise system trusted keyrings [ 3.125127] Key type blacklist registered [ 3.129241] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.137178] zbud: loaded [ 3.140063] pstore: using deflate compression [ 3.144695] Platform Keyring initialized [ 3.218814] NET: Registered protocol family 38 [ 3.223348] Key type asymmetric registered [ 3.227527] Asymmetric key parser 'x509' registered [ 3.232491] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.247644] io scheduler mq-deadline registered [ 3.252258] io scheduler kyber registered [ 3.256372] io scheduler bfq registered [ 3.260352] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.267639] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.273621] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.279596] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.285548] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.291499] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.297446] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.303398] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.310780] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.319254] ACPI: Power Button [PWRB] [ 3.323017] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.330536] ACPI: Power Button [PWRF] [ 3.335362] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.342982] pstore: Registered erst as persistent store backend [ 3.349133] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 3.356728] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.383660] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.411726] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.419514] Non-volatile memory driver v1.3 [ 3.424176] rdac: device handler registered [ 3.428515] hp_sw: device handler registered [ 3.432865] emc: device handler registered [ 3.437071] alua: device handler registered [ 3.441405] libphy: Fixed MDIO Bus: probed [ 3.445647] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.452261] ehci-pci: EHCI PCI platform driver [ 3.456886] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.462249] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.469752] ehci-pci 0000:00:1a.0: debug port 2 [ 3.478283] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.491043] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.496904] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.505268] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.512591] usb usb1: Product: EHCI Host Controller [ 3.517551] usb usb1: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 ehci_hcd [ 3.524681] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.529481] hub 1-0:1.0: USB hub found [ 3.533318] hub 1-0:1.0: 2 ports detected [ 3.537576] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.542938] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.550440] ehci-pci 0000:00:1d.0: debug port 2 [ 3.558950] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.571035] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.576887] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.585256] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.592577] usb usb2: Product: EHCI Host Controller [ 3.597539] usb usb2: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 ehci_hcd [ 3.604668] usb usb2: SerialNumber: 0000:00:1d.0 [ 3.609460] hub 2-0:1.0: USB hub found [ 3.613297] hub 2-0:1.0: 2 ports detected [ 3.617484] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 3.623746] ohci-pci: OHCI PCI platform driver [ 3.628285] uhci_hcd: USB Universal Host Controller Interface driver [ 3.634829] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.640207] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.648751] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.658117] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.666486] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.673805] usb usb3: Product: xHCI Host Controller [ 3.678764] usb usb3: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 xhci-hcd [ 3.685895] usb usb3: SerialNumber: 0000:00:14.0 [ 3.690703] hub 3-0:1.0: USB hub found [ 3.694552] hub 3-0:1.0: 15 ports detected [ 3.700335] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.705701] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 3.713199] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.719567] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.727933] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.735252] usb usb4: Product: xHCI Host Controller [ 3.740215] usb usb4: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 xhci-hcd [ 3.747343] usb usb4: SerialNumber: 0000:00:14.0 [ 3.752221] hub 4-0:1.0: USB hub found [ 3.756066] hub 4-0:1.0: 6 ports detected [ 3.760972] usbcore: registered new interface driver usbserial_generic [ 3.767586] usbserial: USB Serial support registered for generic [ 3.773697] i8042: PNP: No PS/2 controller found. [ 3.778531] mousedev: PS/2 mouse device common for all mice [ 3.784245] rtc_cmos 00:00: RTC can wake from S4 [ 3.789112] rtc_cmos 00:00: registered as rtc0 [ 3.793647] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.801411] intel_pstate: Intel P-state driver initializing [ 3.807066] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.814774] hid: raw HID events driver (C) Jiri Kosina [ 3.820023] usbcore: registered new interface driver usbhid [ 3.825679] usbhid: USB HID core driver [ 3.829695] drop_monitor: Initializing network drop monitor service [ 3.836089] Initializing XFRM netlink socket [ 3.840510] NET: Registered protocol family 10 [ 3.845226] Segment Routing with IPv6 [ 3.848981] NET: Registered protocol family 17 [ 3.853621] mpls_gso: MPLS GSO support [ 3.857832] microcode: sig=0x406f1, pf=0x1, revision=0xb000010 [ 3.863861] microcode: Microcode Update Driver: v2.2. [ 3.863934] resctrl: L3 allocation detected [ 3.865005] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 3.869068] resctrl: L3DATA allocation detected [ 3.884544] resctrl: L3CODE allocation detected [ 3.889154] resctrl: L3 monitoring detected [ 3.893428] AVX2 version of gcm_enc/dec engaged. [ 3.898125] AES CTR mode by8 optimization enabled [ 3.927998] sched_clock: Marking stable (3927994292, 0)->(5549137246, -1621142954) [ 3.935988] registered taskstats version 1 [ 3.940254] Loading compiled-in X.509 certificates [ 3.947311] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 3.955597] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.962973] hub 1-1:1.0: USB hub found [ 3.966958] hub 1-1:1.0: 6 ports detected [ 3.970582] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: fcec8079a12caa6a157125702c0054357b4fc157' [ 3.981777] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 3.982129] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 4.000449] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 4.011183] zswap: loaded using pool lzo/zbud [ 4.015439] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.023901] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.031141] page_owner is disabled [ 4.031334] hub 2-1:1.0: USB hub found [ 4.038564] hub 2-1:1.0: 8 ports detected [ 4.039440] Key type big_key registered [ 4.049038] Key type encrypted registered [ 4.053153] ima: No TPM chip found, activating TPM-bypass! [ 4.058722] ima: Allocated hash algorithm: sha256 [ 4.063514] ima: No architecture policies found [ 4.068139] evm: Initialising EVM extended attributes: [ 4.073368] evm: security.selinux [ 4.076764] evm: security.ima [ 4.079814] evm: security.capability [ 4.083474] evm: HMAC attrs: 0x1 [ 4.087038] rtc_cmos 00:00: setting system clock to 2023-10-08 07:08:43 UTC (1696748923) [ 4.096109] Freeing unused decrypted memory: 2036K [ 4.101349] Freeing unused kernel image (initmem) memory: 2520K [ 4.113081] Write protecting the kernel read-only data: 24576k [ 4.119218] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.119396] Freeing unused kernel image (text/rodata gap) memory: 2012K [ 4.127028] tsc: Refined TSC clocksource calibration: 3499.993 MHz [ 4.127032] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734a05315, max_idle_ns: 440795202126 ns [ 4.127585] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.157961] clocksource: Switched to clocksource tsc [ 4.158248] hub 3-12:1.0: USB hub found [ 4.166996] hub 3-12:1.0: 4 ports detected [ 4.167195] Freeing unused kernel image (rodata/data gap) memory: 1948K [ 4.187149] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.221150] systemd[1]: Detected architecture x86-64. [ 4.226293] systemd[1]: Running in initial RAM disk. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa) dracut-049-201.git20220131.el8 (Initramfs)! [ 4.249118] systemd[1]: Set hostname to . [ 4.293626] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.305844] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 4.317059] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 4.331538] systemd[1]: Started Memstrack Anylazing Service. [ OK ] Started Memstrack Anylazing Service. [ 4.344566] systemd[1]: Starting Create list of required static device nodes for the current kernel... Starting Create list of required st…ce nodes for the current kernel... [ 4.364063] sached target Local File Systems. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Reached target Timers. [ OK ] Reached target Swap. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Sockets. Starting Journal Service... Starting Apply Kernel Variables... [ OK ] Started Setup Virtual Console. [ OK ] Started Crea[ 4.467016] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd te list of the current ker;32m OK ] Directories. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Journal Service. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ 4.579297] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.587861] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ OK ] Started udev Kernel Device Manager. [ 4.600687] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ 4.664168] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.676804] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.688645] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ OK ] Started udev Coldplug all Devices. Starting Show Plymouth Boot Screen... [ OK ] Reached target System Initialization. [ 4.735875] dca service started, version 1.12.1 Starting dracut initqueue hook... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Reached target Paths. [ OK ] Started Forward Password Requests to Plymouth Directory Watch.[ 4.759935] igb: Intel(R) Gigabit Ethernet Network Driver [ OK [ 4.766515] igb: Copyright (c) 2007-2014 Intel Corporation. ] Reached target Basic System. [ 4.777457] nvme nvme0: pci function 0000:02:00.0 [ 4.783741] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 4.789932] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 4.802233] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.802525] nvme nvme0: 8/0/0 default/read/poll queues [ 4.810440] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.824072] nvme0n1: detected capacity change from 0 to 400088457216 [ 4.830162] igb 0000:07:00.0: added PHC on eth0 [ 4.835126] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.835128] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:f6 [ 4.835226] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.835228] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.835599] scsi host0: ahci [ 4.835734] scsi host1: ahci [ 4.836151] scsi host2: ahci [ 4.836314] scsi host3: ahci [ 4.836406] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 52 [ 4.836418] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 52 [ 4.836423] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 52 [ 4.836429] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 52 [ 4.836883] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.836886] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.853418] scsi host4: ahci [ 4.889490] igb 0000:07:00.1: added PHC on eth1 [ 4.892535] scsi host5: ahci [ 4.899911] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.907572] scsi host6: ahci [ 4.915716] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:f7 [ 4.923543] scsi host7: ahci [ 4.926474] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.931140] scsi host8: ahci [ 4.931225] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.931230] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.931247] ast 0000:06:00.0: [drm] Analog VGA only [ 4.931256] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.932160] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.934045] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.941121] scsi host9: ahci [ 4.960440] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.962459] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 [ 5.016248] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 [ 5.016250] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 [ 5.016252] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 [ 5.016253] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 [ 5.016254] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 [ 5.053864] fbcon: astdrmfb (fb0) is primary device [ 5.056241] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.141652] ata4: SATA link down (SStatus 0 SControl 300) [ 5.142840] ata1: SATA link down (SStatus 0 SControl 300) [ 5.149154] ata2: SATA link down (SStatus 0 SControl 300) [ 5.150853] ata3: SATA link down (SStatus 0 SControl 300) [ 5.165751] Console: switching to colour frame buffer device 128x48 [ 5.222646] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.324532] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.330834] ata8: SATA link down (SStatus 0 SControl 300) [ 5.336339] ata7: SATA link down (SStatus 0 SControl 300) [ 5.341855] ata6: SATA link down (SStatus 0 SControl 300) [ 5.347350] ata10: SATA link down (SStatus 0 SControl 300) [ 5.352957] ata9: SATA link down (SStatus 0 SControl 300) [ 5.359141] ata5.00: NCQ Send/Recv Log not supported [ 5.364117] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.370392] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.378873] ata5.00: NCQ Send/Recv Log not supported [ 5.383854] ata5.00: configured for UDMA/133 [ 5.388228] scsi 4:0:0:0: Direct-Ac33-9ZM SN06 PQ: 0 ANSI: 5 [ 5.400861] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.410095] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.418245] sd 4:0:0:0: [sda] Write Protect is off [ 5.423338] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.451069] sda: sda1 [ 5.459059] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.948310] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.959038] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.967999] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.974638] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d8:08 [ 5.989857] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.997175] libphy: ixgbe-mdio: probed [ 6.184252] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.194991] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.203956] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.211452] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d8:09 [ 6.230324] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.237603] libphy: ixgbe-mdio: probed [ 6.243308] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.280327] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…b72-f581-4b1d-8578-0d8161fd4ca1... [ OK ] Started File System Check on /dev/d…86b72-f581-4b1d-8578-0d8161fd4ca1. Mounting /sysroot... [ 6.489182] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped dracut pre-pivot and cleanup hook. Starting Plymouth switch root service... [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Timers. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. Stopping udev Kernel Device Manager... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Sockets. [ OK ] Stopped dracut initqueue hook. Starting Setup Virtual Console... [ OK ] Stopped target Local File Systems. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel S[ 6.868720] printk: systemd: 18 output lines suppressed due to ratelimiting ocket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 7.473519] SELinux: policy capability network_peer_controls=1 [ 7.479774] SELinux: policy capability open_perms=1 [ 7.485039] SELinux: policy capability extended_socket_class=1 [ 7.491256] SELinux: policy capability always_check_network=0 [ 7.497373] SELinux: policy capability cgroup_seclabel=1 [ 7.503055] SELinux: policy capability nnp_nosuid_transition=1 [ 7.533973] audit: type=1403 audit(1696748926.945:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.535509] systemd[1]: Successfully loaded SELinux policy in 216.800ms. [ 7.618430] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.512ms. [ 7.650308] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.686506] systemd[1]: Detected architecture x86-64. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa)! [ 7.712081] systemd[1]: Set hostname to . [ 8.661752] systemd[1]: systemd-journald.service: Succeeded. [ 8.683342] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.699200] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 8.711782] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 8.729508] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 8.745508] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 8.771287] systemd[1]: Starting Journal Service... Starting Journal Service... [ OK ] Listening on initctl Compatibility Named Pipe. Mounting POSIX Message Queue File System... [ OK ] Listening on Process Core Dump Socket. Starting Load Kernel Modules... [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Listening on udev Kernel Socket. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Reached target ceph target allowing…[ 8.889955] EXT4-fs (sda1): re-mounted. Opts: (null) mirror@.service instances at once. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. Starting Remount Root and Kernel File Systems... [ OK ] Created slice system-getty.slice. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Reached target Swap. Mounting Kernel Debug File System... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped Plymouth switch root service. [ OK ] Created slice system-sshd\x2dkeygen.slice. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... Mounting Huge Pages File System... [ OK ] Created slice system-serial\x2dgetty.slice. Starting Setup Virtual Console... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [[ 9.040044] device-mapper: uevent: version 1.0.3  OK [0[ 9.046657] device-mapper: ioctl: 4.43.0-ioctl (2020-10-01) initialised: dm-devel@redhat.com m] Started Journal Service. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Huge[ 9.084067] fuse: init (API version 7.33) Pages File System. Starting Load/Save Random Seed... Starting Flush Journal to Persistent Storage... [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load/Save Random Seed. [ OK ] Started Load Kernel Modules. Starting Apply Kernel Variables... Mounting FUSE Control File System... [ OK ] Mounted FUSE Control File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Restore /run/initramfs on shutdown... Starting Tell Plymouth To Write Out Runtime Data... Starting udev Kernel Device Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ OK ] Started udev Kernel Device Manager. [ OK ] Started Create Volatile Files and Directories. Starting Security Auditing Service... Mounting RPC Pipe File System... Starting RPC Bind... [ 9.622106] RPC: Registered named UNIX socket transport module. [ 9.628758] RPC: Registered udp transport module. [ 9.634210] RPC: Registered tcp transport module. [ 9.639650] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 9.743353] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 9.773536] igb 0000:07:00.0: DCA enabled [ 9.778558] igb 0000:07:00.1: DCA enabled [ 9.813632] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 9.855187] power_meter ACPI000D:00: Found ACPI power meter. [ 9.862381] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Updates mlocate database every day. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Reached target Timers. [ OK ] Listening on CUPS Scheduler. [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket. [ OK ] Reached tar[ 9.984118] IPMI message handler: version 39.2 get Sockets. [ OK ] Started CUPS Scheduler. [ OK ][ 9.995345] ipmi device interface Reached target Paths. [ OK ] Reached target Basic System. [ OK ] [ 10.007049] ipmi_si: IPMI System Interface driver Started libstoragemgmt plug-in s[ 10.014935] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS erver daemon. [ 10.023260] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 Startin[ 10.031350] ipmi_si: Adding SMBIOS-specified kcs state machine g Authorization [ 10.039102] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI Manager... [[[ 10.046286] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 0;32m OK ] Started Machine Check Exception Logging Daemon. Starting VDO volume services... Starting NTP client/server... Starting System Security Services Daemon... Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ 10.125296] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.134781] ipmi_si: Adding ACPI-specified kcs state machine [ OK ] Started irqb[ 10.143173] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 alance daemon. [ OK [ 10.156095] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [0m] Started D-B[ 10.157865] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. us System Message Bus. Starting Network Manager... Starting Resets System Activity Logs... Starting Load CPU microcode update... [ OK ] Reached target sshd-keygen.target. [ 10.196071] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) Starting Kernel Samepage Merging... Starting Avahi mDNS/DNS-SD Stack... [ OK ] Started Kernel Samepage Merging. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM[ 10.256232] ipmi_si IPI0001:00: IPMI kcs interface initialized event activation on device 259:0... [ 10.309590] ipmi_ssif: IPMI SSIF Interface driver [ 10.345557] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.354380] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.360551] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.378368] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.463481] iTCO_vendor_support: vendor-support=0 [ 10.475692] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 10.482739] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 10.491237] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ 11.408272] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.419769] EDAC sbridge: Ver: 1.1.2 [ 11.573518] intel_rapl_common: Found RAPL domain package [ 11.596030] intel_rapl_common: Found RAPL domain dram [ 11.601621] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Load CPU microcode update. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started LVM event activation on device 259:0. [ OK ] Started NTP client/server. [ OK ] Started Avahi mDNS/DNS-SD Stack. [ 11.939671] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 11.949812] XFS (dm-4): Mounting V5 Filesystem [ 11.960853] XFS (dm-4): Ending clean mount [ OK ] Mounted /var/lib/ceph. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Enable periodic update of entitlement certificates.... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... [ OK ] Started Enable periodic update of entitlement certificates.. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started Authorization Manager. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Network Manager Script Dispatcher Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started Network Manager Script Dispatcher Service. [ 13.051717] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 13.110577] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 13.119701] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 13.176819] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 13.188420] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 13.235987] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.351916] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 13.364019] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ OK ] Started VDO volume services. [ 13.411712] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 13.527926] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ OK ] Started System Security Services Daemon. [ OK ] Reached target User and Group Name Lookups. Starting CUPS Scheduler... Starting Login Service... Starting Permit User Sessions... [ 13.635071] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Job spooling tools. [ OK ] Started Login Service. [ 13.847116] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.872064] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started CUPS Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network …nager Wait Online (10s / no limit) [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting /etc/rc.d/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -v '127.0.0.1\|127.0.1.1' ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' [ OK ] Started Notify NFS peers of a restart. + myips= + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' '' '!=' '' ']' + '[' 1 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips= + attempts=2 + sleep 1 + '[' '' '!=' '' ']' + '[' 2 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.86 + attempts=3 + sleep 1 + '[' 172.21.15.86 '!=' '' ']' + set -e + '[' -n 172.21.15.86 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.86 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.86 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi086.front.sepia.ceph.com + '[' -n smithi086.front.sepia.ceph.com ']' + hostname smithi086.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi086 + echo smithi086 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.86 smithi086.front.sepia.ceph.com smithi086/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-10-08T07:09:08.528 DEBUG:teuthology.orchestra.console.smithi086:expect after: smithi086 login: 2023-10-08T07:09:08.581 DEBUG:teuthology.orchestra.console.smithi086:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Age t GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D8 09 GUID: 00000000 0000 0000 0000 0CC47AD8DAF6 DHCP.|                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| CLIENT IP: 172.21.15.86 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d8:09)... Configuring (net0 0c:c4:7a:8f:d8:09).... Configuring (net0 0c:c4:7a:8f:d8:09)..... Configuring (net0 0c:c4:7a:8f:d8:09)...... ok    [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-5a84457b7b52416e95d47d02e2e4a60f) 8.6>               The selected entry will be started automatically in 5s.  Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)   Red Hat Enterprise Linux (0-rescue-5a84457b7b52416e95d47d02e2e4a60f) 8.6*           The selected entry will be started automatically in 4s.    Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h     [ 0.000000] Lion 4.18.0-372.9ckbuild@x86-vm-09.build.eng.bos.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-10) (GCC)) #1 SMP Fri Apr 15 22:12:19 EDT 2022 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-372.9.1.el8.x86_64 root=UUID=78886b72-f581-4b1d-8578-0d8161fd4ca1 ro crashkernel=auto console=ttyS1,115200 console=tty0 console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec1fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f74000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.969 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78ec2 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x3484f000-0x3641ffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 192MB of memory at 1728MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078ec1fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29108 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78ec2000-0x78f73fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f74000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 55 pages/cpu s188416 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228742 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-372.9.1.el8.x86_64 root=UUID=78886b72-f581-4b1d-8578-0d8161fd4ca1 ro crashkernel=auto console=ttyS1,115200 console=tty0 console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] Memory: 1820612K/33438000K available (12293K kernel code, 5865K rwdata, 8292K rodata, 2520K init, 14348K bss, 869504K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 39999 entries in 157 pages [ 0.000000] ftrace: allocated 157 pages with 5 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [tty0] enabled [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20210604 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005001] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013095] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014454] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327333a6725, max_idle_ns: 440795319410 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.93 BogoMIPS (lpj=3499969) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022020] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024003] SELinux: Initializing. [ 0.026004] LSM support for eBPF active [ 0.032116] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.035478] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.036075] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.037071] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.038226] CPU0: Thermal monitoring enabled (TM1) [ 0.039041] process: using mwait in idle threads [ 0.040001] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.041000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.042000] FEATURE SPEC_CTRL Not Present [ 0.043000] FEATURE IBPB_SUPPORT Not Present [ 0.044000] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.045001] Spectre V2 : Mitigation: Retpolines [ 0.046000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.047000] Speculative Store Bypass: Vulnerable [ 0.048003] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.049000] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.050229] Freeing SMP alternatives memory: 36K [ 0.052606] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.155675] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.156099] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.157001] ... version: 3 [ 0.158000] ... bit width: 48 [ 0.159000] ... generic registers: 4 [ 0.160000] ... value mask: 0000ffffffffffff [ 0.161000] ... max period: 00007fffffffffff [ 0.162000] ... fixed-purpose events: 3 [ 0.163000] ... event mask: 000000070000000f [ 0.164027] rcu: Hierarchical SRCU implementation. [ 0.165835] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.166016] smp: Bringing up secondary CPUs ... [ 0.167067] x86: Booting SMP configuration: [ 0.168002] .... node #0, CPUs: #1 #2 #3 #4 [ 0.171254] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.173000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.174089] #5 #6 #7 [ 0.176553] smp: Brought up 1 node, 8 CPUs [ 0.178001] smpboot: Max logical packages: 1 [ 0.179000] smpboot: Total of 8 processors activated (55999.50 BogoMIPS) [ 0.215108] node 0 deferred pages initialised in 34ms [ 0.221591] devtmpfs: initialized [ 0.222039] x86/mm: Memory block size: 128MB [ 0.224946] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.225091] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.226007] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.227061] pinctrl core: initialized pinctrl subsystem [ 0.228119] NET: Registered protocol family 16 [ 0.229078] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.230009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.231009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.240019] audit: initializing netlink subsys (disabled) [ 0.245008] audit: type=2000 audit(1696748918.245:1): state=initialized audit_enabled=0 res=1 [ 0.254002] cpuidle: using governor menu [ 0.258023] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.265001] ACPI: bus type PCI registered [ 0.270001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.276044] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.286002] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.292010] PCI: Using configuration type 1 for base access [ 0.299466] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.306002] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.313023] cryptd: max_cpu_qlen set to 1000 [ 0.317058] ACPI: Added _OSI(Module Device) [ 0.322002] ACPI: Added _OSI(Processor Device) [ 0.326003] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.331000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.336000] ACPI: Added _OSI(Linux-Dell-Video) [ 0.341000] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.346000] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 0.378969] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.387980] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.397052] ACPI: Dynamic OEM Table Load: [ 0.415774] ACPI: Interpreter enabled [ 0.419011] ACPI: PM: (supports S0 S4 S5) [ 0.423000] ACPI: Using IOAPIC for interrupt routing [ 0.428016] HEST: Enabling Firmware First mode for corrected errors. [ 0.435070] HEST: Table parsing has been initialized. [ 0.440002] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.450091] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.477505] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.483003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.494420] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.503022] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.511000] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.519028] PCI host bridge to bus 0000:ff [ 0.523001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.528009] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.534041] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.541031] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.547030] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.553031] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.559029] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.565029] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.571031] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.577031] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.583029] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.590031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.596029] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.602022] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.608030] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.614029] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.620031] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.626029] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.632029] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.638030] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.645021] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.651036] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.657058] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.663042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.669043] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.675041] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.681042] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.687040] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.694034] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.700031] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.706044] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.712041] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.718041] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.724040] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.730031] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.736032] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.743036] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.749033] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.755042] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.761044] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.767042] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.773044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.779036] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.785031] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.792032] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.798034] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.804031] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.810032] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.816033] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.822034] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.828030] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.834030] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.841031] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.847022] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.853032] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.859030] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.867710] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.874002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.883144] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.891270] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.899000] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.908186] PCI host bridge to bus 0000:00 [ 0.912001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.927000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.933000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.941000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.949000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.956000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.964000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.969011] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 0.975126] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 0.982042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 0.988106] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 0.994042] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.000104] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.007041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.013089] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.019008] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.026107] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.032007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.039106] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.045007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.052109] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.058008] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.065106] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.071007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.078107] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.084007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.091106] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.097007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.104108] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.110007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.117105] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.124091] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.130069] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.136090] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.142005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.148105] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.155147] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.161011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.167007] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.172006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.178006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.184006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.189006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.196035] pci 0000:00:11.4: PME# supported from D3hot [ 1.201093] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.207014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.214050] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.220088] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.226013] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.233052] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.239084] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.245013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.252051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.258098] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.265013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.271072] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.277094] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.283066] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.290061] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.296067] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.302103] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.308066] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.315107] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.321010] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.327072] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.333094] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.340173] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.346009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.351005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.357005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.363005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.368005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.374005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.380029] pci 0000:00:1f.2: PME# supported from D3hot [ 1.386084] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.392013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.399016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.405193] acpiphp: Slot [1] registered [ 1.409014] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.414116] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.420008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.427016] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.434003] pci 0000:02:00.0: enabling Extended Tags [ 1.439056] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.444002] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.451071] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.457009] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.464004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.470009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.477004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.484037] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.490017] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.498000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.508008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.515000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.526142] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.532010] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.539004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.545009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.552004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.559038] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.565015] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.573000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.583008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.591000] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.601132] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.606001] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.612001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.619002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.627029] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.632059] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.638065] pci 0000:05:00.0: enabling Extended Tags [ 1.643070] pci 0000:05:00.0: supports D1 D2 [ 1.648000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.654087] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.660002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.666002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.673047] pci_bus 0000:06: extended config space not accessible [ 1.679027] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.685022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.692012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.698012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.704095] pci 0000:06:00.0: supports D1 D2 [ 1.708000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.715091] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.720006] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.726003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.733080] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.739017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.745018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.751009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.758121] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.764038] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.771000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.782021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.789001] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.799160] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.805017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.812017] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.818009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.824115] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.830034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.838000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.848021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.855000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.866145] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.871002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.877002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.884003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.891441] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.897035] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.903033] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.909033] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.916033] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.922000] ACPI: PCI: Interrupt link LNKE disabled [ 1.927032] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.940000] ACPI: PCI: Interrupt link LNKF disabled [ 1.945033] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.951000] ACPI: PCI: Interrupt link LNKG disabled [ 1.956033] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.962000] ACPI: PCI: Interrupt link LNKH disabled [ 1.967134] iommu: Default domain type: Passthrough [ 1.972022] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.973000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.987001] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.993000] vgaarb: loaded [ 1.996065] SCSI subsystem initialized [ 2.000015] ACPI: bus type USB registered [ 2.004010] usbcore: registered new interface driver usbfs [ 2.009004] usbcore: registered new interface driver hub [ 2.015016] usbcore: registered new device driver usb [ 2.020016] pps_core: LinuxPPS API ver. 1 registered [ 2.025002] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.034003] PTP clock support registered [ 2.038021] EDAC MC: Ver: 3.0.0 [ 2.042115] PCI: Using ACPI for IRQ routing [ 2.051354] NetLabel: Initializing [ 2.055000] NetLabel: domain hash size = 128 [ 2.059000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.065011] NetLabel: unlabeled traffic allowed by default [ 2.071045] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.077001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.085023] clocksource: Switched to clocksource tsc-early [ 2.099761] VFS: Disk quotas dquot_6.6.0 [ 2.103775] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.110787] pnp: PnP ACPI init [ 2.114272] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.120272] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.126277] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.132272] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.138271] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.144268] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.150265] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.156958] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.163660] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.170357] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.177056] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.183747] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.190440] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.197300] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.203301] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.209305] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.215303] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.221300] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.228028] pnp: PnP ACPI: found 5 devices [ 2.237565] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.246568] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.258154] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.266086] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.271137] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.276186] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.283058] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.290726] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.298745] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.306498] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.314603] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.322273] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.330291] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.338047] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.346153] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.353820] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.361839] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.369596] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.377700] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.385367] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.393388] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.401143] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.409247] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.414292] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.420468] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.427341] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.435190] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.440240] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.445287] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.451463] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.458341] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.463645] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.469818] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.476695] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.484539] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.492470] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.500313] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.508244] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.513287] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.519462] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.526335] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.534184] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.543327] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.549587] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.555844] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.562796] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.569747] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.576698] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.583656] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.589999] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.595649] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.601996] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.609322] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.614976] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.621324] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.626981] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.633326] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.638975] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.645322] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.652734] NET: Registered protocol family 2 [ 2.657371] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.666738] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.675716] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.684237] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.691934] TCP: Hash tables configured (established 262144 bind 65536) [ 2.698737] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.706593] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.713703] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.721278] NET: Registered protocol family 1 [ 2.725716] NET: Registered protocol family 44 [ 2.730325] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.754130] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x61f took 16036 usecs [ 2.778126] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x61f took 16094 usecs [ 2.785636] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.792169] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.800657] Unpacking initramfs... [ 3.083937] Freeing initrd memory: 28484K [ 3.088106] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.094625] software IO TLB: mapped [mem 0x0000000068000000-0x000000006c000000] (64MB) [ 3.102654] ACPI: bus type thunderbolt registered [ 3.120592] Initialise system trusted keyrings [ 3.125127] Key type blacklist registered [ 3.129241] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.137178] zbud: loaded [ 3.140063] pstore: using deflate compression [ 3.144695] Platform Keyring initialized [ 3.218814] NET: Registered protocol family 38 [ 3.223348] Key type asymmetric registered [ 3.227527] Asymmetric key parser 'x509' registered [ 3.232491] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.247644] io scheduler mq-deadline registered [ 3.252258] io scheduler kyber registered [ 3.256372] io scheduler bfq registered [ 3.260352] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.267639] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.273621] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.279596] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.285548] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.291499] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.297446] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.303398] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.310780] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.319254] ACPI: Power Button [PWRB] [ 3.323017] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.330536] ACPI: Power Button [PWRF] [ 3.335362] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.342982] pstore: Registered erst as persistent store backend [ 3.349133] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 3.356728] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.383660] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.411726] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.419514] Non-volatile memory driver v1.3 [ 3.424176] rdac: device handler registered [ 3.428515] hp_sw: device handler registered [ 3.432865] emc: device handler registered [ 3.437071] alua: device handler registered [ 3.441405] libphy: Fixed MDIO Bus: probed [ 3.445647] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.452261] ehci-pci: EHCI PCI platform driver [ 3.456886] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.462249] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.469752] ehci-pci 0000:00:1a.0: debug port 2 [ 3.478283] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.491043] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.496904] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.505268] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.512591] usb usb1: Product: EHCI Host Controller [ 3.517551] usb usb1: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 ehci_hcd [ 3.524681] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.529481] hub 1-0:1.0: USB hub found [ 3.533318] hub 1-0:1.0: 2 ports detected [ 3.537576] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.542938] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.550440] ehci-pci 0000:00:1d.0: debug port 2 [ 3.558950] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.571035] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.576887] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.585256] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.592577] usb usb2: Product: EHCI Host Controller [ 3.597539] usb usb2: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 ehci_hcd [ 3.604668] usb usb2: SerialNumber: 0000:00:1d.0 [ 3.609460] hub 2-0:1.0: USB hub found [ 3.613297] hub 2-0:1.0: 2 ports detected [ 3.617484] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 3.623746] ohci-pci: OHCI PCI platform driver [ 3.628285] uhci_hcd: USB Universal Host Controller Interface driver [ 3.634829] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.640207] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.648751] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.658117] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.666486] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.673805] usb usb3: Product: xHCI Host Controller [ 3.678764] usb usb3: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 xhci-hcd [ 3.685895] usb usb3: SerialNumber: 0000:00:14.0 [ 3.690703] hub 3-0:1.0: USB hub found [ 3.694552] hub 3-0:1.0: 15 ports detected [ 3.700335] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.705701] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 3.713199] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.719567] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.727933] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.735252] usb usb4: Product: xHCI Host Controller [ 3.740215] usb usb4: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 xhci-hcd [ 3.747343] usb usb4: SerialNumber: 0000:00:14.0 [ 3.752221] hub 4-0:1.0: USB hub found [ 3.756066] hub 4-0:1.0: 6 ports detected [ 3.760972] usbcore: registered new interface driver usbserial_generic [ 3.767586] usbserial: USB Serial support registered for generic [ 3.773697] i8042: PNP: No PS/2 controller found. [ 3.778531] mousedev: PS/2 mouse device common for all mice [ 3.784245] rtc_cmos 00:00: RTC can wake from S4 [ 3.789112] rtc_cmos 00:00: registered as rtc0 [ 3.793647] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.801411] intel_pstate: Intel P-state driver initializing [ 3.807066] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.814774] hid: raw HID events driver (C) Jiri Kosina [ 3.820023] usbcore: registered new interface driver usbhid [ 3.825679] usbhid: USB HID core driver [ 3.829695] drop_monitor: Initializing network drop monitor service [ 3.836089] Initializing XFRM netlink socket [ 3.840510] NET: Registered protocol family 10 [ 3.845226] Segment Routing with IPv6 [ 3.848981] NET: Registered protocol family 17 [ 3.853621] mpls_gso: MPLS GSO support [ 3.857832] microcode: sig=0x406f1, pf=0x1, revision=0xb000010 [ 3.863861] microcode: Microcode Update Driver: v2.2. [ 3.863934] resctrl: L3 allocation detected [ 3.865005] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 3.869068] resctrl: L3DATA allocation detected [ 3.884544] resctrl: L3CODE allocation detected [ 3.889154] resctrl: L3 monitoring detected [ 3.893428] AVX2 version of gcm_enc/dec engaged. [ 3.898125] AES CTR mode by8 optimization enabled [ 3.927998] sched_clock: Marking stable (3927994292, 0)->(5549137246, -1621142954) [ 3.935988] registered taskstats version 1 [ 3.940254] Loading compiled-in X.509 certificates [ 3.947311] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 3.955597] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.962973] hub 1-1:1.0: USB hub found [ 3.966958] hub 1-1:1.0: 6 ports detected [ 3.970582] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: fcec8079a12caa6a157125702c0054357b4fc157' [ 3.981777] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 3.982129] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 4.000449] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 4.011183] zswap: loaded using pool lzo/zbud [ 4.015439] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.023901] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.031141] page_owner is disabled [ 4.031334] hub 2-1:1.0: USB hub found [ 4.038564] hub 2-1:1.0: 8 ports detected [ 4.039440] Key type big_key registered [ 4.049038] Key type encrypted registered [ 4.053153] ima: No TPM chip found, activating TPM-bypass! [ 4.058722] ima: Allocated hash algorithm: sha256 [ 4.063514] ima: No architecture policies found [ 4.068139] evm: Initialising EVM extended attributes: [ 4.073368] evm: security.selinux [ 4.076764] evm: security.ima [ 4.079814] evm: security.capability [ 4.083474] evm: HMAC attrs: 0x1 [ 4.087038] rtc_cmos 00:00: setting system clock to 2023-10-08 07:08:43 UTC (1696748923) [ 4.096109] Freeing unused decrypted memory: 2036K [ 4.101349] Freeing unused kernel image (initmem) memory: 2520K [ 4.113081] Write protecting the kernel read-only data: 24576k [ 4.119218] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.119396] Freeing unused kernel image (text/rodata gap) memory: 2012K [ 4.127028] tsc: Refined TSC clocksource calibration: 3499.993 MHz [ 4.127032] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734a05315, max_idle_ns: 440795202126 ns [ 4.127585] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.157961] clocksource: Switched to clocksource tsc [ 4.158248] hub 3-12:1.0: USB hub found [ 4.166996] hub 3-12:1.0: 4 ports detected [ 4.167195] Freeing unused kernel image (rodata/data gap) memory: 1948K [ 4.187149] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.221150] systemd[1]: Detected architecture x86-64. [ 4.226293] systemd[1]: Running in initial RAM disk. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa) dracut-049-201.git20220131.el8 (Initramfs)! [ 4.249118] systemd[1]: Set hostname to . [ 4.293626] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.305844] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 4.317059] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 4.331538] systemd[1]: Started Memstrack Anylazing Service. [ OK ] Started Memstrack Anylazing Service. [ 4.344566] systemd[1]: Starting Create list of required static device nodes for the current kernel... Starting Create list of required st…ce nodes for the current kernel... [ 4.364063] sached target Local File Systems. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Reached target Timers. [ OK ] Reached target Swap. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Sockets. Starting Journal Service... Starting Apply Kernel Variables... [ OK ] Started Setup Virtual Console. [ OK ] Started Crea[ 4.467016] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd te list of the current ker;32m OK ] Directories. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... [ OK ] Started Journal Service. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ 4.579297] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.587861] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ OK ] Started udev Kernel Device Manager. [ 4.600687] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ 4.664168] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.676804] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.688645] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ OK ] Started udev Coldplug all Devices. Starting Show Plymouth Boot Screen... [ OK ] Reached target System Initialization. [ 4.735875] dca service started, version 1.12.1 Starting dracut initqueue hook... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Reached target Paths. [ OK ] Started Forward Password Requests to Plymouth Directory Watch.[ 4.759935] igb: Intel(R) Gigabit Ethernet Network Driver [ OK [ 4.766515] igb: Copyright (c) 2007-2014 Intel Corporation. ] Reached target Basic System. [ 4.777457] nvme nvme0: pci function 0000:02:00.0 [ 4.783741] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 4.789932] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 4.802233] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.802525] nvme nvme0: 8/0/0 default/read/poll queues [ 4.810440] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.824072] nvme0n1: detected capacity change from 0 to 400088457216 [ 4.830162] igb 0000:07:00.0: added PHC on eth0 [ 4.835126] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.835128] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:f6 [ 4.835226] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.835228] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.835599] scsi host0: ahci [ 4.835734] scsi host1: ahci [ 4.836151] scsi host2: ahci [ 4.836314] scsi host3: ahci [ 4.836406] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 52 [ 4.836418] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 52 [ 4.836423] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 52 [ 4.836429] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 52 [ 4.836883] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.836886] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.853418] scsi host4: ahci [ 4.889490] igb 0000:07:00.1: added PHC on eth1 [ 4.892535] scsi host5: ahci [ 4.899911] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.907572] scsi host6: ahci [ 4.915716] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:f7 [ 4.923543] scsi host7: ahci [ 4.926474] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.931140] scsi host8: ahci [ 4.931225] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.931230] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.931247] ast 0000:06:00.0: [drm] Analog VGA only [ 4.931256] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.932160] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.934045] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.941121] scsi host9: ahci [ 4.960440] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.962459] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 [ 5.016248] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 [ 5.016250] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 [ 5.016252] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 [ 5.016253] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 [ 5.016254] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 [ 5.053864] fbcon: astdrmfb (fb0) is primary device [ 5.056241] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.141652] ata4: SATA link down (SStatus 0 SControl 300) [ 5.142840] ata1: SATA link down (SStatus 0 SControl 300) [ 5.149154] ata2: SATA link down (SStatus 0 SControl 300) [ 5.150853] ata3: SATA link down (SStatus 0 SControl 300) [ 5.165751] Console: switching to colour frame buffer device 128x48 [ 5.222646] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.324532] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.330834] ata8: SATA link down (SStatus 0 SControl 300) [ 5.336339] ata7: SATA link down (SStatus 0 SControl 300) [ 5.341855] ata6: SATA link down (SStatus 0 SControl 300) [ 5.347350] ata10: SATA link down (SStatus 0 SControl 300) [ 5.352957] ata9: SATA link down (SStatus 0 SControl 300) [ 5.359141] ata5.00: NCQ Send/Recv Log not supported [ 5.364117] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.370392] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.378873] ata5.00: NCQ Send/Recv Log not supported [ 5.383854] ata5.00: configured for UDMA/133 [ 5.388228] scsi 4:0:0:0: Direct-Ac33-9ZM SN06 PQ: 0 ANSI: 5 [ 5.400861] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.410095] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.418245] sd 4:0:0:0: [sda] Write Protect is off [ 5.423338] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.451069] sda: sda1 [ 5.459059] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.948310] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.959038] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.967999] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.974638] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d8:08 [ 5.989857] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.997175] libphy: ixgbe-mdio: probed [ 6.184252] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.194991] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.203956] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.211452] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d8:09 [ 6.230324] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.237603] libphy: ixgbe-mdio: probed [ 6.243308] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.280327] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…b72-f581-4b1d-8578-0d8161fd4ca1... [ OK ] Started File System Check on /dev/d…86b72-f581-4b1d-8578-0d8161fd4ca1. Mounting /sysroot... [ 6.489182] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped dracut pre-pivot and cleanup hook. Starting Plymouth switch root service... [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Timers. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Swap. Stopping udev Kernel Device Manager... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Sockets. [ OK ] Stopped dracut initqueue hook. Starting Setup Virtual Console... [ OK ] Stopped target Local File Systems. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel S[ 6.868720] printk: systemd: 18 output lines suppressed due to ratelimiting ocket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 7.473519] SELinux: policy capability network_peer_controls=1 [ 7.479774] SELinux: policy capability open_perms=1 [ 7.485039] SELinux: policy capability extended_socket_class=1 [ 7.491256] SELinux: policy capability always_check_network=0 [ 7.497373] SELinux: policy capability cgroup_seclabel=1 [ 7.503055] SELinux: policy capability nnp_nosuid_transition=1 [ 7.533973] audit: type=1403 audit(1696748926.945:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.535509] systemd[1]: Successfully loaded SELinux policy in 216.800ms. [ 7.618430] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.512ms. [ 7.650308] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.686506] systemd[1]: Detected architecture x86-64. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa)! [ 7.712081] systemd[1]: Set hostname to . [ 8.661752] systemd[1]: systemd-journald.service: Succeeded. [ 8.683342] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.699200] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 8.711782] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 8.729508] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 8.745508] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 8.771287] systemd[1]: Starting Journal Service... Starting Journal Service... [ OK ] Listening on initctl Compatibility Named Pipe. Mounting POSIX Message Queue File System... [ OK ] Listening on Process Core Dump Socket. Starting Load Kernel Modules... [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Listening on udev Kernel Socket. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Reached target ceph target allowing…[ 8.889955] EXT4-fs (sda1): re-mounted. Opts: (null) mirror@.service instances at once. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. Starting Remount Root and Kernel File Systems... [ OK ] Created slice system-getty.slice. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Reached target Swap. Mounting Kernel Debug File System... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped Plymouth switch root service. [ OK ] Created slice system-sshd\x2dkeygen.slice. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... Mounting Huge Pages File System... [ OK ] Created slice system-serial\x2dgetty.slice. Starting Setup Virtual Console... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [[ 9.040044] device-mapper: uevent: version 1.0.3  OK [0[ 9.046657] device-mapper: ioctl: 4.43.0-ioctl (2020-10-01) initialised: dm-devel@redhat.com m] Started Journal Service. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Huge[ 9.084067] fuse: init (API version 7.33) Pages File System. Starting Load/Save Random Seed... Starting Flush Journal to Persistent Storage... [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load/Save Random Seed. [ OK ] Started Load Kernel Modules. Starting Apply Kernel Variables... Mounting FUSE Control File System... [ OK ] Mounted FUSE Control File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Restore /run/initramfs on shutdown... Starting Tell Plymouth To Write Out Runtime Data... Starting udev Kernel Device Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ OK ] Started udev Kernel Device Manager. [ OK ] Started Create Volatile Files and Directories. Starting Security Auditing Service... Mounting RPC Pipe File System... Starting RPC Bind... [ 9.622106] RPC: Registered named UNIX socket transport module. [ 9.628758] RPC: Registered udp transport module. [ 9.634210] RPC: Registered tcp transport module. [ 9.639650] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 9.743353] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 9.773536] igb 0000:07:00.0: DCA enabled [ 9.778558] igb 0000:07:00.1: DCA enabled [ 9.813632] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 9.855187] power_meter ACPI000D:00: Found ACPI power meter. [ 9.862381] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Updates mlocate database every day. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Reached target Timers. [ OK ] Listening on CUPS Scheduler. [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket. [ OK ] Reached tar[ 9.984118] IPMI message handler: version 39.2 get Sockets. [ OK ] Started CUPS Scheduler. [ OK ][ 9.995345] ipmi device interface Reached target Paths. [ OK ] Reached target Basic System. [ OK ] [ 10.007049] ipmi_si: IPMI System Interface driver Started libstoragemgmt plug-in s[ 10.014935] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS erver daemon. [ 10.023260] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 Startin[ 10.031350] ipmi_si: Adding SMBIOS-specified kcs state machine g Authorization [ 10.039102] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI Manager... [[[ 10.046286] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 0;32m OK ] Started Machine Check Exception Logging Daemon. Starting VDO volume services... Starting NTP client/server... Starting System Security Services Daemon... Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ 10.125296] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.134781] ipmi_si: Adding ACPI-specified kcs state machine [ OK ] Started irqb[ 10.143173] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 alance daemon. [ OK [ 10.156095] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [0m] Started D-B[ 10.157865] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. us System Message Bus. Starting Network Manager... Starting Resets System Activity Logs... Starting Load CPU microcode update... [ OK ] Reached target sshd-keygen.target. [ 10.196071] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) Starting Kernel Samepage Merging... Starting Avahi mDNS/DNS-SD Stack... [ OK ] Started Kernel Samepage Merging. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM[ 10.256232] ipmi_si IPI0001:00: IPMI kcs interface initialized event activation on device 259:0... [ 10.309590] ipmi_ssif: IPMI SSIF Interface driver [ 10.345557] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.354380] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.360551] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 10.378368] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.463481] iTCO_vendor_support: vendor-support=0 [ 10.475692] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 10.482739] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 10.491237] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ 11.408272] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.419769] EDAC sbridge: Ver: 1.1.2 [ 11.573518] intel_rapl_common: Found RAPL domain package [ 11.596030] intel_rapl_common: Found RAPL domain dram [ 11.601621] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Load CPU microcode update. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started LVM event activation on device 259:0. [ OK ] Started NTP client/server. [ OK ] Started Avahi mDNS/DNS-SD Stack. [ 11.939671] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 11.949812] XFS (dm-4): Mounting V5 Filesystem [ 11.960853] XFS (dm-4): Ending clean mount [ OK ] Mounted /var/lib/ceph. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Enable periodic update of entitlement certificates.... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... [ OK ] Started Enable periodic update of entitlement certificates.. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started Authorization Manager. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Network Manager Script Dispatcher Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started Network Manager Script Dispatcher Service. [ 13.051717] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 13.110577] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 13.119701] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 13.176819] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 13.188420] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 13.235987] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 13.351916] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 13.364019] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ OK ] Started VDO volume services. [ 13.411712] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 13.527926] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ OK ] Started System Security Services Daemon. [ OK ] Reached target User and Group Name Lookups. Starting CUPS Scheduler... Starting Login Service... Starting Permit User Sessions... [ 13.635071] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Job spooling tools. [ OK ] Started Login Service. [ 13.847116] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.872064] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started CUPS Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network …nager Wait Online (10s / no limit) [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting /etc/rc.d/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -v '127.0.0.1\|127.0.1.1' ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' [ OK ] Started Notify NFS peers of a restart. + myips= + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' '' '!=' '' ']' + '[' 1 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips= + attempts=2 + sleep 1 + '[' '' '!=' '' ']' + '[' 2 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.86 + attempts=3 + sleep 1 + '[' 172.21.15.86 '!=' '' ']' + set -e + '[' -n 172.21.15.86 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.86 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.86 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi086.front.sepia.ceph.com + '[' -n smithi086.front.sepia.ceph.com ']' + hostname smithi086.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi086 + echo smithi086 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.86 smithi086.front.sepia.ceph.com smithi086/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi086 login: [disconnect] 2023-10-08T07:09:08.685 INFO:teuthology.misc:Re-opening connections... 2023-10-08T07:09:08.685 INFO:teuthology.misc:trying to connect to ubuntu@smithi086.front.sepia.ceph.com 2023-10-08T07:09:08.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-08T07:09:08.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T07:09:09.051 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-10-08T07:09:09.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-08T07:09:09.325 DEBUG:teuthology.misc:waited 0.6393506526947021 2023-10-08T07:09:10.326 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi086.front.sepia.ceph.com 2023-10-08T07:09:10.326 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi086.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2023-10-08T07:09:10.326 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-10-08T07:09:10.442 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T07:09:10.475 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T07:09:10.475 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T07:09:10.517 INFO:tasks.ceph.osd.1:Started 2023-10-08T07:09:10.518 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:09:10.646 INFO:teuthology.orchestra.run.smithi086.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2023-10-08T07:09:10.649 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-08T07:09:10.650 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2023-10-08T07:09:11.393 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:09:11.090+0000 7f4eb0693640 -1 Falling back to public interface 2023-10-08T07:09:11.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-08T07:09:15.039 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:09:14.736+0000 7f4eb0693640 -1 osd.1 36 log_to_monitors true 2023-10-08T07:09:15.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:09:15.787 INFO:teuthology.orchestra.run.smithi086.stderr:no valid command found; 10 closest matches: 2023-10-08T07:09:15.787 INFO:teuthology.orchestra.run.smithi086.stderr:0 2023-10-08T07:09:15.787 INFO:teuthology.orchestra.run.smithi086.stderr:1 2023-10-08T07:09:15.787 INFO:teuthology.orchestra.run.smithi086.stderr:2 2023-10-08T07:09:15.787 INFO:teuthology.orchestra.run.smithi086.stderr:abort 2023-10-08T07:09:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:assert 2023-10-08T07:09:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:bluefs debug_inject_read_zeros 2023-10-08T07:09:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:bluefs files list 2023-10-08T07:09:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:bluefs stats 2023-10-08T07:09:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:bluestore allocator dump block 2023-10-08T07:09:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:bluestore allocator fragmentation block 2023-10-08T07:09:15.788 INFO:teuthology.orchestra.run.smithi086.stderr:admin_socket: invalid command 2023-10-08T07:09:15.790 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-08T07:09:15.791 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2023-10-08T07:09:16.054 INFO:tasks.ceph.osd.1.smithi086.stderr:2023-10-08T07:09:15.751+0000 7f4e9c625700 -1 osd.1 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T07:09:20.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-10-08T07:09:20.932 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2023-10-08T07:09:20.932 INFO:teuthology.orchestra.run.smithi086.stdout: "ops": [], 2023-10-08T07:09:20.932 INFO:teuthology.orchestra.run.smithi086.stdout: "num_ops": 0 2023-10-08T07:09:20.932 INFO:teuthology.orchestra.run.smithi086.stdout:} 2023-10-08T07:09:20.943 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2023-10-08T07:09:22.057 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.0 to 1 (10000) 2023-10-08T07:09:22.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2023-10-08T07:09:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.1 to 1 (10000) 2023-10-08T07:09:23.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2023-10-08T07:09:24.065 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.2 to 1 (10000) 2023-10-08T07:09:24.079 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2023-10-08T07:09:24.080 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:09:24.428 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:09:24.430 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:09:24.440 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2023-10-08T07:09:24.061716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":8637560,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149186,"ondisk_log_size":149186,"up":210,"acting":197,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1126612,"kb_used_data":3948,"kb_used_omap":8,"kb_used_meta":1122615,"kb_avail":281988908,"statfs":{"total":289910292480,"available":288756641792,"internally_reserved":0,"allocated":4042752,"data_stored":2625203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1149557789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.033103"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":2987,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737777+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:20.737777+0000","last_peered":"2023-10-08T07:09:20.737777+0000","last_clean":"2023-10-08T07:09:20.737777+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:20.737777+0000","last_undegraded":"2023-10-08T07:09:20.737777+0000","last_fullsized":"2023-10-08T07:09:20.737777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:13.308715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2888,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737069+0000","last_change":"2023-10-08T07:09:20.737069+0000","last_active":"2023-10-08T07:09:20.737069+0000","last_peered":"2023-10-08T07:09:20.737069+0000","last_clean":"2023-10-08T07:09:20.737069+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:20.737069+0000","last_undegraded":"2023-10-08T07:09:20.737069+0000","last_fullsized":"2023-10-08T07:09:20.737069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:03.307776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.057444+0000","last_change":"2023-10-08T07:09:18.056834+0000","last_active":"2023-10-08T07:09:18.057444+0000","last_peered":"2023-10-08T07:09:18.057444+0000","last_clean":"2023-10-08T07:09:18.057444+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:09:18.057444+0000","last_undegraded":"2023-10-08T07:09:18.057444+0000","last_fullsized":"2023-10-08T07:09:18.057444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:16.520645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.050770+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:09:18.050770+0000","last_peered":"2023-10-08T07:09:18.050770+0000","last_clean":"2023-10-08T07:09:18.050770+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:09:18.050770+0000","last_undegraded":"2023-10-08T07:09:18.050770+0000","last_fullsized":"2023-10-08T07:09:18.050770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5877,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.736694+0000","last_change":"2023-10-08T07:09:20.736694+0000","last_active":"2023-10-08T07:09:20.736694+0000","last_peered":"2023-10-08T07:09:20.736694+0000","last_clean":"2023-10-08T07:09:20.736694+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:09:20.736694+0000","last_undegraded":"2023-10-08T07:09:20.736694+0000","last_fullsized":"2023-10-08T07:09:20.736694+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:19:45.353931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8556,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046087+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:09:18.046087+0000","last_peered":"2023-10-08T07:09:18.046087+0000","last_clean":"2023-10-08T07:09:18.046087+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:09:18.046087+0000","last_undegraded":"2023-10-08T07:09:18.046087+0000","last_fullsized":"2023-10-08T07:09:18.046087+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":69,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.045176+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:09:18.045176+0000","last_peered":"2023-10-08T07:09:18.045176+0000","last_clean":"2023-10-08T07:09:18.045176+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:18.045176+0000","last_undegraded":"2023-10-08T07:09:18.045176+0000","last_fullsized":"2023-10-08T07:09:18.045176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3001,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.443345+0000","last_change":"2023-10-08T07:09:19.443561+0000","last_active":"2023-10-08T07:09:19.443345+0000","last_peered":"2023-10-08T07:09:19.443345+0000","last_clean":"2023-10-08T07:09:16.034807+0000","last_became_active":"2023-10-08T07:09:19.371254+0000","last_became_peered":"2023-10-08T07:09:19.371254+0000","last_unstale":"2023-10-08T07:09:19.443345+0000","last_undegraded":"2023-10-08T07:09:19.443345+0000","last_fullsized":"2023-10-08T07:09:19.044784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:56.596378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2861,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.468141+0000","last_change":"2023-10-08T07:09:19.468334+0000","last_active":"2023-10-08T07:09:19.468141+0000","last_peered":"2023-10-08T07:09:19.468141+0000","last_clean":"2023-10-08T07:06:36.118964+0000","last_became_active":"2023-10-08T07:09:19.461967+0000","last_became_peered":"2023-10-08T07:09:19.461967+0000","last_unstale":"2023-10-08T07:09:19.468141+0000","last_undegraded":"2023-10-08T07:09:19.468141+0000","last_fullsized":"2023-10-08T07:09:19.044223+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:48.580026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2944,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737658+0000","last_change":"2023-10-08T07:09:20.737658+0000","last_active":"2023-10-08T07:09:20.737658+0000","last_peered":"2023-10-08T07:09:20.737658+0000","last_clean":"2023-10-08T07:09:20.737658+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:09:20.737658+0000","last_undegraded":"2023-10-08T07:09:20.737658+0000","last_fullsized":"2023-10-08T07:09:20.737658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:36.077873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":49,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.138312+0000","last_change":"2023-10-08T07:09:19.138312+0000","last_active":"2023-10-08T07:09:19.138312+0000","last_peered":"2023-10-08T07:09:19.138312+0000","last_clean":"2023-10-08T07:09:19.138312+0000","last_became_active":"2023-10-08T07:09:19.137923+0000","last_became_peered":"2023-10-08T07:09:19.137923+0000","last_unstale":"2023-10-08T07:09:19.138312+0000","last_undegraded":"2023-10-08T07:09:19.138312+0000","last_fullsized":"2023-10-08T07:09:19.138312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:16.510675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2949,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.736199+0000","last_change":"2023-10-08T07:09:20.736199+0000","last_active":"2023-10-08T07:09:20.736199+0000","last_peered":"2023-10-08T07:09:20.736199+0000","last_clean":"2023-10-08T07:09:20.736199+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:20.736199+0000","last_undegraded":"2023-10-08T07:09:20.736199+0000","last_fullsized":"2023-10-08T07:09:20.736199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.663562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733557+0000","last_change":"2023-10-08T07:09:17.754638+0000","last_active":"2023-10-08T07:09:19.733557+0000","last_peered":"2023-10-08T07:09:19.733557+0000","last_clean":"2023-10-08T07:09:19.733557+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:09:19.733557+0000","last_undegraded":"2023-10-08T07:09:19.733557+0000","last_fullsized":"2023-10-08T07:09:19.733557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:12.379792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2955,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.401297+0000","last_change":"2023-10-08T07:09:19.401477+0000","last_active":"2023-10-08T07:09:19.401297+0000","last_peered":"2023-10-08T07:09:19.401297+0000","last_clean":"2023-10-08T07:06:36.374068+0000","last_became_active":"2023-10-08T07:09:19.336996+0000","last_became_peered":"2023-10-08T07:09:19.336996+0000","last_unstale":"2023-10-08T07:09:19.401297+0000","last_undegraded":"2023-10-08T07:09:19.401297+0000","last_fullsized":"2023-10-08T07:09:19.044824+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:51.222173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5838,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.729885+0000","last_change":"2023-10-08T07:09:19.751084+0000","last_active":"2023-10-08T07:09:20.729885+0000","last_peered":"2023-10-08T07:09:20.729885+0000","last_clean":"2023-10-08T07:09:20.729885+0000","last_became_active":"2023-10-08T07:09:19.750211+0000","last_became_peered":"2023-10-08T07:09:19.750211+0000","last_unstale":"2023-10-08T07:09:20.729885+0000","last_undegraded":"2023-10-08T07:09:20.729885+0000","last_fullsized":"2023-10-08T07:09:20.729885+0000","mapping_epoch":76,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:30.610684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2967,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046334+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:09:18.046334+0000","last_peered":"2023-10-08T07:09:18.046334+0000","last_clean":"2023-10-08T07:09:18.046334+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:09:18.046334+0000","last_undegraded":"2023-10-08T07:09:18.046334+0000","last_fullsized":"2023-10-08T07:09:18.046334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2959,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.480930+0000","last_change":"2023-10-08T07:09:19.481145+0000","last_active":"2023-10-08T07:09:19.480930+0000","last_peered":"2023-10-08T07:09:19.480930+0000","last_clean":"2023-10-08T07:06:36.119029+0000","last_became_active":"2023-10-08T07:09:19.463563+0000","last_became_peered":"2023-10-08T07:09:19.463563+0000","last_unstale":"2023-10-08T07:09:19.480930+0000","last_undegraded":"2023-10-08T07:09:19.480930+0000","last_fullsized":"2023-10-08T07:09:19.103041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:23:49.964864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733596+0000","last_change":"2023-10-08T07:09:17.754747+0000","last_active":"2023-10-08T07:09:19.733596+0000","last_peered":"2023-10-08T07:09:19.733596+0000","last_clean":"2023-10-08T07:09:19.733596+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:09:19.733596+0000","last_undegraded":"2023-10-08T07:09:19.733596+0000","last_fullsized":"2023-10-08T07:09:19.733596+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:47.075369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2940,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.346576+0000","last_change":"2023-10-08T07:09:19.346806+0000","last_active":"2023-10-08T07:09:19.346576+0000","last_peered":"2023-10-08T07:09:19.346576+0000","last_clean":"2023-10-08T07:06:36.118970+0000","last_became_active":"2023-10-08T07:09:19.316021+0000","last_became_peered":"2023-10-08T07:09:19.316021+0000","last_unstale":"2023-10-08T07:09:19.346576+0000","last_undegraded":"2023-10-08T07:09:19.346576+0000","last_fullsized":"2023-10-08T07:09:19.046880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:01.783452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2958,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.050640+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:09:18.050640+0000","last_peered":"2023-10-08T07:09:18.050640+0000","last_clean":"2023-10-08T07:09:18.050640+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:09:18.050640+0000","last_undegraded":"2023-10-08T07:09:18.050640+0000","last_fullsized":"2023-10-08T07:09:18.050640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5877,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.045645+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:09:18.045645+0000","last_peered":"2023-10-08T07:09:18.045645+0000","last_clean":"2023-10-08T07:09:18.045645+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:09:18.045645+0000","last_undegraded":"2023-10-08T07:09:18.045645+0000","last_fullsized":"2023-10-08T07:09:18.045645+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2864,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.735818+0000","last_change":"2023-10-08T07:09:20.735818+0000","last_active":"2023-10-08T07:09:20.735818+0000","last_peered":"2023-10-08T07:09:20.735818+0000","last_clean":"2023-10-08T07:09:20.735818+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:09:20.735818+0000","last_undegraded":"2023-10-08T07:09:20.735818+0000","last_fullsized":"2023-10-08T07:09:20.735818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:56.874136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2966,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.051445+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:09:18.051445+0000","last_peered":"2023-10-08T07:09:18.051445+0000","last_clean":"2023-10-08T07:09:18.051445+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:18.051445+0000","last_undegraded":"2023-10-08T07:09:18.051445+0000","last_fullsized":"2023-10-08T07:09:18.051445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5825,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.736822+0000","last_change":"2023-10-08T07:09:20.736822+0000","last_active":"2023-10-08T07:09:20.736822+0000","last_peered":"2023-10-08T07:09:20.736822+0000","last_clean":"2023-10-08T07:09:20.736822+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:20.736822+0000","last_undegraded":"2023-10-08T07:09:20.736822+0000","last_fullsized":"2023-10-08T07:09:20.736822+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:19.752508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2944,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.735845+0000","last_change":"2023-10-08T07:09:20.735845+0000","last_active":"2023-10-08T07:09:20.735845+0000","last_peered":"2023-10-08T07:09:20.735845+0000","last_clean":"2023-10-08T07:09:20.735845+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:09:20.735845+0000","last_undegraded":"2023-10-08T07:09:20.735845+0000","last_fullsized":"2023-10-08T07:09:20.735845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.084033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2959,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.047945+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:09:18.047945+0000","last_peered":"2023-10-08T07:09:18.047945+0000","last_clean":"2023-10-08T07:09:18.047945+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:09:18.047945+0000","last_undegraded":"2023-10-08T07:09:18.047945+0000","last_fullsized":"2023-10-08T07:09:18.047945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.056731+0000","last_change":"2023-10-08T07:09:18.055530+0000","last_active":"2023-10-08T07:09:18.056731+0000","last_peered":"2023-10-08T07:09:18.056731+0000","last_clean":"2023-10-08T07:09:18.056731+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:18.056731+0000","last_undegraded":"2023-10-08T07:09:18.056731+0000","last_fullsized":"2023-10-08T07:09:18.056731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:01.783452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.732182+0000","last_change":"2023-10-08T07:09:17.751957+0000","last_active":"2023-10-08T07:09:19.732182+0000","last_peered":"2023-10-08T07:09:19.732182+0000","last_clean":"2023-10-08T07:09:19.732182+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:09:19.732182+0000","last_undegraded":"2023-10-08T07:09:19.732182+0000","last_fullsized":"2023-10-08T07:09:19.732182+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:13.104739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733498+0000","last_change":"2023-10-08T07:09:17.754513+0000","last_active":"2023-10-08T07:09:19.733498+0000","last_peered":"2023-10-08T07:09:19.733498+0000","last_clean":"2023-10-08T07:09:19.733498+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:19.733498+0000","last_undegraded":"2023-10-08T07:09:19.733498+0000","last_fullsized":"2023-10-08T07:09:19.733498+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:06.336414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.051943+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:09:18.051943+0000","last_peered":"2023-10-08T07:09:18.051943+0000","last_clean":"2023-10-08T07:09:18.051943+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:09:18.051943+0000","last_undegraded":"2023-10-08T07:09:18.051943+0000","last_fullsized":"2023-10-08T07:09:18.051943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046679+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:09:18.046679+0000","last_peered":"2023-10-08T07:09:18.046679+0000","last_clean":"2023-10-08T07:09:18.046679+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:09:18.046679+0000","last_undegraded":"2023-10-08T07:09:18.046679+0000","last_fullsized":"2023-10-08T07:09:18.046679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.057414+0000","last_change":"2023-10-08T07:09:18.055607+0000","last_active":"2023-10-08T07:09:18.057414+0000","last_peered":"2023-10-08T07:09:18.057414+0000","last_clean":"2023-10-08T07:09:18.057414+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:09:18.057414+0000","last_undegraded":"2023-10-08T07:09:18.057414+0000","last_fullsized":"2023-10-08T07:09:18.057414+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:09.952089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3013,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737162+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:20.737162+0000","last_peered":"2023-10-08T07:09:20.737162+0000","last_clean":"2023-10-08T07:09:20.737162+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:20.737162+0000","last_undegraded":"2023-10-08T07:09:20.737162+0000","last_fullsized":"2023-10-08T07:09:20.737162+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:30.753981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.049422+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:09:18.049422+0000","last_peered":"2023-10-08T07:09:18.049422+0000","last_clean":"2023-10-08T07:09:18.049422+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:18.049422+0000","last_undegraded":"2023-10-08T07:09:18.049422+0000","last_fullsized":"2023-10-08T07:09:18.049422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5803,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.456422+0000","last_change":"2023-10-08T07:09:19.456422+0000","last_active":"2023-10-08T07:09:19.456422+0000","last_peered":"2023-10-08T07:09:19.456422+0000","last_clean":"2023-10-08T07:06:36.118430+0000","last_became_active":"2023-10-08T07:09:19.380282+0000","last_became_peered":"2023-10-08T07:09:19.380282+0000","last_unstale":"2023-10-08T07:09:19.456422+0000","last_undegraded":"2023-10-08T07:09:19.456422+0000","last_fullsized":"2023-10-08T07:09:19.042669+0000","mapping_epoch":75,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:58:38.303498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.047437+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:18.047437+0000","last_peered":"2023-10-08T07:09:18.047437+0000","last_clean":"2023-10-08T07:09:18.047437+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:18.047437+0000","last_undegraded":"2023-10-08T07:09:18.047437+0000","last_fullsized":"2023-10-08T07:09:18.047437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2926,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.052058+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:09:18.052058+0000","last_peered":"2023-10-08T07:09:18.052058+0000","last_clean":"2023-10-08T07:09:18.052058+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:09:18.052058+0000","last_undegraded":"2023-10-08T07:09:18.052058+0000","last_fullsized":"2023-10-08T07:09:18.052058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"67'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733072+0000","last_change":"2023-10-08T07:09:17.758979+0000","last_active":"2023-10-08T07:09:19.733072+0000","last_peered":"2023-10-08T07:09:19.733072+0000","last_clean":"2023-10-08T07:09:19.733072+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:09:19.733072+0000","last_undegraded":"2023-10-08T07:09:19.733072+0000","last_fullsized":"2023-10-08T07:09:19.733072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:06.386900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":90,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.065354+0000","last_change":"2023-10-08T07:09:18.064856+0000","last_active":"2023-10-08T07:09:18.065354+0000","last_peered":"2023-10-08T07:09:18.065354+0000","last_clean":"2023-10-08T07:09:18.065354+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:18.065354+0000","last_undegraded":"2023-10-08T07:09:18.065354+0000","last_fullsized":"2023-10-08T07:09:18.065354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.230654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":174,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.064871+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:18.064871+0000","last_peered":"2023-10-08T07:09:18.064871+0000","last_clean":"2023-10-08T07:09:18.064871+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:18.064871+0000","last_undegraded":"2023-10-08T07:09:18.064871+0000","last_fullsized":"2023-10-08T07:09:18.064871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2926,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.451297+0000","last_change":"2023-10-08T07:09:19.451457+0000","last_active":"2023-10-08T07:09:19.451297+0000","last_peered":"2023-10-08T07:09:19.451297+0000","last_clean":"2023-10-08T07:06:36.374313+0000","last_became_active":"2023-10-08T07:09:19.353141+0000","last_became_peered":"2023-10-08T07:09:19.353141+0000","last_unstale":"2023-10-08T07:09:19.451297+0000","last_undegraded":"2023-10-08T07:09:19.451297+0000","last_fullsized":"2023-10-08T07:09:19.044824+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:59.698365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":72,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.048102+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:09:18.048102+0000","last_peered":"2023-10-08T07:09:18.048102+0000","last_clean":"2023-10-08T07:09:18.048102+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:09:18.048102+0000","last_undegraded":"2023-10-08T07:09:18.048102+0000","last_fullsized":"2023-10-08T07:09:18.048102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2931,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737135+0000","last_change":"2023-10-08T07:09:20.737135+0000","last_active":"2023-10-08T07:09:20.737135+0000","last_peered":"2023-10-08T07:09:20.737135+0000","last_clean":"2023-10-08T07:09:20.737135+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:09:20.737135+0000","last_undegraded":"2023-10-08T07:09:20.737135+0000","last_fullsized":"2023-10-08T07:09:20.737135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:52.474047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.042602+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:09:18.042602+0000","last_peered":"2023-10-08T07:09:18.042602+0000","last_clean":"2023-10-08T07:09:18.042602+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:09:18.042602+0000","last_undegraded":"2023-10-08T07:09:18.042602+0000","last_fullsized":"2023-10-08T07:09:18.042602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8810,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737857+0000","last_change":"2023-10-08T07:09:20.737857+0000","last_active":"2023-10-08T07:09:20.737857+0000","last_peered":"2023-10-08T07:09:20.737857+0000","last_clean":"2023-10-08T07:09:20.737857+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:09:20.737857+0000","last_undegraded":"2023-10-08T07:09:20.737857+0000","last_fullsized":"2023-10-08T07:09:20.737857+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:56.740198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.734699+0000","last_change":"2023-10-08T07:09:17.751068+0000","last_active":"2023-10-08T07:09:19.734699+0000","last_peered":"2023-10-08T07:09:19.734699+0000","last_clean":"2023-10-08T07:09:19.734699+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:09:19.734699+0000","last_undegraded":"2023-10-08T07:09:19.734699+0000","last_fullsized":"2023-10-08T07:09:19.734699+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:15.155530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2909,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.047453+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:09:18.047453+0000","last_peered":"2023-10-08T07:09:18.047453+0000","last_clean":"2023-10-08T07:09:18.047453+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:09:18.047453+0000","last_undegraded":"2023-10-08T07:09:18.047453+0000","last_fullsized":"2023-10-08T07:09:18.047453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'9","reported_seq":91,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.055946+0000","last_change":"2023-10-08T07:09:18.054836+0000","last_active":"2023-10-08T07:09:18.055946+0000","last_peered":"2023-10-08T07:09:18.055946+0000","last_clean":"2023-10-08T07:09:18.055946+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:09:18.055946+0000","last_undegraded":"2023-10-08T07:09:18.055946+0000","last_fullsized":"2023-10-08T07:09:18.055946+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:16.567958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":69,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.050042+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:09:18.050042+0000","last_peered":"2023-10-08T07:09:18.050042+0000","last_clean":"2023-10-08T07:09:18.050042+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:09:18.050042+0000","last_undegraded":"2023-10-08T07:09:18.050042+0000","last_fullsized":"2023-10-08T07:09:18.050042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.057428+0000","last_change":"2023-10-08T07:09:18.056757+0000","last_active":"2023-10-08T07:09:18.057428+0000","last_peered":"2023-10-08T07:09:18.057428+0000","last_clean":"2023-10-08T07:09:18.057428+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:09:18.057428+0000","last_undegraded":"2023-10-08T07:09:18.057428+0000","last_fullsized":"2023-10-08T07:09:18.057428+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:47.575148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.732360+0000","last_change":"2023-10-08T07:09:17.753129+0000","last_active":"2023-10-08T07:09:19.732360+0000","last_peered":"2023-10-08T07:09:19.732360+0000","last_clean":"2023-10-08T07:09:19.732360+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:09:19.732360+0000","last_undegraded":"2023-10-08T07:09:19.732360+0000","last_fullsized":"2023-10-08T07:09:19.732360+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:53.133780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.735034+0000","last_change":"2023-10-08T07:09:17.753124+0000","last_active":"2023-10-08T07:09:19.735034+0000","last_peered":"2023-10-08T07:09:19.735034+0000","last_clean":"2023-10-08T07:09:19.735034+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:09:19.735034+0000","last_undegraded":"2023-10-08T07:09:19.735034+0000","last_fullsized":"2023-10-08T07:09:19.735034+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.689880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":2988,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737843+0000","last_change":"2023-10-08T07:09:20.737843+0000","last_active":"2023-10-08T07:09:20.737843+0000","last_peered":"2023-10-08T07:09:20.737843+0000","last_clean":"2023-10-08T07:09:20.737843+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:09:20.737843+0000","last_undegraded":"2023-10-08T07:09:20.737843+0000","last_fullsized":"2023-10-08T07:09:20.737843+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:58.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.057772+0000","last_change":"2023-10-08T07:09:18.057034+0000","last_active":"2023-10-08T07:09:18.057772+0000","last_peered":"2023-10-08T07:09:18.057772+0000","last_clean":"2023-10-08T07:09:18.057772+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:09:18.057772+0000","last_undegraded":"2023-10-08T07:09:18.057772+0000","last_fullsized":"2023-10-08T07:09:18.057772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:42.006586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2932,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046540+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:09:18.046540+0000","last_peered":"2023-10-08T07:09:18.046540+0000","last_clean":"2023-10-08T07:09:18.046540+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:09:18.046540+0000","last_undegraded":"2023-10-08T07:09:18.046540+0000","last_fullsized":"2023-10-08T07:09:18.046540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.047707+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:18.047707+0000","last_peered":"2023-10-08T07:09:18.047707+0000","last_clean":"2023-10-08T07:09:18.047707+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:18.047707+0000","last_undegraded":"2023-10-08T07:09:18.047707+0000","last_fullsized":"2023-10-08T07:09:18.047707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":2977,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.043030+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:09:18.043030+0000","last_peered":"2023-10-08T07:09:18.043030+0000","last_clean":"2023-10-08T07:09:18.043030+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:18.043030+0000","last_undegraded":"2023-10-08T07:09:18.043030+0000","last_fullsized":"2023-10-08T07:09:18.043030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'3","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.042807+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:09:18.042807+0000","last_peered":"2023-10-08T07:09:18.042807+0000","last_clean":"2023-10-08T07:09:18.042807+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:09:18.042807+0000","last_undegraded":"2023-10-08T07:09:18.042807+0000","last_fullsized":"2023-10-08T07:09:18.042807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5915,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.047832+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:09:18.047832+0000","last_peered":"2023-10-08T07:09:18.047832+0000","last_clean":"2023-10-08T07:09:18.047832+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:18.047832+0000","last_undegraded":"2023-10-08T07:09:18.047832+0000","last_fullsized":"2023-10-08T07:09:18.047832+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046312+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:09:18.046312+0000","last_peered":"2023-10-08T07:09:18.046312+0000","last_clean":"2023-10-08T07:09:18.046312+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:09:18.046312+0000","last_undegraded":"2023-10-08T07:09:18.046312+0000","last_fullsized":"2023-10-08T07:09:18.046312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.058942+0000","last_change":"2023-10-08T07:09:18.058346+0000","last_active":"2023-10-08T07:09:18.058942+0000","last_peered":"2023-10-08T07:09:18.058942+0000","last_clean":"2023-10-08T07:09:18.058942+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:09:18.058942+0000","last_undegraded":"2023-10-08T07:09:18.058942+0000","last_fullsized":"2023-10-08T07:09:18.058942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:51.958399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.735671+0000","last_change":"2023-10-08T07:09:17.752745+0000","last_active":"2023-10-08T07:09:19.735671+0000","last_peered":"2023-10-08T07:09:19.735671+0000","last_clean":"2023-10-08T07:09:19.735671+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:09:19.735671+0000","last_undegraded":"2023-10-08T07:09:19.735671+0000","last_fullsized":"2023-10-08T07:09:19.735671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:08.404190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5913,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.458593+0000","last_change":"2023-10-08T07:09:19.458593+0000","last_active":"2023-10-08T07:09:19.458593+0000","last_peered":"2023-10-08T07:09:19.458593+0000","last_clean":"2023-10-08T07:06:36.374435+0000","last_became_active":"2023-10-08T07:09:19.384706+0000","last_became_peered":"2023-10-08T07:09:19.384706+0000","last_unstale":"2023-10-08T07:09:19.458593+0000","last_undegraded":"2023-10-08T07:09:19.458593+0000","last_fullsized":"2023-10-08T07:09:19.045217+0000","mapping_epoch":75,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:27:12.177789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.732500+0000","last_change":"2023-10-08T07:09:17.754898+0000","last_active":"2023-10-08T07:09:19.732500+0000","last_peered":"2023-10-08T07:09:19.732500+0000","last_clean":"2023-10-08T07:09:19.732500+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:09:19.732500+0000","last_undegraded":"2023-10-08T07:09:19.732500+0000","last_fullsized":"2023-10-08T07:09:19.732500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:19.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2928,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.475307+0000","last_change":"2023-10-08T07:09:19.475550+0000","last_active":"2023-10-08T07:09:19.475307+0000","last_peered":"2023-10-08T07:09:19.475307+0000","last_clean":"2023-10-08T07:06:36.119147+0000","last_became_active":"2023-10-08T07:09:19.463362+0000","last_became_peered":"2023-10-08T07:09:19.463362+0000","last_unstale":"2023-10-08T07:09:19.475307+0000","last_undegraded":"2023-10-08T07:09:19.475307+0000","last_fullsized":"2023-10-08T07:09:19.109027+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:59.698365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.058859+0000","last_change":"2023-10-08T07:09:18.057444+0000","last_active":"2023-10-08T07:09:18.058859+0000","last_peered":"2023-10-08T07:09:18.058859+0000","last_clean":"2023-10-08T07:09:18.058859+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:09:18.058859+0000","last_undegraded":"2023-10-08T07:09:18.058859+0000","last_fullsized":"2023-10-08T07:09:18.058859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:06:13.088433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.049595+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:09:18.049595+0000","last_peered":"2023-10-08T07:09:18.049595+0000","last_clean":"2023-10-08T07:09:18.049595+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:09:18.049595+0000","last_undegraded":"2023-10-08T07:09:18.049595+0000","last_fullsized":"2023-10-08T07:09:18.049595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5839,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.735892+0000","last_change":"2023-10-08T07:09:20.735892+0000","last_active":"2023-10-08T07:09:20.735892+0000","last_peered":"2023-10-08T07:09:20.735892+0000","last_clean":"2023-10-08T07:09:20.735892+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:09:20.735892+0000","last_undegraded":"2023-10-08T07:09:20.735892+0000","last_fullsized":"2023-10-08T07:09:20.735892+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:02.889299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.047211+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:09:18.047211+0000","last_peered":"2023-10-08T07:09:18.047211+0000","last_clean":"2023-10-08T07:09:18.047211+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:09:18.047211+0000","last_undegraded":"2023-10-08T07:09:18.047211+0000","last_fullsized":"2023-10-08T07:09:18.047211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046436+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:09:18.046436+0000","last_peered":"2023-10-08T07:09:18.046436+0000","last_clean":"2023-10-08T07:09:18.046436+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:09:18.046436+0000","last_undegraded":"2023-10-08T07:09:18.046436+0000","last_fullsized":"2023-10-08T07:09:18.046436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2936,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.431387+0000","last_change":"2023-10-08T07:09:19.431528+0000","last_active":"2023-10-08T07:09:19.431387+0000","last_peered":"2023-10-08T07:09:19.431387+0000","last_clean":"2023-10-08T07:06:36.118948+0000","last_became_active":"2023-10-08T07:09:19.413904+0000","last_became_peered":"2023-10-08T07:09:19.413904+0000","last_unstale":"2023-10-08T07:09:19.431387+0000","last_undegraded":"2023-10-08T07:09:19.431387+0000","last_fullsized":"2023-10-08T07:09:19.044596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:16.520645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.069045+0000","last_change":"2023-10-08T07:09:18.067783+0000","last_active":"2023-10-08T07:09:18.069045+0000","last_peered":"2023-10-08T07:09:18.069045+0000","last_clean":"2023-10-08T07:09:18.069045+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:09:18.069045+0000","last_undegraded":"2023-10-08T07:09:18.069045+0000","last_fullsized":"2023-10-08T07:09:18.069045+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:11.554943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.732964+0000","last_change":"2023-10-08T07:09:17.752755+0000","last_active":"2023-10-08T07:09:19.732964+0000","last_peered":"2023-10-08T07:09:19.732964+0000","last_clean":"2023-10-08T07:09:19.732964+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:09:19.732964+0000","last_undegraded":"2023-10-08T07:09:19.732964+0000","last_fullsized":"2023-10-08T07:09:19.732964+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:23.696397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8895,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.505139+0000","last_change":"2023-10-08T07:09:19.505139+0000","last_active":"2023-10-08T07:09:19.505139+0000","last_peered":"2023-10-08T07:09:19.505139+0000","last_clean":"2023-10-08T07:06:36.119241+0000","last_became_active":"2023-10-08T07:09:19.501814+0000","last_became_peered":"2023-10-08T07:09:19.501814+0000","last_unstale":"2023-10-08T07:09:19.505139+0000","last_undegraded":"2023-10-08T07:09:19.505139+0000","last_fullsized":"2023-10-08T07:09:19.137461+0000","mapping_epoch":75,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:24:52.521913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046508+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:09:18.046508+0000","last_peered":"2023-10-08T07:09:18.046508+0000","last_clean":"2023-10-08T07:09:18.046508+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:09:18.046508+0000","last_undegraded":"2023-10-08T07:09:18.046508+0000","last_fullsized":"2023-10-08T07:09:18.046508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":283,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.052988+0000","last_change":"2023-10-08T07:09:18.052234+0000","last_active":"2023-10-08T07:09:18.052988+0000","last_peered":"2023-10-08T07:09:18.052988+0000","last_clean":"2023-10-08T07:09:18.052988+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:09:18.052988+0000","last_undegraded":"2023-10-08T07:09:18.052988+0000","last_fullsized":"2023-10-08T07:09:18.052988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:02:56.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.053877+0000","last_change":"2023-10-08T07:09:18.049984+0000","last_active":"2023-10-08T07:09:18.053877+0000","last_peered":"2023-10-08T07:09:18.053877+0000","last_clean":"2023-10-08T07:09:18.053877+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:09:18.053877+0000","last_undegraded":"2023-10-08T07:09:18.053877+0000","last_fullsized":"2023-10-08T07:09:18.053877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:59:20.880943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5880,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.317165+0000","last_change":"2023-10-08T07:09:19.317165+0000","last_active":"2023-10-08T07:09:19.317165+0000","last_peered":"2023-10-08T07:09:19.317165+0000","last_clean":"2023-10-08T07:06:36.374511+0000","last_became_active":"2023-10-08T07:09:19.307667+0000","last_became_peered":"2023-10-08T07:09:19.307667+0000","last_unstale":"2023-10-08T07:09:19.317165+0000","last_undegraded":"2023-10-08T07:09:19.317165+0000","last_fullsized":"2023-10-08T07:09:19.045906+0000","mapping_epoch":75,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:24:52.521913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.052961+0000","last_change":"2023-10-08T07:09:18.051593+0000","last_active":"2023-10-08T07:09:18.052961+0000","last_peered":"2023-10-08T07:09:18.052961+0000","last_clean":"2023-10-08T07:09:18.052961+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:09:18.052961+0000","last_undegraded":"2023-10-08T07:09:18.052961+0000","last_fullsized":"2023-10-08T07:09:18.052961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:34.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":60,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.378273+0000","last_change":"2023-10-08T07:09:19.378273+0000","last_active":"2023-10-08T07:09:19.378273+0000","last_peered":"2023-10-08T07:09:19.378273+0000","last_clean":"2023-10-08T07:09:19.378273+0000","last_became_active":"2023-10-08T07:09:19.361491+0000","last_became_peered":"2023-10-08T07:09:19.361491+0000","last_unstale":"2023-10-08T07:09:19.378273+0000","last_undegraded":"2023-10-08T07:09:19.378273+0000","last_fullsized":"2023-10-08T07:09:19.378273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:41:58.861671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.734424+0000","last_change":"2023-10-08T07:09:17.755079+0000","last_active":"2023-10-08T07:09:19.734424+0000","last_peered":"2023-10-08T07:09:19.734424+0000","last_clean":"2023-10-08T07:09:19.734424+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:09:19.734424+0000","last_undegraded":"2023-10-08T07:09:19.734424+0000","last_fullsized":"2023-10-08T07:09:19.734424+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:12.238239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733384+0000","last_change":"2023-10-08T07:09:17.754844+0000","last_active":"2023-10-08T07:09:19.733384+0000","last_peered":"2023-10-08T07:09:19.733384+0000","last_clean":"2023-10-08T07:09:19.733384+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:19.733384+0000","last_undegraded":"2023-10-08T07:09:19.733384+0000","last_fullsized":"2023-10-08T07:09:19.733384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:12.129220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.057909+0000","last_change":"2023-10-08T07:09:18.056208+0000","last_active":"2023-10-08T07:09:18.057909+0000","last_peered":"2023-10-08T07:09:18.057909+0000","last_clean":"2023-10-08T07:09:18.057909+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:09:18.057909+0000","last_undegraded":"2023-10-08T07:09:18.057909+0000","last_fullsized":"2023-10-08T07:09:18.057909+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:55.549444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733423+0000","last_change":"2023-10-08T07:09:17.753144+0000","last_active":"2023-10-08T07:09:19.733423+0000","last_peered":"2023-10-08T07:09:19.733423+0000","last_clean":"2023-10-08T07:09:19.733423+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:09:19.733423+0000","last_undegraded":"2023-10-08T07:09:19.733423+0000","last_fullsized":"2023-10-08T07:09:19.733423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:25.968547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.061216+0000","last_change":"2023-10-08T07:09:18.059238+0000","last_active":"2023-10-08T07:09:18.061216+0000","last_peered":"2023-10-08T07:09:18.061216+0000","last_clean":"2023-10-08T07:09:18.061216+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:09:18.061216+0000","last_undegraded":"2023-10-08T07:09:18.061216+0000","last_fullsized":"2023-10-08T07:09:18.061216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:32.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.058819+0000","last_change":"2023-10-08T07:09:18.056706+0000","last_active":"2023-10-08T07:09:18.058819+0000","last_peered":"2023-10-08T07:09:18.058819+0000","last_clean":"2023-10-08T07:09:18.058819+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:09:18.058819+0000","last_undegraded":"2023-10-08T07:09:18.058819+0000","last_fullsized":"2023-10-08T07:09:18.058819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:17.258824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2972,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.041404+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:09:18.041404+0000","last_peered":"2023-10-08T07:09:18.041404+0000","last_clean":"2023-10-08T07:09:18.041404+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:18.041404+0000","last_undegraded":"2023-10-08T07:09:18.041404+0000","last_fullsized":"2023-10-08T07:09:18.041404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.055633+0000","last_change":"2023-10-08T07:09:18.054661+0000","last_active":"2023-10-08T07:09:18.055633+0000","last_peered":"2023-10-08T07:09:18.055633+0000","last_clean":"2023-10-08T07:09:18.055633+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:09:18.055633+0000","last_undegraded":"2023-10-08T07:09:18.055633+0000","last_fullsized":"2023-10-08T07:09:18.055633+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:10.492782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"69'9","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046472+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:09:18.046472+0000","last_peered":"2023-10-08T07:09:18.046472+0000","last_clean":"2023-10-08T07:09:18.046472+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:09:18.046472+0000","last_undegraded":"2023-10-08T07:09:18.046472+0000","last_fullsized":"2023-10-08T07:09:18.046472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2950,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.735652+0000","last_change":"2023-10-08T07:09:20.735652+0000","last_active":"2023-10-08T07:09:20.735652+0000","last_peered":"2023-10-08T07:09:20.735652+0000","last_clean":"2023-10-08T07:09:20.735652+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:09:20.735652+0000","last_undegraded":"2023-10-08T07:09:20.735652+0000","last_fullsized":"2023-10-08T07:09:20.735652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:15.857716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.731583+0000","last_change":"2023-10-08T07:09:18.956809+0000","last_active":"2023-10-08T07:09:19.731583+0000","last_peered":"2023-10-08T07:09:19.731583+0000","last_clean":"2023-10-08T07:09:19.731583+0000","last_became_active":"2023-10-08T07:09:18.956436+0000","last_became_peered":"2023-10-08T07:09:18.956436+0000","last_unstale":"2023-10-08T07:09:19.731583+0000","last_undegraded":"2023-10-08T07:09:19.731583+0000","last_fullsized":"2023-10-08T07:09:19.731583+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:02.470882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.735645+0000","last_change":"2023-10-08T07:09:19.111956+0000","last_active":"2023-10-08T07:09:19.735645+0000","last_peered":"2023-10-08T07:09:19.735645+0000","last_clean":"2023-10-08T07:09:19.735645+0000","last_became_active":"2023-10-08T07:09:19.048200+0000","last_became_peered":"2023-10-08T07:09:19.048200+0000","last_unstale":"2023-10-08T07:09:19.735645+0000","last_undegraded":"2023-10-08T07:09:19.735645+0000","last_fullsized":"2023-10-08T07:09:19.735645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:42:25.377588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":61,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.420273+0000","last_change":"2023-10-08T07:09:19.420273+0000","last_active":"2023-10-08T07:09:19.420273+0000","last_peered":"2023-10-08T07:09:19.420273+0000","last_clean":"2023-10-08T07:09:19.420273+0000","last_became_active":"2023-10-08T07:09:19.414648+0000","last_became_peered":"2023-10-08T07:09:19.414648+0000","last_unstale":"2023-10-08T07:09:19.420273+0000","last_undegraded":"2023-10-08T07:09:19.420273+0000","last_fullsized":"2023-10-08T07:09:19.420273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:55.591501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5875,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.045677+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:09:18.045677+0000","last_peered":"2023-10-08T07:09:18.045677+0000","last_clean":"2023-10-08T07:09:18.045677+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:09:18.045677+0000","last_undegraded":"2023-10-08T07:09:18.045677+0000","last_fullsized":"2023-10-08T07:09:18.045677+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733171+0000","last_change":"2023-10-08T07:09:17.753543+0000","last_active":"2023-10-08T07:09:19.733171+0000","last_peered":"2023-10-08T07:09:19.733171+0000","last_clean":"2023-10-08T07:09:19.733171+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:09:19.733171+0000","last_undegraded":"2023-10-08T07:09:19.733171+0000","last_fullsized":"2023-10-08T07:09:19.733171+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:51.956560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":2994,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046435+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:18.046435+0000","last_peered":"2023-10-08T07:09:18.046435+0000","last_clean":"2023-10-08T07:09:18.046435+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:18.046435+0000","last_undegraded":"2023-10-08T07:09:18.046435+0000","last_fullsized":"2023-10-08T07:09:18.046435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.058917+0000","last_change":"2023-10-08T07:09:18.057710+0000","last_active":"2023-10-08T07:09:18.058917+0000","last_peered":"2023-10-08T07:09:18.058917+0000","last_clean":"2023-10-08T07:09:18.058917+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:09:18.058917+0000","last_undegraded":"2023-10-08T07:09:18.058917+0000","last_fullsized":"2023-10-08T07:09:18.058917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:49.694705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5859,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.734404+0000","last_change":"2023-10-08T07:09:20.734404+0000","last_active":"2023-10-08T07:09:20.734404+0000","last_peered":"2023-10-08T07:09:20.734404+0000","last_clean":"2023-10-08T07:09:20.734404+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:09:20.734404+0000","last_undegraded":"2023-10-08T07:09:20.734404+0000","last_fullsized":"2023-10-08T07:09:20.734404+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:04:28.453406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":74,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.049280+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:09:18.049280+0000","last_peered":"2023-10-08T07:09:18.049280+0000","last_clean":"2023-10-08T07:09:18.049280+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:09:18.049280+0000","last_undegraded":"2023-10-08T07:09:18.049280+0000","last_fullsized":"2023-10-08T07:09:18.049280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046622+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:09:18.046622+0000","last_peered":"2023-10-08T07:09:18.046622+0000","last_clean":"2023-10-08T07:09:18.046622+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:09:18.046622+0000","last_undegraded":"2023-10-08T07:09:18.046622+0000","last_fullsized":"2023-10-08T07:09:18.046622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8792,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046482+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:09:18.046482+0000","last_peered":"2023-10-08T07:09:18.046482+0000","last_clean":"2023-10-08T07:09:18.046482+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:09:18.046482+0000","last_undegraded":"2023-10-08T07:09:18.046482+0000","last_fullsized":"2023-10-08T07:09:18.046482+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":2979,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.440647+0000","last_change":"2023-10-08T07:09:19.440851+0000","last_active":"2023-10-08T07:09:19.440647+0000","last_peered":"2023-10-08T07:09:19.440647+0000","last_clean":"2023-10-08T07:06:36.118444+0000","last_became_active":"2023-10-08T07:09:19.426489+0000","last_became_peered":"2023-10-08T07:09:19.426489+0000","last_unstale":"2023-10-08T07:09:19.440647+0000","last_undegraded":"2023-10-08T07:09:19.440647+0000","last_fullsized":"2023-10-08T07:09:19.103235+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:53.288131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.734512+0000","last_change":"2023-10-08T07:09:17.754585+0000","last_active":"2023-10-08T07:09:19.734512+0000","last_peered":"2023-10-08T07:09:19.734512+0000","last_clean":"2023-10-08T07:09:19.734512+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:09:19.734512+0000","last_undegraded":"2023-10-08T07:09:19.734512+0000","last_fullsized":"2023-10-08T07:09:19.734512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:44.969079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.059004+0000","last_change":"2023-10-08T07:09:18.056756+0000","last_active":"2023-10-08T07:09:18.059004+0000","last_peered":"2023-10-08T07:09:18.059004+0000","last_clean":"2023-10-08T07:09:18.059004+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:18.059004+0000","last_undegraded":"2023-10-08T07:09:18.059004+0000","last_fullsized":"2023-10-08T07:09:18.059004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:21:49.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2962,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.735423+0000","last_change":"2023-10-08T07:09:20.735423+0000","last_active":"2023-10-08T07:09:20.735423+0000","last_peered":"2023-10-08T07:09:20.735423+0000","last_clean":"2023-10-08T07:09:20.735423+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:09:20.735423+0000","last_undegraded":"2023-10-08T07:09:20.735423+0000","last_fullsized":"2023-10-08T07:09:20.735423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:52.216576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":115,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":248952,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738418,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":577596,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":576830,"kb_avail":93794244,"statfs":{"total":96636764160,"available":96045305856,"internally_reserved":0,"allocated":770048,"data_stored":311806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":590674375},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":0.57699999999999996,"15min":0.48599999999999999},"min":{"1min":0.217,"5min":0.188,"15min":0.188},"max":{"1min":15.805999999999999,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.2549999999999999,"5min":0.59099999999999997,"15min":0.501},"min":{"1min":0.20300000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":13.827999999999999,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.63200000000000001}]},{"osd":1,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.85099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483776,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93888064,"statfs":{"total":96636764160,"available":96141377536,"internally_reserved":0,"allocated":1630208,"data_stored":1152093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 07:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.53000000000000003,"15min":0.50600000000000001},"min":{"1min":0.20899999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.9350000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.49099999999999999,"15min":0.504},"min":{"1min":0.193,"5min":0.182,"15min":0.182},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.44500000000000001}]}]},{"osd":1,"up_from":74,"seq":317827579906,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65240,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306600,"statfs":{"total":96636764160,"available":96569958400,"internally_reserved":0,"allocated":1642496,"data_stored":1161304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":255507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:09:24.446 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:09:24.821 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:09:24.823 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:09:24.833 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2023-10-08T07:09:24.566636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":8637560,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149186,"ondisk_log_size":149186,"up":210,"acting":197,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1126612,"kb_used_data":3948,"kb_used_omap":8,"kb_used_meta":1122615,"kb_avail":281988908,"statfs":{"total":289910292480,"available":288756641792,"internally_reserved":0,"allocated":4042752,"data_stored":2625203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1149557789},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001019"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":2987,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737777+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:20.737777+0000","last_peered":"2023-10-08T07:09:20.737777+0000","last_clean":"2023-10-08T07:09:20.737777+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:20.737777+0000","last_undegraded":"2023-10-08T07:09:20.737777+0000","last_fullsized":"2023-10-08T07:09:20.737777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:13.308715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2888,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737069+0000","last_change":"2023-10-08T07:09:20.737069+0000","last_active":"2023-10-08T07:09:20.737069+0000","last_peered":"2023-10-08T07:09:20.737069+0000","last_clean":"2023-10-08T07:09:20.737069+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:20.737069+0000","last_undegraded":"2023-10-08T07:09:20.737069+0000","last_fullsized":"2023-10-08T07:09:20.737069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:03.307776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.057444+0000","last_change":"2023-10-08T07:09:18.056834+0000","last_active":"2023-10-08T07:09:18.057444+0000","last_peered":"2023-10-08T07:09:18.057444+0000","last_clean":"2023-10-08T07:09:18.057444+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:09:18.057444+0000","last_undegraded":"2023-10-08T07:09:18.057444+0000","last_fullsized":"2023-10-08T07:09:18.057444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:16.520645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.050770+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:09:18.050770+0000","last_peered":"2023-10-08T07:09:18.050770+0000","last_clean":"2023-10-08T07:09:18.050770+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:09:18.050770+0000","last_undegraded":"2023-10-08T07:09:18.050770+0000","last_fullsized":"2023-10-08T07:09:18.050770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5877,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.736694+0000","last_change":"2023-10-08T07:09:20.736694+0000","last_active":"2023-10-08T07:09:20.736694+0000","last_peered":"2023-10-08T07:09:20.736694+0000","last_clean":"2023-10-08T07:09:20.736694+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:09:20.736694+0000","last_undegraded":"2023-10-08T07:09:20.736694+0000","last_fullsized":"2023-10-08T07:09:20.736694+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:19:45.353931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8556,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046087+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:09:18.046087+0000","last_peered":"2023-10-08T07:09:18.046087+0000","last_clean":"2023-10-08T07:09:18.046087+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:09:18.046087+0000","last_undegraded":"2023-10-08T07:09:18.046087+0000","last_fullsized":"2023-10-08T07:09:18.046087+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":69,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.045176+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:09:18.045176+0000","last_peered":"2023-10-08T07:09:18.045176+0000","last_clean":"2023-10-08T07:09:18.045176+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:18.045176+0000","last_undegraded":"2023-10-08T07:09:18.045176+0000","last_fullsized":"2023-10-08T07:09:18.045176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3001,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.443345+0000","last_change":"2023-10-08T07:09:19.443561+0000","last_active":"2023-10-08T07:09:19.443345+0000","last_peered":"2023-10-08T07:09:19.443345+0000","last_clean":"2023-10-08T07:09:16.034807+0000","last_became_active":"2023-10-08T07:09:19.371254+0000","last_became_peered":"2023-10-08T07:09:19.371254+0000","last_unstale":"2023-10-08T07:09:19.443345+0000","last_undegraded":"2023-10-08T07:09:19.443345+0000","last_fullsized":"2023-10-08T07:09:19.044784+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:56.596378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2861,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.468141+0000","last_change":"2023-10-08T07:09:19.468334+0000","last_active":"2023-10-08T07:09:19.468141+0000","last_peered":"2023-10-08T07:09:19.468141+0000","last_clean":"2023-10-08T07:06:36.118964+0000","last_became_active":"2023-10-08T07:09:19.461967+0000","last_became_peered":"2023-10-08T07:09:19.461967+0000","last_unstale":"2023-10-08T07:09:19.468141+0000","last_undegraded":"2023-10-08T07:09:19.468141+0000","last_fullsized":"2023-10-08T07:09:19.044223+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:48.580026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2944,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737658+0000","last_change":"2023-10-08T07:09:20.737658+0000","last_active":"2023-10-08T07:09:20.737658+0000","last_peered":"2023-10-08T07:09:20.737658+0000","last_clean":"2023-10-08T07:09:20.737658+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:09:20.737658+0000","last_undegraded":"2023-10-08T07:09:20.737658+0000","last_fullsized":"2023-10-08T07:09:20.737658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:36.077873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":49,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.138312+0000","last_change":"2023-10-08T07:09:19.138312+0000","last_active":"2023-10-08T07:09:19.138312+0000","last_peered":"2023-10-08T07:09:19.138312+0000","last_clean":"2023-10-08T07:09:19.138312+0000","last_became_active":"2023-10-08T07:09:19.137923+0000","last_became_peered":"2023-10-08T07:09:19.137923+0000","last_unstale":"2023-10-08T07:09:19.138312+0000","last_undegraded":"2023-10-08T07:09:19.138312+0000","last_fullsized":"2023-10-08T07:09:19.138312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:16.510675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2949,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.736199+0000","last_change":"2023-10-08T07:09:20.736199+0000","last_active":"2023-10-08T07:09:20.736199+0000","last_peered":"2023-10-08T07:09:20.736199+0000","last_clean":"2023-10-08T07:09:20.736199+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:20.736199+0000","last_undegraded":"2023-10-08T07:09:20.736199+0000","last_fullsized":"2023-10-08T07:09:20.736199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.663562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733557+0000","last_change":"2023-10-08T07:09:17.754638+0000","last_active":"2023-10-08T07:09:19.733557+0000","last_peered":"2023-10-08T07:09:19.733557+0000","last_clean":"2023-10-08T07:09:19.733557+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:09:19.733557+0000","last_undegraded":"2023-10-08T07:09:19.733557+0000","last_fullsized":"2023-10-08T07:09:19.733557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:12.379792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2955,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.401297+0000","last_change":"2023-10-08T07:09:19.401477+0000","last_active":"2023-10-08T07:09:19.401297+0000","last_peered":"2023-10-08T07:09:19.401297+0000","last_clean":"2023-10-08T07:06:36.374068+0000","last_became_active":"2023-10-08T07:09:19.336996+0000","last_became_peered":"2023-10-08T07:09:19.336996+0000","last_unstale":"2023-10-08T07:09:19.401297+0000","last_undegraded":"2023-10-08T07:09:19.401297+0000","last_fullsized":"2023-10-08T07:09:19.044824+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:16:51.222173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5838,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.729885+0000","last_change":"2023-10-08T07:09:19.751084+0000","last_active":"2023-10-08T07:09:20.729885+0000","last_peered":"2023-10-08T07:09:20.729885+0000","last_clean":"2023-10-08T07:09:20.729885+0000","last_became_active":"2023-10-08T07:09:19.750211+0000","last_became_peered":"2023-10-08T07:09:19.750211+0000","last_unstale":"2023-10-08T07:09:20.729885+0000","last_undegraded":"2023-10-08T07:09:20.729885+0000","last_fullsized":"2023-10-08T07:09:20.729885+0000","mapping_epoch":76,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:30.610684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2967,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046334+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:09:18.046334+0000","last_peered":"2023-10-08T07:09:18.046334+0000","last_clean":"2023-10-08T07:09:18.046334+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:09:18.046334+0000","last_undegraded":"2023-10-08T07:09:18.046334+0000","last_fullsized":"2023-10-08T07:09:18.046334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2959,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.480930+0000","last_change":"2023-10-08T07:09:19.481145+0000","last_active":"2023-10-08T07:09:19.480930+0000","last_peered":"2023-10-08T07:09:19.480930+0000","last_clean":"2023-10-08T07:06:36.119029+0000","last_became_active":"2023-10-08T07:09:19.463563+0000","last_became_peered":"2023-10-08T07:09:19.463563+0000","last_unstale":"2023-10-08T07:09:19.480930+0000","last_undegraded":"2023-10-08T07:09:19.480930+0000","last_fullsized":"2023-10-08T07:09:19.103041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:23:49.964864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733596+0000","last_change":"2023-10-08T07:09:17.754747+0000","last_active":"2023-10-08T07:09:19.733596+0000","last_peered":"2023-10-08T07:09:19.733596+0000","last_clean":"2023-10-08T07:09:19.733596+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:09:19.733596+0000","last_undegraded":"2023-10-08T07:09:19.733596+0000","last_fullsized":"2023-10-08T07:09:19.733596+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:47.075369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2940,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.346576+0000","last_change":"2023-10-08T07:09:19.346806+0000","last_active":"2023-10-08T07:09:19.346576+0000","last_peered":"2023-10-08T07:09:19.346576+0000","last_clean":"2023-10-08T07:06:36.118970+0000","last_became_active":"2023-10-08T07:09:19.316021+0000","last_became_peered":"2023-10-08T07:09:19.316021+0000","last_unstale":"2023-10-08T07:09:19.346576+0000","last_undegraded":"2023-10-08T07:09:19.346576+0000","last_fullsized":"2023-10-08T07:09:19.046880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:01.783452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2958,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.050640+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:09:18.050640+0000","last_peered":"2023-10-08T07:09:18.050640+0000","last_clean":"2023-10-08T07:09:18.050640+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:09:18.050640+0000","last_undegraded":"2023-10-08T07:09:18.050640+0000","last_fullsized":"2023-10-08T07:09:18.050640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5877,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.045645+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:09:18.045645+0000","last_peered":"2023-10-08T07:09:18.045645+0000","last_clean":"2023-10-08T07:09:18.045645+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:09:18.045645+0000","last_undegraded":"2023-10-08T07:09:18.045645+0000","last_fullsized":"2023-10-08T07:09:18.045645+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2864,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.735818+0000","last_change":"2023-10-08T07:09:20.735818+0000","last_active":"2023-10-08T07:09:20.735818+0000","last_peered":"2023-10-08T07:09:20.735818+0000","last_clean":"2023-10-08T07:09:20.735818+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:09:20.735818+0000","last_undegraded":"2023-10-08T07:09:20.735818+0000","last_fullsized":"2023-10-08T07:09:20.735818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:56.874136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2966,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.051445+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:09:18.051445+0000","last_peered":"2023-10-08T07:09:18.051445+0000","last_clean":"2023-10-08T07:09:18.051445+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:18.051445+0000","last_undegraded":"2023-10-08T07:09:18.051445+0000","last_fullsized":"2023-10-08T07:09:18.051445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5825,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.736822+0000","last_change":"2023-10-08T07:09:20.736822+0000","last_active":"2023-10-08T07:09:20.736822+0000","last_peered":"2023-10-08T07:09:20.736822+0000","last_clean":"2023-10-08T07:09:20.736822+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:20.736822+0000","last_undegraded":"2023-10-08T07:09:20.736822+0000","last_fullsized":"2023-10-08T07:09:20.736822+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:19.752508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2944,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.735845+0000","last_change":"2023-10-08T07:09:20.735845+0000","last_active":"2023-10-08T07:09:20.735845+0000","last_peered":"2023-10-08T07:09:20.735845+0000","last_clean":"2023-10-08T07:09:20.735845+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:09:20.735845+0000","last_undegraded":"2023-10-08T07:09:20.735845+0000","last_fullsized":"2023-10-08T07:09:20.735845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.084033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2959,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.047945+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:09:18.047945+0000","last_peered":"2023-10-08T07:09:18.047945+0000","last_clean":"2023-10-08T07:09:18.047945+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:09:18.047945+0000","last_undegraded":"2023-10-08T07:09:18.047945+0000","last_fullsized":"2023-10-08T07:09:18.047945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.056731+0000","last_change":"2023-10-08T07:09:18.055530+0000","last_active":"2023-10-08T07:09:18.056731+0000","last_peered":"2023-10-08T07:09:18.056731+0000","last_clean":"2023-10-08T07:09:18.056731+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:18.056731+0000","last_undegraded":"2023-10-08T07:09:18.056731+0000","last_fullsized":"2023-10-08T07:09:18.056731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:01.783452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.732182+0000","last_change":"2023-10-08T07:09:17.751957+0000","last_active":"2023-10-08T07:09:19.732182+0000","last_peered":"2023-10-08T07:09:19.732182+0000","last_clean":"2023-10-08T07:09:19.732182+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:09:19.732182+0000","last_undegraded":"2023-10-08T07:09:19.732182+0000","last_fullsized":"2023-10-08T07:09:19.732182+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:13.104739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733498+0000","last_change":"2023-10-08T07:09:17.754513+0000","last_active":"2023-10-08T07:09:19.733498+0000","last_peered":"2023-10-08T07:09:19.733498+0000","last_clean":"2023-10-08T07:09:19.733498+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:19.733498+0000","last_undegraded":"2023-10-08T07:09:19.733498+0000","last_fullsized":"2023-10-08T07:09:19.733498+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:06.336414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.051943+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:09:18.051943+0000","last_peered":"2023-10-08T07:09:18.051943+0000","last_clean":"2023-10-08T07:09:18.051943+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:09:18.051943+0000","last_undegraded":"2023-10-08T07:09:18.051943+0000","last_fullsized":"2023-10-08T07:09:18.051943+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046679+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:09:18.046679+0000","last_peered":"2023-10-08T07:09:18.046679+0000","last_clean":"2023-10-08T07:09:18.046679+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:09:18.046679+0000","last_undegraded":"2023-10-08T07:09:18.046679+0000","last_fullsized":"2023-10-08T07:09:18.046679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.057414+0000","last_change":"2023-10-08T07:09:18.055607+0000","last_active":"2023-10-08T07:09:18.057414+0000","last_peered":"2023-10-08T07:09:18.057414+0000","last_clean":"2023-10-08T07:09:18.057414+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:09:18.057414+0000","last_undegraded":"2023-10-08T07:09:18.057414+0000","last_fullsized":"2023-10-08T07:09:18.057414+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:09.952089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3013,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737162+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:20.737162+0000","last_peered":"2023-10-08T07:09:20.737162+0000","last_clean":"2023-10-08T07:09:20.737162+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:20.737162+0000","last_undegraded":"2023-10-08T07:09:20.737162+0000","last_fullsized":"2023-10-08T07:09:20.737162+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:30.753981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.049422+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:09:18.049422+0000","last_peered":"2023-10-08T07:09:18.049422+0000","last_clean":"2023-10-08T07:09:18.049422+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:18.049422+0000","last_undegraded":"2023-10-08T07:09:18.049422+0000","last_fullsized":"2023-10-08T07:09:18.049422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5803,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.456422+0000","last_change":"2023-10-08T07:09:19.456422+0000","last_active":"2023-10-08T07:09:19.456422+0000","last_peered":"2023-10-08T07:09:19.456422+0000","last_clean":"2023-10-08T07:06:36.118430+0000","last_became_active":"2023-10-08T07:09:19.380282+0000","last_became_peered":"2023-10-08T07:09:19.380282+0000","last_unstale":"2023-10-08T07:09:19.456422+0000","last_undegraded":"2023-10-08T07:09:19.456422+0000","last_fullsized":"2023-10-08T07:09:19.042669+0000","mapping_epoch":75,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:58:38.303498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.047437+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:18.047437+0000","last_peered":"2023-10-08T07:09:18.047437+0000","last_clean":"2023-10-08T07:09:18.047437+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:18.047437+0000","last_undegraded":"2023-10-08T07:09:18.047437+0000","last_fullsized":"2023-10-08T07:09:18.047437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2926,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.052058+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:09:18.052058+0000","last_peered":"2023-10-08T07:09:18.052058+0000","last_clean":"2023-10-08T07:09:18.052058+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:09:18.052058+0000","last_undegraded":"2023-10-08T07:09:18.052058+0000","last_fullsized":"2023-10-08T07:09:18.052058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"67'7","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733072+0000","last_change":"2023-10-08T07:09:17.758979+0000","last_active":"2023-10-08T07:09:19.733072+0000","last_peered":"2023-10-08T07:09:19.733072+0000","last_clean":"2023-10-08T07:09:19.733072+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:09:19.733072+0000","last_undegraded":"2023-10-08T07:09:19.733072+0000","last_fullsized":"2023-10-08T07:09:19.733072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:06.386900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":90,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.065354+0000","last_change":"2023-10-08T07:09:18.064856+0000","last_active":"2023-10-08T07:09:18.065354+0000","last_peered":"2023-10-08T07:09:18.065354+0000","last_clean":"2023-10-08T07:09:18.065354+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:18.065354+0000","last_undegraded":"2023-10-08T07:09:18.065354+0000","last_fullsized":"2023-10-08T07:09:18.065354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.230654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":174,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.064871+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:18.064871+0000","last_peered":"2023-10-08T07:09:18.064871+0000","last_clean":"2023-10-08T07:09:18.064871+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:18.064871+0000","last_undegraded":"2023-10-08T07:09:18.064871+0000","last_fullsized":"2023-10-08T07:09:18.064871+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2926,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.451297+0000","last_change":"2023-10-08T07:09:19.451457+0000","last_active":"2023-10-08T07:09:19.451297+0000","last_peered":"2023-10-08T07:09:19.451297+0000","last_clean":"2023-10-08T07:06:36.374313+0000","last_became_active":"2023-10-08T07:09:19.353141+0000","last_became_peered":"2023-10-08T07:09:19.353141+0000","last_unstale":"2023-10-08T07:09:19.451297+0000","last_undegraded":"2023-10-08T07:09:19.451297+0000","last_fullsized":"2023-10-08T07:09:19.044824+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:59.698365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":72,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.048102+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:09:18.048102+0000","last_peered":"2023-10-08T07:09:18.048102+0000","last_clean":"2023-10-08T07:09:18.048102+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:09:18.048102+0000","last_undegraded":"2023-10-08T07:09:18.048102+0000","last_fullsized":"2023-10-08T07:09:18.048102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2931,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737135+0000","last_change":"2023-10-08T07:09:20.737135+0000","last_active":"2023-10-08T07:09:20.737135+0000","last_peered":"2023-10-08T07:09:20.737135+0000","last_clean":"2023-10-08T07:09:20.737135+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:09:20.737135+0000","last_undegraded":"2023-10-08T07:09:20.737135+0000","last_fullsized":"2023-10-08T07:09:20.737135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:52.474047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.042602+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:09:18.042602+0000","last_peered":"2023-10-08T07:09:18.042602+0000","last_clean":"2023-10-08T07:09:18.042602+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:09:18.042602+0000","last_undegraded":"2023-10-08T07:09:18.042602+0000","last_fullsized":"2023-10-08T07:09:18.042602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8810,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737857+0000","last_change":"2023-10-08T07:09:20.737857+0000","last_active":"2023-10-08T07:09:20.737857+0000","last_peered":"2023-10-08T07:09:20.737857+0000","last_clean":"2023-10-08T07:09:20.737857+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:09:20.737857+0000","last_undegraded":"2023-10-08T07:09:20.737857+0000","last_fullsized":"2023-10-08T07:09:20.737857+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:56.740198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.734699+0000","last_change":"2023-10-08T07:09:17.751068+0000","last_active":"2023-10-08T07:09:19.734699+0000","last_peered":"2023-10-08T07:09:19.734699+0000","last_clean":"2023-10-08T07:09:19.734699+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:09:19.734699+0000","last_undegraded":"2023-10-08T07:09:19.734699+0000","last_fullsized":"2023-10-08T07:09:19.734699+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:15.155530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2909,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.047453+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:09:18.047453+0000","last_peered":"2023-10-08T07:09:18.047453+0000","last_clean":"2023-10-08T07:09:18.047453+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:09:18.047453+0000","last_undegraded":"2023-10-08T07:09:18.047453+0000","last_fullsized":"2023-10-08T07:09:18.047453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'9","reported_seq":91,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.055946+0000","last_change":"2023-10-08T07:09:18.054836+0000","last_active":"2023-10-08T07:09:18.055946+0000","last_peered":"2023-10-08T07:09:18.055946+0000","last_clean":"2023-10-08T07:09:18.055946+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:09:18.055946+0000","last_undegraded":"2023-10-08T07:09:18.055946+0000","last_fullsized":"2023-10-08T07:09:18.055946+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:16.567958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":69,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.050042+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:09:18.050042+0000","last_peered":"2023-10-08T07:09:18.050042+0000","last_clean":"2023-10-08T07:09:18.050042+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:09:18.050042+0000","last_undegraded":"2023-10-08T07:09:18.050042+0000","last_fullsized":"2023-10-08T07:09:18.050042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.057428+0000","last_change":"2023-10-08T07:09:18.056757+0000","last_active":"2023-10-08T07:09:18.057428+0000","last_peered":"2023-10-08T07:09:18.057428+0000","last_clean":"2023-10-08T07:09:18.057428+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:09:18.057428+0000","last_undegraded":"2023-10-08T07:09:18.057428+0000","last_fullsized":"2023-10-08T07:09:18.057428+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:47.575148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.732360+0000","last_change":"2023-10-08T07:09:17.753129+0000","last_active":"2023-10-08T07:09:19.732360+0000","last_peered":"2023-10-08T07:09:19.732360+0000","last_clean":"2023-10-08T07:09:19.732360+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:09:19.732360+0000","last_undegraded":"2023-10-08T07:09:19.732360+0000","last_fullsized":"2023-10-08T07:09:19.732360+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:53.133780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.735034+0000","last_change":"2023-10-08T07:09:17.753124+0000","last_active":"2023-10-08T07:09:19.735034+0000","last_peered":"2023-10-08T07:09:19.735034+0000","last_clean":"2023-10-08T07:09:19.735034+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:09:19.735034+0000","last_undegraded":"2023-10-08T07:09:19.735034+0000","last_fullsized":"2023-10-08T07:09:19.735034+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.689880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":2988,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.737843+0000","last_change":"2023-10-08T07:09:20.737843+0000","last_active":"2023-10-08T07:09:20.737843+0000","last_peered":"2023-10-08T07:09:20.737843+0000","last_clean":"2023-10-08T07:09:20.737843+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:09:20.737843+0000","last_undegraded":"2023-10-08T07:09:20.737843+0000","last_fullsized":"2023-10-08T07:09:20.737843+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:58.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.057772+0000","last_change":"2023-10-08T07:09:18.057034+0000","last_active":"2023-10-08T07:09:18.057772+0000","last_peered":"2023-10-08T07:09:18.057772+0000","last_clean":"2023-10-08T07:09:18.057772+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:09:18.057772+0000","last_undegraded":"2023-10-08T07:09:18.057772+0000","last_fullsized":"2023-10-08T07:09:18.057772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:42.006586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2932,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046540+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:09:18.046540+0000","last_peered":"2023-10-08T07:09:18.046540+0000","last_clean":"2023-10-08T07:09:18.046540+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:09:18.046540+0000","last_undegraded":"2023-10-08T07:09:18.046540+0000","last_fullsized":"2023-10-08T07:09:18.046540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.047707+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:18.047707+0000","last_peered":"2023-10-08T07:09:18.047707+0000","last_clean":"2023-10-08T07:09:18.047707+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:18.047707+0000","last_undegraded":"2023-10-08T07:09:18.047707+0000","last_fullsized":"2023-10-08T07:09:18.047707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":2977,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.043030+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:09:18.043030+0000","last_peered":"2023-10-08T07:09:18.043030+0000","last_clean":"2023-10-08T07:09:18.043030+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:18.043030+0000","last_undegraded":"2023-10-08T07:09:18.043030+0000","last_fullsized":"2023-10-08T07:09:18.043030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'3","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.042807+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:09:18.042807+0000","last_peered":"2023-10-08T07:09:18.042807+0000","last_clean":"2023-10-08T07:09:18.042807+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:09:18.042807+0000","last_undegraded":"2023-10-08T07:09:18.042807+0000","last_fullsized":"2023-10-08T07:09:18.042807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5915,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.047832+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:09:18.047832+0000","last_peered":"2023-10-08T07:09:18.047832+0000","last_clean":"2023-10-08T07:09:18.047832+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:18.047832+0000","last_undegraded":"2023-10-08T07:09:18.047832+0000","last_fullsized":"2023-10-08T07:09:18.047832+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046312+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:09:18.046312+0000","last_peered":"2023-10-08T07:09:18.046312+0000","last_clean":"2023-10-08T07:09:18.046312+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:09:18.046312+0000","last_undegraded":"2023-10-08T07:09:18.046312+0000","last_fullsized":"2023-10-08T07:09:18.046312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.058942+0000","last_change":"2023-10-08T07:09:18.058346+0000","last_active":"2023-10-08T07:09:18.058942+0000","last_peered":"2023-10-08T07:09:18.058942+0000","last_clean":"2023-10-08T07:09:18.058942+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:09:18.058942+0000","last_undegraded":"2023-10-08T07:09:18.058942+0000","last_fullsized":"2023-10-08T07:09:18.058942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:51.958399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.735671+0000","last_change":"2023-10-08T07:09:17.752745+0000","last_active":"2023-10-08T07:09:19.735671+0000","last_peered":"2023-10-08T07:09:19.735671+0000","last_clean":"2023-10-08T07:09:19.735671+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:09:19.735671+0000","last_undegraded":"2023-10-08T07:09:19.735671+0000","last_fullsized":"2023-10-08T07:09:19.735671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:08.404190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5913,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.458593+0000","last_change":"2023-10-08T07:09:19.458593+0000","last_active":"2023-10-08T07:09:19.458593+0000","last_peered":"2023-10-08T07:09:19.458593+0000","last_clean":"2023-10-08T07:06:36.374435+0000","last_became_active":"2023-10-08T07:09:19.384706+0000","last_became_peered":"2023-10-08T07:09:19.384706+0000","last_unstale":"2023-10-08T07:09:19.458593+0000","last_undegraded":"2023-10-08T07:09:19.458593+0000","last_fullsized":"2023-10-08T07:09:19.045217+0000","mapping_epoch":75,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:27:12.177789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.732500+0000","last_change":"2023-10-08T07:09:17.754898+0000","last_active":"2023-10-08T07:09:19.732500+0000","last_peered":"2023-10-08T07:09:19.732500+0000","last_clean":"2023-10-08T07:09:19.732500+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:09:19.732500+0000","last_undegraded":"2023-10-08T07:09:19.732500+0000","last_fullsized":"2023-10-08T07:09:19.732500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:19.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2928,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.475307+0000","last_change":"2023-10-08T07:09:19.475550+0000","last_active":"2023-10-08T07:09:19.475307+0000","last_peered":"2023-10-08T07:09:19.475307+0000","last_clean":"2023-10-08T07:06:36.119147+0000","last_became_active":"2023-10-08T07:09:19.463362+0000","last_became_peered":"2023-10-08T07:09:19.463362+0000","last_unstale":"2023-10-08T07:09:19.475307+0000","last_undegraded":"2023-10-08T07:09:19.475307+0000","last_fullsized":"2023-10-08T07:09:19.109027+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:59.698365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.058859+0000","last_change":"2023-10-08T07:09:18.057444+0000","last_active":"2023-10-08T07:09:18.058859+0000","last_peered":"2023-10-08T07:09:18.058859+0000","last_clean":"2023-10-08T07:09:18.058859+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:09:18.058859+0000","last_undegraded":"2023-10-08T07:09:18.058859+0000","last_fullsized":"2023-10-08T07:09:18.058859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:06:13.088433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.049595+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:09:18.049595+0000","last_peered":"2023-10-08T07:09:18.049595+0000","last_clean":"2023-10-08T07:09:18.049595+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:09:18.049595+0000","last_undegraded":"2023-10-08T07:09:18.049595+0000","last_fullsized":"2023-10-08T07:09:18.049595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5839,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.735892+0000","last_change":"2023-10-08T07:09:20.735892+0000","last_active":"2023-10-08T07:09:20.735892+0000","last_peered":"2023-10-08T07:09:20.735892+0000","last_clean":"2023-10-08T07:09:20.735892+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:09:20.735892+0000","last_undegraded":"2023-10-08T07:09:20.735892+0000","last_fullsized":"2023-10-08T07:09:20.735892+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:02.889299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.047211+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:09:18.047211+0000","last_peered":"2023-10-08T07:09:18.047211+0000","last_clean":"2023-10-08T07:09:18.047211+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:09:18.047211+0000","last_undegraded":"2023-10-08T07:09:18.047211+0000","last_fullsized":"2023-10-08T07:09:18.047211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046436+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:09:18.046436+0000","last_peered":"2023-10-08T07:09:18.046436+0000","last_clean":"2023-10-08T07:09:18.046436+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:09:18.046436+0000","last_undegraded":"2023-10-08T07:09:18.046436+0000","last_fullsized":"2023-10-08T07:09:18.046436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2936,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.431387+0000","last_change":"2023-10-08T07:09:19.431528+0000","last_active":"2023-10-08T07:09:19.431387+0000","last_peered":"2023-10-08T07:09:19.431387+0000","last_clean":"2023-10-08T07:06:36.118948+0000","last_became_active":"2023-10-08T07:09:19.413904+0000","last_became_peered":"2023-10-08T07:09:19.413904+0000","last_unstale":"2023-10-08T07:09:19.431387+0000","last_undegraded":"2023-10-08T07:09:19.431387+0000","last_fullsized":"2023-10-08T07:09:19.044596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:16.520645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.069045+0000","last_change":"2023-10-08T07:09:18.067783+0000","last_active":"2023-10-08T07:09:18.069045+0000","last_peered":"2023-10-08T07:09:18.069045+0000","last_clean":"2023-10-08T07:09:18.069045+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:09:18.069045+0000","last_undegraded":"2023-10-08T07:09:18.069045+0000","last_fullsized":"2023-10-08T07:09:18.069045+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:11.554943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.732964+0000","last_change":"2023-10-08T07:09:17.752755+0000","last_active":"2023-10-08T07:09:19.732964+0000","last_peered":"2023-10-08T07:09:19.732964+0000","last_clean":"2023-10-08T07:09:19.732964+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:09:19.732964+0000","last_undegraded":"2023-10-08T07:09:19.732964+0000","last_fullsized":"2023-10-08T07:09:19.732964+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:23.696397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8895,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.505139+0000","last_change":"2023-10-08T07:09:19.505139+0000","last_active":"2023-10-08T07:09:19.505139+0000","last_peered":"2023-10-08T07:09:19.505139+0000","last_clean":"2023-10-08T07:06:36.119241+0000","last_became_active":"2023-10-08T07:09:19.501814+0000","last_became_peered":"2023-10-08T07:09:19.501814+0000","last_unstale":"2023-10-08T07:09:19.505139+0000","last_undegraded":"2023-10-08T07:09:19.505139+0000","last_fullsized":"2023-10-08T07:09:19.137461+0000","mapping_epoch":75,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:24:52.521913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046508+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:09:18.046508+0000","last_peered":"2023-10-08T07:09:18.046508+0000","last_clean":"2023-10-08T07:09:18.046508+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:09:18.046508+0000","last_undegraded":"2023-10-08T07:09:18.046508+0000","last_fullsized":"2023-10-08T07:09:18.046508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":283,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.052988+0000","last_change":"2023-10-08T07:09:18.052234+0000","last_active":"2023-10-08T07:09:18.052988+0000","last_peered":"2023-10-08T07:09:18.052988+0000","last_clean":"2023-10-08T07:09:18.052988+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:09:18.052988+0000","last_undegraded":"2023-10-08T07:09:18.052988+0000","last_fullsized":"2023-10-08T07:09:18.052988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:02:56.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.053877+0000","last_change":"2023-10-08T07:09:18.049984+0000","last_active":"2023-10-08T07:09:18.053877+0000","last_peered":"2023-10-08T07:09:18.053877+0000","last_clean":"2023-10-08T07:09:18.053877+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:09:18.053877+0000","last_undegraded":"2023-10-08T07:09:18.053877+0000","last_fullsized":"2023-10-08T07:09:18.053877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:59:20.880943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5880,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.317165+0000","last_change":"2023-10-08T07:09:19.317165+0000","last_active":"2023-10-08T07:09:19.317165+0000","last_peered":"2023-10-08T07:09:19.317165+0000","last_clean":"2023-10-08T07:06:36.374511+0000","last_became_active":"2023-10-08T07:09:19.307667+0000","last_became_peered":"2023-10-08T07:09:19.307667+0000","last_unstale":"2023-10-08T07:09:19.317165+0000","last_undegraded":"2023-10-08T07:09:19.317165+0000","last_fullsized":"2023-10-08T07:09:19.045906+0000","mapping_epoch":75,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:24:52.521913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.052961+0000","last_change":"2023-10-08T07:09:18.051593+0000","last_active":"2023-10-08T07:09:18.052961+0000","last_peered":"2023-10-08T07:09:18.052961+0000","last_clean":"2023-10-08T07:09:18.052961+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:09:18.052961+0000","last_undegraded":"2023-10-08T07:09:18.052961+0000","last_fullsized":"2023-10-08T07:09:18.052961+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:34.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":60,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.378273+0000","last_change":"2023-10-08T07:09:19.378273+0000","last_active":"2023-10-08T07:09:19.378273+0000","last_peered":"2023-10-08T07:09:19.378273+0000","last_clean":"2023-10-08T07:09:19.378273+0000","last_became_active":"2023-10-08T07:09:19.361491+0000","last_became_peered":"2023-10-08T07:09:19.361491+0000","last_unstale":"2023-10-08T07:09:19.378273+0000","last_undegraded":"2023-10-08T07:09:19.378273+0000","last_fullsized":"2023-10-08T07:09:19.378273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:41:58.861671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.734424+0000","last_change":"2023-10-08T07:09:17.755079+0000","last_active":"2023-10-08T07:09:19.734424+0000","last_peered":"2023-10-08T07:09:19.734424+0000","last_clean":"2023-10-08T07:09:19.734424+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:09:19.734424+0000","last_undegraded":"2023-10-08T07:09:19.734424+0000","last_fullsized":"2023-10-08T07:09:19.734424+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:12.238239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733384+0000","last_change":"2023-10-08T07:09:17.754844+0000","last_active":"2023-10-08T07:09:19.733384+0000","last_peered":"2023-10-08T07:09:19.733384+0000","last_clean":"2023-10-08T07:09:19.733384+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:19.733384+0000","last_undegraded":"2023-10-08T07:09:19.733384+0000","last_fullsized":"2023-10-08T07:09:19.733384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:12.129220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.057909+0000","last_change":"2023-10-08T07:09:18.056208+0000","last_active":"2023-10-08T07:09:18.057909+0000","last_peered":"2023-10-08T07:09:18.057909+0000","last_clean":"2023-10-08T07:09:18.057909+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:09:18.057909+0000","last_undegraded":"2023-10-08T07:09:18.057909+0000","last_fullsized":"2023-10-08T07:09:18.057909+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:55.549444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733423+0000","last_change":"2023-10-08T07:09:17.753144+0000","last_active":"2023-10-08T07:09:19.733423+0000","last_peered":"2023-10-08T07:09:19.733423+0000","last_clean":"2023-10-08T07:09:19.733423+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:09:19.733423+0000","last_undegraded":"2023-10-08T07:09:19.733423+0000","last_fullsized":"2023-10-08T07:09:19.733423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:25.968547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.061216+0000","last_change":"2023-10-08T07:09:18.059238+0000","last_active":"2023-10-08T07:09:18.061216+0000","last_peered":"2023-10-08T07:09:18.061216+0000","last_clean":"2023-10-08T07:09:18.061216+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:09:18.061216+0000","last_undegraded":"2023-10-08T07:09:18.061216+0000","last_fullsized":"2023-10-08T07:09:18.061216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:32.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.058819+0000","last_change":"2023-10-08T07:09:18.056706+0000","last_active":"2023-10-08T07:09:18.058819+0000","last_peered":"2023-10-08T07:09:18.058819+0000","last_clean":"2023-10-08T07:09:18.058819+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:09:18.058819+0000","last_undegraded":"2023-10-08T07:09:18.058819+0000","last_fullsized":"2023-10-08T07:09:18.058819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:17.258824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2972,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.041404+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:09:18.041404+0000","last_peered":"2023-10-08T07:09:18.041404+0000","last_clean":"2023-10-08T07:09:18.041404+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:18.041404+0000","last_undegraded":"2023-10-08T07:09:18.041404+0000","last_fullsized":"2023-10-08T07:09:18.041404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.055633+0000","last_change":"2023-10-08T07:09:18.054661+0000","last_active":"2023-10-08T07:09:18.055633+0000","last_peered":"2023-10-08T07:09:18.055633+0000","last_clean":"2023-10-08T07:09:18.055633+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:09:18.055633+0000","last_undegraded":"2023-10-08T07:09:18.055633+0000","last_fullsized":"2023-10-08T07:09:18.055633+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:10.492782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"69'9","reported_seq":79,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046472+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:09:18.046472+0000","last_peered":"2023-10-08T07:09:18.046472+0000","last_clean":"2023-10-08T07:09:18.046472+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:09:18.046472+0000","last_undegraded":"2023-10-08T07:09:18.046472+0000","last_fullsized":"2023-10-08T07:09:18.046472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2950,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.735652+0000","last_change":"2023-10-08T07:09:20.735652+0000","last_active":"2023-10-08T07:09:20.735652+0000","last_peered":"2023-10-08T07:09:20.735652+0000","last_clean":"2023-10-08T07:09:20.735652+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:09:20.735652+0000","last_undegraded":"2023-10-08T07:09:20.735652+0000","last_fullsized":"2023-10-08T07:09:20.735652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:15.857716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.731583+0000","last_change":"2023-10-08T07:09:18.956809+0000","last_active":"2023-10-08T07:09:19.731583+0000","last_peered":"2023-10-08T07:09:19.731583+0000","last_clean":"2023-10-08T07:09:19.731583+0000","last_became_active":"2023-10-08T07:09:18.956436+0000","last_became_peered":"2023-10-08T07:09:18.956436+0000","last_unstale":"2023-10-08T07:09:19.731583+0000","last_undegraded":"2023-10-08T07:09:19.731583+0000","last_fullsized":"2023-10-08T07:09:19.731583+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:02.470882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.735645+0000","last_change":"2023-10-08T07:09:19.111956+0000","last_active":"2023-10-08T07:09:19.735645+0000","last_peered":"2023-10-08T07:09:19.735645+0000","last_clean":"2023-10-08T07:09:19.735645+0000","last_became_active":"2023-10-08T07:09:19.048200+0000","last_became_peered":"2023-10-08T07:09:19.048200+0000","last_unstale":"2023-10-08T07:09:19.735645+0000","last_undegraded":"2023-10-08T07:09:19.735645+0000","last_fullsized":"2023-10-08T07:09:19.735645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:42:25.377588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":61,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.420273+0000","last_change":"2023-10-08T07:09:19.420273+0000","last_active":"2023-10-08T07:09:19.420273+0000","last_peered":"2023-10-08T07:09:19.420273+0000","last_clean":"2023-10-08T07:09:19.420273+0000","last_became_active":"2023-10-08T07:09:19.414648+0000","last_became_peered":"2023-10-08T07:09:19.414648+0000","last_unstale":"2023-10-08T07:09:19.420273+0000","last_undegraded":"2023-10-08T07:09:19.420273+0000","last_fullsized":"2023-10-08T07:09:19.420273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:38:55.591501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5875,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.045677+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:09:18.045677+0000","last_peered":"2023-10-08T07:09:18.045677+0000","last_clean":"2023-10-08T07:09:18.045677+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:09:18.045677+0000","last_undegraded":"2023-10-08T07:09:18.045677+0000","last_fullsized":"2023-10-08T07:09:18.045677+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.733171+0000","last_change":"2023-10-08T07:09:17.753543+0000","last_active":"2023-10-08T07:09:19.733171+0000","last_peered":"2023-10-08T07:09:19.733171+0000","last_clean":"2023-10-08T07:09:19.733171+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:09:19.733171+0000","last_undegraded":"2023-10-08T07:09:19.733171+0000","last_fullsized":"2023-10-08T07:09:19.733171+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:51.956560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":2994,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046435+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:18.046435+0000","last_peered":"2023-10-08T07:09:18.046435+0000","last_clean":"2023-10-08T07:09:18.046435+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:18.046435+0000","last_undegraded":"2023-10-08T07:09:18.046435+0000","last_fullsized":"2023-10-08T07:09:18.046435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.058917+0000","last_change":"2023-10-08T07:09:18.057710+0000","last_active":"2023-10-08T07:09:18.058917+0000","last_peered":"2023-10-08T07:09:18.058917+0000","last_clean":"2023-10-08T07:09:18.058917+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:09:18.058917+0000","last_undegraded":"2023-10-08T07:09:18.058917+0000","last_fullsized":"2023-10-08T07:09:18.058917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:49.694705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5859,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.734404+0000","last_change":"2023-10-08T07:09:20.734404+0000","last_active":"2023-10-08T07:09:20.734404+0000","last_peered":"2023-10-08T07:09:20.734404+0000","last_clean":"2023-10-08T07:09:20.734404+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:09:20.734404+0000","last_undegraded":"2023-10-08T07:09:20.734404+0000","last_fullsized":"2023-10-08T07:09:20.734404+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:04:28.453406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":74,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.049280+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:09:18.049280+0000","last_peered":"2023-10-08T07:09:18.049280+0000","last_clean":"2023-10-08T07:09:18.049280+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:09:18.049280+0000","last_undegraded":"2023-10-08T07:09:18.049280+0000","last_fullsized":"2023-10-08T07:09:18.049280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046622+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:09:18.046622+0000","last_peered":"2023-10-08T07:09:18.046622+0000","last_clean":"2023-10-08T07:09:18.046622+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:09:18.046622+0000","last_undegraded":"2023-10-08T07:09:18.046622+0000","last_fullsized":"2023-10-08T07:09:18.046622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8792,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.046482+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:09:18.046482+0000","last_peered":"2023-10-08T07:09:18.046482+0000","last_clean":"2023-10-08T07:09:18.046482+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:09:18.046482+0000","last_undegraded":"2023-10-08T07:09:18.046482+0000","last_fullsized":"2023-10-08T07:09:18.046482+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":2979,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2023-10-08T07:09:19.440647+0000","last_change":"2023-10-08T07:09:19.440851+0000","last_active":"2023-10-08T07:09:19.440647+0000","last_peered":"2023-10-08T07:09:19.440647+0000","last_clean":"2023-10-08T07:06:36.118444+0000","last_became_active":"2023-10-08T07:09:19.426489+0000","last_became_peered":"2023-10-08T07:09:19.426489+0000","last_unstale":"2023-10-08T07:09:19.440647+0000","last_undegraded":"2023-10-08T07:09:19.440647+0000","last_fullsized":"2023-10-08T07:09:19.103235+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:53.288131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T07:09:19.734512+0000","last_change":"2023-10-08T07:09:17.754585+0000","last_active":"2023-10-08T07:09:19.734512+0000","last_peered":"2023-10-08T07:09:19.734512+0000","last_clean":"2023-10-08T07:09:19.734512+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:09:19.734512+0000","last_undegraded":"2023-10-08T07:09:19.734512+0000","last_fullsized":"2023-10-08T07:09:19.734512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:44.969079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-08T07:09:18.059004+0000","last_change":"2023-10-08T07:09:18.056756+0000","last_active":"2023-10-08T07:09:18.059004+0000","last_peered":"2023-10-08T07:09:18.059004+0000","last_clean":"2023-10-08T07:09:18.059004+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:18.059004+0000","last_undegraded":"2023-10-08T07:09:18.059004+0000","last_fullsized":"2023-10-08T07:09:18.059004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:21:49.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2962,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-10-08T07:09:20.735423+0000","last_change":"2023-10-08T07:09:20.735423+0000","last_active":"2023-10-08T07:09:20.735423+0000","last_peered":"2023-10-08T07:09:20.735423+0000","last_clean":"2023-10-08T07:09:20.735423+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:09:20.735423+0000","last_undegraded":"2023-10-08T07:09:20.735423+0000","last_fullsized":"2023-10-08T07:09:20.735423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:52.216576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":115,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":248952,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738418,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":577596,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":576830,"kb_avail":93794244,"statfs":{"total":96636764160,"available":96045305856,"internally_reserved":0,"allocated":770048,"data_stored":311806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":590674375},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":0.57699999999999996,"15min":0.48599999999999999},"min":{"1min":0.217,"5min":0.188,"15min":0.188},"max":{"1min":15.805999999999999,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.2549999999999999,"5min":0.59099999999999997,"15min":0.501},"min":{"1min":0.20300000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":13.827999999999999,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.63200000000000001}]},{"osd":1,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.85099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483776,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93888064,"statfs":{"total":96636764160,"available":96141377536,"internally_reserved":0,"allocated":1630208,"data_stored":1152093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 07:08:27 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.53000000000000003,"15min":0.50600000000000001},"min":{"1min":0.20899999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.9350000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.49099999999999999,"15min":0.504},"min":{"1min":0.193,"5min":0.182,"15min":0.182},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.44500000000000001}]}]},{"osd":1,"up_from":74,"seq":317827579906,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65240,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306600,"statfs":{"total":96636764160,"available":96569958400,"internally_reserved":0,"allocated":1642496,"data_stored":1161304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":255507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:09:24.839 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2023-10-08T07:09:24.839 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-10-08T07:09:24.839 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-10-08T07:09:24.839 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-10-08T07:09:24.840 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-10-08T07:09:24.840 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-10-08T07:09:24.985 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-08T07:09:24.985 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "" 2023-10-08T07:09:24.985 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-08T07:09:29.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2023-10-08T07:09:30.152 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a: {} 2023-10-08T07:09:30.162 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b: {} 2023-10-08T07:09:30.172 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c: {} 2023-10-08T07:09:30.173 INFO:teuthology.orchestra.run.smithi017.stderr:mon.a: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2023-10-08T07:09:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:mon.b: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2023-10-08T07:09:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:mon.c: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2023-10-08T07:09:30.185 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2023-10-08T07:09:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.0 to 1 (10000) 2023-10-08T07:09:31.103 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2023-10-08T07:09:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.0 primary-affinity to 1 (8655362) 2023-10-08T07:09:32.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2023-10-08T07:09:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.2 to 1 (10000) 2023-10-08T07:09:33.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2023-10-08T07:09:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.2 primary-affinity to 1 (8655362) 2023-10-08T07:09:34.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2023-10-08T07:09:35.110 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.1 to 1 (10000) 2023-10-08T07:09:35.125 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2023-10-08T07:09:36.116 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.1 primary-affinity to 1 (8655362) 2023-10-08T07:09:36.130 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2023-10-08T07:09:36.130 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2023-10-08T07:09:36.130 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2023-10-08T07:09:36.130 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2023-10-08T07:09:36.130 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T07:09:36.131 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:09:36.476 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:09:36.476 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":91,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:09:36.105827+0000","last_up_change":"2023-10-08T07:09:17.031827+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":36,"up_from":74,"up_thru":81,"down_at":37,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6801","nonce":551235404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6803","nonce":551235404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6807","nonce":551235404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6805","nonce":551235404}]},"public_addr":"172.21.15.86:6801/551235404","cluster_addr":"172.21.15.86:6803/551235404","heartbeat_back_addr":"172.21.15.86:6807/551235404","heartbeat_front_addr":"172.21.15.86:6805/551235404","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":36},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:09:36.491 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T07:09:36.491 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:09:36.826 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:09:36.826 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":91,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:09:36.105827+0000","last_up_change":"2023-10-08T07:09:17.031827+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":36,"up_from":74,"up_thru":81,"down_at":37,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6801","nonce":551235404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6803","nonce":551235404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6807","nonce":551235404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6805","nonce":551235404}]},"public_addr":"172.21.15.86:6801/551235404","cluster_addr":"172.21.15.86:6803/551235404","heartbeat_back_addr":"172.21.15.86:6807/551235404","heartbeat_front_addr":"172.21.15.86:6805/551235404","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":36},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:09:36.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T07:09:36.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T07:09:36.842 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T07:09:37.015 INFO:teuthology.orchestra.run.smithi017.stdout:317827579910 2023-10-08T07:09:37.016 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T07:09:37.017 INFO:teuthology.orchestra.run.smithi017.stdout:34359738423 2023-10-08T07:09:37.017 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T07:09:37.018 INFO:teuthology.orchestra.run.smithi017.stdout:34359738422 2023-10-08T07:09:37.018 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T07:09:37.420 INFO:teuthology.orchestra.run.smithi017.stdout:34359738422 2023-10-08T07:09:37.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738423 got 34359738422 for osd.0 2023-10-08T07:09:37.436 INFO:teuthology.orchestra.run.smithi017.stdout:317827579909 2023-10-08T07:09:37.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 317827579910 got 317827579909 for osd.1 2023-10-08T07:09:37.451 INFO:teuthology.orchestra.run.smithi017.stdout:34359738421 2023-10-08T07:09:37.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738422 got 34359738421 for osd.2 2023-10-08T07:09:38.435 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T07:09:38.452 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T07:09:38.467 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T07:09:38.801 INFO:teuthology.orchestra.run.smithi017.stdout:34359738422 2023-10-08T07:09:38.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738423 got 34359738422 for osd.0 2023-10-08T07:09:38.834 INFO:teuthology.orchestra.run.smithi017.stdout:34359738421 2023-10-08T07:09:38.839 INFO:teuthology.orchestra.run.smithi017.stdout:317827579909 2023-10-08T07:09:38.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738422 got 34359738421 for osd.2 2023-10-08T07:09:38.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 317827579910 got 317827579909 for osd.1 2023-10-08T07:09:39.818 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T07:09:39.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T07:09:39.855 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T07:09:40.187 INFO:teuthology.orchestra.run.smithi017.stdout:34359738423 2023-10-08T07:09:40.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738423 got 34359738423 for osd.0 2023-10-08T07:09:40.202 DEBUG:teuthology.parallel:result is None 2023-10-08T07:09:40.221 INFO:teuthology.orchestra.run.smithi017.stdout:34359738422 2023-10-08T07:09:40.223 INFO:teuthology.orchestra.run.smithi017.stdout:317827579910 2023-10-08T07:09:40.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738422 got 34359738422 for osd.2 2023-10-08T07:09:40.237 DEBUG:teuthology.parallel:result is None 2023-10-08T07:09:40.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 317827579910 got 317827579910 for osd.1 2023-10-08T07:09:40.239 DEBUG:teuthology.parallel:result is None 2023-10-08T07:09:40.239 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2023-10-08T07:09:40.239 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:09:40.626 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:09:40.628 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:09:40.636 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-10-08T07:09:40.570113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149186,"ondisk_log_size":149186,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145028,"kb_used_data":4300,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970492,"statfs":{"total":289910292480,"available":288737783808,"internally_reserved":0,"allocated":4403200,"data_stored":2813678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.471654"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":2999,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183536+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:35.183536+0000","last_peered":"2023-10-08T07:09:35.183536+0000","last_clean":"2023-10-08T07:09:35.183536+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:35.183536+0000","last_undegraded":"2023-10-08T07:09:35.183536+0000","last_fullsized":"2023-10-08T07:09:35.183536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:13.308715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2900,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183152+0000","last_change":"2023-10-08T07:09:20.737069+0000","last_active":"2023-10-08T07:09:35.183152+0000","last_peered":"2023-10-08T07:09:35.183152+0000","last_clean":"2023-10-08T07:09:35.183152+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:35.183152+0000","last_undegraded":"2023-10-08T07:09:35.183152+0000","last_fullsized":"2023-10-08T07:09:35.183152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:03.307776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109869+0000","last_change":"2023-10-08T07:09:18.056834+0000","last_active":"2023-10-08T07:09:35.109869+0000","last_peered":"2023-10-08T07:09:35.109869+0000","last_clean":"2023-10-08T07:09:35.109869+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:09:35.109869+0000","last_undegraded":"2023-10-08T07:09:35.109869+0000","last_fullsized":"2023-10-08T07:09:35.109869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:16.520645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109745+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:09:35.109745+0000","last_peered":"2023-10-08T07:09:35.109745+0000","last_clean":"2023-10-08T07:09:35.109745+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:09:35.109745+0000","last_undegraded":"2023-10-08T07:09:35.109745+0000","last_fullsized":"2023-10-08T07:09:35.109745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5889,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182831+0000","last_change":"2023-10-08T07:09:20.736694+0000","last_active":"2023-10-08T07:09:35.182831+0000","last_peered":"2023-10-08T07:09:35.182831+0000","last_clean":"2023-10-08T07:09:35.182831+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:09:35.182831+0000","last_undegraded":"2023-10-08T07:09:35.182831+0000","last_fullsized":"2023-10-08T07:09:35.182831+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:19:45.353931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8571,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109046+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:09:35.109046+0000","last_peered":"2023-10-08T07:09:35.109046+0000","last_clean":"2023-10-08T07:09:35.109046+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:09:35.109046+0000","last_undegraded":"2023-10-08T07:09:35.109046+0000","last_fullsized":"2023-10-08T07:09:35.109046+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108839+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:09:35.108839+0000","last_peered":"2023-10-08T07:09:35.108839+0000","last_clean":"2023-10-08T07:09:35.108839+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:35.108839+0000","last_undegraded":"2023-10-08T07:09:35.108839+0000","last_fullsized":"2023-10-08T07:09:35.108839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3039,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108687+0000","last_change":"2023-10-08T07:09:28.078167+0000","last_active":"2023-10-08T07:09:35.108687+0000","last_peered":"2023-10-08T07:09:35.108687+0000","last_clean":"2023-10-08T07:09:35.108687+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:09:35.108687+0000","last_undegraded":"2023-10-08T07:09:35.108687+0000","last_fullsized":"2023-10-08T07:09:35.108687+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:51.764425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2883,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108902+0000","last_change":"2023-10-08T07:09:21.041511+0000","last_active":"2023-10-08T07:09:35.108902+0000","last_peered":"2023-10-08T07:09:35.108902+0000","last_clean":"2023-10-08T07:09:35.108902+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:35.108902+0000","last_undegraded":"2023-10-08T07:09:35.108902+0000","last_fullsized":"2023-10-08T07:09:35.108902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:41.813249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2956,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183330+0000","last_change":"2023-10-08T07:09:20.737658+0000","last_active":"2023-10-08T07:09:35.183330+0000","last_peered":"2023-10-08T07:09:35.183330+0000","last_clean":"2023-10-08T07:09:35.183330+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:09:35.183330+0000","last_undegraded":"2023-10-08T07:09:35.183330+0000","last_fullsized":"2023-10-08T07:09:35.183330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:36.077873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109454+0000","last_change":"2023-10-08T07:09:23.063882+0000","last_active":"2023-10-08T07:09:35.109454+0000","last_peered":"2023-10-08T07:09:35.109454+0000","last_clean":"2023-10-08T07:09:35.109454+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:09:35.109454+0000","last_undegraded":"2023-10-08T07:09:35.109454+0000","last_fullsized":"2023-10-08T07:09:35.109454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:33.242389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2961,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182940+0000","last_change":"2023-10-08T07:09:20.736199+0000","last_active":"2023-10-08T07:09:35.182940+0000","last_peered":"2023-10-08T07:09:35.182940+0000","last_clean":"2023-10-08T07:09:35.182940+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:35.182940+0000","last_undegraded":"2023-10-08T07:09:35.182940+0000","last_fullsized":"2023-10-08T07:09:35.182940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.663562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182912+0000","last_change":"2023-10-08T07:09:17.754638+0000","last_active":"2023-10-08T07:09:35.182912+0000","last_peered":"2023-10-08T07:09:35.182912+0000","last_clean":"2023-10-08T07:09:35.182912+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:09:35.182912+0000","last_undegraded":"2023-10-08T07:09:35.182912+0000","last_fullsized":"2023-10-08T07:09:35.182912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:12.379792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2977,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109469+0000","last_change":"2023-10-08T07:09:21.040638+0000","last_active":"2023-10-08T07:09:35.109469+0000","last_peered":"2023-10-08T07:09:35.109469+0000","last_clean":"2023-10-08T07:09:35.109469+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:09:35.109469+0000","last_undegraded":"2023-10-08T07:09:35.109469+0000","last_fullsized":"2023-10-08T07:09:35.109469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:13.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5866,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108990+0000","last_change":"2023-10-08T07:09:26.042339+0000","last_active":"2023-10-08T07:09:35.108990+0000","last_peered":"2023-10-08T07:09:35.108990+0000","last_clean":"2023-10-08T07:09:35.108990+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:09:35.108990+0000","last_undegraded":"2023-10-08T07:09:35.108990+0000","last_fullsized":"2023-10-08T07:09:35.108990+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:24:41.696448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2982,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108787+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:09:35.108787+0000","last_peered":"2023-10-08T07:09:35.108787+0000","last_clean":"2023-10-08T07:09:35.108787+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:09:35.108787+0000","last_undegraded":"2023-10-08T07:09:35.108787+0000","last_fullsized":"2023-10-08T07:09:35.108787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2981,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108994+0000","last_change":"2023-10-08T07:09:21.041706+0000","last_active":"2023-10-08T07:09:35.108994+0000","last_peered":"2023-10-08T07:09:35.108994+0000","last_clean":"2023-10-08T07:09:35.108994+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:09:35.108994+0000","last_undegraded":"2023-10-08T07:09:35.108994+0000","last_fullsized":"2023-10-08T07:09:35.108994+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:13.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183023+0000","last_change":"2023-10-08T07:09:17.754747+0000","last_active":"2023-10-08T07:09:35.183023+0000","last_peered":"2023-10-08T07:09:35.183023+0000","last_clean":"2023-10-08T07:09:35.183023+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:09:35.183023+0000","last_undegraded":"2023-10-08T07:09:35.183023+0000","last_fullsized":"2023-10-08T07:09:35.183023+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:47.075369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2962,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108922+0000","last_change":"2023-10-08T07:09:21.039966+0000","last_active":"2023-10-08T07:09:35.108922+0000","last_peered":"2023-10-08T07:09:35.108922+0000","last_clean":"2023-10-08T07:09:35.108922+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:09:35.108922+0000","last_undegraded":"2023-10-08T07:09:35.108922+0000","last_fullsized":"2023-10-08T07:09:35.108922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:14.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2973,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109672+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:09:35.109672+0000","last_peered":"2023-10-08T07:09:35.109672+0000","last_clean":"2023-10-08T07:09:35.109672+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:09:35.109672+0000","last_undegraded":"2023-10-08T07:09:35.109672+0000","last_fullsized":"2023-10-08T07:09:35.109672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5892,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109302+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:09:35.109302+0000","last_peered":"2023-10-08T07:09:35.109302+0000","last_clean":"2023-10-08T07:09:35.109302+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:09:35.109302+0000","last_undegraded":"2023-10-08T07:09:35.109302+0000","last_fullsized":"2023-10-08T07:09:35.109302+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2876,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182479+0000","last_change":"2023-10-08T07:09:20.735818+0000","last_active":"2023-10-08T07:09:35.182479+0000","last_peered":"2023-10-08T07:09:35.182479+0000","last_clean":"2023-10-08T07:09:35.182479+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:09:35.182479+0000","last_undegraded":"2023-10-08T07:09:35.182479+0000","last_fullsized":"2023-10-08T07:09:35.182479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:56.874136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2981,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108494+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:09:35.108494+0000","last_peered":"2023-10-08T07:09:35.108494+0000","last_clean":"2023-10-08T07:09:35.108494+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:35.108494+0000","last_undegraded":"2023-10-08T07:09:35.108494+0000","last_fullsized":"2023-10-08T07:09:35.108494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5837,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182023+0000","last_change":"2023-10-08T07:09:20.736822+0000","last_active":"2023-10-08T07:09:35.182023+0000","last_peered":"2023-10-08T07:09:35.182023+0000","last_clean":"2023-10-08T07:09:35.182023+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:35.182023+0000","last_undegraded":"2023-10-08T07:09:35.182023+0000","last_fullsized":"2023-10-08T07:09:35.182023+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:19.752508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2956,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183225+0000","last_change":"2023-10-08T07:09:20.735845+0000","last_active":"2023-10-08T07:09:35.183225+0000","last_peered":"2023-10-08T07:09:35.183225+0000","last_clean":"2023-10-08T07:09:35.183225+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:09:35.183225+0000","last_undegraded":"2023-10-08T07:09:35.183225+0000","last_fullsized":"2023-10-08T07:09:35.183225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.084033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2974,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109238+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:09:35.109238+0000","last_peered":"2023-10-08T07:09:35.109238+0000","last_clean":"2023-10-08T07:09:35.109238+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:09:35.109238+0000","last_undegraded":"2023-10-08T07:09:35.109238+0000","last_fullsized":"2023-10-08T07:09:35.109238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109732+0000","last_change":"2023-10-08T07:09:18.055530+0000","last_active":"2023-10-08T07:09:35.109732+0000","last_peered":"2023-10-08T07:09:35.109732+0000","last_clean":"2023-10-08T07:09:35.109732+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:35.109732+0000","last_undegraded":"2023-10-08T07:09:35.109732+0000","last_fullsized":"2023-10-08T07:09:35.109732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:01.783452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182304+0000","last_change":"2023-10-08T07:09:17.751957+0000","last_active":"2023-10-08T07:09:35.182304+0000","last_peered":"2023-10-08T07:09:35.182304+0000","last_clean":"2023-10-08T07:09:35.182304+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:09:35.182304+0000","last_undegraded":"2023-10-08T07:09:35.182304+0000","last_fullsized":"2023-10-08T07:09:35.182304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:13.104739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183354+0000","last_change":"2023-10-08T07:09:17.754513+0000","last_active":"2023-10-08T07:09:35.183354+0000","last_peered":"2023-10-08T07:09:35.183354+0000","last_clean":"2023-10-08T07:09:35.183354+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:35.183354+0000","last_undegraded":"2023-10-08T07:09:35.183354+0000","last_fullsized":"2023-10-08T07:09:35.183354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:06.336414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108669+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:09:35.108669+0000","last_peered":"2023-10-08T07:09:35.108669+0000","last_clean":"2023-10-08T07:09:35.108669+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:09:35.108669+0000","last_undegraded":"2023-10-08T07:09:35.108669+0000","last_fullsized":"2023-10-08T07:09:35.108669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109037+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:09:35.109037+0000","last_peered":"2023-10-08T07:09:35.109037+0000","last_clean":"2023-10-08T07:09:35.109037+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:09:35.109037+0000","last_undegraded":"2023-10-08T07:09:35.109037+0000","last_fullsized":"2023-10-08T07:09:35.109037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108261+0000","last_change":"2023-10-08T07:09:18.055607+0000","last_active":"2023-10-08T07:09:35.108261+0000","last_peered":"2023-10-08T07:09:35.108261+0000","last_clean":"2023-10-08T07:09:35.108261+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:09:35.108261+0000","last_undegraded":"2023-10-08T07:09:35.108261+0000","last_fullsized":"2023-10-08T07:09:35.108261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:09.952089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3025,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183742+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:35.183742+0000","last_peered":"2023-10-08T07:09:35.183742+0000","last_clean":"2023-10-08T07:09:35.183742+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:35.183742+0000","last_undegraded":"2023-10-08T07:09:35.183742+0000","last_fullsized":"2023-10-08T07:09:35.183742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:30.753981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:09:35.109135+0000","last_peered":"2023-10-08T07:09:35.109135+0000","last_clean":"2023-10-08T07:09:35.109135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:35.109135+0000","last_undegraded":"2023-10-08T07:09:35.109135+0000","last_fullsized":"2023-10-08T07:09:35.109135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5825,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108074+0000","last_change":"2023-10-08T07:09:21.036901+0000","last_active":"2023-10-08T07:09:35.108074+0000","last_peered":"2023-10-08T07:09:35.108074+0000","last_clean":"2023-10-08T07:09:35.108074+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:09:35.108074+0000","last_undegraded":"2023-10-08T07:09:35.108074+0000","last_fullsized":"2023-10-08T07:09:35.108074+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:44:57.453475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109892+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:35.109892+0000","last_peered":"2023-10-08T07:09:35.109892+0000","last_clean":"2023-10-08T07:09:35.109892+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:35.109892+0000","last_undegraded":"2023-10-08T07:09:35.109892+0000","last_fullsized":"2023-10-08T07:09:35.109892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2941,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108860+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:09:35.108860+0000","last_peered":"2023-10-08T07:09:35.108860+0000","last_clean":"2023-10-08T07:09:35.108860+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:09:35.108860+0000","last_undegraded":"2023-10-08T07:09:35.108860+0000","last_fullsized":"2023-10-08T07:09:35.108860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"67'7","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182792+0000","last_change":"2023-10-08T07:09:17.758979+0000","last_active":"2023-10-08T07:09:35.182792+0000","last_peered":"2023-10-08T07:09:35.182792+0000","last_clean":"2023-10-08T07:09:35.182792+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:09:35.182792+0000","last_undegraded":"2023-10-08T07:09:35.182792+0000","last_fullsized":"2023-10-08T07:09:35.182792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:06.386900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108369+0000","last_change":"2023-10-08T07:09:18.064856+0000","last_active":"2023-10-08T07:09:35.108369+0000","last_peered":"2023-10-08T07:09:35.108369+0000","last_clean":"2023-10-08T07:09:35.108369+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:35.108369+0000","last_undegraded":"2023-10-08T07:09:35.108369+0000","last_fullsized":"2023-10-08T07:09:35.108369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.230654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":189,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109611+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:35.109611+0000","last_peered":"2023-10-08T07:09:35.109611+0000","last_clean":"2023-10-08T07:09:35.109611+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:35.109611+0000","last_undegraded":"2023-10-08T07:09:35.109611+0000","last_fullsized":"2023-10-08T07:09:35.109611+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2948,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.110046+0000","last_change":"2023-10-08T07:09:21.038587+0000","last_active":"2023-10-08T07:09:35.110046+0000","last_peered":"2023-10-08T07:09:35.110046+0000","last_clean":"2023-10-08T07:09:35.110046+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:09:35.110046+0000","last_undegraded":"2023-10-08T07:09:35.110046+0000","last_fullsized":"2023-10-08T07:09:35.110046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:50.835623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109696+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:09:35.109696+0000","last_peered":"2023-10-08T07:09:35.109696+0000","last_clean":"2023-10-08T07:09:35.109696+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:09:35.109696+0000","last_undegraded":"2023-10-08T07:09:35.109696+0000","last_fullsized":"2023-10-08T07:09:35.109696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2943,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183227+0000","last_change":"2023-10-08T07:09:20.737135+0000","last_active":"2023-10-08T07:09:35.183227+0000","last_peered":"2023-10-08T07:09:35.183227+0000","last_clean":"2023-10-08T07:09:35.183227+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:09:35.183227+0000","last_undegraded":"2023-10-08T07:09:35.183227+0000","last_fullsized":"2023-10-08T07:09:35.183227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:52.474047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108478+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:09:35.108478+0000","last_peered":"2023-10-08T07:09:35.108478+0000","last_clean":"2023-10-08T07:09:35.108478+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:09:35.108478+0000","last_undegraded":"2023-10-08T07:09:35.108478+0000","last_fullsized":"2023-10-08T07:09:35.108478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8822,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183486+0000","last_change":"2023-10-08T07:09:20.737857+0000","last_active":"2023-10-08T07:09:35.183486+0000","last_peered":"2023-10-08T07:09:35.183486+0000","last_clean":"2023-10-08T07:09:35.183486+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:09:35.183486+0000","last_undegraded":"2023-10-08T07:09:35.183486+0000","last_fullsized":"2023-10-08T07:09:35.183486+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:56.740198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182158+0000","last_change":"2023-10-08T07:09:17.751068+0000","last_active":"2023-10-08T07:09:35.182158+0000","last_peered":"2023-10-08T07:09:35.182158+0000","last_clean":"2023-10-08T07:09:35.182158+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:09:35.182158+0000","last_undegraded":"2023-10-08T07:09:35.182158+0000","last_fullsized":"2023-10-08T07:09:35.182158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:15.155530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2924,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109141+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:09:35.109141+0000","last_peered":"2023-10-08T07:09:35.109141+0000","last_clean":"2023-10-08T07:09:35.109141+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:09:35.109141+0000","last_undegraded":"2023-10-08T07:09:35.109141+0000","last_fullsized":"2023-10-08T07:09:35.109141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'9","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109028+0000","last_change":"2023-10-08T07:09:18.054836+0000","last_active":"2023-10-08T07:09:35.109028+0000","last_peered":"2023-10-08T07:09:35.109028+0000","last_clean":"2023-10-08T07:09:35.109028+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:09:35.109028+0000","last_undegraded":"2023-10-08T07:09:35.109028+0000","last_fullsized":"2023-10-08T07:09:35.109028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:16.567958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109238+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:09:35.109238+0000","last_peered":"2023-10-08T07:09:35.109238+0000","last_clean":"2023-10-08T07:09:35.109238+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:09:35.109238+0000","last_undegraded":"2023-10-08T07:09:35.109238+0000","last_fullsized":"2023-10-08T07:09:35.109238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109969+0000","last_change":"2023-10-08T07:09:18.056757+0000","last_active":"2023-10-08T07:09:35.109969+0000","last_peered":"2023-10-08T07:09:35.109969+0000","last_clean":"2023-10-08T07:09:35.109969+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:09:35.109969+0000","last_undegraded":"2023-10-08T07:09:35.109969+0000","last_fullsized":"2023-10-08T07:09:35.109969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:47.575148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182122+0000","last_change":"2023-10-08T07:09:17.753129+0000","last_active":"2023-10-08T07:09:35.182122+0000","last_peered":"2023-10-08T07:09:35.182122+0000","last_clean":"2023-10-08T07:09:35.182122+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:09:35.182122+0000","last_undegraded":"2023-10-08T07:09:35.182122+0000","last_fullsized":"2023-10-08T07:09:35.182122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:53.133780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183472+0000","last_change":"2023-10-08T07:09:17.753124+0000","last_active":"2023-10-08T07:09:35.183472+0000","last_peered":"2023-10-08T07:09:35.183472+0000","last_clean":"2023-10-08T07:09:35.183472+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:09:35.183472+0000","last_undegraded":"2023-10-08T07:09:35.183472+0000","last_fullsized":"2023-10-08T07:09:35.183472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.689880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3000,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182330+0000","last_change":"2023-10-08T07:09:20.737843+0000","last_active":"2023-10-08T07:09:35.182330+0000","last_peered":"2023-10-08T07:09:35.182330+0000","last_clean":"2023-10-08T07:09:35.182330+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:09:35.182330+0000","last_undegraded":"2023-10-08T07:09:35.182330+0000","last_fullsized":"2023-10-08T07:09:35.182330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:58.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109742+0000","last_change":"2023-10-08T07:09:18.057034+0000","last_active":"2023-10-08T07:09:35.109742+0000","last_peered":"2023-10-08T07:09:35.109742+0000","last_clean":"2023-10-08T07:09:35.109742+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:09:35.109742+0000","last_undegraded":"2023-10-08T07:09:35.109742+0000","last_fullsized":"2023-10-08T07:09:35.109742+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:42.006586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2947,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109223+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:09:35.109223+0000","last_peered":"2023-10-08T07:09:35.109223+0000","last_clean":"2023-10-08T07:09:35.109223+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:09:35.109223+0000","last_undegraded":"2023-10-08T07:09:35.109223+0000","last_fullsized":"2023-10-08T07:09:35.109223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109356+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:35.109356+0000","last_peered":"2023-10-08T07:09:35.109356+0000","last_clean":"2023-10-08T07:09:35.109356+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:35.109356+0000","last_undegraded":"2023-10-08T07:09:35.109356+0000","last_fullsized":"2023-10-08T07:09:35.109356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":2992,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108605+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:09:35.108605+0000","last_peered":"2023-10-08T07:09:35.108605+0000","last_clean":"2023-10-08T07:09:35.108605+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:35.108605+0000","last_undegraded":"2023-10-08T07:09:35.108605+0000","last_fullsized":"2023-10-08T07:09:35.108605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'3","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108542+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:09:35.108542+0000","last_peered":"2023-10-08T07:09:35.108542+0000","last_clean":"2023-10-08T07:09:35.108542+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:09:35.108542+0000","last_undegraded":"2023-10-08T07:09:35.108542+0000","last_fullsized":"2023-10-08T07:09:35.108542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5930,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109441+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:09:35.109441+0000","last_peered":"2023-10-08T07:09:35.109441+0000","last_clean":"2023-10-08T07:09:35.109441+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:35.109441+0000","last_undegraded":"2023-10-08T07:09:35.109441+0000","last_fullsized":"2023-10-08T07:09:35.109441+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109090+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:09:35.109090+0000","last_peered":"2023-10-08T07:09:35.109090+0000","last_clean":"2023-10-08T07:09:35.109090+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:09:35.109090+0000","last_undegraded":"2023-10-08T07:09:35.109090+0000","last_fullsized":"2023-10-08T07:09:35.109090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109993+0000","last_change":"2023-10-08T07:09:18.058346+0000","last_active":"2023-10-08T07:09:35.109993+0000","last_peered":"2023-10-08T07:09:35.109993+0000","last_clean":"2023-10-08T07:09:35.109993+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:09:35.109993+0000","last_undegraded":"2023-10-08T07:09:35.109993+0000","last_fullsized":"2023-10-08T07:09:35.109993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:51.958399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182484+0000","last_change":"2023-10-08T07:09:17.752745+0000","last_active":"2023-10-08T07:09:35.182484+0000","last_peered":"2023-10-08T07:09:35.182484+0000","last_clean":"2023-10-08T07:09:35.182484+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:09:35.182484+0000","last_undegraded":"2023-10-08T07:09:35.182484+0000","last_fullsized":"2023-10-08T07:09:35.182484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:08.404190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5935,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109869+0000","last_change":"2023-10-08T07:09:21.040694+0000","last_active":"2023-10-08T07:09:35.109869+0000","last_peered":"2023-10-08T07:09:35.109869+0000","last_clean":"2023-10-08T07:09:35.109869+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:09:35.109869+0000","last_undegraded":"2023-10-08T07:09:35.109869+0000","last_fullsized":"2023-10-08T07:09:35.109869+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:41.813249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182364+0000","last_change":"2023-10-08T07:09:17.754898+0000","last_active":"2023-10-08T07:09:35.182364+0000","last_peered":"2023-10-08T07:09:35.182364+0000","last_clean":"2023-10-08T07:09:35.182364+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:09:35.182364+0000","last_undegraded":"2023-10-08T07:09:35.182364+0000","last_fullsized":"2023-10-08T07:09:35.182364+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:19.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2950,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109068+0000","last_change":"2023-10-08T07:09:21.042008+0000","last_active":"2023-10-08T07:09:35.109068+0000","last_peered":"2023-10-08T07:09:35.109068+0000","last_clean":"2023-10-08T07:09:35.109068+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:09:35.109068+0000","last_undegraded":"2023-10-08T07:09:35.109068+0000","last_fullsized":"2023-10-08T07:09:35.109068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:32:00.347477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110127+0000","last_change":"2023-10-08T07:09:18.057444+0000","last_active":"2023-10-08T07:09:36.110127+0000","last_peered":"2023-10-08T07:09:36.110127+0000","last_clean":"2023-10-08T07:09:36.110127+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:09:36.110127+0000","last_undegraded":"2023-10-08T07:09:36.110127+0000","last_fullsized":"2023-10-08T07:09:36.110127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:06:13.088433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109847+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:09:35.109847+0000","last_peered":"2023-10-08T07:09:35.109847+0000","last_clean":"2023-10-08T07:09:35.109847+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:09:35.109847+0000","last_undegraded":"2023-10-08T07:09:35.109847+0000","last_fullsized":"2023-10-08T07:09:35.109847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5851,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182483+0000","last_change":"2023-10-08T07:09:20.735892+0000","last_active":"2023-10-08T07:09:35.182483+0000","last_peered":"2023-10-08T07:09:35.182483+0000","last_clean":"2023-10-08T07:09:35.182483+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:09:35.182483+0000","last_undegraded":"2023-10-08T07:09:35.182483+0000","last_fullsized":"2023-10-08T07:09:35.182483+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:02.889299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111212+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:09:36.111212+0000","last_peered":"2023-10-08T07:09:36.111212+0000","last_clean":"2023-10-08T07:09:36.111212+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:09:36.111212+0000","last_undegraded":"2023-10-08T07:09:36.111212+0000","last_fullsized":"2023-10-08T07:09:36.111212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109450+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:09:35.109450+0000","last_peered":"2023-10-08T07:09:35.109450+0000","last_clean":"2023-10-08T07:09:35.109450+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:09:35.109450+0000","last_undegraded":"2023-10-08T07:09:35.109450+0000","last_fullsized":"2023-10-08T07:09:35.109450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2958,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108810+0000","last_change":"2023-10-08T07:09:21.040185+0000","last_active":"2023-10-08T07:09:35.108810+0000","last_peered":"2023-10-08T07:09:35.108810+0000","last_clean":"2023-10-08T07:09:35.108810+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:09:35.108810+0000","last_undegraded":"2023-10-08T07:09:35.108810+0000","last_fullsized":"2023-10-08T07:09:35.108810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:50.835623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109492+0000","last_change":"2023-10-08T07:09:18.067783+0000","last_active":"2023-10-08T07:09:36.109492+0000","last_peered":"2023-10-08T07:09:36.109492+0000","last_clean":"2023-10-08T07:09:36.109492+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:09:36.109492+0000","last_undegraded":"2023-10-08T07:09:36.109492+0000","last_fullsized":"2023-10-08T07:09:36.109492+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:11.554943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182723+0000","last_change":"2023-10-08T07:09:17.752755+0000","last_active":"2023-10-08T07:09:35.182723+0000","last_peered":"2023-10-08T07:09:35.182723+0000","last_clean":"2023-10-08T07:09:35.182723+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:09:35.182723+0000","last_undegraded":"2023-10-08T07:09:35.182723+0000","last_fullsized":"2023-10-08T07:09:35.182723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:23.696397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8917,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109189+0000","last_change":"2023-10-08T07:09:21.042220+0000","last_active":"2023-10-08T07:09:35.109189+0000","last_peered":"2023-10-08T07:09:35.109189+0000","last_clean":"2023-10-08T07:09:35.109189+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:09:35.109189+0000","last_undegraded":"2023-10-08T07:09:35.109189+0000","last_fullsized":"2023-10-08T07:09:35.109189+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:33.242389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111323+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:09:36.111323+0000","last_peered":"2023-10-08T07:09:36.111323+0000","last_clean":"2023-10-08T07:09:36.111323+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:09:36.111323+0000","last_undegraded":"2023-10-08T07:09:36.111323+0000","last_fullsized":"2023-10-08T07:09:36.111323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":299,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108760+0000","last_change":"2023-10-08T07:09:18.052234+0000","last_active":"2023-10-08T07:09:35.108760+0000","last_peered":"2023-10-08T07:09:35.108760+0000","last_clean":"2023-10-08T07:09:35.108760+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:09:35.108760+0000","last_undegraded":"2023-10-08T07:09:35.108760+0000","last_fullsized":"2023-10-08T07:09:35.108760+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:02:56.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108336+0000","last_change":"2023-10-08T07:09:18.049984+0000","last_active":"2023-10-08T07:09:35.108336+0000","last_peered":"2023-10-08T07:09:35.108336+0000","last_clean":"2023-10-08T07:09:35.108336+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:09:35.108336+0000","last_undegraded":"2023-10-08T07:09:35.108336+0000","last_fullsized":"2023-10-08T07:09:35.108336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:59:20.880943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5902,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109931+0000","last_change":"2023-10-08T07:09:21.040684+0000","last_active":"2023-10-08T07:09:35.109931+0000","last_peered":"2023-10-08T07:09:35.109931+0000","last_clean":"2023-10-08T07:09:35.109931+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:09:35.109931+0000","last_undegraded":"2023-10-08T07:09:35.109931+0000","last_fullsized":"2023-10-08T07:09:35.109931+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:14.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108874+0000","last_change":"2023-10-08T07:09:18.051593+0000","last_active":"2023-10-08T07:09:35.108874+0000","last_peered":"2023-10-08T07:09:35.108874+0000","last_clean":"2023-10-08T07:09:35.108874+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:09:35.108874+0000","last_undegraded":"2023-10-08T07:09:35.108874+0000","last_fullsized":"2023-10-08T07:09:35.108874+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:34.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108212+0000","last_change":"2023-10-08T07:09:25.038493+0000","last_active":"2023-10-08T07:09:35.108212+0000","last_peered":"2023-10-08T07:09:35.108212+0000","last_clean":"2023-10-08T07:09:35.108212+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:09:35.108212+0000","last_undegraded":"2023-10-08T07:09:35.108212+0000","last_fullsized":"2023-10-08T07:09:35.108212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:44.616324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183181+0000","last_change":"2023-10-08T07:09:17.755079+0000","last_active":"2023-10-08T07:09:35.183181+0000","last_peered":"2023-10-08T07:09:35.183181+0000","last_clean":"2023-10-08T07:09:35.183181+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:09:35.183181+0000","last_undegraded":"2023-10-08T07:09:35.183181+0000","last_fullsized":"2023-10-08T07:09:35.183181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:12.238239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183205+0000","last_change":"2023-10-08T07:09:17.754844+0000","last_active":"2023-10-08T07:09:35.183205+0000","last_peered":"2023-10-08T07:09:35.183205+0000","last_clean":"2023-10-08T07:09:35.183205+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:35.183205+0000","last_undegraded":"2023-10-08T07:09:35.183205+0000","last_fullsized":"2023-10-08T07:09:35.183205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:12.129220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108682+0000","last_change":"2023-10-08T07:09:18.056208+0000","last_active":"2023-10-08T07:09:35.108682+0000","last_peered":"2023-10-08T07:09:35.108682+0000","last_clean":"2023-10-08T07:09:35.108682+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:09:35.108682+0000","last_undegraded":"2023-10-08T07:09:35.108682+0000","last_fullsized":"2023-10-08T07:09:35.108682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:55.549444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182645+0000","last_change":"2023-10-08T07:09:17.753144+0000","last_active":"2023-10-08T07:09:35.182645+0000","last_peered":"2023-10-08T07:09:35.182645+0000","last_clean":"2023-10-08T07:09:35.182645+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:09:35.182645+0000","last_undegraded":"2023-10-08T07:09:35.182645+0000","last_fullsized":"2023-10-08T07:09:35.182645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:25.968547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'3","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109045+0000","last_change":"2023-10-08T07:09:18.059238+0000","last_active":"2023-10-08T07:09:35.109045+0000","last_peered":"2023-10-08T07:09:35.109045+0000","last_clean":"2023-10-08T07:09:35.109045+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:09:35.109045+0000","last_undegraded":"2023-10-08T07:09:35.109045+0000","last_fullsized":"2023-10-08T07:09:35.109045+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:32.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109103+0000","last_change":"2023-10-08T07:09:18.056706+0000","last_active":"2023-10-08T07:09:35.109103+0000","last_peered":"2023-10-08T07:09:35.109103+0000","last_clean":"2023-10-08T07:09:35.109103+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:09:35.109103+0000","last_undegraded":"2023-10-08T07:09:35.109103+0000","last_fullsized":"2023-10-08T07:09:35.109103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:17.258824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2988,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108033+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:09:35.108033+0000","last_peered":"2023-10-08T07:09:35.108033+0000","last_clean":"2023-10-08T07:09:35.108033+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:35.108033+0000","last_undegraded":"2023-10-08T07:09:35.108033+0000","last_fullsized":"2023-10-08T07:09:35.108033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.110033+0000","last_change":"2023-10-08T07:09:18.054661+0000","last_active":"2023-10-08T07:09:35.110033+0000","last_peered":"2023-10-08T07:09:35.110033+0000","last_clean":"2023-10-08T07:09:35.110033+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:09:35.110033+0000","last_undegraded":"2023-10-08T07:09:35.110033+0000","last_fullsized":"2023-10-08T07:09:35.110033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:10.492782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"69'9","reported_seq":94,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108910+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:09:35.108910+0000","last_peered":"2023-10-08T07:09:35.108910+0000","last_clean":"2023-10-08T07:09:35.108910+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:09:35.108910+0000","last_undegraded":"2023-10-08T07:09:35.108910+0000","last_fullsized":"2023-10-08T07:09:35.108910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2962,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182541+0000","last_change":"2023-10-08T07:09:20.735652+0000","last_active":"2023-10-08T07:09:35.182541+0000","last_peered":"2023-10-08T07:09:35.182541+0000","last_clean":"2023-10-08T07:09:35.182541+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:09:35.182541+0000","last_undegraded":"2023-10-08T07:09:35.182541+0000","last_fullsized":"2023-10-08T07:09:35.182541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:15.857716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182410+0000","last_change":"2023-10-08T07:09:22.762216+0000","last_active":"2023-10-08T07:09:35.182410+0000","last_peered":"2023-10-08T07:09:35.182410+0000","last_clean":"2023-10-08T07:09:35.182410+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:35.182410+0000","last_undegraded":"2023-10-08T07:09:35.182410+0000","last_fullsized":"2023-10-08T07:09:35.182410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:49.404736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183153+0000","last_change":"2023-10-08T07:09:24.732784+0000","last_active":"2023-10-08T07:09:35.183153+0000","last_peered":"2023-10-08T07:09:35.183153+0000","last_clean":"2023-10-08T07:09:35.183153+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:09:35.183153+0000","last_undegraded":"2023-10-08T07:09:35.183153+0000","last_fullsized":"2023-10-08T07:09:35.183153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:25.502260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109487+0000","last_change":"2023-10-08T07:09:23.066235+0000","last_active":"2023-10-08T07:09:35.109487+0000","last_peered":"2023-10-08T07:09:35.109487+0000","last_clean":"2023-10-08T07:09:35.109487+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:09:35.109487+0000","last_undegraded":"2023-10-08T07:09:35.109487+0000","last_fullsized":"2023-10-08T07:09:35.109487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:42.060351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5890,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109543+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:09:35.109543+0000","last_peered":"2023-10-08T07:09:35.109543+0000","last_clean":"2023-10-08T07:09:35.109543+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:09:35.109543+0000","last_undegraded":"2023-10-08T07:09:35.109543+0000","last_fullsized":"2023-10-08T07:09:35.109543+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182938+0000","last_change":"2023-10-08T07:09:17.753543+0000","last_active":"2023-10-08T07:09:35.182938+0000","last_peered":"2023-10-08T07:09:35.182938+0000","last_clean":"2023-10-08T07:09:35.182938+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:09:35.182938+0000","last_undegraded":"2023-10-08T07:09:35.182938+0000","last_fullsized":"2023-10-08T07:09:35.182938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:51.956560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3009,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109233+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:35.109233+0000","last_peered":"2023-10-08T07:09:35.109233+0000","last_clean":"2023-10-08T07:09:35.109233+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:35.109233+0000","last_undegraded":"2023-10-08T07:09:35.109233+0000","last_fullsized":"2023-10-08T07:09:35.109233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109221+0000","last_change":"2023-10-08T07:09:18.057710+0000","last_active":"2023-10-08T07:09:35.109221+0000","last_peered":"2023-10-08T07:09:35.109221+0000","last_clean":"2023-10-08T07:09:35.109221+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:09:35.109221+0000","last_undegraded":"2023-10-08T07:09:35.109221+0000","last_fullsized":"2023-10-08T07:09:35.109221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:49.694705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5871,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182257+0000","last_change":"2023-10-08T07:09:20.734404+0000","last_active":"2023-10-08T07:09:35.182257+0000","last_peered":"2023-10-08T07:09:35.182257+0000","last_clean":"2023-10-08T07:09:35.182257+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:09:35.182257+0000","last_undegraded":"2023-10-08T07:09:35.182257+0000","last_fullsized":"2023-10-08T07:09:35.182257+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:04:28.453406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":89,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109149+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:09:35.109149+0000","last_peered":"2023-10-08T07:09:35.109149+0000","last_clean":"2023-10-08T07:09:35.109149+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:09:35.109149+0000","last_undegraded":"2023-10-08T07:09:35.109149+0000","last_fullsized":"2023-10-08T07:09:35.109149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109047+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:09:35.109047+0000","last_peered":"2023-10-08T07:09:35.109047+0000","last_clean":"2023-10-08T07:09:35.109047+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:09:35.109047+0000","last_undegraded":"2023-10-08T07:09:35.109047+0000","last_fullsized":"2023-10-08T07:09:35.109047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8807,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108915+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:09:35.108915+0000","last_peered":"2023-10-08T07:09:35.108915+0000","last_clean":"2023-10-08T07:09:35.108915+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:09:35.108915+0000","last_undegraded":"2023-10-08T07:09:35.108915+0000","last_fullsized":"2023-10-08T07:09:35.108915+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3001,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108201+0000","last_change":"2023-10-08T07:09:21.036530+0000","last_active":"2023-10-08T07:09:35.108201+0000","last_peered":"2023-10-08T07:09:35.108201+0000","last_clean":"2023-10-08T07:09:35.108201+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:09:35.108201+0000","last_undegraded":"2023-10-08T07:09:35.108201+0000","last_fullsized":"2023-10-08T07:09:35.108201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:41:49.285073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182677+0000","last_change":"2023-10-08T07:09:17.754585+0000","last_active":"2023-10-08T07:09:35.182677+0000","last_peered":"2023-10-08T07:09:35.182677+0000","last_clean":"2023-10-08T07:09:35.182677+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:09:35.182677+0000","last_undegraded":"2023-10-08T07:09:35.182677+0000","last_fullsized":"2023-10-08T07:09:35.182677+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:44.969079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108686+0000","last_change":"2023-10-08T07:09:18.056756+0000","last_active":"2023-10-08T07:09:35.108686+0000","last_peered":"2023-10-08T07:09:35.108686+0000","last_clean":"2023-10-08T07:09:35.108686+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:35.108686+0000","last_undegraded":"2023-10-08T07:09:35.108686+0000","last_fullsized":"2023-10-08T07:09:35.108686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:21:49.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2974,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182686+0000","last_change":"2023-10-08T07:09:20.735423+0000","last_active":"2023-10-08T07:09:35.182686+0000","last_peered":"2023-10-08T07:09:35.182686+0000","last_clean":"2023-10-08T07:09:35.182686+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:09:35.182686+0000","last_undegraded":"2023-10-08T07:09:35.182686+0000","last_fullsized":"2023-10-08T07:09:35.182686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:52.216576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595772,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776068,"statfs":{"total":96636764160,"available":96026693632,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59499999999999997,"15min":0.49199999999999999},"min":{"1min":0.35499999999999998,"5min":0.188,"15min":0.188},"max":{"1min":0.76200000000000001,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.60499999999999998,"15min":0.505},"min":{"1min":0.372,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.66300000000000003,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.31}]},{"osd":1,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.55800000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483920,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887920,"statfs":{"total":96636764160,"available":96141230080,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.54300000000000004}]},{"osd":2,"last update":"Sun Oct 8 07:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.1910000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.36399999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.90700000000000003,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":74,"seq":317827579910,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":1704,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":1744896,"data_stored":1216013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:09:40.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:09:41.015 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:09:41.017 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:09:41.027 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-10-08T07:09:40.570113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149186,"ondisk_log_size":149186,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145028,"kb_used_data":4300,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970492,"statfs":{"total":289910292480,"available":288737783808,"internally_reserved":0,"allocated":4403200,"data_stored":2813678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.471654"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":2999,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183536+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:35.183536+0000","last_peered":"2023-10-08T07:09:35.183536+0000","last_clean":"2023-10-08T07:09:35.183536+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:35.183536+0000","last_undegraded":"2023-10-08T07:09:35.183536+0000","last_fullsized":"2023-10-08T07:09:35.183536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:13.308715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2900,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183152+0000","last_change":"2023-10-08T07:09:20.737069+0000","last_active":"2023-10-08T07:09:35.183152+0000","last_peered":"2023-10-08T07:09:35.183152+0000","last_clean":"2023-10-08T07:09:35.183152+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:35.183152+0000","last_undegraded":"2023-10-08T07:09:35.183152+0000","last_fullsized":"2023-10-08T07:09:35.183152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:03.307776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109869+0000","last_change":"2023-10-08T07:09:18.056834+0000","last_active":"2023-10-08T07:09:35.109869+0000","last_peered":"2023-10-08T07:09:35.109869+0000","last_clean":"2023-10-08T07:09:35.109869+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:09:35.109869+0000","last_undegraded":"2023-10-08T07:09:35.109869+0000","last_fullsized":"2023-10-08T07:09:35.109869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:16.520645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109745+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:09:35.109745+0000","last_peered":"2023-10-08T07:09:35.109745+0000","last_clean":"2023-10-08T07:09:35.109745+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:09:35.109745+0000","last_undegraded":"2023-10-08T07:09:35.109745+0000","last_fullsized":"2023-10-08T07:09:35.109745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5889,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182831+0000","last_change":"2023-10-08T07:09:20.736694+0000","last_active":"2023-10-08T07:09:35.182831+0000","last_peered":"2023-10-08T07:09:35.182831+0000","last_clean":"2023-10-08T07:09:35.182831+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:09:35.182831+0000","last_undegraded":"2023-10-08T07:09:35.182831+0000","last_fullsized":"2023-10-08T07:09:35.182831+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:19:45.353931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8571,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109046+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:09:35.109046+0000","last_peered":"2023-10-08T07:09:35.109046+0000","last_clean":"2023-10-08T07:09:35.109046+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:09:35.109046+0000","last_undegraded":"2023-10-08T07:09:35.109046+0000","last_fullsized":"2023-10-08T07:09:35.109046+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108839+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:09:35.108839+0000","last_peered":"2023-10-08T07:09:35.108839+0000","last_clean":"2023-10-08T07:09:35.108839+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:35.108839+0000","last_undegraded":"2023-10-08T07:09:35.108839+0000","last_fullsized":"2023-10-08T07:09:35.108839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3039,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108687+0000","last_change":"2023-10-08T07:09:28.078167+0000","last_active":"2023-10-08T07:09:35.108687+0000","last_peered":"2023-10-08T07:09:35.108687+0000","last_clean":"2023-10-08T07:09:35.108687+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:09:35.108687+0000","last_undegraded":"2023-10-08T07:09:35.108687+0000","last_fullsized":"2023-10-08T07:09:35.108687+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:51.764425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2883,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108902+0000","last_change":"2023-10-08T07:09:21.041511+0000","last_active":"2023-10-08T07:09:35.108902+0000","last_peered":"2023-10-08T07:09:35.108902+0000","last_clean":"2023-10-08T07:09:35.108902+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:35.108902+0000","last_undegraded":"2023-10-08T07:09:35.108902+0000","last_fullsized":"2023-10-08T07:09:35.108902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:41.813249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2956,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183330+0000","last_change":"2023-10-08T07:09:20.737658+0000","last_active":"2023-10-08T07:09:35.183330+0000","last_peered":"2023-10-08T07:09:35.183330+0000","last_clean":"2023-10-08T07:09:35.183330+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:09:35.183330+0000","last_undegraded":"2023-10-08T07:09:35.183330+0000","last_fullsized":"2023-10-08T07:09:35.183330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:36.077873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109454+0000","last_change":"2023-10-08T07:09:23.063882+0000","last_active":"2023-10-08T07:09:35.109454+0000","last_peered":"2023-10-08T07:09:35.109454+0000","last_clean":"2023-10-08T07:09:35.109454+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:09:35.109454+0000","last_undegraded":"2023-10-08T07:09:35.109454+0000","last_fullsized":"2023-10-08T07:09:35.109454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:33.242389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2961,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182940+0000","last_change":"2023-10-08T07:09:20.736199+0000","last_active":"2023-10-08T07:09:35.182940+0000","last_peered":"2023-10-08T07:09:35.182940+0000","last_clean":"2023-10-08T07:09:35.182940+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:35.182940+0000","last_undegraded":"2023-10-08T07:09:35.182940+0000","last_fullsized":"2023-10-08T07:09:35.182940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.663562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182912+0000","last_change":"2023-10-08T07:09:17.754638+0000","last_active":"2023-10-08T07:09:35.182912+0000","last_peered":"2023-10-08T07:09:35.182912+0000","last_clean":"2023-10-08T07:09:35.182912+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:09:35.182912+0000","last_undegraded":"2023-10-08T07:09:35.182912+0000","last_fullsized":"2023-10-08T07:09:35.182912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:12.379792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2977,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109469+0000","last_change":"2023-10-08T07:09:21.040638+0000","last_active":"2023-10-08T07:09:35.109469+0000","last_peered":"2023-10-08T07:09:35.109469+0000","last_clean":"2023-10-08T07:09:35.109469+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:09:35.109469+0000","last_undegraded":"2023-10-08T07:09:35.109469+0000","last_fullsized":"2023-10-08T07:09:35.109469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:13.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5866,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108990+0000","last_change":"2023-10-08T07:09:26.042339+0000","last_active":"2023-10-08T07:09:35.108990+0000","last_peered":"2023-10-08T07:09:35.108990+0000","last_clean":"2023-10-08T07:09:35.108990+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:09:35.108990+0000","last_undegraded":"2023-10-08T07:09:35.108990+0000","last_fullsized":"2023-10-08T07:09:35.108990+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:24:41.696448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2982,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108787+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:09:35.108787+0000","last_peered":"2023-10-08T07:09:35.108787+0000","last_clean":"2023-10-08T07:09:35.108787+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:09:35.108787+0000","last_undegraded":"2023-10-08T07:09:35.108787+0000","last_fullsized":"2023-10-08T07:09:35.108787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2981,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108994+0000","last_change":"2023-10-08T07:09:21.041706+0000","last_active":"2023-10-08T07:09:35.108994+0000","last_peered":"2023-10-08T07:09:35.108994+0000","last_clean":"2023-10-08T07:09:35.108994+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:09:35.108994+0000","last_undegraded":"2023-10-08T07:09:35.108994+0000","last_fullsized":"2023-10-08T07:09:35.108994+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:13.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183023+0000","last_change":"2023-10-08T07:09:17.754747+0000","last_active":"2023-10-08T07:09:35.183023+0000","last_peered":"2023-10-08T07:09:35.183023+0000","last_clean":"2023-10-08T07:09:35.183023+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:09:35.183023+0000","last_undegraded":"2023-10-08T07:09:35.183023+0000","last_fullsized":"2023-10-08T07:09:35.183023+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:47.075369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2962,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108922+0000","last_change":"2023-10-08T07:09:21.039966+0000","last_active":"2023-10-08T07:09:35.108922+0000","last_peered":"2023-10-08T07:09:35.108922+0000","last_clean":"2023-10-08T07:09:35.108922+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:09:35.108922+0000","last_undegraded":"2023-10-08T07:09:35.108922+0000","last_fullsized":"2023-10-08T07:09:35.108922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:14.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2973,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109672+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:09:35.109672+0000","last_peered":"2023-10-08T07:09:35.109672+0000","last_clean":"2023-10-08T07:09:35.109672+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:09:35.109672+0000","last_undegraded":"2023-10-08T07:09:35.109672+0000","last_fullsized":"2023-10-08T07:09:35.109672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5892,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109302+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:09:35.109302+0000","last_peered":"2023-10-08T07:09:35.109302+0000","last_clean":"2023-10-08T07:09:35.109302+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:09:35.109302+0000","last_undegraded":"2023-10-08T07:09:35.109302+0000","last_fullsized":"2023-10-08T07:09:35.109302+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2876,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182479+0000","last_change":"2023-10-08T07:09:20.735818+0000","last_active":"2023-10-08T07:09:35.182479+0000","last_peered":"2023-10-08T07:09:35.182479+0000","last_clean":"2023-10-08T07:09:35.182479+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:09:35.182479+0000","last_undegraded":"2023-10-08T07:09:35.182479+0000","last_fullsized":"2023-10-08T07:09:35.182479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:56.874136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2981,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108494+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:09:35.108494+0000","last_peered":"2023-10-08T07:09:35.108494+0000","last_clean":"2023-10-08T07:09:35.108494+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:35.108494+0000","last_undegraded":"2023-10-08T07:09:35.108494+0000","last_fullsized":"2023-10-08T07:09:35.108494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5837,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182023+0000","last_change":"2023-10-08T07:09:20.736822+0000","last_active":"2023-10-08T07:09:35.182023+0000","last_peered":"2023-10-08T07:09:35.182023+0000","last_clean":"2023-10-08T07:09:35.182023+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:35.182023+0000","last_undegraded":"2023-10-08T07:09:35.182023+0000","last_fullsized":"2023-10-08T07:09:35.182023+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:19.752508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2956,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183225+0000","last_change":"2023-10-08T07:09:20.735845+0000","last_active":"2023-10-08T07:09:35.183225+0000","last_peered":"2023-10-08T07:09:35.183225+0000","last_clean":"2023-10-08T07:09:35.183225+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:09:35.183225+0000","last_undegraded":"2023-10-08T07:09:35.183225+0000","last_fullsized":"2023-10-08T07:09:35.183225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.084033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2974,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109238+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:09:35.109238+0000","last_peered":"2023-10-08T07:09:35.109238+0000","last_clean":"2023-10-08T07:09:35.109238+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:09:35.109238+0000","last_undegraded":"2023-10-08T07:09:35.109238+0000","last_fullsized":"2023-10-08T07:09:35.109238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109732+0000","last_change":"2023-10-08T07:09:18.055530+0000","last_active":"2023-10-08T07:09:35.109732+0000","last_peered":"2023-10-08T07:09:35.109732+0000","last_clean":"2023-10-08T07:09:35.109732+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:35.109732+0000","last_undegraded":"2023-10-08T07:09:35.109732+0000","last_fullsized":"2023-10-08T07:09:35.109732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:01.783452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182304+0000","last_change":"2023-10-08T07:09:17.751957+0000","last_active":"2023-10-08T07:09:35.182304+0000","last_peered":"2023-10-08T07:09:35.182304+0000","last_clean":"2023-10-08T07:09:35.182304+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:09:35.182304+0000","last_undegraded":"2023-10-08T07:09:35.182304+0000","last_fullsized":"2023-10-08T07:09:35.182304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:13.104739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183354+0000","last_change":"2023-10-08T07:09:17.754513+0000","last_active":"2023-10-08T07:09:35.183354+0000","last_peered":"2023-10-08T07:09:35.183354+0000","last_clean":"2023-10-08T07:09:35.183354+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:35.183354+0000","last_undegraded":"2023-10-08T07:09:35.183354+0000","last_fullsized":"2023-10-08T07:09:35.183354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:06.336414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108669+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:09:35.108669+0000","last_peered":"2023-10-08T07:09:35.108669+0000","last_clean":"2023-10-08T07:09:35.108669+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:09:35.108669+0000","last_undegraded":"2023-10-08T07:09:35.108669+0000","last_fullsized":"2023-10-08T07:09:35.108669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109037+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:09:35.109037+0000","last_peered":"2023-10-08T07:09:35.109037+0000","last_clean":"2023-10-08T07:09:35.109037+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:09:35.109037+0000","last_undegraded":"2023-10-08T07:09:35.109037+0000","last_fullsized":"2023-10-08T07:09:35.109037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108261+0000","last_change":"2023-10-08T07:09:18.055607+0000","last_active":"2023-10-08T07:09:35.108261+0000","last_peered":"2023-10-08T07:09:35.108261+0000","last_clean":"2023-10-08T07:09:35.108261+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:09:35.108261+0000","last_undegraded":"2023-10-08T07:09:35.108261+0000","last_fullsized":"2023-10-08T07:09:35.108261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:09.952089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3025,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183742+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:35.183742+0000","last_peered":"2023-10-08T07:09:35.183742+0000","last_clean":"2023-10-08T07:09:35.183742+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:35.183742+0000","last_undegraded":"2023-10-08T07:09:35.183742+0000","last_fullsized":"2023-10-08T07:09:35.183742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:30.753981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:09:35.109135+0000","last_peered":"2023-10-08T07:09:35.109135+0000","last_clean":"2023-10-08T07:09:35.109135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:35.109135+0000","last_undegraded":"2023-10-08T07:09:35.109135+0000","last_fullsized":"2023-10-08T07:09:35.109135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5825,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108074+0000","last_change":"2023-10-08T07:09:21.036901+0000","last_active":"2023-10-08T07:09:35.108074+0000","last_peered":"2023-10-08T07:09:35.108074+0000","last_clean":"2023-10-08T07:09:35.108074+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:09:35.108074+0000","last_undegraded":"2023-10-08T07:09:35.108074+0000","last_fullsized":"2023-10-08T07:09:35.108074+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:44:57.453475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109892+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:35.109892+0000","last_peered":"2023-10-08T07:09:35.109892+0000","last_clean":"2023-10-08T07:09:35.109892+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:35.109892+0000","last_undegraded":"2023-10-08T07:09:35.109892+0000","last_fullsized":"2023-10-08T07:09:35.109892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2941,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108860+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:09:35.108860+0000","last_peered":"2023-10-08T07:09:35.108860+0000","last_clean":"2023-10-08T07:09:35.108860+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:09:35.108860+0000","last_undegraded":"2023-10-08T07:09:35.108860+0000","last_fullsized":"2023-10-08T07:09:35.108860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"67'7","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182792+0000","last_change":"2023-10-08T07:09:17.758979+0000","last_active":"2023-10-08T07:09:35.182792+0000","last_peered":"2023-10-08T07:09:35.182792+0000","last_clean":"2023-10-08T07:09:35.182792+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:09:35.182792+0000","last_undegraded":"2023-10-08T07:09:35.182792+0000","last_fullsized":"2023-10-08T07:09:35.182792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:06.386900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108369+0000","last_change":"2023-10-08T07:09:18.064856+0000","last_active":"2023-10-08T07:09:35.108369+0000","last_peered":"2023-10-08T07:09:35.108369+0000","last_clean":"2023-10-08T07:09:35.108369+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:35.108369+0000","last_undegraded":"2023-10-08T07:09:35.108369+0000","last_fullsized":"2023-10-08T07:09:35.108369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.230654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":189,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109611+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:35.109611+0000","last_peered":"2023-10-08T07:09:35.109611+0000","last_clean":"2023-10-08T07:09:35.109611+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:35.109611+0000","last_undegraded":"2023-10-08T07:09:35.109611+0000","last_fullsized":"2023-10-08T07:09:35.109611+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2948,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.110046+0000","last_change":"2023-10-08T07:09:21.038587+0000","last_active":"2023-10-08T07:09:35.110046+0000","last_peered":"2023-10-08T07:09:35.110046+0000","last_clean":"2023-10-08T07:09:35.110046+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:09:35.110046+0000","last_undegraded":"2023-10-08T07:09:35.110046+0000","last_fullsized":"2023-10-08T07:09:35.110046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:50.835623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109696+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:09:35.109696+0000","last_peered":"2023-10-08T07:09:35.109696+0000","last_clean":"2023-10-08T07:09:35.109696+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:09:35.109696+0000","last_undegraded":"2023-10-08T07:09:35.109696+0000","last_fullsized":"2023-10-08T07:09:35.109696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2943,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183227+0000","last_change":"2023-10-08T07:09:20.737135+0000","last_active":"2023-10-08T07:09:35.183227+0000","last_peered":"2023-10-08T07:09:35.183227+0000","last_clean":"2023-10-08T07:09:35.183227+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:09:35.183227+0000","last_undegraded":"2023-10-08T07:09:35.183227+0000","last_fullsized":"2023-10-08T07:09:35.183227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:52.474047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108478+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:09:35.108478+0000","last_peered":"2023-10-08T07:09:35.108478+0000","last_clean":"2023-10-08T07:09:35.108478+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:09:35.108478+0000","last_undegraded":"2023-10-08T07:09:35.108478+0000","last_fullsized":"2023-10-08T07:09:35.108478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8822,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183486+0000","last_change":"2023-10-08T07:09:20.737857+0000","last_active":"2023-10-08T07:09:35.183486+0000","last_peered":"2023-10-08T07:09:35.183486+0000","last_clean":"2023-10-08T07:09:35.183486+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:09:35.183486+0000","last_undegraded":"2023-10-08T07:09:35.183486+0000","last_fullsized":"2023-10-08T07:09:35.183486+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:56.740198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182158+0000","last_change":"2023-10-08T07:09:17.751068+0000","last_active":"2023-10-08T07:09:35.182158+0000","last_peered":"2023-10-08T07:09:35.182158+0000","last_clean":"2023-10-08T07:09:35.182158+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:09:35.182158+0000","last_undegraded":"2023-10-08T07:09:35.182158+0000","last_fullsized":"2023-10-08T07:09:35.182158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:15.155530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2924,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109141+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:09:35.109141+0000","last_peered":"2023-10-08T07:09:35.109141+0000","last_clean":"2023-10-08T07:09:35.109141+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:09:35.109141+0000","last_undegraded":"2023-10-08T07:09:35.109141+0000","last_fullsized":"2023-10-08T07:09:35.109141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'9","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109028+0000","last_change":"2023-10-08T07:09:18.054836+0000","last_active":"2023-10-08T07:09:35.109028+0000","last_peered":"2023-10-08T07:09:35.109028+0000","last_clean":"2023-10-08T07:09:35.109028+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:09:35.109028+0000","last_undegraded":"2023-10-08T07:09:35.109028+0000","last_fullsized":"2023-10-08T07:09:35.109028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:16.567958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109238+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:09:35.109238+0000","last_peered":"2023-10-08T07:09:35.109238+0000","last_clean":"2023-10-08T07:09:35.109238+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:09:35.109238+0000","last_undegraded":"2023-10-08T07:09:35.109238+0000","last_fullsized":"2023-10-08T07:09:35.109238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109969+0000","last_change":"2023-10-08T07:09:18.056757+0000","last_active":"2023-10-08T07:09:35.109969+0000","last_peered":"2023-10-08T07:09:35.109969+0000","last_clean":"2023-10-08T07:09:35.109969+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:09:35.109969+0000","last_undegraded":"2023-10-08T07:09:35.109969+0000","last_fullsized":"2023-10-08T07:09:35.109969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:47.575148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182122+0000","last_change":"2023-10-08T07:09:17.753129+0000","last_active":"2023-10-08T07:09:35.182122+0000","last_peered":"2023-10-08T07:09:35.182122+0000","last_clean":"2023-10-08T07:09:35.182122+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:09:35.182122+0000","last_undegraded":"2023-10-08T07:09:35.182122+0000","last_fullsized":"2023-10-08T07:09:35.182122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:53.133780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183472+0000","last_change":"2023-10-08T07:09:17.753124+0000","last_active":"2023-10-08T07:09:35.183472+0000","last_peered":"2023-10-08T07:09:35.183472+0000","last_clean":"2023-10-08T07:09:35.183472+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:09:35.183472+0000","last_undegraded":"2023-10-08T07:09:35.183472+0000","last_fullsized":"2023-10-08T07:09:35.183472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.689880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3000,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182330+0000","last_change":"2023-10-08T07:09:20.737843+0000","last_active":"2023-10-08T07:09:35.182330+0000","last_peered":"2023-10-08T07:09:35.182330+0000","last_clean":"2023-10-08T07:09:35.182330+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:09:35.182330+0000","last_undegraded":"2023-10-08T07:09:35.182330+0000","last_fullsized":"2023-10-08T07:09:35.182330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:58.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109742+0000","last_change":"2023-10-08T07:09:18.057034+0000","last_active":"2023-10-08T07:09:35.109742+0000","last_peered":"2023-10-08T07:09:35.109742+0000","last_clean":"2023-10-08T07:09:35.109742+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:09:35.109742+0000","last_undegraded":"2023-10-08T07:09:35.109742+0000","last_fullsized":"2023-10-08T07:09:35.109742+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:42.006586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2947,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109223+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:09:35.109223+0000","last_peered":"2023-10-08T07:09:35.109223+0000","last_clean":"2023-10-08T07:09:35.109223+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:09:35.109223+0000","last_undegraded":"2023-10-08T07:09:35.109223+0000","last_fullsized":"2023-10-08T07:09:35.109223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109356+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:35.109356+0000","last_peered":"2023-10-08T07:09:35.109356+0000","last_clean":"2023-10-08T07:09:35.109356+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:35.109356+0000","last_undegraded":"2023-10-08T07:09:35.109356+0000","last_fullsized":"2023-10-08T07:09:35.109356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":2992,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108605+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:09:35.108605+0000","last_peered":"2023-10-08T07:09:35.108605+0000","last_clean":"2023-10-08T07:09:35.108605+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:35.108605+0000","last_undegraded":"2023-10-08T07:09:35.108605+0000","last_fullsized":"2023-10-08T07:09:35.108605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'3","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108542+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:09:35.108542+0000","last_peered":"2023-10-08T07:09:35.108542+0000","last_clean":"2023-10-08T07:09:35.108542+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:09:35.108542+0000","last_undegraded":"2023-10-08T07:09:35.108542+0000","last_fullsized":"2023-10-08T07:09:35.108542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5930,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109441+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:09:35.109441+0000","last_peered":"2023-10-08T07:09:35.109441+0000","last_clean":"2023-10-08T07:09:35.109441+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:35.109441+0000","last_undegraded":"2023-10-08T07:09:35.109441+0000","last_fullsized":"2023-10-08T07:09:35.109441+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109090+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:09:35.109090+0000","last_peered":"2023-10-08T07:09:35.109090+0000","last_clean":"2023-10-08T07:09:35.109090+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:09:35.109090+0000","last_undegraded":"2023-10-08T07:09:35.109090+0000","last_fullsized":"2023-10-08T07:09:35.109090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109993+0000","last_change":"2023-10-08T07:09:18.058346+0000","last_active":"2023-10-08T07:09:35.109993+0000","last_peered":"2023-10-08T07:09:35.109993+0000","last_clean":"2023-10-08T07:09:35.109993+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:09:35.109993+0000","last_undegraded":"2023-10-08T07:09:35.109993+0000","last_fullsized":"2023-10-08T07:09:35.109993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:51.958399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182484+0000","last_change":"2023-10-08T07:09:17.752745+0000","last_active":"2023-10-08T07:09:35.182484+0000","last_peered":"2023-10-08T07:09:35.182484+0000","last_clean":"2023-10-08T07:09:35.182484+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:09:35.182484+0000","last_undegraded":"2023-10-08T07:09:35.182484+0000","last_fullsized":"2023-10-08T07:09:35.182484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:08.404190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5935,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109869+0000","last_change":"2023-10-08T07:09:21.040694+0000","last_active":"2023-10-08T07:09:35.109869+0000","last_peered":"2023-10-08T07:09:35.109869+0000","last_clean":"2023-10-08T07:09:35.109869+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:09:35.109869+0000","last_undegraded":"2023-10-08T07:09:35.109869+0000","last_fullsized":"2023-10-08T07:09:35.109869+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:41.813249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182364+0000","last_change":"2023-10-08T07:09:17.754898+0000","last_active":"2023-10-08T07:09:35.182364+0000","last_peered":"2023-10-08T07:09:35.182364+0000","last_clean":"2023-10-08T07:09:35.182364+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:09:35.182364+0000","last_undegraded":"2023-10-08T07:09:35.182364+0000","last_fullsized":"2023-10-08T07:09:35.182364+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:19.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2950,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109068+0000","last_change":"2023-10-08T07:09:21.042008+0000","last_active":"2023-10-08T07:09:35.109068+0000","last_peered":"2023-10-08T07:09:35.109068+0000","last_clean":"2023-10-08T07:09:35.109068+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:09:35.109068+0000","last_undegraded":"2023-10-08T07:09:35.109068+0000","last_fullsized":"2023-10-08T07:09:35.109068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:32:00.347477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110127+0000","last_change":"2023-10-08T07:09:18.057444+0000","last_active":"2023-10-08T07:09:36.110127+0000","last_peered":"2023-10-08T07:09:36.110127+0000","last_clean":"2023-10-08T07:09:36.110127+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:09:36.110127+0000","last_undegraded":"2023-10-08T07:09:36.110127+0000","last_fullsized":"2023-10-08T07:09:36.110127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:06:13.088433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109847+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:09:35.109847+0000","last_peered":"2023-10-08T07:09:35.109847+0000","last_clean":"2023-10-08T07:09:35.109847+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:09:35.109847+0000","last_undegraded":"2023-10-08T07:09:35.109847+0000","last_fullsized":"2023-10-08T07:09:35.109847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5851,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182483+0000","last_change":"2023-10-08T07:09:20.735892+0000","last_active":"2023-10-08T07:09:35.182483+0000","last_peered":"2023-10-08T07:09:35.182483+0000","last_clean":"2023-10-08T07:09:35.182483+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:09:35.182483+0000","last_undegraded":"2023-10-08T07:09:35.182483+0000","last_fullsized":"2023-10-08T07:09:35.182483+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:02.889299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111212+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:09:36.111212+0000","last_peered":"2023-10-08T07:09:36.111212+0000","last_clean":"2023-10-08T07:09:36.111212+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:09:36.111212+0000","last_undegraded":"2023-10-08T07:09:36.111212+0000","last_fullsized":"2023-10-08T07:09:36.111212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109450+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:09:35.109450+0000","last_peered":"2023-10-08T07:09:35.109450+0000","last_clean":"2023-10-08T07:09:35.109450+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:09:35.109450+0000","last_undegraded":"2023-10-08T07:09:35.109450+0000","last_fullsized":"2023-10-08T07:09:35.109450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2958,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108810+0000","last_change":"2023-10-08T07:09:21.040185+0000","last_active":"2023-10-08T07:09:35.108810+0000","last_peered":"2023-10-08T07:09:35.108810+0000","last_clean":"2023-10-08T07:09:35.108810+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:09:35.108810+0000","last_undegraded":"2023-10-08T07:09:35.108810+0000","last_fullsized":"2023-10-08T07:09:35.108810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:50.835623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109492+0000","last_change":"2023-10-08T07:09:18.067783+0000","last_active":"2023-10-08T07:09:36.109492+0000","last_peered":"2023-10-08T07:09:36.109492+0000","last_clean":"2023-10-08T07:09:36.109492+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:09:36.109492+0000","last_undegraded":"2023-10-08T07:09:36.109492+0000","last_fullsized":"2023-10-08T07:09:36.109492+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:11.554943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182723+0000","last_change":"2023-10-08T07:09:17.752755+0000","last_active":"2023-10-08T07:09:35.182723+0000","last_peered":"2023-10-08T07:09:35.182723+0000","last_clean":"2023-10-08T07:09:35.182723+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:09:35.182723+0000","last_undegraded":"2023-10-08T07:09:35.182723+0000","last_fullsized":"2023-10-08T07:09:35.182723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:23.696397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8917,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109189+0000","last_change":"2023-10-08T07:09:21.042220+0000","last_active":"2023-10-08T07:09:35.109189+0000","last_peered":"2023-10-08T07:09:35.109189+0000","last_clean":"2023-10-08T07:09:35.109189+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:09:35.109189+0000","last_undegraded":"2023-10-08T07:09:35.109189+0000","last_fullsized":"2023-10-08T07:09:35.109189+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:33.242389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111323+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:09:36.111323+0000","last_peered":"2023-10-08T07:09:36.111323+0000","last_clean":"2023-10-08T07:09:36.111323+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:09:36.111323+0000","last_undegraded":"2023-10-08T07:09:36.111323+0000","last_fullsized":"2023-10-08T07:09:36.111323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":299,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108760+0000","last_change":"2023-10-08T07:09:18.052234+0000","last_active":"2023-10-08T07:09:35.108760+0000","last_peered":"2023-10-08T07:09:35.108760+0000","last_clean":"2023-10-08T07:09:35.108760+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:09:35.108760+0000","last_undegraded":"2023-10-08T07:09:35.108760+0000","last_fullsized":"2023-10-08T07:09:35.108760+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:02:56.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108336+0000","last_change":"2023-10-08T07:09:18.049984+0000","last_active":"2023-10-08T07:09:35.108336+0000","last_peered":"2023-10-08T07:09:35.108336+0000","last_clean":"2023-10-08T07:09:35.108336+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:09:35.108336+0000","last_undegraded":"2023-10-08T07:09:35.108336+0000","last_fullsized":"2023-10-08T07:09:35.108336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:59:20.880943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5902,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109931+0000","last_change":"2023-10-08T07:09:21.040684+0000","last_active":"2023-10-08T07:09:35.109931+0000","last_peered":"2023-10-08T07:09:35.109931+0000","last_clean":"2023-10-08T07:09:35.109931+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:09:35.109931+0000","last_undegraded":"2023-10-08T07:09:35.109931+0000","last_fullsized":"2023-10-08T07:09:35.109931+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:14.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108874+0000","last_change":"2023-10-08T07:09:18.051593+0000","last_active":"2023-10-08T07:09:35.108874+0000","last_peered":"2023-10-08T07:09:35.108874+0000","last_clean":"2023-10-08T07:09:35.108874+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:09:35.108874+0000","last_undegraded":"2023-10-08T07:09:35.108874+0000","last_fullsized":"2023-10-08T07:09:35.108874+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:34.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108212+0000","last_change":"2023-10-08T07:09:25.038493+0000","last_active":"2023-10-08T07:09:35.108212+0000","last_peered":"2023-10-08T07:09:35.108212+0000","last_clean":"2023-10-08T07:09:35.108212+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:09:35.108212+0000","last_undegraded":"2023-10-08T07:09:35.108212+0000","last_fullsized":"2023-10-08T07:09:35.108212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:44.616324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183181+0000","last_change":"2023-10-08T07:09:17.755079+0000","last_active":"2023-10-08T07:09:35.183181+0000","last_peered":"2023-10-08T07:09:35.183181+0000","last_clean":"2023-10-08T07:09:35.183181+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:09:35.183181+0000","last_undegraded":"2023-10-08T07:09:35.183181+0000","last_fullsized":"2023-10-08T07:09:35.183181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:12.238239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183205+0000","last_change":"2023-10-08T07:09:17.754844+0000","last_active":"2023-10-08T07:09:35.183205+0000","last_peered":"2023-10-08T07:09:35.183205+0000","last_clean":"2023-10-08T07:09:35.183205+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:35.183205+0000","last_undegraded":"2023-10-08T07:09:35.183205+0000","last_fullsized":"2023-10-08T07:09:35.183205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:12.129220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108682+0000","last_change":"2023-10-08T07:09:18.056208+0000","last_active":"2023-10-08T07:09:35.108682+0000","last_peered":"2023-10-08T07:09:35.108682+0000","last_clean":"2023-10-08T07:09:35.108682+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:09:35.108682+0000","last_undegraded":"2023-10-08T07:09:35.108682+0000","last_fullsized":"2023-10-08T07:09:35.108682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:55.549444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182645+0000","last_change":"2023-10-08T07:09:17.753144+0000","last_active":"2023-10-08T07:09:35.182645+0000","last_peered":"2023-10-08T07:09:35.182645+0000","last_clean":"2023-10-08T07:09:35.182645+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:09:35.182645+0000","last_undegraded":"2023-10-08T07:09:35.182645+0000","last_fullsized":"2023-10-08T07:09:35.182645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:25.968547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'3","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109045+0000","last_change":"2023-10-08T07:09:18.059238+0000","last_active":"2023-10-08T07:09:35.109045+0000","last_peered":"2023-10-08T07:09:35.109045+0000","last_clean":"2023-10-08T07:09:35.109045+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:09:35.109045+0000","last_undegraded":"2023-10-08T07:09:35.109045+0000","last_fullsized":"2023-10-08T07:09:35.109045+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:32.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109103+0000","last_change":"2023-10-08T07:09:18.056706+0000","last_active":"2023-10-08T07:09:35.109103+0000","last_peered":"2023-10-08T07:09:35.109103+0000","last_clean":"2023-10-08T07:09:35.109103+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:09:35.109103+0000","last_undegraded":"2023-10-08T07:09:35.109103+0000","last_fullsized":"2023-10-08T07:09:35.109103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:17.258824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2988,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108033+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:09:35.108033+0000","last_peered":"2023-10-08T07:09:35.108033+0000","last_clean":"2023-10-08T07:09:35.108033+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:35.108033+0000","last_undegraded":"2023-10-08T07:09:35.108033+0000","last_fullsized":"2023-10-08T07:09:35.108033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.110033+0000","last_change":"2023-10-08T07:09:18.054661+0000","last_active":"2023-10-08T07:09:35.110033+0000","last_peered":"2023-10-08T07:09:35.110033+0000","last_clean":"2023-10-08T07:09:35.110033+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:09:35.110033+0000","last_undegraded":"2023-10-08T07:09:35.110033+0000","last_fullsized":"2023-10-08T07:09:35.110033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:10.492782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"69'9","reported_seq":94,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108910+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:09:35.108910+0000","last_peered":"2023-10-08T07:09:35.108910+0000","last_clean":"2023-10-08T07:09:35.108910+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:09:35.108910+0000","last_undegraded":"2023-10-08T07:09:35.108910+0000","last_fullsized":"2023-10-08T07:09:35.108910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2962,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182541+0000","last_change":"2023-10-08T07:09:20.735652+0000","last_active":"2023-10-08T07:09:35.182541+0000","last_peered":"2023-10-08T07:09:35.182541+0000","last_clean":"2023-10-08T07:09:35.182541+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:09:35.182541+0000","last_undegraded":"2023-10-08T07:09:35.182541+0000","last_fullsized":"2023-10-08T07:09:35.182541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:15.857716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182410+0000","last_change":"2023-10-08T07:09:22.762216+0000","last_active":"2023-10-08T07:09:35.182410+0000","last_peered":"2023-10-08T07:09:35.182410+0000","last_clean":"2023-10-08T07:09:35.182410+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:35.182410+0000","last_undegraded":"2023-10-08T07:09:35.182410+0000","last_fullsized":"2023-10-08T07:09:35.182410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:49.404736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183153+0000","last_change":"2023-10-08T07:09:24.732784+0000","last_active":"2023-10-08T07:09:35.183153+0000","last_peered":"2023-10-08T07:09:35.183153+0000","last_clean":"2023-10-08T07:09:35.183153+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:09:35.183153+0000","last_undegraded":"2023-10-08T07:09:35.183153+0000","last_fullsized":"2023-10-08T07:09:35.183153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:25.502260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109487+0000","last_change":"2023-10-08T07:09:23.066235+0000","last_active":"2023-10-08T07:09:35.109487+0000","last_peered":"2023-10-08T07:09:35.109487+0000","last_clean":"2023-10-08T07:09:35.109487+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:09:35.109487+0000","last_undegraded":"2023-10-08T07:09:35.109487+0000","last_fullsized":"2023-10-08T07:09:35.109487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:42.060351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5890,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109543+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:09:35.109543+0000","last_peered":"2023-10-08T07:09:35.109543+0000","last_clean":"2023-10-08T07:09:35.109543+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:09:35.109543+0000","last_undegraded":"2023-10-08T07:09:35.109543+0000","last_fullsized":"2023-10-08T07:09:35.109543+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182938+0000","last_change":"2023-10-08T07:09:17.753543+0000","last_active":"2023-10-08T07:09:35.182938+0000","last_peered":"2023-10-08T07:09:35.182938+0000","last_clean":"2023-10-08T07:09:35.182938+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:09:35.182938+0000","last_undegraded":"2023-10-08T07:09:35.182938+0000","last_fullsized":"2023-10-08T07:09:35.182938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:51.956560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3009,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109233+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:35.109233+0000","last_peered":"2023-10-08T07:09:35.109233+0000","last_clean":"2023-10-08T07:09:35.109233+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:35.109233+0000","last_undegraded":"2023-10-08T07:09:35.109233+0000","last_fullsized":"2023-10-08T07:09:35.109233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109221+0000","last_change":"2023-10-08T07:09:18.057710+0000","last_active":"2023-10-08T07:09:35.109221+0000","last_peered":"2023-10-08T07:09:35.109221+0000","last_clean":"2023-10-08T07:09:35.109221+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:09:35.109221+0000","last_undegraded":"2023-10-08T07:09:35.109221+0000","last_fullsized":"2023-10-08T07:09:35.109221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:49.694705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5871,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182257+0000","last_change":"2023-10-08T07:09:20.734404+0000","last_active":"2023-10-08T07:09:35.182257+0000","last_peered":"2023-10-08T07:09:35.182257+0000","last_clean":"2023-10-08T07:09:35.182257+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:09:35.182257+0000","last_undegraded":"2023-10-08T07:09:35.182257+0000","last_fullsized":"2023-10-08T07:09:35.182257+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:04:28.453406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":89,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109149+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:09:35.109149+0000","last_peered":"2023-10-08T07:09:35.109149+0000","last_clean":"2023-10-08T07:09:35.109149+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:09:35.109149+0000","last_undegraded":"2023-10-08T07:09:35.109149+0000","last_fullsized":"2023-10-08T07:09:35.109149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109047+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:09:35.109047+0000","last_peered":"2023-10-08T07:09:35.109047+0000","last_clean":"2023-10-08T07:09:35.109047+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:09:35.109047+0000","last_undegraded":"2023-10-08T07:09:35.109047+0000","last_fullsized":"2023-10-08T07:09:35.109047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8807,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108915+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:09:35.108915+0000","last_peered":"2023-10-08T07:09:35.108915+0000","last_clean":"2023-10-08T07:09:35.108915+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:09:35.108915+0000","last_undegraded":"2023-10-08T07:09:35.108915+0000","last_fullsized":"2023-10-08T07:09:35.108915+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3001,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108201+0000","last_change":"2023-10-08T07:09:21.036530+0000","last_active":"2023-10-08T07:09:35.108201+0000","last_peered":"2023-10-08T07:09:35.108201+0000","last_clean":"2023-10-08T07:09:35.108201+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:09:35.108201+0000","last_undegraded":"2023-10-08T07:09:35.108201+0000","last_fullsized":"2023-10-08T07:09:35.108201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:41:49.285073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182677+0000","last_change":"2023-10-08T07:09:17.754585+0000","last_active":"2023-10-08T07:09:35.182677+0000","last_peered":"2023-10-08T07:09:35.182677+0000","last_clean":"2023-10-08T07:09:35.182677+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:09:35.182677+0000","last_undegraded":"2023-10-08T07:09:35.182677+0000","last_fullsized":"2023-10-08T07:09:35.182677+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:44.969079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108686+0000","last_change":"2023-10-08T07:09:18.056756+0000","last_active":"2023-10-08T07:09:35.108686+0000","last_peered":"2023-10-08T07:09:35.108686+0000","last_clean":"2023-10-08T07:09:35.108686+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:35.108686+0000","last_undegraded":"2023-10-08T07:09:35.108686+0000","last_fullsized":"2023-10-08T07:09:35.108686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:21:49.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2974,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182686+0000","last_change":"2023-10-08T07:09:20.735423+0000","last_active":"2023-10-08T07:09:35.182686+0000","last_peered":"2023-10-08T07:09:35.182686+0000","last_clean":"2023-10-08T07:09:35.182686+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:09:35.182686+0000","last_undegraded":"2023-10-08T07:09:35.182686+0000","last_fullsized":"2023-10-08T07:09:35.182686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:52.216576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595772,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776068,"statfs":{"total":96636764160,"available":96026693632,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59499999999999997,"15min":0.49199999999999999},"min":{"1min":0.35499999999999998,"5min":0.188,"15min":0.188},"max":{"1min":0.76200000000000001,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.60499999999999998,"15min":0.505},"min":{"1min":0.372,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.66300000000000003,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.31}]},{"osd":1,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.55800000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483920,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887920,"statfs":{"total":96636764160,"available":96141230080,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.54300000000000004}]},{"osd":2,"last update":"Sun Oct 8 07:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.1910000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.36399999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.90700000000000003,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":74,"seq":317827579910,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":1704,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":1744896,"data_stored":1216013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:09:41.032 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2023-10-08T07:09:41.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2023-10-08T07:09:41.429 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-08T07:09:41.439 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T07:09:41.439 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:09:41.781 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:09:41.782 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:09:41.793 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-10-08T07:09:40.570113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149186,"ondisk_log_size":149186,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145028,"kb_used_data":4300,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970492,"statfs":{"total":289910292480,"available":288737783808,"internally_reserved":0,"allocated":4403200,"data_stored":2813678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.471654"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":2999,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183536+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:35.183536+0000","last_peered":"2023-10-08T07:09:35.183536+0000","last_clean":"2023-10-08T07:09:35.183536+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:35.183536+0000","last_undegraded":"2023-10-08T07:09:35.183536+0000","last_fullsized":"2023-10-08T07:09:35.183536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:13.308715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2900,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183152+0000","last_change":"2023-10-08T07:09:20.737069+0000","last_active":"2023-10-08T07:09:35.183152+0000","last_peered":"2023-10-08T07:09:35.183152+0000","last_clean":"2023-10-08T07:09:35.183152+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:35.183152+0000","last_undegraded":"2023-10-08T07:09:35.183152+0000","last_fullsized":"2023-10-08T07:09:35.183152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:03.307776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109869+0000","last_change":"2023-10-08T07:09:18.056834+0000","last_active":"2023-10-08T07:09:35.109869+0000","last_peered":"2023-10-08T07:09:35.109869+0000","last_clean":"2023-10-08T07:09:35.109869+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:09:35.109869+0000","last_undegraded":"2023-10-08T07:09:35.109869+0000","last_fullsized":"2023-10-08T07:09:35.109869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:16.520645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109745+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:09:35.109745+0000","last_peered":"2023-10-08T07:09:35.109745+0000","last_clean":"2023-10-08T07:09:35.109745+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:09:35.109745+0000","last_undegraded":"2023-10-08T07:09:35.109745+0000","last_fullsized":"2023-10-08T07:09:35.109745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5889,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182831+0000","last_change":"2023-10-08T07:09:20.736694+0000","last_active":"2023-10-08T07:09:35.182831+0000","last_peered":"2023-10-08T07:09:35.182831+0000","last_clean":"2023-10-08T07:09:35.182831+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:09:35.182831+0000","last_undegraded":"2023-10-08T07:09:35.182831+0000","last_fullsized":"2023-10-08T07:09:35.182831+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:19:45.353931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8571,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109046+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:09:35.109046+0000","last_peered":"2023-10-08T07:09:35.109046+0000","last_clean":"2023-10-08T07:09:35.109046+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:09:35.109046+0000","last_undegraded":"2023-10-08T07:09:35.109046+0000","last_fullsized":"2023-10-08T07:09:35.109046+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108839+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:09:35.108839+0000","last_peered":"2023-10-08T07:09:35.108839+0000","last_clean":"2023-10-08T07:09:35.108839+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:35.108839+0000","last_undegraded":"2023-10-08T07:09:35.108839+0000","last_fullsized":"2023-10-08T07:09:35.108839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3039,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108687+0000","last_change":"2023-10-08T07:09:28.078167+0000","last_active":"2023-10-08T07:09:35.108687+0000","last_peered":"2023-10-08T07:09:35.108687+0000","last_clean":"2023-10-08T07:09:35.108687+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:09:35.108687+0000","last_undegraded":"2023-10-08T07:09:35.108687+0000","last_fullsized":"2023-10-08T07:09:35.108687+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:51.764425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2883,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108902+0000","last_change":"2023-10-08T07:09:21.041511+0000","last_active":"2023-10-08T07:09:35.108902+0000","last_peered":"2023-10-08T07:09:35.108902+0000","last_clean":"2023-10-08T07:09:35.108902+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:35.108902+0000","last_undegraded":"2023-10-08T07:09:35.108902+0000","last_fullsized":"2023-10-08T07:09:35.108902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:41.813249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2956,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183330+0000","last_change":"2023-10-08T07:09:20.737658+0000","last_active":"2023-10-08T07:09:35.183330+0000","last_peered":"2023-10-08T07:09:35.183330+0000","last_clean":"2023-10-08T07:09:35.183330+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:09:35.183330+0000","last_undegraded":"2023-10-08T07:09:35.183330+0000","last_fullsized":"2023-10-08T07:09:35.183330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:36.077873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109454+0000","last_change":"2023-10-08T07:09:23.063882+0000","last_active":"2023-10-08T07:09:35.109454+0000","last_peered":"2023-10-08T07:09:35.109454+0000","last_clean":"2023-10-08T07:09:35.109454+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:09:35.109454+0000","last_undegraded":"2023-10-08T07:09:35.109454+0000","last_fullsized":"2023-10-08T07:09:35.109454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:33.242389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2961,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182940+0000","last_change":"2023-10-08T07:09:20.736199+0000","last_active":"2023-10-08T07:09:35.182940+0000","last_peered":"2023-10-08T07:09:35.182940+0000","last_clean":"2023-10-08T07:09:35.182940+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:35.182940+0000","last_undegraded":"2023-10-08T07:09:35.182940+0000","last_fullsized":"2023-10-08T07:09:35.182940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.663562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182912+0000","last_change":"2023-10-08T07:09:17.754638+0000","last_active":"2023-10-08T07:09:35.182912+0000","last_peered":"2023-10-08T07:09:35.182912+0000","last_clean":"2023-10-08T07:09:35.182912+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:09:35.182912+0000","last_undegraded":"2023-10-08T07:09:35.182912+0000","last_fullsized":"2023-10-08T07:09:35.182912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:12.379792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2977,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109469+0000","last_change":"2023-10-08T07:09:21.040638+0000","last_active":"2023-10-08T07:09:35.109469+0000","last_peered":"2023-10-08T07:09:35.109469+0000","last_clean":"2023-10-08T07:09:35.109469+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:09:35.109469+0000","last_undegraded":"2023-10-08T07:09:35.109469+0000","last_fullsized":"2023-10-08T07:09:35.109469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:13.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5866,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108990+0000","last_change":"2023-10-08T07:09:26.042339+0000","last_active":"2023-10-08T07:09:35.108990+0000","last_peered":"2023-10-08T07:09:35.108990+0000","last_clean":"2023-10-08T07:09:35.108990+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:09:35.108990+0000","last_undegraded":"2023-10-08T07:09:35.108990+0000","last_fullsized":"2023-10-08T07:09:35.108990+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:24:41.696448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2982,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108787+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:09:35.108787+0000","last_peered":"2023-10-08T07:09:35.108787+0000","last_clean":"2023-10-08T07:09:35.108787+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:09:35.108787+0000","last_undegraded":"2023-10-08T07:09:35.108787+0000","last_fullsized":"2023-10-08T07:09:35.108787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2981,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108994+0000","last_change":"2023-10-08T07:09:21.041706+0000","last_active":"2023-10-08T07:09:35.108994+0000","last_peered":"2023-10-08T07:09:35.108994+0000","last_clean":"2023-10-08T07:09:35.108994+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:09:35.108994+0000","last_undegraded":"2023-10-08T07:09:35.108994+0000","last_fullsized":"2023-10-08T07:09:35.108994+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:13.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183023+0000","last_change":"2023-10-08T07:09:17.754747+0000","last_active":"2023-10-08T07:09:35.183023+0000","last_peered":"2023-10-08T07:09:35.183023+0000","last_clean":"2023-10-08T07:09:35.183023+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:09:35.183023+0000","last_undegraded":"2023-10-08T07:09:35.183023+0000","last_fullsized":"2023-10-08T07:09:35.183023+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:47.075369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2962,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108922+0000","last_change":"2023-10-08T07:09:21.039966+0000","last_active":"2023-10-08T07:09:35.108922+0000","last_peered":"2023-10-08T07:09:35.108922+0000","last_clean":"2023-10-08T07:09:35.108922+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:09:35.108922+0000","last_undegraded":"2023-10-08T07:09:35.108922+0000","last_fullsized":"2023-10-08T07:09:35.108922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:14.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2973,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109672+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:09:35.109672+0000","last_peered":"2023-10-08T07:09:35.109672+0000","last_clean":"2023-10-08T07:09:35.109672+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:09:35.109672+0000","last_undegraded":"2023-10-08T07:09:35.109672+0000","last_fullsized":"2023-10-08T07:09:35.109672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5892,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109302+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:09:35.109302+0000","last_peered":"2023-10-08T07:09:35.109302+0000","last_clean":"2023-10-08T07:09:35.109302+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:09:35.109302+0000","last_undegraded":"2023-10-08T07:09:35.109302+0000","last_fullsized":"2023-10-08T07:09:35.109302+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2876,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182479+0000","last_change":"2023-10-08T07:09:20.735818+0000","last_active":"2023-10-08T07:09:35.182479+0000","last_peered":"2023-10-08T07:09:35.182479+0000","last_clean":"2023-10-08T07:09:35.182479+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:09:35.182479+0000","last_undegraded":"2023-10-08T07:09:35.182479+0000","last_fullsized":"2023-10-08T07:09:35.182479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:56.874136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2981,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108494+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:09:35.108494+0000","last_peered":"2023-10-08T07:09:35.108494+0000","last_clean":"2023-10-08T07:09:35.108494+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:35.108494+0000","last_undegraded":"2023-10-08T07:09:35.108494+0000","last_fullsized":"2023-10-08T07:09:35.108494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5837,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182023+0000","last_change":"2023-10-08T07:09:20.736822+0000","last_active":"2023-10-08T07:09:35.182023+0000","last_peered":"2023-10-08T07:09:35.182023+0000","last_clean":"2023-10-08T07:09:35.182023+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:35.182023+0000","last_undegraded":"2023-10-08T07:09:35.182023+0000","last_fullsized":"2023-10-08T07:09:35.182023+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:19.752508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2956,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183225+0000","last_change":"2023-10-08T07:09:20.735845+0000","last_active":"2023-10-08T07:09:35.183225+0000","last_peered":"2023-10-08T07:09:35.183225+0000","last_clean":"2023-10-08T07:09:35.183225+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:09:35.183225+0000","last_undegraded":"2023-10-08T07:09:35.183225+0000","last_fullsized":"2023-10-08T07:09:35.183225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.084033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2974,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109238+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:09:35.109238+0000","last_peered":"2023-10-08T07:09:35.109238+0000","last_clean":"2023-10-08T07:09:35.109238+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:09:35.109238+0000","last_undegraded":"2023-10-08T07:09:35.109238+0000","last_fullsized":"2023-10-08T07:09:35.109238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109732+0000","last_change":"2023-10-08T07:09:18.055530+0000","last_active":"2023-10-08T07:09:35.109732+0000","last_peered":"2023-10-08T07:09:35.109732+0000","last_clean":"2023-10-08T07:09:35.109732+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:35.109732+0000","last_undegraded":"2023-10-08T07:09:35.109732+0000","last_fullsized":"2023-10-08T07:09:35.109732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:01.783452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182304+0000","last_change":"2023-10-08T07:09:17.751957+0000","last_active":"2023-10-08T07:09:35.182304+0000","last_peered":"2023-10-08T07:09:35.182304+0000","last_clean":"2023-10-08T07:09:35.182304+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:09:35.182304+0000","last_undegraded":"2023-10-08T07:09:35.182304+0000","last_fullsized":"2023-10-08T07:09:35.182304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:13.104739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183354+0000","last_change":"2023-10-08T07:09:17.754513+0000","last_active":"2023-10-08T07:09:35.183354+0000","last_peered":"2023-10-08T07:09:35.183354+0000","last_clean":"2023-10-08T07:09:35.183354+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:35.183354+0000","last_undegraded":"2023-10-08T07:09:35.183354+0000","last_fullsized":"2023-10-08T07:09:35.183354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:06.336414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108669+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:09:35.108669+0000","last_peered":"2023-10-08T07:09:35.108669+0000","last_clean":"2023-10-08T07:09:35.108669+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:09:35.108669+0000","last_undegraded":"2023-10-08T07:09:35.108669+0000","last_fullsized":"2023-10-08T07:09:35.108669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109037+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:09:35.109037+0000","last_peered":"2023-10-08T07:09:35.109037+0000","last_clean":"2023-10-08T07:09:35.109037+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:09:35.109037+0000","last_undegraded":"2023-10-08T07:09:35.109037+0000","last_fullsized":"2023-10-08T07:09:35.109037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108261+0000","last_change":"2023-10-08T07:09:18.055607+0000","last_active":"2023-10-08T07:09:35.108261+0000","last_peered":"2023-10-08T07:09:35.108261+0000","last_clean":"2023-10-08T07:09:35.108261+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:09:35.108261+0000","last_undegraded":"2023-10-08T07:09:35.108261+0000","last_fullsized":"2023-10-08T07:09:35.108261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:09.952089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3025,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183742+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:35.183742+0000","last_peered":"2023-10-08T07:09:35.183742+0000","last_clean":"2023-10-08T07:09:35.183742+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:35.183742+0000","last_undegraded":"2023-10-08T07:09:35.183742+0000","last_fullsized":"2023-10-08T07:09:35.183742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:30.753981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:09:35.109135+0000","last_peered":"2023-10-08T07:09:35.109135+0000","last_clean":"2023-10-08T07:09:35.109135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:35.109135+0000","last_undegraded":"2023-10-08T07:09:35.109135+0000","last_fullsized":"2023-10-08T07:09:35.109135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5825,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108074+0000","last_change":"2023-10-08T07:09:21.036901+0000","last_active":"2023-10-08T07:09:35.108074+0000","last_peered":"2023-10-08T07:09:35.108074+0000","last_clean":"2023-10-08T07:09:35.108074+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:09:35.108074+0000","last_undegraded":"2023-10-08T07:09:35.108074+0000","last_fullsized":"2023-10-08T07:09:35.108074+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:44:57.453475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109892+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:35.109892+0000","last_peered":"2023-10-08T07:09:35.109892+0000","last_clean":"2023-10-08T07:09:35.109892+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:35.109892+0000","last_undegraded":"2023-10-08T07:09:35.109892+0000","last_fullsized":"2023-10-08T07:09:35.109892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2941,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108860+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:09:35.108860+0000","last_peered":"2023-10-08T07:09:35.108860+0000","last_clean":"2023-10-08T07:09:35.108860+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:09:35.108860+0000","last_undegraded":"2023-10-08T07:09:35.108860+0000","last_fullsized":"2023-10-08T07:09:35.108860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"67'7","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182792+0000","last_change":"2023-10-08T07:09:17.758979+0000","last_active":"2023-10-08T07:09:35.182792+0000","last_peered":"2023-10-08T07:09:35.182792+0000","last_clean":"2023-10-08T07:09:35.182792+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:09:35.182792+0000","last_undegraded":"2023-10-08T07:09:35.182792+0000","last_fullsized":"2023-10-08T07:09:35.182792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:06.386900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108369+0000","last_change":"2023-10-08T07:09:18.064856+0000","last_active":"2023-10-08T07:09:35.108369+0000","last_peered":"2023-10-08T07:09:35.108369+0000","last_clean":"2023-10-08T07:09:35.108369+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:35.108369+0000","last_undegraded":"2023-10-08T07:09:35.108369+0000","last_fullsized":"2023-10-08T07:09:35.108369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.230654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":189,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109611+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:35.109611+0000","last_peered":"2023-10-08T07:09:35.109611+0000","last_clean":"2023-10-08T07:09:35.109611+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:35.109611+0000","last_undegraded":"2023-10-08T07:09:35.109611+0000","last_fullsized":"2023-10-08T07:09:35.109611+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2948,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.110046+0000","last_change":"2023-10-08T07:09:21.038587+0000","last_active":"2023-10-08T07:09:35.110046+0000","last_peered":"2023-10-08T07:09:35.110046+0000","last_clean":"2023-10-08T07:09:35.110046+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:09:35.110046+0000","last_undegraded":"2023-10-08T07:09:35.110046+0000","last_fullsized":"2023-10-08T07:09:35.110046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:50.835623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109696+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:09:35.109696+0000","last_peered":"2023-10-08T07:09:35.109696+0000","last_clean":"2023-10-08T07:09:35.109696+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:09:35.109696+0000","last_undegraded":"2023-10-08T07:09:35.109696+0000","last_fullsized":"2023-10-08T07:09:35.109696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2943,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183227+0000","last_change":"2023-10-08T07:09:20.737135+0000","last_active":"2023-10-08T07:09:35.183227+0000","last_peered":"2023-10-08T07:09:35.183227+0000","last_clean":"2023-10-08T07:09:35.183227+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:09:35.183227+0000","last_undegraded":"2023-10-08T07:09:35.183227+0000","last_fullsized":"2023-10-08T07:09:35.183227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:52.474047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108478+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:09:35.108478+0000","last_peered":"2023-10-08T07:09:35.108478+0000","last_clean":"2023-10-08T07:09:35.108478+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:09:35.108478+0000","last_undegraded":"2023-10-08T07:09:35.108478+0000","last_fullsized":"2023-10-08T07:09:35.108478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8822,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183486+0000","last_change":"2023-10-08T07:09:20.737857+0000","last_active":"2023-10-08T07:09:35.183486+0000","last_peered":"2023-10-08T07:09:35.183486+0000","last_clean":"2023-10-08T07:09:35.183486+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:09:35.183486+0000","last_undegraded":"2023-10-08T07:09:35.183486+0000","last_fullsized":"2023-10-08T07:09:35.183486+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:56.740198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182158+0000","last_change":"2023-10-08T07:09:17.751068+0000","last_active":"2023-10-08T07:09:35.182158+0000","last_peered":"2023-10-08T07:09:35.182158+0000","last_clean":"2023-10-08T07:09:35.182158+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:09:35.182158+0000","last_undegraded":"2023-10-08T07:09:35.182158+0000","last_fullsized":"2023-10-08T07:09:35.182158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:15.155530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2924,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109141+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:09:35.109141+0000","last_peered":"2023-10-08T07:09:35.109141+0000","last_clean":"2023-10-08T07:09:35.109141+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:09:35.109141+0000","last_undegraded":"2023-10-08T07:09:35.109141+0000","last_fullsized":"2023-10-08T07:09:35.109141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'9","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109028+0000","last_change":"2023-10-08T07:09:18.054836+0000","last_active":"2023-10-08T07:09:35.109028+0000","last_peered":"2023-10-08T07:09:35.109028+0000","last_clean":"2023-10-08T07:09:35.109028+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:09:35.109028+0000","last_undegraded":"2023-10-08T07:09:35.109028+0000","last_fullsized":"2023-10-08T07:09:35.109028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:16.567958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109238+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:09:35.109238+0000","last_peered":"2023-10-08T07:09:35.109238+0000","last_clean":"2023-10-08T07:09:35.109238+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:09:35.109238+0000","last_undegraded":"2023-10-08T07:09:35.109238+0000","last_fullsized":"2023-10-08T07:09:35.109238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109969+0000","last_change":"2023-10-08T07:09:18.056757+0000","last_active":"2023-10-08T07:09:35.109969+0000","last_peered":"2023-10-08T07:09:35.109969+0000","last_clean":"2023-10-08T07:09:35.109969+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:09:35.109969+0000","last_undegraded":"2023-10-08T07:09:35.109969+0000","last_fullsized":"2023-10-08T07:09:35.109969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:47.575148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182122+0000","last_change":"2023-10-08T07:09:17.753129+0000","last_active":"2023-10-08T07:09:35.182122+0000","last_peered":"2023-10-08T07:09:35.182122+0000","last_clean":"2023-10-08T07:09:35.182122+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:09:35.182122+0000","last_undegraded":"2023-10-08T07:09:35.182122+0000","last_fullsized":"2023-10-08T07:09:35.182122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:53.133780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183472+0000","last_change":"2023-10-08T07:09:17.753124+0000","last_active":"2023-10-08T07:09:35.183472+0000","last_peered":"2023-10-08T07:09:35.183472+0000","last_clean":"2023-10-08T07:09:35.183472+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:09:35.183472+0000","last_undegraded":"2023-10-08T07:09:35.183472+0000","last_fullsized":"2023-10-08T07:09:35.183472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.689880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3000,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182330+0000","last_change":"2023-10-08T07:09:20.737843+0000","last_active":"2023-10-08T07:09:35.182330+0000","last_peered":"2023-10-08T07:09:35.182330+0000","last_clean":"2023-10-08T07:09:35.182330+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:09:35.182330+0000","last_undegraded":"2023-10-08T07:09:35.182330+0000","last_fullsized":"2023-10-08T07:09:35.182330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:58.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109742+0000","last_change":"2023-10-08T07:09:18.057034+0000","last_active":"2023-10-08T07:09:35.109742+0000","last_peered":"2023-10-08T07:09:35.109742+0000","last_clean":"2023-10-08T07:09:35.109742+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:09:35.109742+0000","last_undegraded":"2023-10-08T07:09:35.109742+0000","last_fullsized":"2023-10-08T07:09:35.109742+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:42.006586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2947,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109223+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:09:35.109223+0000","last_peered":"2023-10-08T07:09:35.109223+0000","last_clean":"2023-10-08T07:09:35.109223+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:09:35.109223+0000","last_undegraded":"2023-10-08T07:09:35.109223+0000","last_fullsized":"2023-10-08T07:09:35.109223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109356+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:35.109356+0000","last_peered":"2023-10-08T07:09:35.109356+0000","last_clean":"2023-10-08T07:09:35.109356+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:35.109356+0000","last_undegraded":"2023-10-08T07:09:35.109356+0000","last_fullsized":"2023-10-08T07:09:35.109356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":2992,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108605+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:09:35.108605+0000","last_peered":"2023-10-08T07:09:35.108605+0000","last_clean":"2023-10-08T07:09:35.108605+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:35.108605+0000","last_undegraded":"2023-10-08T07:09:35.108605+0000","last_fullsized":"2023-10-08T07:09:35.108605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'3","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108542+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:09:35.108542+0000","last_peered":"2023-10-08T07:09:35.108542+0000","last_clean":"2023-10-08T07:09:35.108542+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:09:35.108542+0000","last_undegraded":"2023-10-08T07:09:35.108542+0000","last_fullsized":"2023-10-08T07:09:35.108542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5930,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109441+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:09:35.109441+0000","last_peered":"2023-10-08T07:09:35.109441+0000","last_clean":"2023-10-08T07:09:35.109441+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:35.109441+0000","last_undegraded":"2023-10-08T07:09:35.109441+0000","last_fullsized":"2023-10-08T07:09:35.109441+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109090+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:09:35.109090+0000","last_peered":"2023-10-08T07:09:35.109090+0000","last_clean":"2023-10-08T07:09:35.109090+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:09:35.109090+0000","last_undegraded":"2023-10-08T07:09:35.109090+0000","last_fullsized":"2023-10-08T07:09:35.109090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109993+0000","last_change":"2023-10-08T07:09:18.058346+0000","last_active":"2023-10-08T07:09:35.109993+0000","last_peered":"2023-10-08T07:09:35.109993+0000","last_clean":"2023-10-08T07:09:35.109993+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:09:35.109993+0000","last_undegraded":"2023-10-08T07:09:35.109993+0000","last_fullsized":"2023-10-08T07:09:35.109993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:51.958399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182484+0000","last_change":"2023-10-08T07:09:17.752745+0000","last_active":"2023-10-08T07:09:35.182484+0000","last_peered":"2023-10-08T07:09:35.182484+0000","last_clean":"2023-10-08T07:09:35.182484+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:09:35.182484+0000","last_undegraded":"2023-10-08T07:09:35.182484+0000","last_fullsized":"2023-10-08T07:09:35.182484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:08.404190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5935,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109869+0000","last_change":"2023-10-08T07:09:21.040694+0000","last_active":"2023-10-08T07:09:35.109869+0000","last_peered":"2023-10-08T07:09:35.109869+0000","last_clean":"2023-10-08T07:09:35.109869+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:09:35.109869+0000","last_undegraded":"2023-10-08T07:09:35.109869+0000","last_fullsized":"2023-10-08T07:09:35.109869+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:41.813249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182364+0000","last_change":"2023-10-08T07:09:17.754898+0000","last_active":"2023-10-08T07:09:35.182364+0000","last_peered":"2023-10-08T07:09:35.182364+0000","last_clean":"2023-10-08T07:09:35.182364+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:09:35.182364+0000","last_undegraded":"2023-10-08T07:09:35.182364+0000","last_fullsized":"2023-10-08T07:09:35.182364+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:19.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2950,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109068+0000","last_change":"2023-10-08T07:09:21.042008+0000","last_active":"2023-10-08T07:09:35.109068+0000","last_peered":"2023-10-08T07:09:35.109068+0000","last_clean":"2023-10-08T07:09:35.109068+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:09:35.109068+0000","last_undegraded":"2023-10-08T07:09:35.109068+0000","last_fullsized":"2023-10-08T07:09:35.109068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:32:00.347477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110127+0000","last_change":"2023-10-08T07:09:18.057444+0000","last_active":"2023-10-08T07:09:36.110127+0000","last_peered":"2023-10-08T07:09:36.110127+0000","last_clean":"2023-10-08T07:09:36.110127+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:09:36.110127+0000","last_undegraded":"2023-10-08T07:09:36.110127+0000","last_fullsized":"2023-10-08T07:09:36.110127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:06:13.088433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109847+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:09:35.109847+0000","last_peered":"2023-10-08T07:09:35.109847+0000","last_clean":"2023-10-08T07:09:35.109847+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:09:35.109847+0000","last_undegraded":"2023-10-08T07:09:35.109847+0000","last_fullsized":"2023-10-08T07:09:35.109847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5851,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182483+0000","last_change":"2023-10-08T07:09:20.735892+0000","last_active":"2023-10-08T07:09:35.182483+0000","last_peered":"2023-10-08T07:09:35.182483+0000","last_clean":"2023-10-08T07:09:35.182483+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:09:35.182483+0000","last_undegraded":"2023-10-08T07:09:35.182483+0000","last_fullsized":"2023-10-08T07:09:35.182483+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:02.889299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111212+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:09:36.111212+0000","last_peered":"2023-10-08T07:09:36.111212+0000","last_clean":"2023-10-08T07:09:36.111212+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:09:36.111212+0000","last_undegraded":"2023-10-08T07:09:36.111212+0000","last_fullsized":"2023-10-08T07:09:36.111212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109450+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:09:35.109450+0000","last_peered":"2023-10-08T07:09:35.109450+0000","last_clean":"2023-10-08T07:09:35.109450+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:09:35.109450+0000","last_undegraded":"2023-10-08T07:09:35.109450+0000","last_fullsized":"2023-10-08T07:09:35.109450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2958,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108810+0000","last_change":"2023-10-08T07:09:21.040185+0000","last_active":"2023-10-08T07:09:35.108810+0000","last_peered":"2023-10-08T07:09:35.108810+0000","last_clean":"2023-10-08T07:09:35.108810+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:09:35.108810+0000","last_undegraded":"2023-10-08T07:09:35.108810+0000","last_fullsized":"2023-10-08T07:09:35.108810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:50.835623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109492+0000","last_change":"2023-10-08T07:09:18.067783+0000","last_active":"2023-10-08T07:09:36.109492+0000","last_peered":"2023-10-08T07:09:36.109492+0000","last_clean":"2023-10-08T07:09:36.109492+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:09:36.109492+0000","last_undegraded":"2023-10-08T07:09:36.109492+0000","last_fullsized":"2023-10-08T07:09:36.109492+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:11.554943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182723+0000","last_change":"2023-10-08T07:09:17.752755+0000","last_active":"2023-10-08T07:09:35.182723+0000","last_peered":"2023-10-08T07:09:35.182723+0000","last_clean":"2023-10-08T07:09:35.182723+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:09:35.182723+0000","last_undegraded":"2023-10-08T07:09:35.182723+0000","last_fullsized":"2023-10-08T07:09:35.182723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:23.696397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8917,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109189+0000","last_change":"2023-10-08T07:09:21.042220+0000","last_active":"2023-10-08T07:09:35.109189+0000","last_peered":"2023-10-08T07:09:35.109189+0000","last_clean":"2023-10-08T07:09:35.109189+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:09:35.109189+0000","last_undegraded":"2023-10-08T07:09:35.109189+0000","last_fullsized":"2023-10-08T07:09:35.109189+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:33.242389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111323+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:09:36.111323+0000","last_peered":"2023-10-08T07:09:36.111323+0000","last_clean":"2023-10-08T07:09:36.111323+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:09:36.111323+0000","last_undegraded":"2023-10-08T07:09:36.111323+0000","last_fullsized":"2023-10-08T07:09:36.111323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":299,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108760+0000","last_change":"2023-10-08T07:09:18.052234+0000","last_active":"2023-10-08T07:09:35.108760+0000","last_peered":"2023-10-08T07:09:35.108760+0000","last_clean":"2023-10-08T07:09:35.108760+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:09:35.108760+0000","last_undegraded":"2023-10-08T07:09:35.108760+0000","last_fullsized":"2023-10-08T07:09:35.108760+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:02:56.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108336+0000","last_change":"2023-10-08T07:09:18.049984+0000","last_active":"2023-10-08T07:09:35.108336+0000","last_peered":"2023-10-08T07:09:35.108336+0000","last_clean":"2023-10-08T07:09:35.108336+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:09:35.108336+0000","last_undegraded":"2023-10-08T07:09:35.108336+0000","last_fullsized":"2023-10-08T07:09:35.108336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:59:20.880943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5902,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109931+0000","last_change":"2023-10-08T07:09:21.040684+0000","last_active":"2023-10-08T07:09:35.109931+0000","last_peered":"2023-10-08T07:09:35.109931+0000","last_clean":"2023-10-08T07:09:35.109931+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:09:35.109931+0000","last_undegraded":"2023-10-08T07:09:35.109931+0000","last_fullsized":"2023-10-08T07:09:35.109931+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:14.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108874+0000","last_change":"2023-10-08T07:09:18.051593+0000","last_active":"2023-10-08T07:09:35.108874+0000","last_peered":"2023-10-08T07:09:35.108874+0000","last_clean":"2023-10-08T07:09:35.108874+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:09:35.108874+0000","last_undegraded":"2023-10-08T07:09:35.108874+0000","last_fullsized":"2023-10-08T07:09:35.108874+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:34.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108212+0000","last_change":"2023-10-08T07:09:25.038493+0000","last_active":"2023-10-08T07:09:35.108212+0000","last_peered":"2023-10-08T07:09:35.108212+0000","last_clean":"2023-10-08T07:09:35.108212+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:09:35.108212+0000","last_undegraded":"2023-10-08T07:09:35.108212+0000","last_fullsized":"2023-10-08T07:09:35.108212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:44.616324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183181+0000","last_change":"2023-10-08T07:09:17.755079+0000","last_active":"2023-10-08T07:09:35.183181+0000","last_peered":"2023-10-08T07:09:35.183181+0000","last_clean":"2023-10-08T07:09:35.183181+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:09:35.183181+0000","last_undegraded":"2023-10-08T07:09:35.183181+0000","last_fullsized":"2023-10-08T07:09:35.183181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:12.238239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183205+0000","last_change":"2023-10-08T07:09:17.754844+0000","last_active":"2023-10-08T07:09:35.183205+0000","last_peered":"2023-10-08T07:09:35.183205+0000","last_clean":"2023-10-08T07:09:35.183205+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:35.183205+0000","last_undegraded":"2023-10-08T07:09:35.183205+0000","last_fullsized":"2023-10-08T07:09:35.183205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:12.129220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108682+0000","last_change":"2023-10-08T07:09:18.056208+0000","last_active":"2023-10-08T07:09:35.108682+0000","last_peered":"2023-10-08T07:09:35.108682+0000","last_clean":"2023-10-08T07:09:35.108682+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:09:35.108682+0000","last_undegraded":"2023-10-08T07:09:35.108682+0000","last_fullsized":"2023-10-08T07:09:35.108682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:55.549444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182645+0000","last_change":"2023-10-08T07:09:17.753144+0000","last_active":"2023-10-08T07:09:35.182645+0000","last_peered":"2023-10-08T07:09:35.182645+0000","last_clean":"2023-10-08T07:09:35.182645+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:09:35.182645+0000","last_undegraded":"2023-10-08T07:09:35.182645+0000","last_fullsized":"2023-10-08T07:09:35.182645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:25.968547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'3","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109045+0000","last_change":"2023-10-08T07:09:18.059238+0000","last_active":"2023-10-08T07:09:35.109045+0000","last_peered":"2023-10-08T07:09:35.109045+0000","last_clean":"2023-10-08T07:09:35.109045+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:09:35.109045+0000","last_undegraded":"2023-10-08T07:09:35.109045+0000","last_fullsized":"2023-10-08T07:09:35.109045+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:32.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109103+0000","last_change":"2023-10-08T07:09:18.056706+0000","last_active":"2023-10-08T07:09:35.109103+0000","last_peered":"2023-10-08T07:09:35.109103+0000","last_clean":"2023-10-08T07:09:35.109103+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:09:35.109103+0000","last_undegraded":"2023-10-08T07:09:35.109103+0000","last_fullsized":"2023-10-08T07:09:35.109103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:17.258824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2988,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108033+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:09:35.108033+0000","last_peered":"2023-10-08T07:09:35.108033+0000","last_clean":"2023-10-08T07:09:35.108033+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:35.108033+0000","last_undegraded":"2023-10-08T07:09:35.108033+0000","last_fullsized":"2023-10-08T07:09:35.108033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.110033+0000","last_change":"2023-10-08T07:09:18.054661+0000","last_active":"2023-10-08T07:09:35.110033+0000","last_peered":"2023-10-08T07:09:35.110033+0000","last_clean":"2023-10-08T07:09:35.110033+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:09:35.110033+0000","last_undegraded":"2023-10-08T07:09:35.110033+0000","last_fullsized":"2023-10-08T07:09:35.110033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:10.492782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"69'9","reported_seq":94,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108910+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:09:35.108910+0000","last_peered":"2023-10-08T07:09:35.108910+0000","last_clean":"2023-10-08T07:09:35.108910+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:09:35.108910+0000","last_undegraded":"2023-10-08T07:09:35.108910+0000","last_fullsized":"2023-10-08T07:09:35.108910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2962,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182541+0000","last_change":"2023-10-08T07:09:20.735652+0000","last_active":"2023-10-08T07:09:35.182541+0000","last_peered":"2023-10-08T07:09:35.182541+0000","last_clean":"2023-10-08T07:09:35.182541+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:09:35.182541+0000","last_undegraded":"2023-10-08T07:09:35.182541+0000","last_fullsized":"2023-10-08T07:09:35.182541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:15.857716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182410+0000","last_change":"2023-10-08T07:09:22.762216+0000","last_active":"2023-10-08T07:09:35.182410+0000","last_peered":"2023-10-08T07:09:35.182410+0000","last_clean":"2023-10-08T07:09:35.182410+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:35.182410+0000","last_undegraded":"2023-10-08T07:09:35.182410+0000","last_fullsized":"2023-10-08T07:09:35.182410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:49.404736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183153+0000","last_change":"2023-10-08T07:09:24.732784+0000","last_active":"2023-10-08T07:09:35.183153+0000","last_peered":"2023-10-08T07:09:35.183153+0000","last_clean":"2023-10-08T07:09:35.183153+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:09:35.183153+0000","last_undegraded":"2023-10-08T07:09:35.183153+0000","last_fullsized":"2023-10-08T07:09:35.183153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:25.502260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109487+0000","last_change":"2023-10-08T07:09:23.066235+0000","last_active":"2023-10-08T07:09:35.109487+0000","last_peered":"2023-10-08T07:09:35.109487+0000","last_clean":"2023-10-08T07:09:35.109487+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:09:35.109487+0000","last_undegraded":"2023-10-08T07:09:35.109487+0000","last_fullsized":"2023-10-08T07:09:35.109487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:42.060351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5890,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109543+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:09:35.109543+0000","last_peered":"2023-10-08T07:09:35.109543+0000","last_clean":"2023-10-08T07:09:35.109543+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:09:35.109543+0000","last_undegraded":"2023-10-08T07:09:35.109543+0000","last_fullsized":"2023-10-08T07:09:35.109543+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182938+0000","last_change":"2023-10-08T07:09:17.753543+0000","last_active":"2023-10-08T07:09:35.182938+0000","last_peered":"2023-10-08T07:09:35.182938+0000","last_clean":"2023-10-08T07:09:35.182938+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:09:35.182938+0000","last_undegraded":"2023-10-08T07:09:35.182938+0000","last_fullsized":"2023-10-08T07:09:35.182938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:51.956560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3009,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109233+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:35.109233+0000","last_peered":"2023-10-08T07:09:35.109233+0000","last_clean":"2023-10-08T07:09:35.109233+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:35.109233+0000","last_undegraded":"2023-10-08T07:09:35.109233+0000","last_fullsized":"2023-10-08T07:09:35.109233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109221+0000","last_change":"2023-10-08T07:09:18.057710+0000","last_active":"2023-10-08T07:09:35.109221+0000","last_peered":"2023-10-08T07:09:35.109221+0000","last_clean":"2023-10-08T07:09:35.109221+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:09:35.109221+0000","last_undegraded":"2023-10-08T07:09:35.109221+0000","last_fullsized":"2023-10-08T07:09:35.109221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:49.694705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5871,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182257+0000","last_change":"2023-10-08T07:09:20.734404+0000","last_active":"2023-10-08T07:09:35.182257+0000","last_peered":"2023-10-08T07:09:35.182257+0000","last_clean":"2023-10-08T07:09:35.182257+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:09:35.182257+0000","last_undegraded":"2023-10-08T07:09:35.182257+0000","last_fullsized":"2023-10-08T07:09:35.182257+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:04:28.453406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":89,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109149+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:09:35.109149+0000","last_peered":"2023-10-08T07:09:35.109149+0000","last_clean":"2023-10-08T07:09:35.109149+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:09:35.109149+0000","last_undegraded":"2023-10-08T07:09:35.109149+0000","last_fullsized":"2023-10-08T07:09:35.109149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109047+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:09:35.109047+0000","last_peered":"2023-10-08T07:09:35.109047+0000","last_clean":"2023-10-08T07:09:35.109047+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:09:35.109047+0000","last_undegraded":"2023-10-08T07:09:35.109047+0000","last_fullsized":"2023-10-08T07:09:35.109047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8807,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108915+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:09:35.108915+0000","last_peered":"2023-10-08T07:09:35.108915+0000","last_clean":"2023-10-08T07:09:35.108915+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:09:35.108915+0000","last_undegraded":"2023-10-08T07:09:35.108915+0000","last_fullsized":"2023-10-08T07:09:35.108915+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3001,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108201+0000","last_change":"2023-10-08T07:09:21.036530+0000","last_active":"2023-10-08T07:09:35.108201+0000","last_peered":"2023-10-08T07:09:35.108201+0000","last_clean":"2023-10-08T07:09:35.108201+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:09:35.108201+0000","last_undegraded":"2023-10-08T07:09:35.108201+0000","last_fullsized":"2023-10-08T07:09:35.108201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:41:49.285073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182677+0000","last_change":"2023-10-08T07:09:17.754585+0000","last_active":"2023-10-08T07:09:35.182677+0000","last_peered":"2023-10-08T07:09:35.182677+0000","last_clean":"2023-10-08T07:09:35.182677+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:09:35.182677+0000","last_undegraded":"2023-10-08T07:09:35.182677+0000","last_fullsized":"2023-10-08T07:09:35.182677+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:44.969079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108686+0000","last_change":"2023-10-08T07:09:18.056756+0000","last_active":"2023-10-08T07:09:35.108686+0000","last_peered":"2023-10-08T07:09:35.108686+0000","last_clean":"2023-10-08T07:09:35.108686+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:35.108686+0000","last_undegraded":"2023-10-08T07:09:35.108686+0000","last_fullsized":"2023-10-08T07:09:35.108686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:21:49.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2974,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182686+0000","last_change":"2023-10-08T07:09:20.735423+0000","last_active":"2023-10-08T07:09:35.182686+0000","last_peered":"2023-10-08T07:09:35.182686+0000","last_clean":"2023-10-08T07:09:35.182686+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:09:35.182686+0000","last_undegraded":"2023-10-08T07:09:35.182686+0000","last_fullsized":"2023-10-08T07:09:35.182686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:52.216576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595772,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776068,"statfs":{"total":96636764160,"available":96026693632,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59499999999999997,"15min":0.49199999999999999},"min":{"1min":0.35499999999999998,"5min":0.188,"15min":0.188},"max":{"1min":0.76200000000000001,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.60499999999999998,"15min":0.505},"min":{"1min":0.372,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.66300000000000003,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.31}]},{"osd":1,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.55800000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483920,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887920,"statfs":{"total":96636764160,"available":96141230080,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.54300000000000004}]},{"osd":2,"last update":"Sun Oct 8 07:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.1910000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.36399999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.90700000000000003,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":74,"seq":317827579910,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":1704,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":1744896,"data_stored":1216013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:09:41.798 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:09:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:09:42.180 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:09:42.190 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-10-08T07:09:40.570113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149186,"ondisk_log_size":149186,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145028,"kb_used_data":4300,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970492,"statfs":{"total":289910292480,"available":288737783808,"internally_reserved":0,"allocated":4403200,"data_stored":2813678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.471654"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":2999,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183536+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:35.183536+0000","last_peered":"2023-10-08T07:09:35.183536+0000","last_clean":"2023-10-08T07:09:35.183536+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:35.183536+0000","last_undegraded":"2023-10-08T07:09:35.183536+0000","last_fullsized":"2023-10-08T07:09:35.183536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:13.308715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2900,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183152+0000","last_change":"2023-10-08T07:09:20.737069+0000","last_active":"2023-10-08T07:09:35.183152+0000","last_peered":"2023-10-08T07:09:35.183152+0000","last_clean":"2023-10-08T07:09:35.183152+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:35.183152+0000","last_undegraded":"2023-10-08T07:09:35.183152+0000","last_fullsized":"2023-10-08T07:09:35.183152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:03.307776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109869+0000","last_change":"2023-10-08T07:09:18.056834+0000","last_active":"2023-10-08T07:09:35.109869+0000","last_peered":"2023-10-08T07:09:35.109869+0000","last_clean":"2023-10-08T07:09:35.109869+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:09:35.109869+0000","last_undegraded":"2023-10-08T07:09:35.109869+0000","last_fullsized":"2023-10-08T07:09:35.109869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:16.520645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109745+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:09:35.109745+0000","last_peered":"2023-10-08T07:09:35.109745+0000","last_clean":"2023-10-08T07:09:35.109745+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:09:35.109745+0000","last_undegraded":"2023-10-08T07:09:35.109745+0000","last_fullsized":"2023-10-08T07:09:35.109745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5889,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182831+0000","last_change":"2023-10-08T07:09:20.736694+0000","last_active":"2023-10-08T07:09:35.182831+0000","last_peered":"2023-10-08T07:09:35.182831+0000","last_clean":"2023-10-08T07:09:35.182831+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:09:35.182831+0000","last_undegraded":"2023-10-08T07:09:35.182831+0000","last_fullsized":"2023-10-08T07:09:35.182831+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:19:45.353931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8571,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109046+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:09:35.109046+0000","last_peered":"2023-10-08T07:09:35.109046+0000","last_clean":"2023-10-08T07:09:35.109046+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:09:35.109046+0000","last_undegraded":"2023-10-08T07:09:35.109046+0000","last_fullsized":"2023-10-08T07:09:35.109046+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108839+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:09:35.108839+0000","last_peered":"2023-10-08T07:09:35.108839+0000","last_clean":"2023-10-08T07:09:35.108839+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:35.108839+0000","last_undegraded":"2023-10-08T07:09:35.108839+0000","last_fullsized":"2023-10-08T07:09:35.108839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3039,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108687+0000","last_change":"2023-10-08T07:09:28.078167+0000","last_active":"2023-10-08T07:09:35.108687+0000","last_peered":"2023-10-08T07:09:35.108687+0000","last_clean":"2023-10-08T07:09:35.108687+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:09:35.108687+0000","last_undegraded":"2023-10-08T07:09:35.108687+0000","last_fullsized":"2023-10-08T07:09:35.108687+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:51.764425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2883,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108902+0000","last_change":"2023-10-08T07:09:21.041511+0000","last_active":"2023-10-08T07:09:35.108902+0000","last_peered":"2023-10-08T07:09:35.108902+0000","last_clean":"2023-10-08T07:09:35.108902+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:35.108902+0000","last_undegraded":"2023-10-08T07:09:35.108902+0000","last_fullsized":"2023-10-08T07:09:35.108902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:41.813249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2956,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183330+0000","last_change":"2023-10-08T07:09:20.737658+0000","last_active":"2023-10-08T07:09:35.183330+0000","last_peered":"2023-10-08T07:09:35.183330+0000","last_clean":"2023-10-08T07:09:35.183330+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:09:35.183330+0000","last_undegraded":"2023-10-08T07:09:35.183330+0000","last_fullsized":"2023-10-08T07:09:35.183330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:36.077873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109454+0000","last_change":"2023-10-08T07:09:23.063882+0000","last_active":"2023-10-08T07:09:35.109454+0000","last_peered":"2023-10-08T07:09:35.109454+0000","last_clean":"2023-10-08T07:09:35.109454+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:09:35.109454+0000","last_undegraded":"2023-10-08T07:09:35.109454+0000","last_fullsized":"2023-10-08T07:09:35.109454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:33.242389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2961,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182940+0000","last_change":"2023-10-08T07:09:20.736199+0000","last_active":"2023-10-08T07:09:35.182940+0000","last_peered":"2023-10-08T07:09:35.182940+0000","last_clean":"2023-10-08T07:09:35.182940+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:35.182940+0000","last_undegraded":"2023-10-08T07:09:35.182940+0000","last_fullsized":"2023-10-08T07:09:35.182940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.663562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182912+0000","last_change":"2023-10-08T07:09:17.754638+0000","last_active":"2023-10-08T07:09:35.182912+0000","last_peered":"2023-10-08T07:09:35.182912+0000","last_clean":"2023-10-08T07:09:35.182912+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:09:35.182912+0000","last_undegraded":"2023-10-08T07:09:35.182912+0000","last_fullsized":"2023-10-08T07:09:35.182912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:12.379792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2977,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109469+0000","last_change":"2023-10-08T07:09:21.040638+0000","last_active":"2023-10-08T07:09:35.109469+0000","last_peered":"2023-10-08T07:09:35.109469+0000","last_clean":"2023-10-08T07:09:35.109469+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:09:35.109469+0000","last_undegraded":"2023-10-08T07:09:35.109469+0000","last_fullsized":"2023-10-08T07:09:35.109469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:13.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5866,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108990+0000","last_change":"2023-10-08T07:09:26.042339+0000","last_active":"2023-10-08T07:09:35.108990+0000","last_peered":"2023-10-08T07:09:35.108990+0000","last_clean":"2023-10-08T07:09:35.108990+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:09:35.108990+0000","last_undegraded":"2023-10-08T07:09:35.108990+0000","last_fullsized":"2023-10-08T07:09:35.108990+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:24:41.696448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2982,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108787+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:09:35.108787+0000","last_peered":"2023-10-08T07:09:35.108787+0000","last_clean":"2023-10-08T07:09:35.108787+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:09:35.108787+0000","last_undegraded":"2023-10-08T07:09:35.108787+0000","last_fullsized":"2023-10-08T07:09:35.108787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2981,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108994+0000","last_change":"2023-10-08T07:09:21.041706+0000","last_active":"2023-10-08T07:09:35.108994+0000","last_peered":"2023-10-08T07:09:35.108994+0000","last_clean":"2023-10-08T07:09:35.108994+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:09:35.108994+0000","last_undegraded":"2023-10-08T07:09:35.108994+0000","last_fullsized":"2023-10-08T07:09:35.108994+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:13.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183023+0000","last_change":"2023-10-08T07:09:17.754747+0000","last_active":"2023-10-08T07:09:35.183023+0000","last_peered":"2023-10-08T07:09:35.183023+0000","last_clean":"2023-10-08T07:09:35.183023+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:09:35.183023+0000","last_undegraded":"2023-10-08T07:09:35.183023+0000","last_fullsized":"2023-10-08T07:09:35.183023+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:47.075369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2962,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108922+0000","last_change":"2023-10-08T07:09:21.039966+0000","last_active":"2023-10-08T07:09:35.108922+0000","last_peered":"2023-10-08T07:09:35.108922+0000","last_clean":"2023-10-08T07:09:35.108922+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:09:35.108922+0000","last_undegraded":"2023-10-08T07:09:35.108922+0000","last_fullsized":"2023-10-08T07:09:35.108922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:14.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2973,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109672+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:09:35.109672+0000","last_peered":"2023-10-08T07:09:35.109672+0000","last_clean":"2023-10-08T07:09:35.109672+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:09:35.109672+0000","last_undegraded":"2023-10-08T07:09:35.109672+0000","last_fullsized":"2023-10-08T07:09:35.109672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5892,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109302+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:09:35.109302+0000","last_peered":"2023-10-08T07:09:35.109302+0000","last_clean":"2023-10-08T07:09:35.109302+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:09:35.109302+0000","last_undegraded":"2023-10-08T07:09:35.109302+0000","last_fullsized":"2023-10-08T07:09:35.109302+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2876,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182479+0000","last_change":"2023-10-08T07:09:20.735818+0000","last_active":"2023-10-08T07:09:35.182479+0000","last_peered":"2023-10-08T07:09:35.182479+0000","last_clean":"2023-10-08T07:09:35.182479+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:09:35.182479+0000","last_undegraded":"2023-10-08T07:09:35.182479+0000","last_fullsized":"2023-10-08T07:09:35.182479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:56.874136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2981,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108494+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:09:35.108494+0000","last_peered":"2023-10-08T07:09:35.108494+0000","last_clean":"2023-10-08T07:09:35.108494+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:35.108494+0000","last_undegraded":"2023-10-08T07:09:35.108494+0000","last_fullsized":"2023-10-08T07:09:35.108494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5837,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182023+0000","last_change":"2023-10-08T07:09:20.736822+0000","last_active":"2023-10-08T07:09:35.182023+0000","last_peered":"2023-10-08T07:09:35.182023+0000","last_clean":"2023-10-08T07:09:35.182023+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:35.182023+0000","last_undegraded":"2023-10-08T07:09:35.182023+0000","last_fullsized":"2023-10-08T07:09:35.182023+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:19.752508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2956,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183225+0000","last_change":"2023-10-08T07:09:20.735845+0000","last_active":"2023-10-08T07:09:35.183225+0000","last_peered":"2023-10-08T07:09:35.183225+0000","last_clean":"2023-10-08T07:09:35.183225+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:09:35.183225+0000","last_undegraded":"2023-10-08T07:09:35.183225+0000","last_fullsized":"2023-10-08T07:09:35.183225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.084033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2974,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109238+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:09:35.109238+0000","last_peered":"2023-10-08T07:09:35.109238+0000","last_clean":"2023-10-08T07:09:35.109238+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:09:35.109238+0000","last_undegraded":"2023-10-08T07:09:35.109238+0000","last_fullsized":"2023-10-08T07:09:35.109238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109732+0000","last_change":"2023-10-08T07:09:18.055530+0000","last_active":"2023-10-08T07:09:35.109732+0000","last_peered":"2023-10-08T07:09:35.109732+0000","last_clean":"2023-10-08T07:09:35.109732+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:35.109732+0000","last_undegraded":"2023-10-08T07:09:35.109732+0000","last_fullsized":"2023-10-08T07:09:35.109732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:01.783452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182304+0000","last_change":"2023-10-08T07:09:17.751957+0000","last_active":"2023-10-08T07:09:35.182304+0000","last_peered":"2023-10-08T07:09:35.182304+0000","last_clean":"2023-10-08T07:09:35.182304+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:09:35.182304+0000","last_undegraded":"2023-10-08T07:09:35.182304+0000","last_fullsized":"2023-10-08T07:09:35.182304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:13.104739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183354+0000","last_change":"2023-10-08T07:09:17.754513+0000","last_active":"2023-10-08T07:09:35.183354+0000","last_peered":"2023-10-08T07:09:35.183354+0000","last_clean":"2023-10-08T07:09:35.183354+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:35.183354+0000","last_undegraded":"2023-10-08T07:09:35.183354+0000","last_fullsized":"2023-10-08T07:09:35.183354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:06.336414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108669+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:09:35.108669+0000","last_peered":"2023-10-08T07:09:35.108669+0000","last_clean":"2023-10-08T07:09:35.108669+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:09:35.108669+0000","last_undegraded":"2023-10-08T07:09:35.108669+0000","last_fullsized":"2023-10-08T07:09:35.108669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109037+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:09:35.109037+0000","last_peered":"2023-10-08T07:09:35.109037+0000","last_clean":"2023-10-08T07:09:35.109037+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:09:35.109037+0000","last_undegraded":"2023-10-08T07:09:35.109037+0000","last_fullsized":"2023-10-08T07:09:35.109037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108261+0000","last_change":"2023-10-08T07:09:18.055607+0000","last_active":"2023-10-08T07:09:35.108261+0000","last_peered":"2023-10-08T07:09:35.108261+0000","last_clean":"2023-10-08T07:09:35.108261+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:09:35.108261+0000","last_undegraded":"2023-10-08T07:09:35.108261+0000","last_fullsized":"2023-10-08T07:09:35.108261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:09.952089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3025,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183742+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:35.183742+0000","last_peered":"2023-10-08T07:09:35.183742+0000","last_clean":"2023-10-08T07:09:35.183742+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:35.183742+0000","last_undegraded":"2023-10-08T07:09:35.183742+0000","last_fullsized":"2023-10-08T07:09:35.183742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:30.753981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:09:35.109135+0000","last_peered":"2023-10-08T07:09:35.109135+0000","last_clean":"2023-10-08T07:09:35.109135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:35.109135+0000","last_undegraded":"2023-10-08T07:09:35.109135+0000","last_fullsized":"2023-10-08T07:09:35.109135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5825,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108074+0000","last_change":"2023-10-08T07:09:21.036901+0000","last_active":"2023-10-08T07:09:35.108074+0000","last_peered":"2023-10-08T07:09:35.108074+0000","last_clean":"2023-10-08T07:09:35.108074+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:09:35.108074+0000","last_undegraded":"2023-10-08T07:09:35.108074+0000","last_fullsized":"2023-10-08T07:09:35.108074+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:44:57.453475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109892+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:35.109892+0000","last_peered":"2023-10-08T07:09:35.109892+0000","last_clean":"2023-10-08T07:09:35.109892+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:35.109892+0000","last_undegraded":"2023-10-08T07:09:35.109892+0000","last_fullsized":"2023-10-08T07:09:35.109892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2941,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108860+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:09:35.108860+0000","last_peered":"2023-10-08T07:09:35.108860+0000","last_clean":"2023-10-08T07:09:35.108860+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:09:35.108860+0000","last_undegraded":"2023-10-08T07:09:35.108860+0000","last_fullsized":"2023-10-08T07:09:35.108860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"67'7","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182792+0000","last_change":"2023-10-08T07:09:17.758979+0000","last_active":"2023-10-08T07:09:35.182792+0000","last_peered":"2023-10-08T07:09:35.182792+0000","last_clean":"2023-10-08T07:09:35.182792+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:09:35.182792+0000","last_undegraded":"2023-10-08T07:09:35.182792+0000","last_fullsized":"2023-10-08T07:09:35.182792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:06.386900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108369+0000","last_change":"2023-10-08T07:09:18.064856+0000","last_active":"2023-10-08T07:09:35.108369+0000","last_peered":"2023-10-08T07:09:35.108369+0000","last_clean":"2023-10-08T07:09:35.108369+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:35.108369+0000","last_undegraded":"2023-10-08T07:09:35.108369+0000","last_fullsized":"2023-10-08T07:09:35.108369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.230654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":189,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109611+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:35.109611+0000","last_peered":"2023-10-08T07:09:35.109611+0000","last_clean":"2023-10-08T07:09:35.109611+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:35.109611+0000","last_undegraded":"2023-10-08T07:09:35.109611+0000","last_fullsized":"2023-10-08T07:09:35.109611+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2948,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.110046+0000","last_change":"2023-10-08T07:09:21.038587+0000","last_active":"2023-10-08T07:09:35.110046+0000","last_peered":"2023-10-08T07:09:35.110046+0000","last_clean":"2023-10-08T07:09:35.110046+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:09:35.110046+0000","last_undegraded":"2023-10-08T07:09:35.110046+0000","last_fullsized":"2023-10-08T07:09:35.110046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:50.835623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109696+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:09:35.109696+0000","last_peered":"2023-10-08T07:09:35.109696+0000","last_clean":"2023-10-08T07:09:35.109696+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:09:35.109696+0000","last_undegraded":"2023-10-08T07:09:35.109696+0000","last_fullsized":"2023-10-08T07:09:35.109696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2943,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183227+0000","last_change":"2023-10-08T07:09:20.737135+0000","last_active":"2023-10-08T07:09:35.183227+0000","last_peered":"2023-10-08T07:09:35.183227+0000","last_clean":"2023-10-08T07:09:35.183227+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:09:35.183227+0000","last_undegraded":"2023-10-08T07:09:35.183227+0000","last_fullsized":"2023-10-08T07:09:35.183227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:52.474047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108478+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:09:35.108478+0000","last_peered":"2023-10-08T07:09:35.108478+0000","last_clean":"2023-10-08T07:09:35.108478+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:09:35.108478+0000","last_undegraded":"2023-10-08T07:09:35.108478+0000","last_fullsized":"2023-10-08T07:09:35.108478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8822,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183486+0000","last_change":"2023-10-08T07:09:20.737857+0000","last_active":"2023-10-08T07:09:35.183486+0000","last_peered":"2023-10-08T07:09:35.183486+0000","last_clean":"2023-10-08T07:09:35.183486+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:09:35.183486+0000","last_undegraded":"2023-10-08T07:09:35.183486+0000","last_fullsized":"2023-10-08T07:09:35.183486+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:56.740198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182158+0000","last_change":"2023-10-08T07:09:17.751068+0000","last_active":"2023-10-08T07:09:35.182158+0000","last_peered":"2023-10-08T07:09:35.182158+0000","last_clean":"2023-10-08T07:09:35.182158+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:09:35.182158+0000","last_undegraded":"2023-10-08T07:09:35.182158+0000","last_fullsized":"2023-10-08T07:09:35.182158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:15.155530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2924,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109141+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:09:35.109141+0000","last_peered":"2023-10-08T07:09:35.109141+0000","last_clean":"2023-10-08T07:09:35.109141+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:09:35.109141+0000","last_undegraded":"2023-10-08T07:09:35.109141+0000","last_fullsized":"2023-10-08T07:09:35.109141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'9","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109028+0000","last_change":"2023-10-08T07:09:18.054836+0000","last_active":"2023-10-08T07:09:35.109028+0000","last_peered":"2023-10-08T07:09:35.109028+0000","last_clean":"2023-10-08T07:09:35.109028+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:09:35.109028+0000","last_undegraded":"2023-10-08T07:09:35.109028+0000","last_fullsized":"2023-10-08T07:09:35.109028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:16.567958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109238+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:09:35.109238+0000","last_peered":"2023-10-08T07:09:35.109238+0000","last_clean":"2023-10-08T07:09:35.109238+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:09:35.109238+0000","last_undegraded":"2023-10-08T07:09:35.109238+0000","last_fullsized":"2023-10-08T07:09:35.109238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109969+0000","last_change":"2023-10-08T07:09:18.056757+0000","last_active":"2023-10-08T07:09:35.109969+0000","last_peered":"2023-10-08T07:09:35.109969+0000","last_clean":"2023-10-08T07:09:35.109969+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:09:35.109969+0000","last_undegraded":"2023-10-08T07:09:35.109969+0000","last_fullsized":"2023-10-08T07:09:35.109969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:47.575148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182122+0000","last_change":"2023-10-08T07:09:17.753129+0000","last_active":"2023-10-08T07:09:35.182122+0000","last_peered":"2023-10-08T07:09:35.182122+0000","last_clean":"2023-10-08T07:09:35.182122+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:09:35.182122+0000","last_undegraded":"2023-10-08T07:09:35.182122+0000","last_fullsized":"2023-10-08T07:09:35.182122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:53.133780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183472+0000","last_change":"2023-10-08T07:09:17.753124+0000","last_active":"2023-10-08T07:09:35.183472+0000","last_peered":"2023-10-08T07:09:35.183472+0000","last_clean":"2023-10-08T07:09:35.183472+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:09:35.183472+0000","last_undegraded":"2023-10-08T07:09:35.183472+0000","last_fullsized":"2023-10-08T07:09:35.183472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.689880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3000,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182330+0000","last_change":"2023-10-08T07:09:20.737843+0000","last_active":"2023-10-08T07:09:35.182330+0000","last_peered":"2023-10-08T07:09:35.182330+0000","last_clean":"2023-10-08T07:09:35.182330+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:09:35.182330+0000","last_undegraded":"2023-10-08T07:09:35.182330+0000","last_fullsized":"2023-10-08T07:09:35.182330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:58.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109742+0000","last_change":"2023-10-08T07:09:18.057034+0000","last_active":"2023-10-08T07:09:35.109742+0000","last_peered":"2023-10-08T07:09:35.109742+0000","last_clean":"2023-10-08T07:09:35.109742+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:09:35.109742+0000","last_undegraded":"2023-10-08T07:09:35.109742+0000","last_fullsized":"2023-10-08T07:09:35.109742+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:42.006586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2947,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109223+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:09:35.109223+0000","last_peered":"2023-10-08T07:09:35.109223+0000","last_clean":"2023-10-08T07:09:35.109223+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:09:35.109223+0000","last_undegraded":"2023-10-08T07:09:35.109223+0000","last_fullsized":"2023-10-08T07:09:35.109223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109356+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:35.109356+0000","last_peered":"2023-10-08T07:09:35.109356+0000","last_clean":"2023-10-08T07:09:35.109356+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:35.109356+0000","last_undegraded":"2023-10-08T07:09:35.109356+0000","last_fullsized":"2023-10-08T07:09:35.109356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":2992,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108605+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:09:35.108605+0000","last_peered":"2023-10-08T07:09:35.108605+0000","last_clean":"2023-10-08T07:09:35.108605+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:35.108605+0000","last_undegraded":"2023-10-08T07:09:35.108605+0000","last_fullsized":"2023-10-08T07:09:35.108605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'3","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108542+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:09:35.108542+0000","last_peered":"2023-10-08T07:09:35.108542+0000","last_clean":"2023-10-08T07:09:35.108542+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:09:35.108542+0000","last_undegraded":"2023-10-08T07:09:35.108542+0000","last_fullsized":"2023-10-08T07:09:35.108542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5930,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109441+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:09:35.109441+0000","last_peered":"2023-10-08T07:09:35.109441+0000","last_clean":"2023-10-08T07:09:35.109441+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:35.109441+0000","last_undegraded":"2023-10-08T07:09:35.109441+0000","last_fullsized":"2023-10-08T07:09:35.109441+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109090+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:09:35.109090+0000","last_peered":"2023-10-08T07:09:35.109090+0000","last_clean":"2023-10-08T07:09:35.109090+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:09:35.109090+0000","last_undegraded":"2023-10-08T07:09:35.109090+0000","last_fullsized":"2023-10-08T07:09:35.109090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109993+0000","last_change":"2023-10-08T07:09:18.058346+0000","last_active":"2023-10-08T07:09:35.109993+0000","last_peered":"2023-10-08T07:09:35.109993+0000","last_clean":"2023-10-08T07:09:35.109993+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:09:35.109993+0000","last_undegraded":"2023-10-08T07:09:35.109993+0000","last_fullsized":"2023-10-08T07:09:35.109993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:51.958399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182484+0000","last_change":"2023-10-08T07:09:17.752745+0000","last_active":"2023-10-08T07:09:35.182484+0000","last_peered":"2023-10-08T07:09:35.182484+0000","last_clean":"2023-10-08T07:09:35.182484+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:09:35.182484+0000","last_undegraded":"2023-10-08T07:09:35.182484+0000","last_fullsized":"2023-10-08T07:09:35.182484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:08.404190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5935,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109869+0000","last_change":"2023-10-08T07:09:21.040694+0000","last_active":"2023-10-08T07:09:35.109869+0000","last_peered":"2023-10-08T07:09:35.109869+0000","last_clean":"2023-10-08T07:09:35.109869+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:09:35.109869+0000","last_undegraded":"2023-10-08T07:09:35.109869+0000","last_fullsized":"2023-10-08T07:09:35.109869+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:41.813249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182364+0000","last_change":"2023-10-08T07:09:17.754898+0000","last_active":"2023-10-08T07:09:35.182364+0000","last_peered":"2023-10-08T07:09:35.182364+0000","last_clean":"2023-10-08T07:09:35.182364+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:09:35.182364+0000","last_undegraded":"2023-10-08T07:09:35.182364+0000","last_fullsized":"2023-10-08T07:09:35.182364+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:19.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2950,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109068+0000","last_change":"2023-10-08T07:09:21.042008+0000","last_active":"2023-10-08T07:09:35.109068+0000","last_peered":"2023-10-08T07:09:35.109068+0000","last_clean":"2023-10-08T07:09:35.109068+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:09:35.109068+0000","last_undegraded":"2023-10-08T07:09:35.109068+0000","last_fullsized":"2023-10-08T07:09:35.109068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:32:00.347477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110127+0000","last_change":"2023-10-08T07:09:18.057444+0000","last_active":"2023-10-08T07:09:36.110127+0000","last_peered":"2023-10-08T07:09:36.110127+0000","last_clean":"2023-10-08T07:09:36.110127+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:09:36.110127+0000","last_undegraded":"2023-10-08T07:09:36.110127+0000","last_fullsized":"2023-10-08T07:09:36.110127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:06:13.088433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109847+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:09:35.109847+0000","last_peered":"2023-10-08T07:09:35.109847+0000","last_clean":"2023-10-08T07:09:35.109847+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:09:35.109847+0000","last_undegraded":"2023-10-08T07:09:35.109847+0000","last_fullsized":"2023-10-08T07:09:35.109847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5851,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182483+0000","last_change":"2023-10-08T07:09:20.735892+0000","last_active":"2023-10-08T07:09:35.182483+0000","last_peered":"2023-10-08T07:09:35.182483+0000","last_clean":"2023-10-08T07:09:35.182483+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:09:35.182483+0000","last_undegraded":"2023-10-08T07:09:35.182483+0000","last_fullsized":"2023-10-08T07:09:35.182483+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:02.889299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111212+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:09:36.111212+0000","last_peered":"2023-10-08T07:09:36.111212+0000","last_clean":"2023-10-08T07:09:36.111212+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:09:36.111212+0000","last_undegraded":"2023-10-08T07:09:36.111212+0000","last_fullsized":"2023-10-08T07:09:36.111212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109450+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:09:35.109450+0000","last_peered":"2023-10-08T07:09:35.109450+0000","last_clean":"2023-10-08T07:09:35.109450+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:09:35.109450+0000","last_undegraded":"2023-10-08T07:09:35.109450+0000","last_fullsized":"2023-10-08T07:09:35.109450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2958,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108810+0000","last_change":"2023-10-08T07:09:21.040185+0000","last_active":"2023-10-08T07:09:35.108810+0000","last_peered":"2023-10-08T07:09:35.108810+0000","last_clean":"2023-10-08T07:09:35.108810+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:09:35.108810+0000","last_undegraded":"2023-10-08T07:09:35.108810+0000","last_fullsized":"2023-10-08T07:09:35.108810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:50.835623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109492+0000","last_change":"2023-10-08T07:09:18.067783+0000","last_active":"2023-10-08T07:09:36.109492+0000","last_peered":"2023-10-08T07:09:36.109492+0000","last_clean":"2023-10-08T07:09:36.109492+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:09:36.109492+0000","last_undegraded":"2023-10-08T07:09:36.109492+0000","last_fullsized":"2023-10-08T07:09:36.109492+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:11.554943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182723+0000","last_change":"2023-10-08T07:09:17.752755+0000","last_active":"2023-10-08T07:09:35.182723+0000","last_peered":"2023-10-08T07:09:35.182723+0000","last_clean":"2023-10-08T07:09:35.182723+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:09:35.182723+0000","last_undegraded":"2023-10-08T07:09:35.182723+0000","last_fullsized":"2023-10-08T07:09:35.182723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:23.696397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8917,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109189+0000","last_change":"2023-10-08T07:09:21.042220+0000","last_active":"2023-10-08T07:09:35.109189+0000","last_peered":"2023-10-08T07:09:35.109189+0000","last_clean":"2023-10-08T07:09:35.109189+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:09:35.109189+0000","last_undegraded":"2023-10-08T07:09:35.109189+0000","last_fullsized":"2023-10-08T07:09:35.109189+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:33.242389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111323+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:09:36.111323+0000","last_peered":"2023-10-08T07:09:36.111323+0000","last_clean":"2023-10-08T07:09:36.111323+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:09:36.111323+0000","last_undegraded":"2023-10-08T07:09:36.111323+0000","last_fullsized":"2023-10-08T07:09:36.111323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":299,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108760+0000","last_change":"2023-10-08T07:09:18.052234+0000","last_active":"2023-10-08T07:09:35.108760+0000","last_peered":"2023-10-08T07:09:35.108760+0000","last_clean":"2023-10-08T07:09:35.108760+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:09:35.108760+0000","last_undegraded":"2023-10-08T07:09:35.108760+0000","last_fullsized":"2023-10-08T07:09:35.108760+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:02:56.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108336+0000","last_change":"2023-10-08T07:09:18.049984+0000","last_active":"2023-10-08T07:09:35.108336+0000","last_peered":"2023-10-08T07:09:35.108336+0000","last_clean":"2023-10-08T07:09:35.108336+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:09:35.108336+0000","last_undegraded":"2023-10-08T07:09:35.108336+0000","last_fullsized":"2023-10-08T07:09:35.108336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:59:20.880943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5902,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109931+0000","last_change":"2023-10-08T07:09:21.040684+0000","last_active":"2023-10-08T07:09:35.109931+0000","last_peered":"2023-10-08T07:09:35.109931+0000","last_clean":"2023-10-08T07:09:35.109931+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:09:35.109931+0000","last_undegraded":"2023-10-08T07:09:35.109931+0000","last_fullsized":"2023-10-08T07:09:35.109931+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:14.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108874+0000","last_change":"2023-10-08T07:09:18.051593+0000","last_active":"2023-10-08T07:09:35.108874+0000","last_peered":"2023-10-08T07:09:35.108874+0000","last_clean":"2023-10-08T07:09:35.108874+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:09:35.108874+0000","last_undegraded":"2023-10-08T07:09:35.108874+0000","last_fullsized":"2023-10-08T07:09:35.108874+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:34.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108212+0000","last_change":"2023-10-08T07:09:25.038493+0000","last_active":"2023-10-08T07:09:35.108212+0000","last_peered":"2023-10-08T07:09:35.108212+0000","last_clean":"2023-10-08T07:09:35.108212+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:09:35.108212+0000","last_undegraded":"2023-10-08T07:09:35.108212+0000","last_fullsized":"2023-10-08T07:09:35.108212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:44.616324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183181+0000","last_change":"2023-10-08T07:09:17.755079+0000","last_active":"2023-10-08T07:09:35.183181+0000","last_peered":"2023-10-08T07:09:35.183181+0000","last_clean":"2023-10-08T07:09:35.183181+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:09:35.183181+0000","last_undegraded":"2023-10-08T07:09:35.183181+0000","last_fullsized":"2023-10-08T07:09:35.183181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:12.238239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183205+0000","last_change":"2023-10-08T07:09:17.754844+0000","last_active":"2023-10-08T07:09:35.183205+0000","last_peered":"2023-10-08T07:09:35.183205+0000","last_clean":"2023-10-08T07:09:35.183205+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:35.183205+0000","last_undegraded":"2023-10-08T07:09:35.183205+0000","last_fullsized":"2023-10-08T07:09:35.183205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:12.129220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108682+0000","last_change":"2023-10-08T07:09:18.056208+0000","last_active":"2023-10-08T07:09:35.108682+0000","last_peered":"2023-10-08T07:09:35.108682+0000","last_clean":"2023-10-08T07:09:35.108682+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:09:35.108682+0000","last_undegraded":"2023-10-08T07:09:35.108682+0000","last_fullsized":"2023-10-08T07:09:35.108682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:55.549444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182645+0000","last_change":"2023-10-08T07:09:17.753144+0000","last_active":"2023-10-08T07:09:35.182645+0000","last_peered":"2023-10-08T07:09:35.182645+0000","last_clean":"2023-10-08T07:09:35.182645+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:09:35.182645+0000","last_undegraded":"2023-10-08T07:09:35.182645+0000","last_fullsized":"2023-10-08T07:09:35.182645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:25.968547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'3","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109045+0000","last_change":"2023-10-08T07:09:18.059238+0000","last_active":"2023-10-08T07:09:35.109045+0000","last_peered":"2023-10-08T07:09:35.109045+0000","last_clean":"2023-10-08T07:09:35.109045+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:09:35.109045+0000","last_undegraded":"2023-10-08T07:09:35.109045+0000","last_fullsized":"2023-10-08T07:09:35.109045+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:32.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109103+0000","last_change":"2023-10-08T07:09:18.056706+0000","last_active":"2023-10-08T07:09:35.109103+0000","last_peered":"2023-10-08T07:09:35.109103+0000","last_clean":"2023-10-08T07:09:35.109103+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:09:35.109103+0000","last_undegraded":"2023-10-08T07:09:35.109103+0000","last_fullsized":"2023-10-08T07:09:35.109103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:17.258824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2988,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108033+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:09:35.108033+0000","last_peered":"2023-10-08T07:09:35.108033+0000","last_clean":"2023-10-08T07:09:35.108033+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:35.108033+0000","last_undegraded":"2023-10-08T07:09:35.108033+0000","last_fullsized":"2023-10-08T07:09:35.108033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.110033+0000","last_change":"2023-10-08T07:09:18.054661+0000","last_active":"2023-10-08T07:09:35.110033+0000","last_peered":"2023-10-08T07:09:35.110033+0000","last_clean":"2023-10-08T07:09:35.110033+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:09:35.110033+0000","last_undegraded":"2023-10-08T07:09:35.110033+0000","last_fullsized":"2023-10-08T07:09:35.110033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:10.492782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"69'9","reported_seq":94,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108910+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:09:35.108910+0000","last_peered":"2023-10-08T07:09:35.108910+0000","last_clean":"2023-10-08T07:09:35.108910+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:09:35.108910+0000","last_undegraded":"2023-10-08T07:09:35.108910+0000","last_fullsized":"2023-10-08T07:09:35.108910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2962,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182541+0000","last_change":"2023-10-08T07:09:20.735652+0000","last_active":"2023-10-08T07:09:35.182541+0000","last_peered":"2023-10-08T07:09:35.182541+0000","last_clean":"2023-10-08T07:09:35.182541+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:09:35.182541+0000","last_undegraded":"2023-10-08T07:09:35.182541+0000","last_fullsized":"2023-10-08T07:09:35.182541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:15.857716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182410+0000","last_change":"2023-10-08T07:09:22.762216+0000","last_active":"2023-10-08T07:09:35.182410+0000","last_peered":"2023-10-08T07:09:35.182410+0000","last_clean":"2023-10-08T07:09:35.182410+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:35.182410+0000","last_undegraded":"2023-10-08T07:09:35.182410+0000","last_fullsized":"2023-10-08T07:09:35.182410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:49.404736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183153+0000","last_change":"2023-10-08T07:09:24.732784+0000","last_active":"2023-10-08T07:09:35.183153+0000","last_peered":"2023-10-08T07:09:35.183153+0000","last_clean":"2023-10-08T07:09:35.183153+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:09:35.183153+0000","last_undegraded":"2023-10-08T07:09:35.183153+0000","last_fullsized":"2023-10-08T07:09:35.183153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:25.502260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109487+0000","last_change":"2023-10-08T07:09:23.066235+0000","last_active":"2023-10-08T07:09:35.109487+0000","last_peered":"2023-10-08T07:09:35.109487+0000","last_clean":"2023-10-08T07:09:35.109487+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:09:35.109487+0000","last_undegraded":"2023-10-08T07:09:35.109487+0000","last_fullsized":"2023-10-08T07:09:35.109487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:42.060351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5890,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109543+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:09:35.109543+0000","last_peered":"2023-10-08T07:09:35.109543+0000","last_clean":"2023-10-08T07:09:35.109543+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:09:35.109543+0000","last_undegraded":"2023-10-08T07:09:35.109543+0000","last_fullsized":"2023-10-08T07:09:35.109543+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182938+0000","last_change":"2023-10-08T07:09:17.753543+0000","last_active":"2023-10-08T07:09:35.182938+0000","last_peered":"2023-10-08T07:09:35.182938+0000","last_clean":"2023-10-08T07:09:35.182938+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:09:35.182938+0000","last_undegraded":"2023-10-08T07:09:35.182938+0000","last_fullsized":"2023-10-08T07:09:35.182938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:51.956560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3009,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109233+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:35.109233+0000","last_peered":"2023-10-08T07:09:35.109233+0000","last_clean":"2023-10-08T07:09:35.109233+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:35.109233+0000","last_undegraded":"2023-10-08T07:09:35.109233+0000","last_fullsized":"2023-10-08T07:09:35.109233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109221+0000","last_change":"2023-10-08T07:09:18.057710+0000","last_active":"2023-10-08T07:09:35.109221+0000","last_peered":"2023-10-08T07:09:35.109221+0000","last_clean":"2023-10-08T07:09:35.109221+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:09:35.109221+0000","last_undegraded":"2023-10-08T07:09:35.109221+0000","last_fullsized":"2023-10-08T07:09:35.109221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:49.694705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5871,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182257+0000","last_change":"2023-10-08T07:09:20.734404+0000","last_active":"2023-10-08T07:09:35.182257+0000","last_peered":"2023-10-08T07:09:35.182257+0000","last_clean":"2023-10-08T07:09:35.182257+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:09:35.182257+0000","last_undegraded":"2023-10-08T07:09:35.182257+0000","last_fullsized":"2023-10-08T07:09:35.182257+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:04:28.453406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":89,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109149+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:09:35.109149+0000","last_peered":"2023-10-08T07:09:35.109149+0000","last_clean":"2023-10-08T07:09:35.109149+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:09:35.109149+0000","last_undegraded":"2023-10-08T07:09:35.109149+0000","last_fullsized":"2023-10-08T07:09:35.109149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109047+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:09:35.109047+0000","last_peered":"2023-10-08T07:09:35.109047+0000","last_clean":"2023-10-08T07:09:35.109047+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:09:35.109047+0000","last_undegraded":"2023-10-08T07:09:35.109047+0000","last_fullsized":"2023-10-08T07:09:35.109047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8807,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108915+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:09:35.108915+0000","last_peered":"2023-10-08T07:09:35.108915+0000","last_clean":"2023-10-08T07:09:35.108915+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:09:35.108915+0000","last_undegraded":"2023-10-08T07:09:35.108915+0000","last_fullsized":"2023-10-08T07:09:35.108915+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3001,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108201+0000","last_change":"2023-10-08T07:09:21.036530+0000","last_active":"2023-10-08T07:09:35.108201+0000","last_peered":"2023-10-08T07:09:35.108201+0000","last_clean":"2023-10-08T07:09:35.108201+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:09:35.108201+0000","last_undegraded":"2023-10-08T07:09:35.108201+0000","last_fullsized":"2023-10-08T07:09:35.108201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:41:49.285073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182677+0000","last_change":"2023-10-08T07:09:17.754585+0000","last_active":"2023-10-08T07:09:35.182677+0000","last_peered":"2023-10-08T07:09:35.182677+0000","last_clean":"2023-10-08T07:09:35.182677+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:09:35.182677+0000","last_undegraded":"2023-10-08T07:09:35.182677+0000","last_fullsized":"2023-10-08T07:09:35.182677+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:44.969079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108686+0000","last_change":"2023-10-08T07:09:18.056756+0000","last_active":"2023-10-08T07:09:35.108686+0000","last_peered":"2023-10-08T07:09:35.108686+0000","last_clean":"2023-10-08T07:09:35.108686+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:35.108686+0000","last_undegraded":"2023-10-08T07:09:35.108686+0000","last_fullsized":"2023-10-08T07:09:35.108686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:21:49.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2974,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182686+0000","last_change":"2023-10-08T07:09:20.735423+0000","last_active":"2023-10-08T07:09:35.182686+0000","last_peered":"2023-10-08T07:09:35.182686+0000","last_clean":"2023-10-08T07:09:35.182686+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:09:35.182686+0000","last_undegraded":"2023-10-08T07:09:35.182686+0000","last_fullsized":"2023-10-08T07:09:35.182686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:52.216576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595772,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776068,"statfs":{"total":96636764160,"available":96026693632,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59499999999999997,"15min":0.49199999999999999},"min":{"1min":0.35499999999999998,"5min":0.188,"15min":0.188},"max":{"1min":0.76200000000000001,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.60499999999999998,"15min":0.505},"min":{"1min":0.372,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.66300000000000003,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.31}]},{"osd":1,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.55800000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483920,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887920,"statfs":{"total":96636764160,"available":96141230080,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.54300000000000004}]},{"osd":2,"last update":"Sun Oct 8 07:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.1910000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.36399999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.90700000000000003,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":74,"seq":317827579910,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":1704,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":1744896,"data_stored":1216013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:09:42.196 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T07:09:42.196 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:09:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:09:42.577 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:09:42.585 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-10-08T07:09:40.570113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149186,"ondisk_log_size":149186,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145028,"kb_used_data":4300,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970492,"statfs":{"total":289910292480,"available":288737783808,"internally_reserved":0,"allocated":4403200,"data_stored":2813678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.471654"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":2999,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183536+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:35.183536+0000","last_peered":"2023-10-08T07:09:35.183536+0000","last_clean":"2023-10-08T07:09:35.183536+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:35.183536+0000","last_undegraded":"2023-10-08T07:09:35.183536+0000","last_fullsized":"2023-10-08T07:09:35.183536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:13.308715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2900,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183152+0000","last_change":"2023-10-08T07:09:20.737069+0000","last_active":"2023-10-08T07:09:35.183152+0000","last_peered":"2023-10-08T07:09:35.183152+0000","last_clean":"2023-10-08T07:09:35.183152+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:35.183152+0000","last_undegraded":"2023-10-08T07:09:35.183152+0000","last_fullsized":"2023-10-08T07:09:35.183152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:03.307776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109869+0000","last_change":"2023-10-08T07:09:18.056834+0000","last_active":"2023-10-08T07:09:35.109869+0000","last_peered":"2023-10-08T07:09:35.109869+0000","last_clean":"2023-10-08T07:09:35.109869+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:09:35.109869+0000","last_undegraded":"2023-10-08T07:09:35.109869+0000","last_fullsized":"2023-10-08T07:09:35.109869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:16.520645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109745+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:09:35.109745+0000","last_peered":"2023-10-08T07:09:35.109745+0000","last_clean":"2023-10-08T07:09:35.109745+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:09:35.109745+0000","last_undegraded":"2023-10-08T07:09:35.109745+0000","last_fullsized":"2023-10-08T07:09:35.109745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5889,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182831+0000","last_change":"2023-10-08T07:09:20.736694+0000","last_active":"2023-10-08T07:09:35.182831+0000","last_peered":"2023-10-08T07:09:35.182831+0000","last_clean":"2023-10-08T07:09:35.182831+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:09:35.182831+0000","last_undegraded":"2023-10-08T07:09:35.182831+0000","last_fullsized":"2023-10-08T07:09:35.182831+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:19:45.353931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8571,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109046+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:09:35.109046+0000","last_peered":"2023-10-08T07:09:35.109046+0000","last_clean":"2023-10-08T07:09:35.109046+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:09:35.109046+0000","last_undegraded":"2023-10-08T07:09:35.109046+0000","last_fullsized":"2023-10-08T07:09:35.109046+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108839+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:09:35.108839+0000","last_peered":"2023-10-08T07:09:35.108839+0000","last_clean":"2023-10-08T07:09:35.108839+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:35.108839+0000","last_undegraded":"2023-10-08T07:09:35.108839+0000","last_fullsized":"2023-10-08T07:09:35.108839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3039,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108687+0000","last_change":"2023-10-08T07:09:28.078167+0000","last_active":"2023-10-08T07:09:35.108687+0000","last_peered":"2023-10-08T07:09:35.108687+0000","last_clean":"2023-10-08T07:09:35.108687+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:09:35.108687+0000","last_undegraded":"2023-10-08T07:09:35.108687+0000","last_fullsized":"2023-10-08T07:09:35.108687+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:51.764425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2883,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108902+0000","last_change":"2023-10-08T07:09:21.041511+0000","last_active":"2023-10-08T07:09:35.108902+0000","last_peered":"2023-10-08T07:09:35.108902+0000","last_clean":"2023-10-08T07:09:35.108902+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:35.108902+0000","last_undegraded":"2023-10-08T07:09:35.108902+0000","last_fullsized":"2023-10-08T07:09:35.108902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:41.813249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2956,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183330+0000","last_change":"2023-10-08T07:09:20.737658+0000","last_active":"2023-10-08T07:09:35.183330+0000","last_peered":"2023-10-08T07:09:35.183330+0000","last_clean":"2023-10-08T07:09:35.183330+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:09:35.183330+0000","last_undegraded":"2023-10-08T07:09:35.183330+0000","last_fullsized":"2023-10-08T07:09:35.183330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:36.077873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109454+0000","last_change":"2023-10-08T07:09:23.063882+0000","last_active":"2023-10-08T07:09:35.109454+0000","last_peered":"2023-10-08T07:09:35.109454+0000","last_clean":"2023-10-08T07:09:35.109454+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:09:35.109454+0000","last_undegraded":"2023-10-08T07:09:35.109454+0000","last_fullsized":"2023-10-08T07:09:35.109454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:33.242389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2961,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182940+0000","last_change":"2023-10-08T07:09:20.736199+0000","last_active":"2023-10-08T07:09:35.182940+0000","last_peered":"2023-10-08T07:09:35.182940+0000","last_clean":"2023-10-08T07:09:35.182940+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:35.182940+0000","last_undegraded":"2023-10-08T07:09:35.182940+0000","last_fullsized":"2023-10-08T07:09:35.182940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.663562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182912+0000","last_change":"2023-10-08T07:09:17.754638+0000","last_active":"2023-10-08T07:09:35.182912+0000","last_peered":"2023-10-08T07:09:35.182912+0000","last_clean":"2023-10-08T07:09:35.182912+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:09:35.182912+0000","last_undegraded":"2023-10-08T07:09:35.182912+0000","last_fullsized":"2023-10-08T07:09:35.182912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:12.379792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2977,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109469+0000","last_change":"2023-10-08T07:09:21.040638+0000","last_active":"2023-10-08T07:09:35.109469+0000","last_peered":"2023-10-08T07:09:35.109469+0000","last_clean":"2023-10-08T07:09:35.109469+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:09:35.109469+0000","last_undegraded":"2023-10-08T07:09:35.109469+0000","last_fullsized":"2023-10-08T07:09:35.109469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:13.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5866,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108990+0000","last_change":"2023-10-08T07:09:26.042339+0000","last_active":"2023-10-08T07:09:35.108990+0000","last_peered":"2023-10-08T07:09:35.108990+0000","last_clean":"2023-10-08T07:09:35.108990+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:09:35.108990+0000","last_undegraded":"2023-10-08T07:09:35.108990+0000","last_fullsized":"2023-10-08T07:09:35.108990+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:24:41.696448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2982,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108787+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:09:35.108787+0000","last_peered":"2023-10-08T07:09:35.108787+0000","last_clean":"2023-10-08T07:09:35.108787+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:09:35.108787+0000","last_undegraded":"2023-10-08T07:09:35.108787+0000","last_fullsized":"2023-10-08T07:09:35.108787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2981,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108994+0000","last_change":"2023-10-08T07:09:21.041706+0000","last_active":"2023-10-08T07:09:35.108994+0000","last_peered":"2023-10-08T07:09:35.108994+0000","last_clean":"2023-10-08T07:09:35.108994+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:09:35.108994+0000","last_undegraded":"2023-10-08T07:09:35.108994+0000","last_fullsized":"2023-10-08T07:09:35.108994+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:13.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183023+0000","last_change":"2023-10-08T07:09:17.754747+0000","last_active":"2023-10-08T07:09:35.183023+0000","last_peered":"2023-10-08T07:09:35.183023+0000","last_clean":"2023-10-08T07:09:35.183023+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:09:35.183023+0000","last_undegraded":"2023-10-08T07:09:35.183023+0000","last_fullsized":"2023-10-08T07:09:35.183023+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:47.075369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2962,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108922+0000","last_change":"2023-10-08T07:09:21.039966+0000","last_active":"2023-10-08T07:09:35.108922+0000","last_peered":"2023-10-08T07:09:35.108922+0000","last_clean":"2023-10-08T07:09:35.108922+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:09:35.108922+0000","last_undegraded":"2023-10-08T07:09:35.108922+0000","last_fullsized":"2023-10-08T07:09:35.108922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:14.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2973,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109672+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:09:35.109672+0000","last_peered":"2023-10-08T07:09:35.109672+0000","last_clean":"2023-10-08T07:09:35.109672+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:09:35.109672+0000","last_undegraded":"2023-10-08T07:09:35.109672+0000","last_fullsized":"2023-10-08T07:09:35.109672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5892,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109302+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:09:35.109302+0000","last_peered":"2023-10-08T07:09:35.109302+0000","last_clean":"2023-10-08T07:09:35.109302+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:09:35.109302+0000","last_undegraded":"2023-10-08T07:09:35.109302+0000","last_fullsized":"2023-10-08T07:09:35.109302+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2876,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182479+0000","last_change":"2023-10-08T07:09:20.735818+0000","last_active":"2023-10-08T07:09:35.182479+0000","last_peered":"2023-10-08T07:09:35.182479+0000","last_clean":"2023-10-08T07:09:35.182479+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:09:35.182479+0000","last_undegraded":"2023-10-08T07:09:35.182479+0000","last_fullsized":"2023-10-08T07:09:35.182479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:56.874136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2981,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108494+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:09:35.108494+0000","last_peered":"2023-10-08T07:09:35.108494+0000","last_clean":"2023-10-08T07:09:35.108494+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:35.108494+0000","last_undegraded":"2023-10-08T07:09:35.108494+0000","last_fullsized":"2023-10-08T07:09:35.108494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5837,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182023+0000","last_change":"2023-10-08T07:09:20.736822+0000","last_active":"2023-10-08T07:09:35.182023+0000","last_peered":"2023-10-08T07:09:35.182023+0000","last_clean":"2023-10-08T07:09:35.182023+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:35.182023+0000","last_undegraded":"2023-10-08T07:09:35.182023+0000","last_fullsized":"2023-10-08T07:09:35.182023+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:19.752508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2956,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183225+0000","last_change":"2023-10-08T07:09:20.735845+0000","last_active":"2023-10-08T07:09:35.183225+0000","last_peered":"2023-10-08T07:09:35.183225+0000","last_clean":"2023-10-08T07:09:35.183225+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:09:35.183225+0000","last_undegraded":"2023-10-08T07:09:35.183225+0000","last_fullsized":"2023-10-08T07:09:35.183225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.084033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2974,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109238+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:09:35.109238+0000","last_peered":"2023-10-08T07:09:35.109238+0000","last_clean":"2023-10-08T07:09:35.109238+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:09:35.109238+0000","last_undegraded":"2023-10-08T07:09:35.109238+0000","last_fullsized":"2023-10-08T07:09:35.109238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109732+0000","last_change":"2023-10-08T07:09:18.055530+0000","last_active":"2023-10-08T07:09:35.109732+0000","last_peered":"2023-10-08T07:09:35.109732+0000","last_clean":"2023-10-08T07:09:35.109732+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:35.109732+0000","last_undegraded":"2023-10-08T07:09:35.109732+0000","last_fullsized":"2023-10-08T07:09:35.109732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:01.783452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182304+0000","last_change":"2023-10-08T07:09:17.751957+0000","last_active":"2023-10-08T07:09:35.182304+0000","last_peered":"2023-10-08T07:09:35.182304+0000","last_clean":"2023-10-08T07:09:35.182304+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:09:35.182304+0000","last_undegraded":"2023-10-08T07:09:35.182304+0000","last_fullsized":"2023-10-08T07:09:35.182304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:13.104739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183354+0000","last_change":"2023-10-08T07:09:17.754513+0000","last_active":"2023-10-08T07:09:35.183354+0000","last_peered":"2023-10-08T07:09:35.183354+0000","last_clean":"2023-10-08T07:09:35.183354+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:35.183354+0000","last_undegraded":"2023-10-08T07:09:35.183354+0000","last_fullsized":"2023-10-08T07:09:35.183354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:06.336414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108669+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:09:35.108669+0000","last_peered":"2023-10-08T07:09:35.108669+0000","last_clean":"2023-10-08T07:09:35.108669+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:09:35.108669+0000","last_undegraded":"2023-10-08T07:09:35.108669+0000","last_fullsized":"2023-10-08T07:09:35.108669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109037+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:09:35.109037+0000","last_peered":"2023-10-08T07:09:35.109037+0000","last_clean":"2023-10-08T07:09:35.109037+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:09:35.109037+0000","last_undegraded":"2023-10-08T07:09:35.109037+0000","last_fullsized":"2023-10-08T07:09:35.109037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108261+0000","last_change":"2023-10-08T07:09:18.055607+0000","last_active":"2023-10-08T07:09:35.108261+0000","last_peered":"2023-10-08T07:09:35.108261+0000","last_clean":"2023-10-08T07:09:35.108261+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:09:35.108261+0000","last_undegraded":"2023-10-08T07:09:35.108261+0000","last_fullsized":"2023-10-08T07:09:35.108261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:09.952089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3025,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183742+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:35.183742+0000","last_peered":"2023-10-08T07:09:35.183742+0000","last_clean":"2023-10-08T07:09:35.183742+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:35.183742+0000","last_undegraded":"2023-10-08T07:09:35.183742+0000","last_fullsized":"2023-10-08T07:09:35.183742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:30.753981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:09:35.109135+0000","last_peered":"2023-10-08T07:09:35.109135+0000","last_clean":"2023-10-08T07:09:35.109135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:35.109135+0000","last_undegraded":"2023-10-08T07:09:35.109135+0000","last_fullsized":"2023-10-08T07:09:35.109135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5825,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108074+0000","last_change":"2023-10-08T07:09:21.036901+0000","last_active":"2023-10-08T07:09:35.108074+0000","last_peered":"2023-10-08T07:09:35.108074+0000","last_clean":"2023-10-08T07:09:35.108074+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:09:35.108074+0000","last_undegraded":"2023-10-08T07:09:35.108074+0000","last_fullsized":"2023-10-08T07:09:35.108074+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:44:57.453475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109892+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:35.109892+0000","last_peered":"2023-10-08T07:09:35.109892+0000","last_clean":"2023-10-08T07:09:35.109892+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:35.109892+0000","last_undegraded":"2023-10-08T07:09:35.109892+0000","last_fullsized":"2023-10-08T07:09:35.109892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2941,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108860+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:09:35.108860+0000","last_peered":"2023-10-08T07:09:35.108860+0000","last_clean":"2023-10-08T07:09:35.108860+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:09:35.108860+0000","last_undegraded":"2023-10-08T07:09:35.108860+0000","last_fullsized":"2023-10-08T07:09:35.108860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"67'7","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182792+0000","last_change":"2023-10-08T07:09:17.758979+0000","last_active":"2023-10-08T07:09:35.182792+0000","last_peered":"2023-10-08T07:09:35.182792+0000","last_clean":"2023-10-08T07:09:35.182792+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:09:35.182792+0000","last_undegraded":"2023-10-08T07:09:35.182792+0000","last_fullsized":"2023-10-08T07:09:35.182792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:06.386900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108369+0000","last_change":"2023-10-08T07:09:18.064856+0000","last_active":"2023-10-08T07:09:35.108369+0000","last_peered":"2023-10-08T07:09:35.108369+0000","last_clean":"2023-10-08T07:09:35.108369+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:35.108369+0000","last_undegraded":"2023-10-08T07:09:35.108369+0000","last_fullsized":"2023-10-08T07:09:35.108369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.230654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":189,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109611+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:35.109611+0000","last_peered":"2023-10-08T07:09:35.109611+0000","last_clean":"2023-10-08T07:09:35.109611+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:35.109611+0000","last_undegraded":"2023-10-08T07:09:35.109611+0000","last_fullsized":"2023-10-08T07:09:35.109611+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2948,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.110046+0000","last_change":"2023-10-08T07:09:21.038587+0000","last_active":"2023-10-08T07:09:35.110046+0000","last_peered":"2023-10-08T07:09:35.110046+0000","last_clean":"2023-10-08T07:09:35.110046+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:09:35.110046+0000","last_undegraded":"2023-10-08T07:09:35.110046+0000","last_fullsized":"2023-10-08T07:09:35.110046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:50.835623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109696+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:09:35.109696+0000","last_peered":"2023-10-08T07:09:35.109696+0000","last_clean":"2023-10-08T07:09:35.109696+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:09:35.109696+0000","last_undegraded":"2023-10-08T07:09:35.109696+0000","last_fullsized":"2023-10-08T07:09:35.109696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2943,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183227+0000","last_change":"2023-10-08T07:09:20.737135+0000","last_active":"2023-10-08T07:09:35.183227+0000","last_peered":"2023-10-08T07:09:35.183227+0000","last_clean":"2023-10-08T07:09:35.183227+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:09:35.183227+0000","last_undegraded":"2023-10-08T07:09:35.183227+0000","last_fullsized":"2023-10-08T07:09:35.183227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:52.474047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108478+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:09:35.108478+0000","last_peered":"2023-10-08T07:09:35.108478+0000","last_clean":"2023-10-08T07:09:35.108478+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:09:35.108478+0000","last_undegraded":"2023-10-08T07:09:35.108478+0000","last_fullsized":"2023-10-08T07:09:35.108478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8822,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183486+0000","last_change":"2023-10-08T07:09:20.737857+0000","last_active":"2023-10-08T07:09:35.183486+0000","last_peered":"2023-10-08T07:09:35.183486+0000","last_clean":"2023-10-08T07:09:35.183486+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:09:35.183486+0000","last_undegraded":"2023-10-08T07:09:35.183486+0000","last_fullsized":"2023-10-08T07:09:35.183486+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:56.740198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182158+0000","last_change":"2023-10-08T07:09:17.751068+0000","last_active":"2023-10-08T07:09:35.182158+0000","last_peered":"2023-10-08T07:09:35.182158+0000","last_clean":"2023-10-08T07:09:35.182158+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:09:35.182158+0000","last_undegraded":"2023-10-08T07:09:35.182158+0000","last_fullsized":"2023-10-08T07:09:35.182158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:15.155530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2924,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109141+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:09:35.109141+0000","last_peered":"2023-10-08T07:09:35.109141+0000","last_clean":"2023-10-08T07:09:35.109141+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:09:35.109141+0000","last_undegraded":"2023-10-08T07:09:35.109141+0000","last_fullsized":"2023-10-08T07:09:35.109141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'9","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109028+0000","last_change":"2023-10-08T07:09:18.054836+0000","last_active":"2023-10-08T07:09:35.109028+0000","last_peered":"2023-10-08T07:09:35.109028+0000","last_clean":"2023-10-08T07:09:35.109028+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:09:35.109028+0000","last_undegraded":"2023-10-08T07:09:35.109028+0000","last_fullsized":"2023-10-08T07:09:35.109028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:16.567958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109238+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:09:35.109238+0000","last_peered":"2023-10-08T07:09:35.109238+0000","last_clean":"2023-10-08T07:09:35.109238+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:09:35.109238+0000","last_undegraded":"2023-10-08T07:09:35.109238+0000","last_fullsized":"2023-10-08T07:09:35.109238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109969+0000","last_change":"2023-10-08T07:09:18.056757+0000","last_active":"2023-10-08T07:09:35.109969+0000","last_peered":"2023-10-08T07:09:35.109969+0000","last_clean":"2023-10-08T07:09:35.109969+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:09:35.109969+0000","last_undegraded":"2023-10-08T07:09:35.109969+0000","last_fullsized":"2023-10-08T07:09:35.109969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:47.575148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182122+0000","last_change":"2023-10-08T07:09:17.753129+0000","last_active":"2023-10-08T07:09:35.182122+0000","last_peered":"2023-10-08T07:09:35.182122+0000","last_clean":"2023-10-08T07:09:35.182122+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:09:35.182122+0000","last_undegraded":"2023-10-08T07:09:35.182122+0000","last_fullsized":"2023-10-08T07:09:35.182122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:53.133780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183472+0000","last_change":"2023-10-08T07:09:17.753124+0000","last_active":"2023-10-08T07:09:35.183472+0000","last_peered":"2023-10-08T07:09:35.183472+0000","last_clean":"2023-10-08T07:09:35.183472+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:09:35.183472+0000","last_undegraded":"2023-10-08T07:09:35.183472+0000","last_fullsized":"2023-10-08T07:09:35.183472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.689880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3000,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182330+0000","last_change":"2023-10-08T07:09:20.737843+0000","last_active":"2023-10-08T07:09:35.182330+0000","last_peered":"2023-10-08T07:09:35.182330+0000","last_clean":"2023-10-08T07:09:35.182330+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:09:35.182330+0000","last_undegraded":"2023-10-08T07:09:35.182330+0000","last_fullsized":"2023-10-08T07:09:35.182330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:58.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109742+0000","last_change":"2023-10-08T07:09:18.057034+0000","last_active":"2023-10-08T07:09:35.109742+0000","last_peered":"2023-10-08T07:09:35.109742+0000","last_clean":"2023-10-08T07:09:35.109742+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:09:35.109742+0000","last_undegraded":"2023-10-08T07:09:35.109742+0000","last_fullsized":"2023-10-08T07:09:35.109742+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:42.006586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2947,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109223+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:09:35.109223+0000","last_peered":"2023-10-08T07:09:35.109223+0000","last_clean":"2023-10-08T07:09:35.109223+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:09:35.109223+0000","last_undegraded":"2023-10-08T07:09:35.109223+0000","last_fullsized":"2023-10-08T07:09:35.109223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109356+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:35.109356+0000","last_peered":"2023-10-08T07:09:35.109356+0000","last_clean":"2023-10-08T07:09:35.109356+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:35.109356+0000","last_undegraded":"2023-10-08T07:09:35.109356+0000","last_fullsized":"2023-10-08T07:09:35.109356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":2992,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108605+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:09:35.108605+0000","last_peered":"2023-10-08T07:09:35.108605+0000","last_clean":"2023-10-08T07:09:35.108605+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:35.108605+0000","last_undegraded":"2023-10-08T07:09:35.108605+0000","last_fullsized":"2023-10-08T07:09:35.108605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'3","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108542+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:09:35.108542+0000","last_peered":"2023-10-08T07:09:35.108542+0000","last_clean":"2023-10-08T07:09:35.108542+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:09:35.108542+0000","last_undegraded":"2023-10-08T07:09:35.108542+0000","last_fullsized":"2023-10-08T07:09:35.108542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5930,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109441+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:09:35.109441+0000","last_peered":"2023-10-08T07:09:35.109441+0000","last_clean":"2023-10-08T07:09:35.109441+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:35.109441+0000","last_undegraded":"2023-10-08T07:09:35.109441+0000","last_fullsized":"2023-10-08T07:09:35.109441+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109090+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:09:35.109090+0000","last_peered":"2023-10-08T07:09:35.109090+0000","last_clean":"2023-10-08T07:09:35.109090+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:09:35.109090+0000","last_undegraded":"2023-10-08T07:09:35.109090+0000","last_fullsized":"2023-10-08T07:09:35.109090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109993+0000","last_change":"2023-10-08T07:09:18.058346+0000","last_active":"2023-10-08T07:09:35.109993+0000","last_peered":"2023-10-08T07:09:35.109993+0000","last_clean":"2023-10-08T07:09:35.109993+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:09:35.109993+0000","last_undegraded":"2023-10-08T07:09:35.109993+0000","last_fullsized":"2023-10-08T07:09:35.109993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:51.958399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182484+0000","last_change":"2023-10-08T07:09:17.752745+0000","last_active":"2023-10-08T07:09:35.182484+0000","last_peered":"2023-10-08T07:09:35.182484+0000","last_clean":"2023-10-08T07:09:35.182484+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:09:35.182484+0000","last_undegraded":"2023-10-08T07:09:35.182484+0000","last_fullsized":"2023-10-08T07:09:35.182484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:08.404190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5935,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109869+0000","last_change":"2023-10-08T07:09:21.040694+0000","last_active":"2023-10-08T07:09:35.109869+0000","last_peered":"2023-10-08T07:09:35.109869+0000","last_clean":"2023-10-08T07:09:35.109869+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:09:35.109869+0000","last_undegraded":"2023-10-08T07:09:35.109869+0000","last_fullsized":"2023-10-08T07:09:35.109869+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:41.813249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182364+0000","last_change":"2023-10-08T07:09:17.754898+0000","last_active":"2023-10-08T07:09:35.182364+0000","last_peered":"2023-10-08T07:09:35.182364+0000","last_clean":"2023-10-08T07:09:35.182364+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:09:35.182364+0000","last_undegraded":"2023-10-08T07:09:35.182364+0000","last_fullsized":"2023-10-08T07:09:35.182364+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:19.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2950,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109068+0000","last_change":"2023-10-08T07:09:21.042008+0000","last_active":"2023-10-08T07:09:35.109068+0000","last_peered":"2023-10-08T07:09:35.109068+0000","last_clean":"2023-10-08T07:09:35.109068+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:09:35.109068+0000","last_undegraded":"2023-10-08T07:09:35.109068+0000","last_fullsized":"2023-10-08T07:09:35.109068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:32:00.347477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110127+0000","last_change":"2023-10-08T07:09:18.057444+0000","last_active":"2023-10-08T07:09:36.110127+0000","last_peered":"2023-10-08T07:09:36.110127+0000","last_clean":"2023-10-08T07:09:36.110127+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:09:36.110127+0000","last_undegraded":"2023-10-08T07:09:36.110127+0000","last_fullsized":"2023-10-08T07:09:36.110127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:06:13.088433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109847+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:09:35.109847+0000","last_peered":"2023-10-08T07:09:35.109847+0000","last_clean":"2023-10-08T07:09:35.109847+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:09:35.109847+0000","last_undegraded":"2023-10-08T07:09:35.109847+0000","last_fullsized":"2023-10-08T07:09:35.109847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5851,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182483+0000","last_change":"2023-10-08T07:09:20.735892+0000","last_active":"2023-10-08T07:09:35.182483+0000","last_peered":"2023-10-08T07:09:35.182483+0000","last_clean":"2023-10-08T07:09:35.182483+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:09:35.182483+0000","last_undegraded":"2023-10-08T07:09:35.182483+0000","last_fullsized":"2023-10-08T07:09:35.182483+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:02.889299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111212+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:09:36.111212+0000","last_peered":"2023-10-08T07:09:36.111212+0000","last_clean":"2023-10-08T07:09:36.111212+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:09:36.111212+0000","last_undegraded":"2023-10-08T07:09:36.111212+0000","last_fullsized":"2023-10-08T07:09:36.111212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109450+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:09:35.109450+0000","last_peered":"2023-10-08T07:09:35.109450+0000","last_clean":"2023-10-08T07:09:35.109450+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:09:35.109450+0000","last_undegraded":"2023-10-08T07:09:35.109450+0000","last_fullsized":"2023-10-08T07:09:35.109450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2958,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108810+0000","last_change":"2023-10-08T07:09:21.040185+0000","last_active":"2023-10-08T07:09:35.108810+0000","last_peered":"2023-10-08T07:09:35.108810+0000","last_clean":"2023-10-08T07:09:35.108810+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:09:35.108810+0000","last_undegraded":"2023-10-08T07:09:35.108810+0000","last_fullsized":"2023-10-08T07:09:35.108810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:50.835623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109492+0000","last_change":"2023-10-08T07:09:18.067783+0000","last_active":"2023-10-08T07:09:36.109492+0000","last_peered":"2023-10-08T07:09:36.109492+0000","last_clean":"2023-10-08T07:09:36.109492+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:09:36.109492+0000","last_undegraded":"2023-10-08T07:09:36.109492+0000","last_fullsized":"2023-10-08T07:09:36.109492+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:11.554943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182723+0000","last_change":"2023-10-08T07:09:17.752755+0000","last_active":"2023-10-08T07:09:35.182723+0000","last_peered":"2023-10-08T07:09:35.182723+0000","last_clean":"2023-10-08T07:09:35.182723+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:09:35.182723+0000","last_undegraded":"2023-10-08T07:09:35.182723+0000","last_fullsized":"2023-10-08T07:09:35.182723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:23.696397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8917,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109189+0000","last_change":"2023-10-08T07:09:21.042220+0000","last_active":"2023-10-08T07:09:35.109189+0000","last_peered":"2023-10-08T07:09:35.109189+0000","last_clean":"2023-10-08T07:09:35.109189+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:09:35.109189+0000","last_undegraded":"2023-10-08T07:09:35.109189+0000","last_fullsized":"2023-10-08T07:09:35.109189+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:33.242389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111323+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:09:36.111323+0000","last_peered":"2023-10-08T07:09:36.111323+0000","last_clean":"2023-10-08T07:09:36.111323+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:09:36.111323+0000","last_undegraded":"2023-10-08T07:09:36.111323+0000","last_fullsized":"2023-10-08T07:09:36.111323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":299,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108760+0000","last_change":"2023-10-08T07:09:18.052234+0000","last_active":"2023-10-08T07:09:35.108760+0000","last_peered":"2023-10-08T07:09:35.108760+0000","last_clean":"2023-10-08T07:09:35.108760+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:09:35.108760+0000","last_undegraded":"2023-10-08T07:09:35.108760+0000","last_fullsized":"2023-10-08T07:09:35.108760+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:02:56.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108336+0000","last_change":"2023-10-08T07:09:18.049984+0000","last_active":"2023-10-08T07:09:35.108336+0000","last_peered":"2023-10-08T07:09:35.108336+0000","last_clean":"2023-10-08T07:09:35.108336+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:09:35.108336+0000","last_undegraded":"2023-10-08T07:09:35.108336+0000","last_fullsized":"2023-10-08T07:09:35.108336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:59:20.880943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5902,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109931+0000","last_change":"2023-10-08T07:09:21.040684+0000","last_active":"2023-10-08T07:09:35.109931+0000","last_peered":"2023-10-08T07:09:35.109931+0000","last_clean":"2023-10-08T07:09:35.109931+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:09:35.109931+0000","last_undegraded":"2023-10-08T07:09:35.109931+0000","last_fullsized":"2023-10-08T07:09:35.109931+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:14.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108874+0000","last_change":"2023-10-08T07:09:18.051593+0000","last_active":"2023-10-08T07:09:35.108874+0000","last_peered":"2023-10-08T07:09:35.108874+0000","last_clean":"2023-10-08T07:09:35.108874+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:09:35.108874+0000","last_undegraded":"2023-10-08T07:09:35.108874+0000","last_fullsized":"2023-10-08T07:09:35.108874+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:34.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108212+0000","last_change":"2023-10-08T07:09:25.038493+0000","last_active":"2023-10-08T07:09:35.108212+0000","last_peered":"2023-10-08T07:09:35.108212+0000","last_clean":"2023-10-08T07:09:35.108212+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:09:35.108212+0000","last_undegraded":"2023-10-08T07:09:35.108212+0000","last_fullsized":"2023-10-08T07:09:35.108212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:44.616324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183181+0000","last_change":"2023-10-08T07:09:17.755079+0000","last_active":"2023-10-08T07:09:35.183181+0000","last_peered":"2023-10-08T07:09:35.183181+0000","last_clean":"2023-10-08T07:09:35.183181+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:09:35.183181+0000","last_undegraded":"2023-10-08T07:09:35.183181+0000","last_fullsized":"2023-10-08T07:09:35.183181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:12.238239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183205+0000","last_change":"2023-10-08T07:09:17.754844+0000","last_active":"2023-10-08T07:09:35.183205+0000","last_peered":"2023-10-08T07:09:35.183205+0000","last_clean":"2023-10-08T07:09:35.183205+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:35.183205+0000","last_undegraded":"2023-10-08T07:09:35.183205+0000","last_fullsized":"2023-10-08T07:09:35.183205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:12.129220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108682+0000","last_change":"2023-10-08T07:09:18.056208+0000","last_active":"2023-10-08T07:09:35.108682+0000","last_peered":"2023-10-08T07:09:35.108682+0000","last_clean":"2023-10-08T07:09:35.108682+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:09:35.108682+0000","last_undegraded":"2023-10-08T07:09:35.108682+0000","last_fullsized":"2023-10-08T07:09:35.108682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:55.549444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182645+0000","last_change":"2023-10-08T07:09:17.753144+0000","last_active":"2023-10-08T07:09:35.182645+0000","last_peered":"2023-10-08T07:09:35.182645+0000","last_clean":"2023-10-08T07:09:35.182645+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:09:35.182645+0000","last_undegraded":"2023-10-08T07:09:35.182645+0000","last_fullsized":"2023-10-08T07:09:35.182645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:25.968547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'3","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109045+0000","last_change":"2023-10-08T07:09:18.059238+0000","last_active":"2023-10-08T07:09:35.109045+0000","last_peered":"2023-10-08T07:09:35.109045+0000","last_clean":"2023-10-08T07:09:35.109045+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:09:35.109045+0000","last_undegraded":"2023-10-08T07:09:35.109045+0000","last_fullsized":"2023-10-08T07:09:35.109045+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:32.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109103+0000","last_change":"2023-10-08T07:09:18.056706+0000","last_active":"2023-10-08T07:09:35.109103+0000","last_peered":"2023-10-08T07:09:35.109103+0000","last_clean":"2023-10-08T07:09:35.109103+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:09:35.109103+0000","last_undegraded":"2023-10-08T07:09:35.109103+0000","last_fullsized":"2023-10-08T07:09:35.109103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:17.258824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2988,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108033+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:09:35.108033+0000","last_peered":"2023-10-08T07:09:35.108033+0000","last_clean":"2023-10-08T07:09:35.108033+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:35.108033+0000","last_undegraded":"2023-10-08T07:09:35.108033+0000","last_fullsized":"2023-10-08T07:09:35.108033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.110033+0000","last_change":"2023-10-08T07:09:18.054661+0000","last_active":"2023-10-08T07:09:35.110033+0000","last_peered":"2023-10-08T07:09:35.110033+0000","last_clean":"2023-10-08T07:09:35.110033+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:09:35.110033+0000","last_undegraded":"2023-10-08T07:09:35.110033+0000","last_fullsized":"2023-10-08T07:09:35.110033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:10.492782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"69'9","reported_seq":94,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108910+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:09:35.108910+0000","last_peered":"2023-10-08T07:09:35.108910+0000","last_clean":"2023-10-08T07:09:35.108910+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:09:35.108910+0000","last_undegraded":"2023-10-08T07:09:35.108910+0000","last_fullsized":"2023-10-08T07:09:35.108910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2962,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182541+0000","last_change":"2023-10-08T07:09:20.735652+0000","last_active":"2023-10-08T07:09:35.182541+0000","last_peered":"2023-10-08T07:09:35.182541+0000","last_clean":"2023-10-08T07:09:35.182541+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:09:35.182541+0000","last_undegraded":"2023-10-08T07:09:35.182541+0000","last_fullsized":"2023-10-08T07:09:35.182541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:15.857716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182410+0000","last_change":"2023-10-08T07:09:22.762216+0000","last_active":"2023-10-08T07:09:35.182410+0000","last_peered":"2023-10-08T07:09:35.182410+0000","last_clean":"2023-10-08T07:09:35.182410+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:35.182410+0000","last_undegraded":"2023-10-08T07:09:35.182410+0000","last_fullsized":"2023-10-08T07:09:35.182410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:49.404736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183153+0000","last_change":"2023-10-08T07:09:24.732784+0000","last_active":"2023-10-08T07:09:35.183153+0000","last_peered":"2023-10-08T07:09:35.183153+0000","last_clean":"2023-10-08T07:09:35.183153+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:09:35.183153+0000","last_undegraded":"2023-10-08T07:09:35.183153+0000","last_fullsized":"2023-10-08T07:09:35.183153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:25.502260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109487+0000","last_change":"2023-10-08T07:09:23.066235+0000","last_active":"2023-10-08T07:09:35.109487+0000","last_peered":"2023-10-08T07:09:35.109487+0000","last_clean":"2023-10-08T07:09:35.109487+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:09:35.109487+0000","last_undegraded":"2023-10-08T07:09:35.109487+0000","last_fullsized":"2023-10-08T07:09:35.109487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:42.060351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5890,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109543+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:09:35.109543+0000","last_peered":"2023-10-08T07:09:35.109543+0000","last_clean":"2023-10-08T07:09:35.109543+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:09:35.109543+0000","last_undegraded":"2023-10-08T07:09:35.109543+0000","last_fullsized":"2023-10-08T07:09:35.109543+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182938+0000","last_change":"2023-10-08T07:09:17.753543+0000","last_active":"2023-10-08T07:09:35.182938+0000","last_peered":"2023-10-08T07:09:35.182938+0000","last_clean":"2023-10-08T07:09:35.182938+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:09:35.182938+0000","last_undegraded":"2023-10-08T07:09:35.182938+0000","last_fullsized":"2023-10-08T07:09:35.182938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:51.956560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3009,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109233+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:35.109233+0000","last_peered":"2023-10-08T07:09:35.109233+0000","last_clean":"2023-10-08T07:09:35.109233+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:35.109233+0000","last_undegraded":"2023-10-08T07:09:35.109233+0000","last_fullsized":"2023-10-08T07:09:35.109233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109221+0000","last_change":"2023-10-08T07:09:18.057710+0000","last_active":"2023-10-08T07:09:35.109221+0000","last_peered":"2023-10-08T07:09:35.109221+0000","last_clean":"2023-10-08T07:09:35.109221+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:09:35.109221+0000","last_undegraded":"2023-10-08T07:09:35.109221+0000","last_fullsized":"2023-10-08T07:09:35.109221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:49.694705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5871,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182257+0000","last_change":"2023-10-08T07:09:20.734404+0000","last_active":"2023-10-08T07:09:35.182257+0000","last_peered":"2023-10-08T07:09:35.182257+0000","last_clean":"2023-10-08T07:09:35.182257+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:09:35.182257+0000","last_undegraded":"2023-10-08T07:09:35.182257+0000","last_fullsized":"2023-10-08T07:09:35.182257+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:04:28.453406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":89,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109149+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:09:35.109149+0000","last_peered":"2023-10-08T07:09:35.109149+0000","last_clean":"2023-10-08T07:09:35.109149+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:09:35.109149+0000","last_undegraded":"2023-10-08T07:09:35.109149+0000","last_fullsized":"2023-10-08T07:09:35.109149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109047+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:09:35.109047+0000","last_peered":"2023-10-08T07:09:35.109047+0000","last_clean":"2023-10-08T07:09:35.109047+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:09:35.109047+0000","last_undegraded":"2023-10-08T07:09:35.109047+0000","last_fullsized":"2023-10-08T07:09:35.109047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8807,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108915+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:09:35.108915+0000","last_peered":"2023-10-08T07:09:35.108915+0000","last_clean":"2023-10-08T07:09:35.108915+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:09:35.108915+0000","last_undegraded":"2023-10-08T07:09:35.108915+0000","last_fullsized":"2023-10-08T07:09:35.108915+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3001,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108201+0000","last_change":"2023-10-08T07:09:21.036530+0000","last_active":"2023-10-08T07:09:35.108201+0000","last_peered":"2023-10-08T07:09:35.108201+0000","last_clean":"2023-10-08T07:09:35.108201+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:09:35.108201+0000","last_undegraded":"2023-10-08T07:09:35.108201+0000","last_fullsized":"2023-10-08T07:09:35.108201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:41:49.285073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182677+0000","last_change":"2023-10-08T07:09:17.754585+0000","last_active":"2023-10-08T07:09:35.182677+0000","last_peered":"2023-10-08T07:09:35.182677+0000","last_clean":"2023-10-08T07:09:35.182677+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:09:35.182677+0000","last_undegraded":"2023-10-08T07:09:35.182677+0000","last_fullsized":"2023-10-08T07:09:35.182677+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:44.969079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108686+0000","last_change":"2023-10-08T07:09:18.056756+0000","last_active":"2023-10-08T07:09:35.108686+0000","last_peered":"2023-10-08T07:09:35.108686+0000","last_clean":"2023-10-08T07:09:35.108686+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:35.108686+0000","last_undegraded":"2023-10-08T07:09:35.108686+0000","last_fullsized":"2023-10-08T07:09:35.108686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:21:49.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2974,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182686+0000","last_change":"2023-10-08T07:09:20.735423+0000","last_active":"2023-10-08T07:09:35.182686+0000","last_peered":"2023-10-08T07:09:35.182686+0000","last_clean":"2023-10-08T07:09:35.182686+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:09:35.182686+0000","last_undegraded":"2023-10-08T07:09:35.182686+0000","last_fullsized":"2023-10-08T07:09:35.182686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:52.216576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595772,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776068,"statfs":{"total":96636764160,"available":96026693632,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59499999999999997,"15min":0.49199999999999999},"min":{"1min":0.35499999999999998,"5min":0.188,"15min":0.188},"max":{"1min":0.76200000000000001,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.60499999999999998,"15min":0.505},"min":{"1min":0.372,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.66300000000000003,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.31}]},{"osd":1,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.55800000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483920,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887920,"statfs":{"total":96636764160,"available":96141230080,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.54300000000000004}]},{"osd":2,"last update":"Sun Oct 8 07:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.1910000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.36399999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.90700000000000003,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":74,"seq":317827579910,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":1704,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":1744896,"data_stored":1216013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:09:42.591 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:09:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:09:42.963 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":91,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:09:36.105827+0000","last_up_change":"2023-10-08T07:09:17.031827+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":36,"up_from":74,"up_thru":81,"down_at":37,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6801","nonce":551235404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6803","nonce":551235404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6807","nonce":551235404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6805","nonce":551235404}]},"public_addr":"172.21.15.86:6801/551235404","cluster_addr":"172.21.15.86:6803/551235404","heartbeat_back_addr":"172.21.15.86:6807/551235404","heartbeat_front_addr":"172.21.15.86:6805/551235404","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":36},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:09:43.978 INFO:tasks.ceph:Scrubbing osd.0 2023-10-08T07:09:43.979 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-08T07:09:44.147 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-08T07:09:44.148 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T07:09:44.148 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-08T07:09:44.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-08T07:09:44.502 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 0 to deep-scrub 2023-10-08T07:09:44.512 INFO:tasks.ceph:Scrubbing osd.1 2023-10-08T07:09:44.512 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-08T07:09:44.663 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-08T07:09:44.663 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-08T07:09:44.663 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-08T07:09:44.675 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-08T07:09:45.015 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 1 to deep-scrub 2023-10-08T07:09:45.027 INFO:tasks.ceph:Scrubbing osd.2 2023-10-08T07:09:45.027 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-08T07:09:45.183 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-08T07:09:45.183 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T07:09:45.183 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-08T07:09:45.195 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-08T07:09:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 2 to deep-scrub 2023-10-08T07:09:45.547 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:09:45.889 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:09:45.890 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:09:45.901 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2023-10-08T07:09:44.570828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149186,"ondisk_log_size":149186,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145032,"kb_used_data":4308,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970488,"statfs":{"total":289910292480,"available":288737779712,"internally_reserved":0,"allocated":4411392,"data_stored":2817910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.464082"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":2999,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183536+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:35.183536+0000","last_peered":"2023-10-08T07:09:35.183536+0000","last_clean":"2023-10-08T07:09:35.183536+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:35.183536+0000","last_undegraded":"2023-10-08T07:09:35.183536+0000","last_fullsized":"2023-10-08T07:09:35.183536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:13.308715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2900,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183152+0000","last_change":"2023-10-08T07:09:20.737069+0000","last_active":"2023-10-08T07:09:35.183152+0000","last_peered":"2023-10-08T07:09:35.183152+0000","last_clean":"2023-10-08T07:09:35.183152+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:35.183152+0000","last_undegraded":"2023-10-08T07:09:35.183152+0000","last_fullsized":"2023-10-08T07:09:35.183152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:03.307776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109869+0000","last_change":"2023-10-08T07:09:18.056834+0000","last_active":"2023-10-08T07:09:35.109869+0000","last_peered":"2023-10-08T07:09:35.109869+0000","last_clean":"2023-10-08T07:09:35.109869+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:09:35.109869+0000","last_undegraded":"2023-10-08T07:09:35.109869+0000","last_fullsized":"2023-10-08T07:09:35.109869+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:16.520645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109745+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:09:35.109745+0000","last_peered":"2023-10-08T07:09:35.109745+0000","last_clean":"2023-10-08T07:09:35.109745+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:09:35.109745+0000","last_undegraded":"2023-10-08T07:09:35.109745+0000","last_fullsized":"2023-10-08T07:09:35.109745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:35:49.999333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5889,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182831+0000","last_change":"2023-10-08T07:09:20.736694+0000","last_active":"2023-10-08T07:09:35.182831+0000","last_peered":"2023-10-08T07:09:35.182831+0000","last_clean":"2023-10-08T07:09:35.182831+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:09:35.182831+0000","last_undegraded":"2023-10-08T07:09:35.182831+0000","last_fullsized":"2023-10-08T07:09:35.182831+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:19:45.353931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8571,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109046+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:09:35.109046+0000","last_peered":"2023-10-08T07:09:35.109046+0000","last_clean":"2023-10-08T07:09:35.109046+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:09:35.109046+0000","last_undegraded":"2023-10-08T07:09:35.109046+0000","last_fullsized":"2023-10-08T07:09:35.109046+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108839+0000","last_change":"2023-10-08T07:05:33.324686+0000","last_active":"2023-10-08T07:09:35.108839+0000","last_peered":"2023-10-08T07:09:35.108839+0000","last_clean":"2023-10-08T07:09:35.108839+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:35.108839+0000","last_undegraded":"2023-10-08T07:09:35.108839+0000","last_fullsized":"2023-10-08T07:09:35.108839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:06:48.802601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3039,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108687+0000","last_change":"2023-10-08T07:09:28.078167+0000","last_active":"2023-10-08T07:09:35.108687+0000","last_peered":"2023-10-08T07:09:35.108687+0000","last_clean":"2023-10-08T07:09:35.108687+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:09:35.108687+0000","last_undegraded":"2023-10-08T07:09:35.108687+0000","last_fullsized":"2023-10-08T07:09:35.108687+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:33:51.764425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2883,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108902+0000","last_change":"2023-10-08T07:09:21.041511+0000","last_active":"2023-10-08T07:09:35.108902+0000","last_peered":"2023-10-08T07:09:35.108902+0000","last_clean":"2023-10-08T07:09:35.108902+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:35.108902+0000","last_undegraded":"2023-10-08T07:09:35.108902+0000","last_fullsized":"2023-10-08T07:09:35.108902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:41.813249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2956,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183330+0000","last_change":"2023-10-08T07:09:20.737658+0000","last_active":"2023-10-08T07:09:35.183330+0000","last_peered":"2023-10-08T07:09:35.183330+0000","last_clean":"2023-10-08T07:09:35.183330+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:09:35.183330+0000","last_undegraded":"2023-10-08T07:09:35.183330+0000","last_fullsized":"2023-10-08T07:09:35.183330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:36.077873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109454+0000","last_change":"2023-10-08T07:09:23.063882+0000","last_active":"2023-10-08T07:09:35.109454+0000","last_peered":"2023-10-08T07:09:35.109454+0000","last_clean":"2023-10-08T07:09:35.109454+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:09:35.109454+0000","last_undegraded":"2023-10-08T07:09:35.109454+0000","last_fullsized":"2023-10-08T07:09:35.109454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:33.242389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2961,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182940+0000","last_change":"2023-10-08T07:09:20.736199+0000","last_active":"2023-10-08T07:09:35.182940+0000","last_peered":"2023-10-08T07:09:35.182940+0000","last_clean":"2023-10-08T07:09:35.182940+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:35.182940+0000","last_undegraded":"2023-10-08T07:09:35.182940+0000","last_fullsized":"2023-10-08T07:09:35.182940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.663562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182912+0000","last_change":"2023-10-08T07:09:17.754638+0000","last_active":"2023-10-08T07:09:35.182912+0000","last_peered":"2023-10-08T07:09:35.182912+0000","last_clean":"2023-10-08T07:09:35.182912+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:09:35.182912+0000","last_undegraded":"2023-10-08T07:09:35.182912+0000","last_fullsized":"2023-10-08T07:09:35.182912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:12.379792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2977,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109469+0000","last_change":"2023-10-08T07:09:21.040638+0000","last_active":"2023-10-08T07:09:35.109469+0000","last_peered":"2023-10-08T07:09:35.109469+0000","last_clean":"2023-10-08T07:09:35.109469+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:09:35.109469+0000","last_undegraded":"2023-10-08T07:09:35.109469+0000","last_fullsized":"2023-10-08T07:09:35.109469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:13.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5866,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108990+0000","last_change":"2023-10-08T07:09:26.042339+0000","last_active":"2023-10-08T07:09:35.108990+0000","last_peered":"2023-10-08T07:09:35.108990+0000","last_clean":"2023-10-08T07:09:35.108990+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:09:35.108990+0000","last_undegraded":"2023-10-08T07:09:35.108990+0000","last_fullsized":"2023-10-08T07:09:35.108990+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:24:41.696448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2982,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108787+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:09:35.108787+0000","last_peered":"2023-10-08T07:09:35.108787+0000","last_clean":"2023-10-08T07:09:35.108787+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:09:35.108787+0000","last_undegraded":"2023-10-08T07:09:35.108787+0000","last_fullsized":"2023-10-08T07:09:35.108787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2981,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108994+0000","last_change":"2023-10-08T07:09:21.041706+0000","last_active":"2023-10-08T07:09:35.108994+0000","last_peered":"2023-10-08T07:09:35.108994+0000","last_clean":"2023-10-08T07:09:35.108994+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:09:35.108994+0000","last_undegraded":"2023-10-08T07:09:35.108994+0000","last_fullsized":"2023-10-08T07:09:35.108994+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:13.540283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183023+0000","last_change":"2023-10-08T07:09:17.754747+0000","last_active":"2023-10-08T07:09:35.183023+0000","last_peered":"2023-10-08T07:09:35.183023+0000","last_clean":"2023-10-08T07:09:35.183023+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:09:35.183023+0000","last_undegraded":"2023-10-08T07:09:35.183023+0000","last_fullsized":"2023-10-08T07:09:35.183023+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:47.075369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2962,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108922+0000","last_change":"2023-10-08T07:09:21.039966+0000","last_active":"2023-10-08T07:09:35.108922+0000","last_peered":"2023-10-08T07:09:35.108922+0000","last_clean":"2023-10-08T07:09:35.108922+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:09:35.108922+0000","last_undegraded":"2023-10-08T07:09:35.108922+0000","last_fullsized":"2023-10-08T07:09:35.108922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:14.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2973,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109672+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:09:35.109672+0000","last_peered":"2023-10-08T07:09:35.109672+0000","last_clean":"2023-10-08T07:09:35.109672+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:09:35.109672+0000","last_undegraded":"2023-10-08T07:09:35.109672+0000","last_fullsized":"2023-10-08T07:09:35.109672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.458719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5892,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109302+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:09:35.109302+0000","last_peered":"2023-10-08T07:09:35.109302+0000","last_clean":"2023-10-08T07:09:35.109302+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:09:35.109302+0000","last_undegraded":"2023-10-08T07:09:35.109302+0000","last_fullsized":"2023-10-08T07:09:35.109302+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:17.360199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2876,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182479+0000","last_change":"2023-10-08T07:09:20.735818+0000","last_active":"2023-10-08T07:09:35.182479+0000","last_peered":"2023-10-08T07:09:35.182479+0000","last_clean":"2023-10-08T07:09:35.182479+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:09:35.182479+0000","last_undegraded":"2023-10-08T07:09:35.182479+0000","last_fullsized":"2023-10-08T07:09:35.182479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:38:56.874136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2981,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108494+0000","last_change":"2023-10-08T07:05:33.318779+0000","last_active":"2023-10-08T07:09:35.108494+0000","last_peered":"2023-10-08T07:09:35.108494+0000","last_clean":"2023-10-08T07:09:35.108494+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:35.108494+0000","last_undegraded":"2023-10-08T07:09:35.108494+0000","last_fullsized":"2023-10-08T07:09:35.108494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:13.798632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5837,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182023+0000","last_change":"2023-10-08T07:09:20.736822+0000","last_active":"2023-10-08T07:09:35.182023+0000","last_peered":"2023-10-08T07:09:35.182023+0000","last_clean":"2023-10-08T07:09:35.182023+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:35.182023+0000","last_undegraded":"2023-10-08T07:09:35.182023+0000","last_fullsized":"2023-10-08T07:09:35.182023+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:19.752508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2956,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183225+0000","last_change":"2023-10-08T07:09:20.735845+0000","last_active":"2023-10-08T07:09:35.183225+0000","last_peered":"2023-10-08T07:09:35.183225+0000","last_clean":"2023-10-08T07:09:35.183225+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:09:35.183225+0000","last_undegraded":"2023-10-08T07:09:35.183225+0000","last_fullsized":"2023-10-08T07:09:35.183225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:18.084033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2974,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109238+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:09:35.109238+0000","last_peered":"2023-10-08T07:09:35.109238+0000","last_clean":"2023-10-08T07:09:35.109238+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:09:35.109238+0000","last_undegraded":"2023-10-08T07:09:35.109238+0000","last_fullsized":"2023-10-08T07:09:35.109238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109732+0000","last_change":"2023-10-08T07:09:18.055530+0000","last_active":"2023-10-08T07:09:35.109732+0000","last_peered":"2023-10-08T07:09:35.109732+0000","last_clean":"2023-10-08T07:09:35.109732+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:35.109732+0000","last_undegraded":"2023-10-08T07:09:35.109732+0000","last_fullsized":"2023-10-08T07:09:35.109732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:21:01.783452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182304+0000","last_change":"2023-10-08T07:09:17.751957+0000","last_active":"2023-10-08T07:09:35.182304+0000","last_peered":"2023-10-08T07:09:35.182304+0000","last_clean":"2023-10-08T07:09:35.182304+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:09:35.182304+0000","last_undegraded":"2023-10-08T07:09:35.182304+0000","last_fullsized":"2023-10-08T07:09:35.182304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:13.104739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183354+0000","last_change":"2023-10-08T07:09:17.754513+0000","last_active":"2023-10-08T07:09:35.183354+0000","last_peered":"2023-10-08T07:09:35.183354+0000","last_clean":"2023-10-08T07:09:35.183354+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:35.183354+0000","last_undegraded":"2023-10-08T07:09:35.183354+0000","last_fullsized":"2023-10-08T07:09:35.183354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:06.336414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108669+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:09:35.108669+0000","last_peered":"2023-10-08T07:09:35.108669+0000","last_clean":"2023-10-08T07:09:35.108669+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:09:35.108669+0000","last_undegraded":"2023-10-08T07:09:35.108669+0000","last_fullsized":"2023-10-08T07:09:35.108669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:02.622175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109037+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:09:35.109037+0000","last_peered":"2023-10-08T07:09:35.109037+0000","last_clean":"2023-10-08T07:09:35.109037+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:09:35.109037+0000","last_undegraded":"2023-10-08T07:09:35.109037+0000","last_fullsized":"2023-10-08T07:09:35.109037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:26.968610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108261+0000","last_change":"2023-10-08T07:09:18.055607+0000","last_active":"2023-10-08T07:09:35.108261+0000","last_peered":"2023-10-08T07:09:35.108261+0000","last_clean":"2023-10-08T07:09:35.108261+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:09:35.108261+0000","last_undegraded":"2023-10-08T07:09:35.108261+0000","last_fullsized":"2023-10-08T07:09:35.108261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:09.952089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3025,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183742+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:35.183742+0000","last_peered":"2023-10-08T07:09:35.183742+0000","last_clean":"2023-10-08T07:09:35.183742+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:35.183742+0000","last_undegraded":"2023-10-08T07:09:35.183742+0000","last_fullsized":"2023-10-08T07:09:35.183742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:30.753981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109135+0000","last_change":"2023-10-08T07:05:32.319151+0000","last_active":"2023-10-08T07:09:35.109135+0000","last_peered":"2023-10-08T07:09:35.109135+0000","last_clean":"2023-10-08T07:09:35.109135+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:35.109135+0000","last_undegraded":"2023-10-08T07:09:35.109135+0000","last_fullsized":"2023-10-08T07:09:35.109135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5825,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108074+0000","last_change":"2023-10-08T07:09:21.036901+0000","last_active":"2023-10-08T07:09:35.108074+0000","last_peered":"2023-10-08T07:09:35.108074+0000","last_clean":"2023-10-08T07:09:35.108074+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:09:35.108074+0000","last_undegraded":"2023-10-08T07:09:35.108074+0000","last_fullsized":"2023-10-08T07:09:35.108074+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:44:57.453475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109892+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:35.109892+0000","last_peered":"2023-10-08T07:09:35.109892+0000","last_clean":"2023-10-08T07:09:35.109892+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:35.109892+0000","last_undegraded":"2023-10-08T07:09:35.109892+0000","last_fullsized":"2023-10-08T07:09:35.109892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:30.193888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2941,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108860+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:09:35.108860+0000","last_peered":"2023-10-08T07:09:35.108860+0000","last_clean":"2023-10-08T07:09:35.108860+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:09:35.108860+0000","last_undegraded":"2023-10-08T07:09:35.108860+0000","last_fullsized":"2023-10-08T07:09:35.108860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:31.198766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"67'7","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182792+0000","last_change":"2023-10-08T07:09:17.758979+0000","last_active":"2023-10-08T07:09:35.182792+0000","last_peered":"2023-10-08T07:09:35.182792+0000","last_clean":"2023-10-08T07:09:35.182792+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:09:35.182792+0000","last_undegraded":"2023-10-08T07:09:35.182792+0000","last_fullsized":"2023-10-08T07:09:35.182792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:06.386900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108369+0000","last_change":"2023-10-08T07:09:18.064856+0000","last_active":"2023-10-08T07:09:35.108369+0000","last_peered":"2023-10-08T07:09:35.108369+0000","last_clean":"2023-10-08T07:09:35.108369+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:35.108369+0000","last_undegraded":"2023-10-08T07:09:35.108369+0000","last_fullsized":"2023-10-08T07:09:35.108369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.230654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":189,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109611+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:35.109611+0000","last_peered":"2023-10-08T07:09:35.109611+0000","last_clean":"2023-10-08T07:09:35.109611+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:35.109611+0000","last_undegraded":"2023-10-08T07:09:35.109611+0000","last_fullsized":"2023-10-08T07:09:35.109611+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:37.437458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2948,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.110046+0000","last_change":"2023-10-08T07:09:21.038587+0000","last_active":"2023-10-08T07:09:35.110046+0000","last_peered":"2023-10-08T07:09:35.110046+0000","last_clean":"2023-10-08T07:09:35.110046+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:09:35.110046+0000","last_undegraded":"2023-10-08T07:09:35.110046+0000","last_fullsized":"2023-10-08T07:09:35.110046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:50.835623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109696+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:09:35.109696+0000","last_peered":"2023-10-08T07:09:35.109696+0000","last_clean":"2023-10-08T07:09:35.109696+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:09:35.109696+0000","last_undegraded":"2023-10-08T07:09:35.109696+0000","last_fullsized":"2023-10-08T07:09:35.109696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:30.747311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2943,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183227+0000","last_change":"2023-10-08T07:09:20.737135+0000","last_active":"2023-10-08T07:09:35.183227+0000","last_peered":"2023-10-08T07:09:35.183227+0000","last_clean":"2023-10-08T07:09:35.183227+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:09:35.183227+0000","last_undegraded":"2023-10-08T07:09:35.183227+0000","last_fullsized":"2023-10-08T07:09:35.183227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:52.474047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108478+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:09:35.108478+0000","last_peered":"2023-10-08T07:09:35.108478+0000","last_clean":"2023-10-08T07:09:35.108478+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:09:35.108478+0000","last_undegraded":"2023-10-08T07:09:35.108478+0000","last_fullsized":"2023-10-08T07:09:35.108478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.602666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8822,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183486+0000","last_change":"2023-10-08T07:09:20.737857+0000","last_active":"2023-10-08T07:09:35.183486+0000","last_peered":"2023-10-08T07:09:35.183486+0000","last_clean":"2023-10-08T07:09:35.183486+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:09:35.183486+0000","last_undegraded":"2023-10-08T07:09:35.183486+0000","last_fullsized":"2023-10-08T07:09:35.183486+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:56.740198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182158+0000","last_change":"2023-10-08T07:09:17.751068+0000","last_active":"2023-10-08T07:09:35.182158+0000","last_peered":"2023-10-08T07:09:35.182158+0000","last_clean":"2023-10-08T07:09:35.182158+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:09:35.182158+0000","last_undegraded":"2023-10-08T07:09:35.182158+0000","last_fullsized":"2023-10-08T07:09:35.182158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:11:15.155530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2924,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109141+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:09:35.109141+0000","last_peered":"2023-10-08T07:09:35.109141+0000","last_clean":"2023-10-08T07:09:35.109141+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:09:35.109141+0000","last_undegraded":"2023-10-08T07:09:35.109141+0000","last_fullsized":"2023-10-08T07:09:35.109141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:01.626624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'9","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109028+0000","last_change":"2023-10-08T07:09:18.054836+0000","last_active":"2023-10-08T07:09:35.109028+0000","last_peered":"2023-10-08T07:09:35.109028+0000","last_clean":"2023-10-08T07:09:35.109028+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:09:35.109028+0000","last_undegraded":"2023-10-08T07:09:35.109028+0000","last_fullsized":"2023-10-08T07:09:35.109028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:16.567958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":84,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109238+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:09:35.109238+0000","last_peered":"2023-10-08T07:09:35.109238+0000","last_clean":"2023-10-08T07:09:35.109238+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:09:35.109238+0000","last_undegraded":"2023-10-08T07:09:35.109238+0000","last_fullsized":"2023-10-08T07:09:35.109238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:12.675866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109969+0000","last_change":"2023-10-08T07:09:18.056757+0000","last_active":"2023-10-08T07:09:35.109969+0000","last_peered":"2023-10-08T07:09:35.109969+0000","last_clean":"2023-10-08T07:09:35.109969+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:09:35.109969+0000","last_undegraded":"2023-10-08T07:09:35.109969+0000","last_fullsized":"2023-10-08T07:09:35.109969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:47.575148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182122+0000","last_change":"2023-10-08T07:09:17.753129+0000","last_active":"2023-10-08T07:09:35.182122+0000","last_peered":"2023-10-08T07:09:35.182122+0000","last_clean":"2023-10-08T07:09:35.182122+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:09:35.182122+0000","last_undegraded":"2023-10-08T07:09:35.182122+0000","last_fullsized":"2023-10-08T07:09:35.182122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:53.133780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183472+0000","last_change":"2023-10-08T07:09:17.753124+0000","last_active":"2023-10-08T07:09:35.183472+0000","last_peered":"2023-10-08T07:09:35.183472+0000","last_clean":"2023-10-08T07:09:35.183472+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:09:35.183472+0000","last_undegraded":"2023-10-08T07:09:35.183472+0000","last_fullsized":"2023-10-08T07:09:35.183472+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.689880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3000,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182330+0000","last_change":"2023-10-08T07:09:20.737843+0000","last_active":"2023-10-08T07:09:35.182330+0000","last_peered":"2023-10-08T07:09:35.182330+0000","last_clean":"2023-10-08T07:09:35.182330+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:09:35.182330+0000","last_undegraded":"2023-10-08T07:09:35.182330+0000","last_fullsized":"2023-10-08T07:09:35.182330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:26:58.513035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":97,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109742+0000","last_change":"2023-10-08T07:09:18.057034+0000","last_active":"2023-10-08T07:09:35.109742+0000","last_peered":"2023-10-08T07:09:35.109742+0000","last_clean":"2023-10-08T07:09:35.109742+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:09:35.109742+0000","last_undegraded":"2023-10-08T07:09:35.109742+0000","last_fullsized":"2023-10-08T07:09:35.109742+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:42.006586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2947,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109223+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:09:35.109223+0000","last_peered":"2023-10-08T07:09:35.109223+0000","last_clean":"2023-10-08T07:09:35.109223+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:09:35.109223+0000","last_undegraded":"2023-10-08T07:09:35.109223+0000","last_fullsized":"2023-10-08T07:09:35.109223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:32.954566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109356+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:35.109356+0000","last_peered":"2023-10-08T07:09:35.109356+0000","last_clean":"2023-10-08T07:09:35.109356+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:35.109356+0000","last_undegraded":"2023-10-08T07:09:35.109356+0000","last_fullsized":"2023-10-08T07:09:35.109356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:02:20.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":2992,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108605+0000","last_change":"2023-10-08T07:05:33.327336+0000","last_active":"2023-10-08T07:09:35.108605+0000","last_peered":"2023-10-08T07:09:35.108605+0000","last_clean":"2023-10-08T07:09:35.108605+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:35.108605+0000","last_undegraded":"2023-10-08T07:09:35.108605+0000","last_fullsized":"2023-10-08T07:09:35.108605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:32.270873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'3","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108542+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:09:35.108542+0000","last_peered":"2023-10-08T07:09:35.108542+0000","last_clean":"2023-10-08T07:09:35.108542+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:09:35.108542+0000","last_undegraded":"2023-10-08T07:09:35.108542+0000","last_fullsized":"2023-10-08T07:09:35.108542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:43:32.792235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5930,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109441+0000","last_change":"2023-10-08T07:05:33.328939+0000","last_active":"2023-10-08T07:09:35.109441+0000","last_peered":"2023-10-08T07:09:35.109441+0000","last_clean":"2023-10-08T07:09:35.109441+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:35.109441+0000","last_undegraded":"2023-10-08T07:09:35.109441+0000","last_fullsized":"2023-10-08T07:09:35.109441+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:13.747756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109090+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:09:35.109090+0000","last_peered":"2023-10-08T07:09:35.109090+0000","last_clean":"2023-10-08T07:09:35.109090+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:09:35.109090+0000","last_undegraded":"2023-10-08T07:09:35.109090+0000","last_fullsized":"2023-10-08T07:09:35.109090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109993+0000","last_change":"2023-10-08T07:09:18.058346+0000","last_active":"2023-10-08T07:09:35.109993+0000","last_peered":"2023-10-08T07:09:35.109993+0000","last_clean":"2023-10-08T07:09:35.109993+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:09:35.109993+0000","last_undegraded":"2023-10-08T07:09:35.109993+0000","last_fullsized":"2023-10-08T07:09:35.109993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:51.958399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182484+0000","last_change":"2023-10-08T07:09:17.752745+0000","last_active":"2023-10-08T07:09:35.182484+0000","last_peered":"2023-10-08T07:09:35.182484+0000","last_clean":"2023-10-08T07:09:35.182484+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:09:35.182484+0000","last_undegraded":"2023-10-08T07:09:35.182484+0000","last_fullsized":"2023-10-08T07:09:35.182484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:08.404190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5935,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109869+0000","last_change":"2023-10-08T07:09:21.040694+0000","last_active":"2023-10-08T07:09:35.109869+0000","last_peered":"2023-10-08T07:09:35.109869+0000","last_clean":"2023-10-08T07:09:35.109869+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:09:35.109869+0000","last_undegraded":"2023-10-08T07:09:35.109869+0000","last_fullsized":"2023-10-08T07:09:35.109869+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:41.813249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182364+0000","last_change":"2023-10-08T07:09:17.754898+0000","last_active":"2023-10-08T07:09:35.182364+0000","last_peered":"2023-10-08T07:09:35.182364+0000","last_clean":"2023-10-08T07:09:35.182364+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:09:35.182364+0000","last_undegraded":"2023-10-08T07:09:35.182364+0000","last_fullsized":"2023-10-08T07:09:35.182364+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:19.045045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2950,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109068+0000","last_change":"2023-10-08T07:09:21.042008+0000","last_active":"2023-10-08T07:09:35.109068+0000","last_peered":"2023-10-08T07:09:35.109068+0000","last_clean":"2023-10-08T07:09:35.109068+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:09:35.109068+0000","last_undegraded":"2023-10-08T07:09:35.109068+0000","last_fullsized":"2023-10-08T07:09:35.109068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:32:00.347477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110127+0000","last_change":"2023-10-08T07:09:18.057444+0000","last_active":"2023-10-08T07:09:36.110127+0000","last_peered":"2023-10-08T07:09:36.110127+0000","last_clean":"2023-10-08T07:09:36.110127+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:09:36.110127+0000","last_undegraded":"2023-10-08T07:09:36.110127+0000","last_fullsized":"2023-10-08T07:09:36.110127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:06:13.088433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109847+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:09:35.109847+0000","last_peered":"2023-10-08T07:09:35.109847+0000","last_clean":"2023-10-08T07:09:35.109847+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:09:35.109847+0000","last_undegraded":"2023-10-08T07:09:35.109847+0000","last_fullsized":"2023-10-08T07:09:35.109847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:12.793754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5851,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182483+0000","last_change":"2023-10-08T07:09:20.735892+0000","last_active":"2023-10-08T07:09:35.182483+0000","last_peered":"2023-10-08T07:09:35.182483+0000","last_clean":"2023-10-08T07:09:35.182483+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:09:35.182483+0000","last_undegraded":"2023-10-08T07:09:35.182483+0000","last_fullsized":"2023-10-08T07:09:35.182483+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:02.889299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111212+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:09:36.111212+0000","last_peered":"2023-10-08T07:09:36.111212+0000","last_clean":"2023-10-08T07:09:36.111212+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:09:36.111212+0000","last_undegraded":"2023-10-08T07:09:36.111212+0000","last_fullsized":"2023-10-08T07:09:36.111212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:10:41.092505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109450+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:09:35.109450+0000","last_peered":"2023-10-08T07:09:35.109450+0000","last_clean":"2023-10-08T07:09:35.109450+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:09:35.109450+0000","last_undegraded":"2023-10-08T07:09:35.109450+0000","last_fullsized":"2023-10-08T07:09:35.109450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:23.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2958,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108810+0000","last_change":"2023-10-08T07:09:21.040185+0000","last_active":"2023-10-08T07:09:35.108810+0000","last_peered":"2023-10-08T07:09:35.108810+0000","last_clean":"2023-10-08T07:09:35.108810+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:09:35.108810+0000","last_undegraded":"2023-10-08T07:09:35.108810+0000","last_fullsized":"2023-10-08T07:09:35.108810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:50.835623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109492+0000","last_change":"2023-10-08T07:09:18.067783+0000","last_active":"2023-10-08T07:09:36.109492+0000","last_peered":"2023-10-08T07:09:36.109492+0000","last_clean":"2023-10-08T07:09:36.109492+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:09:36.109492+0000","last_undegraded":"2023-10-08T07:09:36.109492+0000","last_fullsized":"2023-10-08T07:09:36.109492+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:47:11.554943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182723+0000","last_change":"2023-10-08T07:09:17.752755+0000","last_active":"2023-10-08T07:09:35.182723+0000","last_peered":"2023-10-08T07:09:35.182723+0000","last_clean":"2023-10-08T07:09:35.182723+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:09:35.182723+0000","last_undegraded":"2023-10-08T07:09:35.182723+0000","last_fullsized":"2023-10-08T07:09:35.182723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:08:23.696397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8917,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109189+0000","last_change":"2023-10-08T07:09:21.042220+0000","last_active":"2023-10-08T07:09:35.109189+0000","last_peered":"2023-10-08T07:09:35.109189+0000","last_clean":"2023-10-08T07:09:35.109189+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:09:35.109189+0000","last_undegraded":"2023-10-08T07:09:35.109189+0000","last_fullsized":"2023-10-08T07:09:35.109189+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:33.242389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111323+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:09:36.111323+0000","last_peered":"2023-10-08T07:09:36.111323+0000","last_clean":"2023-10-08T07:09:36.111323+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:09:36.111323+0000","last_undegraded":"2023-10-08T07:09:36.111323+0000","last_fullsized":"2023-10-08T07:09:36.111323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:55.279686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":299,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108760+0000","last_change":"2023-10-08T07:09:18.052234+0000","last_active":"2023-10-08T07:09:35.108760+0000","last_peered":"2023-10-08T07:09:35.108760+0000","last_clean":"2023-10-08T07:09:35.108760+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:09:35.108760+0000","last_undegraded":"2023-10-08T07:09:35.108760+0000","last_fullsized":"2023-10-08T07:09:35.108760+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:02:56.508361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108336+0000","last_change":"2023-10-08T07:09:18.049984+0000","last_active":"2023-10-08T07:09:35.108336+0000","last_peered":"2023-10-08T07:09:35.108336+0000","last_clean":"2023-10-08T07:09:35.108336+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:09:35.108336+0000","last_undegraded":"2023-10-08T07:09:35.108336+0000","last_fullsized":"2023-10-08T07:09:35.108336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:59:20.880943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5902,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109931+0000","last_change":"2023-10-08T07:09:21.040684+0000","last_active":"2023-10-08T07:09:35.109931+0000","last_peered":"2023-10-08T07:09:35.109931+0000","last_clean":"2023-10-08T07:09:35.109931+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:09:35.109931+0000","last_undegraded":"2023-10-08T07:09:35.109931+0000","last_fullsized":"2023-10-08T07:09:35.109931+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:14.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108874+0000","last_change":"2023-10-08T07:09:18.051593+0000","last_active":"2023-10-08T07:09:35.108874+0000","last_peered":"2023-10-08T07:09:35.108874+0000","last_clean":"2023-10-08T07:09:35.108874+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:09:35.108874+0000","last_undegraded":"2023-10-08T07:09:35.108874+0000","last_fullsized":"2023-10-08T07:09:35.108874+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:34.735278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108212+0000","last_change":"2023-10-08T07:09:25.038493+0000","last_active":"2023-10-08T07:09:35.108212+0000","last_peered":"2023-10-08T07:09:35.108212+0000","last_clean":"2023-10-08T07:09:35.108212+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:09:35.108212+0000","last_undegraded":"2023-10-08T07:09:35.108212+0000","last_fullsized":"2023-10-08T07:09:35.108212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:44.616324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183181+0000","last_change":"2023-10-08T07:09:17.755079+0000","last_active":"2023-10-08T07:09:35.183181+0000","last_peered":"2023-10-08T07:09:35.183181+0000","last_clean":"2023-10-08T07:09:35.183181+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:09:35.183181+0000","last_undegraded":"2023-10-08T07:09:35.183181+0000","last_fullsized":"2023-10-08T07:09:35.183181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:01:12.238239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183205+0000","last_change":"2023-10-08T07:09:17.754844+0000","last_active":"2023-10-08T07:09:35.183205+0000","last_peered":"2023-10-08T07:09:35.183205+0000","last_clean":"2023-10-08T07:09:35.183205+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:35.183205+0000","last_undegraded":"2023-10-08T07:09:35.183205+0000","last_fullsized":"2023-10-08T07:09:35.183205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:12.129220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108682+0000","last_change":"2023-10-08T07:09:18.056208+0000","last_active":"2023-10-08T07:09:35.108682+0000","last_peered":"2023-10-08T07:09:35.108682+0000","last_clean":"2023-10-08T07:09:35.108682+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:09:35.108682+0000","last_undegraded":"2023-10-08T07:09:35.108682+0000","last_fullsized":"2023-10-08T07:09:35.108682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:55.549444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182645+0000","last_change":"2023-10-08T07:09:17.753144+0000","last_active":"2023-10-08T07:09:35.182645+0000","last_peered":"2023-10-08T07:09:35.182645+0000","last_clean":"2023-10-08T07:09:35.182645+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:09:35.182645+0000","last_undegraded":"2023-10-08T07:09:35.182645+0000","last_fullsized":"2023-10-08T07:09:35.182645+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:25.968547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'3","reported_seq":100,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109045+0000","last_change":"2023-10-08T07:09:18.059238+0000","last_active":"2023-10-08T07:09:35.109045+0000","last_peered":"2023-10-08T07:09:35.109045+0000","last_clean":"2023-10-08T07:09:35.109045+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:09:35.109045+0000","last_undegraded":"2023-10-08T07:09:35.109045+0000","last_fullsized":"2023-10-08T07:09:35.109045+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:32.546214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109103+0000","last_change":"2023-10-08T07:09:18.056706+0000","last_active":"2023-10-08T07:09:35.109103+0000","last_peered":"2023-10-08T07:09:35.109103+0000","last_clean":"2023-10-08T07:09:35.109103+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:09:35.109103+0000","last_undegraded":"2023-10-08T07:09:35.109103+0000","last_fullsized":"2023-10-08T07:09:35.109103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:17.258824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2988,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108033+0000","last_change":"2023-10-08T07:05:33.327241+0000","last_active":"2023-10-08T07:09:35.108033+0000","last_peered":"2023-10-08T07:09:35.108033+0000","last_clean":"2023-10-08T07:09:35.108033+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:35.108033+0000","last_undegraded":"2023-10-08T07:09:35.108033+0000","last_fullsized":"2023-10-08T07:09:35.108033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:07:10.253906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.110033+0000","last_change":"2023-10-08T07:09:18.054661+0000","last_active":"2023-10-08T07:09:35.110033+0000","last_peered":"2023-10-08T07:09:35.110033+0000","last_clean":"2023-10-08T07:09:35.110033+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:09:35.110033+0000","last_undegraded":"2023-10-08T07:09:35.110033+0000","last_fullsized":"2023-10-08T07:09:35.110033+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:09:10.492782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"69'9","reported_seq":94,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108910+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:09:35.108910+0000","last_peered":"2023-10-08T07:09:35.108910+0000","last_clean":"2023-10-08T07:09:35.108910+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:09:35.108910+0000","last_undegraded":"2023-10-08T07:09:35.108910+0000","last_fullsized":"2023-10-08T07:09:35.108910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:13.213525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2962,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182541+0000","last_change":"2023-10-08T07:09:20.735652+0000","last_active":"2023-10-08T07:09:35.182541+0000","last_peered":"2023-10-08T07:09:35.182541+0000","last_clean":"2023-10-08T07:09:35.182541+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:09:35.182541+0000","last_undegraded":"2023-10-08T07:09:35.182541+0000","last_fullsized":"2023-10-08T07:09:35.182541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:15.857716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182410+0000","last_change":"2023-10-08T07:09:22.762216+0000","last_active":"2023-10-08T07:09:35.182410+0000","last_peered":"2023-10-08T07:09:35.182410+0000","last_clean":"2023-10-08T07:09:35.182410+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:35.182410+0000","last_undegraded":"2023-10-08T07:09:35.182410+0000","last_fullsized":"2023-10-08T07:09:35.182410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:49.404736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.183153+0000","last_change":"2023-10-08T07:09:24.732784+0000","last_active":"2023-10-08T07:09:35.183153+0000","last_peered":"2023-10-08T07:09:35.183153+0000","last_clean":"2023-10-08T07:09:35.183153+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:09:35.183153+0000","last_undegraded":"2023-10-08T07:09:35.183153+0000","last_fullsized":"2023-10-08T07:09:35.183153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:06:25.502260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109487+0000","last_change":"2023-10-08T07:09:23.066235+0000","last_active":"2023-10-08T07:09:35.109487+0000","last_peered":"2023-10-08T07:09:35.109487+0000","last_clean":"2023-10-08T07:09:35.109487+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:09:35.109487+0000","last_undegraded":"2023-10-08T07:09:35.109487+0000","last_fullsized":"2023-10-08T07:09:35.109487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:42.060351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5890,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109543+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:09:35.109543+0000","last_peered":"2023-10-08T07:09:35.109543+0000","last_clean":"2023-10-08T07:09:35.109543+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:09:35.109543+0000","last_undegraded":"2023-10-08T07:09:35.109543+0000","last_fullsized":"2023-10-08T07:09:35.109543+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:30.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182938+0000","last_change":"2023-10-08T07:09:17.753543+0000","last_active":"2023-10-08T07:09:35.182938+0000","last_peered":"2023-10-08T07:09:35.182938+0000","last_clean":"2023-10-08T07:09:35.182938+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:09:35.182938+0000","last_undegraded":"2023-10-08T07:09:35.182938+0000","last_fullsized":"2023-10-08T07:09:35.182938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:51.956560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3009,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109233+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:35.109233+0000","last_peered":"2023-10-08T07:09:35.109233+0000","last_clean":"2023-10-08T07:09:35.109233+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:35.109233+0000","last_undegraded":"2023-10-08T07:09:35.109233+0000","last_fullsized":"2023-10-08T07:09:35.109233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:50:54.312881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109221+0000","last_change":"2023-10-08T07:09:18.057710+0000","last_active":"2023-10-08T07:09:35.109221+0000","last_peered":"2023-10-08T07:09:35.109221+0000","last_clean":"2023-10-08T07:09:35.109221+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:09:35.109221+0000","last_undegraded":"2023-10-08T07:09:35.109221+0000","last_fullsized":"2023-10-08T07:09:35.109221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:49.694705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5871,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182257+0000","last_change":"2023-10-08T07:09:20.734404+0000","last_active":"2023-10-08T07:09:35.182257+0000","last_peered":"2023-10-08T07:09:35.182257+0000","last_clean":"2023-10-08T07:09:35.182257+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:09:35.182257+0000","last_undegraded":"2023-10-08T07:09:35.182257+0000","last_fullsized":"2023-10-08T07:09:35.182257+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:04:28.453406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":89,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109149+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:09:35.109149+0000","last_peered":"2023-10-08T07:09:35.109149+0000","last_clean":"2023-10-08T07:09:35.109149+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:09:35.109149+0000","last_undegraded":"2023-10-08T07:09:35.109149+0000","last_fullsized":"2023-10-08T07:09:35.109149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:51:00.548190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.109047+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:09:35.109047+0000","last_peered":"2023-10-08T07:09:35.109047+0000","last_clean":"2023-10-08T07:09:35.109047+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:09:35.109047+0000","last_undegraded":"2023-10-08T07:09:35.109047+0000","last_fullsized":"2023-10-08T07:09:35.109047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:20:13.094254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8807,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108915+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:09:35.108915+0000","last_peered":"2023-10-08T07:09:35.108915+0000","last_clean":"2023-10-08T07:09:35.108915+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:09:35.108915+0000","last_undegraded":"2023-10-08T07:09:35.108915+0000","last_fullsized":"2023-10-08T07:09:35.108915+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:59.249544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3001,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108201+0000","last_change":"2023-10-08T07:09:21.036530+0000","last_active":"2023-10-08T07:09:35.108201+0000","last_peered":"2023-10-08T07:09:35.108201+0000","last_clean":"2023-10-08T07:09:35.108201+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:09:35.108201+0000","last_undegraded":"2023-10-08T07:09:35.108201+0000","last_fullsized":"2023-10-08T07:09:35.108201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:41:49.285073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182677+0000","last_change":"2023-10-08T07:09:17.754585+0000","last_active":"2023-10-08T07:09:35.182677+0000","last_peered":"2023-10-08T07:09:35.182677+0000","last_clean":"2023-10-08T07:09:35.182677+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:09:35.182677+0000","last_undegraded":"2023-10-08T07:09:35.182677+0000","last_fullsized":"2023-10-08T07:09:35.182677+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:44.969079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":98,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.108686+0000","last_change":"2023-10-08T07:09:18.056756+0000","last_active":"2023-10-08T07:09:35.108686+0000","last_peered":"2023-10-08T07:09:35.108686+0000","last_clean":"2023-10-08T07:09:35.108686+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:35.108686+0000","last_undegraded":"2023-10-08T07:09:35.108686+0000","last_fullsized":"2023-10-08T07:09:35.108686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:21:49.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2974,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T07:09:35.182686+0000","last_change":"2023-10-08T07:09:20.735423+0000","last_active":"2023-10-08T07:09:35.182686+0000","last_peered":"2023-10-08T07:09:35.182686+0000","last_clean":"2023-10-08T07:09:35.182686+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:09:35.182686+0000","last_undegraded":"2023-10-08T07:09:35.182686+0000","last_fullsized":"2023-10-08T07:09:35.182686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:52.216576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595772,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776068,"statfs":{"total":96636764160,"available":96026693632,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59499999999999997,"15min":0.49199999999999999},"min":{"1min":0.35499999999999998,"5min":0.188,"15min":0.188},"max":{"1min":0.76200000000000001,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.60499999999999998,"15min":0.505},"min":{"1min":0.372,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.66300000000000003,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.31}]},{"osd":1,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.55800000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483920,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887920,"statfs":{"total":96636764160,"available":96141230080,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.54300000000000004}]},{"osd":2,"last update":"Sun Oct 8 07:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.1910000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.36399999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.90700000000000003,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":74,"seq":317827579911,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65340,"kb_used_data":1712,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306500,"statfs":{"total":96636764160,"available":96569856000,"internally_reserved":0,"allocated":1753088,"data_stored":1220245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:09:45.909 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.909 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.909 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.909 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.909 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.910 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.910 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.910 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.910 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.910 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.910 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.910 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.910 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.911 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.911 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.911 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.911 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.911 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.911 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.911 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.911 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.912 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.912 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.912 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.912 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.912 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.912 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.912 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.912 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.913 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.913 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.913 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.913 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.913 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.913 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.913 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.913 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.913 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.914 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.914 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.914 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.914 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.914 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.914 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.914 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.915 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.915 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.915 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.915 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.915 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.915 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.915 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.915 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.915 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.916 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.916 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.916 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.916 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.916 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.916 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.916 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.916 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.917 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.917 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.917 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.917 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.917 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.917 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.917 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.917 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.917 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.918 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.918 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.918 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.918 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.918 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T07:05:21.265947+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=21, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.918 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.918 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.918 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.919 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.919 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.919 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.919 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.919 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.919 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.919 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.919 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.920 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.920 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.920 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.920 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.920 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.920 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.920 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.920 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.921 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.921 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.921 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.921 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.921 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.921 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.921 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.921 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.921 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.922 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:09:45.922 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:10:05.922 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:10:06.295 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:10:06.297 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:10:06.308 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2023-10-08T07:10:04.576218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149186,"ondisk_log_size":149186,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145004,"kb_used_data":4308,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970516,"statfs":{"total":289910292480,"available":288737808384,"internally_reserved":0,"allocated":4411392,"data_stored":2817910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003366"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":3000,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742299+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:36.742299+0000","last_peered":"2023-10-08T07:09:36.742299+0000","last_clean":"2023-10-08T07:09:36.742299+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:36.742299+0000","last_undegraded":"2023-10-08T07:09:36.742299+0000","last_fullsized":"2023-10-08T07:09:36.742299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2909,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:46.756297+0000","last_change":"2023-10-08T07:09:46.756403+0000","last_active":"2023-10-08T07:09:46.756297+0000","last_peered":"2023-10-08T07:09:46.756297+0000","last_clean":"2023-10-08T07:09:46.756297+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:46.756297+0000","last_undegraded":"2023-10-08T07:09:46.756297+0000","last_fullsized":"2023-10-08T07:09:46.756297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2832","last_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_deep_scrub":"67'2832","last_deep_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_clean_scrub_stamp":"2023-10-08T07:09:46.756167+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:46.978745+0000","scrub_duration":0.0030689100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498730+0000","last_change":"2023-10-08T07:09:18.056834+0000","last_active":"2023-10-08T07:09:44.498730+0000","last_peered":"2023-10-08T07:09:44.498730+0000","last_clean":"2023-10-08T07:09:44.498730+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:09:44.498730+0000","last_undegraded":"2023-10-08T07:09:44.498730+0000","last_fullsized":"2023-10-08T07:09:44.498730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111384+0000","last_change":"2023-10-08T07:05:33.325136+0000","last_active":"2023-10-08T07:09:36.111384+0000","last_peered":"2023-10-08T07:09:36.111384+0000","last_clean":"2023-10-08T07:09:36.111384+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:09:36.111384+0000","last_undegraded":"2023-10-08T07:09:36.111384+0000","last_fullsized":"2023-10-08T07:09:36.111384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5890,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742050+0000","last_change":"2023-10-08T07:09:20.736694+0000","last_active":"2023-10-08T07:09:36.742050+0000","last_peered":"2023-10-08T07:09:36.742050+0000","last_clean":"2023-10-08T07:09:36.742050+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:09:36.742050+0000","last_undegraded":"2023-10-08T07:09:36.742050+0000","last_fullsized":"2023-10-08T07:09:36.742050+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8572,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110737+0000","last_change":"2023-10-08T07:05:33.324501+0000","last_active":"2023-10-08T07:09:36.110737+0000","last_peered":"2023-10-08T07:09:36.110737+0000","last_clean":"2023-10-08T07:09:36.110737+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:09:36.110737+0000","last_undegraded":"2023-10-08T07:09:36.110737+0000","last_fullsized":"2023-10-08T07:09:36.110737+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.809133+0000","last_change":"2023-10-08T07:09:50.809212+0000","last_active":"2023-10-08T07:09:50.809133+0000","last_peered":"2023-10-08T07:09:50.809133+0000","last_clean":"2023-10-08T07:09:50.809133+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:50.809133+0000","last_undegraded":"2023-10-08T07:09:50.809133+0000","last_fullsized":"2023-10-08T07:09:50.809133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.808986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:57.252774+0000","scrub_duration":0.0027253220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3040,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110268+0000","last_change":"2023-10-08T07:09:28.078167+0000","last_active":"2023-10-08T07:09:36.110268+0000","last_peered":"2023-10-08T07:09:36.110268+0000","last_clean":"2023-10-08T07:09:36.110268+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:09:36.110268+0000","last_undegraded":"2023-10-08T07:09:36.110268+0000","last_fullsized":"2023-10-08T07:09:36.110268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2892,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:48.261093+0000","last_change":"2023-10-08T07:09:48.261144+0000","last_active":"2023-10-08T07:09:48.261093+0000","last_peered":"2023-10-08T07:09:48.261093+0000","last_clean":"2023-10-08T07:09:48.261093+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:48.261093+0000","last_undegraded":"2023-10-08T07:09:48.261093+0000","last_fullsized":"2023-10-08T07:09:48.261093+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2779","last_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_deep_scrub":"67'2779","last_deep_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_clean_scrub_stamp":"2023-10-08T07:09:48.260984+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:35.661462+0000","scrub_duration":0.0021476020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2957,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742109+0000","last_change":"2023-10-08T07:09:20.737658+0000","last_active":"2023-10-08T07:09:36.742109+0000","last_peered":"2023-10-08T07:09:36.742109+0000","last_clean":"2023-10-08T07:09:36.742109+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:09:36.742109+0000","last_undegraded":"2023-10-08T07:09:36.742109+0000","last_fullsized":"2023-10-08T07:09:36.742109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110966+0000","last_change":"2023-10-08T07:09:23.063882+0000","last_active":"2023-10-08T07:09:36.110966+0000","last_peered":"2023-10-08T07:09:36.110966+0000","last_clean":"2023-10-08T07:09:36.110966+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:09:36.110966+0000","last_undegraded":"2023-10-08T07:09:36.110966+0000","last_fullsized":"2023-10-08T07:09:36.110966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2970,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.799105+0000","last_change":"2023-10-08T07:09:51.799195+0000","last_active":"2023-10-08T07:09:51.799105+0000","last_peered":"2023-10-08T07:09:51.799105+0000","last_clean":"2023-10-08T07:09:51.799105+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:51.799105+0000","last_undegraded":"2023-10-08T07:09:51.799105+0000","last_fullsized":"2023-10-08T07:09:51.799105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2893","last_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_deep_scrub":"67'2893","last_deep_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.798991+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:39.037371+0000","scrub_duration":0.0024056889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.743108+0000","last_change":"2023-10-08T07:09:17.754638+0000","last_active":"2023-10-08T07:09:36.743108+0000","last_peered":"2023-10-08T07:09:36.743108+0000","last_clean":"2023-10-08T07:09:36.743108+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:09:36.743108+0000","last_undegraded":"2023-10-08T07:09:36.743108+0000","last_fullsized":"2023-10-08T07:09:36.743108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2978,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111214+0000","last_change":"2023-10-08T07:09:21.040638+0000","last_active":"2023-10-08T07:09:36.111214+0000","last_peered":"2023-10-08T07:09:36.111214+0000","last_clean":"2023-10-08T07:09:36.111214+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:09:36.111214+0000","last_undegraded":"2023-10-08T07:09:36.111214+0000","last_fullsized":"2023-10-08T07:09:36.111214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5867,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110557+0000","last_change":"2023-10-08T07:09:26.042339+0000","last_active":"2023-10-08T07:09:36.110557+0000","last_peered":"2023-10-08T07:09:36.110557+0000","last_clean":"2023-10-08T07:09:36.110557+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:09:36.110557+0000","last_undegraded":"2023-10-08T07:09:36.110557+0000","last_fullsized":"2023-10-08T07:09:36.110557+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2983,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110329+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:09:36.110329+0000","last_peered":"2023-10-08T07:09:36.110329+0000","last_clean":"2023-10-08T07:09:36.110329+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:09:36.110329+0000","last_undegraded":"2023-10-08T07:09:36.110329+0000","last_fullsized":"2023-10-08T07:09:36.110329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2982,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110295+0000","last_change":"2023-10-08T07:09:21.041706+0000","last_active":"2023-10-08T07:09:36.110295+0000","last_peered":"2023-10-08T07:09:36.110295+0000","last_clean":"2023-10-08T07:09:36.110295+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:09:36.110295+0000","last_undegraded":"2023-10-08T07:09:36.110295+0000","last_fullsized":"2023-10-08T07:09:36.110295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742992+0000","last_change":"2023-10-08T07:09:17.754747+0000","last_active":"2023-10-08T07:09:36.742992+0000","last_peered":"2023-10-08T07:09:36.742992+0000","last_clean":"2023-10-08T07:09:36.742992+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:09:36.742992+0000","last_undegraded":"2023-10-08T07:09:36.742992+0000","last_fullsized":"2023-10-08T07:09:36.742992+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2963,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110014+0000","last_change":"2023-10-08T07:09:21.039966+0000","last_active":"2023-10-08T07:09:36.110014+0000","last_peered":"2023-10-08T07:09:36.110014+0000","last_clean":"2023-10-08T07:09:36.110014+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:09:36.110014+0000","last_undegraded":"2023-10-08T07:09:36.110014+0000","last_fullsized":"2023-10-08T07:09:36.110014+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2974,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111296+0000","last_change":"2023-10-08T07:05:33.326227+0000","last_active":"2023-10-08T07:09:36.111296+0000","last_peered":"2023-10-08T07:09:36.111296+0000","last_clean":"2023-10-08T07:09:36.111296+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:09:36.111296+0000","last_undegraded":"2023-10-08T07:09:36.111296+0000","last_fullsized":"2023-10-08T07:09:36.111296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5893,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111024+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:09:36.111024+0000","last_peered":"2023-10-08T07:09:36.111024+0000","last_clean":"2023-10-08T07:09:36.111024+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:09:36.111024+0000","last_undegraded":"2023-10-08T07:09:36.111024+0000","last_fullsized":"2023-10-08T07:09:36.111024+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2877,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742046+0000","last_change":"2023-10-08T07:09:20.735818+0000","last_active":"2023-10-08T07:09:36.742046+0000","last_peered":"2023-10-08T07:09:36.742046+0000","last_clean":"2023-10-08T07:09:36.742046+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:09:36.742046+0000","last_undegraded":"2023-10-08T07:09:36.742046+0000","last_fullsized":"2023-10-08T07:09:36.742046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2990,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:49.238841+0000","last_change":"2023-10-08T07:09:49.238913+0000","last_active":"2023-10-08T07:09:49.238841+0000","last_peered":"2023-10-08T07:09:49.238841+0000","last_clean":"2023-10-08T07:09:49.238841+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:49.238841+0000","last_undegraded":"2023-10-08T07:09:49.238841+0000","last_fullsized":"2023-10-08T07:09:49.238841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2897","last_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_deep_scrub":"67'2897","last_deep_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_clean_scrub_stamp":"2023-10-08T07:09:49.238678+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:45:50.648559+0000","scrub_duration":0.0033918249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5846,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.780218+0000","last_change":"2023-10-08T07:09:58.780269+0000","last_active":"2023-10-08T07:09:58.780218+0000","last_peered":"2023-10-08T07:09:58.780218+0000","last_clean":"2023-10-08T07:09:58.780218+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:58.780218+0000","last_undegraded":"2023-10-08T07:09:58.780218+0000","last_fullsized":"2023-10-08T07:09:58.780218+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5763","last_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_deep_scrub":"67'5763","last_deep_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.780116+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:40.304910+0000","scrub_duration":0.0028329620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2957,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742330+0000","last_change":"2023-10-08T07:09:20.735845+0000","last_active":"2023-10-08T07:09:36.742330+0000","last_peered":"2023-10-08T07:09:36.742330+0000","last_clean":"2023-10-08T07:09:36.742330+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:09:36.742330+0000","last_undegraded":"2023-10-08T07:09:36.742330+0000","last_fullsized":"2023-10-08T07:09:36.742330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2976,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534166+0000","last_change":"2023-10-08T07:05:33.324757+0000","last_active":"2023-10-08T07:09:45.534166+0000","last_peered":"2023-10-08T07:09:45.534166+0000","last_clean":"2023-10-08T07:09:45.534166+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:09:45.534166+0000","last_undegraded":"2023-10-08T07:09:45.534166+0000","last_fullsized":"2023-10-08T07:09:45.534166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.846882+0000","last_change":"2023-10-08T07:09:56.846960+0000","last_active":"2023-10-08T07:09:56.846882+0000","last_peered":"2023-10-08T07:09:56.846882+0000","last_clean":"2023-10-08T07:09:56.846882+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:56.846882+0000","last_undegraded":"2023-10-08T07:09:56.846882+0000","last_fullsized":"2023-10-08T07:09:56.846882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.846797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:30.858022+0000","scrub_duration":0.0019930149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742643+0000","last_change":"2023-10-08T07:09:17.751957+0000","last_active":"2023-10-08T07:09:36.742643+0000","last_peered":"2023-10-08T07:09:36.742643+0000","last_clean":"2023-10-08T07:09:36.742643+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:09:36.742643+0000","last_undegraded":"2023-10-08T07:09:36.742643+0000","last_fullsized":"2023-10-08T07:09:36.742643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.785724+0000","last_change":"2023-10-08T07:09:56.785826+0000","last_active":"2023-10-08T07:09:56.785724+0000","last_peered":"2023-10-08T07:09:56.785724+0000","last_clean":"2023-10-08T07:09:56.785724+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:56.785724+0000","last_undegraded":"2023-10-08T07:09:56.785724+0000","last_fullsized":"2023-10-08T07:09:56.785724+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.785595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:34.531648+0000","scrub_duration":0.002195621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":86,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109627+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:09:36.109627+0000","last_peered":"2023-10-08T07:09:36.109627+0000","last_clean":"2023-10-08T07:09:36.109627+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:09:36.109627+0000","last_undegraded":"2023-10-08T07:09:36.109627+0000","last_fullsized":"2023-10-08T07:09:36.109627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110297+0000","last_change":"2023-10-08T07:05:33.320871+0000","last_active":"2023-10-08T07:09:36.110297+0000","last_peered":"2023-10-08T07:09:36.110297+0000","last_clean":"2023-10-08T07:09:36.110297+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:09:36.110297+0000","last_undegraded":"2023-10-08T07:09:36.110297+0000","last_fullsized":"2023-10-08T07:09:36.110297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":97,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109606+0000","last_change":"2023-10-08T07:09:18.055607+0000","last_active":"2023-10-08T07:09:36.109606+0000","last_peered":"2023-10-08T07:09:36.109606+0000","last_clean":"2023-10-08T07:09:36.109606+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:09:36.109606+0000","last_undegraded":"2023-10-08T07:09:36.109606+0000","last_fullsized":"2023-10-08T07:09:36.109606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3026,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742264+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:36.742264+0000","last_peered":"2023-10-08T07:09:36.742264+0000","last_clean":"2023-10-08T07:09:36.742264+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:36.742264+0000","last_undegraded":"2023-10-08T07:09:36.742264+0000","last_fullsized":"2023-10-08T07:09:36.742264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.183743+0000","last_change":"2023-10-08T07:09:56.183794+0000","last_active":"2023-10-08T07:09:56.183743+0000","last_peered":"2023-10-08T07:09:56.183743+0000","last_clean":"2023-10-08T07:09:56.183743+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:56.183743+0000","last_undegraded":"2023-10-08T07:09:56.183743+0000","last_fullsized":"2023-10-08T07:09:56.183743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_deep_scrub":"66'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.183634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:57:57.773772+0000","scrub_duration":0.0020570499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5826,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109372+0000","last_change":"2023-10-08T07:09:21.036901+0000","last_active":"2023-10-08T07:09:36.109372+0000","last_peered":"2023-10-08T07:09:36.109372+0000","last_clean":"2023-10-08T07:09:36.109372+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:09:36.109372+0000","last_undegraded":"2023-10-08T07:09:36.109372+0000","last_fullsized":"2023-10-08T07:09:36.109372+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":86,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111314+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:36.111314+0000","last_peered":"2023-10-08T07:09:36.111314+0000","last_clean":"2023-10-08T07:09:36.111314+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:36.111314+0000","last_undegraded":"2023-10-08T07:09:36.111314+0000","last_fullsized":"2023-10-08T07:09:36.111314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2942,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109687+0000","last_change":"2023-10-08T07:05:33.320870+0000","last_active":"2023-10-08T07:09:36.109687+0000","last_peered":"2023-10-08T07:09:36.109687+0000","last_clean":"2023-10-08T07:09:36.109687+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:09:36.109687+0000","last_undegraded":"2023-10-08T07:09:36.109687+0000","last_fullsized":"2023-10-08T07:09:36.109687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"67'7","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742884+0000","last_change":"2023-10-08T07:09:17.758979+0000","last_active":"2023-10-08T07:09:36.742884+0000","last_peered":"2023-10-08T07:09:36.742884+0000","last_clean":"2023-10-08T07:09:36.742884+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:09:36.742884+0000","last_undegraded":"2023-10-08T07:09:36.742884+0000","last_fullsized":"2023-10-08T07:09:36.742884+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":114,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.204936+0000","last_change":"2023-10-08T07:09:50.205001+0000","last_active":"2023-10-08T07:09:50.204936+0000","last_peered":"2023-10-08T07:09:50.204936+0000","last_clean":"2023-10-08T07:09:50.204936+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:50.204936+0000","last_undegraded":"2023-10-08T07:09:50.204936+0000","last_fullsized":"2023-10-08T07:09:50.204936+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'3","last_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_deep_scrub":"66'3","last_deep_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.204815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:31.664355+0000","scrub_duration":0.0019594320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":190,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111265+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:36.111265+0000","last_peered":"2023-10-08T07:09:36.111265+0000","last_clean":"2023-10-08T07:09:36.111265+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:36.111265+0000","last_undegraded":"2023-10-08T07:09:36.111265+0000","last_fullsized":"2023-10-08T07:09:36.111265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2949,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111451+0000","last_change":"2023-10-08T07:09:21.038587+0000","last_active":"2023-10-08T07:09:36.111451+0000","last_peered":"2023-10-08T07:09:36.111451+0000","last_clean":"2023-10-08T07:09:36.111451+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:09:36.111451+0000","last_undegraded":"2023-10-08T07:09:36.111451+0000","last_fullsized":"2023-10-08T07:09:36.111451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":88,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111221+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:09:36.111221+0000","last_peered":"2023-10-08T07:09:36.111221+0000","last_clean":"2023-10-08T07:09:36.111221+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:09:36.111221+0000","last_undegraded":"2023-10-08T07:09:36.111221+0000","last_fullsized":"2023-10-08T07:09:36.111221+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2944,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742087+0000","last_change":"2023-10-08T07:09:20.737135+0000","last_active":"2023-10-08T07:09:36.742087+0000","last_peered":"2023-10-08T07:09:36.742087+0000","last_clean":"2023-10-08T07:09:36.742087+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:09:36.742087+0000","last_undegraded":"2023-10-08T07:09:36.742087+0000","last_fullsized":"2023-10-08T07:09:36.742087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":86,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109779+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:09:36.109779+0000","last_peered":"2023-10-08T07:09:36.109779+0000","last_clean":"2023-10-08T07:09:36.109779+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:09:36.109779+0000","last_undegraded":"2023-10-08T07:09:36.109779+0000","last_fullsized":"2023-10-08T07:09:36.109779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8823,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742117+0000","last_change":"2023-10-08T07:09:20.737857+0000","last_active":"2023-10-08T07:09:36.742117+0000","last_peered":"2023-10-08T07:09:36.742117+0000","last_clean":"2023-10-08T07:09:36.742117+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:09:36.742117+0000","last_undegraded":"2023-10-08T07:09:36.742117+0000","last_fullsized":"2023-10-08T07:09:36.742117+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742525+0000","last_change":"2023-10-08T07:09:17.751068+0000","last_active":"2023-10-08T07:09:36.742525+0000","last_peered":"2023-10-08T07:09:36.742525+0000","last_clean":"2023-10-08T07:09:36.742525+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:09:36.742525+0000","last_undegraded":"2023-10-08T07:09:36.742525+0000","last_fullsized":"2023-10-08T07:09:36.742525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2925,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110479+0000","last_change":"2023-10-08T07:05:33.324411+0000","last_active":"2023-10-08T07:09:36.110479+0000","last_peered":"2023-10-08T07:09:36.110479+0000","last_clean":"2023-10-08T07:09:36.110479+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:09:36.110479+0000","last_undegraded":"2023-10-08T07:09:36.110479+0000","last_fullsized":"2023-10-08T07:09:36.110479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'9","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110580+0000","last_change":"2023-10-08T07:09:18.054836+0000","last_active":"2023-10-08T07:09:36.110580+0000","last_peered":"2023-10-08T07:09:36.110580+0000","last_clean":"2023-10-08T07:09:36.110580+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:09:36.110580+0000","last_undegraded":"2023-10-08T07:09:36.110580+0000","last_fullsized":"2023-10-08T07:09:36.110580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":85,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110552+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:09:36.110552+0000","last_peered":"2023-10-08T07:09:36.110552+0000","last_clean":"2023-10-08T07:09:36.110552+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:09:36.110552+0000","last_undegraded":"2023-10-08T07:09:36.110552+0000","last_fullsized":"2023-10-08T07:09:36.110552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111363+0000","last_change":"2023-10-08T07:09:18.056757+0000","last_active":"2023-10-08T07:09:36.111363+0000","last_peered":"2023-10-08T07:09:36.111363+0000","last_clean":"2023-10-08T07:09:36.111363+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:09:36.111363+0000","last_undegraded":"2023-10-08T07:09:36.111363+0000","last_fullsized":"2023-10-08T07:09:36.111363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742470+0000","last_change":"2023-10-08T07:09:17.753129+0000","last_active":"2023-10-08T07:09:36.742470+0000","last_peered":"2023-10-08T07:09:36.742470+0000","last_clean":"2023-10-08T07:09:36.742470+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:09:36.742470+0000","last_undegraded":"2023-10-08T07:09:36.742470+0000","last_fullsized":"2023-10-08T07:09:36.742470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.743391+0000","last_change":"2023-10-08T07:09:17.753124+0000","last_active":"2023-10-08T07:09:36.743391+0000","last_peered":"2023-10-08T07:09:36.743391+0000","last_clean":"2023-10-08T07:09:36.743391+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:09:36.743391+0000","last_undegraded":"2023-10-08T07:09:36.743391+0000","last_fullsized":"2023-10-08T07:09:36.743391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3001,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742197+0000","last_change":"2023-10-08T07:09:20.737843+0000","last_active":"2023-10-08T07:09:36.742197+0000","last_peered":"2023-10-08T07:09:36.742197+0000","last_clean":"2023-10-08T07:09:36.742197+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:09:36.742197+0000","last_undegraded":"2023-10-08T07:09:36.742197+0000","last_fullsized":"2023-10-08T07:09:36.742197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111473+0000","last_change":"2023-10-08T07:09:18.057034+0000","last_active":"2023-10-08T07:09:36.111473+0000","last_peered":"2023-10-08T07:09:36.111473+0000","last_clean":"2023-10-08T07:09:36.111473+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:09:36.111473+0000","last_undegraded":"2023-10-08T07:09:36.111473+0000","last_fullsized":"2023-10-08T07:09:36.111473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2949,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498202+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:09:44.498202+0000","last_peered":"2023-10-08T07:09:44.498202+0000","last_clean":"2023-10-08T07:09:44.498202+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:09:44.498202+0000","last_undegraded":"2023-10-08T07:09:44.498202+0000","last_fullsized":"2023-10-08T07:09:44.498202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":86,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110842+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:36.110842+0000","last_peered":"2023-10-08T07:09:36.110842+0000","last_clean":"2023-10-08T07:09:36.110842+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:36.110842+0000","last_undegraded":"2023-10-08T07:09:36.110842+0000","last_fullsized":"2023-10-08T07:09:36.110842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":3001,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.177402+0000","last_change":"2023-10-08T07:09:51.177449+0000","last_active":"2023-10-08T07:09:51.177402+0000","last_peered":"2023-10-08T07:09:51.177402+0000","last_clean":"2023-10-08T07:09:51.177402+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:51.177402+0000","last_undegraded":"2023-10-08T07:09:51.177402+0000","last_fullsized":"2023-10-08T07:09:51.177402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2908","last_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_deep_scrub":"67'2908","last_deep_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.177304+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:24.847471+0000","scrub_duration":0.0043549410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'3","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109896+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:09:36.109896+0000","last_peered":"2023-10-08T07:09:36.109896+0000","last_clean":"2023-10-08T07:09:36.109896+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:09:36.109896+0000","last_undegraded":"2023-10-08T07:09:36.109896+0000","last_fullsized":"2023-10-08T07:09:36.109896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5939,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.877324+0000","last_change":"2023-10-08T07:09:58.877374+0000","last_active":"2023-10-08T07:09:58.877324+0000","last_peered":"2023-10-08T07:09:58.877324+0000","last_clean":"2023-10-08T07:09:58.877324+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:58.877324+0000","last_undegraded":"2023-10-08T07:09:58.877324+0000","last_fullsized":"2023-10-08T07:09:58.877324+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5846","last_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_deep_scrub":"67'5846","last_deep_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.877221+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.287679+0000","scrub_duration":0.0031762159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498076+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:09:44.498076+0000","last_peered":"2023-10-08T07:09:44.498076+0000","last_clean":"2023-10-08T07:09:44.498076+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:09:44.498076+0000","last_undegraded":"2023-10-08T07:09:44.498076+0000","last_fullsized":"2023-10-08T07:09:44.498076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111708+0000","last_change":"2023-10-08T07:09:18.058346+0000","last_active":"2023-10-08T07:09:36.111708+0000","last_peered":"2023-10-08T07:09:36.111708+0000","last_clean":"2023-10-08T07:09:36.111708+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:09:36.111708+0000","last_undegraded":"2023-10-08T07:09:36.111708+0000","last_fullsized":"2023-10-08T07:09:36.111708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742692+0000","last_change":"2023-10-08T07:09:17.752745+0000","last_active":"2023-10-08T07:09:36.742692+0000","last_peered":"2023-10-08T07:09:36.742692+0000","last_clean":"2023-10-08T07:09:36.742692+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:09:36.742692+0000","last_undegraded":"2023-10-08T07:09:36.742692+0000","last_fullsized":"2023-10-08T07:09:36.742692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5936,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.111462+0000","last_change":"2023-10-08T07:09:21.040694+0000","last_active":"2023-10-08T07:09:36.111462+0000","last_peered":"2023-10-08T07:09:36.111462+0000","last_clean":"2023-10-08T07:09:36.111462+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:09:36.111462+0000","last_undegraded":"2023-10-08T07:09:36.111462+0000","last_fullsized":"2023-10-08T07:09:36.111462+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742659+0000","last_change":"2023-10-08T07:09:17.754898+0000","last_active":"2023-10-08T07:09:36.742659+0000","last_peered":"2023-10-08T07:09:36.742659+0000","last_clean":"2023-10-08T07:09:36.742659+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:09:36.742659+0000","last_undegraded":"2023-10-08T07:09:36.742659+0000","last_fullsized":"2023-10-08T07:09:36.742659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2951,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110359+0000","last_change":"2023-10-08T07:09:21.042008+0000","last_active":"2023-10-08T07:09:36.110359+0000","last_peered":"2023-10-08T07:09:36.110359+0000","last_clean":"2023-10-08T07:09:36.110359+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:09:36.110359+0000","last_undegraded":"2023-10-08T07:09:36.110359+0000","last_fullsized":"2023-10-08T07:09:36.110359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:39.927550+0000","last_change":"2023-10-08T07:09:18.057444+0000","last_active":"2023-10-08T07:09:39.927550+0000","last_peered":"2023-10-08T07:09:39.927550+0000","last_clean":"2023-10-08T07:09:39.927550+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:09:39.927550+0000","last_undegraded":"2023-10-08T07:09:39.927550+0000","last_fullsized":"2023-10-08T07:09:39.927550+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498063+0000","last_change":"2023-10-08T07:05:32.324740+0000","last_active":"2023-10-08T07:09:44.498063+0000","last_peered":"2023-10-08T07:09:44.498063+0000","last_clean":"2023-10-08T07:09:44.498063+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:09:44.498063+0000","last_undegraded":"2023-10-08T07:09:44.498063+0000","last_fullsized":"2023-10-08T07:09:44.498063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5852,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742034+0000","last_change":"2023-10-08T07:09:20.735892+0000","last_active":"2023-10-08T07:09:36.742034+0000","last_peered":"2023-10-08T07:09:36.742034+0000","last_clean":"2023-10-08T07:09:36.742034+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:09:36.742034+0000","last_undegraded":"2023-10-08T07:09:36.742034+0000","last_fullsized":"2023-10-08T07:09:36.742034+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:37.000081+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:09:37.000081+0000","last_peered":"2023-10-08T07:09:37.000081+0000","last_clean":"2023-10-08T07:09:37.000081+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:09:37.000081+0000","last_undegraded":"2023-10-08T07:09:37.000081+0000","last_fullsized":"2023-10-08T07:09:37.000081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498093+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:09:44.498093+0000","last_peered":"2023-10-08T07:09:44.498093+0000","last_clean":"2023-10-08T07:09:44.498093+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:09:44.498093+0000","last_undegraded":"2023-10-08T07:09:44.498093+0000","last_fullsized":"2023-10-08T07:09:44.498093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2960,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928399+0000","last_change":"2023-10-08T07:09:21.040185+0000","last_active":"2023-10-08T07:09:44.928399+0000","last_peered":"2023-10-08T07:09:44.928399+0000","last_clean":"2023-10-08T07:09:44.928399+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:09:44.928399+0000","last_undegraded":"2023-10-08T07:09:44.928399+0000","last_fullsized":"2023-10-08T07:09:44.928399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:37.000157+0000","last_change":"2023-10-08T07:09:18.067783+0000","last_active":"2023-10-08T07:09:37.000157+0000","last_peered":"2023-10-08T07:09:37.000157+0000","last_clean":"2023-10-08T07:09:37.000157+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:09:37.000157+0000","last_undegraded":"2023-10-08T07:09:37.000157+0000","last_fullsized":"2023-10-08T07:09:37.000157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742738+0000","last_change":"2023-10-08T07:09:17.752755+0000","last_active":"2023-10-08T07:09:36.742738+0000","last_peered":"2023-10-08T07:09:36.742738+0000","last_clean":"2023-10-08T07:09:36.742738+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:09:36.742738+0000","last_undegraded":"2023-10-08T07:09:36.742738+0000","last_fullsized":"2023-10-08T07:09:36.742738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8919,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533998+0000","last_change":"2023-10-08T07:09:21.042220+0000","last_active":"2023-10-08T07:09:45.533998+0000","last_peered":"2023-10-08T07:09:45.533998+0000","last_clean":"2023-10-08T07:09:45.533998+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:09:45.533998+0000","last_undegraded":"2023-10-08T07:09:45.533998+0000","last_fullsized":"2023-10-08T07:09:45.533998+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:39.702099+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:09:39.702099+0000","last_peered":"2023-10-08T07:09:39.702099+0000","last_clean":"2023-10-08T07:09:39.702099+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:09:39.702099+0000","last_undegraded":"2023-10-08T07:09:39.702099+0000","last_fullsized":"2023-10-08T07:09:39.702099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":300,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110395+0000","last_change":"2023-10-08T07:09:18.052234+0000","last_active":"2023-10-08T07:09:36.110395+0000","last_peered":"2023-10-08T07:09:36.110395+0000","last_clean":"2023-10-08T07:09:36.110395+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:09:36.110395+0000","last_undegraded":"2023-10-08T07:09:36.110395+0000","last_fullsized":"2023-10-08T07:09:36.110395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928343+0000","last_change":"2023-10-08T07:09:18.049984+0000","last_active":"2023-10-08T07:09:44.928343+0000","last_peered":"2023-10-08T07:09:44.928343+0000","last_clean":"2023-10-08T07:09:44.928343+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:09:44.928343+0000","last_undegraded":"2023-10-08T07:09:44.928343+0000","last_fullsized":"2023-10-08T07:09:44.928343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5904,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498255+0000","last_change":"2023-10-08T07:09:21.040684+0000","last_active":"2023-10-08T07:09:44.498255+0000","last_peered":"2023-10-08T07:09:44.498255+0000","last_clean":"2023-10-08T07:09:44.498255+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:09:44.498255+0000","last_undegraded":"2023-10-08T07:09:44.498255+0000","last_fullsized":"2023-10-08T07:09:44.498255+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110453+0000","last_change":"2023-10-08T07:09:18.051593+0000","last_active":"2023-10-08T07:09:36.110453+0000","last_peered":"2023-10-08T07:09:36.110453+0000","last_clean":"2023-10-08T07:09:36.110453+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:09:36.110453+0000","last_undegraded":"2023-10-08T07:09:36.110453+0000","last_fullsized":"2023-10-08T07:09:36.110453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109394+0000","last_change":"2023-10-08T07:09:25.038493+0000","last_active":"2023-10-08T07:09:36.109394+0000","last_peered":"2023-10-08T07:09:36.109394+0000","last_clean":"2023-10-08T07:09:36.109394+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:09:36.109394+0000","last_undegraded":"2023-10-08T07:09:36.109394+0000","last_fullsized":"2023-10-08T07:09:36.109394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.743277+0000","last_change":"2023-10-08T07:09:17.755079+0000","last_active":"2023-10-08T07:09:36.743277+0000","last_peered":"2023-10-08T07:09:36.743277+0000","last_clean":"2023-10-08T07:09:36.743277+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:09:36.743277+0000","last_undegraded":"2023-10-08T07:09:36.743277+0000","last_fullsized":"2023-10-08T07:09:36.743277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:59.745960+0000","last_change":"2023-10-08T07:09:59.746038+0000","last_active":"2023-10-08T07:09:59.745960+0000","last_peered":"2023-10-08T07:09:59.745960+0000","last_clean":"2023-10-08T07:09:59.745960+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:59.745960+0000","last_undegraded":"2023-10-08T07:09:59.745960+0000","last_fullsized":"2023-10-08T07:09:59.745960+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_clean_scrub_stamp":"2023-10-08T07:09:59.745834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:05.711715+0000","scrub_duration":0.002070012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928387+0000","last_change":"2023-10-08T07:09:18.056208+0000","last_active":"2023-10-08T07:09:44.928387+0000","last_peered":"2023-10-08T07:09:44.928387+0000","last_clean":"2023-10-08T07:09:44.928387+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:09:44.928387+0000","last_undegraded":"2023-10-08T07:09:44.928387+0000","last_fullsized":"2023-10-08T07:09:44.928387+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.743021+0000","last_change":"2023-10-08T07:09:17.753144+0000","last_active":"2023-10-08T07:09:36.743021+0000","last_peered":"2023-10-08T07:09:36.743021+0000","last_clean":"2023-10-08T07:09:36.743021+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:09:36.743021+0000","last_undegraded":"2023-10-08T07:09:36.743021+0000","last_fullsized":"2023-10-08T07:09:36.743021+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'3","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533799+0000","last_change":"2023-10-08T07:09:18.059238+0000","last_active":"2023-10-08T07:09:45.533799+0000","last_peered":"2023-10-08T07:09:45.533799+0000","last_clean":"2023-10-08T07:09:45.533799+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:09:45.533799+0000","last_undegraded":"2023-10-08T07:09:45.533799+0000","last_fullsized":"2023-10-08T07:09:45.533799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533769+0000","last_change":"2023-10-08T07:09:18.056706+0000","last_active":"2023-10-08T07:09:45.533769+0000","last_peered":"2023-10-08T07:09:45.533769+0000","last_clean":"2023-10-08T07:09:45.533769+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:09:45.533769+0000","last_undegraded":"2023-10-08T07:09:45.533769+0000","last_fullsized":"2023-10-08T07:09:45.533769+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2997,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:52.224898+0000","last_change":"2023-10-08T07:09:52.224944+0000","last_active":"2023-10-08T07:09:52.224898+0000","last_peered":"2023-10-08T07:09:52.224898+0000","last_clean":"2023-10-08T07:09:52.224898+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:52.224898+0000","last_undegraded":"2023-10-08T07:09:52.224898+0000","last_fullsized":"2023-10-08T07:09:52.224898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2903","last_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_deep_scrub":"67'2903","last_deep_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_clean_scrub_stamp":"2023-10-08T07:09:52.224790+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:46.117778+0000","scrub_duration":0.0028885249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498016+0000","last_change":"2023-10-08T07:09:18.054661+0000","last_active":"2023-10-08T07:09:44.498016+0000","last_peered":"2023-10-08T07:09:44.498016+0000","last_clean":"2023-10-08T07:09:44.498016+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:09:44.498016+0000","last_undegraded":"2023-10-08T07:09:44.498016+0000","last_fullsized":"2023-10-08T07:09:44.498016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"69'9","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533793+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:09:45.533793+0000","last_peered":"2023-10-08T07:09:45.533793+0000","last_clean":"2023-10-08T07:09:45.533793+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:09:45.533793+0000","last_undegraded":"2023-10-08T07:09:45.533793+0000","last_fullsized":"2023-10-08T07:09:45.533793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2963,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742027+0000","last_change":"2023-10-08T07:09:20.735652+0000","last_active":"2023-10-08T07:09:36.742027+0000","last_peered":"2023-10-08T07:09:36.742027+0000","last_clean":"2023-10-08T07:09:36.742027+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:09:36.742027+0000","last_undegraded":"2023-10-08T07:09:36.742027+0000","last_fullsized":"2023-10-08T07:09:36.742027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:53.800092+0000","last_change":"2023-10-08T07:09:53.800170+0000","last_active":"2023-10-08T07:09:53.800092+0000","last_peered":"2023-10-08T07:09:53.800092+0000","last_clean":"2023-10-08T07:09:53.800092+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:53.800092+0000","last_undegraded":"2023-10-08T07:09:53.800092+0000","last_fullsized":"2023-10-08T07:09:53.800092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_clean_scrub_stamp":"2023-10-08T07:09:53.799979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:11.628567+0000","scrub_duration":0.0021863500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.743146+0000","last_change":"2023-10-08T07:09:24.732784+0000","last_active":"2023-10-08T07:09:36.743146+0000","last_peered":"2023-10-08T07:09:36.743146+0000","last_clean":"2023-10-08T07:09:36.743146+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:09:36.743146+0000","last_undegraded":"2023-10-08T07:09:36.743146+0000","last_fullsized":"2023-10-08T07:09:36.743146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110970+0000","last_change":"2023-10-08T07:09:23.066235+0000","last_active":"2023-10-08T07:09:36.110970+0000","last_peered":"2023-10-08T07:09:36.110970+0000","last_clean":"2023-10-08T07:09:36.110970+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:09:36.110970+0000","last_undegraded":"2023-10-08T07:09:36.110970+0000","last_fullsized":"2023-10-08T07:09:36.110970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5891,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110870+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:09:36.110870+0000","last_peered":"2023-10-08T07:09:36.110870+0000","last_clean":"2023-10-08T07:09:36.110870+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:09:36.110870+0000","last_undegraded":"2023-10-08T07:09:36.110870+0000","last_fullsized":"2023-10-08T07:09:36.110870+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'3","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742965+0000","last_change":"2023-10-08T07:09:17.753543+0000","last_active":"2023-10-08T07:09:36.742965+0000","last_peered":"2023-10-08T07:09:36.742965+0000","last_clean":"2023-10-08T07:09:36.742965+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:09:36.742965+0000","last_undegraded":"2023-10-08T07:09:36.742965+0000","last_fullsized":"2023-10-08T07:09:36.742965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3010,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110909+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:36.110909+0000","last_peered":"2023-10-08T07:09:36.110909+0000","last_clean":"2023-10-08T07:09:36.110909+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:36.110909+0000","last_undegraded":"2023-10-08T07:09:36.110909+0000","last_fullsized":"2023-10-08T07:09:36.110909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110496+0000","last_change":"2023-10-08T07:09:18.057710+0000","last_active":"2023-10-08T07:09:36.110496+0000","last_peered":"2023-10-08T07:09:36.110496+0000","last_clean":"2023-10-08T07:09:36.110496+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:09:36.110496+0000","last_undegraded":"2023-10-08T07:09:36.110496+0000","last_fullsized":"2023-10-08T07:09:36.110496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5880,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:00.754545+0000","last_change":"2023-10-08T07:10:00.754601+0000","last_active":"2023-10-08T07:10:00.754545+0000","last_peered":"2023-10-08T07:10:00.754545+0000","last_clean":"2023-10-08T07:10:00.754545+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:10:00.754545+0000","last_undegraded":"2023-10-08T07:10:00.754545+0000","last_fullsized":"2023-10-08T07:10:00.754545+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5794","last_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_deep_scrub":"67'5794","last_deep_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_clean_scrub_stamp":"2023-10-08T07:10:00.754451+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:41.308685+0000","scrub_duration":0.0023848570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":91,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928489+0000","last_change":"2023-10-08T07:05:32.318989+0000","last_active":"2023-10-08T07:09:44.928489+0000","last_peered":"2023-10-08T07:09:44.928489+0000","last_clean":"2023-10-08T07:09:44.928489+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:09:44.928489+0000","last_undegraded":"2023-10-08T07:09:44.928489+0000","last_fullsized":"2023-10-08T07:09:44.928489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110719+0000","last_change":"2023-10-08T07:05:33.319287+0000","last_active":"2023-10-08T07:09:36.110719+0000","last_peered":"2023-10-08T07:09:36.110719+0000","last_clean":"2023-10-08T07:09:36.110719+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:09:36.110719+0000","last_undegraded":"2023-10-08T07:09:36.110719+0000","last_fullsized":"2023-10-08T07:09:36.110719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8809,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498491+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:09:44.498491+0000","last_peered":"2023-10-08T07:09:44.498491+0000","last_clean":"2023-10-08T07:09:44.498491+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:09:44.498491+0000","last_undegraded":"2023-10-08T07:09:44.498491+0000","last_fullsized":"2023-10-08T07:09:44.498491+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3003,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928301+0000","last_change":"2023-10-08T07:09:21.036530+0000","last_active":"2023-10-08T07:09:44.928301+0000","last_peered":"2023-10-08T07:09:44.928301+0000","last_clean":"2023-10-08T07:09:44.928301+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:09:44.928301+0000","last_undegraded":"2023-10-08T07:09:44.928301+0000","last_fullsized":"2023-10-08T07:09:44.928301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742775+0000","last_change":"2023-10-08T07:09:17.754585+0000","last_active":"2023-10-08T07:09:36.742775+0000","last_peered":"2023-10-08T07:09:36.742775+0000","last_clean":"2023-10-08T07:09:36.742775+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:09:36.742775+0000","last_undegraded":"2023-10-08T07:09:36.742775+0000","last_fullsized":"2023-10-08T07:09:36.742775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:55.216862+0000","last_change":"2023-10-08T07:09:55.216924+0000","last_active":"2023-10-08T07:09:55.216862+0000","last_peered":"2023-10-08T07:09:55.216862+0000","last_clean":"2023-10-08T07:09:55.216862+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:55.216862+0000","last_undegraded":"2023-10-08T07:09:55.216862+0000","last_fullsized":"2023-10-08T07:09:55.216862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_clean_scrub_stamp":"2023-10-08T07:09:55.216748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:14.264100+0000","scrub_duration":0.001903205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2975,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742216+0000","last_change":"2023-10-08T07:09:20.735423+0000","last_active":"2023-10-08T07:09:36.742216+0000","last_peered":"2023-10-08T07:09:36.742216+0000","last_clean":"2023-10-08T07:09:36.742216+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:09:36.742216+0000","last_undegraded":"2023-10-08T07:09:36.742216+0000","last_fullsized":"2023-10-08T07:09:36.742216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738427,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595760,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776080,"statfs":{"total":96636764160,"available":96026705920,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59499999999999997,"15min":0.49199999999999999},"min":{"1min":0.35499999999999998,"5min":0.188,"15min":0.188},"max":{"1min":0.76200000000000001,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.60499999999999998,"15min":0.505},"min":{"1min":0.372,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.66300000000000003,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Oct 8 07:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.68000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483908,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887932,"statfs":{"total":96636764160,"available":96141242368,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.433}]},{"osd":2,"last update":"Sun Oct 8 07:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.1910000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.36399999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.90700000000000003,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.65700000000000003}]}]},{"osd":1,"up_from":74,"seq":317827579915,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":1712,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":1753088,"data_stored":1220245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:10:06.314 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.315 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.315 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.315 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.315 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.315 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.315 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.315 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.315 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.316 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.316 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.316 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.316 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.316 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.316 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.316 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.316 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.317 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.317 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.317 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.317 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.317 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.317 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.318 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.318 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.318 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.318 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.318 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.318 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.318 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.318 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.319 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.319 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.319 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.319 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.319 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.319 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.319 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.319 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.320 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.320 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.320 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.320 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.320 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.320 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.320 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.320 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.321 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.321 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.321 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.321 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.321 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.321 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.321 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.321 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.322 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.322 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.322 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.322 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.322 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.322 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.322 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.322 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.323 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T07:05:21.265947+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=21, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.323 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.323 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.323 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.323 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.323 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.323 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.323 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.324 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.324 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.324 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.324 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.324 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.324 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.324 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.324 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.325 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.325 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.325 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.325 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.325 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.325 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.325 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.325 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.326 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:06.326 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:10:26.327 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:10:26.685 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:10:26.687 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:10:26.697 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2023-10-08T07:10:26.581808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149189,"ondisk_log_size":149189,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145004,"kb_used_data":4308,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970516,"statfs":{"total":289910292480,"available":288737808384,"internally_reserved":0,"allocated":4411392,"data_stored":2817910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002811"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":3000,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742299+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:36.742299+0000","last_peered":"2023-10-08T07:09:36.742299+0000","last_clean":"2023-10-08T07:09:36.742299+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:36.742299+0000","last_undegraded":"2023-10-08T07:09:36.742299+0000","last_fullsized":"2023-10-08T07:09:36.742299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2909,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:46.756297+0000","last_change":"2023-10-08T07:09:46.756403+0000","last_active":"2023-10-08T07:09:46.756297+0000","last_peered":"2023-10-08T07:09:46.756297+0000","last_clean":"2023-10-08T07:09:46.756297+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:46.756297+0000","last_undegraded":"2023-10-08T07:09:46.756297+0000","last_fullsized":"2023-10-08T07:09:46.756297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2832","last_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_deep_scrub":"67'2832","last_deep_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_clean_scrub_stamp":"2023-10-08T07:09:46.756167+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:46.978745+0000","scrub_duration":0.0030689100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:01.902591+0000","last_change":"2023-10-08T07:10:01.902641+0000","last_active":"2023-10-08T07:10:01.902591+0000","last_peered":"2023-10-08T07:10:01.902591+0000","last_clean":"2023-10-08T07:10:01.902591+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:10:01.902591+0000","last_undegraded":"2023-10-08T07:10:01.902591+0000","last_fullsized":"2023-10-08T07:10:01.902591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:01.902474+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:01.902474+0000","last_clean_scrub_stamp":"2023-10-08T07:10:01.902474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:20.949826+0000","scrub_duration":0.001921706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:08.963077+0000","last_change":"2023-10-08T07:10:08.963139+0000","last_active":"2023-10-08T07:10:08.963077+0000","last_peered":"2023-10-08T07:10:08.963077+0000","last_clean":"2023-10-08T07:10:08.963077+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:10:08.963077+0000","last_undegraded":"2023-10-08T07:10:08.963077+0000","last_fullsized":"2023-10-08T07:10:08.963077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:08.962981+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:08.962981+0000","last_clean_scrub_stamp":"2023-10-08T07:10:08.962981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:20.893734+0000","scrub_duration":0.0026257540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5890,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742050+0000","last_change":"2023-10-08T07:09:20.736694+0000","last_active":"2023-10-08T07:09:36.742050+0000","last_peered":"2023-10-08T07:09:36.742050+0000","last_clean":"2023-10-08T07:09:36.742050+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:09:36.742050+0000","last_undegraded":"2023-10-08T07:09:36.742050+0000","last_fullsized":"2023-10-08T07:09:36.742050+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8580,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:06.916279+0000","last_change":"2023-10-08T07:10:06.916355+0000","last_active":"2023-10-08T07:10:06.916279+0000","last_peered":"2023-10-08T07:10:06.916279+0000","last_clean":"2023-10-08T07:10:06.916279+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:10:06.916279+0000","last_undegraded":"2023-10-08T07:10:06.916279+0000","last_fullsized":"2023-10-08T07:10:06.916279+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8487","last_scrub_stamp":"2023-10-08T07:10:06.916118+0000","last_deep_scrub":"67'8487","last_deep_scrub_stamp":"2023-10-08T07:10:06.916118+0000","last_clean_scrub_stamp":"2023-10-08T07:10:06.916118+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:55:34.602055+0000","scrub_duration":0.0043577499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.809133+0000","last_change":"2023-10-08T07:09:50.809212+0000","last_active":"2023-10-08T07:09:50.809133+0000","last_peered":"2023-10-08T07:09:50.809133+0000","last_clean":"2023-10-08T07:09:50.809133+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:50.809133+0000","last_undegraded":"2023-10-08T07:09:50.809133+0000","last_fullsized":"2023-10-08T07:09:50.809133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.808986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:57.252774+0000","scrub_duration":0.0027253220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3040,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110268+0000","last_change":"2023-10-08T07:09:28.078167+0000","last_active":"2023-10-08T07:09:36.110268+0000","last_peered":"2023-10-08T07:09:36.110268+0000","last_clean":"2023-10-08T07:09:36.110268+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:09:36.110268+0000","last_undegraded":"2023-10-08T07:09:36.110268+0000","last_fullsized":"2023-10-08T07:09:36.110268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2893,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:48.261144+0000","last_change":"2023-10-08T07:09:48.261144+0000","last_active":"2023-10-08T07:09:48.261144+0000","last_peered":"2023-10-08T07:09:48.261144+0000","last_clean":"2023-10-08T07:09:48.261144+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:48.261144+0000","last_undegraded":"2023-10-08T07:09:48.261144+0000","last_fullsized":"2023-10-08T07:09:48.261144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2779","last_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_deep_scrub":"67'2779","last_deep_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_clean_scrub_stamp":"2023-10-08T07:09:48.260984+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:35.661462+0000","scrub_duration":0.0021476020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2957,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742109+0000","last_change":"2023-10-08T07:09:20.737658+0000","last_active":"2023-10-08T07:09:36.742109+0000","last_peered":"2023-10-08T07:09:36.742109+0000","last_clean":"2023-10-08T07:09:36.742109+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:09:36.742109+0000","last_undegraded":"2023-10-08T07:09:36.742109+0000","last_fullsized":"2023-10-08T07:09:36.742109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110966+0000","last_change":"2023-10-08T07:09:23.063882+0000","last_active":"2023-10-08T07:09:36.110966+0000","last_peered":"2023-10-08T07:09:36.110966+0000","last_clean":"2023-10-08T07:09:36.110966+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:09:36.110966+0000","last_undegraded":"2023-10-08T07:09:36.110966+0000","last_fullsized":"2023-10-08T07:09:36.110966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2970,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.799105+0000","last_change":"2023-10-08T07:09:51.799195+0000","last_active":"2023-10-08T07:09:51.799105+0000","last_peered":"2023-10-08T07:09:51.799105+0000","last_clean":"2023-10-08T07:09:51.799105+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:51.799105+0000","last_undegraded":"2023-10-08T07:09:51.799105+0000","last_fullsized":"2023-10-08T07:09:51.799105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2893","last_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_deep_scrub":"67'2893","last_deep_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.798991+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:39.037371+0000","scrub_duration":0.0024056889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.743108+0000","last_change":"2023-10-08T07:09:17.754638+0000","last_active":"2023-10-08T07:09:36.743108+0000","last_peered":"2023-10-08T07:09:36.743108+0000","last_clean":"2023-10-08T07:09:36.743108+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:09:36.743108+0000","last_undegraded":"2023-10-08T07:09:36.743108+0000","last_fullsized":"2023-10-08T07:09:36.743108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2979,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498596+0000","last_change":"2023-10-08T07:09:21.040638+0000","last_active":"2023-10-08T07:09:44.498596+0000","last_peered":"2023-10-08T07:09:44.498596+0000","last_clean":"2023-10-08T07:09:44.498596+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:09:44.498596+0000","last_undegraded":"2023-10-08T07:09:44.498596+0000","last_fullsized":"2023-10-08T07:09:44.498596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5867,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110557+0000","last_change":"2023-10-08T07:09:26.042339+0000","last_active":"2023-10-08T07:09:36.110557+0000","last_peered":"2023-10-08T07:09:36.110557+0000","last_clean":"2023-10-08T07:09:36.110557+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:09:36.110557+0000","last_undegraded":"2023-10-08T07:09:36.110557+0000","last_fullsized":"2023-10-08T07:09:36.110557+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2984,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498563+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:09:44.498563+0000","last_peered":"2023-10-08T07:09:44.498563+0000","last_clean":"2023-10-08T07:09:44.498563+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:09:44.498563+0000","last_undegraded":"2023-10-08T07:09:44.498563+0000","last_fullsized":"2023-10-08T07:09:44.498563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2983,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534220+0000","last_change":"2023-10-08T07:09:21.041706+0000","last_active":"2023-10-08T07:09:45.534220+0000","last_peered":"2023-10-08T07:09:45.534220+0000","last_clean":"2023-10-08T07:09:45.534220+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:09:45.534220+0000","last_undegraded":"2023-10-08T07:09:45.534220+0000","last_fullsized":"2023-10-08T07:09:45.534220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742992+0000","last_change":"2023-10-08T07:09:17.754747+0000","last_active":"2023-10-08T07:09:36.742992+0000","last_peered":"2023-10-08T07:09:36.742992+0000","last_clean":"2023-10-08T07:09:36.742992+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:09:36.742992+0000","last_undegraded":"2023-10-08T07:09:36.742992+0000","last_fullsized":"2023-10-08T07:09:36.742992+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2964,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534210+0000","last_change":"2023-10-08T07:09:21.039966+0000","last_active":"2023-10-08T07:09:45.534210+0000","last_peered":"2023-10-08T07:09:45.534210+0000","last_clean":"2023-10-08T07:09:45.534210+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:09:45.534210+0000","last_undegraded":"2023-10-08T07:09:45.534210+0000","last_fullsized":"2023-10-08T07:09:45.534210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2983,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:17.967333+0000","last_change":"2023-10-08T07:10:17.967390+0000","last_active":"2023-10-08T07:10:17.967333+0000","last_peered":"2023-10-08T07:10:17.967333+0000","last_clean":"2023-10-08T07:10:17.967333+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:10:17.967333+0000","last_undegraded":"2023-10-08T07:10:17.967333+0000","last_fullsized":"2023-10-08T07:10:17.967333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2889","last_scrub_stamp":"2023-10-08T07:10:17.967218+0000","last_deep_scrub":"67'2889","last_deep_scrub_stamp":"2023-10-08T07:10:17.967218+0000","last_clean_scrub_stamp":"2023-10-08T07:10:17.967218+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:31.882860+0000","scrub_duration":0.003096765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5894,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498528+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:09:44.498528+0000","last_peered":"2023-10-08T07:09:44.498528+0000","last_clean":"2023-10-08T07:09:44.498528+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:09:44.498528+0000","last_undegraded":"2023-10-08T07:09:44.498528+0000","last_fullsized":"2023-10-08T07:09:44.498528+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2885,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:15.676032+0000","last_change":"2023-10-08T07:10:15.676084+0000","last_active":"2023-10-08T07:10:15.676032+0000","last_peered":"2023-10-08T07:10:15.676032+0000","last_clean":"2023-10-08T07:10:15.676032+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:10:15.676032+0000","last_undegraded":"2023-10-08T07:10:15.676032+0000","last_fullsized":"2023-10-08T07:10:15.676032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2808","last_scrub_stamp":"2023-10-08T07:10:15.675928+0000","last_deep_scrub":"67'2808","last_deep_scrub_stamp":"2023-10-08T07:10:15.675928+0000","last_clean_scrub_stamp":"2023-10-08T07:10:15.675928+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:38.425941+0000","scrub_duration":0.00268585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2991,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:49.238913+0000","last_change":"2023-10-08T07:09:49.238913+0000","last_active":"2023-10-08T07:09:49.238913+0000","last_peered":"2023-10-08T07:09:49.238913+0000","last_clean":"2023-10-08T07:09:49.238913+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:49.238913+0000","last_undegraded":"2023-10-08T07:09:49.238913+0000","last_fullsized":"2023-10-08T07:09:49.238913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2897","last_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_deep_scrub":"67'2897","last_deep_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_clean_scrub_stamp":"2023-10-08T07:09:49.238678+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:45:50.648559+0000","scrub_duration":0.0033918249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5846,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.780218+0000","last_change":"2023-10-08T07:09:58.780269+0000","last_active":"2023-10-08T07:09:58.780218+0000","last_peered":"2023-10-08T07:09:58.780218+0000","last_clean":"2023-10-08T07:09:58.780218+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:58.780218+0000","last_undegraded":"2023-10-08T07:09:58.780218+0000","last_fullsized":"2023-10-08T07:09:58.780218+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5763","last_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_deep_scrub":"67'5763","last_deep_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.780116+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:40.304910+0000","scrub_duration":0.0028329620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2957,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742330+0000","last_change":"2023-10-08T07:09:20.735845+0000","last_active":"2023-10-08T07:09:36.742330+0000","last_peered":"2023-10-08T07:09:36.742330+0000","last_clean":"2023-10-08T07:09:36.742330+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:09:36.742330+0000","last_undegraded":"2023-10-08T07:09:36.742330+0000","last_fullsized":"2023-10-08T07:09:36.742330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2984,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:20.454198+0000","last_change":"2023-10-08T07:10:20.454247+0000","last_active":"2023-10-08T07:10:20.454198+0000","last_peered":"2023-10-08T07:10:20.454198+0000","last_clean":"2023-10-08T07:10:20.454198+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:10:20.454198+0000","last_undegraded":"2023-10-08T07:10:20.454198+0000","last_fullsized":"2023-10-08T07:10:20.454198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2890","last_scrub_stamp":"2023-10-08T07:10:20.454059+0000","last_deep_scrub":"67'2890","last_deep_scrub_stamp":"2023-10-08T07:10:20.454059+0000","last_clean_scrub_stamp":"2023-10-08T07:10:20.454059+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:00.814028+0000","scrub_duration":0.0034117829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.846882+0000","last_change":"2023-10-08T07:09:56.846960+0000","last_active":"2023-10-08T07:09:56.846882+0000","last_peered":"2023-10-08T07:09:56.846882+0000","last_clean":"2023-10-08T07:09:56.846882+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:56.846882+0000","last_undegraded":"2023-10-08T07:09:56.846882+0000","last_fullsized":"2023-10-08T07:09:56.846882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.846797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:30.858022+0000","scrub_duration":0.0019930149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742643+0000","last_change":"2023-10-08T07:09:17.751957+0000","last_active":"2023-10-08T07:09:36.742643+0000","last_peered":"2023-10-08T07:09:36.742643+0000","last_clean":"2023-10-08T07:09:36.742643+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:09:36.742643+0000","last_undegraded":"2023-10-08T07:09:36.742643+0000","last_fullsized":"2023-10-08T07:09:36.742643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.785724+0000","last_change":"2023-10-08T07:09:56.785826+0000","last_active":"2023-10-08T07:09:56.785724+0000","last_peered":"2023-10-08T07:09:56.785724+0000","last_clean":"2023-10-08T07:09:56.785724+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:56.785724+0000","last_undegraded":"2023-10-08T07:09:56.785724+0000","last_fullsized":"2023-10-08T07:09:56.785724+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.785595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:34.531648+0000","scrub_duration":0.002195621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533864+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:09:45.533864+0000","last_peered":"2023-10-08T07:09:45.533864+0000","last_clean":"2023-10-08T07:09:45.533864+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:09:45.533864+0000","last_undegraded":"2023-10-08T07:09:45.533864+0000","last_fullsized":"2023-10-08T07:09:45.533864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:04.363555+0000","last_change":"2023-10-08T07:10:04.363638+0000","last_active":"2023-10-08T07:10:04.363555+0000","last_peered":"2023-10-08T07:10:04.363555+0000","last_clean":"2023-10-08T07:10:04.363555+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:10:04.363555+0000","last_undegraded":"2023-10-08T07:10:04.363555+0000","last_fullsized":"2023-10-08T07:10:04.363555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:04.363441+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:04.363441+0000","last_clean_scrub_stamp":"2023-10-08T07:10:04.363441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:25.507425+0000","scrub_duration":0.0036677139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:22.504516+0000","last_change":"2023-10-08T07:10:22.504516+0000","last_active":"2023-10-08T07:10:22.504516+0000","last_peered":"2023-10-08T07:10:22.504516+0000","last_clean":"2023-10-08T07:10:22.504516+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:10:22.504516+0000","last_undegraded":"2023-10-08T07:10:22.504516+0000","last_fullsized":"2023-10-08T07:10:22.504516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:22.504358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:22.504358+0000","last_clean_scrub_stamp":"2023-10-08T07:10:22.504358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:36.534493+0000","scrub_duration":0.001785551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3026,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742264+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:36.742264+0000","last_peered":"2023-10-08T07:09:36.742264+0000","last_clean":"2023-10-08T07:09:36.742264+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:36.742264+0000","last_undegraded":"2023-10-08T07:09:36.742264+0000","last_fullsized":"2023-10-08T07:09:36.742264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.183794+0000","last_change":"2023-10-08T07:09:56.183794+0000","last_active":"2023-10-08T07:09:56.183794+0000","last_peered":"2023-10-08T07:09:56.183794+0000","last_clean":"2023-10-08T07:09:56.183794+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:56.183794+0000","last_undegraded":"2023-10-08T07:09:56.183794+0000","last_fullsized":"2023-10-08T07:09:56.183794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_deep_scrub":"66'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.183634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:57:57.773772+0000","scrub_duration":0.0020570499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5827,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534034+0000","last_change":"2023-10-08T07:09:21.036901+0000","last_active":"2023-10-08T07:09:45.534034+0000","last_peered":"2023-10-08T07:09:45.534034+0000","last_clean":"2023-10-08T07:09:45.534034+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:09:45.534034+0000","last_undegraded":"2023-10-08T07:09:45.534034+0000","last_fullsized":"2023-10-08T07:09:45.534034+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498252+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:44.498252+0000","last_peered":"2023-10-08T07:09:44.498252+0000","last_clean":"2023-10-08T07:09:44.498252+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:44.498252+0000","last_undegraded":"2023-10-08T07:09:44.498252+0000","last_fullsized":"2023-10-08T07:09:44.498252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2951,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:07.391860+0000","last_change":"2023-10-08T07:10:07.391860+0000","last_active":"2023-10-08T07:10:07.391860+0000","last_peered":"2023-10-08T07:10:07.391860+0000","last_clean":"2023-10-08T07:10:07.391860+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:10:07.391860+0000","last_undegraded":"2023-10-08T07:10:07.391860+0000","last_fullsized":"2023-10-08T07:10:07.391860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2857","last_scrub_stamp":"2023-10-08T07:10:07.391617+0000","last_deep_scrub":"67'2857","last_deep_scrub_stamp":"2023-10-08T07:10:07.391617+0000","last_clean_scrub_stamp":"2023-10-08T07:10:07.391617+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:07.864957+0000","scrub_duration":0.0030912190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"67'7","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742884+0000","last_change":"2023-10-08T07:09:17.758979+0000","last_active":"2023-10-08T07:09:36.742884+0000","last_peered":"2023-10-08T07:09:36.742884+0000","last_clean":"2023-10-08T07:09:36.742884+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:09:36.742884+0000","last_undegraded":"2023-10-08T07:09:36.742884+0000","last_fullsized":"2023-10-08T07:09:36.742884+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.205001+0000","last_change":"2023-10-08T07:09:50.205001+0000","last_active":"2023-10-08T07:09:50.205001+0000","last_peered":"2023-10-08T07:09:50.205001+0000","last_clean":"2023-10-08T07:09:50.205001+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:50.205001+0000","last_undegraded":"2023-10-08T07:09:50.205001+0000","last_fullsized":"2023-10-08T07:09:50.205001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'3","last_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_deep_scrub":"66'3","last_deep_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.204815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:31.664355+0000","scrub_duration":0.0019594320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498246+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:44.498246+0000","last_peered":"2023-10-08T07:09:44.498246+0000","last_clean":"2023-10-08T07:09:44.498246+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:44.498246+0000","last_undegraded":"2023-10-08T07:09:44.498246+0000","last_fullsized":"2023-10-08T07:09:44.498246+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2958,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:05.926577+0000","last_change":"2023-10-08T07:10:05.926577+0000","last_active":"2023-10-08T07:10:05.926577+0000","last_peered":"2023-10-08T07:10:05.926577+0000","last_clean":"2023-10-08T07:10:05.926577+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:10:05.926577+0000","last_undegraded":"2023-10-08T07:10:05.926577+0000","last_fullsized":"2023-10-08T07:10:05.926577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2841","last_scrub_stamp":"2023-10-08T07:10:05.926418+0000","last_deep_scrub":"67'2841","last_deep_scrub_stamp":"2023-10-08T07:10:05.926418+0000","last_clean_scrub_stamp":"2023-10-08T07:10:05.926418+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:07.516556+0000","scrub_duration":0.0027102820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498176+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:09:44.498176+0000","last_peered":"2023-10-08T07:09:44.498176+0000","last_clean":"2023-10-08T07:09:44.498176+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:09:44.498176+0000","last_undegraded":"2023-10-08T07:09:44.498176+0000","last_fullsized":"2023-10-08T07:09:44.498176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2944,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742087+0000","last_change":"2023-10-08T07:09:20.737135+0000","last_active":"2023-10-08T07:09:36.742087+0000","last_peered":"2023-10-08T07:09:36.742087+0000","last_clean":"2023-10-08T07:09:36.742087+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:09:36.742087+0000","last_undegraded":"2023-10-08T07:09:36.742087+0000","last_fullsized":"2023-10-08T07:09:36.742087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533936+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:09:45.533936+0000","last_peered":"2023-10-08T07:09:45.533936+0000","last_clean":"2023-10-08T07:09:45.533936+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:09:45.533936+0000","last_undegraded":"2023-10-08T07:09:45.533936+0000","last_fullsized":"2023-10-08T07:09:45.533936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8823,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742117+0000","last_change":"2023-10-08T07:09:20.737857+0000","last_active":"2023-10-08T07:09:36.742117+0000","last_peered":"2023-10-08T07:09:36.742117+0000","last_clean":"2023-10-08T07:09:36.742117+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:09:36.742117+0000","last_undegraded":"2023-10-08T07:09:36.742117+0000","last_fullsized":"2023-10-08T07:09:36.742117+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742525+0000","last_change":"2023-10-08T07:09:17.751068+0000","last_active":"2023-10-08T07:09:36.742525+0000","last_peered":"2023-10-08T07:09:36.742525+0000","last_clean":"2023-10-08T07:09:36.742525+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:09:36.742525+0000","last_undegraded":"2023-10-08T07:09:36.742525+0000","last_fullsized":"2023-10-08T07:09:36.742525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2934,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:15.518408+0000","last_change":"2023-10-08T07:10:15.518408+0000","last_active":"2023-10-08T07:10:15.518408+0000","last_peered":"2023-10-08T07:10:15.518408+0000","last_clean":"2023-10-08T07:10:15.518408+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:10:15.518408+0000","last_undegraded":"2023-10-08T07:10:15.518408+0000","last_fullsized":"2023-10-08T07:10:15.518408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2840","last_scrub_stamp":"2023-10-08T07:10:15.518167+0000","last_deep_scrub":"67'2840","last_deep_scrub_stamp":"2023-10-08T07:10:15.518167+0000","last_clean_scrub_stamp":"2023-10-08T07:10:15.518167+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:47.143209+0000","scrub_duration":0.0035381470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'9","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498155+0000","last_change":"2023-10-08T07:09:18.054836+0000","last_active":"2023-10-08T07:09:44.498155+0000","last_peered":"2023-10-08T07:09:44.498155+0000","last_clean":"2023-10-08T07:09:44.498155+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:09:44.498155+0000","last_undegraded":"2023-10-08T07:09:44.498155+0000","last_fullsized":"2023-10-08T07:09:44.498155+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":86,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534077+0000","last_change":"2023-10-08T07:05:33.327407+0000","last_active":"2023-10-08T07:09:45.534077+0000","last_peered":"2023-10-08T07:09:45.534077+0000","last_clean":"2023-10-08T07:09:45.534077+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:09:45.534077+0000","last_undegraded":"2023-10-08T07:09:45.534077+0000","last_fullsized":"2023-10-08T07:09:45.534077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498150+0000","last_change":"2023-10-08T07:09:18.056757+0000","last_active":"2023-10-08T07:09:44.498150+0000","last_peered":"2023-10-08T07:09:44.498150+0000","last_clean":"2023-10-08T07:09:44.498150+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:09:44.498150+0000","last_undegraded":"2023-10-08T07:09:44.498150+0000","last_fullsized":"2023-10-08T07:09:44.498150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742470+0000","last_change":"2023-10-08T07:09:17.753129+0000","last_active":"2023-10-08T07:09:36.742470+0000","last_peered":"2023-10-08T07:09:36.742470+0000","last_clean":"2023-10-08T07:09:36.742470+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:09:36.742470+0000","last_undegraded":"2023-10-08T07:09:36.742470+0000","last_fullsized":"2023-10-08T07:09:36.742470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:01.721161+0000","last_change":"2023-10-08T07:10:01.721235+0000","last_active":"2023-10-08T07:10:01.721161+0000","last_peered":"2023-10-08T07:10:01.721161+0000","last_clean":"2023-10-08T07:10:01.721161+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:10:01.721161+0000","last_undegraded":"2023-10-08T07:10:01.721161+0000","last_fullsized":"2023-10-08T07:10:01.721161+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2023-10-08T07:10:01.721055+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2023-10-08T07:10:01.721055+0000","last_clean_scrub_stamp":"2023-10-08T07:10:01.721055+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:38.621496+0000","scrub_duration":0.0061286539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3009,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:03.673263+0000","last_change":"2023-10-08T07:10:03.673316+0000","last_active":"2023-10-08T07:10:03.673263+0000","last_peered":"2023-10-08T07:10:03.673263+0000","last_clean":"2023-10-08T07:10:03.673263+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:10:03.673263+0000","last_undegraded":"2023-10-08T07:10:03.673263+0000","last_fullsized":"2023-10-08T07:10:03.673263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2932","last_scrub_stamp":"2023-10-08T07:10:03.673166+0000","last_deep_scrub":"67'2932","last_deep_scrub_stamp":"2023-10-08T07:10:03.673166+0000","last_clean_scrub_stamp":"2023-10-08T07:10:03.673166+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:45:38.773848+0000","scrub_duration":0.0023330069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498158+0000","last_change":"2023-10-08T07:09:18.057034+0000","last_active":"2023-10-08T07:09:44.498158+0000","last_peered":"2023-10-08T07:09:44.498158+0000","last_clean":"2023-10-08T07:09:44.498158+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:09:44.498158+0000","last_undegraded":"2023-10-08T07:09:44.498158+0000","last_fullsized":"2023-10-08T07:09:44.498158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2949,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498202+0000","last_change":"2023-10-08T07:05:33.321553+0000","last_active":"2023-10-08T07:09:44.498202+0000","last_peered":"2023-10-08T07:09:44.498202+0000","last_clean":"2023-10-08T07:09:44.498202+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:09:44.498202+0000","last_undegraded":"2023-10-08T07:09:44.498202+0000","last_fullsized":"2023-10-08T07:09:44.498202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498239+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:44.498239+0000","last_peered":"2023-10-08T07:09:44.498239+0000","last_clean":"2023-10-08T07:09:44.498239+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:44.498239+0000","last_undegraded":"2023-10-08T07:09:44.498239+0000","last_fullsized":"2023-10-08T07:09:44.498239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":3002,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.177449+0000","last_change":"2023-10-08T07:09:51.177449+0000","last_active":"2023-10-08T07:09:51.177449+0000","last_peered":"2023-10-08T07:09:51.177449+0000","last_clean":"2023-10-08T07:09:51.177449+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:51.177449+0000","last_undegraded":"2023-10-08T07:09:51.177449+0000","last_fullsized":"2023-10-08T07:09:51.177449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2908","last_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_deep_scrub":"67'2908","last_deep_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.177304+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:24.847471+0000","scrub_duration":0.0043549410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'3","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533841+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:09:45.533841+0000","last_peered":"2023-10-08T07:09:45.533841+0000","last_clean":"2023-10-08T07:09:45.533841+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:09:45.533841+0000","last_undegraded":"2023-10-08T07:09:45.533841+0000","last_fullsized":"2023-10-08T07:09:45.533841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5940,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.877374+0000","last_change":"2023-10-08T07:09:58.877374+0000","last_active":"2023-10-08T07:09:58.877374+0000","last_peered":"2023-10-08T07:09:58.877374+0000","last_clean":"2023-10-08T07:09:58.877374+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:58.877374+0000","last_undegraded":"2023-10-08T07:09:58.877374+0000","last_fullsized":"2023-10-08T07:09:58.877374+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5846","last_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_deep_scrub":"67'5846","last_deep_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.877221+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.287679+0000","scrub_duration":0.0031762159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498076+0000","last_change":"2023-10-08T07:05:32.320913+0000","last_active":"2023-10-08T07:09:44.498076+0000","last_peered":"2023-10-08T07:09:44.498076+0000","last_clean":"2023-10-08T07:09:44.498076+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:09:44.498076+0000","last_undegraded":"2023-10-08T07:09:44.498076+0000","last_fullsized":"2023-10-08T07:09:44.498076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":97,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498314+0000","last_change":"2023-10-08T07:09:18.058346+0000","last_active":"2023-10-08T07:09:44.498314+0000","last_peered":"2023-10-08T07:09:44.498314+0000","last_clean":"2023-10-08T07:09:44.498314+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:09:44.498314+0000","last_undegraded":"2023-10-08T07:09:44.498314+0000","last_fullsized":"2023-10-08T07:09:44.498314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742692+0000","last_change":"2023-10-08T07:09:17.752745+0000","last_active":"2023-10-08T07:09:36.742692+0000","last_peered":"2023-10-08T07:09:36.742692+0000","last_clean":"2023-10-08T07:09:36.742692+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:09:36.742692+0000","last_undegraded":"2023-10-08T07:09:36.742692+0000","last_fullsized":"2023-10-08T07:09:36.742692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5937,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498360+0000","last_change":"2023-10-08T07:09:21.040694+0000","last_active":"2023-10-08T07:09:44.498360+0000","last_peered":"2023-10-08T07:09:44.498360+0000","last_clean":"2023-10-08T07:09:44.498360+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:09:44.498360+0000","last_undegraded":"2023-10-08T07:09:44.498360+0000","last_fullsized":"2023-10-08T07:09:44.498360+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742659+0000","last_change":"2023-10-08T07:09:17.754898+0000","last_active":"2023-10-08T07:09:36.742659+0000","last_peered":"2023-10-08T07:09:36.742659+0000","last_clean":"2023-10-08T07:09:36.742659+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:09:36.742659+0000","last_undegraded":"2023-10-08T07:09:36.742659+0000","last_fullsized":"2023-10-08T07:09:36.742659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2952,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534045+0000","last_change":"2023-10-08T07:09:21.042008+0000","last_active":"2023-10-08T07:09:45.534045+0000","last_peered":"2023-10-08T07:09:45.534045+0000","last_clean":"2023-10-08T07:09:45.534045+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:09:45.534045+0000","last_undegraded":"2023-10-08T07:09:45.534045+0000","last_fullsized":"2023-10-08T07:09:45.534045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:39.927550+0000","last_change":"2023-10-08T07:09:18.057444+0000","last_active":"2023-10-08T07:09:39.927550+0000","last_peered":"2023-10-08T07:09:39.927550+0000","last_clean":"2023-10-08T07:09:39.927550+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:09:39.927550+0000","last_undegraded":"2023-10-08T07:09:39.927550+0000","last_fullsized":"2023-10-08T07:09:39.927550+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:18.987300+0000","last_change":"2023-10-08T07:10:18.987348+0000","last_active":"2023-10-08T07:10:18.987300+0000","last_peered":"2023-10-08T07:10:18.987300+0000","last_clean":"2023-10-08T07:10:18.987300+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:10:18.987300+0000","last_undegraded":"2023-10-08T07:10:18.987300+0000","last_fullsized":"2023-10-08T07:10:18.987300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:18.987171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:18.987171+0000","last_clean_scrub_stamp":"2023-10-08T07:10:18.987171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:50.612213+0000","scrub_duration":0.0022629809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5860,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:25.718146+0000","last_change":"2023-10-08T07:10:25.718202+0000","last_active":"2023-10-08T07:10:25.718146+0000","last_peered":"2023-10-08T07:10:25.718146+0000","last_clean":"2023-10-08T07:10:25.718146+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:10:25.718146+0000","last_undegraded":"2023-10-08T07:10:25.718146+0000","last_fullsized":"2023-10-08T07:10:25.718146+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5777","last_scrub_stamp":"2023-10-08T07:10:25.718038+0000","last_deep_scrub":"67'5777","last_deep_scrub_stamp":"2023-10-08T07:10:25.718038+0000","last_clean_scrub_stamp":"2023-10-08T07:10:25.718038+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:11.338172+0000","scrub_duration":0.0025969640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:37.000081+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:09:37.000081+0000","last_peered":"2023-10-08T07:09:37.000081+0000","last_clean":"2023-10-08T07:09:37.000081+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:09:37.000081+0000","last_undegraded":"2023-10-08T07:09:37.000081+0000","last_fullsized":"2023-10-08T07:09:37.000081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498093+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:09:44.498093+0000","last_peered":"2023-10-08T07:09:44.498093+0000","last_clean":"2023-10-08T07:09:44.498093+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:09:44.498093+0000","last_undegraded":"2023-10-08T07:09:44.498093+0000","last_fullsized":"2023-10-08T07:09:44.498093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2960,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928399+0000","last_change":"2023-10-08T07:09:21.040185+0000","last_active":"2023-10-08T07:09:44.928399+0000","last_peered":"2023-10-08T07:09:44.928399+0000","last_clean":"2023-10-08T07:09:44.928399+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:09:44.928399+0000","last_undegraded":"2023-10-08T07:09:44.928399+0000","last_fullsized":"2023-10-08T07:09:44.928399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:37.000157+0000","last_change":"2023-10-08T07:09:18.067783+0000","last_active":"2023-10-08T07:09:37.000157+0000","last_peered":"2023-10-08T07:09:37.000157+0000","last_clean":"2023-10-08T07:09:37.000157+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:09:37.000157+0000","last_undegraded":"2023-10-08T07:09:37.000157+0000","last_fullsized":"2023-10-08T07:09:37.000157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:04.640794+0000","last_change":"2023-10-08T07:10:04.640857+0000","last_active":"2023-10-08T07:10:04.640794+0000","last_peered":"2023-10-08T07:10:04.640794+0000","last_clean":"2023-10-08T07:10:04.640794+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:10:04.640794+0000","last_undegraded":"2023-10-08T07:10:04.640794+0000","last_fullsized":"2023-10-08T07:10:04.640794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:04.640672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:04.640672+0000","last_clean_scrub_stamp":"2023-10-08T07:10:04.640672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:31:07.525494+0000","scrub_duration":0.002134164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8919,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533998+0000","last_change":"2023-10-08T07:09:21.042220+0000","last_active":"2023-10-08T07:09:45.533998+0000","last_peered":"2023-10-08T07:09:45.533998+0000","last_clean":"2023-10-08T07:09:45.533998+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:09:45.533998+0000","last_undegraded":"2023-10-08T07:09:45.533998+0000","last_fullsized":"2023-10-08T07:09:45.533998+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:39.702099+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:09:39.702099+0000","last_peered":"2023-10-08T07:09:39.702099+0000","last_clean":"2023-10-08T07:09:39.702099+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:09:39.702099+0000","last_undegraded":"2023-10-08T07:09:39.702099+0000","last_fullsized":"2023-10-08T07:09:39.702099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":300,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110395+0000","last_change":"2023-10-08T07:09:18.052234+0000","last_active":"2023-10-08T07:09:36.110395+0000","last_peered":"2023-10-08T07:09:36.110395+0000","last_clean":"2023-10-08T07:09:36.110395+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:09:36.110395+0000","last_undegraded":"2023-10-08T07:09:36.110395+0000","last_fullsized":"2023-10-08T07:09:36.110395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:14.490905+0000","last_change":"2023-10-08T07:10:14.490962+0000","last_active":"2023-10-08T07:10:14.490905+0000","last_peered":"2023-10-08T07:10:14.490905+0000","last_clean":"2023-10-08T07:10:14.490905+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:10:14.490905+0000","last_undegraded":"2023-10-08T07:10:14.490905+0000","last_fullsized":"2023-10-08T07:10:14.490905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:14.490798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:14.490798+0000","last_clean_scrub_stamp":"2023-10-08T07:10:14.490798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:50.710326+0000","scrub_duration":0.0018705449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5904,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498255+0000","last_change":"2023-10-08T07:09:21.040684+0000","last_active":"2023-10-08T07:09:44.498255+0000","last_peered":"2023-10-08T07:09:44.498255+0000","last_clean":"2023-10-08T07:09:44.498255+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:09:44.498255+0000","last_undegraded":"2023-10-08T07:09:44.498255+0000","last_fullsized":"2023-10-08T07:09:44.498255+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110453+0000","last_change":"2023-10-08T07:09:18.051593+0000","last_active":"2023-10-08T07:09:36.110453+0000","last_peered":"2023-10-08T07:09:36.110453+0000","last_clean":"2023-10-08T07:09:36.110453+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:09:36.110453+0000","last_undegraded":"2023-10-08T07:09:36.110453+0000","last_fullsized":"2023-10-08T07:09:36.110453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109394+0000","last_change":"2023-10-08T07:09:25.038493+0000","last_active":"2023-10-08T07:09:36.109394+0000","last_peered":"2023-10-08T07:09:36.109394+0000","last_clean":"2023-10-08T07:09:36.109394+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:09:36.109394+0000","last_undegraded":"2023-10-08T07:09:36.109394+0000","last_fullsized":"2023-10-08T07:09:36.109394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:22.766176+0000","last_change":"2023-10-08T07:10:22.766221+0000","last_active":"2023-10-08T07:10:22.766176+0000","last_peered":"2023-10-08T07:10:22.766176+0000","last_clean":"2023-10-08T07:10:22.766176+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:10:22.766176+0000","last_undegraded":"2023-10-08T07:10:22.766176+0000","last_fullsized":"2023-10-08T07:10:22.766176+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:22.766075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:22.766075+0000","last_clean_scrub_stamp":"2023-10-08T07:10:22.766075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:57.867526+0000","scrub_duration":0.0019628810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:59.745960+0000","last_change":"2023-10-08T07:09:59.746038+0000","last_active":"2023-10-08T07:09:59.745960+0000","last_peered":"2023-10-08T07:09:59.745960+0000","last_clean":"2023-10-08T07:09:59.745960+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:59.745960+0000","last_undegraded":"2023-10-08T07:09:59.745960+0000","last_fullsized":"2023-10-08T07:09:59.745960+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_clean_scrub_stamp":"2023-10-08T07:09:59.745834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:05.711715+0000","scrub_duration":0.002070012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928387+0000","last_change":"2023-10-08T07:09:18.056208+0000","last_active":"2023-10-08T07:09:44.928387+0000","last_peered":"2023-10-08T07:09:44.928387+0000","last_clean":"2023-10-08T07:09:44.928387+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:09:44.928387+0000","last_undegraded":"2023-10-08T07:09:44.928387+0000","last_fullsized":"2023-10-08T07:09:44.928387+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.743021+0000","last_change":"2023-10-08T07:09:17.753144+0000","last_active":"2023-10-08T07:09:36.743021+0000","last_peered":"2023-10-08T07:09:36.743021+0000","last_clean":"2023-10-08T07:09:36.743021+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:09:36.743021+0000","last_undegraded":"2023-10-08T07:09:36.743021+0000","last_fullsized":"2023-10-08T07:09:36.743021+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'3","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533799+0000","last_change":"2023-10-08T07:09:18.059238+0000","last_active":"2023-10-08T07:09:45.533799+0000","last_peered":"2023-10-08T07:09:45.533799+0000","last_clean":"2023-10-08T07:09:45.533799+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:09:45.533799+0000","last_undegraded":"2023-10-08T07:09:45.533799+0000","last_fullsized":"2023-10-08T07:09:45.533799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533769+0000","last_change":"2023-10-08T07:09:18.056706+0000","last_active":"2023-10-08T07:09:45.533769+0000","last_peered":"2023-10-08T07:09:45.533769+0000","last_clean":"2023-10-08T07:09:45.533769+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:09:45.533769+0000","last_undegraded":"2023-10-08T07:09:45.533769+0000","last_fullsized":"2023-10-08T07:09:45.533769+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2997,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:52.224898+0000","last_change":"2023-10-08T07:09:52.224944+0000","last_active":"2023-10-08T07:09:52.224898+0000","last_peered":"2023-10-08T07:09:52.224898+0000","last_clean":"2023-10-08T07:09:52.224898+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:52.224898+0000","last_undegraded":"2023-10-08T07:09:52.224898+0000","last_fullsized":"2023-10-08T07:09:52.224898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2903","last_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_deep_scrub":"67'2903","last_deep_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_clean_scrub_stamp":"2023-10-08T07:09:52.224790+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:46.117778+0000","scrub_duration":0.0028885249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498016+0000","last_change":"2023-10-08T07:09:18.054661+0000","last_active":"2023-10-08T07:09:44.498016+0000","last_peered":"2023-10-08T07:09:44.498016+0000","last_clean":"2023-10-08T07:09:44.498016+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:09:44.498016+0000","last_undegraded":"2023-10-08T07:09:44.498016+0000","last_fullsized":"2023-10-08T07:09:44.498016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"69'9","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533793+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:09:45.533793+0000","last_peered":"2023-10-08T07:09:45.533793+0000","last_clean":"2023-10-08T07:09:45.533793+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:09:45.533793+0000","last_undegraded":"2023-10-08T07:09:45.533793+0000","last_fullsized":"2023-10-08T07:09:45.533793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2963,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742027+0000","last_change":"2023-10-08T07:09:20.735652+0000","last_active":"2023-10-08T07:09:36.742027+0000","last_peered":"2023-10-08T07:09:36.742027+0000","last_clean":"2023-10-08T07:09:36.742027+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:09:36.742027+0000","last_undegraded":"2023-10-08T07:09:36.742027+0000","last_fullsized":"2023-10-08T07:09:36.742027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:53.800092+0000","last_change":"2023-10-08T07:09:53.800170+0000","last_active":"2023-10-08T07:09:53.800092+0000","last_peered":"2023-10-08T07:09:53.800092+0000","last_clean":"2023-10-08T07:09:53.800092+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:53.800092+0000","last_undegraded":"2023-10-08T07:09:53.800092+0000","last_fullsized":"2023-10-08T07:09:53.800092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_clean_scrub_stamp":"2023-10-08T07:09:53.799979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:11.628567+0000","scrub_duration":0.0021863500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.743146+0000","last_change":"2023-10-08T07:09:24.732784+0000","last_active":"2023-10-08T07:09:36.743146+0000","last_peered":"2023-10-08T07:09:36.743146+0000","last_clean":"2023-10-08T07:09:36.743146+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:09:36.743146+0000","last_undegraded":"2023-10-08T07:09:36.743146+0000","last_fullsized":"2023-10-08T07:09:36.743146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110970+0000","last_change":"2023-10-08T07:09:23.066235+0000","last_active":"2023-10-08T07:09:36.110970+0000","last_peered":"2023-10-08T07:09:36.110970+0000","last_clean":"2023-10-08T07:09:36.110970+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:09:36.110970+0000","last_undegraded":"2023-10-08T07:09:36.110970+0000","last_fullsized":"2023-10-08T07:09:36.110970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5891,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110870+0000","last_change":"2023-10-08T07:05:33.324981+0000","last_active":"2023-10-08T07:09:36.110870+0000","last_peered":"2023-10-08T07:09:36.110870+0000","last_clean":"2023-10-08T07:09:36.110870+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:09:36.110870+0000","last_undegraded":"2023-10-08T07:09:36.110870+0000","last_fullsized":"2023-10-08T07:09:36.110870+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'3","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742965+0000","last_change":"2023-10-08T07:09:17.753543+0000","last_active":"2023-10-08T07:09:36.742965+0000","last_peered":"2023-10-08T07:09:36.742965+0000","last_clean":"2023-10-08T07:09:36.742965+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:09:36.742965+0000","last_undegraded":"2023-10-08T07:09:36.742965+0000","last_fullsized":"2023-10-08T07:09:36.742965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3010,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110909+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:36.110909+0000","last_peered":"2023-10-08T07:09:36.110909+0000","last_clean":"2023-10-08T07:09:36.110909+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:36.110909+0000","last_undegraded":"2023-10-08T07:09:36.110909+0000","last_fullsized":"2023-10-08T07:09:36.110909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:18.452697+0000","last_change":"2023-10-08T07:10:18.452754+0000","last_active":"2023-10-08T07:10:18.452697+0000","last_peered":"2023-10-08T07:10:18.452697+0000","last_clean":"2023-10-08T07:10:18.452697+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:10:18.452697+0000","last_undegraded":"2023-10-08T07:10:18.452697+0000","last_fullsized":"2023-10-08T07:10:18.452697+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:10:18.452579+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:10:18.452579+0000","last_clean_scrub_stamp":"2023-10-08T07:10:18.452579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:51.487483+0000","scrub_duration":0.0019171150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5880,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:00.754545+0000","last_change":"2023-10-08T07:10:00.754601+0000","last_active":"2023-10-08T07:10:00.754545+0000","last_peered":"2023-10-08T07:10:00.754545+0000","last_clean":"2023-10-08T07:10:00.754545+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:10:00.754545+0000","last_undegraded":"2023-10-08T07:10:00.754545+0000","last_fullsized":"2023-10-08T07:10:00.754545+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5794","last_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_deep_scrub":"67'5794","last_deep_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_clean_scrub_stamp":"2023-10-08T07:10:00.754451+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:41.308685+0000","scrub_duration":0.0023848570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:06.392046+0000","last_change":"2023-10-08T07:10:06.392100+0000","last_active":"2023-10-08T07:10:06.392046+0000","last_peered":"2023-10-08T07:10:06.392046+0000","last_clean":"2023-10-08T07:10:06.392046+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:10:06.392046+0000","last_undegraded":"2023-10-08T07:10:06.392046+0000","last_fullsized":"2023-10-08T07:10:06.392046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2023-10-08T07:10:06.391949+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2023-10-08T07:10:06.391949+0000","last_clean_scrub_stamp":"2023-10-08T07:10:06.391949+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:18.322702+0000","scrub_duration":0.005184073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:17.009849+0000","last_change":"2023-10-08T07:10:17.009849+0000","last_active":"2023-10-08T07:10:17.009849+0000","last_peered":"2023-10-08T07:10:17.009849+0000","last_clean":"2023-10-08T07:10:17.009849+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:10:17.009849+0000","last_undegraded":"2023-10-08T07:10:17.009849+0000","last_fullsized":"2023-10-08T07:10:17.009849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:10:17.009657+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:10:17.009657+0000","last_clean_scrub_stamp":"2023-10-08T07:10:17.009657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:59:07.822088+0000","scrub_duration":0.0028116880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8809,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498491+0000","last_change":"2023-10-08T07:05:33.325021+0000","last_active":"2023-10-08T07:09:44.498491+0000","last_peered":"2023-10-08T07:09:44.498491+0000","last_clean":"2023-10-08T07:09:44.498491+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:09:44.498491+0000","last_undegraded":"2023-10-08T07:09:44.498491+0000","last_fullsized":"2023-10-08T07:09:44.498491+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3003,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928301+0000","last_change":"2023-10-08T07:09:21.036530+0000","last_active":"2023-10-08T07:09:44.928301+0000","last_peered":"2023-10-08T07:09:44.928301+0000","last_clean":"2023-10-08T07:09:44.928301+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:09:44.928301+0000","last_undegraded":"2023-10-08T07:09:44.928301+0000","last_fullsized":"2023-10-08T07:09:44.928301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742775+0000","last_change":"2023-10-08T07:09:17.754585+0000","last_active":"2023-10-08T07:09:36.742775+0000","last_peered":"2023-10-08T07:09:36.742775+0000","last_clean":"2023-10-08T07:09:36.742775+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:09:36.742775+0000","last_undegraded":"2023-10-08T07:09:36.742775+0000","last_fullsized":"2023-10-08T07:09:36.742775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:55.216862+0000","last_change":"2023-10-08T07:09:55.216924+0000","last_active":"2023-10-08T07:09:55.216862+0000","last_peered":"2023-10-08T07:09:55.216862+0000","last_clean":"2023-10-08T07:09:55.216862+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:55.216862+0000","last_undegraded":"2023-10-08T07:09:55.216862+0000","last_fullsized":"2023-10-08T07:09:55.216862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_clean_scrub_stamp":"2023-10-08T07:09:55.216748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:14.264100+0000","scrub_duration":0.001903205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2975,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742216+0000","last_change":"2023-10-08T07:09:20.735423+0000","last_active":"2023-10-08T07:09:36.742216+0000","last_peered":"2023-10-08T07:09:36.742216+0000","last_clean":"2023-10-08T07:09:36.742216+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:09:36.742216+0000","last_undegraded":"2023-10-08T07:09:36.742216+0000","last_fullsized":"2023-10-08T07:09:36.742216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595760,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776080,"statfs":{"total":96636764160,"available":96026705920,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59499999999999997,"15min":0.49199999999999999},"min":{"1min":0.35499999999999998,"5min":0.188,"15min":0.188},"max":{"1min":0.76200000000000001,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.60499999999999998,"15min":0.505},"min":{"1min":0.372,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.66300000000000003,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.54400000000000004}]},{"osd":1,"last update":"Sun Oct 8 07:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.56799999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483908,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887932,"statfs":{"total":96636764160,"available":96141242368,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.45500000000000002}]},{"osd":2,"last update":"Sun Oct 8 07:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":1.1910000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.499},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.496,"15min":0.50600000000000001},"min":{"1min":0.36399999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.90700000000000003,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.61399999999999999}]}]},{"osd":1,"up_from":74,"seq":317827579920,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":1712,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":1753088,"data_stored":1220245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.55700000000000005}]},{"osd":2,"last update":"Sun Oct 8 07:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.048,"5min":3.048,"15min":3.048},"last":0.47499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:10:26.705 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.706 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.706 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.706 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.706 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.707 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.707 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.707 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.707 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.707 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.708 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.708 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.708 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.708 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.709 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.709 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.709 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.709 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.710 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.710 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.710 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.710 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.711 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.711 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.711 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.711 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.711 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.712 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.712 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.712 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.712 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.713 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.713 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.713 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.713 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.713 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.714 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.714 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.714 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.714 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.715 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.715 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.715 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.715 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.715 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.716 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.716 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.716 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T07:05:21.265947+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=21, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.716 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.716 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.717 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.717 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.717 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.717 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.717 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.718 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.718 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.718 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.718 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.718 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.719 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.719 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.719 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.720 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.720 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.720 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.720 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:26.720 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:10:46.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:10:47.077 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:10:47.080 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:10:47.089 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2023-10-08T07:10:46.586795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149196,"ondisk_log_size":149196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145004,"kb_used_data":4308,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970516,"statfs":{"total":289910292480,"available":288737808384,"internally_reserved":0,"allocated":4411392,"data_stored":2817910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002910"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":3000,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742299+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:36.742299+0000","last_peered":"2023-10-08T07:09:36.742299+0000","last_clean":"2023-10-08T07:09:36.742299+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:36.742299+0000","last_undegraded":"2023-10-08T07:09:36.742299+0000","last_fullsized":"2023-10-08T07:09:36.742299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2909,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:46.756297+0000","last_change":"2023-10-08T07:09:46.756403+0000","last_active":"2023-10-08T07:09:46.756297+0000","last_peered":"2023-10-08T07:09:46.756297+0000","last_clean":"2023-10-08T07:09:46.756297+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:46.756297+0000","last_undegraded":"2023-10-08T07:09:46.756297+0000","last_fullsized":"2023-10-08T07:09:46.756297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2832","last_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_deep_scrub":"67'2832","last_deep_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_clean_scrub_stamp":"2023-10-08T07:09:46.756167+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:46.978745+0000","scrub_duration":0.0030689100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:01.902591+0000","last_change":"2023-10-08T07:10:01.902641+0000","last_active":"2023-10-08T07:10:01.902591+0000","last_peered":"2023-10-08T07:10:01.902591+0000","last_clean":"2023-10-08T07:10:01.902591+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:10:01.902591+0000","last_undegraded":"2023-10-08T07:10:01.902591+0000","last_fullsized":"2023-10-08T07:10:01.902591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:01.902474+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:01.902474+0000","last_clean_scrub_stamp":"2023-10-08T07:10:01.902474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:20.949826+0000","scrub_duration":0.001921706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:08.963077+0000","last_change":"2023-10-08T07:10:08.963139+0000","last_active":"2023-10-08T07:10:08.963077+0000","last_peered":"2023-10-08T07:10:08.963077+0000","last_clean":"2023-10-08T07:10:08.963077+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:10:08.963077+0000","last_undegraded":"2023-10-08T07:10:08.963077+0000","last_fullsized":"2023-10-08T07:10:08.963077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:08.962981+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:08.962981+0000","last_clean_scrub_stamp":"2023-10-08T07:10:08.962981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:20.893734+0000","scrub_duration":0.0026257540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5898,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:44.651559+0000","last_change":"2023-10-08T07:10:44.651612+0000","last_active":"2023-10-08T07:10:44.651559+0000","last_peered":"2023-10-08T07:10:44.651559+0000","last_clean":"2023-10-08T07:10:44.651559+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:10:44.651559+0000","last_undegraded":"2023-10-08T07:10:44.651559+0000","last_fullsized":"2023-10-08T07:10:44.651559+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5815","last_scrub_stamp":"2023-10-08T07:10:44.651463+0000","last_deep_scrub":"67'5815","last_deep_scrub_stamp":"2023-10-08T07:10:44.651463+0000","last_clean_scrub_stamp":"2023-10-08T07:10:44.651463+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:50.033791+0000","scrub_duration":0.0026907989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8581,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:06.916355+0000","last_change":"2023-10-08T07:10:06.916355+0000","last_active":"2023-10-08T07:10:06.916355+0000","last_peered":"2023-10-08T07:10:06.916355+0000","last_clean":"2023-10-08T07:10:06.916355+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:10:06.916355+0000","last_undegraded":"2023-10-08T07:10:06.916355+0000","last_fullsized":"2023-10-08T07:10:06.916355+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8487","last_scrub_stamp":"2023-10-08T07:10:06.916118+0000","last_deep_scrub":"67'8487","last_deep_scrub_stamp":"2023-10-08T07:10:06.916118+0000","last_clean_scrub_stamp":"2023-10-08T07:10:06.916118+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:55:34.602055+0000","scrub_duration":0.0043577499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.809212+0000","last_change":"2023-10-08T07:09:50.809212+0000","last_active":"2023-10-08T07:09:50.809212+0000","last_peered":"2023-10-08T07:09:50.809212+0000","last_clean":"2023-10-08T07:09:50.809212+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:50.809212+0000","last_undegraded":"2023-10-08T07:09:50.809212+0000","last_fullsized":"2023-10-08T07:09:50.809212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.808986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:57.252774+0000","scrub_duration":0.0027253220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3041,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498596+0000","last_change":"2023-10-08T07:09:28.078167+0000","last_active":"2023-10-08T07:09:44.498596+0000","last_peered":"2023-10-08T07:09:44.498596+0000","last_clean":"2023-10-08T07:09:44.498596+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:09:44.498596+0000","last_undegraded":"2023-10-08T07:09:44.498596+0000","last_fullsized":"2023-10-08T07:09:44.498596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2893,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:48.261144+0000","last_change":"2023-10-08T07:09:48.261144+0000","last_active":"2023-10-08T07:09:48.261144+0000","last_peered":"2023-10-08T07:09:48.261144+0000","last_clean":"2023-10-08T07:09:48.261144+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:48.261144+0000","last_undegraded":"2023-10-08T07:09:48.261144+0000","last_fullsized":"2023-10-08T07:09:48.261144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2779","last_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_deep_scrub":"67'2779","last_deep_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_clean_scrub_stamp":"2023-10-08T07:09:48.260984+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:35.661462+0000","scrub_duration":0.0021476020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2957,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742109+0000","last_change":"2023-10-08T07:09:20.737658+0000","last_active":"2023-10-08T07:09:36.742109+0000","last_peered":"2023-10-08T07:09:36.742109+0000","last_clean":"2023-10-08T07:09:36.742109+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:09:36.742109+0000","last_undegraded":"2023-10-08T07:09:36.742109+0000","last_fullsized":"2023-10-08T07:09:36.742109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110966+0000","last_change":"2023-10-08T07:09:23.063882+0000","last_active":"2023-10-08T07:09:36.110966+0000","last_peered":"2023-10-08T07:09:36.110966+0000","last_clean":"2023-10-08T07:09:36.110966+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:09:36.110966+0000","last_undegraded":"2023-10-08T07:09:36.110966+0000","last_fullsized":"2023-10-08T07:09:36.110966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2970,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.799105+0000","last_change":"2023-10-08T07:09:51.799195+0000","last_active":"2023-10-08T07:09:51.799105+0000","last_peered":"2023-10-08T07:09:51.799105+0000","last_clean":"2023-10-08T07:09:51.799105+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:51.799105+0000","last_undegraded":"2023-10-08T07:09:51.799105+0000","last_fullsized":"2023-10-08T07:09:51.799105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2893","last_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_deep_scrub":"67'2893","last_deep_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.798991+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:39.037371+0000","scrub_duration":0.0024056889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:27.710762+0000","last_change":"2023-10-08T07:10:27.710809+0000","last_active":"2023-10-08T07:10:27.710762+0000","last_peered":"2023-10-08T07:10:27.710762+0000","last_clean":"2023-10-08T07:10:27.710762+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:10:27.710762+0000","last_undegraded":"2023-10-08T07:10:27.710762+0000","last_fullsized":"2023-10-08T07:10:27.710762+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:27.710670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:27.710670+0000","last_clean_scrub_stamp":"2023-10-08T07:10:27.710670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:51.076837+0000","scrub_duration":0.002419591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2979,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498596+0000","last_change":"2023-10-08T07:09:21.040638+0000","last_active":"2023-10-08T07:09:44.498596+0000","last_peered":"2023-10-08T07:09:44.498596+0000","last_clean":"2023-10-08T07:09:44.498596+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:09:44.498596+0000","last_undegraded":"2023-10-08T07:09:44.498596+0000","last_fullsized":"2023-10-08T07:09:44.498596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5867,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110557+0000","last_change":"2023-10-08T07:09:26.042339+0000","last_active":"2023-10-08T07:09:36.110557+0000","last_peered":"2023-10-08T07:09:36.110557+0000","last_clean":"2023-10-08T07:09:36.110557+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:09:36.110557+0000","last_undegraded":"2023-10-08T07:09:36.110557+0000","last_fullsized":"2023-10-08T07:09:36.110557+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2984,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498563+0000","last_change":"2023-10-08T07:05:33.326153+0000","last_active":"2023-10-08T07:09:44.498563+0000","last_peered":"2023-10-08T07:09:44.498563+0000","last_clean":"2023-10-08T07:09:44.498563+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:09:44.498563+0000","last_undegraded":"2023-10-08T07:09:44.498563+0000","last_fullsized":"2023-10-08T07:09:44.498563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2983,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534220+0000","last_change":"2023-10-08T07:09:21.041706+0000","last_active":"2023-10-08T07:09:45.534220+0000","last_peered":"2023-10-08T07:09:45.534220+0000","last_clean":"2023-10-08T07:09:45.534220+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:09:45.534220+0000","last_undegraded":"2023-10-08T07:09:45.534220+0000","last_fullsized":"2023-10-08T07:09:45.534220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742992+0000","last_change":"2023-10-08T07:09:17.754747+0000","last_active":"2023-10-08T07:09:36.742992+0000","last_peered":"2023-10-08T07:09:36.742992+0000","last_clean":"2023-10-08T07:09:36.742992+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:09:36.742992+0000","last_undegraded":"2023-10-08T07:09:36.742992+0000","last_fullsized":"2023-10-08T07:09:36.742992+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2964,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534210+0000","last_change":"2023-10-08T07:09:21.039966+0000","last_active":"2023-10-08T07:09:45.534210+0000","last_peered":"2023-10-08T07:09:45.534210+0000","last_clean":"2023-10-08T07:09:45.534210+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:09:45.534210+0000","last_undegraded":"2023-10-08T07:09:45.534210+0000","last_fullsized":"2023-10-08T07:09:45.534210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2983,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:17.967333+0000","last_change":"2023-10-08T07:10:17.967390+0000","last_active":"2023-10-08T07:10:17.967333+0000","last_peered":"2023-10-08T07:10:17.967333+0000","last_clean":"2023-10-08T07:10:17.967333+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:10:17.967333+0000","last_undegraded":"2023-10-08T07:10:17.967333+0000","last_fullsized":"2023-10-08T07:10:17.967333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2889","last_scrub_stamp":"2023-10-08T07:10:17.967218+0000","last_deep_scrub":"67'2889","last_deep_scrub_stamp":"2023-10-08T07:10:17.967218+0000","last_clean_scrub_stamp":"2023-10-08T07:10:17.967218+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:31.882860+0000","scrub_duration":0.003096765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5894,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498528+0000","last_change":"2023-10-08T07:05:33.326135+0000","last_active":"2023-10-08T07:09:44.498528+0000","last_peered":"2023-10-08T07:09:44.498528+0000","last_clean":"2023-10-08T07:09:44.498528+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:09:44.498528+0000","last_undegraded":"2023-10-08T07:09:44.498528+0000","last_fullsized":"2023-10-08T07:09:44.498528+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2885,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:15.676032+0000","last_change":"2023-10-08T07:10:15.676084+0000","last_active":"2023-10-08T07:10:15.676032+0000","last_peered":"2023-10-08T07:10:15.676032+0000","last_clean":"2023-10-08T07:10:15.676032+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:10:15.676032+0000","last_undegraded":"2023-10-08T07:10:15.676032+0000","last_fullsized":"2023-10-08T07:10:15.676032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2808","last_scrub_stamp":"2023-10-08T07:10:15.675928+0000","last_deep_scrub":"67'2808","last_deep_scrub_stamp":"2023-10-08T07:10:15.675928+0000","last_clean_scrub_stamp":"2023-10-08T07:10:15.675928+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:38.425941+0000","scrub_duration":0.00268585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2991,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:49.238913+0000","last_change":"2023-10-08T07:09:49.238913+0000","last_active":"2023-10-08T07:09:49.238913+0000","last_peered":"2023-10-08T07:09:49.238913+0000","last_clean":"2023-10-08T07:09:49.238913+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:49.238913+0000","last_undegraded":"2023-10-08T07:09:49.238913+0000","last_fullsized":"2023-10-08T07:09:49.238913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2897","last_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_deep_scrub":"67'2897","last_deep_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_clean_scrub_stamp":"2023-10-08T07:09:49.238678+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:45:50.648559+0000","scrub_duration":0.0033918249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5846,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.780218+0000","last_change":"2023-10-08T07:09:58.780269+0000","last_active":"2023-10-08T07:09:58.780218+0000","last_peered":"2023-10-08T07:09:58.780218+0000","last_clean":"2023-10-08T07:09:58.780218+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:58.780218+0000","last_undegraded":"2023-10-08T07:09:58.780218+0000","last_fullsized":"2023-10-08T07:09:58.780218+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5763","last_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_deep_scrub":"67'5763","last_deep_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.780116+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:40.304910+0000","scrub_duration":0.0028329620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2957,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742330+0000","last_change":"2023-10-08T07:09:20.735845+0000","last_active":"2023-10-08T07:09:36.742330+0000","last_peered":"2023-10-08T07:09:36.742330+0000","last_clean":"2023-10-08T07:09:36.742330+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:09:36.742330+0000","last_undegraded":"2023-10-08T07:09:36.742330+0000","last_fullsized":"2023-10-08T07:09:36.742330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2984,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:20.454198+0000","last_change":"2023-10-08T07:10:20.454247+0000","last_active":"2023-10-08T07:10:20.454198+0000","last_peered":"2023-10-08T07:10:20.454198+0000","last_clean":"2023-10-08T07:10:20.454198+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:10:20.454198+0000","last_undegraded":"2023-10-08T07:10:20.454198+0000","last_fullsized":"2023-10-08T07:10:20.454198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2890","last_scrub_stamp":"2023-10-08T07:10:20.454059+0000","last_deep_scrub":"67'2890","last_deep_scrub_stamp":"2023-10-08T07:10:20.454059+0000","last_clean_scrub_stamp":"2023-10-08T07:10:20.454059+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:00.814028+0000","scrub_duration":0.0034117829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.846882+0000","last_change":"2023-10-08T07:09:56.846960+0000","last_active":"2023-10-08T07:09:56.846882+0000","last_peered":"2023-10-08T07:09:56.846882+0000","last_clean":"2023-10-08T07:09:56.846882+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:56.846882+0000","last_undegraded":"2023-10-08T07:09:56.846882+0000","last_fullsized":"2023-10-08T07:09:56.846882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.846797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:30.858022+0000","scrub_duration":0.0019930149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742643+0000","last_change":"2023-10-08T07:09:17.751957+0000","last_active":"2023-10-08T07:09:36.742643+0000","last_peered":"2023-10-08T07:09:36.742643+0000","last_clean":"2023-10-08T07:09:36.742643+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:09:36.742643+0000","last_undegraded":"2023-10-08T07:09:36.742643+0000","last_fullsized":"2023-10-08T07:09:36.742643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.785724+0000","last_change":"2023-10-08T07:09:56.785826+0000","last_active":"2023-10-08T07:09:56.785724+0000","last_peered":"2023-10-08T07:09:56.785724+0000","last_clean":"2023-10-08T07:09:56.785724+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:56.785724+0000","last_undegraded":"2023-10-08T07:09:56.785724+0000","last_fullsized":"2023-10-08T07:09:56.785724+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.785595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:34.531648+0000","scrub_duration":0.002195621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533864+0000","last_change":"2023-10-08T07:05:32.316917+0000","last_active":"2023-10-08T07:09:45.533864+0000","last_peered":"2023-10-08T07:09:45.533864+0000","last_clean":"2023-10-08T07:09:45.533864+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:09:45.533864+0000","last_undegraded":"2023-10-08T07:09:45.533864+0000","last_fullsized":"2023-10-08T07:09:45.533864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:04.363555+0000","last_change":"2023-10-08T07:10:04.363638+0000","last_active":"2023-10-08T07:10:04.363555+0000","last_peered":"2023-10-08T07:10:04.363555+0000","last_clean":"2023-10-08T07:10:04.363555+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:10:04.363555+0000","last_undegraded":"2023-10-08T07:10:04.363555+0000","last_fullsized":"2023-10-08T07:10:04.363555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:04.363441+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:04.363441+0000","last_clean_scrub_stamp":"2023-10-08T07:10:04.363441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:25.507425+0000","scrub_duration":0.0036677139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:22.504516+0000","last_change":"2023-10-08T07:10:22.504516+0000","last_active":"2023-10-08T07:10:22.504516+0000","last_peered":"2023-10-08T07:10:22.504516+0000","last_clean":"2023-10-08T07:10:22.504516+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:10:22.504516+0000","last_undegraded":"2023-10-08T07:10:22.504516+0000","last_fullsized":"2023-10-08T07:10:22.504516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:22.504358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:22.504358+0000","last_clean_scrub_stamp":"2023-10-08T07:10:22.504358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:36.534493+0000","scrub_duration":0.001785551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3026,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742264+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:36.742264+0000","last_peered":"2023-10-08T07:09:36.742264+0000","last_clean":"2023-10-08T07:09:36.742264+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:36.742264+0000","last_undegraded":"2023-10-08T07:09:36.742264+0000","last_fullsized":"2023-10-08T07:09:36.742264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.183794+0000","last_change":"2023-10-08T07:09:56.183794+0000","last_active":"2023-10-08T07:09:56.183794+0000","last_peered":"2023-10-08T07:09:56.183794+0000","last_clean":"2023-10-08T07:09:56.183794+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:56.183794+0000","last_undegraded":"2023-10-08T07:09:56.183794+0000","last_fullsized":"2023-10-08T07:09:56.183794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_deep_scrub":"66'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.183634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:57:57.773772+0000","scrub_duration":0.0020570499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5827,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534034+0000","last_change":"2023-10-08T07:09:21.036901+0000","last_active":"2023-10-08T07:09:45.534034+0000","last_peered":"2023-10-08T07:09:45.534034+0000","last_clean":"2023-10-08T07:09:45.534034+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:09:45.534034+0000","last_undegraded":"2023-10-08T07:09:45.534034+0000","last_fullsized":"2023-10-08T07:09:45.534034+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498252+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:44.498252+0000","last_peered":"2023-10-08T07:09:44.498252+0000","last_clean":"2023-10-08T07:09:44.498252+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:44.498252+0000","last_undegraded":"2023-10-08T07:09:44.498252+0000","last_fullsized":"2023-10-08T07:09:44.498252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2951,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:07.391860+0000","last_change":"2023-10-08T07:10:07.391860+0000","last_active":"2023-10-08T07:10:07.391860+0000","last_peered":"2023-10-08T07:10:07.391860+0000","last_clean":"2023-10-08T07:10:07.391860+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:10:07.391860+0000","last_undegraded":"2023-10-08T07:10:07.391860+0000","last_fullsized":"2023-10-08T07:10:07.391860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2857","last_scrub_stamp":"2023-10-08T07:10:07.391617+0000","last_deep_scrub":"67'2857","last_deep_scrub_stamp":"2023-10-08T07:10:07.391617+0000","last_clean_scrub_stamp":"2023-10-08T07:10:07.391617+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:07.864957+0000","scrub_duration":0.0030912190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"91'9","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:40.662517+0000","last_change":"2023-10-08T07:10:40.662587+0000","last_active":"2023-10-08T07:10:40.662517+0000","last_peered":"2023-10-08T07:10:40.662517+0000","last_clean":"2023-10-08T07:10:40.662517+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:10:40.662517+0000","last_undegraded":"2023-10-08T07:10:40.662517+0000","last_fullsized":"2023-10-08T07:10:40.662517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2023-10-08T07:10:40.662409+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2023-10-08T07:10:40.662409+0000","last_clean_scrub_stamp":"2023-10-08T07:10:40.662409+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:47.613277+0000","scrub_duration":0.0039694750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.205001+0000","last_change":"2023-10-08T07:09:50.205001+0000","last_active":"2023-10-08T07:09:50.205001+0000","last_peered":"2023-10-08T07:09:50.205001+0000","last_clean":"2023-10-08T07:09:50.205001+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:50.205001+0000","last_undegraded":"2023-10-08T07:09:50.205001+0000","last_fullsized":"2023-10-08T07:09:50.205001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'3","last_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_deep_scrub":"66'3","last_deep_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.204815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:31.664355+0000","scrub_duration":0.0019594320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498246+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:44.498246+0000","last_peered":"2023-10-08T07:09:44.498246+0000","last_clean":"2023-10-08T07:09:44.498246+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:44.498246+0000","last_undegraded":"2023-10-08T07:09:44.498246+0000","last_fullsized":"2023-10-08T07:09:44.498246+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2958,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:05.926577+0000","last_change":"2023-10-08T07:10:05.926577+0000","last_active":"2023-10-08T07:10:05.926577+0000","last_peered":"2023-10-08T07:10:05.926577+0000","last_clean":"2023-10-08T07:10:05.926577+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:10:05.926577+0000","last_undegraded":"2023-10-08T07:10:05.926577+0000","last_fullsized":"2023-10-08T07:10:05.926577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2841","last_scrub_stamp":"2023-10-08T07:10:05.926418+0000","last_deep_scrub":"67'2841","last_deep_scrub_stamp":"2023-10-08T07:10:05.926418+0000","last_clean_scrub_stamp":"2023-10-08T07:10:05.926418+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:07.516556+0000","scrub_duration":0.0027102820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498176+0000","last_change":"2023-10-08T07:05:32.320448+0000","last_active":"2023-10-08T07:09:44.498176+0000","last_peered":"2023-10-08T07:09:44.498176+0000","last_clean":"2023-10-08T07:09:44.498176+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:09:44.498176+0000","last_undegraded":"2023-10-08T07:09:44.498176+0000","last_fullsized":"2023-10-08T07:09:44.498176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2944,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742087+0000","last_change":"2023-10-08T07:09:20.737135+0000","last_active":"2023-10-08T07:09:36.742087+0000","last_peered":"2023-10-08T07:09:36.742087+0000","last_clean":"2023-10-08T07:09:36.742087+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:09:36.742087+0000","last_undegraded":"2023-10-08T07:09:36.742087+0000","last_fullsized":"2023-10-08T07:09:36.742087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533936+0000","last_change":"2023-10-08T07:05:32.319201+0000","last_active":"2023-10-08T07:09:45.533936+0000","last_peered":"2023-10-08T07:09:45.533936+0000","last_clean":"2023-10-08T07:09:45.533936+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:09:45.533936+0000","last_undegraded":"2023-10-08T07:09:45.533936+0000","last_fullsized":"2023-10-08T07:09:45.533936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8823,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742117+0000","last_change":"2023-10-08T07:09:20.737857+0000","last_active":"2023-10-08T07:09:36.742117+0000","last_peered":"2023-10-08T07:09:36.742117+0000","last_clean":"2023-10-08T07:09:36.742117+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:09:36.742117+0000","last_undegraded":"2023-10-08T07:09:36.742117+0000","last_fullsized":"2023-10-08T07:09:36.742117+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742525+0000","last_change":"2023-10-08T07:09:17.751068+0000","last_active":"2023-10-08T07:09:36.742525+0000","last_peered":"2023-10-08T07:09:36.742525+0000","last_clean":"2023-10-08T07:09:36.742525+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:09:36.742525+0000","last_undegraded":"2023-10-08T07:09:36.742525+0000","last_fullsized":"2023-10-08T07:09:36.742525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2934,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:15.518408+0000","last_change":"2023-10-08T07:10:15.518408+0000","last_active":"2023-10-08T07:10:15.518408+0000","last_peered":"2023-10-08T07:10:15.518408+0000","last_clean":"2023-10-08T07:10:15.518408+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:10:15.518408+0000","last_undegraded":"2023-10-08T07:10:15.518408+0000","last_fullsized":"2023-10-08T07:10:15.518408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2840","last_scrub_stamp":"2023-10-08T07:10:15.518167+0000","last_deep_scrub":"67'2840","last_deep_scrub_stamp":"2023-10-08T07:10:15.518167+0000","last_clean_scrub_stamp":"2023-10-08T07:10:15.518167+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:47.143209+0000","scrub_duration":0.0035381470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"91'13","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.954538+0000","last_change":"2023-10-08T07:10:36.954611+0000","last_active":"2023-10-08T07:10:36.954538+0000","last_peered":"2023-10-08T07:10:36.954538+0000","last_clean":"2023-10-08T07:10:36.954538+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:10:36.954538+0000","last_undegraded":"2023-10-08T07:10:36.954538+0000","last_fullsized":"2023-10-08T07:10:36.954538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'13","last_scrub_stamp":"2023-10-08T07:10:36.954426+0000","last_deep_scrub":"91'13","last_deep_scrub_stamp":"2023-10-08T07:10:36.954426+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.954426+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:38.169926+0000","scrub_duration":0.0097942589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:28.367071+0000","last_change":"2023-10-08T07:10:28.367120+0000","last_active":"2023-10-08T07:10:28.367071+0000","last_peered":"2023-10-08T07:10:28.367071+0000","last_clean":"2023-10-08T07:10:28.367071+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:10:28.367071+0000","last_undegraded":"2023-10-08T07:10:28.367071+0000","last_fullsized":"2023-10-08T07:10:28.367071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:28.366970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:28.366970+0000","last_clean_scrub_stamp":"2023-10-08T07:10:28.366970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:27.637172+0000","scrub_duration":0.0029471160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498150+0000","last_change":"2023-10-08T07:09:18.056757+0000","last_active":"2023-10-08T07:09:44.498150+0000","last_peered":"2023-10-08T07:09:44.498150+0000","last_clean":"2023-10-08T07:09:44.498150+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:09:44.498150+0000","last_undegraded":"2023-10-08T07:09:44.498150+0000","last_fullsized":"2023-10-08T07:09:44.498150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742470+0000","last_change":"2023-10-08T07:09:17.753129+0000","last_active":"2023-10-08T07:09:36.742470+0000","last_peered":"2023-10-08T07:09:36.742470+0000","last_clean":"2023-10-08T07:09:36.742470+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:09:36.742470+0000","last_undegraded":"2023-10-08T07:09:36.742470+0000","last_fullsized":"2023-10-08T07:09:36.742470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:01.721161+0000","last_change":"2023-10-08T07:10:01.721235+0000","last_active":"2023-10-08T07:10:01.721161+0000","last_peered":"2023-10-08T07:10:01.721161+0000","last_clean":"2023-10-08T07:10:01.721161+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:10:01.721161+0000","last_undegraded":"2023-10-08T07:10:01.721161+0000","last_fullsized":"2023-10-08T07:10:01.721161+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2023-10-08T07:10:01.721055+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2023-10-08T07:10:01.721055+0000","last_clean_scrub_stamp":"2023-10-08T07:10:01.721055+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:38.621496+0000","scrub_duration":0.0061286539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3009,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:03.673263+0000","last_change":"2023-10-08T07:10:03.673316+0000","last_active":"2023-10-08T07:10:03.673263+0000","last_peered":"2023-10-08T07:10:03.673263+0000","last_clean":"2023-10-08T07:10:03.673263+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:10:03.673263+0000","last_undegraded":"2023-10-08T07:10:03.673263+0000","last_fullsized":"2023-10-08T07:10:03.673263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2932","last_scrub_stamp":"2023-10-08T07:10:03.673166+0000","last_deep_scrub":"67'2932","last_deep_scrub_stamp":"2023-10-08T07:10:03.673166+0000","last_clean_scrub_stamp":"2023-10-08T07:10:03.673166+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:45:38.773848+0000","scrub_duration":0.0023330069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:26.956810+0000","last_change":"2023-10-08T07:10:26.956867+0000","last_active":"2023-10-08T07:10:26.956810+0000","last_peered":"2023-10-08T07:10:26.956810+0000","last_clean":"2023-10-08T07:10:26.956810+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:10:26.956810+0000","last_undegraded":"2023-10-08T07:10:26.956810+0000","last_fullsized":"2023-10-08T07:10:26.956810+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2023-10-08T07:10:26.956714+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2023-10-08T07:10:26.956714+0000","last_clean_scrub_stamp":"2023-10-08T07:10:26.956714+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:41.451138+0000","scrub_duration":0.0040178289999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2957,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:29.955939+0000","last_change":"2023-10-08T07:10:29.956001+0000","last_active":"2023-10-08T07:10:29.955939+0000","last_peered":"2023-10-08T07:10:29.955939+0000","last_clean":"2023-10-08T07:10:29.955939+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:10:29.955939+0000","last_undegraded":"2023-10-08T07:10:29.955939+0000","last_fullsized":"2023-10-08T07:10:29.955939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2863","last_scrub_stamp":"2023-10-08T07:10:29.955814+0000","last_deep_scrub":"67'2863","last_deep_scrub_stamp":"2023-10-08T07:10:29.955814+0000","last_clean_scrub_stamp":"2023-10-08T07:10:29.955814+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:43.985949+0000","scrub_duration":0.0033374920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498239+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:44.498239+0000","last_peered":"2023-10-08T07:09:44.498239+0000","last_clean":"2023-10-08T07:09:44.498239+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:44.498239+0000","last_undegraded":"2023-10-08T07:09:44.498239+0000","last_fullsized":"2023-10-08T07:09:44.498239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":3002,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.177449+0000","last_change":"2023-10-08T07:09:51.177449+0000","last_active":"2023-10-08T07:09:51.177449+0000","last_peered":"2023-10-08T07:09:51.177449+0000","last_clean":"2023-10-08T07:09:51.177449+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:51.177449+0000","last_undegraded":"2023-10-08T07:09:51.177449+0000","last_fullsized":"2023-10-08T07:09:51.177449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2908","last_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_deep_scrub":"67'2908","last_deep_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.177304+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:24.847471+0000","scrub_duration":0.0043549410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'3","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533841+0000","last_change":"2023-10-08T07:05:32.319198+0000","last_active":"2023-10-08T07:09:45.533841+0000","last_peered":"2023-10-08T07:09:45.533841+0000","last_clean":"2023-10-08T07:09:45.533841+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:09:45.533841+0000","last_undegraded":"2023-10-08T07:09:45.533841+0000","last_fullsized":"2023-10-08T07:09:45.533841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5940,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.877374+0000","last_change":"2023-10-08T07:09:58.877374+0000","last_active":"2023-10-08T07:09:58.877374+0000","last_peered":"2023-10-08T07:09:58.877374+0000","last_clean":"2023-10-08T07:09:58.877374+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:58.877374+0000","last_undegraded":"2023-10-08T07:09:58.877374+0000","last_fullsized":"2023-10-08T07:09:58.877374+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5846","last_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_deep_scrub":"67'5846","last_deep_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.877221+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.287679+0000","scrub_duration":0.0031762159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:34.990831+0000","last_change":"2023-10-08T07:10:34.990887+0000","last_active":"2023-10-08T07:10:34.990831+0000","last_peered":"2023-10-08T07:10:34.990831+0000","last_clean":"2023-10-08T07:10:34.990831+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:10:34.990831+0000","last_undegraded":"2023-10-08T07:10:34.990831+0000","last_fullsized":"2023-10-08T07:10:34.990831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:34.990723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:34.990723+0000","last_clean_scrub_stamp":"2023-10-08T07:10:34.990723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:34.260924+0000","scrub_duration":0.0019640790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:37.996096+0000","last_change":"2023-10-08T07:10:37.996151+0000","last_active":"2023-10-08T07:10:37.996096+0000","last_peered":"2023-10-08T07:10:37.996096+0000","last_clean":"2023-10-08T07:10:37.996096+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:10:37.996096+0000","last_undegraded":"2023-10-08T07:10:37.996096+0000","last_fullsized":"2023-10-08T07:10:37.996096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:37.995993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:37.995993+0000","last_clean_scrub_stamp":"2023-10-08T07:10:37.995993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:06.897411+0000","scrub_duration":0.0020275480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742692+0000","last_change":"2023-10-08T07:09:17.752745+0000","last_active":"2023-10-08T07:09:36.742692+0000","last_peered":"2023-10-08T07:09:36.742692+0000","last_clean":"2023-10-08T07:09:36.742692+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:09:36.742692+0000","last_undegraded":"2023-10-08T07:09:36.742692+0000","last_fullsized":"2023-10-08T07:09:36.742692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5937,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498360+0000","last_change":"2023-10-08T07:09:21.040694+0000","last_active":"2023-10-08T07:09:44.498360+0000","last_peered":"2023-10-08T07:09:44.498360+0000","last_clean":"2023-10-08T07:09:44.498360+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:09:44.498360+0000","last_undegraded":"2023-10-08T07:09:44.498360+0000","last_fullsized":"2023-10-08T07:09:44.498360+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:45.649630+0000","last_change":"2023-10-08T07:10:45.649710+0000","last_active":"2023-10-08T07:10:45.649630+0000","last_peered":"2023-10-08T07:10:45.649630+0000","last_clean":"2023-10-08T07:10:45.649630+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:10:45.649630+0000","last_undegraded":"2023-10-08T07:10:45.649630+0000","last_fullsized":"2023-10-08T07:10:45.649630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:45.649532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:45.649532+0000","last_clean_scrub_stamp":"2023-10-08T07:10:45.649532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:26.132541+0000","scrub_duration":0.0019874580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2952,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534045+0000","last_change":"2023-10-08T07:09:21.042008+0000","last_active":"2023-10-08T07:09:45.534045+0000","last_peered":"2023-10-08T07:09:45.534045+0000","last_clean":"2023-10-08T07:09:45.534045+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:09:45.534045+0000","last_undegraded":"2023-10-08T07:09:45.534045+0000","last_fullsized":"2023-10-08T07:09:45.534045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:39.927550+0000","last_change":"2023-10-08T07:09:18.057444+0000","last_active":"2023-10-08T07:09:39.927550+0000","last_peered":"2023-10-08T07:09:39.927550+0000","last_clean":"2023-10-08T07:09:39.927550+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:09:39.927550+0000","last_undegraded":"2023-10-08T07:09:39.927550+0000","last_fullsized":"2023-10-08T07:09:39.927550+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:18.987300+0000","last_change":"2023-10-08T07:10:18.987348+0000","last_active":"2023-10-08T07:10:18.987300+0000","last_peered":"2023-10-08T07:10:18.987300+0000","last_clean":"2023-10-08T07:10:18.987300+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:10:18.987300+0000","last_undegraded":"2023-10-08T07:10:18.987300+0000","last_fullsized":"2023-10-08T07:10:18.987300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:18.987171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:18.987171+0000","last_clean_scrub_stamp":"2023-10-08T07:10:18.987171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:50.612213+0000","scrub_duration":0.0022629809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5860,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:25.718146+0000","last_change":"2023-10-08T07:10:25.718202+0000","last_active":"2023-10-08T07:10:25.718146+0000","last_peered":"2023-10-08T07:10:25.718146+0000","last_clean":"2023-10-08T07:10:25.718146+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:10:25.718146+0000","last_undegraded":"2023-10-08T07:10:25.718146+0000","last_fullsized":"2023-10-08T07:10:25.718146+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5777","last_scrub_stamp":"2023-10-08T07:10:25.718038+0000","last_deep_scrub":"67'5777","last_deep_scrub_stamp":"2023-10-08T07:10:25.718038+0000","last_clean_scrub_stamp":"2023-10-08T07:10:25.718038+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:11.338172+0000","scrub_duration":0.0025969640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:37.000081+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:09:37.000081+0000","last_peered":"2023-10-08T07:09:37.000081+0000","last_clean":"2023-10-08T07:09:37.000081+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:09:37.000081+0000","last_undegraded":"2023-10-08T07:09:37.000081+0000","last_fullsized":"2023-10-08T07:09:37.000081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498093+0000","last_change":"2023-10-08T07:05:32.320649+0000","last_active":"2023-10-08T07:09:44.498093+0000","last_peered":"2023-10-08T07:09:44.498093+0000","last_clean":"2023-10-08T07:09:44.498093+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:09:44.498093+0000","last_undegraded":"2023-10-08T07:09:44.498093+0000","last_fullsized":"2023-10-08T07:09:44.498093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2960,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928399+0000","last_change":"2023-10-08T07:09:21.040185+0000","last_active":"2023-10-08T07:09:44.928399+0000","last_peered":"2023-10-08T07:09:44.928399+0000","last_clean":"2023-10-08T07:09:44.928399+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:09:44.928399+0000","last_undegraded":"2023-10-08T07:09:44.928399+0000","last_fullsized":"2023-10-08T07:09:44.928399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.424913+0000","last_change":"2023-10-08T07:10:36.424976+0000","last_active":"2023-10-08T07:10:36.424913+0000","last_peered":"2023-10-08T07:10:36.424913+0000","last_clean":"2023-10-08T07:10:36.424913+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:10:36.424913+0000","last_undegraded":"2023-10-08T07:10:36.424913+0000","last_fullsized":"2023-10-08T07:10:36.424913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:36.424768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:36.424768+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.424768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:46.936565+0000","scrub_duration":0.001635028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:04.640794+0000","last_change":"2023-10-08T07:10:04.640857+0000","last_active":"2023-10-08T07:10:04.640794+0000","last_peered":"2023-10-08T07:10:04.640794+0000","last_clean":"2023-10-08T07:10:04.640794+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:10:04.640794+0000","last_undegraded":"2023-10-08T07:10:04.640794+0000","last_fullsized":"2023-10-08T07:10:04.640794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:04.640672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:04.640672+0000","last_clean_scrub_stamp":"2023-10-08T07:10:04.640672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:31:07.525494+0000","scrub_duration":0.002134164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8919,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533998+0000","last_change":"2023-10-08T07:09:21.042220+0000","last_active":"2023-10-08T07:09:45.533998+0000","last_peered":"2023-10-08T07:09:45.533998+0000","last_clean":"2023-10-08T07:09:45.533998+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:09:45.533998+0000","last_undegraded":"2023-10-08T07:09:45.533998+0000","last_fullsized":"2023-10-08T07:09:45.533998+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:39.702099+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:09:39.702099+0000","last_peered":"2023-10-08T07:09:39.702099+0000","last_clean":"2023-10-08T07:09:39.702099+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:09:39.702099+0000","last_undegraded":"2023-10-08T07:09:39.702099+0000","last_fullsized":"2023-10-08T07:09:39.702099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":300,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110395+0000","last_change":"2023-10-08T07:09:18.052234+0000","last_active":"2023-10-08T07:09:36.110395+0000","last_peered":"2023-10-08T07:09:36.110395+0000","last_clean":"2023-10-08T07:09:36.110395+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:09:36.110395+0000","last_undegraded":"2023-10-08T07:09:36.110395+0000","last_fullsized":"2023-10-08T07:09:36.110395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:21.265947+0000","last_clean_scrub_stamp":"2023-10-08T07:05:21.265947+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:14.490905+0000","last_change":"2023-10-08T07:10:14.490962+0000","last_active":"2023-10-08T07:10:14.490905+0000","last_peered":"2023-10-08T07:10:14.490905+0000","last_clean":"2023-10-08T07:10:14.490905+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:10:14.490905+0000","last_undegraded":"2023-10-08T07:10:14.490905+0000","last_fullsized":"2023-10-08T07:10:14.490905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:14.490798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:14.490798+0000","last_clean_scrub_stamp":"2023-10-08T07:10:14.490798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:50.710326+0000","scrub_duration":0.0018705449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5904,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498255+0000","last_change":"2023-10-08T07:09:21.040684+0000","last_active":"2023-10-08T07:09:44.498255+0000","last_peered":"2023-10-08T07:09:44.498255+0000","last_clean":"2023-10-08T07:09:44.498255+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:09:44.498255+0000","last_undegraded":"2023-10-08T07:09:44.498255+0000","last_fullsized":"2023-10-08T07:09:44.498255+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110453+0000","last_change":"2023-10-08T07:09:18.051593+0000","last_active":"2023-10-08T07:09:36.110453+0000","last_peered":"2023-10-08T07:09:36.110453+0000","last_clean":"2023-10-08T07:09:36.110453+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:09:36.110453+0000","last_undegraded":"2023-10-08T07:09:36.110453+0000","last_fullsized":"2023-10-08T07:09:36.110453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109394+0000","last_change":"2023-10-08T07:09:25.038493+0000","last_active":"2023-10-08T07:09:36.109394+0000","last_peered":"2023-10-08T07:09:36.109394+0000","last_clean":"2023-10-08T07:09:36.109394+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:09:36.109394+0000","last_undegraded":"2023-10-08T07:09:36.109394+0000","last_fullsized":"2023-10-08T07:09:36.109394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:22.766176+0000","last_change":"2023-10-08T07:10:22.766221+0000","last_active":"2023-10-08T07:10:22.766176+0000","last_peered":"2023-10-08T07:10:22.766176+0000","last_clean":"2023-10-08T07:10:22.766176+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:10:22.766176+0000","last_undegraded":"2023-10-08T07:10:22.766176+0000","last_fullsized":"2023-10-08T07:10:22.766176+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:22.766075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:22.766075+0000","last_clean_scrub_stamp":"2023-10-08T07:10:22.766075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:57.867526+0000","scrub_duration":0.0019628810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:59.745960+0000","last_change":"2023-10-08T07:09:59.746038+0000","last_active":"2023-10-08T07:09:59.745960+0000","last_peered":"2023-10-08T07:09:59.745960+0000","last_clean":"2023-10-08T07:09:59.745960+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:59.745960+0000","last_undegraded":"2023-10-08T07:09:59.745960+0000","last_fullsized":"2023-10-08T07:09:59.745960+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_clean_scrub_stamp":"2023-10-08T07:09:59.745834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:05.711715+0000","scrub_duration":0.002070012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:31.391524+0000","last_change":"2023-10-08T07:10:31.391575+0000","last_active":"2023-10-08T07:10:31.391524+0000","last_peered":"2023-10-08T07:10:31.391524+0000","last_clean":"2023-10-08T07:10:31.391524+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:10:31.391524+0000","last_undegraded":"2023-10-08T07:10:31.391524+0000","last_fullsized":"2023-10-08T07:10:31.391524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:31.391414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:31.391414+0000","last_clean_scrub_stamp":"2023-10-08T07:10:31.391414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:58.361849+0000","scrub_duration":0.001953729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.743021+0000","last_change":"2023-10-08T07:09:17.753144+0000","last_active":"2023-10-08T07:09:36.743021+0000","last_peered":"2023-10-08T07:09:36.743021+0000","last_clean":"2023-10-08T07:09:36.743021+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:09:36.743021+0000","last_undegraded":"2023-10-08T07:09:36.743021+0000","last_fullsized":"2023-10-08T07:09:36.743021+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'3","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533799+0000","last_change":"2023-10-08T07:09:18.059238+0000","last_active":"2023-10-08T07:09:45.533799+0000","last_peered":"2023-10-08T07:09:45.533799+0000","last_clean":"2023-10-08T07:09:45.533799+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:09:45.533799+0000","last_undegraded":"2023-10-08T07:09:45.533799+0000","last_fullsized":"2023-10-08T07:09:45.533799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:38.461564+0000","last_change":"2023-10-08T07:10:38.461609+0000","last_active":"2023-10-08T07:10:38.461564+0000","last_peered":"2023-10-08T07:10:38.461564+0000","last_clean":"2023-10-08T07:10:38.461564+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:10:38.461564+0000","last_undegraded":"2023-10-08T07:10:38.461564+0000","last_fullsized":"2023-10-08T07:10:38.461564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:38.461431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:38.461431+0000","last_clean_scrub_stamp":"2023-10-08T07:10:38.461431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:09.555421+0000","scrub_duration":0.001628572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2997,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:52.224898+0000","last_change":"2023-10-08T07:09:52.224944+0000","last_active":"2023-10-08T07:09:52.224898+0000","last_peered":"2023-10-08T07:09:52.224898+0000","last_clean":"2023-10-08T07:09:52.224898+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:52.224898+0000","last_undegraded":"2023-10-08T07:09:52.224898+0000","last_fullsized":"2023-10-08T07:09:52.224898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2903","last_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_deep_scrub":"67'2903","last_deep_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_clean_scrub_stamp":"2023-10-08T07:09:52.224790+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:46.117778+0000","scrub_duration":0.0028885249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498016+0000","last_change":"2023-10-08T07:09:18.054661+0000","last_active":"2023-10-08T07:09:44.498016+0000","last_peered":"2023-10-08T07:09:44.498016+0000","last_clean":"2023-10-08T07:09:44.498016+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:09:44.498016+0000","last_undegraded":"2023-10-08T07:09:44.498016+0000","last_fullsized":"2023-10-08T07:09:44.498016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"69'9","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533793+0000","last_change":"2023-10-08T07:05:32.317637+0000","last_active":"2023-10-08T07:09:45.533793+0000","last_peered":"2023-10-08T07:09:45.533793+0000","last_clean":"2023-10-08T07:09:45.533793+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:09:45.533793+0000","last_undegraded":"2023-10-08T07:09:45.533793+0000","last_fullsized":"2023-10-08T07:09:45.533793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2971,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.619710+0000","last_change":"2023-10-08T07:10:36.619759+0000","last_active":"2023-10-08T07:10:36.619710+0000","last_peered":"2023-10-08T07:10:36.619710+0000","last_clean":"2023-10-08T07:10:36.619710+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:10:36.619710+0000","last_undegraded":"2023-10-08T07:10:36.619710+0000","last_fullsized":"2023-10-08T07:10:36.619710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2894","last_scrub_stamp":"2023-10-08T07:10:36.619619+0000","last_deep_scrub":"67'2894","last_deep_scrub_stamp":"2023-10-08T07:10:36.619619+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.619619+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:03.016252+0000","scrub_duration":0.0024615819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:53.800092+0000","last_change":"2023-10-08T07:09:53.800170+0000","last_active":"2023-10-08T07:09:53.800092+0000","last_peered":"2023-10-08T07:09:53.800092+0000","last_clean":"2023-10-08T07:09:53.800092+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:53.800092+0000","last_undegraded":"2023-10-08T07:09:53.800092+0000","last_fullsized":"2023-10-08T07:09:53.800092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_clean_scrub_stamp":"2023-10-08T07:09:53.799979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:11.628567+0000","scrub_duration":0.0021863500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.743146+0000","last_change":"2023-10-08T07:09:24.732784+0000","last_active":"2023-10-08T07:09:36.743146+0000","last_peered":"2023-10-08T07:09:36.743146+0000","last_clean":"2023-10-08T07:09:36.743146+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:09:36.743146+0000","last_undegraded":"2023-10-08T07:09:36.743146+0000","last_fullsized":"2023-10-08T07:09:36.743146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110970+0000","last_change":"2023-10-08T07:09:23.066235+0000","last_active":"2023-10-08T07:09:36.110970+0000","last_peered":"2023-10-08T07:09:36.110970+0000","last_clean":"2023-10-08T07:09:36.110970+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:09:36.110970+0000","last_undegraded":"2023-10-08T07:09:36.110970+0000","last_fullsized":"2023-10-08T07:09:36.110970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5900,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:25.908075+0000","last_change":"2023-10-08T07:10:25.908075+0000","last_active":"2023-10-08T07:10:25.908075+0000","last_peered":"2023-10-08T07:10:25.908075+0000","last_clean":"2023-10-08T07:10:25.908075+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:10:25.908075+0000","last_undegraded":"2023-10-08T07:10:25.908075+0000","last_fullsized":"2023-10-08T07:10:25.908075+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5806","last_scrub_stamp":"2023-10-08T07:10:25.907915+0000","last_deep_scrub":"67'5806","last_deep_scrub_stamp":"2023-10-08T07:10:25.907915+0000","last_clean_scrub_stamp":"2023-10-08T07:10:25.907915+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:33.667782+0000","scrub_duration":0.0029813180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'3","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742965+0000","last_change":"2023-10-08T07:09:17.753543+0000","last_active":"2023-10-08T07:09:36.742965+0000","last_peered":"2023-10-08T07:09:36.742965+0000","last_clean":"2023-10-08T07:09:36.742965+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:09:36.742965+0000","last_undegraded":"2023-10-08T07:09:36.742965+0000","last_fullsized":"2023-10-08T07:09:36.742965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3011,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498397+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:44.498397+0000","last_peered":"2023-10-08T07:09:44.498397+0000","last_clean":"2023-10-08T07:09:44.498397+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:44.498397+0000","last_undegraded":"2023-10-08T07:09:44.498397+0000","last_fullsized":"2023-10-08T07:09:44.498397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:18.452697+0000","last_change":"2023-10-08T07:10:18.452754+0000","last_active":"2023-10-08T07:10:18.452697+0000","last_peered":"2023-10-08T07:10:18.452697+0000","last_clean":"2023-10-08T07:10:18.452697+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:10:18.452697+0000","last_undegraded":"2023-10-08T07:10:18.452697+0000","last_fullsized":"2023-10-08T07:10:18.452697+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:10:18.452579+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:10:18.452579+0000","last_clean_scrub_stamp":"2023-10-08T07:10:18.452579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:51.487483+0000","scrub_duration":0.0019171150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5880,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:00.754545+0000","last_change":"2023-10-08T07:10:00.754601+0000","last_active":"2023-10-08T07:10:00.754545+0000","last_peered":"2023-10-08T07:10:00.754545+0000","last_clean":"2023-10-08T07:10:00.754545+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:10:00.754545+0000","last_undegraded":"2023-10-08T07:10:00.754545+0000","last_fullsized":"2023-10-08T07:10:00.754545+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5794","last_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_deep_scrub":"67'5794","last_deep_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_clean_scrub_stamp":"2023-10-08T07:10:00.754451+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:41.308685+0000","scrub_duration":0.0023848570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:06.392046+0000","last_change":"2023-10-08T07:10:06.392100+0000","last_active":"2023-10-08T07:10:06.392046+0000","last_peered":"2023-10-08T07:10:06.392046+0000","last_clean":"2023-10-08T07:10:06.392046+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:10:06.392046+0000","last_undegraded":"2023-10-08T07:10:06.392046+0000","last_fullsized":"2023-10-08T07:10:06.392046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2023-10-08T07:10:06.391949+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2023-10-08T07:10:06.391949+0000","last_clean_scrub_stamp":"2023-10-08T07:10:06.391949+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:18.322702+0000","scrub_duration":0.005184073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:17.009849+0000","last_change":"2023-10-08T07:10:17.009849+0000","last_active":"2023-10-08T07:10:17.009849+0000","last_peered":"2023-10-08T07:10:17.009849+0000","last_clean":"2023-10-08T07:10:17.009849+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:10:17.009849+0000","last_undegraded":"2023-10-08T07:10:17.009849+0000","last_fullsized":"2023-10-08T07:10:17.009849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:10:17.009657+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:10:17.009657+0000","last_clean_scrub_stamp":"2023-10-08T07:10:17.009657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:59:07.822088+0000","scrub_duration":0.0028116880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8817,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:35.984320+0000","last_change":"2023-10-08T07:10:35.984376+0000","last_active":"2023-10-08T07:10:35.984320+0000","last_peered":"2023-10-08T07:10:35.984320+0000","last_clean":"2023-10-08T07:10:35.984320+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:10:35.984320+0000","last_undegraded":"2023-10-08T07:10:35.984320+0000","last_fullsized":"2023-10-08T07:10:35.984320+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8723","last_scrub_stamp":"2023-10-08T07:10:35.984180+0000","last_deep_scrub":"67'8723","last_deep_scrub_stamp":"2023-10-08T07:10:35.984180+0000","last_clean_scrub_stamp":"2023-10-08T07:10:35.984180+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:35:02.954615+0000","scrub_duration":0.0034636020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3003,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928301+0000","last_change":"2023-10-08T07:09:21.036530+0000","last_active":"2023-10-08T07:09:44.928301+0000","last_peered":"2023-10-08T07:09:44.928301+0000","last_clean":"2023-10-08T07:09:44.928301+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:09:44.928301+0000","last_undegraded":"2023-10-08T07:09:44.928301+0000","last_fullsized":"2023-10-08T07:09:44.928301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742775+0000","last_change":"2023-10-08T07:09:17.754585+0000","last_active":"2023-10-08T07:09:36.742775+0000","last_peered":"2023-10-08T07:09:36.742775+0000","last_clean":"2023-10-08T07:09:36.742775+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:09:36.742775+0000","last_undegraded":"2023-10-08T07:09:36.742775+0000","last_fullsized":"2023-10-08T07:09:36.742775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:55.216862+0000","last_change":"2023-10-08T07:09:55.216924+0000","last_active":"2023-10-08T07:09:55.216862+0000","last_peered":"2023-10-08T07:09:55.216862+0000","last_clean":"2023-10-08T07:09:55.216862+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:55.216862+0000","last_undegraded":"2023-10-08T07:09:55.216862+0000","last_fullsized":"2023-10-08T07:09:55.216862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_clean_scrub_stamp":"2023-10-08T07:09:55.216748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:14.264100+0000","scrub_duration":0.001903205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2975,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742216+0000","last_change":"2023-10-08T07:09:20.735423+0000","last_active":"2023-10-08T07:09:36.742216+0000","last_peered":"2023-10-08T07:09:36.742216+0000","last_clean":"2023-10-08T07:09:36.742216+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:09:36.742216+0000","last_undegraded":"2023-10-08T07:09:36.742216+0000","last_fullsized":"2023-10-08T07:09:36.742216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738436,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595760,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776080,"statfs":{"total":96636764160,"available":96026705920,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.60199999999999998,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.188,"15min":0.188},"max":{"1min":0.65400000000000003,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.60599999999999998,"15min":0.50600000000000001},"min":{"1min":0.31,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58399999999999996,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Sun Oct 8 07:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483908,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887932,"statfs":{"total":96636764160,"available":96141242368,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.432}]},{"osd":2,"last update":"Sun Oct 8 07:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54700000000000004,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.63100000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.497,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.65700000000000003,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.48099999999999998}]}]},{"osd":1,"up_from":74,"seq":317827579924,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":1712,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":1753088,"data_stored":1220245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.62},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.67600000000000005}]},{"osd":2,"last update":"Sun Oct 8 07:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.048,"5min":3.048,"15min":3.048},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:10:47.099 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.099 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.099 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.099 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.099 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.100 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.100 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.100 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.100 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.100 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.100 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.100 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.101 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.101 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.101 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.101 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.101 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.101 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.101 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.102 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.102 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.102 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.102 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.102 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.102 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.102 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.102 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.103 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.103 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.103 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.103 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.103 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.103 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.104 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.104 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.104 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.104 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T07:05:21.265947+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=21, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.104 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.104 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.105 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.105 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.105 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.105 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.105 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.105 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.105 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.106 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.106 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.106 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.106 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.106 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:10:47.106 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:11:07.107 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:11:07.469 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:11:07.470 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:11:07.480 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2023-10-08T07:11:06.592054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149204,"ondisk_log_size":149204,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145004,"kb_used_data":4308,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970516,"statfs":{"total":289910292480,"available":288737808384,"internally_reserved":0,"allocated":4411392,"data_stored":2817910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003041"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":3000,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742299+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:36.742299+0000","last_peered":"2023-10-08T07:09:36.742299+0000","last_clean":"2023-10-08T07:09:36.742299+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:36.742299+0000","last_undegraded":"2023-10-08T07:09:36.742299+0000","last_fullsized":"2023-10-08T07:09:36.742299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2909,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:46.756297+0000","last_change":"2023-10-08T07:09:46.756403+0000","last_active":"2023-10-08T07:09:46.756297+0000","last_peered":"2023-10-08T07:09:46.756297+0000","last_clean":"2023-10-08T07:09:46.756297+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:46.756297+0000","last_undegraded":"2023-10-08T07:09:46.756297+0000","last_fullsized":"2023-10-08T07:09:46.756297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2832","last_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_deep_scrub":"67'2832","last_deep_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_clean_scrub_stamp":"2023-10-08T07:09:46.756167+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:46.978745+0000","scrub_duration":0.0030689100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:01.902591+0000","last_change":"2023-10-08T07:10:01.902641+0000","last_active":"2023-10-08T07:10:01.902591+0000","last_peered":"2023-10-08T07:10:01.902591+0000","last_clean":"2023-10-08T07:10:01.902591+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:10:01.902591+0000","last_undegraded":"2023-10-08T07:10:01.902591+0000","last_fullsized":"2023-10-08T07:10:01.902591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:01.902474+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:01.902474+0000","last_clean_scrub_stamp":"2023-10-08T07:10:01.902474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:20.949826+0000","scrub_duration":0.001921706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:08.963077+0000","last_change":"2023-10-08T07:10:08.963139+0000","last_active":"2023-10-08T07:10:08.963077+0000","last_peered":"2023-10-08T07:10:08.963077+0000","last_clean":"2023-10-08T07:10:08.963077+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:10:08.963077+0000","last_undegraded":"2023-10-08T07:10:08.963077+0000","last_fullsized":"2023-10-08T07:10:08.963077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:08.962981+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:08.962981+0000","last_clean_scrub_stamp":"2023-10-08T07:10:08.962981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:20.893734+0000","scrub_duration":0.0026257540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5898,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:44.651559+0000","last_change":"2023-10-08T07:10:44.651612+0000","last_active":"2023-10-08T07:10:44.651559+0000","last_peered":"2023-10-08T07:10:44.651559+0000","last_clean":"2023-10-08T07:10:44.651559+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:10:44.651559+0000","last_undegraded":"2023-10-08T07:10:44.651559+0000","last_fullsized":"2023-10-08T07:10:44.651559+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5815","last_scrub_stamp":"2023-10-08T07:10:44.651463+0000","last_deep_scrub":"67'5815","last_deep_scrub_stamp":"2023-10-08T07:10:44.651463+0000","last_clean_scrub_stamp":"2023-10-08T07:10:44.651463+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:50.033791+0000","scrub_duration":0.0026907989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8581,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:06.916355+0000","last_change":"2023-10-08T07:10:06.916355+0000","last_active":"2023-10-08T07:10:06.916355+0000","last_peered":"2023-10-08T07:10:06.916355+0000","last_clean":"2023-10-08T07:10:06.916355+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:10:06.916355+0000","last_undegraded":"2023-10-08T07:10:06.916355+0000","last_fullsized":"2023-10-08T07:10:06.916355+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8487","last_scrub_stamp":"2023-10-08T07:10:06.916118+0000","last_deep_scrub":"67'8487","last_deep_scrub_stamp":"2023-10-08T07:10:06.916118+0000","last_clean_scrub_stamp":"2023-10-08T07:10:06.916118+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:55:34.602055+0000","scrub_duration":0.0043577499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.809212+0000","last_change":"2023-10-08T07:09:50.809212+0000","last_active":"2023-10-08T07:09:50.809212+0000","last_peered":"2023-10-08T07:09:50.809212+0000","last_clean":"2023-10-08T07:09:50.809212+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:50.809212+0000","last_undegraded":"2023-10-08T07:09:50.809212+0000","last_fullsized":"2023-10-08T07:09:50.809212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.808986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:57.252774+0000","scrub_duration":0.0027253220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3041,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498596+0000","last_change":"2023-10-08T07:09:28.078167+0000","last_active":"2023-10-08T07:09:44.498596+0000","last_peered":"2023-10-08T07:09:44.498596+0000","last_clean":"2023-10-08T07:09:44.498596+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:09:44.498596+0000","last_undegraded":"2023-10-08T07:09:44.498596+0000","last_fullsized":"2023-10-08T07:09:44.498596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2893,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:48.261144+0000","last_change":"2023-10-08T07:09:48.261144+0000","last_active":"2023-10-08T07:09:48.261144+0000","last_peered":"2023-10-08T07:09:48.261144+0000","last_clean":"2023-10-08T07:09:48.261144+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:48.261144+0000","last_undegraded":"2023-10-08T07:09:48.261144+0000","last_fullsized":"2023-10-08T07:09:48.261144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2779","last_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_deep_scrub":"67'2779","last_deep_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_clean_scrub_stamp":"2023-10-08T07:09:48.260984+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:35.661462+0000","scrub_duration":0.0021476020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2957,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742109+0000","last_change":"2023-10-08T07:09:20.737658+0000","last_active":"2023-10-08T07:09:36.742109+0000","last_peered":"2023-10-08T07:09:36.742109+0000","last_clean":"2023-10-08T07:09:36.742109+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:09:36.742109+0000","last_undegraded":"2023-10-08T07:09:36.742109+0000","last_fullsized":"2023-10-08T07:09:36.742109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110966+0000","last_change":"2023-10-08T07:09:23.063882+0000","last_active":"2023-10-08T07:09:36.110966+0000","last_peered":"2023-10-08T07:09:36.110966+0000","last_clean":"2023-10-08T07:09:36.110966+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:09:36.110966+0000","last_undegraded":"2023-10-08T07:09:36.110966+0000","last_fullsized":"2023-10-08T07:09:36.110966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2970,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.799105+0000","last_change":"2023-10-08T07:09:51.799195+0000","last_active":"2023-10-08T07:09:51.799105+0000","last_peered":"2023-10-08T07:09:51.799105+0000","last_clean":"2023-10-08T07:09:51.799105+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:51.799105+0000","last_undegraded":"2023-10-08T07:09:51.799105+0000","last_fullsized":"2023-10-08T07:09:51.799105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2893","last_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_deep_scrub":"67'2893","last_deep_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.798991+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:39.037371+0000","scrub_duration":0.0024056889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:27.710762+0000","last_change":"2023-10-08T07:10:27.710809+0000","last_active":"2023-10-08T07:10:27.710762+0000","last_peered":"2023-10-08T07:10:27.710762+0000","last_clean":"2023-10-08T07:10:27.710762+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:10:27.710762+0000","last_undegraded":"2023-10-08T07:10:27.710762+0000","last_fullsized":"2023-10-08T07:10:27.710762+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:27.710670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:27.710670+0000","last_clean_scrub_stamp":"2023-10-08T07:10:27.710670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:51.076837+0000","scrub_duration":0.002419591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2979,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498596+0000","last_change":"2023-10-08T07:09:21.040638+0000","last_active":"2023-10-08T07:09:44.498596+0000","last_peered":"2023-10-08T07:09:44.498596+0000","last_clean":"2023-10-08T07:09:44.498596+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:09:44.498596+0000","last_undegraded":"2023-10-08T07:09:44.498596+0000","last_fullsized":"2023-10-08T07:09:44.498596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5867,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110557+0000","last_change":"2023-10-08T07:09:26.042339+0000","last_active":"2023-10-08T07:09:36.110557+0000","last_peered":"2023-10-08T07:09:36.110557+0000","last_clean":"2023-10-08T07:09:36.110557+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:09:36.110557+0000","last_undegraded":"2023-10-08T07:09:36.110557+0000","last_fullsized":"2023-10-08T07:09:36.110557+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2992,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:54.975424+0000","last_change":"2023-10-08T07:10:54.975485+0000","last_active":"2023-10-08T07:10:54.975424+0000","last_peered":"2023-10-08T07:10:54.975424+0000","last_clean":"2023-10-08T07:10:54.975424+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:10:54.975424+0000","last_undegraded":"2023-10-08T07:10:54.975424+0000","last_fullsized":"2023-10-08T07:10:54.975424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2898","last_scrub_stamp":"2023-10-08T07:10:54.975318+0000","last_deep_scrub":"67'2898","last_deep_scrub_stamp":"2023-10-08T07:10:54.975318+0000","last_clean_scrub_stamp":"2023-10-08T07:10:54.975318+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:44.044191+0000","scrub_duration":0.0030843680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2983,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534220+0000","last_change":"2023-10-08T07:09:21.041706+0000","last_active":"2023-10-08T07:09:45.534220+0000","last_peered":"2023-10-08T07:09:45.534220+0000","last_clean":"2023-10-08T07:09:45.534220+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:09:45.534220+0000","last_undegraded":"2023-10-08T07:09:45.534220+0000","last_fullsized":"2023-10-08T07:09:45.534220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:54.718681+0000","last_change":"2023-10-08T07:10:54.718730+0000","last_active":"2023-10-08T07:10:54.718681+0000","last_peered":"2023-10-08T07:10:54.718681+0000","last_clean":"2023-10-08T07:10:54.718681+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:10:54.718681+0000","last_undegraded":"2023-10-08T07:10:54.718681+0000","last_fullsized":"2023-10-08T07:10:54.718681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:54.718583+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:54.718583+0000","last_clean_scrub_stamp":"2023-10-08T07:10:54.718583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:36.200157+0000","scrub_duration":0.002087308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2964,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534210+0000","last_change":"2023-10-08T07:09:21.039966+0000","last_active":"2023-10-08T07:09:45.534210+0000","last_peered":"2023-10-08T07:09:45.534210+0000","last_clean":"2023-10-08T07:09:45.534210+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:09:45.534210+0000","last_undegraded":"2023-10-08T07:09:45.534210+0000","last_fullsized":"2023-10-08T07:09:45.534210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2983,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:17.967333+0000","last_change":"2023-10-08T07:10:17.967390+0000","last_active":"2023-10-08T07:10:17.967333+0000","last_peered":"2023-10-08T07:10:17.967333+0000","last_clean":"2023-10-08T07:10:17.967333+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:10:17.967333+0000","last_undegraded":"2023-10-08T07:10:17.967333+0000","last_fullsized":"2023-10-08T07:10:17.967333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2889","last_scrub_stamp":"2023-10-08T07:10:17.967218+0000","last_deep_scrub":"67'2889","last_deep_scrub_stamp":"2023-10-08T07:10:17.967218+0000","last_clean_scrub_stamp":"2023-10-08T07:10:17.967218+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:31.882860+0000","scrub_duration":0.003096765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5902,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:50.041003+0000","last_change":"2023-10-08T07:10:50.041061+0000","last_active":"2023-10-08T07:10:50.041003+0000","last_peered":"2023-10-08T07:10:50.041003+0000","last_clean":"2023-10-08T07:10:50.041003+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:10:50.041003+0000","last_undegraded":"2023-10-08T07:10:50.041003+0000","last_fullsized":"2023-10-08T07:10:50.041003+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5808","last_scrub_stamp":"2023-10-08T07:10:50.040881+0000","last_deep_scrub":"67'5808","last_deep_scrub_stamp":"2023-10-08T07:10:50.040881+0000","last_clean_scrub_stamp":"2023-10-08T07:10:50.040881+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:24.160061+0000","scrub_duration":0.0032418830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2885,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:15.676032+0000","last_change":"2023-10-08T07:10:15.676084+0000","last_active":"2023-10-08T07:10:15.676032+0000","last_peered":"2023-10-08T07:10:15.676032+0000","last_clean":"2023-10-08T07:10:15.676032+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:10:15.676032+0000","last_undegraded":"2023-10-08T07:10:15.676032+0000","last_fullsized":"2023-10-08T07:10:15.676032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2808","last_scrub_stamp":"2023-10-08T07:10:15.675928+0000","last_deep_scrub":"67'2808","last_deep_scrub_stamp":"2023-10-08T07:10:15.675928+0000","last_clean_scrub_stamp":"2023-10-08T07:10:15.675928+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:38.425941+0000","scrub_duration":0.00268585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2991,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:49.238913+0000","last_change":"2023-10-08T07:09:49.238913+0000","last_active":"2023-10-08T07:09:49.238913+0000","last_peered":"2023-10-08T07:09:49.238913+0000","last_clean":"2023-10-08T07:09:49.238913+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:49.238913+0000","last_undegraded":"2023-10-08T07:09:49.238913+0000","last_fullsized":"2023-10-08T07:09:49.238913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2897","last_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_deep_scrub":"67'2897","last_deep_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_clean_scrub_stamp":"2023-10-08T07:09:49.238678+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:45:50.648559+0000","scrub_duration":0.0033918249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5846,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.780218+0000","last_change":"2023-10-08T07:09:58.780269+0000","last_active":"2023-10-08T07:09:58.780218+0000","last_peered":"2023-10-08T07:09:58.780218+0000","last_clean":"2023-10-08T07:09:58.780218+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:58.780218+0000","last_undegraded":"2023-10-08T07:09:58.780218+0000","last_fullsized":"2023-10-08T07:09:58.780218+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5763","last_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_deep_scrub":"67'5763","last_deep_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.780116+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:40.304910+0000","scrub_duration":0.0028329620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2957,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742330+0000","last_change":"2023-10-08T07:09:20.735845+0000","last_active":"2023-10-08T07:09:36.742330+0000","last_peered":"2023-10-08T07:09:36.742330+0000","last_clean":"2023-10-08T07:09:36.742330+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:09:36.742330+0000","last_undegraded":"2023-10-08T07:09:36.742330+0000","last_fullsized":"2023-10-08T07:09:36.742330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2984,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:20.454198+0000","last_change":"2023-10-08T07:10:20.454247+0000","last_active":"2023-10-08T07:10:20.454198+0000","last_peered":"2023-10-08T07:10:20.454198+0000","last_clean":"2023-10-08T07:10:20.454198+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:10:20.454198+0000","last_undegraded":"2023-10-08T07:10:20.454198+0000","last_fullsized":"2023-10-08T07:10:20.454198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2890","last_scrub_stamp":"2023-10-08T07:10:20.454059+0000","last_deep_scrub":"67'2890","last_deep_scrub_stamp":"2023-10-08T07:10:20.454059+0000","last_clean_scrub_stamp":"2023-10-08T07:10:20.454059+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:00.814028+0000","scrub_duration":0.0034117829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.846882+0000","last_change":"2023-10-08T07:09:56.846960+0000","last_active":"2023-10-08T07:09:56.846882+0000","last_peered":"2023-10-08T07:09:56.846882+0000","last_clean":"2023-10-08T07:09:56.846882+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:56.846882+0000","last_undegraded":"2023-10-08T07:09:56.846882+0000","last_fullsized":"2023-10-08T07:09:56.846882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.846797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:30.858022+0000","scrub_duration":0.0019930149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:52.735956+0000","last_change":"2023-10-08T07:10:52.736039+0000","last_active":"2023-10-08T07:10:52.735956+0000","last_peered":"2023-10-08T07:10:52.735956+0000","last_clean":"2023-10-08T07:10:52.735956+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:10:52.735956+0000","last_undegraded":"2023-10-08T07:10:52.735956+0000","last_fullsized":"2023-10-08T07:10:52.735956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:10:52.735818+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:10:52.735818+0000","last_clean_scrub_stamp":"2023-10-08T07:10:52.735818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:10.360832+0000","scrub_duration":0.002026103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.785724+0000","last_change":"2023-10-08T07:09:56.785826+0000","last_active":"2023-10-08T07:09:56.785724+0000","last_peered":"2023-10-08T07:09:56.785724+0000","last_clean":"2023-10-08T07:09:56.785724+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:56.785724+0000","last_undegraded":"2023-10-08T07:09:56.785724+0000","last_fullsized":"2023-10-08T07:09:56.785724+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.785595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:34.531648+0000","scrub_duration":0.002195621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:56.475740+0000","last_change":"2023-10-08T07:10:56.475786+0000","last_active":"2023-10-08T07:10:56.475740+0000","last_peered":"2023-10-08T07:10:56.475740+0000","last_clean":"2023-10-08T07:10:56.475740+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:10:56.475740+0000","last_undegraded":"2023-10-08T07:10:56.475740+0000","last_fullsized":"2023-10-08T07:10:56.475740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:56.475635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:56.475635+0000","last_clean_scrub_stamp":"2023-10-08T07:10:56.475635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:57.868976+0000","scrub_duration":0.0020186980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:04.363555+0000","last_change":"2023-10-08T07:10:04.363638+0000","last_active":"2023-10-08T07:10:04.363555+0000","last_peered":"2023-10-08T07:10:04.363555+0000","last_clean":"2023-10-08T07:10:04.363555+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:10:04.363555+0000","last_undegraded":"2023-10-08T07:10:04.363555+0000","last_fullsized":"2023-10-08T07:10:04.363555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:04.363441+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:04.363441+0000","last_clean_scrub_stamp":"2023-10-08T07:10:04.363441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:25.507425+0000","scrub_duration":0.0036677139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:22.504516+0000","last_change":"2023-10-08T07:10:22.504516+0000","last_active":"2023-10-08T07:10:22.504516+0000","last_peered":"2023-10-08T07:10:22.504516+0000","last_clean":"2023-10-08T07:10:22.504516+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:10:22.504516+0000","last_undegraded":"2023-10-08T07:10:22.504516+0000","last_fullsized":"2023-10-08T07:10:22.504516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:22.504358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:22.504358+0000","last_clean_scrub_stamp":"2023-10-08T07:10:22.504358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:36.534493+0000","scrub_duration":0.001785551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3026,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742264+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:36.742264+0000","last_peered":"2023-10-08T07:09:36.742264+0000","last_clean":"2023-10-08T07:09:36.742264+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:36.742264+0000","last_undegraded":"2023-10-08T07:09:36.742264+0000","last_fullsized":"2023-10-08T07:09:36.742264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.183794+0000","last_change":"2023-10-08T07:09:56.183794+0000","last_active":"2023-10-08T07:09:56.183794+0000","last_peered":"2023-10-08T07:09:56.183794+0000","last_clean":"2023-10-08T07:09:56.183794+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:56.183794+0000","last_undegraded":"2023-10-08T07:09:56.183794+0000","last_fullsized":"2023-10-08T07:09:56.183794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_deep_scrub":"66'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.183634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:57:57.773772+0000","scrub_duration":0.0020570499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5827,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534034+0000","last_change":"2023-10-08T07:09:21.036901+0000","last_active":"2023-10-08T07:09:45.534034+0000","last_peered":"2023-10-08T07:09:45.534034+0000","last_clean":"2023-10-08T07:09:45.534034+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:09:45.534034+0000","last_undegraded":"2023-10-08T07:09:45.534034+0000","last_fullsized":"2023-10-08T07:09:45.534034+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498252+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:44.498252+0000","last_peered":"2023-10-08T07:09:44.498252+0000","last_clean":"2023-10-08T07:09:44.498252+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:44.498252+0000","last_undegraded":"2023-10-08T07:09:44.498252+0000","last_fullsized":"2023-10-08T07:09:44.498252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2951,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:07.391860+0000","last_change":"2023-10-08T07:10:07.391860+0000","last_active":"2023-10-08T07:10:07.391860+0000","last_peered":"2023-10-08T07:10:07.391860+0000","last_clean":"2023-10-08T07:10:07.391860+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:10:07.391860+0000","last_undegraded":"2023-10-08T07:10:07.391860+0000","last_fullsized":"2023-10-08T07:10:07.391860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2857","last_scrub_stamp":"2023-10-08T07:10:07.391617+0000","last_deep_scrub":"67'2857","last_deep_scrub_stamp":"2023-10-08T07:10:07.391617+0000","last_clean_scrub_stamp":"2023-10-08T07:10:07.391617+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:07.864957+0000","scrub_duration":0.0030912190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"91'9","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:40.662517+0000","last_change":"2023-10-08T07:10:40.662587+0000","last_active":"2023-10-08T07:10:40.662517+0000","last_peered":"2023-10-08T07:10:40.662517+0000","last_clean":"2023-10-08T07:10:40.662517+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:10:40.662517+0000","last_undegraded":"2023-10-08T07:10:40.662517+0000","last_fullsized":"2023-10-08T07:10:40.662517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2023-10-08T07:10:40.662409+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2023-10-08T07:10:40.662409+0000","last_clean_scrub_stamp":"2023-10-08T07:10:40.662409+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:47.613277+0000","scrub_duration":0.0039694750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.205001+0000","last_change":"2023-10-08T07:09:50.205001+0000","last_active":"2023-10-08T07:09:50.205001+0000","last_peered":"2023-10-08T07:09:50.205001+0000","last_clean":"2023-10-08T07:09:50.205001+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:50.205001+0000","last_undegraded":"2023-10-08T07:09:50.205001+0000","last_fullsized":"2023-10-08T07:09:50.205001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'3","last_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_deep_scrub":"66'3","last_deep_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.204815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:31.664355+0000","scrub_duration":0.0019594320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498246+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:44.498246+0000","last_peered":"2023-10-08T07:09:44.498246+0000","last_clean":"2023-10-08T07:09:44.498246+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:44.498246+0000","last_undegraded":"2023-10-08T07:09:44.498246+0000","last_fullsized":"2023-10-08T07:09:44.498246+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2958,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:05.926577+0000","last_change":"2023-10-08T07:10:05.926577+0000","last_active":"2023-10-08T07:10:05.926577+0000","last_peered":"2023-10-08T07:10:05.926577+0000","last_clean":"2023-10-08T07:10:05.926577+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:10:05.926577+0000","last_undegraded":"2023-10-08T07:10:05.926577+0000","last_fullsized":"2023-10-08T07:10:05.926577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2841","last_scrub_stamp":"2023-10-08T07:10:05.926418+0000","last_deep_scrub":"67'2841","last_deep_scrub_stamp":"2023-10-08T07:10:05.926418+0000","last_clean_scrub_stamp":"2023-10-08T07:10:05.926418+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:07.516556+0000","scrub_duration":0.0027102820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"91'4","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:51.976716+0000","last_change":"2023-10-08T07:10:51.976777+0000","last_active":"2023-10-08T07:10:51.976716+0000","last_peered":"2023-10-08T07:10:51.976716+0000","last_clean":"2023-10-08T07:10:51.976716+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:10:51.976716+0000","last_undegraded":"2023-10-08T07:10:51.976716+0000","last_fullsized":"2023-10-08T07:10:51.976716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:10:51.976599+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:10:51.976599+0000","last_clean_scrub_stamp":"2023-10-08T07:10:51.976599+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:39.729393+0000","scrub_duration":0.0041755680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2944,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742087+0000","last_change":"2023-10-08T07:09:20.737135+0000","last_active":"2023-10-08T07:09:36.742087+0000","last_peered":"2023-10-08T07:09:36.742087+0000","last_clean":"2023-10-08T07:09:36.742087+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:09:36.742087+0000","last_undegraded":"2023-10-08T07:09:36.742087+0000","last_fullsized":"2023-10-08T07:09:36.742087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:59.504119+0000","last_change":"2023-10-08T07:10:59.504215+0000","last_active":"2023-10-08T07:10:59.504119+0000","last_peered":"2023-10-08T07:10:59.504119+0000","last_clean":"2023-10-08T07:10:59.504119+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:10:59.504119+0000","last_undegraded":"2023-10-08T07:10:59.504119+0000","last_fullsized":"2023-10-08T07:10:59.504119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:59.504012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:59.504012+0000","last_clean_scrub_stamp":"2023-10-08T07:10:59.504012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:51:50.766230+0000","scrub_duration":0.0016614209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8823,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742117+0000","last_change":"2023-10-08T07:09:20.737857+0000","last_active":"2023-10-08T07:09:36.742117+0000","last_peered":"2023-10-08T07:09:36.742117+0000","last_clean":"2023-10-08T07:09:36.742117+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:09:36.742117+0000","last_undegraded":"2023-10-08T07:09:36.742117+0000","last_fullsized":"2023-10-08T07:09:36.742117+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:47.711196+0000","last_change":"2023-10-08T07:10:47.711265+0000","last_active":"2023-10-08T07:10:47.711196+0000","last_peered":"2023-10-08T07:10:47.711196+0000","last_clean":"2023-10-08T07:10:47.711196+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:10:47.711196+0000","last_undegraded":"2023-10-08T07:10:47.711196+0000","last_fullsized":"2023-10-08T07:10:47.711196+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:47.711101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:47.711101+0000","last_clean_scrub_stamp":"2023-10-08T07:10:47.711101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:44:42.808700+0000","scrub_duration":0.001740978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2934,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:15.518408+0000","last_change":"2023-10-08T07:10:15.518408+0000","last_active":"2023-10-08T07:10:15.518408+0000","last_peered":"2023-10-08T07:10:15.518408+0000","last_clean":"2023-10-08T07:10:15.518408+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:10:15.518408+0000","last_undegraded":"2023-10-08T07:10:15.518408+0000","last_fullsized":"2023-10-08T07:10:15.518408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2840","last_scrub_stamp":"2023-10-08T07:10:15.518167+0000","last_deep_scrub":"67'2840","last_deep_scrub_stamp":"2023-10-08T07:10:15.518167+0000","last_clean_scrub_stamp":"2023-10-08T07:10:15.518167+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:47.143209+0000","scrub_duration":0.0035381470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"91'13","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.954538+0000","last_change":"2023-10-08T07:10:36.954611+0000","last_active":"2023-10-08T07:10:36.954538+0000","last_peered":"2023-10-08T07:10:36.954538+0000","last_clean":"2023-10-08T07:10:36.954538+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:10:36.954538+0000","last_undegraded":"2023-10-08T07:10:36.954538+0000","last_fullsized":"2023-10-08T07:10:36.954538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'13","last_scrub_stamp":"2023-10-08T07:10:36.954426+0000","last_deep_scrub":"91'13","last_deep_scrub_stamp":"2023-10-08T07:10:36.954426+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.954426+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:38.169926+0000","scrub_duration":0.0097942589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:28.367071+0000","last_change":"2023-10-08T07:10:28.367120+0000","last_active":"2023-10-08T07:10:28.367071+0000","last_peered":"2023-10-08T07:10:28.367071+0000","last_clean":"2023-10-08T07:10:28.367071+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:10:28.367071+0000","last_undegraded":"2023-10-08T07:10:28.367071+0000","last_fullsized":"2023-10-08T07:10:28.367071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:28.366970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:28.366970+0000","last_clean_scrub_stamp":"2023-10-08T07:10:28.366970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:27.637172+0000","scrub_duration":0.0029471160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"91'2","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:56.966275+0000","last_change":"2023-10-08T07:10:56.966328+0000","last_active":"2023-10-08T07:10:56.966275+0000","last_peered":"2023-10-08T07:10:56.966275+0000","last_clean":"2023-10-08T07:10:56.966275+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:10:56.966275+0000","last_undegraded":"2023-10-08T07:10:56.966275+0000","last_fullsized":"2023-10-08T07:10:56.966275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2023-10-08T07:10:56.966171+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2023-10-08T07:10:56.966171+0000","last_clean_scrub_stamp":"2023-10-08T07:10:56.966171+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:51:48.228389+0000","scrub_duration":0.0038520659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:03.716653+0000","last_change":"2023-10-08T07:11:03.716700+0000","last_active":"2023-10-08T07:11:03.716653+0000","last_peered":"2023-10-08T07:11:03.716653+0000","last_clean":"2023-10-08T07:11:03.716653+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:11:03.716653+0000","last_undegraded":"2023-10-08T07:11:03.716653+0000","last_fullsized":"2023-10-08T07:11:03.716653+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:03.716560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:03.716560+0000","last_clean_scrub_stamp":"2023-10-08T07:11:03.716560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:17.194562+0000","scrub_duration":0.0024862790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:01.721161+0000","last_change":"2023-10-08T07:10:01.721235+0000","last_active":"2023-10-08T07:10:01.721161+0000","last_peered":"2023-10-08T07:10:01.721161+0000","last_clean":"2023-10-08T07:10:01.721161+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:10:01.721161+0000","last_undegraded":"2023-10-08T07:10:01.721161+0000","last_fullsized":"2023-10-08T07:10:01.721161+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2023-10-08T07:10:01.721055+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2023-10-08T07:10:01.721055+0000","last_clean_scrub_stamp":"2023-10-08T07:10:01.721055+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:38.621496+0000","scrub_duration":0.0061286539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3009,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:03.673263+0000","last_change":"2023-10-08T07:10:03.673316+0000","last_active":"2023-10-08T07:10:03.673263+0000","last_peered":"2023-10-08T07:10:03.673263+0000","last_clean":"2023-10-08T07:10:03.673263+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:10:03.673263+0000","last_undegraded":"2023-10-08T07:10:03.673263+0000","last_fullsized":"2023-10-08T07:10:03.673263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2932","last_scrub_stamp":"2023-10-08T07:10:03.673166+0000","last_deep_scrub":"67'2932","last_deep_scrub_stamp":"2023-10-08T07:10:03.673166+0000","last_clean_scrub_stamp":"2023-10-08T07:10:03.673166+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:45:38.773848+0000","scrub_duration":0.0023330069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:26.956810+0000","last_change":"2023-10-08T07:10:26.956867+0000","last_active":"2023-10-08T07:10:26.956810+0000","last_peered":"2023-10-08T07:10:26.956810+0000","last_clean":"2023-10-08T07:10:26.956810+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:10:26.956810+0000","last_undegraded":"2023-10-08T07:10:26.956810+0000","last_fullsized":"2023-10-08T07:10:26.956810+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2023-10-08T07:10:26.956714+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2023-10-08T07:10:26.956714+0000","last_clean_scrub_stamp":"2023-10-08T07:10:26.956714+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:41.451138+0000","scrub_duration":0.0040178289999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2957,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:29.955939+0000","last_change":"2023-10-08T07:10:29.956001+0000","last_active":"2023-10-08T07:10:29.955939+0000","last_peered":"2023-10-08T07:10:29.955939+0000","last_clean":"2023-10-08T07:10:29.955939+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:10:29.955939+0000","last_undegraded":"2023-10-08T07:10:29.955939+0000","last_fullsized":"2023-10-08T07:10:29.955939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2863","last_scrub_stamp":"2023-10-08T07:10:29.955814+0000","last_deep_scrub":"67'2863","last_deep_scrub_stamp":"2023-10-08T07:10:29.955814+0000","last_clean_scrub_stamp":"2023-10-08T07:10:29.955814+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:43.985949+0000","scrub_duration":0.0033374920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498239+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:44.498239+0000","last_peered":"2023-10-08T07:09:44.498239+0000","last_clean":"2023-10-08T07:09:44.498239+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:44.498239+0000","last_undegraded":"2023-10-08T07:09:44.498239+0000","last_fullsized":"2023-10-08T07:09:44.498239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":3002,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.177449+0000","last_change":"2023-10-08T07:09:51.177449+0000","last_active":"2023-10-08T07:09:51.177449+0000","last_peered":"2023-10-08T07:09:51.177449+0000","last_clean":"2023-10-08T07:09:51.177449+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:51.177449+0000","last_undegraded":"2023-10-08T07:09:51.177449+0000","last_fullsized":"2023-10-08T07:09:51.177449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2908","last_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_deep_scrub":"67'2908","last_deep_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.177304+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:24.847471+0000","scrub_duration":0.0043549410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'4","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:01.413711+0000","last_change":"2023-10-08T07:11:01.413760+0000","last_active":"2023-10-08T07:11:01.413711+0000","last_peered":"2023-10-08T07:11:01.413711+0000","last_clean":"2023-10-08T07:11:01.413711+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:11:01.413711+0000","last_undegraded":"2023-10-08T07:11:01.413711+0000","last_fullsized":"2023-10-08T07:11:01.413711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:11:01.413615+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:11:01.413615+0000","last_clean_scrub_stamp":"2023-10-08T07:11:01.413615+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:07.522439+0000","scrub_duration":0.0035531170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5940,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.877374+0000","last_change":"2023-10-08T07:09:58.877374+0000","last_active":"2023-10-08T07:09:58.877374+0000","last_peered":"2023-10-08T07:09:58.877374+0000","last_clean":"2023-10-08T07:09:58.877374+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:58.877374+0000","last_undegraded":"2023-10-08T07:09:58.877374+0000","last_fullsized":"2023-10-08T07:09:58.877374+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5846","last_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_deep_scrub":"67'5846","last_deep_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.877221+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.287679+0000","scrub_duration":0.0031762159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:34.990831+0000","last_change":"2023-10-08T07:10:34.990887+0000","last_active":"2023-10-08T07:10:34.990831+0000","last_peered":"2023-10-08T07:10:34.990831+0000","last_clean":"2023-10-08T07:10:34.990831+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:10:34.990831+0000","last_undegraded":"2023-10-08T07:10:34.990831+0000","last_fullsized":"2023-10-08T07:10:34.990831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:34.990723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:34.990723+0000","last_clean_scrub_stamp":"2023-10-08T07:10:34.990723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:34.260924+0000","scrub_duration":0.0019640790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:37.996096+0000","last_change":"2023-10-08T07:10:37.996151+0000","last_active":"2023-10-08T07:10:37.996096+0000","last_peered":"2023-10-08T07:10:37.996096+0000","last_clean":"2023-10-08T07:10:37.996096+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:10:37.996096+0000","last_undegraded":"2023-10-08T07:10:37.996096+0000","last_fullsized":"2023-10-08T07:10:37.996096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:37.995993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:37.995993+0000","last_clean_scrub_stamp":"2023-10-08T07:10:37.995993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:06.897411+0000","scrub_duration":0.0020275480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742692+0000","last_change":"2023-10-08T07:09:17.752745+0000","last_active":"2023-10-08T07:09:36.742692+0000","last_peered":"2023-10-08T07:09:36.742692+0000","last_clean":"2023-10-08T07:09:36.742692+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:09:36.742692+0000","last_undegraded":"2023-10-08T07:09:36.742692+0000","last_fullsized":"2023-10-08T07:09:36.742692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5937,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498360+0000","last_change":"2023-10-08T07:09:21.040694+0000","last_active":"2023-10-08T07:09:44.498360+0000","last_peered":"2023-10-08T07:09:44.498360+0000","last_clean":"2023-10-08T07:09:44.498360+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:09:44.498360+0000","last_undegraded":"2023-10-08T07:09:44.498360+0000","last_fullsized":"2023-10-08T07:09:44.498360+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:45.649630+0000","last_change":"2023-10-08T07:10:45.649710+0000","last_active":"2023-10-08T07:10:45.649630+0000","last_peered":"2023-10-08T07:10:45.649630+0000","last_clean":"2023-10-08T07:10:45.649630+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:10:45.649630+0000","last_undegraded":"2023-10-08T07:10:45.649630+0000","last_fullsized":"2023-10-08T07:10:45.649630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:45.649532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:45.649532+0000","last_clean_scrub_stamp":"2023-10-08T07:10:45.649532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:26.132541+0000","scrub_duration":0.0019874580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2952,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534045+0000","last_change":"2023-10-08T07:09:21.042008+0000","last_active":"2023-10-08T07:09:45.534045+0000","last_peered":"2023-10-08T07:09:45.534045+0000","last_clean":"2023-10-08T07:09:45.534045+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:09:45.534045+0000","last_undegraded":"2023-10-08T07:09:45.534045+0000","last_fullsized":"2023-10-08T07:09:45.534045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:53.453324+0000","last_change":"2023-10-08T07:10:53.453369+0000","last_active":"2023-10-08T07:10:53.453324+0000","last_peered":"2023-10-08T07:10:53.453324+0000","last_clean":"2023-10-08T07:10:53.453324+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:10:53.453324+0000","last_undegraded":"2023-10-08T07:10:53.453324+0000","last_fullsized":"2023-10-08T07:10:53.453324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:53.453181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:53.453181+0000","last_clean_scrub_stamp":"2023-10-08T07:10:53.453181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:27.290354+0000","scrub_duration":0.002075145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:18.987300+0000","last_change":"2023-10-08T07:10:18.987348+0000","last_active":"2023-10-08T07:10:18.987300+0000","last_peered":"2023-10-08T07:10:18.987300+0000","last_clean":"2023-10-08T07:10:18.987300+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:10:18.987300+0000","last_undegraded":"2023-10-08T07:10:18.987300+0000","last_fullsized":"2023-10-08T07:10:18.987300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:18.987171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:18.987171+0000","last_clean_scrub_stamp":"2023-10-08T07:10:18.987171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:50.612213+0000","scrub_duration":0.0022629809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5860,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:25.718146+0000","last_change":"2023-10-08T07:10:25.718202+0000","last_active":"2023-10-08T07:10:25.718146+0000","last_peered":"2023-10-08T07:10:25.718146+0000","last_clean":"2023-10-08T07:10:25.718146+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:10:25.718146+0000","last_undegraded":"2023-10-08T07:10:25.718146+0000","last_fullsized":"2023-10-08T07:10:25.718146+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5777","last_scrub_stamp":"2023-10-08T07:10:25.718038+0000","last_deep_scrub":"67'5777","last_deep_scrub_stamp":"2023-10-08T07:10:25.718038+0000","last_clean_scrub_stamp":"2023-10-08T07:10:25.718038+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:11.338172+0000","scrub_duration":0.0025969640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:37.000081+0000","last_change":"2023-10-08T07:05:27.292759+0000","last_active":"2023-10-08T07:09:37.000081+0000","last_peered":"2023-10-08T07:09:37.000081+0000","last_clean":"2023-10-08T07:09:37.000081+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:09:37.000081+0000","last_undegraded":"2023-10-08T07:09:37.000081+0000","last_fullsized":"2023-10-08T07:09:37.000081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:47.997985+0000","last_change":"2023-10-08T07:10:47.998055+0000","last_active":"2023-10-08T07:10:47.997985+0000","last_peered":"2023-10-08T07:10:47.997985+0000","last_clean":"2023-10-08T07:10:47.997985+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:10:47.997985+0000","last_undegraded":"2023-10-08T07:10:47.997985+0000","last_fullsized":"2023-10-08T07:10:47.997985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:47.997873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:47.997873+0000","last_clean_scrub_stamp":"2023-10-08T07:10:47.997873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:35.775296+0000","scrub_duration":0.0020812069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2960,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928399+0000","last_change":"2023-10-08T07:09:21.040185+0000","last_active":"2023-10-08T07:09:44.928399+0000","last_peered":"2023-10-08T07:09:44.928399+0000","last_clean":"2023-10-08T07:09:44.928399+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:09:44.928399+0000","last_undegraded":"2023-10-08T07:09:44.928399+0000","last_fullsized":"2023-10-08T07:09:44.928399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.424913+0000","last_change":"2023-10-08T07:10:36.424976+0000","last_active":"2023-10-08T07:10:36.424913+0000","last_peered":"2023-10-08T07:10:36.424913+0000","last_clean":"2023-10-08T07:10:36.424913+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:10:36.424913+0000","last_undegraded":"2023-10-08T07:10:36.424913+0000","last_fullsized":"2023-10-08T07:10:36.424913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:36.424768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:36.424768+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.424768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:46.936565+0000","scrub_duration":0.001635028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:04.640794+0000","last_change":"2023-10-08T07:10:04.640857+0000","last_active":"2023-10-08T07:10:04.640794+0000","last_peered":"2023-10-08T07:10:04.640794+0000","last_clean":"2023-10-08T07:10:04.640794+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:10:04.640794+0000","last_undegraded":"2023-10-08T07:10:04.640794+0000","last_fullsized":"2023-10-08T07:10:04.640794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:04.640672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:04.640672+0000","last_clean_scrub_stamp":"2023-10-08T07:10:04.640672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:31:07.525494+0000","scrub_duration":0.002134164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8919,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533998+0000","last_change":"2023-10-08T07:09:21.042220+0000","last_active":"2023-10-08T07:09:45.533998+0000","last_peered":"2023-10-08T07:09:45.533998+0000","last_clean":"2023-10-08T07:09:45.533998+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:09:45.533998+0000","last_undegraded":"2023-10-08T07:09:45.533998+0000","last_fullsized":"2023-10-08T07:09:45.533998+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:39.702099+0000","last_change":"2023-10-08T07:05:27.293075+0000","last_active":"2023-10-08T07:09:39.702099+0000","last_peered":"2023-10-08T07:09:39.702099+0000","last_clean":"2023-10-08T07:09:39.702099+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:09:39.702099+0000","last_undegraded":"2023-10-08T07:09:39.702099+0000","last_fullsized":"2023-10-08T07:09:39.702099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"91'159","reported_seq":310,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:02.005039+0000","last_change":"2023-10-08T07:11:02.005133+0000","last_active":"2023-10-08T07:11:02.005039+0000","last_peered":"2023-10-08T07:11:02.005039+0000","last_clean":"2023-10-08T07:11:02.005039+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:11:02.005039+0000","last_undegraded":"2023-10-08T07:11:02.005039+0000","last_fullsized":"2023-10-08T07:11:02.005039+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'159","last_scrub_stamp":"2023-10-08T07:11:02.004931+0000","last_deep_scrub":"91'159","last_deep_scrub_stamp":"2023-10-08T07:11:02.004931+0000","last_clean_scrub_stamp":"2023-10-08T07:11:02.004931+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:07.761573+0000","scrub_duration":0.0067731960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:14.490905+0000","last_change":"2023-10-08T07:10:14.490962+0000","last_active":"2023-10-08T07:10:14.490905+0000","last_peered":"2023-10-08T07:10:14.490905+0000","last_clean":"2023-10-08T07:10:14.490905+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:10:14.490905+0000","last_undegraded":"2023-10-08T07:10:14.490905+0000","last_fullsized":"2023-10-08T07:10:14.490905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:14.490798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:14.490798+0000","last_clean_scrub_stamp":"2023-10-08T07:10:14.490798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:50.710326+0000","scrub_duration":0.0018705449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5904,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498255+0000","last_change":"2023-10-08T07:09:21.040684+0000","last_active":"2023-10-08T07:09:44.498255+0000","last_peered":"2023-10-08T07:09:44.498255+0000","last_clean":"2023-10-08T07:09:44.498255+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:09:44.498255+0000","last_undegraded":"2023-10-08T07:09:44.498255+0000","last_fullsized":"2023-10-08T07:09:44.498255+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110453+0000","last_change":"2023-10-08T07:09:18.051593+0000","last_active":"2023-10-08T07:09:36.110453+0000","last_peered":"2023-10-08T07:09:36.110453+0000","last_clean":"2023-10-08T07:09:36.110453+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:09:36.110453+0000","last_undegraded":"2023-10-08T07:09:36.110453+0000","last_fullsized":"2023-10-08T07:09:36.110453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109394+0000","last_change":"2023-10-08T07:09:25.038493+0000","last_active":"2023-10-08T07:09:36.109394+0000","last_peered":"2023-10-08T07:09:36.109394+0000","last_clean":"2023-10-08T07:09:36.109394+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:09:36.109394+0000","last_undegraded":"2023-10-08T07:09:36.109394+0000","last_fullsized":"2023-10-08T07:09:36.109394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:22.766176+0000","last_change":"2023-10-08T07:10:22.766221+0000","last_active":"2023-10-08T07:10:22.766176+0000","last_peered":"2023-10-08T07:10:22.766176+0000","last_clean":"2023-10-08T07:10:22.766176+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:10:22.766176+0000","last_undegraded":"2023-10-08T07:10:22.766176+0000","last_fullsized":"2023-10-08T07:10:22.766176+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:22.766075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:22.766075+0000","last_clean_scrub_stamp":"2023-10-08T07:10:22.766075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:57.867526+0000","scrub_duration":0.0019628810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:59.745960+0000","last_change":"2023-10-08T07:09:59.746038+0000","last_active":"2023-10-08T07:09:59.745960+0000","last_peered":"2023-10-08T07:09:59.745960+0000","last_clean":"2023-10-08T07:09:59.745960+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:59.745960+0000","last_undegraded":"2023-10-08T07:09:59.745960+0000","last_fullsized":"2023-10-08T07:09:59.745960+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_clean_scrub_stamp":"2023-10-08T07:09:59.745834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:05.711715+0000","scrub_duration":0.002070012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:31.391524+0000","last_change":"2023-10-08T07:10:31.391575+0000","last_active":"2023-10-08T07:10:31.391524+0000","last_peered":"2023-10-08T07:10:31.391524+0000","last_clean":"2023-10-08T07:10:31.391524+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:10:31.391524+0000","last_undegraded":"2023-10-08T07:10:31.391524+0000","last_fullsized":"2023-10-08T07:10:31.391524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:31.391414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:31.391414+0000","last_clean_scrub_stamp":"2023-10-08T07:10:31.391414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:58.361849+0000","scrub_duration":0.001953729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:05.747132+0000","last_change":"2023-10-08T07:11:05.747198+0000","last_active":"2023-10-08T07:11:05.747132+0000","last_peered":"2023-10-08T07:11:05.747132+0000","last_clean":"2023-10-08T07:11:05.747132+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:11:05.747132+0000","last_undegraded":"2023-10-08T07:11:05.747132+0000","last_fullsized":"2023-10-08T07:11:05.747132+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:05.747028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:05.747028+0000","last_clean_scrub_stamp":"2023-10-08T07:11:05.747028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:48.021225+0000","scrub_duration":0.0025933689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'3","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533799+0000","last_change":"2023-10-08T07:09:18.059238+0000","last_active":"2023-10-08T07:09:45.533799+0000","last_peered":"2023-10-08T07:09:45.533799+0000","last_clean":"2023-10-08T07:09:45.533799+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:09:45.533799+0000","last_undegraded":"2023-10-08T07:09:45.533799+0000","last_fullsized":"2023-10-08T07:09:45.533799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:38.461564+0000","last_change":"2023-10-08T07:10:38.461609+0000","last_active":"2023-10-08T07:10:38.461564+0000","last_peered":"2023-10-08T07:10:38.461564+0000","last_clean":"2023-10-08T07:10:38.461564+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:10:38.461564+0000","last_undegraded":"2023-10-08T07:10:38.461564+0000","last_fullsized":"2023-10-08T07:10:38.461564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:38.461431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:38.461431+0000","last_clean_scrub_stamp":"2023-10-08T07:10:38.461431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:09.555421+0000","scrub_duration":0.001628572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2997,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:52.224898+0000","last_change":"2023-10-08T07:09:52.224944+0000","last_active":"2023-10-08T07:09:52.224898+0000","last_peered":"2023-10-08T07:09:52.224898+0000","last_clean":"2023-10-08T07:09:52.224898+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:52.224898+0000","last_undegraded":"2023-10-08T07:09:52.224898+0000","last_fullsized":"2023-10-08T07:09:52.224898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2903","last_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_deep_scrub":"67'2903","last_deep_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_clean_scrub_stamp":"2023-10-08T07:09:52.224790+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:46.117778+0000","scrub_duration":0.0028885249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498016+0000","last_change":"2023-10-08T07:09:18.054661+0000","last_active":"2023-10-08T07:09:44.498016+0000","last_peered":"2023-10-08T07:09:44.498016+0000","last_clean":"2023-10-08T07:09:44.498016+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:09:44.498016+0000","last_undegraded":"2023-10-08T07:09:44.498016+0000","last_fullsized":"2023-10-08T07:09:44.498016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:26.281219+0000","last_clean_scrub_stamp":"2023-10-08T07:05:26.281219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"91'10","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:03.449585+0000","last_change":"2023-10-08T07:11:03.449648+0000","last_active":"2023-10-08T07:11:03.449585+0000","last_peered":"2023-10-08T07:11:03.449585+0000","last_clean":"2023-10-08T07:11:03.449585+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:11:03.449585+0000","last_undegraded":"2023-10-08T07:11:03.449585+0000","last_fullsized":"2023-10-08T07:11:03.449585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2023-10-08T07:11:03.449489+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2023-10-08T07:11:03.449489+0000","last_clean_scrub_stamp":"2023-10-08T07:11:03.449489+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:26.149116+0000","scrub_duration":0.003637454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2971,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.619710+0000","last_change":"2023-10-08T07:10:36.619759+0000","last_active":"2023-10-08T07:10:36.619710+0000","last_peered":"2023-10-08T07:10:36.619710+0000","last_clean":"2023-10-08T07:10:36.619710+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:10:36.619710+0000","last_undegraded":"2023-10-08T07:10:36.619710+0000","last_fullsized":"2023-10-08T07:10:36.619710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2894","last_scrub_stamp":"2023-10-08T07:10:36.619619+0000","last_deep_scrub":"67'2894","last_deep_scrub_stamp":"2023-10-08T07:10:36.619619+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.619619+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:03.016252+0000","scrub_duration":0.0024615819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:53.800092+0000","last_change":"2023-10-08T07:09:53.800170+0000","last_active":"2023-10-08T07:09:53.800092+0000","last_peered":"2023-10-08T07:09:53.800092+0000","last_clean":"2023-10-08T07:09:53.800092+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:53.800092+0000","last_undegraded":"2023-10-08T07:09:53.800092+0000","last_fullsized":"2023-10-08T07:09:53.800092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_clean_scrub_stamp":"2023-10-08T07:09:53.799979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:11.628567+0000","scrub_duration":0.0021863500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.743146+0000","last_change":"2023-10-08T07:09:24.732784+0000","last_active":"2023-10-08T07:09:36.743146+0000","last_peered":"2023-10-08T07:09:36.743146+0000","last_clean":"2023-10-08T07:09:36.743146+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:09:36.743146+0000","last_undegraded":"2023-10-08T07:09:36.743146+0000","last_fullsized":"2023-10-08T07:09:36.743146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110970+0000","last_change":"2023-10-08T07:09:23.066235+0000","last_active":"2023-10-08T07:09:36.110970+0000","last_peered":"2023-10-08T07:09:36.110970+0000","last_clean":"2023-10-08T07:09:36.110970+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:09:36.110970+0000","last_undegraded":"2023-10-08T07:09:36.110970+0000","last_fullsized":"2023-10-08T07:09:36.110970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5900,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:25.908075+0000","last_change":"2023-10-08T07:10:25.908075+0000","last_active":"2023-10-08T07:10:25.908075+0000","last_peered":"2023-10-08T07:10:25.908075+0000","last_clean":"2023-10-08T07:10:25.908075+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:10:25.908075+0000","last_undegraded":"2023-10-08T07:10:25.908075+0000","last_fullsized":"2023-10-08T07:10:25.908075+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5806","last_scrub_stamp":"2023-10-08T07:10:25.907915+0000","last_deep_scrub":"67'5806","last_deep_scrub_stamp":"2023-10-08T07:10:25.907915+0000","last_clean_scrub_stamp":"2023-10-08T07:10:25.907915+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:33.667782+0000","scrub_duration":0.0029813180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"91'4","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:58.746498+0000","last_change":"2023-10-08T07:10:58.746571+0000","last_active":"2023-10-08T07:10:58.746498+0000","last_peered":"2023-10-08T07:10:58.746498+0000","last_clean":"2023-10-08T07:10:58.746498+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:10:58.746498+0000","last_undegraded":"2023-10-08T07:10:58.746498+0000","last_fullsized":"2023-10-08T07:10:58.746498+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:10:58.746368+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:10:58.746368+0000","last_clean_scrub_stamp":"2023-10-08T07:10:58.746368+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:25:49.547384+0000","scrub_duration":0.0037535310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3011,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498397+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:44.498397+0000","last_peered":"2023-10-08T07:09:44.498397+0000","last_clean":"2023-10-08T07:09:44.498397+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:44.498397+0000","last_undegraded":"2023-10-08T07:09:44.498397+0000","last_fullsized":"2023-10-08T07:09:44.498397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:18.452697+0000","last_change":"2023-10-08T07:10:18.452754+0000","last_active":"2023-10-08T07:10:18.452697+0000","last_peered":"2023-10-08T07:10:18.452697+0000","last_clean":"2023-10-08T07:10:18.452697+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:10:18.452697+0000","last_undegraded":"2023-10-08T07:10:18.452697+0000","last_fullsized":"2023-10-08T07:10:18.452697+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:10:18.452579+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:10:18.452579+0000","last_clean_scrub_stamp":"2023-10-08T07:10:18.452579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:51.487483+0000","scrub_duration":0.0019171150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5880,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:00.754545+0000","last_change":"2023-10-08T07:10:00.754601+0000","last_active":"2023-10-08T07:10:00.754545+0000","last_peered":"2023-10-08T07:10:00.754545+0000","last_clean":"2023-10-08T07:10:00.754545+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:10:00.754545+0000","last_undegraded":"2023-10-08T07:10:00.754545+0000","last_fullsized":"2023-10-08T07:10:00.754545+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5794","last_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_deep_scrub":"67'5794","last_deep_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_clean_scrub_stamp":"2023-10-08T07:10:00.754451+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:41.308685+0000","scrub_duration":0.0023848570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:06.392046+0000","last_change":"2023-10-08T07:10:06.392100+0000","last_active":"2023-10-08T07:10:06.392046+0000","last_peered":"2023-10-08T07:10:06.392046+0000","last_clean":"2023-10-08T07:10:06.392046+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:10:06.392046+0000","last_undegraded":"2023-10-08T07:10:06.392046+0000","last_fullsized":"2023-10-08T07:10:06.392046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2023-10-08T07:10:06.391949+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2023-10-08T07:10:06.391949+0000","last_clean_scrub_stamp":"2023-10-08T07:10:06.391949+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:18.322702+0000","scrub_duration":0.005184073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:17.009849+0000","last_change":"2023-10-08T07:10:17.009849+0000","last_active":"2023-10-08T07:10:17.009849+0000","last_peered":"2023-10-08T07:10:17.009849+0000","last_clean":"2023-10-08T07:10:17.009849+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:10:17.009849+0000","last_undegraded":"2023-10-08T07:10:17.009849+0000","last_fullsized":"2023-10-08T07:10:17.009849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:10:17.009657+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:10:17.009657+0000","last_clean_scrub_stamp":"2023-10-08T07:10:17.009657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:59:07.822088+0000","scrub_duration":0.0028116880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8817,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:35.984320+0000","last_change":"2023-10-08T07:10:35.984376+0000","last_active":"2023-10-08T07:10:35.984320+0000","last_peered":"2023-10-08T07:10:35.984320+0000","last_clean":"2023-10-08T07:10:35.984320+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:10:35.984320+0000","last_undegraded":"2023-10-08T07:10:35.984320+0000","last_fullsized":"2023-10-08T07:10:35.984320+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8723","last_scrub_stamp":"2023-10-08T07:10:35.984180+0000","last_deep_scrub":"67'8723","last_deep_scrub_stamp":"2023-10-08T07:10:35.984180+0000","last_clean_scrub_stamp":"2023-10-08T07:10:35.984180+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:35:02.954615+0000","scrub_duration":0.0034636020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3003,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928301+0000","last_change":"2023-10-08T07:09:21.036530+0000","last_active":"2023-10-08T07:09:44.928301+0000","last_peered":"2023-10-08T07:09:44.928301+0000","last_clean":"2023-10-08T07:09:44.928301+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:09:44.928301+0000","last_undegraded":"2023-10-08T07:09:44.928301+0000","last_fullsized":"2023-10-08T07:09:44.928301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:04.731750+0000","last_change":"2023-10-08T07:11:04.731839+0000","last_active":"2023-10-08T07:11:04.731750+0000","last_peered":"2023-10-08T07:11:04.731750+0000","last_clean":"2023-10-08T07:11:04.731750+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:11:04.731750+0000","last_undegraded":"2023-10-08T07:11:04.731750+0000","last_fullsized":"2023-10-08T07:11:04.731750+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2023-10-08T07:11:04.731603+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2023-10-08T07:11:04.731603+0000","last_clean_scrub_stamp":"2023-10-08T07:11:04.731603+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:54:15.076074+0000","scrub_duration":0.0027692070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:55.216862+0000","last_change":"2023-10-08T07:09:55.216924+0000","last_active":"2023-10-08T07:09:55.216862+0000","last_peered":"2023-10-08T07:09:55.216862+0000","last_clean":"2023-10-08T07:09:55.216862+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:55.216862+0000","last_undegraded":"2023-10-08T07:09:55.216862+0000","last_fullsized":"2023-10-08T07:09:55.216862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_clean_scrub_stamp":"2023-10-08T07:09:55.216748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:14.264100+0000","scrub_duration":0.001903205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2975,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.742216+0000","last_change":"2023-10-08T07:09:20.735423+0000","last_active":"2023-10-08T07:09:36.742216+0000","last_peered":"2023-10-08T07:09:36.742216+0000","last_clean":"2023-10-08T07:09:36.742216+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:09:36.742216+0000","last_undegraded":"2023-10-08T07:09:36.742216+0000","last_fullsized":"2023-10-08T07:09:36.742216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738440,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595760,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776080,"statfs":{"total":96636764160,"available":96026705920,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.60199999999999998,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.188,"15min":0.188},"max":{"1min":0.65400000000000003,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.60599999999999998,"15min":0.50600000000000001},"min":{"1min":0.31,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58399999999999996,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.41399999999999998}]},{"osd":1,"last update":"Sun Oct 8 07:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.33700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483908,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887932,"statfs":{"total":96636764160,"available":96141242368,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.373}]},{"osd":2,"last update":"Sun Oct 8 07:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54700000000000004,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.63100000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.497,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.65700000000000003,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.65700000000000003}]}]},{"osd":1,"up_from":74,"seq":317827579928,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":1712,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":1753088,"data_stored":1220245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.53700000000000003}]},{"osd":2,"last update":"Sun Oct 8 07:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.499},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.048,"5min":3.048,"15min":3.048},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:11:07.487 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.487 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.487 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.488 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.488 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.488 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.488 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.488 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.488 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.488 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.489 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.489 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.489 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.489 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.489 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.489 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.490 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.490 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.490 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.490 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.490 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.490 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.491 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.491 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.491 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.491 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.491 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.491 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-08T07:05:26.281219+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=26, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.491 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.493 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.493 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.493 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.493 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:07.493 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:11:27.494 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:11:27.853 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:11:27.854 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:11:27.864 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2023-10-08T07:11:26.596813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149205,"ondisk_log_size":149205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145004,"kb_used_data":4308,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970516,"statfs":{"total":289910292480,"available":288737808384,"internally_reserved":0,"allocated":4411392,"data_stored":2817910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002859"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":3001,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.014154+0000","last_change":"2023-10-08T07:09:20.737777+0000","last_active":"2023-10-08T07:09:45.014154+0000","last_peered":"2023-10-08T07:09:45.014154+0000","last_clean":"2023-10-08T07:09:45.014154+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:09:45.014154+0000","last_undegraded":"2023-10-08T07:09:45.014154+0000","last_fullsized":"2023-10-08T07:09:45.014154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2910,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:46.756403+0000","last_change":"2023-10-08T07:09:46.756403+0000","last_active":"2023-10-08T07:09:46.756403+0000","last_peered":"2023-10-08T07:09:46.756403+0000","last_clean":"2023-10-08T07:09:46.756403+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:46.756403+0000","last_undegraded":"2023-10-08T07:09:46.756403+0000","last_fullsized":"2023-10-08T07:09:46.756403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2832","last_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_deep_scrub":"67'2832","last_deep_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_clean_scrub_stamp":"2023-10-08T07:09:46.756167+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:46.978745+0000","scrub_duration":0.0030689100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:01.902591+0000","last_change":"2023-10-08T07:10:01.902641+0000","last_active":"2023-10-08T07:10:01.902591+0000","last_peered":"2023-10-08T07:10:01.902591+0000","last_clean":"2023-10-08T07:10:01.902591+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:10:01.902591+0000","last_undegraded":"2023-10-08T07:10:01.902591+0000","last_fullsized":"2023-10-08T07:10:01.902591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:01.902474+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:01.902474+0000","last_clean_scrub_stamp":"2023-10-08T07:10:01.902474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:20.949826+0000","scrub_duration":0.001921706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:08.963077+0000","last_change":"2023-10-08T07:10:08.963139+0000","last_active":"2023-10-08T07:10:08.963077+0000","last_peered":"2023-10-08T07:10:08.963077+0000","last_clean":"2023-10-08T07:10:08.963077+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:10:08.963077+0000","last_undegraded":"2023-10-08T07:10:08.963077+0000","last_fullsized":"2023-10-08T07:10:08.963077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:08.962981+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:08.962981+0000","last_clean_scrub_stamp":"2023-10-08T07:10:08.962981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:20.893734+0000","scrub_duration":0.0026257540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5898,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:44.651559+0000","last_change":"2023-10-08T07:10:44.651612+0000","last_active":"2023-10-08T07:10:44.651559+0000","last_peered":"2023-10-08T07:10:44.651559+0000","last_clean":"2023-10-08T07:10:44.651559+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:10:44.651559+0000","last_undegraded":"2023-10-08T07:10:44.651559+0000","last_fullsized":"2023-10-08T07:10:44.651559+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5815","last_scrub_stamp":"2023-10-08T07:10:44.651463+0000","last_deep_scrub":"67'5815","last_deep_scrub_stamp":"2023-10-08T07:10:44.651463+0000","last_clean_scrub_stamp":"2023-10-08T07:10:44.651463+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:50.033791+0000","scrub_duration":0.0026907989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8581,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:06.916355+0000","last_change":"2023-10-08T07:10:06.916355+0000","last_active":"2023-10-08T07:10:06.916355+0000","last_peered":"2023-10-08T07:10:06.916355+0000","last_clean":"2023-10-08T07:10:06.916355+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:10:06.916355+0000","last_undegraded":"2023-10-08T07:10:06.916355+0000","last_fullsized":"2023-10-08T07:10:06.916355+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8487","last_scrub_stamp":"2023-10-08T07:10:06.916118+0000","last_deep_scrub":"67'8487","last_deep_scrub_stamp":"2023-10-08T07:10:06.916118+0000","last_clean_scrub_stamp":"2023-10-08T07:10:06.916118+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:55:34.602055+0000","scrub_duration":0.0043577499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.809212+0000","last_change":"2023-10-08T07:09:50.809212+0000","last_active":"2023-10-08T07:09:50.809212+0000","last_peered":"2023-10-08T07:09:50.809212+0000","last_clean":"2023-10-08T07:09:50.809212+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:50.809212+0000","last_undegraded":"2023-10-08T07:09:50.809212+0000","last_fullsized":"2023-10-08T07:09:50.809212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.808986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:57.252774+0000","scrub_duration":0.0027253220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3041,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498596+0000","last_change":"2023-10-08T07:09:28.078167+0000","last_active":"2023-10-08T07:09:44.498596+0000","last_peered":"2023-10-08T07:09:44.498596+0000","last_clean":"2023-10-08T07:09:44.498596+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:09:44.498596+0000","last_undegraded":"2023-10-08T07:09:44.498596+0000","last_fullsized":"2023-10-08T07:09:44.498596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2893,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:48.261144+0000","last_change":"2023-10-08T07:09:48.261144+0000","last_active":"2023-10-08T07:09:48.261144+0000","last_peered":"2023-10-08T07:09:48.261144+0000","last_clean":"2023-10-08T07:09:48.261144+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:48.261144+0000","last_undegraded":"2023-10-08T07:09:48.261144+0000","last_fullsized":"2023-10-08T07:09:48.261144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2779","last_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_deep_scrub":"67'2779","last_deep_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_clean_scrub_stamp":"2023-10-08T07:09:48.260984+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:35.661462+0000","scrub_duration":0.0021476020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2965,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:15.720306+0000","last_change":"2023-10-08T07:11:15.720366+0000","last_active":"2023-10-08T07:11:15.720306+0000","last_peered":"2023-10-08T07:11:15.720306+0000","last_clean":"2023-10-08T07:11:15.720306+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:11:15.720306+0000","last_undegraded":"2023-10-08T07:11:15.720306+0000","last_fullsized":"2023-10-08T07:11:15.720306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2888","last_scrub_stamp":"2023-10-08T07:11:15.720178+0000","last_deep_scrub":"67'2888","last_deep_scrub_stamp":"2023-10-08T07:11:15.720178+0000","last_clean_scrub_stamp":"2023-10-08T07:11:15.720178+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:50.380873+0000","scrub_duration":0.0025953560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110966+0000","last_change":"2023-10-08T07:09:23.063882+0000","last_active":"2023-10-08T07:09:36.110966+0000","last_peered":"2023-10-08T07:09:36.110966+0000","last_clean":"2023-10-08T07:09:36.110966+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:09:36.110966+0000","last_undegraded":"2023-10-08T07:09:36.110966+0000","last_fullsized":"2023-10-08T07:09:36.110966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2970,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.799105+0000","last_change":"2023-10-08T07:09:51.799195+0000","last_active":"2023-10-08T07:09:51.799105+0000","last_peered":"2023-10-08T07:09:51.799105+0000","last_clean":"2023-10-08T07:09:51.799105+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:51.799105+0000","last_undegraded":"2023-10-08T07:09:51.799105+0000","last_fullsized":"2023-10-08T07:09:51.799105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2893","last_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_deep_scrub":"67'2893","last_deep_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.798991+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:39.037371+0000","scrub_duration":0.0024056889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:27.710762+0000","last_change":"2023-10-08T07:10:27.710809+0000","last_active":"2023-10-08T07:10:27.710762+0000","last_peered":"2023-10-08T07:10:27.710762+0000","last_clean":"2023-10-08T07:10:27.710762+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:10:27.710762+0000","last_undegraded":"2023-10-08T07:10:27.710762+0000","last_fullsized":"2023-10-08T07:10:27.710762+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:27.710670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:27.710670+0000","last_clean_scrub_stamp":"2023-10-08T07:10:27.710670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:51.076837+0000","scrub_duration":0.002419591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2979,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498596+0000","last_change":"2023-10-08T07:09:21.040638+0000","last_active":"2023-10-08T07:09:44.498596+0000","last_peered":"2023-10-08T07:09:44.498596+0000","last_clean":"2023-10-08T07:09:44.498596+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:09:44.498596+0000","last_undegraded":"2023-10-08T07:09:44.498596+0000","last_fullsized":"2023-10-08T07:09:44.498596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5867,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110557+0000","last_change":"2023-10-08T07:09:26.042339+0000","last_active":"2023-10-08T07:09:36.110557+0000","last_peered":"2023-10-08T07:09:36.110557+0000","last_clean":"2023-10-08T07:09:36.110557+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:09:36.110557+0000","last_undegraded":"2023-10-08T07:09:36.110557+0000","last_fullsized":"2023-10-08T07:09:36.110557+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2992,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:54.975424+0000","last_change":"2023-10-08T07:10:54.975485+0000","last_active":"2023-10-08T07:10:54.975424+0000","last_peered":"2023-10-08T07:10:54.975424+0000","last_clean":"2023-10-08T07:10:54.975424+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:10:54.975424+0000","last_undegraded":"2023-10-08T07:10:54.975424+0000","last_fullsized":"2023-10-08T07:10:54.975424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2898","last_scrub_stamp":"2023-10-08T07:10:54.975318+0000","last_deep_scrub":"67'2898","last_deep_scrub_stamp":"2023-10-08T07:10:54.975318+0000","last_clean_scrub_stamp":"2023-10-08T07:10:54.975318+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:44.044191+0000","scrub_duration":0.0030843680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2983,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534220+0000","last_change":"2023-10-08T07:09:21.041706+0000","last_active":"2023-10-08T07:09:45.534220+0000","last_peered":"2023-10-08T07:09:45.534220+0000","last_clean":"2023-10-08T07:09:45.534220+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:09:45.534220+0000","last_undegraded":"2023-10-08T07:09:45.534220+0000","last_fullsized":"2023-10-08T07:09:45.534220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:54.718681+0000","last_change":"2023-10-08T07:10:54.718730+0000","last_active":"2023-10-08T07:10:54.718681+0000","last_peered":"2023-10-08T07:10:54.718681+0000","last_clean":"2023-10-08T07:10:54.718681+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:10:54.718681+0000","last_undegraded":"2023-10-08T07:10:54.718681+0000","last_fullsized":"2023-10-08T07:10:54.718681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:54.718583+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:54.718583+0000","last_clean_scrub_stamp":"2023-10-08T07:10:54.718583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:36.200157+0000","scrub_duration":0.002087308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2964,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534210+0000","last_change":"2023-10-08T07:09:21.039966+0000","last_active":"2023-10-08T07:09:45.534210+0000","last_peered":"2023-10-08T07:09:45.534210+0000","last_clean":"2023-10-08T07:09:45.534210+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:09:45.534210+0000","last_undegraded":"2023-10-08T07:09:45.534210+0000","last_fullsized":"2023-10-08T07:09:45.534210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2983,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:17.967333+0000","last_change":"2023-10-08T07:10:17.967390+0000","last_active":"2023-10-08T07:10:17.967333+0000","last_peered":"2023-10-08T07:10:17.967333+0000","last_clean":"2023-10-08T07:10:17.967333+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:10:17.967333+0000","last_undegraded":"2023-10-08T07:10:17.967333+0000","last_fullsized":"2023-10-08T07:10:17.967333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2889","last_scrub_stamp":"2023-10-08T07:10:17.967218+0000","last_deep_scrub":"67'2889","last_deep_scrub_stamp":"2023-10-08T07:10:17.967218+0000","last_clean_scrub_stamp":"2023-10-08T07:10:17.967218+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:31.882860+0000","scrub_duration":0.003096765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5902,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:50.041003+0000","last_change":"2023-10-08T07:10:50.041061+0000","last_active":"2023-10-08T07:10:50.041003+0000","last_peered":"2023-10-08T07:10:50.041003+0000","last_clean":"2023-10-08T07:10:50.041003+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:10:50.041003+0000","last_undegraded":"2023-10-08T07:10:50.041003+0000","last_fullsized":"2023-10-08T07:10:50.041003+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5808","last_scrub_stamp":"2023-10-08T07:10:50.040881+0000","last_deep_scrub":"67'5808","last_deep_scrub_stamp":"2023-10-08T07:10:50.040881+0000","last_clean_scrub_stamp":"2023-10-08T07:10:50.040881+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:24.160061+0000","scrub_duration":0.0032418830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2885,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:15.676032+0000","last_change":"2023-10-08T07:10:15.676084+0000","last_active":"2023-10-08T07:10:15.676032+0000","last_peered":"2023-10-08T07:10:15.676032+0000","last_clean":"2023-10-08T07:10:15.676032+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:10:15.676032+0000","last_undegraded":"2023-10-08T07:10:15.676032+0000","last_fullsized":"2023-10-08T07:10:15.676032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2808","last_scrub_stamp":"2023-10-08T07:10:15.675928+0000","last_deep_scrub":"67'2808","last_deep_scrub_stamp":"2023-10-08T07:10:15.675928+0000","last_clean_scrub_stamp":"2023-10-08T07:10:15.675928+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:38.425941+0000","scrub_duration":0.00268585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2991,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:49.238913+0000","last_change":"2023-10-08T07:09:49.238913+0000","last_active":"2023-10-08T07:09:49.238913+0000","last_peered":"2023-10-08T07:09:49.238913+0000","last_clean":"2023-10-08T07:09:49.238913+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:49.238913+0000","last_undegraded":"2023-10-08T07:09:49.238913+0000","last_fullsized":"2023-10-08T07:09:49.238913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2897","last_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_deep_scrub":"67'2897","last_deep_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_clean_scrub_stamp":"2023-10-08T07:09:49.238678+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:45:50.648559+0000","scrub_duration":0.0033918249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5847,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.780269+0000","last_change":"2023-10-08T07:09:58.780269+0000","last_active":"2023-10-08T07:09:58.780269+0000","last_peered":"2023-10-08T07:09:58.780269+0000","last_clean":"2023-10-08T07:09:58.780269+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:58.780269+0000","last_undegraded":"2023-10-08T07:09:58.780269+0000","last_fullsized":"2023-10-08T07:09:58.780269+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5763","last_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_deep_scrub":"67'5763","last_deep_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.780116+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:40.304910+0000","scrub_duration":0.0028329620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2966,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:20.660569+0000","last_change":"2023-10-08T07:11:20.660569+0000","last_active":"2023-10-08T07:11:20.660569+0000","last_peered":"2023-10-08T07:11:20.660569+0000","last_clean":"2023-10-08T07:11:20.660569+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:11:20.660569+0000","last_undegraded":"2023-10-08T07:11:20.660569+0000","last_fullsized":"2023-10-08T07:11:20.660569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2888","last_scrub_stamp":"2023-10-08T07:11:20.660364+0000","last_deep_scrub":"67'2888","last_deep_scrub_stamp":"2023-10-08T07:11:20.660364+0000","last_clean_scrub_stamp":"2023-10-08T07:11:20.660364+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:40.092072+0000","scrub_duration":0.0024428240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2984,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:20.454198+0000","last_change":"2023-10-08T07:10:20.454247+0000","last_active":"2023-10-08T07:10:20.454198+0000","last_peered":"2023-10-08T07:10:20.454198+0000","last_clean":"2023-10-08T07:10:20.454198+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:10:20.454198+0000","last_undegraded":"2023-10-08T07:10:20.454198+0000","last_fullsized":"2023-10-08T07:10:20.454198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2890","last_scrub_stamp":"2023-10-08T07:10:20.454059+0000","last_deep_scrub":"67'2890","last_deep_scrub_stamp":"2023-10-08T07:10:20.454059+0000","last_clean_scrub_stamp":"2023-10-08T07:10:20.454059+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:00.814028+0000","scrub_duration":0.0034117829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.846882+0000","last_change":"2023-10-08T07:09:56.846960+0000","last_active":"2023-10-08T07:09:56.846882+0000","last_peered":"2023-10-08T07:09:56.846882+0000","last_clean":"2023-10-08T07:09:56.846882+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:56.846882+0000","last_undegraded":"2023-10-08T07:09:56.846882+0000","last_fullsized":"2023-10-08T07:09:56.846882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.846797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:30.858022+0000","scrub_duration":0.0019930149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:52.735956+0000","last_change":"2023-10-08T07:10:52.736039+0000","last_active":"2023-10-08T07:10:52.735956+0000","last_peered":"2023-10-08T07:10:52.735956+0000","last_clean":"2023-10-08T07:10:52.735956+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:10:52.735956+0000","last_undegraded":"2023-10-08T07:10:52.735956+0000","last_fullsized":"2023-10-08T07:10:52.735956+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:10:52.735818+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:10:52.735818+0000","last_clean_scrub_stamp":"2023-10-08T07:10:52.735818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:10.360832+0000","scrub_duration":0.002026103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.785724+0000","last_change":"2023-10-08T07:09:56.785826+0000","last_active":"2023-10-08T07:09:56.785724+0000","last_peered":"2023-10-08T07:09:56.785724+0000","last_clean":"2023-10-08T07:09:56.785724+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:56.785724+0000","last_undegraded":"2023-10-08T07:09:56.785724+0000","last_fullsized":"2023-10-08T07:09:56.785724+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.785595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:34.531648+0000","scrub_duration":0.002195621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:56.475740+0000","last_change":"2023-10-08T07:10:56.475786+0000","last_active":"2023-10-08T07:10:56.475740+0000","last_peered":"2023-10-08T07:10:56.475740+0000","last_clean":"2023-10-08T07:10:56.475740+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:10:56.475740+0000","last_undegraded":"2023-10-08T07:10:56.475740+0000","last_fullsized":"2023-10-08T07:10:56.475740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:56.475635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:56.475635+0000","last_clean_scrub_stamp":"2023-10-08T07:10:56.475635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:57.868976+0000","scrub_duration":0.0020186980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:04.363555+0000","last_change":"2023-10-08T07:10:04.363638+0000","last_active":"2023-10-08T07:10:04.363555+0000","last_peered":"2023-10-08T07:10:04.363555+0000","last_clean":"2023-10-08T07:10:04.363555+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:10:04.363555+0000","last_undegraded":"2023-10-08T07:10:04.363555+0000","last_fullsized":"2023-10-08T07:10:04.363555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:04.363441+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:04.363441+0000","last_clean_scrub_stamp":"2023-10-08T07:10:04.363441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:25.507425+0000","scrub_duration":0.0036677139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:22.504516+0000","last_change":"2023-10-08T07:10:22.504516+0000","last_active":"2023-10-08T07:10:22.504516+0000","last_peered":"2023-10-08T07:10:22.504516+0000","last_clean":"2023-10-08T07:10:22.504516+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:10:22.504516+0000","last_undegraded":"2023-10-08T07:10:22.504516+0000","last_fullsized":"2023-10-08T07:10:22.504516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:22.504358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:22.504358+0000","last_clean_scrub_stamp":"2023-10-08T07:10:22.504358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:36.534493+0000","scrub_duration":0.001785551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3027,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.013938+0000","last_change":"2023-10-08T07:09:20.737162+0000","last_active":"2023-10-08T07:09:45.013938+0000","last_peered":"2023-10-08T07:09:45.013938+0000","last_clean":"2023-10-08T07:09:45.013938+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:09:45.013938+0000","last_undegraded":"2023-10-08T07:09:45.013938+0000","last_fullsized":"2023-10-08T07:09:45.013938+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.183794+0000","last_change":"2023-10-08T07:09:56.183794+0000","last_active":"2023-10-08T07:09:56.183794+0000","last_peered":"2023-10-08T07:09:56.183794+0000","last_clean":"2023-10-08T07:09:56.183794+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:56.183794+0000","last_undegraded":"2023-10-08T07:09:56.183794+0000","last_fullsized":"2023-10-08T07:09:56.183794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_deep_scrub":"66'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.183634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:57:57.773772+0000","scrub_duration":0.0020570499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5827,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534034+0000","last_change":"2023-10-08T07:09:21.036901+0000","last_active":"2023-10-08T07:09:45.534034+0000","last_peered":"2023-10-08T07:09:45.534034+0000","last_clean":"2023-10-08T07:09:45.534034+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:09:45.534034+0000","last_undegraded":"2023-10-08T07:09:45.534034+0000","last_fullsized":"2023-10-08T07:09:45.534034+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498252+0000","last_change":"2023-10-08T07:05:32.320385+0000","last_active":"2023-10-08T07:09:44.498252+0000","last_peered":"2023-10-08T07:09:44.498252+0000","last_clean":"2023-10-08T07:09:44.498252+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:09:44.498252+0000","last_undegraded":"2023-10-08T07:09:44.498252+0000","last_fullsized":"2023-10-08T07:09:44.498252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2951,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:07.391860+0000","last_change":"2023-10-08T07:10:07.391860+0000","last_active":"2023-10-08T07:10:07.391860+0000","last_peered":"2023-10-08T07:10:07.391860+0000","last_clean":"2023-10-08T07:10:07.391860+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:10:07.391860+0000","last_undegraded":"2023-10-08T07:10:07.391860+0000","last_fullsized":"2023-10-08T07:10:07.391860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2857","last_scrub_stamp":"2023-10-08T07:10:07.391617+0000","last_deep_scrub":"67'2857","last_deep_scrub_stamp":"2023-10-08T07:10:07.391617+0000","last_clean_scrub_stamp":"2023-10-08T07:10:07.391617+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:07.864957+0000","scrub_duration":0.0030912190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"91'9","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:40.662517+0000","last_change":"2023-10-08T07:10:40.662587+0000","last_active":"2023-10-08T07:10:40.662517+0000","last_peered":"2023-10-08T07:10:40.662517+0000","last_clean":"2023-10-08T07:10:40.662517+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:10:40.662517+0000","last_undegraded":"2023-10-08T07:10:40.662517+0000","last_fullsized":"2023-10-08T07:10:40.662517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2023-10-08T07:10:40.662409+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2023-10-08T07:10:40.662409+0000","last_clean_scrub_stamp":"2023-10-08T07:10:40.662409+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:47.613277+0000","scrub_duration":0.0039694750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.205001+0000","last_change":"2023-10-08T07:09:50.205001+0000","last_active":"2023-10-08T07:09:50.205001+0000","last_peered":"2023-10-08T07:09:50.205001+0000","last_clean":"2023-10-08T07:09:50.205001+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:50.205001+0000","last_undegraded":"2023-10-08T07:09:50.205001+0000","last_fullsized":"2023-10-08T07:09:50.205001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'3","last_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_deep_scrub":"66'3","last_deep_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.204815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:31.664355+0000","scrub_duration":0.0019594320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"67'86","reported_seq":191,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498246+0000","last_change":"2023-10-08T07:09:18.064260+0000","last_active":"2023-10-08T07:09:44.498246+0000","last_peered":"2023-10-08T07:09:44.498246+0000","last_clean":"2023-10-08T07:09:44.498246+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:09:44.498246+0000","last_undegraded":"2023-10-08T07:09:44.498246+0000","last_fullsized":"2023-10-08T07:09:44.498246+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2958,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:05.926577+0000","last_change":"2023-10-08T07:10:05.926577+0000","last_active":"2023-10-08T07:10:05.926577+0000","last_peered":"2023-10-08T07:10:05.926577+0000","last_clean":"2023-10-08T07:10:05.926577+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:10:05.926577+0000","last_undegraded":"2023-10-08T07:10:05.926577+0000","last_fullsized":"2023-10-08T07:10:05.926577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2841","last_scrub_stamp":"2023-10-08T07:10:05.926418+0000","last_deep_scrub":"67'2841","last_deep_scrub_stamp":"2023-10-08T07:10:05.926418+0000","last_clean_scrub_stamp":"2023-10-08T07:10:05.926418+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:07.516556+0000","scrub_duration":0.0027102820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"91'4","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:51.976716+0000","last_change":"2023-10-08T07:10:51.976777+0000","last_active":"2023-10-08T07:10:51.976716+0000","last_peered":"2023-10-08T07:10:51.976716+0000","last_clean":"2023-10-08T07:10:51.976716+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:10:51.976716+0000","last_undegraded":"2023-10-08T07:10:51.976716+0000","last_fullsized":"2023-10-08T07:10:51.976716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:10:51.976599+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:10:51.976599+0000","last_clean_scrub_stamp":"2023-10-08T07:10:51.976599+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:39.729393+0000","scrub_duration":0.0041755680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2952,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:16.695136+0000","last_change":"2023-10-08T07:11:16.695184+0000","last_active":"2023-10-08T07:11:16.695136+0000","last_peered":"2023-10-08T07:11:16.695136+0000","last_clean":"2023-10-08T07:11:16.695136+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:11:16.695136+0000","last_undegraded":"2023-10-08T07:11:16.695136+0000","last_fullsized":"2023-10-08T07:11:16.695136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2875","last_scrub_stamp":"2023-10-08T07:11:16.695045+0000","last_deep_scrub":"67'2875","last_deep_scrub_stamp":"2023-10-08T07:11:16.695045+0000","last_clean_scrub_stamp":"2023-10-08T07:11:16.695045+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:09.511327+0000","scrub_duration":0.0024567220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:59.504119+0000","last_change":"2023-10-08T07:10:59.504215+0000","last_active":"2023-10-08T07:10:59.504119+0000","last_peered":"2023-10-08T07:10:59.504119+0000","last_clean":"2023-10-08T07:10:59.504119+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:10:59.504119+0000","last_undegraded":"2023-10-08T07:10:59.504119+0000","last_fullsized":"2023-10-08T07:10:59.504119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:59.504012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:59.504012+0000","last_clean_scrub_stamp":"2023-10-08T07:10:59.504012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:51:50.766230+0000","scrub_duration":0.0016614209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8831,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:24.713218+0000","last_change":"2023-10-08T07:11:24.713295+0000","last_active":"2023-10-08T07:11:24.713218+0000","last_peered":"2023-10-08T07:11:24.713218+0000","last_clean":"2023-10-08T07:11:24.713218+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:11:24.713218+0000","last_undegraded":"2023-10-08T07:11:24.713218+0000","last_fullsized":"2023-10-08T07:11:24.713218+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8742","last_scrub_stamp":"2023-10-08T07:11:24.713102+0000","last_deep_scrub":"67'8742","last_deep_scrub_stamp":"2023-10-08T07:11:24.713102+0000","last_clean_scrub_stamp":"2023-10-08T07:11:24.713102+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:15.657707+0000","scrub_duration":0.0024625300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:47.711196+0000","last_change":"2023-10-08T07:10:47.711265+0000","last_active":"2023-10-08T07:10:47.711196+0000","last_peered":"2023-10-08T07:10:47.711196+0000","last_clean":"2023-10-08T07:10:47.711196+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:10:47.711196+0000","last_undegraded":"2023-10-08T07:10:47.711196+0000","last_fullsized":"2023-10-08T07:10:47.711196+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:47.711101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:47.711101+0000","last_clean_scrub_stamp":"2023-10-08T07:10:47.711101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:44:42.808700+0000","scrub_duration":0.001740978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2934,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:15.518408+0000","last_change":"2023-10-08T07:10:15.518408+0000","last_active":"2023-10-08T07:10:15.518408+0000","last_peered":"2023-10-08T07:10:15.518408+0000","last_clean":"2023-10-08T07:10:15.518408+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:10:15.518408+0000","last_undegraded":"2023-10-08T07:10:15.518408+0000","last_fullsized":"2023-10-08T07:10:15.518408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2840","last_scrub_stamp":"2023-10-08T07:10:15.518167+0000","last_deep_scrub":"67'2840","last_deep_scrub_stamp":"2023-10-08T07:10:15.518167+0000","last_clean_scrub_stamp":"2023-10-08T07:10:15.518167+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:47.143209+0000","scrub_duration":0.0035381470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"91'13","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.954538+0000","last_change":"2023-10-08T07:10:36.954611+0000","last_active":"2023-10-08T07:10:36.954538+0000","last_peered":"2023-10-08T07:10:36.954538+0000","last_clean":"2023-10-08T07:10:36.954538+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:10:36.954538+0000","last_undegraded":"2023-10-08T07:10:36.954538+0000","last_fullsized":"2023-10-08T07:10:36.954538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'13","last_scrub_stamp":"2023-10-08T07:10:36.954426+0000","last_deep_scrub":"91'13","last_deep_scrub_stamp":"2023-10-08T07:10:36.954426+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.954426+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:38.169926+0000","scrub_duration":0.0097942589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:28.367071+0000","last_change":"2023-10-08T07:10:28.367120+0000","last_active":"2023-10-08T07:10:28.367071+0000","last_peered":"2023-10-08T07:10:28.367071+0000","last_clean":"2023-10-08T07:10:28.367071+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:10:28.367071+0000","last_undegraded":"2023-10-08T07:10:28.367071+0000","last_fullsized":"2023-10-08T07:10:28.367071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:28.366970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:28.366970+0000","last_clean_scrub_stamp":"2023-10-08T07:10:28.366970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:27.637172+0000","scrub_duration":0.0029471160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"91'2","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:56.966275+0000","last_change":"2023-10-08T07:10:56.966328+0000","last_active":"2023-10-08T07:10:56.966275+0000","last_peered":"2023-10-08T07:10:56.966275+0000","last_clean":"2023-10-08T07:10:56.966275+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:10:56.966275+0000","last_undegraded":"2023-10-08T07:10:56.966275+0000","last_fullsized":"2023-10-08T07:10:56.966275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2023-10-08T07:10:56.966171+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2023-10-08T07:10:56.966171+0000","last_clean_scrub_stamp":"2023-10-08T07:10:56.966171+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:51:48.228389+0000","scrub_duration":0.0038520659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:03.716700+0000","last_change":"2023-10-08T07:11:03.716700+0000","last_active":"2023-10-08T07:11:03.716700+0000","last_peered":"2023-10-08T07:11:03.716700+0000","last_clean":"2023-10-08T07:11:03.716700+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:11:03.716700+0000","last_undegraded":"2023-10-08T07:11:03.716700+0000","last_fullsized":"2023-10-08T07:11:03.716700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:03.716560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:03.716560+0000","last_clean_scrub_stamp":"2023-10-08T07:11:03.716560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:17.194562+0000","scrub_duration":0.0024862790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:01.721161+0000","last_change":"2023-10-08T07:10:01.721235+0000","last_active":"2023-10-08T07:10:01.721161+0000","last_peered":"2023-10-08T07:10:01.721161+0000","last_clean":"2023-10-08T07:10:01.721161+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:10:01.721161+0000","last_undegraded":"2023-10-08T07:10:01.721161+0000","last_fullsized":"2023-10-08T07:10:01.721161+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2023-10-08T07:10:01.721055+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2023-10-08T07:10:01.721055+0000","last_clean_scrub_stamp":"2023-10-08T07:10:01.721055+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:38.621496+0000","scrub_duration":0.0061286539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3010,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:03.673316+0000","last_change":"2023-10-08T07:10:03.673316+0000","last_active":"2023-10-08T07:10:03.673316+0000","last_peered":"2023-10-08T07:10:03.673316+0000","last_clean":"2023-10-08T07:10:03.673316+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:10:03.673316+0000","last_undegraded":"2023-10-08T07:10:03.673316+0000","last_fullsized":"2023-10-08T07:10:03.673316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2932","last_scrub_stamp":"2023-10-08T07:10:03.673166+0000","last_deep_scrub":"67'2932","last_deep_scrub_stamp":"2023-10-08T07:10:03.673166+0000","last_clean_scrub_stamp":"2023-10-08T07:10:03.673166+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:45:38.773848+0000","scrub_duration":0.0023330069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:26.956810+0000","last_change":"2023-10-08T07:10:26.956867+0000","last_active":"2023-10-08T07:10:26.956810+0000","last_peered":"2023-10-08T07:10:26.956810+0000","last_clean":"2023-10-08T07:10:26.956810+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:10:26.956810+0000","last_undegraded":"2023-10-08T07:10:26.956810+0000","last_fullsized":"2023-10-08T07:10:26.956810+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2023-10-08T07:10:26.956714+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2023-10-08T07:10:26.956714+0000","last_clean_scrub_stamp":"2023-10-08T07:10:26.956714+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:41.451138+0000","scrub_duration":0.0040178289999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2957,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:29.955939+0000","last_change":"2023-10-08T07:10:29.956001+0000","last_active":"2023-10-08T07:10:29.955939+0000","last_peered":"2023-10-08T07:10:29.955939+0000","last_clean":"2023-10-08T07:10:29.955939+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:10:29.955939+0000","last_undegraded":"2023-10-08T07:10:29.955939+0000","last_fullsized":"2023-10-08T07:10:29.955939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2863","last_scrub_stamp":"2023-10-08T07:10:29.955814+0000","last_deep_scrub":"67'2863","last_deep_scrub_stamp":"2023-10-08T07:10:29.955814+0000","last_clean_scrub_stamp":"2023-10-08T07:10:29.955814+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:43.985949+0000","scrub_duration":0.0033374920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498239+0000","last_change":"2023-10-08T07:05:32.320597+0000","last_active":"2023-10-08T07:09:44.498239+0000","last_peered":"2023-10-08T07:09:44.498239+0000","last_clean":"2023-10-08T07:09:44.498239+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:09:44.498239+0000","last_undegraded":"2023-10-08T07:09:44.498239+0000","last_fullsized":"2023-10-08T07:09:44.498239+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":3002,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.177449+0000","last_change":"2023-10-08T07:09:51.177449+0000","last_active":"2023-10-08T07:09:51.177449+0000","last_peered":"2023-10-08T07:09:51.177449+0000","last_clean":"2023-10-08T07:09:51.177449+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:51.177449+0000","last_undegraded":"2023-10-08T07:09:51.177449+0000","last_fullsized":"2023-10-08T07:09:51.177449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2908","last_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_deep_scrub":"67'2908","last_deep_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.177304+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:24.847471+0000","scrub_duration":0.0043549410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'4","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:01.413711+0000","last_change":"2023-10-08T07:11:01.413760+0000","last_active":"2023-10-08T07:11:01.413711+0000","last_peered":"2023-10-08T07:11:01.413711+0000","last_clean":"2023-10-08T07:11:01.413711+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:11:01.413711+0000","last_undegraded":"2023-10-08T07:11:01.413711+0000","last_fullsized":"2023-10-08T07:11:01.413711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:11:01.413615+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:11:01.413615+0000","last_clean_scrub_stamp":"2023-10-08T07:11:01.413615+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:07.522439+0000","scrub_duration":0.0035531170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5940,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.877374+0000","last_change":"2023-10-08T07:09:58.877374+0000","last_active":"2023-10-08T07:09:58.877374+0000","last_peered":"2023-10-08T07:09:58.877374+0000","last_clean":"2023-10-08T07:09:58.877374+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:58.877374+0000","last_undegraded":"2023-10-08T07:09:58.877374+0000","last_fullsized":"2023-10-08T07:09:58.877374+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5846","last_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_deep_scrub":"67'5846","last_deep_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.877221+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.287679+0000","scrub_duration":0.0031762159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:34.990831+0000","last_change":"2023-10-08T07:10:34.990887+0000","last_active":"2023-10-08T07:10:34.990831+0000","last_peered":"2023-10-08T07:10:34.990831+0000","last_clean":"2023-10-08T07:10:34.990831+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:10:34.990831+0000","last_undegraded":"2023-10-08T07:10:34.990831+0000","last_fullsized":"2023-10-08T07:10:34.990831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:34.990723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:34.990723+0000","last_clean_scrub_stamp":"2023-10-08T07:10:34.990723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:34.260924+0000","scrub_duration":0.0019640790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:37.996096+0000","last_change":"2023-10-08T07:10:37.996151+0000","last_active":"2023-10-08T07:10:37.996096+0000","last_peered":"2023-10-08T07:10:37.996096+0000","last_clean":"2023-10-08T07:10:37.996096+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:10:37.996096+0000","last_undegraded":"2023-10-08T07:10:37.996096+0000","last_fullsized":"2023-10-08T07:10:37.996096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:37.995993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:37.995993+0000","last_clean_scrub_stamp":"2023-10-08T07:10:37.995993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:06.897411+0000","scrub_duration":0.0020275480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:06.723751+0000","last_change":"2023-10-08T07:11:06.723751+0000","last_active":"2023-10-08T07:11:06.723751+0000","last_peered":"2023-10-08T07:11:06.723751+0000","last_clean":"2023-10-08T07:11:06.723751+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:11:06.723751+0000","last_undegraded":"2023-10-08T07:11:06.723751+0000","last_fullsized":"2023-10-08T07:11:06.723751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:06.723539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:06.723539+0000","last_clean_scrub_stamp":"2023-10-08T07:11:06.723539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:55.594128+0000","scrub_duration":0.0018006879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5937,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498360+0000","last_change":"2023-10-08T07:09:21.040694+0000","last_active":"2023-10-08T07:09:44.498360+0000","last_peered":"2023-10-08T07:09:44.498360+0000","last_clean":"2023-10-08T07:09:44.498360+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:09:44.498360+0000","last_undegraded":"2023-10-08T07:09:44.498360+0000","last_fullsized":"2023-10-08T07:09:44.498360+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:45.649710+0000","last_change":"2023-10-08T07:10:45.649710+0000","last_active":"2023-10-08T07:10:45.649710+0000","last_peered":"2023-10-08T07:10:45.649710+0000","last_clean":"2023-10-08T07:10:45.649710+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:10:45.649710+0000","last_undegraded":"2023-10-08T07:10:45.649710+0000","last_fullsized":"2023-10-08T07:10:45.649710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:45.649532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:45.649532+0000","last_clean_scrub_stamp":"2023-10-08T07:10:45.649532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:26.132541+0000","scrub_duration":0.0019874580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2952,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.534045+0000","last_change":"2023-10-08T07:09:21.042008+0000","last_active":"2023-10-08T07:09:45.534045+0000","last_peered":"2023-10-08T07:09:45.534045+0000","last_clean":"2023-10-08T07:09:45.534045+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:09:45.534045+0000","last_undegraded":"2023-10-08T07:09:45.534045+0000","last_fullsized":"2023-10-08T07:09:45.534045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:53.453324+0000","last_change":"2023-10-08T07:10:53.453369+0000","last_active":"2023-10-08T07:10:53.453324+0000","last_peered":"2023-10-08T07:10:53.453324+0000","last_clean":"2023-10-08T07:10:53.453324+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:10:53.453324+0000","last_undegraded":"2023-10-08T07:10:53.453324+0000","last_fullsized":"2023-10-08T07:10:53.453324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:53.453181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:53.453181+0000","last_clean_scrub_stamp":"2023-10-08T07:10:53.453181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:27.290354+0000","scrub_duration":0.002075145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:18.987300+0000","last_change":"2023-10-08T07:10:18.987348+0000","last_active":"2023-10-08T07:10:18.987300+0000","last_peered":"2023-10-08T07:10:18.987300+0000","last_clean":"2023-10-08T07:10:18.987300+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:10:18.987300+0000","last_undegraded":"2023-10-08T07:10:18.987300+0000","last_fullsized":"2023-10-08T07:10:18.987300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:18.987171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:18.987171+0000","last_clean_scrub_stamp":"2023-10-08T07:10:18.987171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:50.612213+0000","scrub_duration":0.0022629809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5861,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:25.718202+0000","last_change":"2023-10-08T07:10:25.718202+0000","last_active":"2023-10-08T07:10:25.718202+0000","last_peered":"2023-10-08T07:10:25.718202+0000","last_clean":"2023-10-08T07:10:25.718202+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:10:25.718202+0000","last_undegraded":"2023-10-08T07:10:25.718202+0000","last_fullsized":"2023-10-08T07:10:25.718202+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5777","last_scrub_stamp":"2023-10-08T07:10:25.718038+0000","last_deep_scrub":"67'5777","last_deep_scrub_stamp":"2023-10-08T07:10:25.718038+0000","last_clean_scrub_stamp":"2023-10-08T07:10:25.718038+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:11.338172+0000","scrub_duration":0.0025969640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:17.091816+0000","last_change":"2023-10-08T07:11:17.091890+0000","last_active":"2023-10-08T07:11:17.091816+0000","last_peered":"2023-10-08T07:11:17.091816+0000","last_clean":"2023-10-08T07:11:17.091816+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:11:17.091816+0000","last_undegraded":"2023-10-08T07:11:17.091816+0000","last_fullsized":"2023-10-08T07:11:17.091816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:17.091711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:17.091711+0000","last_clean_scrub_stamp":"2023-10-08T07:11:17.091711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:12.124209+0000","scrub_duration":0.0021563580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:47.997985+0000","last_change":"2023-10-08T07:10:47.998055+0000","last_active":"2023-10-08T07:10:47.997985+0000","last_peered":"2023-10-08T07:10:47.997985+0000","last_clean":"2023-10-08T07:10:47.997985+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:10:47.997985+0000","last_undegraded":"2023-10-08T07:10:47.997985+0000","last_fullsized":"2023-10-08T07:10:47.997985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:47.997873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:47.997873+0000","last_clean_scrub_stamp":"2023-10-08T07:10:47.997873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:35.775296+0000","scrub_duration":0.0020812069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2960,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928399+0000","last_change":"2023-10-08T07:09:21.040185+0000","last_active":"2023-10-08T07:09:44.928399+0000","last_peered":"2023-10-08T07:09:44.928399+0000","last_clean":"2023-10-08T07:09:44.928399+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:09:44.928399+0000","last_undegraded":"2023-10-08T07:09:44.928399+0000","last_fullsized":"2023-10-08T07:09:44.928399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.424913+0000","last_change":"2023-10-08T07:10:36.424976+0000","last_active":"2023-10-08T07:10:36.424913+0000","last_peered":"2023-10-08T07:10:36.424913+0000","last_clean":"2023-10-08T07:10:36.424913+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:10:36.424913+0000","last_undegraded":"2023-10-08T07:10:36.424913+0000","last_fullsized":"2023-10-08T07:10:36.424913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:36.424768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:36.424768+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.424768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:46.936565+0000","scrub_duration":0.001635028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:04.640857+0000","last_change":"2023-10-08T07:10:04.640857+0000","last_active":"2023-10-08T07:10:04.640857+0000","last_peered":"2023-10-08T07:10:04.640857+0000","last_clean":"2023-10-08T07:10:04.640857+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:10:04.640857+0000","last_undegraded":"2023-10-08T07:10:04.640857+0000","last_fullsized":"2023-10-08T07:10:04.640857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:04.640672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:04.640672+0000","last_clean_scrub_stamp":"2023-10-08T07:10:04.640672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:31:07.525494+0000","scrub_duration":0.002134164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8919,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533998+0000","last_change":"2023-10-08T07:09:21.042220+0000","last_active":"2023-10-08T07:09:45.533998+0000","last_peered":"2023-10-08T07:09:45.533998+0000","last_clean":"2023-10-08T07:09:45.533998+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:09:45.533998+0000","last_undegraded":"2023-10-08T07:09:45.533998+0000","last_fullsized":"2023-10-08T07:09:45.533998+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:22.226108+0000","last_change":"2023-10-08T07:11:22.226159+0000","last_active":"2023-10-08T07:11:22.226108+0000","last_peered":"2023-10-08T07:11:22.226108+0000","last_clean":"2023-10-08T07:11:22.226108+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:11:22.226108+0000","last_undegraded":"2023-10-08T07:11:22.226108+0000","last_fullsized":"2023-10-08T07:11:22.226108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:22.225988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:22.225988+0000","last_clean_scrub_stamp":"2023-10-08T07:11:22.225988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:16.913069+0000","scrub_duration":0.001846252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"91'159","reported_seq":311,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:02.005133+0000","last_change":"2023-10-08T07:11:02.005133+0000","last_active":"2023-10-08T07:11:02.005133+0000","last_peered":"2023-10-08T07:11:02.005133+0000","last_clean":"2023-10-08T07:11:02.005133+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:11:02.005133+0000","last_undegraded":"2023-10-08T07:11:02.005133+0000","last_fullsized":"2023-10-08T07:11:02.005133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'159","last_scrub_stamp":"2023-10-08T07:11:02.004931+0000","last_deep_scrub":"91'159","last_deep_scrub_stamp":"2023-10-08T07:11:02.004931+0000","last_clean_scrub_stamp":"2023-10-08T07:11:02.004931+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:07.761573+0000","scrub_duration":0.0067731960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:14.490905+0000","last_change":"2023-10-08T07:10:14.490962+0000","last_active":"2023-10-08T07:10:14.490905+0000","last_peered":"2023-10-08T07:10:14.490905+0000","last_clean":"2023-10-08T07:10:14.490905+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:10:14.490905+0000","last_undegraded":"2023-10-08T07:10:14.490905+0000","last_fullsized":"2023-10-08T07:10:14.490905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:14.490798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:14.490798+0000","last_clean_scrub_stamp":"2023-10-08T07:10:14.490798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:50.710326+0000","scrub_duration":0.0018705449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5904,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498255+0000","last_change":"2023-10-08T07:09:21.040684+0000","last_active":"2023-10-08T07:09:44.498255+0000","last_peered":"2023-10-08T07:09:44.498255+0000","last_clean":"2023-10-08T07:09:44.498255+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:09:44.498255+0000","last_undegraded":"2023-10-08T07:09:44.498255+0000","last_fullsized":"2023-10-08T07:09:44.498255+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:14.101755+0000","last_change":"2023-10-08T07:11:14.101830+0000","last_active":"2023-10-08T07:11:14.101755+0000","last_peered":"2023-10-08T07:11:14.101755+0000","last_clean":"2023-10-08T07:11:14.101755+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:11:14.101755+0000","last_undegraded":"2023-10-08T07:11:14.101755+0000","last_fullsized":"2023-10-08T07:11:14.101755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:14.101622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:14.101622+0000","last_clean_scrub_stamp":"2023-10-08T07:11:14.101622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:57:42.163685+0000","scrub_duration":0.001960626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.109394+0000","last_change":"2023-10-08T07:09:25.038493+0000","last_active":"2023-10-08T07:09:36.109394+0000","last_peered":"2023-10-08T07:09:36.109394+0000","last_clean":"2023-10-08T07:09:36.109394+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:09:36.109394+0000","last_undegraded":"2023-10-08T07:09:36.109394+0000","last_fullsized":"2023-10-08T07:09:36.109394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:22.766221+0000","last_change":"2023-10-08T07:10:22.766221+0000","last_active":"2023-10-08T07:10:22.766221+0000","last_peered":"2023-10-08T07:10:22.766221+0000","last_clean":"2023-10-08T07:10:22.766221+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:10:22.766221+0000","last_undegraded":"2023-10-08T07:10:22.766221+0000","last_fullsized":"2023-10-08T07:10:22.766221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:22.766075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:22.766075+0000","last_clean_scrub_stamp":"2023-10-08T07:10:22.766075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:57.867526+0000","scrub_duration":0.0019628810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:59.746038+0000","last_change":"2023-10-08T07:09:59.746038+0000","last_active":"2023-10-08T07:09:59.746038+0000","last_peered":"2023-10-08T07:09:59.746038+0000","last_clean":"2023-10-08T07:09:59.746038+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:59.746038+0000","last_undegraded":"2023-10-08T07:09:59.746038+0000","last_fullsized":"2023-10-08T07:09:59.746038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_clean_scrub_stamp":"2023-10-08T07:09:59.745834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:05.711715+0000","scrub_duration":0.002070012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:31.391524+0000","last_change":"2023-10-08T07:10:31.391575+0000","last_active":"2023-10-08T07:10:31.391524+0000","last_peered":"2023-10-08T07:10:31.391524+0000","last_clean":"2023-10-08T07:10:31.391524+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:10:31.391524+0000","last_undegraded":"2023-10-08T07:10:31.391524+0000","last_fullsized":"2023-10-08T07:10:31.391524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:31.391414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:31.391414+0000","last_clean_scrub_stamp":"2023-10-08T07:10:31.391414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:58.361849+0000","scrub_duration":0.001953729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:05.747198+0000","last_change":"2023-10-08T07:11:05.747198+0000","last_active":"2023-10-08T07:11:05.747198+0000","last_peered":"2023-10-08T07:11:05.747198+0000","last_clean":"2023-10-08T07:11:05.747198+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:11:05.747198+0000","last_undegraded":"2023-10-08T07:11:05.747198+0000","last_fullsized":"2023-10-08T07:11:05.747198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:05.747028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:05.747028+0000","last_clean_scrub_stamp":"2023-10-08T07:11:05.747028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:48.021225+0000","scrub_duration":0.0025933689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"91'4","reported_seq":111,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:11.279394+0000","last_change":"2023-10-08T07:11:11.279450+0000","last_active":"2023-10-08T07:11:11.279394+0000","last_peered":"2023-10-08T07:11:11.279394+0000","last_clean":"2023-10-08T07:11:11.279394+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:11:11.279394+0000","last_undegraded":"2023-10-08T07:11:11.279394+0000","last_fullsized":"2023-10-08T07:11:11.279394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:11:11.279275+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:11:11.279275+0000","last_clean_scrub_stamp":"2023-10-08T07:11:11.279275+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:33.249103+0000","scrub_duration":0.0038380409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:38.461564+0000","last_change":"2023-10-08T07:10:38.461609+0000","last_active":"2023-10-08T07:10:38.461564+0000","last_peered":"2023-10-08T07:10:38.461564+0000","last_clean":"2023-10-08T07:10:38.461564+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:10:38.461564+0000","last_undegraded":"2023-10-08T07:10:38.461564+0000","last_fullsized":"2023-10-08T07:10:38.461564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:38.461431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:38.461431+0000","last_clean_scrub_stamp":"2023-10-08T07:10:38.461431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:09.555421+0000","scrub_duration":0.001628572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2997,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:52.224898+0000","last_change":"2023-10-08T07:09:52.224944+0000","last_active":"2023-10-08T07:09:52.224898+0000","last_peered":"2023-10-08T07:09:52.224898+0000","last_clean":"2023-10-08T07:09:52.224898+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:52.224898+0000","last_undegraded":"2023-10-08T07:09:52.224898+0000","last_fullsized":"2023-10-08T07:09:52.224898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2903","last_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_deep_scrub":"67'2903","last_deep_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_clean_scrub_stamp":"2023-10-08T07:09:52.224790+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:46.117778+0000","scrub_duration":0.0028885249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:20.186482+0000","last_change":"2023-10-08T07:11:20.186536+0000","last_active":"2023-10-08T07:11:20.186482+0000","last_peered":"2023-10-08T07:11:20.186482+0000","last_clean":"2023-10-08T07:11:20.186482+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:11:20.186482+0000","last_undegraded":"2023-10-08T07:11:20.186482+0000","last_fullsized":"2023-10-08T07:11:20.186482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:20.186375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:20.186375+0000","last_clean_scrub_stamp":"2023-10-08T07:11:20.186375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:34:43.779446+0000","scrub_duration":0.0022044709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"91'10","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:03.449585+0000","last_change":"2023-10-08T07:11:03.449648+0000","last_active":"2023-10-08T07:11:03.449585+0000","last_peered":"2023-10-08T07:11:03.449585+0000","last_clean":"2023-10-08T07:11:03.449585+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:11:03.449585+0000","last_undegraded":"2023-10-08T07:11:03.449585+0000","last_fullsized":"2023-10-08T07:11:03.449585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2023-10-08T07:11:03.449489+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2023-10-08T07:11:03.449489+0000","last_clean_scrub_stamp":"2023-10-08T07:11:03.449489+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:26.149116+0000","scrub_duration":0.003637454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2972,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.619759+0000","last_change":"2023-10-08T07:10:36.619759+0000","last_active":"2023-10-08T07:10:36.619759+0000","last_peered":"2023-10-08T07:10:36.619759+0000","last_clean":"2023-10-08T07:10:36.619759+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:10:36.619759+0000","last_undegraded":"2023-10-08T07:10:36.619759+0000","last_fullsized":"2023-10-08T07:10:36.619759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2894","last_scrub_stamp":"2023-10-08T07:10:36.619619+0000","last_deep_scrub":"67'2894","last_deep_scrub_stamp":"2023-10-08T07:10:36.619619+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.619619+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:03.016252+0000","scrub_duration":0.0024615819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:53.800092+0000","last_change":"2023-10-08T07:09:53.800170+0000","last_active":"2023-10-08T07:09:53.800092+0000","last_peered":"2023-10-08T07:09:53.800092+0000","last_clean":"2023-10-08T07:09:53.800092+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:53.800092+0000","last_undegraded":"2023-10-08T07:09:53.800092+0000","last_fullsized":"2023-10-08T07:09:53.800092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_clean_scrub_stamp":"2023-10-08T07:09:53.799979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:11.628567+0000","scrub_duration":0.0021863500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.743146+0000","last_change":"2023-10-08T07:09:24.732784+0000","last_active":"2023-10-08T07:09:36.743146+0000","last_peered":"2023-10-08T07:09:36.743146+0000","last_clean":"2023-10-08T07:09:36.743146+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:09:36.743146+0000","last_undegraded":"2023-10-08T07:09:36.743146+0000","last_fullsized":"2023-10-08T07:09:36.743146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110970+0000","last_change":"2023-10-08T07:09:23.066235+0000","last_active":"2023-10-08T07:09:36.110970+0000","last_peered":"2023-10-08T07:09:36.110970+0000","last_clean":"2023-10-08T07:09:36.110970+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:09:36.110970+0000","last_undegraded":"2023-10-08T07:09:36.110970+0000","last_fullsized":"2023-10-08T07:09:36.110970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5900,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:25.908075+0000","last_change":"2023-10-08T07:10:25.908075+0000","last_active":"2023-10-08T07:10:25.908075+0000","last_peered":"2023-10-08T07:10:25.908075+0000","last_clean":"2023-10-08T07:10:25.908075+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:10:25.908075+0000","last_undegraded":"2023-10-08T07:10:25.908075+0000","last_fullsized":"2023-10-08T07:10:25.908075+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5806","last_scrub_stamp":"2023-10-08T07:10:25.907915+0000","last_deep_scrub":"67'5806","last_deep_scrub_stamp":"2023-10-08T07:10:25.907915+0000","last_clean_scrub_stamp":"2023-10-08T07:10:25.907915+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:33.667782+0000","scrub_duration":0.0029813180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"91'4","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:58.746498+0000","last_change":"2023-10-08T07:10:58.746571+0000","last_active":"2023-10-08T07:10:58.746498+0000","last_peered":"2023-10-08T07:10:58.746498+0000","last_clean":"2023-10-08T07:10:58.746498+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:10:58.746498+0000","last_undegraded":"2023-10-08T07:10:58.746498+0000","last_fullsized":"2023-10-08T07:10:58.746498+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:10:58.746368+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:10:58.746368+0000","last_clean_scrub_stamp":"2023-10-08T07:10:58.746368+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:25:49.547384+0000","scrub_duration":0.0037535310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3011,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498397+0000","last_change":"2023-10-08T07:05:33.324710+0000","last_active":"2023-10-08T07:09:44.498397+0000","last_peered":"2023-10-08T07:09:44.498397+0000","last_clean":"2023-10-08T07:09:44.498397+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:09:44.498397+0000","last_undegraded":"2023-10-08T07:09:44.498397+0000","last_fullsized":"2023-10-08T07:09:44.498397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:18.452697+0000","last_change":"2023-10-08T07:10:18.452754+0000","last_active":"2023-10-08T07:10:18.452697+0000","last_peered":"2023-10-08T07:10:18.452697+0000","last_clean":"2023-10-08T07:10:18.452697+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:10:18.452697+0000","last_undegraded":"2023-10-08T07:10:18.452697+0000","last_fullsized":"2023-10-08T07:10:18.452697+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:10:18.452579+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:10:18.452579+0000","last_clean_scrub_stamp":"2023-10-08T07:10:18.452579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:51.487483+0000","scrub_duration":0.0019171150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5880,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:00.754545+0000","last_change":"2023-10-08T07:10:00.754601+0000","last_active":"2023-10-08T07:10:00.754545+0000","last_peered":"2023-10-08T07:10:00.754545+0000","last_clean":"2023-10-08T07:10:00.754545+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:10:00.754545+0000","last_undegraded":"2023-10-08T07:10:00.754545+0000","last_fullsized":"2023-10-08T07:10:00.754545+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5794","last_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_deep_scrub":"67'5794","last_deep_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_clean_scrub_stamp":"2023-10-08T07:10:00.754451+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:41.308685+0000","scrub_duration":0.0023848570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:06.392046+0000","last_change":"2023-10-08T07:10:06.392100+0000","last_active":"2023-10-08T07:10:06.392046+0000","last_peered":"2023-10-08T07:10:06.392046+0000","last_clean":"2023-10-08T07:10:06.392046+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:10:06.392046+0000","last_undegraded":"2023-10-08T07:10:06.392046+0000","last_fullsized":"2023-10-08T07:10:06.392046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2023-10-08T07:10:06.391949+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2023-10-08T07:10:06.391949+0000","last_clean_scrub_stamp":"2023-10-08T07:10:06.391949+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:18.322702+0000","scrub_duration":0.005184073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:17.009849+0000","last_change":"2023-10-08T07:10:17.009849+0000","last_active":"2023-10-08T07:10:17.009849+0000","last_peered":"2023-10-08T07:10:17.009849+0000","last_clean":"2023-10-08T07:10:17.009849+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:10:17.009849+0000","last_undegraded":"2023-10-08T07:10:17.009849+0000","last_fullsized":"2023-10-08T07:10:17.009849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:10:17.009657+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:10:17.009657+0000","last_clean_scrub_stamp":"2023-10-08T07:10:17.009657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:59:07.822088+0000","scrub_duration":0.0028116880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8817,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:35.984320+0000","last_change":"2023-10-08T07:10:35.984376+0000","last_active":"2023-10-08T07:10:35.984320+0000","last_peered":"2023-10-08T07:10:35.984320+0000","last_clean":"2023-10-08T07:10:35.984320+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:10:35.984320+0000","last_undegraded":"2023-10-08T07:10:35.984320+0000","last_fullsized":"2023-10-08T07:10:35.984320+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8723","last_scrub_stamp":"2023-10-08T07:10:35.984180+0000","last_deep_scrub":"67'8723","last_deep_scrub_stamp":"2023-10-08T07:10:35.984180+0000","last_clean_scrub_stamp":"2023-10-08T07:10:35.984180+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:35:02.954615+0000","scrub_duration":0.0034636020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3003,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.928301+0000","last_change":"2023-10-08T07:09:21.036530+0000","last_active":"2023-10-08T07:09:44.928301+0000","last_peered":"2023-10-08T07:09:44.928301+0000","last_clean":"2023-10-08T07:09:44.928301+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:09:44.928301+0000","last_undegraded":"2023-10-08T07:09:44.928301+0000","last_fullsized":"2023-10-08T07:09:44.928301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:04.731839+0000","last_change":"2023-10-08T07:11:04.731839+0000","last_active":"2023-10-08T07:11:04.731839+0000","last_peered":"2023-10-08T07:11:04.731839+0000","last_clean":"2023-10-08T07:11:04.731839+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:11:04.731839+0000","last_undegraded":"2023-10-08T07:11:04.731839+0000","last_fullsized":"2023-10-08T07:11:04.731839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2023-10-08T07:11:04.731603+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2023-10-08T07:11:04.731603+0000","last_clean_scrub_stamp":"2023-10-08T07:11:04.731603+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:54:15.076074+0000","scrub_duration":0.0027692070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:55.216862+0000","last_change":"2023-10-08T07:09:55.216924+0000","last_active":"2023-10-08T07:09:55.216862+0000","last_peered":"2023-10-08T07:09:55.216862+0000","last_clean":"2023-10-08T07:09:55.216862+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:55.216862+0000","last_undegraded":"2023-10-08T07:09:55.216862+0000","last_fullsized":"2023-10-08T07:09:55.216862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_clean_scrub_stamp":"2023-10-08T07:09:55.216748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:14.264100+0000","scrub_duration":0.001903205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2984,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:11.731360+0000","last_change":"2023-10-08T07:11:11.731360+0000","last_active":"2023-10-08T07:11:11.731360+0000","last_peered":"2023-10-08T07:11:11.731360+0000","last_clean":"2023-10-08T07:11:11.731360+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:11:11.731360+0000","last_undegraded":"2023-10-08T07:11:11.731360+0000","last_fullsized":"2023-10-08T07:11:11.731360+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2906","last_scrub_stamp":"2023-10-08T07:11:11.731149+0000","last_deep_scrub":"67'2906","last_deep_scrub_stamp":"2023-10-08T07:11:11.731149+0000","last_clean_scrub_stamp":"2023-10-08T07:11:11.731149+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:11.458600+0000","scrub_duration":0.002706651,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738444,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595760,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776080,"statfs":{"total":96636764160,"available":96026705920,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:10:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.60199999999999998,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.188,"15min":0.188},"max":{"1min":0.65400000000000003,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.60599999999999998,"15min":0.50600000000000001},"min":{"1min":0.31,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58399999999999996,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Sun Oct 8 07:11:19 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60999999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64700000000000002,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.61699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483908,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887932,"statfs":{"total":96636764160,"available":96141242368,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:11:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.433,"15min":0.43099999999999999},"min":{"1min":0.35099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Oct 8 07:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54700000000000004,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.63100000000000001,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.497,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.65700000000000003,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.35599999999999998}]}]},{"osd":1,"up_from":74,"seq":317827579932,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":1712,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":1753088,"data_stored":1220245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.34000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.36099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.47599999999999998}]},{"osd":2,"last update":"Sun Oct 8 07:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.42299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65400000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59899999999999998,"5min":3.048,"15min":3.048},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:11:27.871 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.871 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.871 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.871 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.871 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.872 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.872 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.872 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.872 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.872 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.873 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.873 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.873 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.873 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.873 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.874 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.874 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.874 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.874 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.874 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.875 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.875 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:27.875 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:11:47.876 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:11:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:11:48.234 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:11:48.244 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2023-10-08T07:11:46.602158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149210,"ondisk_log_size":149210,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145004,"kb_used_data":4308,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970516,"statfs":{"total":289910292480,"available":288737808384,"internally_reserved":0,"allocated":4411392,"data_stored":2817910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003011"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":3009,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:26.717954+0000","last_change":"2023-10-08T07:11:26.718010+0000","last_active":"2023-10-08T07:11:26.717954+0000","last_peered":"2023-10-08T07:11:26.717954+0000","last_clean":"2023-10-08T07:11:26.717954+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:11:26.717954+0000","last_undegraded":"2023-10-08T07:11:26.717954+0000","last_fullsized":"2023-10-08T07:11:26.717954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2931","last_scrub_stamp":"2023-10-08T07:11:26.717857+0000","last_deep_scrub":"67'2931","last_deep_scrub_stamp":"2023-10-08T07:11:26.717857+0000","last_clean_scrub_stamp":"2023-10-08T07:11:26.717857+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:59.144037+0000","scrub_duration":0.0021000200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2910,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:46.756403+0000","last_change":"2023-10-08T07:09:46.756403+0000","last_active":"2023-10-08T07:09:46.756403+0000","last_peered":"2023-10-08T07:09:46.756403+0000","last_clean":"2023-10-08T07:09:46.756403+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:46.756403+0000","last_undegraded":"2023-10-08T07:09:46.756403+0000","last_fullsized":"2023-10-08T07:09:46.756403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2832","last_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_deep_scrub":"67'2832","last_deep_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_clean_scrub_stamp":"2023-10-08T07:09:46.756167+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:46.978745+0000","scrub_duration":0.0030689100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:01.902591+0000","last_change":"2023-10-08T07:10:01.902641+0000","last_active":"2023-10-08T07:10:01.902591+0000","last_peered":"2023-10-08T07:10:01.902591+0000","last_clean":"2023-10-08T07:10:01.902591+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:10:01.902591+0000","last_undegraded":"2023-10-08T07:10:01.902591+0000","last_fullsized":"2023-10-08T07:10:01.902591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:01.902474+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:01.902474+0000","last_clean_scrub_stamp":"2023-10-08T07:10:01.902474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:20.949826+0000","scrub_duration":0.001921706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:08.963139+0000","last_change":"2023-10-08T07:10:08.963139+0000","last_active":"2023-10-08T07:10:08.963139+0000","last_peered":"2023-10-08T07:10:08.963139+0000","last_clean":"2023-10-08T07:10:08.963139+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:10:08.963139+0000","last_undegraded":"2023-10-08T07:10:08.963139+0000","last_fullsized":"2023-10-08T07:10:08.963139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:08.962981+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:08.962981+0000","last_clean_scrub_stamp":"2023-10-08T07:10:08.962981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:20.893734+0000","scrub_duration":0.0026257540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5899,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:44.651612+0000","last_change":"2023-10-08T07:10:44.651612+0000","last_active":"2023-10-08T07:10:44.651612+0000","last_peered":"2023-10-08T07:10:44.651612+0000","last_clean":"2023-10-08T07:10:44.651612+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:10:44.651612+0000","last_undegraded":"2023-10-08T07:10:44.651612+0000","last_fullsized":"2023-10-08T07:10:44.651612+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5815","last_scrub_stamp":"2023-10-08T07:10:44.651463+0000","last_deep_scrub":"67'5815","last_deep_scrub_stamp":"2023-10-08T07:10:44.651463+0000","last_clean_scrub_stamp":"2023-10-08T07:10:44.651463+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:50.033791+0000","scrub_duration":0.0026907989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8581,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:06.916355+0000","last_change":"2023-10-08T07:10:06.916355+0000","last_active":"2023-10-08T07:10:06.916355+0000","last_peered":"2023-10-08T07:10:06.916355+0000","last_clean":"2023-10-08T07:10:06.916355+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:10:06.916355+0000","last_undegraded":"2023-10-08T07:10:06.916355+0000","last_fullsized":"2023-10-08T07:10:06.916355+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8487","last_scrub_stamp":"2023-10-08T07:10:06.916118+0000","last_deep_scrub":"67'8487","last_deep_scrub_stamp":"2023-10-08T07:10:06.916118+0000","last_clean_scrub_stamp":"2023-10-08T07:10:06.916118+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:55:34.602055+0000","scrub_duration":0.0043577499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.809212+0000","last_change":"2023-10-08T07:09:50.809212+0000","last_active":"2023-10-08T07:09:50.809212+0000","last_peered":"2023-10-08T07:09:50.809212+0000","last_clean":"2023-10-08T07:09:50.809212+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:50.809212+0000","last_undegraded":"2023-10-08T07:09:50.809212+0000","last_fullsized":"2023-10-08T07:09:50.809212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.808986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:57.252774+0000","scrub_duration":0.0027253220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3041,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:44.498596+0000","last_change":"2023-10-08T07:09:28.078167+0000","last_active":"2023-10-08T07:09:44.498596+0000","last_peered":"2023-10-08T07:09:44.498596+0000","last_clean":"2023-10-08T07:09:44.498596+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:09:44.498596+0000","last_undegraded":"2023-10-08T07:09:44.498596+0000","last_fullsized":"2023-10-08T07:09:44.498596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2893,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:48.261144+0000","last_change":"2023-10-08T07:09:48.261144+0000","last_active":"2023-10-08T07:09:48.261144+0000","last_peered":"2023-10-08T07:09:48.261144+0000","last_clean":"2023-10-08T07:09:48.261144+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:48.261144+0000","last_undegraded":"2023-10-08T07:09:48.261144+0000","last_fullsized":"2023-10-08T07:09:48.261144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2779","last_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_deep_scrub":"67'2779","last_deep_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_clean_scrub_stamp":"2023-10-08T07:09:48.260984+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:35.661462+0000","scrub_duration":0.0021476020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2966,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:15.720366+0000","last_change":"2023-10-08T07:11:15.720366+0000","last_active":"2023-10-08T07:11:15.720366+0000","last_peered":"2023-10-08T07:11:15.720366+0000","last_clean":"2023-10-08T07:11:15.720366+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:11:15.720366+0000","last_undegraded":"2023-10-08T07:11:15.720366+0000","last_fullsized":"2023-10-08T07:11:15.720366+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2888","last_scrub_stamp":"2023-10-08T07:11:15.720178+0000","last_deep_scrub":"67'2888","last_deep_scrub_stamp":"2023-10-08T07:11:15.720178+0000","last_clean_scrub_stamp":"2023-10-08T07:11:15.720178+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:50.380873+0000","scrub_duration":0.0025953560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:41.448823+0000","last_change":"2023-10-08T07:11:41.448907+0000","last_active":"2023-10-08T07:11:41.448823+0000","last_peered":"2023-10-08T07:11:41.448823+0000","last_clean":"2023-10-08T07:11:41.448823+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:11:41.448823+0000","last_undegraded":"2023-10-08T07:11:41.448823+0000","last_fullsized":"2023-10-08T07:11:41.448823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:11:41.448689+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:11:41.448689+0000","last_clean_scrub_stamp":"2023-10-08T07:11:41.448689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:24.101169+0000","scrub_duration":0.0022439249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2971,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.799195+0000","last_change":"2023-10-08T07:09:51.799195+0000","last_active":"2023-10-08T07:09:51.799195+0000","last_peered":"2023-10-08T07:09:51.799195+0000","last_clean":"2023-10-08T07:09:51.799195+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:51.799195+0000","last_undegraded":"2023-10-08T07:09:51.799195+0000","last_fullsized":"2023-10-08T07:09:51.799195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2893","last_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_deep_scrub":"67'2893","last_deep_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.798991+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:39.037371+0000","scrub_duration":0.0024056889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:27.710809+0000","last_change":"2023-10-08T07:10:27.710809+0000","last_active":"2023-10-08T07:10:27.710809+0000","last_peered":"2023-10-08T07:10:27.710809+0000","last_clean":"2023-10-08T07:10:27.710809+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:10:27.710809+0000","last_undegraded":"2023-10-08T07:10:27.710809+0000","last_fullsized":"2023-10-08T07:10:27.710809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:27.710670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:27.710670+0000","last_clean_scrub_stamp":"2023-10-08T07:10:27.710670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:51.076837+0000","scrub_duration":0.002419591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2987,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:37.459280+0000","last_change":"2023-10-08T07:11:37.459333+0000","last_active":"2023-10-08T07:11:37.459280+0000","last_peered":"2023-10-08T07:11:37.459280+0000","last_clean":"2023-10-08T07:11:37.459280+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:11:37.459280+0000","last_undegraded":"2023-10-08T07:11:37.459280+0000","last_fullsized":"2023-10-08T07:11:37.459280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2871","last_scrub_stamp":"2023-10-08T07:11:37.459145+0000","last_deep_scrub":"67'2871","last_deep_scrub_stamp":"2023-10-08T07:11:37.459145+0000","last_clean_scrub_stamp":"2023-10-08T07:11:37.459145+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:36.878105+0000","scrub_duration":0.0024396470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5867,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:36.110557+0000","last_change":"2023-10-08T07:09:26.042339+0000","last_active":"2023-10-08T07:09:36.110557+0000","last_peered":"2023-10-08T07:09:36.110557+0000","last_clean":"2023-10-08T07:09:36.110557+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:09:36.110557+0000","last_undegraded":"2023-10-08T07:09:36.110557+0000","last_fullsized":"2023-10-08T07:09:36.110557+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:32.299112+0000","last_clean_scrub_stamp":"2023-10-08T07:05:32.299112+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2992,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:54.975424+0000","last_change":"2023-10-08T07:10:54.975485+0000","last_active":"2023-10-08T07:10:54.975424+0000","last_peered":"2023-10-08T07:10:54.975424+0000","last_clean":"2023-10-08T07:10:54.975424+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:10:54.975424+0000","last_undegraded":"2023-10-08T07:10:54.975424+0000","last_fullsized":"2023-10-08T07:10:54.975424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2898","last_scrub_stamp":"2023-10-08T07:10:54.975318+0000","last_deep_scrub":"67'2898","last_deep_scrub_stamp":"2023-10-08T07:10:54.975318+0000","last_clean_scrub_stamp":"2023-10-08T07:10:54.975318+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:44.044191+0000","scrub_duration":0.0030843680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2991,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:37.076414+0000","last_change":"2023-10-08T07:11:37.076477+0000","last_active":"2023-10-08T07:11:37.076414+0000","last_peered":"2023-10-08T07:11:37.076414+0000","last_clean":"2023-10-08T07:11:37.076414+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:11:37.076414+0000","last_undegraded":"2023-10-08T07:11:37.076414+0000","last_fullsized":"2023-10-08T07:11:37.076414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2877","last_scrub_stamp":"2023-10-08T07:11:37.076311+0000","last_deep_scrub":"67'2877","last_deep_scrub_stamp":"2023-10-08T07:11:37.076311+0000","last_clean_scrub_stamp":"2023-10-08T07:11:37.076311+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:36.378102+0000","scrub_duration":0.002185078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:54.718730+0000","last_change":"2023-10-08T07:10:54.718730+0000","last_active":"2023-10-08T07:10:54.718730+0000","last_peered":"2023-10-08T07:10:54.718730+0000","last_clean":"2023-10-08T07:10:54.718730+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:10:54.718730+0000","last_undegraded":"2023-10-08T07:10:54.718730+0000","last_fullsized":"2023-10-08T07:10:54.718730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:54.718583+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:54.718583+0000","last_clean_scrub_stamp":"2023-10-08T07:10:54.718583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:36.200157+0000","scrub_duration":0.002087308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2972,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:30.141172+0000","last_change":"2023-10-08T07:11:30.141220+0000","last_active":"2023-10-08T07:11:30.141172+0000","last_peered":"2023-10-08T07:11:30.141172+0000","last_clean":"2023-10-08T07:11:30.141172+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:11:30.141172+0000","last_undegraded":"2023-10-08T07:11:30.141172+0000","last_fullsized":"2023-10-08T07:11:30.141172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2858","last_scrub_stamp":"2023-10-08T07:11:30.141070+0000","last_deep_scrub":"67'2858","last_deep_scrub_stamp":"2023-10-08T07:11:30.141070+0000","last_clean_scrub_stamp":"2023-10-08T07:11:30.141070+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:33.526645+0000","scrub_duration":0.0022205079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2983,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:17.967333+0000","last_change":"2023-10-08T07:10:17.967390+0000","last_active":"2023-10-08T07:10:17.967333+0000","last_peered":"2023-10-08T07:10:17.967333+0000","last_clean":"2023-10-08T07:10:17.967333+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:10:17.967333+0000","last_undegraded":"2023-10-08T07:10:17.967333+0000","last_fullsized":"2023-10-08T07:10:17.967333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2889","last_scrub_stamp":"2023-10-08T07:10:17.967218+0000","last_deep_scrub":"67'2889","last_deep_scrub_stamp":"2023-10-08T07:10:17.967218+0000","last_clean_scrub_stamp":"2023-10-08T07:10:17.967218+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:31.882860+0000","scrub_duration":0.003096765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5902,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:50.041003+0000","last_change":"2023-10-08T07:10:50.041061+0000","last_active":"2023-10-08T07:10:50.041003+0000","last_peered":"2023-10-08T07:10:50.041003+0000","last_clean":"2023-10-08T07:10:50.041003+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:10:50.041003+0000","last_undegraded":"2023-10-08T07:10:50.041003+0000","last_fullsized":"2023-10-08T07:10:50.041003+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5808","last_scrub_stamp":"2023-10-08T07:10:50.040881+0000","last_deep_scrub":"67'5808","last_deep_scrub_stamp":"2023-10-08T07:10:50.040881+0000","last_clean_scrub_stamp":"2023-10-08T07:10:50.040881+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:24.160061+0000","scrub_duration":0.0032418830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2886,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:15.676084+0000","last_change":"2023-10-08T07:10:15.676084+0000","last_active":"2023-10-08T07:10:15.676084+0000","last_peered":"2023-10-08T07:10:15.676084+0000","last_clean":"2023-10-08T07:10:15.676084+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:10:15.676084+0000","last_undegraded":"2023-10-08T07:10:15.676084+0000","last_fullsized":"2023-10-08T07:10:15.676084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2808","last_scrub_stamp":"2023-10-08T07:10:15.675928+0000","last_deep_scrub":"67'2808","last_deep_scrub_stamp":"2023-10-08T07:10:15.675928+0000","last_clean_scrub_stamp":"2023-10-08T07:10:15.675928+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:38.425941+0000","scrub_duration":0.00268585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2991,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:49.238913+0000","last_change":"2023-10-08T07:09:49.238913+0000","last_active":"2023-10-08T07:09:49.238913+0000","last_peered":"2023-10-08T07:09:49.238913+0000","last_clean":"2023-10-08T07:09:49.238913+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:49.238913+0000","last_undegraded":"2023-10-08T07:09:49.238913+0000","last_fullsized":"2023-10-08T07:09:49.238913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2897","last_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_deep_scrub":"67'2897","last_deep_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_clean_scrub_stamp":"2023-10-08T07:09:49.238678+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:45:50.648559+0000","scrub_duration":0.0033918249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5847,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.780269+0000","last_change":"2023-10-08T07:09:58.780269+0000","last_active":"2023-10-08T07:09:58.780269+0000","last_peered":"2023-10-08T07:09:58.780269+0000","last_clean":"2023-10-08T07:09:58.780269+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:58.780269+0000","last_undegraded":"2023-10-08T07:09:58.780269+0000","last_fullsized":"2023-10-08T07:09:58.780269+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5763","last_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_deep_scrub":"67'5763","last_deep_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.780116+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:40.304910+0000","scrub_duration":0.0028329620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2966,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:20.660569+0000","last_change":"2023-10-08T07:11:20.660569+0000","last_active":"2023-10-08T07:11:20.660569+0000","last_peered":"2023-10-08T07:11:20.660569+0000","last_clean":"2023-10-08T07:11:20.660569+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:11:20.660569+0000","last_undegraded":"2023-10-08T07:11:20.660569+0000","last_fullsized":"2023-10-08T07:11:20.660569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2888","last_scrub_stamp":"2023-10-08T07:11:20.660364+0000","last_deep_scrub":"67'2888","last_deep_scrub_stamp":"2023-10-08T07:11:20.660364+0000","last_clean_scrub_stamp":"2023-10-08T07:11:20.660364+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:40.092072+0000","scrub_duration":0.0024428240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2984,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:20.454198+0000","last_change":"2023-10-08T07:10:20.454247+0000","last_active":"2023-10-08T07:10:20.454198+0000","last_peered":"2023-10-08T07:10:20.454198+0000","last_clean":"2023-10-08T07:10:20.454198+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:10:20.454198+0000","last_undegraded":"2023-10-08T07:10:20.454198+0000","last_fullsized":"2023-10-08T07:10:20.454198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2890","last_scrub_stamp":"2023-10-08T07:10:20.454059+0000","last_deep_scrub":"67'2890","last_deep_scrub_stamp":"2023-10-08T07:10:20.454059+0000","last_clean_scrub_stamp":"2023-10-08T07:10:20.454059+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:00.814028+0000","scrub_duration":0.0034117829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.846882+0000","last_change":"2023-10-08T07:09:56.846960+0000","last_active":"2023-10-08T07:09:56.846882+0000","last_peered":"2023-10-08T07:09:56.846882+0000","last_clean":"2023-10-08T07:09:56.846882+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:56.846882+0000","last_undegraded":"2023-10-08T07:09:56.846882+0000","last_fullsized":"2023-10-08T07:09:56.846882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.846797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:30.858022+0000","scrub_duration":0.0019930149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:52.736039+0000","last_change":"2023-10-08T07:10:52.736039+0000","last_active":"2023-10-08T07:10:52.736039+0000","last_peered":"2023-10-08T07:10:52.736039+0000","last_clean":"2023-10-08T07:10:52.736039+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:10:52.736039+0000","last_undegraded":"2023-10-08T07:10:52.736039+0000","last_fullsized":"2023-10-08T07:10:52.736039+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:10:52.735818+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:10:52.735818+0000","last_clean_scrub_stamp":"2023-10-08T07:10:52.735818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:10.360832+0000","scrub_duration":0.002026103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.785826+0000","last_change":"2023-10-08T07:09:56.785826+0000","last_active":"2023-10-08T07:09:56.785826+0000","last_peered":"2023-10-08T07:09:56.785826+0000","last_clean":"2023-10-08T07:09:56.785826+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:56.785826+0000","last_undegraded":"2023-10-08T07:09:56.785826+0000","last_fullsized":"2023-10-08T07:09:56.785826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.785595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:34.531648+0000","scrub_duration":0.002195621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:56.475740+0000","last_change":"2023-10-08T07:10:56.475786+0000","last_active":"2023-10-08T07:10:56.475740+0000","last_peered":"2023-10-08T07:10:56.475740+0000","last_clean":"2023-10-08T07:10:56.475740+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:10:56.475740+0000","last_undegraded":"2023-10-08T07:10:56.475740+0000","last_fullsized":"2023-10-08T07:10:56.475740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:56.475635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:56.475635+0000","last_clean_scrub_stamp":"2023-10-08T07:10:56.475635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:57.868976+0000","scrub_duration":0.0020186980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:04.363638+0000","last_change":"2023-10-08T07:10:04.363638+0000","last_active":"2023-10-08T07:10:04.363638+0000","last_peered":"2023-10-08T07:10:04.363638+0000","last_clean":"2023-10-08T07:10:04.363638+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:10:04.363638+0000","last_undegraded":"2023-10-08T07:10:04.363638+0000","last_fullsized":"2023-10-08T07:10:04.363638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:04.363441+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:04.363441+0000","last_clean_scrub_stamp":"2023-10-08T07:10:04.363441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:25.507425+0000","scrub_duration":0.0036677139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:22.504516+0000","last_change":"2023-10-08T07:10:22.504516+0000","last_active":"2023-10-08T07:10:22.504516+0000","last_peered":"2023-10-08T07:10:22.504516+0000","last_clean":"2023-10-08T07:10:22.504516+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:10:22.504516+0000","last_undegraded":"2023-10-08T07:10:22.504516+0000","last_fullsized":"2023-10-08T07:10:22.504516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:22.504358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:22.504358+0000","last_clean_scrub_stamp":"2023-10-08T07:10:22.504358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:36.534493+0000","scrub_duration":0.001785551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3035,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:28.713074+0000","last_change":"2023-10-08T07:11:28.713128+0000","last_active":"2023-10-08T07:11:28.713074+0000","last_peered":"2023-10-08T07:11:28.713074+0000","last_clean":"2023-10-08T07:11:28.713074+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:11:28.713074+0000","last_undegraded":"2023-10-08T07:11:28.713074+0000","last_fullsized":"2023-10-08T07:11:28.713074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2957","last_scrub_stamp":"2023-10-08T07:11:28.712943+0000","last_deep_scrub":"67'2957","last_deep_scrub_stamp":"2023-10-08T07:11:28.712943+0000","last_clean_scrub_stamp":"2023-10-08T07:11:28.712943+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:46.065381+0000","scrub_duration":0.0020660650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.183794+0000","last_change":"2023-10-08T07:09:56.183794+0000","last_active":"2023-10-08T07:09:56.183794+0000","last_peered":"2023-10-08T07:09:56.183794+0000","last_clean":"2023-10-08T07:09:56.183794+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:56.183794+0000","last_undegraded":"2023-10-08T07:09:56.183794+0000","last_fullsized":"2023-10-08T07:09:56.183794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_deep_scrub":"66'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.183634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:57:57.773772+0000","scrub_duration":0.0020570499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5835,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:32.072686+0000","last_change":"2023-10-08T07:11:32.072736+0000","last_active":"2023-10-08T07:11:32.072686+0000","last_peered":"2023-10-08T07:11:32.072686+0000","last_clean":"2023-10-08T07:11:32.072686+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:11:32.072686+0000","last_undegraded":"2023-10-08T07:11:32.072686+0000","last_fullsized":"2023-10-08T07:11:32.072686+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5721","last_scrub_stamp":"2023-10-08T07:11:32.072591+0000","last_deep_scrub":"67'5721","last_deep_scrub_stamp":"2023-10-08T07:11:32.072591+0000","last_clean_scrub_stamp":"2023-10-08T07:11:32.072591+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:14:43.621587+0000","scrub_duration":0.0024425850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:31.244267+0000","last_change":"2023-10-08T07:11:31.244341+0000","last_active":"2023-10-08T07:11:31.244267+0000","last_peered":"2023-10-08T07:11:31.244267+0000","last_clean":"2023-10-08T07:11:31.244267+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:11:31.244267+0000","last_undegraded":"2023-10-08T07:11:31.244267+0000","last_fullsized":"2023-10-08T07:11:31.244267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:31.244107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:31.244107+0000","last_clean_scrub_stamp":"2023-10-08T07:11:31.244107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:57.412045+0000","scrub_duration":0.0020999299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2951,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:07.391860+0000","last_change":"2023-10-08T07:10:07.391860+0000","last_active":"2023-10-08T07:10:07.391860+0000","last_peered":"2023-10-08T07:10:07.391860+0000","last_clean":"2023-10-08T07:10:07.391860+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:10:07.391860+0000","last_undegraded":"2023-10-08T07:10:07.391860+0000","last_fullsized":"2023-10-08T07:10:07.391860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2857","last_scrub_stamp":"2023-10-08T07:10:07.391617+0000","last_deep_scrub":"67'2857","last_deep_scrub_stamp":"2023-10-08T07:10:07.391617+0000","last_clean_scrub_stamp":"2023-10-08T07:10:07.391617+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:07.864957+0000","scrub_duration":0.0030912190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"91'9","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:40.662587+0000","last_change":"2023-10-08T07:10:40.662587+0000","last_active":"2023-10-08T07:10:40.662587+0000","last_peered":"2023-10-08T07:10:40.662587+0000","last_clean":"2023-10-08T07:10:40.662587+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:10:40.662587+0000","last_undegraded":"2023-10-08T07:10:40.662587+0000","last_fullsized":"2023-10-08T07:10:40.662587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2023-10-08T07:10:40.662409+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2023-10-08T07:10:40.662409+0000","last_clean_scrub_stamp":"2023-10-08T07:10:40.662409+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:47.613277+0000","scrub_duration":0.0039694750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.205001+0000","last_change":"2023-10-08T07:09:50.205001+0000","last_active":"2023-10-08T07:09:50.205001+0000","last_peered":"2023-10-08T07:09:50.205001+0000","last_clean":"2023-10-08T07:09:50.205001+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:50.205001+0000","last_undegraded":"2023-10-08T07:09:50.205001+0000","last_fullsized":"2023-10-08T07:09:50.205001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'3","last_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_deep_scrub":"66'3","last_deep_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.204815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:31.664355+0000","scrub_duration":0.0019594320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"91'90","reported_seq":203,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:27.323897+0000","last_change":"2023-10-08T07:11:27.324009+0000","last_active":"2023-10-08T07:11:27.323897+0000","last_peered":"2023-10-08T07:11:27.323897+0000","last_clean":"2023-10-08T07:11:27.323897+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:11:27.323897+0000","last_undegraded":"2023-10-08T07:11:27.323897+0000","last_fullsized":"2023-10-08T07:11:27.323897+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'90","last_scrub_stamp":"2023-10-08T07:11:27.323789+0000","last_deep_scrub":"91'90","last_deep_scrub_stamp":"2023-10-08T07:11:27.323789+0000","last_clean_scrub_stamp":"2023-10-08T07:11:27.323789+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:28:41.092087+0000","scrub_duration":0.0064926289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2958,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:05.926577+0000","last_change":"2023-10-08T07:10:05.926577+0000","last_active":"2023-10-08T07:10:05.926577+0000","last_peered":"2023-10-08T07:10:05.926577+0000","last_clean":"2023-10-08T07:10:05.926577+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:10:05.926577+0000","last_undegraded":"2023-10-08T07:10:05.926577+0000","last_fullsized":"2023-10-08T07:10:05.926577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2841","last_scrub_stamp":"2023-10-08T07:10:05.926418+0000","last_deep_scrub":"67'2841","last_deep_scrub_stamp":"2023-10-08T07:10:05.926418+0000","last_clean_scrub_stamp":"2023-10-08T07:10:05.926418+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:07.516556+0000","scrub_duration":0.0027102820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"91'4","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:51.976716+0000","last_change":"2023-10-08T07:10:51.976777+0000","last_active":"2023-10-08T07:10:51.976716+0000","last_peered":"2023-10-08T07:10:51.976716+0000","last_clean":"2023-10-08T07:10:51.976716+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:10:51.976716+0000","last_undegraded":"2023-10-08T07:10:51.976716+0000","last_fullsized":"2023-10-08T07:10:51.976716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:10:51.976599+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:10:51.976599+0000","last_clean_scrub_stamp":"2023-10-08T07:10:51.976599+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:39.729393+0000","scrub_duration":0.0041755680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2953,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:16.695184+0000","last_change":"2023-10-08T07:11:16.695184+0000","last_active":"2023-10-08T07:11:16.695184+0000","last_peered":"2023-10-08T07:11:16.695184+0000","last_clean":"2023-10-08T07:11:16.695184+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:11:16.695184+0000","last_undegraded":"2023-10-08T07:11:16.695184+0000","last_fullsized":"2023-10-08T07:11:16.695184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2875","last_scrub_stamp":"2023-10-08T07:11:16.695045+0000","last_deep_scrub":"67'2875","last_deep_scrub_stamp":"2023-10-08T07:11:16.695045+0000","last_clean_scrub_stamp":"2023-10-08T07:11:16.695045+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:09.511327+0000","scrub_duration":0.0024567220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:59.504119+0000","last_change":"2023-10-08T07:10:59.504215+0000","last_active":"2023-10-08T07:10:59.504119+0000","last_peered":"2023-10-08T07:10:59.504119+0000","last_clean":"2023-10-08T07:10:59.504119+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:10:59.504119+0000","last_undegraded":"2023-10-08T07:10:59.504119+0000","last_fullsized":"2023-10-08T07:10:59.504119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:59.504012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:59.504012+0000","last_clean_scrub_stamp":"2023-10-08T07:10:59.504012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:51:50.766230+0000","scrub_duration":0.0016614209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8832,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:24.713295+0000","last_change":"2023-10-08T07:11:24.713295+0000","last_active":"2023-10-08T07:11:24.713295+0000","last_peered":"2023-10-08T07:11:24.713295+0000","last_clean":"2023-10-08T07:11:24.713295+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:11:24.713295+0000","last_undegraded":"2023-10-08T07:11:24.713295+0000","last_fullsized":"2023-10-08T07:11:24.713295+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8742","last_scrub_stamp":"2023-10-08T07:11:24.713102+0000","last_deep_scrub":"67'8742","last_deep_scrub_stamp":"2023-10-08T07:11:24.713102+0000","last_clean_scrub_stamp":"2023-10-08T07:11:24.713102+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:15.657707+0000","scrub_duration":0.0024625300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:47.711265+0000","last_change":"2023-10-08T07:10:47.711265+0000","last_active":"2023-10-08T07:10:47.711265+0000","last_peered":"2023-10-08T07:10:47.711265+0000","last_clean":"2023-10-08T07:10:47.711265+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:10:47.711265+0000","last_undegraded":"2023-10-08T07:10:47.711265+0000","last_fullsized":"2023-10-08T07:10:47.711265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:47.711101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:47.711101+0000","last_clean_scrub_stamp":"2023-10-08T07:10:47.711101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:44:42.808700+0000","scrub_duration":0.001740978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2934,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:15.518408+0000","last_change":"2023-10-08T07:10:15.518408+0000","last_active":"2023-10-08T07:10:15.518408+0000","last_peered":"2023-10-08T07:10:15.518408+0000","last_clean":"2023-10-08T07:10:15.518408+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:10:15.518408+0000","last_undegraded":"2023-10-08T07:10:15.518408+0000","last_fullsized":"2023-10-08T07:10:15.518408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2840","last_scrub_stamp":"2023-10-08T07:10:15.518167+0000","last_deep_scrub":"67'2840","last_deep_scrub_stamp":"2023-10-08T07:10:15.518167+0000","last_clean_scrub_stamp":"2023-10-08T07:10:15.518167+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:47.143209+0000","scrub_duration":0.0035381470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"91'13","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.954538+0000","last_change":"2023-10-08T07:10:36.954611+0000","last_active":"2023-10-08T07:10:36.954538+0000","last_peered":"2023-10-08T07:10:36.954538+0000","last_clean":"2023-10-08T07:10:36.954538+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:10:36.954538+0000","last_undegraded":"2023-10-08T07:10:36.954538+0000","last_fullsized":"2023-10-08T07:10:36.954538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'13","last_scrub_stamp":"2023-10-08T07:10:36.954426+0000","last_deep_scrub":"91'13","last_deep_scrub_stamp":"2023-10-08T07:10:36.954426+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.954426+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:38.169926+0000","scrub_duration":0.0097942589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:28.367071+0000","last_change":"2023-10-08T07:10:28.367120+0000","last_active":"2023-10-08T07:10:28.367071+0000","last_peered":"2023-10-08T07:10:28.367071+0000","last_clean":"2023-10-08T07:10:28.367071+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:10:28.367071+0000","last_undegraded":"2023-10-08T07:10:28.367071+0000","last_fullsized":"2023-10-08T07:10:28.367071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:28.366970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:28.366970+0000","last_clean_scrub_stamp":"2023-10-08T07:10:28.366970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:27.637172+0000","scrub_duration":0.0029471160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"91'2","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:56.966275+0000","last_change":"2023-10-08T07:10:56.966328+0000","last_active":"2023-10-08T07:10:56.966275+0000","last_peered":"2023-10-08T07:10:56.966275+0000","last_clean":"2023-10-08T07:10:56.966275+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:10:56.966275+0000","last_undegraded":"2023-10-08T07:10:56.966275+0000","last_fullsized":"2023-10-08T07:10:56.966275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2023-10-08T07:10:56.966171+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2023-10-08T07:10:56.966171+0000","last_clean_scrub_stamp":"2023-10-08T07:10:56.966171+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:51:48.228389+0000","scrub_duration":0.0038520659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:03.716700+0000","last_change":"2023-10-08T07:11:03.716700+0000","last_active":"2023-10-08T07:11:03.716700+0000","last_peered":"2023-10-08T07:11:03.716700+0000","last_clean":"2023-10-08T07:11:03.716700+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:11:03.716700+0000","last_undegraded":"2023-10-08T07:11:03.716700+0000","last_fullsized":"2023-10-08T07:11:03.716700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:03.716560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:03.716560+0000","last_clean_scrub_stamp":"2023-10-08T07:11:03.716560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:17.194562+0000","scrub_duration":0.0024862790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:01.721235+0000","last_change":"2023-10-08T07:10:01.721235+0000","last_active":"2023-10-08T07:10:01.721235+0000","last_peered":"2023-10-08T07:10:01.721235+0000","last_clean":"2023-10-08T07:10:01.721235+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:10:01.721235+0000","last_undegraded":"2023-10-08T07:10:01.721235+0000","last_fullsized":"2023-10-08T07:10:01.721235+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2023-10-08T07:10:01.721055+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2023-10-08T07:10:01.721055+0000","last_clean_scrub_stamp":"2023-10-08T07:10:01.721055+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:38.621496+0000","scrub_duration":0.0061286539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3010,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:03.673316+0000","last_change":"2023-10-08T07:10:03.673316+0000","last_active":"2023-10-08T07:10:03.673316+0000","last_peered":"2023-10-08T07:10:03.673316+0000","last_clean":"2023-10-08T07:10:03.673316+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:10:03.673316+0000","last_undegraded":"2023-10-08T07:10:03.673316+0000","last_fullsized":"2023-10-08T07:10:03.673316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2932","last_scrub_stamp":"2023-10-08T07:10:03.673166+0000","last_deep_scrub":"67'2932","last_deep_scrub_stamp":"2023-10-08T07:10:03.673166+0000","last_clean_scrub_stamp":"2023-10-08T07:10:03.673166+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:45:38.773848+0000","scrub_duration":0.0023330069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:26.956810+0000","last_change":"2023-10-08T07:10:26.956867+0000","last_active":"2023-10-08T07:10:26.956810+0000","last_peered":"2023-10-08T07:10:26.956810+0000","last_clean":"2023-10-08T07:10:26.956810+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:10:26.956810+0000","last_undegraded":"2023-10-08T07:10:26.956810+0000","last_fullsized":"2023-10-08T07:10:26.956810+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2023-10-08T07:10:26.956714+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2023-10-08T07:10:26.956714+0000","last_clean_scrub_stamp":"2023-10-08T07:10:26.956714+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:41.451138+0000","scrub_duration":0.0040178289999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2957,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:29.955939+0000","last_change":"2023-10-08T07:10:29.956001+0000","last_active":"2023-10-08T07:10:29.955939+0000","last_peered":"2023-10-08T07:10:29.955939+0000","last_clean":"2023-10-08T07:10:29.955939+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:10:29.955939+0000","last_undegraded":"2023-10-08T07:10:29.955939+0000","last_fullsized":"2023-10-08T07:10:29.955939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2863","last_scrub_stamp":"2023-10-08T07:10:29.955814+0000","last_deep_scrub":"67'2863","last_deep_scrub_stamp":"2023-10-08T07:10:29.955814+0000","last_clean_scrub_stamp":"2023-10-08T07:10:29.955814+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:43.985949+0000","scrub_duration":0.0033374920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:35.385631+0000","last_change":"2023-10-08T07:11:35.385684+0000","last_active":"2023-10-08T07:11:35.385631+0000","last_peered":"2023-10-08T07:11:35.385631+0000","last_clean":"2023-10-08T07:11:35.385631+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:11:35.385631+0000","last_undegraded":"2023-10-08T07:11:35.385631+0000","last_fullsized":"2023-10-08T07:11:35.385631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:35.385522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:35.385522+0000","last_clean_scrub_stamp":"2023-10-08T07:11:35.385522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:23.756186+0000","scrub_duration":0.0018716589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":3002,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.177449+0000","last_change":"2023-10-08T07:09:51.177449+0000","last_active":"2023-10-08T07:09:51.177449+0000","last_peered":"2023-10-08T07:09:51.177449+0000","last_clean":"2023-10-08T07:09:51.177449+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:51.177449+0000","last_undegraded":"2023-10-08T07:09:51.177449+0000","last_fullsized":"2023-10-08T07:09:51.177449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2908","last_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_deep_scrub":"67'2908","last_deep_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.177304+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:24.847471+0000","scrub_duration":0.0043549410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'4","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:01.413711+0000","last_change":"2023-10-08T07:11:01.413760+0000","last_active":"2023-10-08T07:11:01.413711+0000","last_peered":"2023-10-08T07:11:01.413711+0000","last_clean":"2023-10-08T07:11:01.413711+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:11:01.413711+0000","last_undegraded":"2023-10-08T07:11:01.413711+0000","last_fullsized":"2023-10-08T07:11:01.413711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:11:01.413615+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:11:01.413615+0000","last_clean_scrub_stamp":"2023-10-08T07:11:01.413615+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:07.522439+0000","scrub_duration":0.0035531170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5940,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.877374+0000","last_change":"2023-10-08T07:09:58.877374+0000","last_active":"2023-10-08T07:09:58.877374+0000","last_peered":"2023-10-08T07:09:58.877374+0000","last_clean":"2023-10-08T07:09:58.877374+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:58.877374+0000","last_undegraded":"2023-10-08T07:09:58.877374+0000","last_fullsized":"2023-10-08T07:09:58.877374+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5846","last_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_deep_scrub":"67'5846","last_deep_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.877221+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.287679+0000","scrub_duration":0.0031762159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:34.990831+0000","last_change":"2023-10-08T07:10:34.990887+0000","last_active":"2023-10-08T07:10:34.990831+0000","last_peered":"2023-10-08T07:10:34.990831+0000","last_clean":"2023-10-08T07:10:34.990831+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:10:34.990831+0000","last_undegraded":"2023-10-08T07:10:34.990831+0000","last_fullsized":"2023-10-08T07:10:34.990831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:34.990723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:34.990723+0000","last_clean_scrub_stamp":"2023-10-08T07:10:34.990723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:34.260924+0000","scrub_duration":0.0019640790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:37.996096+0000","last_change":"2023-10-08T07:10:37.996151+0000","last_active":"2023-10-08T07:10:37.996096+0000","last_peered":"2023-10-08T07:10:37.996096+0000","last_clean":"2023-10-08T07:10:37.996096+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:10:37.996096+0000","last_undegraded":"2023-10-08T07:10:37.996096+0000","last_fullsized":"2023-10-08T07:10:37.996096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:37.995993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:37.995993+0000","last_clean_scrub_stamp":"2023-10-08T07:10:37.995993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:06.897411+0000","scrub_duration":0.0020275480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:06.723751+0000","last_change":"2023-10-08T07:11:06.723751+0000","last_active":"2023-10-08T07:11:06.723751+0000","last_peered":"2023-10-08T07:11:06.723751+0000","last_clean":"2023-10-08T07:11:06.723751+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:11:06.723751+0000","last_undegraded":"2023-10-08T07:11:06.723751+0000","last_fullsized":"2023-10-08T07:11:06.723751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:06.723539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:06.723539+0000","last_clean_scrub_stamp":"2023-10-08T07:11:06.723539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:55.594128+0000","scrub_duration":0.0018006879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5945,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:39.461118+0000","last_change":"2023-10-08T07:11:39.461170+0000","last_active":"2023-10-08T07:11:39.461118+0000","last_peered":"2023-10-08T07:11:39.461118+0000","last_clean":"2023-10-08T07:11:39.461118+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:11:39.461118+0000","last_undegraded":"2023-10-08T07:11:39.461118+0000","last_fullsized":"2023-10-08T07:11:39.461118+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5831","last_scrub_stamp":"2023-10-08T07:11:39.461014+0000","last_deep_scrub":"67'5831","last_deep_scrub_stamp":"2023-10-08T07:11:39.461014+0000","last_clean_scrub_stamp":"2023-10-08T07:11:39.461014+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:37:39.747194+0000","scrub_duration":0.002811296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:45.649710+0000","last_change":"2023-10-08T07:10:45.649710+0000","last_active":"2023-10-08T07:10:45.649710+0000","last_peered":"2023-10-08T07:10:45.649710+0000","last_clean":"2023-10-08T07:10:45.649710+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:10:45.649710+0000","last_undegraded":"2023-10-08T07:10:45.649710+0000","last_fullsized":"2023-10-08T07:10:45.649710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:45.649532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:45.649532+0000","last_clean_scrub_stamp":"2023-10-08T07:10:45.649532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:26.132541+0000","scrub_duration":0.0019874580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2960,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:39.152468+0000","last_change":"2023-10-08T07:11:39.152515+0000","last_active":"2023-10-08T07:11:39.152468+0000","last_peered":"2023-10-08T07:11:39.152468+0000","last_clean":"2023-10-08T07:11:39.152468+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:11:39.152468+0000","last_undegraded":"2023-10-08T07:11:39.152468+0000","last_fullsized":"2023-10-08T07:11:39.152468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2846","last_scrub_stamp":"2023-10-08T07:11:39.152360+0000","last_deep_scrub":"67'2846","last_deep_scrub_stamp":"2023-10-08T07:11:39.152360+0000","last_clean_scrub_stamp":"2023-10-08T07:11:39.152360+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:49.012464+0000","scrub_duration":0.0021660099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:53.453369+0000","last_change":"2023-10-08T07:10:53.453369+0000","last_active":"2023-10-08T07:10:53.453369+0000","last_peered":"2023-10-08T07:10:53.453369+0000","last_clean":"2023-10-08T07:10:53.453369+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:10:53.453369+0000","last_undegraded":"2023-10-08T07:10:53.453369+0000","last_fullsized":"2023-10-08T07:10:53.453369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:53.453181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:53.453181+0000","last_clean_scrub_stamp":"2023-10-08T07:10:53.453181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:27.290354+0000","scrub_duration":0.002075145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:18.987300+0000","last_change":"2023-10-08T07:10:18.987348+0000","last_active":"2023-10-08T07:10:18.987300+0000","last_peered":"2023-10-08T07:10:18.987300+0000","last_clean":"2023-10-08T07:10:18.987300+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:10:18.987300+0000","last_undegraded":"2023-10-08T07:10:18.987300+0000","last_fullsized":"2023-10-08T07:10:18.987300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:18.987171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:18.987171+0000","last_clean_scrub_stamp":"2023-10-08T07:10:18.987171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:50.612213+0000","scrub_duration":0.0022629809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5861,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:25.718202+0000","last_change":"2023-10-08T07:10:25.718202+0000","last_active":"2023-10-08T07:10:25.718202+0000","last_peered":"2023-10-08T07:10:25.718202+0000","last_clean":"2023-10-08T07:10:25.718202+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:10:25.718202+0000","last_undegraded":"2023-10-08T07:10:25.718202+0000","last_fullsized":"2023-10-08T07:10:25.718202+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5777","last_scrub_stamp":"2023-10-08T07:10:25.718038+0000","last_deep_scrub":"67'5777","last_deep_scrub_stamp":"2023-10-08T07:10:25.718038+0000","last_clean_scrub_stamp":"2023-10-08T07:10:25.718038+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:11.338172+0000","scrub_duration":0.0025969640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:17.091890+0000","last_change":"2023-10-08T07:11:17.091890+0000","last_active":"2023-10-08T07:11:17.091890+0000","last_peered":"2023-10-08T07:11:17.091890+0000","last_clean":"2023-10-08T07:11:17.091890+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:11:17.091890+0000","last_undegraded":"2023-10-08T07:11:17.091890+0000","last_fullsized":"2023-10-08T07:11:17.091890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:17.091711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:17.091711+0000","last_clean_scrub_stamp":"2023-10-08T07:11:17.091711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:12.124209+0000","scrub_duration":0.0021563580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:47.997985+0000","last_change":"2023-10-08T07:10:47.998055+0000","last_active":"2023-10-08T07:10:47.997985+0000","last_peered":"2023-10-08T07:10:47.997985+0000","last_clean":"2023-10-08T07:10:47.997985+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:10:47.997985+0000","last_undegraded":"2023-10-08T07:10:47.997985+0000","last_fullsized":"2023-10-08T07:10:47.997985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:47.997873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:47.997873+0000","last_clean_scrub_stamp":"2023-10-08T07:10:47.997873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:35.775296+0000","scrub_duration":0.0020812069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2968,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:31.102928+0000","last_change":"2023-10-08T07:11:31.102978+0000","last_active":"2023-10-08T07:11:31.102928+0000","last_peered":"2023-10-08T07:11:31.102928+0000","last_clean":"2023-10-08T07:11:31.102928+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:11:31.102928+0000","last_undegraded":"2023-10-08T07:11:31.102928+0000","last_fullsized":"2023-10-08T07:11:31.102928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2854","last_scrub_stamp":"2023-10-08T07:11:31.102824+0000","last_deep_scrub":"67'2854","last_deep_scrub_stamp":"2023-10-08T07:11:31.102824+0000","last_clean_scrub_stamp":"2023-10-08T07:11:31.102824+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:23.151603+0000","scrub_duration":0.002145068,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.424976+0000","last_change":"2023-10-08T07:10:36.424976+0000","last_active":"2023-10-08T07:10:36.424976+0000","last_peered":"2023-10-08T07:10:36.424976+0000","last_clean":"2023-10-08T07:10:36.424976+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:10:36.424976+0000","last_undegraded":"2023-10-08T07:10:36.424976+0000","last_fullsized":"2023-10-08T07:10:36.424976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:36.424768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:36.424768+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.424768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:46.936565+0000","scrub_duration":0.001635028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:04.640857+0000","last_change":"2023-10-08T07:10:04.640857+0000","last_active":"2023-10-08T07:10:04.640857+0000","last_peered":"2023-10-08T07:10:04.640857+0000","last_clean":"2023-10-08T07:10:04.640857+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:10:04.640857+0000","last_undegraded":"2023-10-08T07:10:04.640857+0000","last_fullsized":"2023-10-08T07:10:04.640857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:04.640672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:04.640672+0000","last_clean_scrub_stamp":"2023-10-08T07:10:04.640672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:31:07.525494+0000","scrub_duration":0.002134164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8927,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:41.160317+0000","last_change":"2023-10-08T07:11:41.160365+0000","last_active":"2023-10-08T07:11:41.160317+0000","last_peered":"2023-10-08T07:11:41.160317+0000","last_clean":"2023-10-08T07:11:41.160317+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:11:41.160317+0000","last_undegraded":"2023-10-08T07:11:41.160317+0000","last_fullsized":"2023-10-08T07:11:41.160317+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8813","last_scrub_stamp":"2023-10-08T07:11:41.160199+0000","last_deep_scrub":"67'8813","last_deep_scrub_stamp":"2023-10-08T07:11:41.160199+0000","last_clean_scrub_stamp":"2023-10-08T07:11:41.160199+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:53:04.959395+0000","scrub_duration":0.0021911629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:22.226159+0000","last_change":"2023-10-08T07:11:22.226159+0000","last_active":"2023-10-08T07:11:22.226159+0000","last_peered":"2023-10-08T07:11:22.226159+0000","last_clean":"2023-10-08T07:11:22.226159+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:11:22.226159+0000","last_undegraded":"2023-10-08T07:11:22.226159+0000","last_fullsized":"2023-10-08T07:11:22.226159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:22.225988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:22.225988+0000","last_clean_scrub_stamp":"2023-10-08T07:11:22.225988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:16.913069+0000","scrub_duration":0.001846252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"91'159","reported_seq":311,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:02.005133+0000","last_change":"2023-10-08T07:11:02.005133+0000","last_active":"2023-10-08T07:11:02.005133+0000","last_peered":"2023-10-08T07:11:02.005133+0000","last_clean":"2023-10-08T07:11:02.005133+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:11:02.005133+0000","last_undegraded":"2023-10-08T07:11:02.005133+0000","last_fullsized":"2023-10-08T07:11:02.005133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'159","last_scrub_stamp":"2023-10-08T07:11:02.004931+0000","last_deep_scrub":"91'159","last_deep_scrub_stamp":"2023-10-08T07:11:02.004931+0000","last_clean_scrub_stamp":"2023-10-08T07:11:02.004931+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:07.761573+0000","scrub_duration":0.0067731960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:14.490905+0000","last_change":"2023-10-08T07:10:14.490962+0000","last_active":"2023-10-08T07:10:14.490905+0000","last_peered":"2023-10-08T07:10:14.490905+0000","last_clean":"2023-10-08T07:10:14.490905+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:10:14.490905+0000","last_undegraded":"2023-10-08T07:10:14.490905+0000","last_fullsized":"2023-10-08T07:10:14.490905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:14.490798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:14.490798+0000","last_clean_scrub_stamp":"2023-10-08T07:10:14.490798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:50.710326+0000","scrub_duration":0.0018705449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5912,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:38.484377+0000","last_change":"2023-10-08T07:11:38.484457+0000","last_active":"2023-10-08T07:11:38.484377+0000","last_peered":"2023-10-08T07:11:38.484377+0000","last_clean":"2023-10-08T07:11:38.484377+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:11:38.484377+0000","last_undegraded":"2023-10-08T07:11:38.484377+0000","last_fullsized":"2023-10-08T07:11:38.484377+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5798","last_scrub_stamp":"2023-10-08T07:11:38.484223+0000","last_deep_scrub":"67'5798","last_deep_scrub_stamp":"2023-10-08T07:11:38.484223+0000","last_clean_scrub_stamp":"2023-10-08T07:11:38.484223+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:16.800596+0000","scrub_duration":0.0022464609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:14.101830+0000","last_change":"2023-10-08T07:11:14.101830+0000","last_active":"2023-10-08T07:11:14.101830+0000","last_peered":"2023-10-08T07:11:14.101830+0000","last_clean":"2023-10-08T07:11:14.101830+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:11:14.101830+0000","last_undegraded":"2023-10-08T07:11:14.101830+0000","last_fullsized":"2023-10-08T07:11:14.101830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:14.101622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:14.101622+0000","last_clean_scrub_stamp":"2023-10-08T07:11:14.101622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:57:42.163685+0000","scrub_duration":0.001960626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"67'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:45.533796+0000","last_change":"2023-10-08T07:09:25.038493+0000","last_active":"2023-10-08T07:09:45.533796+0000","last_peered":"2023-10-08T07:09:45.533796+0000","last_clean":"2023-10-08T07:09:45.533796+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:09:45.533796+0000","last_undegraded":"2023-10-08T07:09:45.533796+0000","last_fullsized":"2023-10-08T07:09:45.533796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:05:31.294234+0000","last_clean_scrub_stamp":"2023-10-08T07:05:31.294234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:22.766221+0000","last_change":"2023-10-08T07:10:22.766221+0000","last_active":"2023-10-08T07:10:22.766221+0000","last_peered":"2023-10-08T07:10:22.766221+0000","last_clean":"2023-10-08T07:10:22.766221+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:10:22.766221+0000","last_undegraded":"2023-10-08T07:10:22.766221+0000","last_fullsized":"2023-10-08T07:10:22.766221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:22.766075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:22.766075+0000","last_clean_scrub_stamp":"2023-10-08T07:10:22.766075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:57.867526+0000","scrub_duration":0.0019628810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:59.746038+0000","last_change":"2023-10-08T07:09:59.746038+0000","last_active":"2023-10-08T07:09:59.746038+0000","last_peered":"2023-10-08T07:09:59.746038+0000","last_clean":"2023-10-08T07:09:59.746038+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:59.746038+0000","last_undegraded":"2023-10-08T07:09:59.746038+0000","last_fullsized":"2023-10-08T07:09:59.746038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_clean_scrub_stamp":"2023-10-08T07:09:59.745834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:05.711715+0000","scrub_duration":0.002070012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:31.391524+0000","last_change":"2023-10-08T07:10:31.391575+0000","last_active":"2023-10-08T07:10:31.391524+0000","last_peered":"2023-10-08T07:10:31.391524+0000","last_clean":"2023-10-08T07:10:31.391524+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:10:31.391524+0000","last_undegraded":"2023-10-08T07:10:31.391524+0000","last_fullsized":"2023-10-08T07:10:31.391524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:31.391414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:31.391414+0000","last_clean_scrub_stamp":"2023-10-08T07:10:31.391414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:58.361849+0000","scrub_duration":0.001953729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:05.747198+0000","last_change":"2023-10-08T07:11:05.747198+0000","last_active":"2023-10-08T07:11:05.747198+0000","last_peered":"2023-10-08T07:11:05.747198+0000","last_clean":"2023-10-08T07:11:05.747198+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:11:05.747198+0000","last_undegraded":"2023-10-08T07:11:05.747198+0000","last_fullsized":"2023-10-08T07:11:05.747198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:05.747028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:05.747028+0000","last_clean_scrub_stamp":"2023-10-08T07:11:05.747028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:48.021225+0000","scrub_duration":0.0025933689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"91'4","reported_seq":111,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:11.279394+0000","last_change":"2023-10-08T07:11:11.279450+0000","last_active":"2023-10-08T07:11:11.279394+0000","last_peered":"2023-10-08T07:11:11.279394+0000","last_clean":"2023-10-08T07:11:11.279394+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:11:11.279394+0000","last_undegraded":"2023-10-08T07:11:11.279394+0000","last_fullsized":"2023-10-08T07:11:11.279394+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:11:11.279275+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:11:11.279275+0000","last_clean_scrub_stamp":"2023-10-08T07:11:11.279275+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:33.249103+0000","scrub_duration":0.0038380409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:38.461564+0000","last_change":"2023-10-08T07:10:38.461609+0000","last_active":"2023-10-08T07:10:38.461564+0000","last_peered":"2023-10-08T07:10:38.461564+0000","last_clean":"2023-10-08T07:10:38.461564+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:10:38.461564+0000","last_undegraded":"2023-10-08T07:10:38.461564+0000","last_fullsized":"2023-10-08T07:10:38.461564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:38.461431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:38.461431+0000","last_clean_scrub_stamp":"2023-10-08T07:10:38.461431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:09.555421+0000","scrub_duration":0.001628572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2998,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:52.224944+0000","last_change":"2023-10-08T07:09:52.224944+0000","last_active":"2023-10-08T07:09:52.224944+0000","last_peered":"2023-10-08T07:09:52.224944+0000","last_clean":"2023-10-08T07:09:52.224944+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:52.224944+0000","last_undegraded":"2023-10-08T07:09:52.224944+0000","last_fullsized":"2023-10-08T07:09:52.224944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2903","last_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_deep_scrub":"67'2903","last_deep_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_clean_scrub_stamp":"2023-10-08T07:09:52.224790+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:46.117778+0000","scrub_duration":0.0028885249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:20.186482+0000","last_change":"2023-10-08T07:11:20.186536+0000","last_active":"2023-10-08T07:11:20.186482+0000","last_peered":"2023-10-08T07:11:20.186482+0000","last_clean":"2023-10-08T07:11:20.186482+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:11:20.186482+0000","last_undegraded":"2023-10-08T07:11:20.186482+0000","last_fullsized":"2023-10-08T07:11:20.186482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:20.186375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:20.186375+0000","last_clean_scrub_stamp":"2023-10-08T07:11:20.186375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:34:43.779446+0000","scrub_duration":0.0022044709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"91'10","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:03.449585+0000","last_change":"2023-10-08T07:11:03.449648+0000","last_active":"2023-10-08T07:11:03.449585+0000","last_peered":"2023-10-08T07:11:03.449585+0000","last_clean":"2023-10-08T07:11:03.449585+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:11:03.449585+0000","last_undegraded":"2023-10-08T07:11:03.449585+0000","last_fullsized":"2023-10-08T07:11:03.449585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2023-10-08T07:11:03.449489+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2023-10-08T07:11:03.449489+0000","last_clean_scrub_stamp":"2023-10-08T07:11:03.449489+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:26.149116+0000","scrub_duration":0.003637454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2972,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.619759+0000","last_change":"2023-10-08T07:10:36.619759+0000","last_active":"2023-10-08T07:10:36.619759+0000","last_peered":"2023-10-08T07:10:36.619759+0000","last_clean":"2023-10-08T07:10:36.619759+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:10:36.619759+0000","last_undegraded":"2023-10-08T07:10:36.619759+0000","last_fullsized":"2023-10-08T07:10:36.619759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2894","last_scrub_stamp":"2023-10-08T07:10:36.619619+0000","last_deep_scrub":"67'2894","last_deep_scrub_stamp":"2023-10-08T07:10:36.619619+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.619619+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:03.016252+0000","scrub_duration":0.0024615819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:53.800170+0000","last_change":"2023-10-08T07:09:53.800170+0000","last_active":"2023-10-08T07:09:53.800170+0000","last_peered":"2023-10-08T07:09:53.800170+0000","last_clean":"2023-10-08T07:09:53.800170+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:53.800170+0000","last_undegraded":"2023-10-08T07:09:53.800170+0000","last_fullsized":"2023-10-08T07:09:53.800170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_clean_scrub_stamp":"2023-10-08T07:09:53.799979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:11.628567+0000","scrub_duration":0.0021863500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:29.686997+0000","last_change":"2023-10-08T07:11:29.686997+0000","last_active":"2023-10-08T07:11:29.686997+0000","last_peered":"2023-10-08T07:11:29.686997+0000","last_clean":"2023-10-08T07:11:29.686997+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:11:29.686997+0000","last_undegraded":"2023-10-08T07:11:29.686997+0000","last_fullsized":"2023-10-08T07:11:29.686997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:11:29.686827+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:11:29.686827+0000","last_clean_scrub_stamp":"2023-10-08T07:11:29.686827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:22.032611+0000","scrub_duration":0.0019020109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"91'3","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:43.436437+0000","last_change":"2023-10-08T07:11:43.436498+0000","last_active":"2023-10-08T07:11:43.436437+0000","last_peered":"2023-10-08T07:11:43.436437+0000","last_clean":"2023-10-08T07:11:43.436437+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:11:43.436437+0000","last_undegraded":"2023-10-08T07:11:43.436437+0000","last_fullsized":"2023-10-08T07:11:43.436437+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2023-10-08T07:11:43.436324+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2023-10-08T07:11:43.436324+0000","last_clean_scrub_stamp":"2023-10-08T07:11:43.436324+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:58:16.950805+0000","scrub_duration":0.003718098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5900,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:25.908075+0000","last_change":"2023-10-08T07:10:25.908075+0000","last_active":"2023-10-08T07:10:25.908075+0000","last_peered":"2023-10-08T07:10:25.908075+0000","last_clean":"2023-10-08T07:10:25.908075+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:10:25.908075+0000","last_undegraded":"2023-10-08T07:10:25.908075+0000","last_fullsized":"2023-10-08T07:10:25.908075+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5806","last_scrub_stamp":"2023-10-08T07:10:25.907915+0000","last_deep_scrub":"67'5806","last_deep_scrub_stamp":"2023-10-08T07:10:25.907915+0000","last_clean_scrub_stamp":"2023-10-08T07:10:25.907915+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:33.667782+0000","scrub_duration":0.0029813180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"91'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:58.746571+0000","last_change":"2023-10-08T07:10:58.746571+0000","last_active":"2023-10-08T07:10:58.746571+0000","last_peered":"2023-10-08T07:10:58.746571+0000","last_clean":"2023-10-08T07:10:58.746571+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:10:58.746571+0000","last_undegraded":"2023-10-08T07:10:58.746571+0000","last_fullsized":"2023-10-08T07:10:58.746571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:10:58.746368+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:10:58.746368+0000","last_clean_scrub_stamp":"2023-10-08T07:10:58.746368+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:25:49.547384+0000","scrub_duration":0.0037535310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3019,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:36.417311+0000","last_change":"2023-10-08T07:11:36.417364+0000","last_active":"2023-10-08T07:11:36.417311+0000","last_peered":"2023-10-08T07:11:36.417311+0000","last_clean":"2023-10-08T07:11:36.417311+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:11:36.417311+0000","last_undegraded":"2023-10-08T07:11:36.417311+0000","last_fullsized":"2023-10-08T07:11:36.417311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2925","last_scrub_stamp":"2023-10-08T07:11:36.417193+0000","last_deep_scrub":"67'2925","last_deep_scrub_stamp":"2023-10-08T07:11:36.417193+0000","last_clean_scrub_stamp":"2023-10-08T07:11:36.417193+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:46.277296+0000","scrub_duration":0.0047613630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:18.452754+0000","last_change":"2023-10-08T07:10:18.452754+0000","last_active":"2023-10-08T07:10:18.452754+0000","last_peered":"2023-10-08T07:10:18.452754+0000","last_clean":"2023-10-08T07:10:18.452754+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:10:18.452754+0000","last_undegraded":"2023-10-08T07:10:18.452754+0000","last_fullsized":"2023-10-08T07:10:18.452754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:10:18.452579+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:10:18.452579+0000","last_clean_scrub_stamp":"2023-10-08T07:10:18.452579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:51.487483+0000","scrub_duration":0.0019171150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5881,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:00.754601+0000","last_change":"2023-10-08T07:10:00.754601+0000","last_active":"2023-10-08T07:10:00.754601+0000","last_peered":"2023-10-08T07:10:00.754601+0000","last_clean":"2023-10-08T07:10:00.754601+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:10:00.754601+0000","last_undegraded":"2023-10-08T07:10:00.754601+0000","last_fullsized":"2023-10-08T07:10:00.754601+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5794","last_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_deep_scrub":"67'5794","last_deep_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_clean_scrub_stamp":"2023-10-08T07:10:00.754451+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:41.308685+0000","scrub_duration":0.0023848570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:06.392046+0000","last_change":"2023-10-08T07:10:06.392100+0000","last_active":"2023-10-08T07:10:06.392046+0000","last_peered":"2023-10-08T07:10:06.392046+0000","last_clean":"2023-10-08T07:10:06.392046+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:10:06.392046+0000","last_undegraded":"2023-10-08T07:10:06.392046+0000","last_fullsized":"2023-10-08T07:10:06.392046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2023-10-08T07:10:06.391949+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2023-10-08T07:10:06.391949+0000","last_clean_scrub_stamp":"2023-10-08T07:10:06.391949+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:18.322702+0000","scrub_duration":0.005184073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:17.009849+0000","last_change":"2023-10-08T07:10:17.009849+0000","last_active":"2023-10-08T07:10:17.009849+0000","last_peered":"2023-10-08T07:10:17.009849+0000","last_clean":"2023-10-08T07:10:17.009849+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:10:17.009849+0000","last_undegraded":"2023-10-08T07:10:17.009849+0000","last_fullsized":"2023-10-08T07:10:17.009849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:10:17.009657+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:10:17.009657+0000","last_clean_scrub_stamp":"2023-10-08T07:10:17.009657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:59:07.822088+0000","scrub_duration":0.0028116880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8817,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:35.984320+0000","last_change":"2023-10-08T07:10:35.984376+0000","last_active":"2023-10-08T07:10:35.984320+0000","last_peered":"2023-10-08T07:10:35.984320+0000","last_clean":"2023-10-08T07:10:35.984320+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:10:35.984320+0000","last_undegraded":"2023-10-08T07:10:35.984320+0000","last_fullsized":"2023-10-08T07:10:35.984320+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8723","last_scrub_stamp":"2023-10-08T07:10:35.984180+0000","last_deep_scrub":"67'8723","last_deep_scrub_stamp":"2023-10-08T07:10:35.984180+0000","last_clean_scrub_stamp":"2023-10-08T07:10:35.984180+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:35:02.954615+0000","scrub_duration":0.0034636020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3011,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:38.119997+0000","last_change":"2023-10-08T07:11:38.120044+0000","last_active":"2023-10-08T07:11:38.119997+0000","last_peered":"2023-10-08T07:11:38.119997+0000","last_clean":"2023-10-08T07:11:38.119997+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:11:38.119997+0000","last_undegraded":"2023-10-08T07:11:38.119997+0000","last_fullsized":"2023-10-08T07:11:38.119997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2897","last_scrub_stamp":"2023-10-08T07:11:38.119890+0000","last_deep_scrub":"67'2897","last_deep_scrub_stamp":"2023-10-08T07:11:38.119890+0000","last_clean_scrub_stamp":"2023-10-08T07:11:38.119890+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:26.490554+0000","scrub_duration":0.0025913389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:04.731839+0000","last_change":"2023-10-08T07:11:04.731839+0000","last_active":"2023-10-08T07:11:04.731839+0000","last_peered":"2023-10-08T07:11:04.731839+0000","last_clean":"2023-10-08T07:11:04.731839+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:11:04.731839+0000","last_undegraded":"2023-10-08T07:11:04.731839+0000","last_fullsized":"2023-10-08T07:11:04.731839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2023-10-08T07:11:04.731603+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2023-10-08T07:11:04.731603+0000","last_clean_scrub_stamp":"2023-10-08T07:11:04.731603+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:54:15.076074+0000","scrub_duration":0.0027692070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:55.216862+0000","last_change":"2023-10-08T07:09:55.216924+0000","last_active":"2023-10-08T07:09:55.216862+0000","last_peered":"2023-10-08T07:09:55.216862+0000","last_clean":"2023-10-08T07:09:55.216862+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:55.216862+0000","last_undegraded":"2023-10-08T07:09:55.216862+0000","last_fullsized":"2023-10-08T07:09:55.216862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_clean_scrub_stamp":"2023-10-08T07:09:55.216748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:14.264100+0000","scrub_duration":0.001903205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2984,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:11.731360+0000","last_change":"2023-10-08T07:11:11.731360+0000","last_active":"2023-10-08T07:11:11.731360+0000","last_peered":"2023-10-08T07:11:11.731360+0000","last_clean":"2023-10-08T07:11:11.731360+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:11:11.731360+0000","last_undegraded":"2023-10-08T07:11:11.731360+0000","last_fullsized":"2023-10-08T07:11:11.731360+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2906","last_scrub_stamp":"2023-10-08T07:11:11.731149+0000","last_deep_scrub":"67'2906","last_deep_scrub_stamp":"2023-10-08T07:11:11.731149+0000","last_clean_scrub_stamp":"2023-10-08T07:11:11.731149+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:11.458600+0000","scrub_duration":0.002706651,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738448,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595760,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776080,"statfs":{"total":96636764160,"available":96026705920,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.60999999999999999,"15min":0.497},"min":{"1min":0.35799999999999998,"5min":0.188,"15min":0.188},"max":{"1min":0.60599999999999998,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.60899999999999999,"15min":0.50700000000000001},"min":{"1min":0.36899999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.629,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Sun Oct 8 07:11:19 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60999999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64700000000000002,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483908,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887932,"statfs":{"total":96636764160,"available":96141242368,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:11:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.433,"15min":0.43099999999999999},"min":{"1min":0.35099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.56699999999999995}]},{"osd":2,"last update":"Sun Oct 8 07:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.51400000000000001},"min":{"1min":0.33100000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66900000000000004,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.503,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.182,"15min":0.182},"max":{"1min":0.69299999999999995,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.54600000000000004}]}]},{"osd":1,"up_from":74,"seq":317827579936,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":1712,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":1753088,"data_stored":1220245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.34000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.36099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.55200000000000005}]},{"osd":2,"last update":"Sun Oct 8 07:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.42299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65400000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59899999999999998,"5min":3.048,"15min":3.048},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:11:48.250 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:48.250 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-08T07:05:32.299112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=32, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:48.251 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-08T07:05:31.294234+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=5, tm_sec=31, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=7, tm_min=9, tm_sec=42, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T07:11:48.251 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T07:12:08.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T07:12:08.608 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:12:08.609 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-08T07:12:08.620 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2023-10-08T07:12:06.607646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":846491,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":139,"num_read_kb":121,"num_write":541931,"num_write_kb":2624889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":8638166,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149211,"ondisk_log_size":149211,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1145004,"kb_used_data":4308,"kb_used_omap":8,"kb_used_meta":1140663,"kb_avail":281970516,"statfs":{"total":289910292480,"available":288737808384,"internally_reserved":0,"allocated":4411392,"data_stored":2817910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9187,"internal_metadata":1168038941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003312"},"pg_stats":[{"pgid":"4.3f","version":"67'2931","reported_seq":3009,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:26.717954+0000","last_change":"2023-10-08T07:11:26.718010+0000","last_active":"2023-10-08T07:11:26.717954+0000","last_peered":"2023-10-08T07:11:26.717954+0000","last_clean":"2023-10-08T07:11:26.717954+0000","last_became_active":"2023-10-08T07:09:20.737045+0000","last_became_peered":"2023-10-08T07:09:20.737045+0000","last_unstale":"2023-10-08T07:11:26.717954+0000","last_undegraded":"2023-10-08T07:11:26.717954+0000","last_fullsized":"2023-10-08T07:11:26.717954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2931","last_scrub_stamp":"2023-10-08T07:11:26.717857+0000","last_deep_scrub":"67'2931","last_deep_scrub_stamp":"2023-10-08T07:11:26.717857+0000","last_clean_scrub_stamp":"2023-10-08T07:11:26.717857+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:59.144037+0000","scrub_duration":0.0021000200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8524,"num_write_kb":40400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"67'2832","reported_seq":2910,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:46.756403+0000","last_change":"2023-10-08T07:09:46.756403+0000","last_active":"2023-10-08T07:09:46.756403+0000","last_peered":"2023-10-08T07:09:46.756403+0000","last_clean":"2023-10-08T07:09:46.756403+0000","last_became_active":"2023-10-08T07:09:20.736123+0000","last_became_peered":"2023-10-08T07:09:20.736123+0000","last_unstale":"2023-10-08T07:09:46.756403+0000","last_undegraded":"2023-10-08T07:09:46.756403+0000","last_fullsized":"2023-10-08T07:09:46.756403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2832","last_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_deep_scrub":"67'2832","last_deep_scrub_stamp":"2023-10-08T07:09:46.756167+0000","last_clean_scrub_stamp":"2023-10-08T07:09:46.756167+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:46.978745+0000","scrub_duration":0.0030689100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8370,"num_write_kb":39624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"67'1","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:01.902641+0000","last_change":"2023-10-08T07:10:01.902641+0000","last_active":"2023-10-08T07:10:01.902641+0000","last_peered":"2023-10-08T07:10:01.902641+0000","last_clean":"2023-10-08T07:10:01.902641+0000","last_became_active":"2023-10-08T07:09:18.056477+0000","last_became_peered":"2023-10-08T07:09:18.056477+0000","last_unstale":"2023-10-08T07:10:01.902641+0000","last_undegraded":"2023-10-08T07:10:01.902641+0000","last_fullsized":"2023-10-08T07:10:01.902641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:01.902474+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:01.902474+0000","last_clean_scrub_stamp":"2023-10-08T07:10:01.902474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:20.949826+0000","scrub_duration":0.001921706,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"67'1","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:08.963139+0000","last_change":"2023-10-08T07:10:08.963139+0000","last_active":"2023-10-08T07:10:08.963139+0000","last_peered":"2023-10-08T07:10:08.963139+0000","last_clean":"2023-10-08T07:10:08.963139+0000","last_became_active":"2023-10-08T07:05:33.322957+0000","last_became_peered":"2023-10-08T07:05:33.322957+0000","last_unstale":"2023-10-08T07:10:08.963139+0000","last_undegraded":"2023-10-08T07:10:08.963139+0000","last_fullsized":"2023-10-08T07:10:08.963139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:08.962981+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:08.962981+0000","last_clean_scrub_stamp":"2023-10-08T07:10:08.962981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:20.893734+0000","scrub_duration":0.0026257540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"67'5815","reported_seq":5899,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:44.651612+0000","last_change":"2023-10-08T07:10:44.651612+0000","last_active":"2023-10-08T07:10:44.651612+0000","last_peered":"2023-10-08T07:10:44.651612+0000","last_clean":"2023-10-08T07:10:44.651612+0000","last_became_active":"2023-10-08T07:09:20.735896+0000","last_became_peered":"2023-10-08T07:09:20.735896+0000","last_unstale":"2023-10-08T07:10:44.651612+0000","last_undegraded":"2023-10-08T07:10:44.651612+0000","last_fullsized":"2023-10-08T07:10:44.651612+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5815","last_scrub_stamp":"2023-10-08T07:10:44.651463+0000","last_deep_scrub":"67'5815","last_deep_scrub_stamp":"2023-10-08T07:10:44.651463+0000","last_clean_scrub_stamp":"2023-10-08T07:10:44.651463+0000","objects_scrubbed":0,"log_size":4115,"log_dups_size":1700,"ondisk_log_size":4115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:47:50.033791+0000","scrub_duration":0.0026907989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17098,"num_write_kb":80956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"67'8487","reported_seq":8581,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:06.916355+0000","last_change":"2023-10-08T07:10:06.916355+0000","last_active":"2023-10-08T07:10:06.916355+0000","last_peered":"2023-10-08T07:10:06.916355+0000","last_clean":"2023-10-08T07:10:06.916355+0000","last_became_active":"2023-10-08T07:05:33.322329+0000","last_became_peered":"2023-10-08T07:05:33.322329+0000","last_unstale":"2023-10-08T07:10:06.916355+0000","last_undegraded":"2023-10-08T07:10:06.916355+0000","last_fullsized":"2023-10-08T07:10:06.916355+0000","mapping_epoch":17,"log_start":"55'4300","ondisk_log_start":"55'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8487","last_scrub_stamp":"2023-10-08T07:10:06.916118+0000","last_deep_scrub":"67'8487","last_deep_scrub_stamp":"2023-10-08T07:10:06.916118+0000","last_clean_scrub_stamp":"2023-10-08T07:10:06.916118+0000","objects_scrubbed":0,"log_size":4187,"log_dups_size":4300,"ondisk_log_size":4187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:55:34.602055+0000","scrub_duration":0.0043577499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25158,"num_write_kb":119592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.809212+0000","last_change":"2023-10-08T07:09:50.809212+0000","last_active":"2023-10-08T07:09:50.809212+0000","last_peered":"2023-10-08T07:09:50.809212+0000","last_clean":"2023-10-08T07:09:50.809212+0000","last_became_active":"2023-10-08T07:05:33.323267+0000","last_became_peered":"2023-10-08T07:05:33.323267+0000","last_unstale":"2023-10-08T07:09:50.809212+0000","last_undegraded":"2023-10-08T07:09:50.809212+0000","last_fullsized":"2023-10-08T07:09:50.809212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:50.808986+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.808986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:57.252774+0000","scrub_duration":0.0027253220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"67'2916","reported_seq":3049,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:48.479012+0000","last_change":"2023-10-08T07:11:48.479064+0000","last_active":"2023-10-08T07:11:48.479012+0000","last_peered":"2023-10-08T07:11:48.479012+0000","last_clean":"2023-10-08T07:11:48.479012+0000","last_became_active":"2023-10-08T07:09:28.076750+0000","last_became_peered":"2023-10-08T07:09:28.076750+0000","last_unstale":"2023-10-08T07:11:48.479012+0000","last_undegraded":"2023-10-08T07:11:48.479012+0000","last_fullsized":"2023-10-08T07:11:48.479012+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2916","last_scrub_stamp":"2023-10-08T07:11:48.478901+0000","last_deep_scrub":"67'2916","last_deep_scrub_stamp":"2023-10-08T07:11:48.478901+0000","last_clean_scrub_stamp":"2023-10-08T07:11:48.478901+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":0,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:54:18.855106+0000","scrub_duration":0.002901739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8526,"num_write_kb":40416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"67'2779","reported_seq":2893,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:48.261144+0000","last_change":"2023-10-08T07:09:48.261144+0000","last_active":"2023-10-08T07:09:48.261144+0000","last_peered":"2023-10-08T07:09:48.261144+0000","last_clean":"2023-10-08T07:09:48.261144+0000","last_became_active":"2023-10-08T07:09:21.038516+0000","last_became_peered":"2023-10-08T07:09:21.038516+0000","last_unstale":"2023-10-08T07:09:48.261144+0000","last_undegraded":"2023-10-08T07:09:48.261144+0000","last_fullsized":"2023-10-08T07:09:48.261144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2779","last_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_deep_scrub":"67'2779","last_deep_scrub_stamp":"2023-10-08T07:09:48.260984+0000","last_clean_scrub_stamp":"2023-10-08T07:09:48.260984+0000","objects_scrubbed":0,"log_size":2779,"log_dups_size":0,"ondisk_log_size":2779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:50:35.661462+0000","scrub_duration":0.0021476020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8297,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"67'2888","reported_seq":2966,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:15.720366+0000","last_change":"2023-10-08T07:11:15.720366+0000","last_active":"2023-10-08T07:11:15.720366+0000","last_peered":"2023-10-08T07:11:15.720366+0000","last_clean":"2023-10-08T07:11:15.720366+0000","last_became_active":"2023-10-08T07:09:20.736983+0000","last_became_peered":"2023-10-08T07:09:20.736983+0000","last_unstale":"2023-10-08T07:11:15.720366+0000","last_undegraded":"2023-10-08T07:11:15.720366+0000","last_fullsized":"2023-10-08T07:11:15.720366+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2888","last_scrub_stamp":"2023-10-08T07:11:15.720178+0000","last_deep_scrub":"67'2888","last_deep_scrub_stamp":"2023-10-08T07:11:15.720178+0000","last_clean_scrub_stamp":"2023-10-08T07:11:15.720178+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:50.380873+0000","scrub_duration":0.0025953560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8485,"num_write_kb":40232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"67'1","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:41.448907+0000","last_change":"2023-10-08T07:11:41.448907+0000","last_active":"2023-10-08T07:11:41.448907+0000","last_peered":"2023-10-08T07:11:41.448907+0000","last_clean":"2023-10-08T07:11:41.448907+0000","last_became_active":"2023-10-08T07:09:23.063526+0000","last_became_peered":"2023-10-08T07:09:23.063526+0000","last_unstale":"2023-10-08T07:11:41.448907+0000","last_undegraded":"2023-10-08T07:11:41.448907+0000","last_fullsized":"2023-10-08T07:11:41.448907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:11:41.448689+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:11:41.448689+0000","last_clean_scrub_stamp":"2023-10-08T07:11:41.448689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:24.101169+0000","scrub_duration":0.0022439249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"67'2893","reported_seq":2971,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.799195+0000","last_change":"2023-10-08T07:09:51.799195+0000","last_active":"2023-10-08T07:09:51.799195+0000","last_peered":"2023-10-08T07:09:51.799195+0000","last_clean":"2023-10-08T07:09:51.799195+0000","last_became_active":"2023-10-08T07:09:20.735505+0000","last_became_peered":"2023-10-08T07:09:20.735505+0000","last_unstale":"2023-10-08T07:09:51.799195+0000","last_undegraded":"2023-10-08T07:09:51.799195+0000","last_fullsized":"2023-10-08T07:09:51.799195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2893","last_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_deep_scrub":"67'2893","last_deep_scrub_stamp":"2023-10-08T07:09:51.798991+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.798991+0000","objects_scrubbed":0,"log_size":2893,"log_dups_size":0,"ondisk_log_size":2893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:39.037371+0000","scrub_duration":0.0024056889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8430,"num_write_kb":40128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:27.710809+0000","last_change":"2023-10-08T07:10:27.710809+0000","last_active":"2023-10-08T07:10:27.710809+0000","last_peered":"2023-10-08T07:10:27.710809+0000","last_clean":"2023-10-08T07:10:27.710809+0000","last_became_active":"2023-10-08T07:09:17.753759+0000","last_became_peered":"2023-10-08T07:09:17.753759+0000","last_unstale":"2023-10-08T07:10:27.710809+0000","last_undegraded":"2023-10-08T07:10:27.710809+0000","last_fullsized":"2023-10-08T07:10:27.710809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:27.710670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:27.710670+0000","last_clean_scrub_stamp":"2023-10-08T07:10:27.710670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:51.076837+0000","scrub_duration":0.002419591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"67'2871","reported_seq":2987,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:37.459280+0000","last_change":"2023-10-08T07:11:37.459333+0000","last_active":"2023-10-08T07:11:37.459280+0000","last_peered":"2023-10-08T07:11:37.459280+0000","last_clean":"2023-10-08T07:11:37.459280+0000","last_became_active":"2023-10-08T07:09:21.039096+0000","last_became_peered":"2023-10-08T07:09:21.039096+0000","last_unstale":"2023-10-08T07:11:37.459280+0000","last_undegraded":"2023-10-08T07:11:37.459280+0000","last_fullsized":"2023-10-08T07:11:37.459280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2871","last_scrub_stamp":"2023-10-08T07:11:37.459145+0000","last_deep_scrub":"67'2871","last_deep_scrub_stamp":"2023-10-08T07:11:37.459145+0000","last_clean_scrub_stamp":"2023-10-08T07:11:37.459145+0000","objects_scrubbed":0,"log_size":2871,"log_dups_size":0,"ondisk_log_size":2871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:36.878105+0000","scrub_duration":0.0024396470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8427,"num_write_kb":39831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"67'5731","reported_seq":5876,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:46.388895+0000","last_change":"2023-10-08T07:11:46.388895+0000","last_active":"2023-10-08T07:11:46.388895+0000","last_peered":"2023-10-08T07:11:46.388895+0000","last_clean":"2023-10-08T07:11:46.388895+0000","last_became_active":"2023-10-08T07:09:26.041076+0000","last_became_peered":"2023-10-08T07:09:26.041076+0000","last_unstale":"2023-10-08T07:11:46.388895+0000","last_undegraded":"2023-10-08T07:11:46.388895+0000","last_fullsized":"2023-10-08T07:11:46.388895+0000","mapping_epoch":82,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5731","last_scrub_stamp":"2023-10-08T07:11:46.388714+0000","last_deep_scrub":"67'5731","last_deep_scrub_stamp":"2023-10-08T07:11:46.388714+0000","last_clean_scrub_stamp":"2023-10-08T07:11:46.388714+0000","objects_scrubbed":0,"log_size":4131,"log_dups_size":1600,"ondisk_log_size":4131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:47.321326+0000","scrub_duration":0.002820875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16905,"num_write_kb":80220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"67'2898","reported_seq":2992,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:54.975424+0000","last_change":"2023-10-08T07:10:54.975485+0000","last_active":"2023-10-08T07:10:54.975424+0000","last_peered":"2023-10-08T07:10:54.975424+0000","last_clean":"2023-10-08T07:10:54.975424+0000","last_became_active":"2023-10-08T07:05:33.321735+0000","last_became_peered":"2023-10-08T07:05:33.321735+0000","last_unstale":"2023-10-08T07:10:54.975424+0000","last_undegraded":"2023-10-08T07:10:54.975424+0000","last_fullsized":"2023-10-08T07:10:54.975424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2898","last_scrub_stamp":"2023-10-08T07:10:54.975318+0000","last_deep_scrub":"67'2898","last_deep_scrub_stamp":"2023-10-08T07:10:54.975318+0000","last_clean_scrub_stamp":"2023-10-08T07:10:54.975318+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":0,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:44.044191+0000","scrub_duration":0.0030843680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8513,"num_write_kb":40408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2877","reported_seq":2991,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:37.076414+0000","last_change":"2023-10-08T07:11:37.076477+0000","last_active":"2023-10-08T07:11:37.076414+0000","last_peered":"2023-10-08T07:11:37.076414+0000","last_clean":"2023-10-08T07:11:37.076414+0000","last_became_active":"2023-10-08T07:09:21.038553+0000","last_became_peered":"2023-10-08T07:09:21.038553+0000","last_unstale":"2023-10-08T07:11:37.076414+0000","last_undegraded":"2023-10-08T07:11:37.076414+0000","last_fullsized":"2023-10-08T07:11:37.076414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2877","last_scrub_stamp":"2023-10-08T07:11:37.076311+0000","last_deep_scrub":"67'2877","last_deep_scrub_stamp":"2023-10-08T07:11:37.076311+0000","last_clean_scrub_stamp":"2023-10-08T07:11:37.076311+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":0,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:36.378102+0000","scrub_duration":0.002185078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8517,"num_write_kb":40424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"67'1","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:54.718730+0000","last_change":"2023-10-08T07:10:54.718730+0000","last_active":"2023-10-08T07:10:54.718730+0000","last_peered":"2023-10-08T07:10:54.718730+0000","last_clean":"2023-10-08T07:10:54.718730+0000","last_became_active":"2023-10-08T07:09:17.753916+0000","last_became_peered":"2023-10-08T07:09:17.753916+0000","last_unstale":"2023-10-08T07:10:54.718730+0000","last_undegraded":"2023-10-08T07:10:54.718730+0000","last_fullsized":"2023-10-08T07:10:54.718730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:54.718583+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:54.718583+0000","last_clean_scrub_stamp":"2023-10-08T07:10:54.718583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:36.200157+0000","scrub_duration":0.002087308,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"67'2858","reported_seq":2972,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:30.141172+0000","last_change":"2023-10-08T07:11:30.141220+0000","last_active":"2023-10-08T07:11:30.141172+0000","last_peered":"2023-10-08T07:11:30.141172+0000","last_clean":"2023-10-08T07:11:30.141172+0000","last_became_active":"2023-10-08T07:09:21.038463+0000","last_became_peered":"2023-10-08T07:09:21.038463+0000","last_unstale":"2023-10-08T07:11:30.141172+0000","last_undegraded":"2023-10-08T07:11:30.141172+0000","last_fullsized":"2023-10-08T07:11:30.141172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2858","last_scrub_stamp":"2023-10-08T07:11:30.141070+0000","last_deep_scrub":"67'2858","last_deep_scrub_stamp":"2023-10-08T07:11:30.141070+0000","last_clean_scrub_stamp":"2023-10-08T07:11:30.141070+0000","objects_scrubbed":0,"log_size":2858,"log_dups_size":0,"ondisk_log_size":2858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:48:33.526645+0000","scrub_duration":0.0022205079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8412,"num_write_kb":39816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2889","reported_seq":2983,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:17.967333+0000","last_change":"2023-10-08T07:10:17.967390+0000","last_active":"2023-10-08T07:10:17.967333+0000","last_peered":"2023-10-08T07:10:17.967333+0000","last_clean":"2023-10-08T07:10:17.967333+0000","last_became_active":"2023-10-08T07:05:33.323597+0000","last_became_peered":"2023-10-08T07:05:33.323597+0000","last_unstale":"2023-10-08T07:10:17.967333+0000","last_undegraded":"2023-10-08T07:10:17.967333+0000","last_fullsized":"2023-10-08T07:10:17.967333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2889","last_scrub_stamp":"2023-10-08T07:10:17.967218+0000","last_deep_scrub":"67'2889","last_deep_scrub_stamp":"2023-10-08T07:10:17.967218+0000","last_clean_scrub_stamp":"2023-10-08T07:10:17.967218+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:31.882860+0000","scrub_duration":0.003096765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8383,"num_write_kb":39704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'5808","reported_seq":5902,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:50.041003+0000","last_change":"2023-10-08T07:10:50.041061+0000","last_active":"2023-10-08T07:10:50.041003+0000","last_peered":"2023-10-08T07:10:50.041003+0000","last_clean":"2023-10-08T07:10:50.041003+0000","last_became_active":"2023-10-08T07:05:33.324496+0000","last_became_peered":"2023-10-08T07:05:33.324496+0000","last_unstale":"2023-10-08T07:10:50.041003+0000","last_undegraded":"2023-10-08T07:10:50.041003+0000","last_fullsized":"2023-10-08T07:10:50.041003+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5808","last_scrub_stamp":"2023-10-08T07:10:50.040881+0000","last_deep_scrub":"67'5808","last_deep_scrub_stamp":"2023-10-08T07:10:50.040881+0000","last_clean_scrub_stamp":"2023-10-08T07:10:50.040881+0000","objects_scrubbed":0,"log_size":4208,"log_dups_size":1600,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:24.160061+0000","scrub_duration":0.0032418830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16928,"num_write_kb":80316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"67'2808","reported_seq":2886,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:15.676084+0000","last_change":"2023-10-08T07:10:15.676084+0000","last_active":"2023-10-08T07:10:15.676084+0000","last_peered":"2023-10-08T07:10:15.676084+0000","last_clean":"2023-10-08T07:10:15.676084+0000","last_became_active":"2023-10-08T07:09:20.735142+0000","last_became_peered":"2023-10-08T07:09:20.735142+0000","last_unstale":"2023-10-08T07:10:15.676084+0000","last_undegraded":"2023-10-08T07:10:15.676084+0000","last_fullsized":"2023-10-08T07:10:15.676084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2808","last_scrub_stamp":"2023-10-08T07:10:15.675928+0000","last_deep_scrub":"67'2808","last_deep_scrub_stamp":"2023-10-08T07:10:15.675928+0000","last_clean_scrub_stamp":"2023-10-08T07:10:15.675928+0000","objects_scrubbed":0,"log_size":2808,"log_dups_size":0,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:38.425941+0000","scrub_duration":0.00268585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8261,"num_write_kb":39240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"67'2897","reported_seq":2991,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:49.238913+0000","last_change":"2023-10-08T07:09:49.238913+0000","last_active":"2023-10-08T07:09:49.238913+0000","last_peered":"2023-10-08T07:09:49.238913+0000","last_clean":"2023-10-08T07:09:49.238913+0000","last_became_active":"2023-10-08T07:05:33.318468+0000","last_became_peered":"2023-10-08T07:05:33.318468+0000","last_unstale":"2023-10-08T07:09:49.238913+0000","last_undegraded":"2023-10-08T07:09:49.238913+0000","last_fullsized":"2023-10-08T07:09:49.238913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2897","last_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_deep_scrub":"67'2897","last_deep_scrub_stamp":"2023-10-08T07:09:49.238678+0000","last_clean_scrub_stamp":"2023-10-08T07:09:49.238678+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:45:50.648559+0000","scrub_duration":0.0033918249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8475,"num_write_kb":40200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"67'5763","reported_seq":5847,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.780269+0000","last_change":"2023-10-08T07:09:58.780269+0000","last_active":"2023-10-08T07:09:58.780269+0000","last_peered":"2023-10-08T07:09:58.780269+0000","last_clean":"2023-10-08T07:09:58.780269+0000","last_became_active":"2023-10-08T07:09:20.736016+0000","last_became_peered":"2023-10-08T07:09:20.736016+0000","last_unstale":"2023-10-08T07:09:58.780269+0000","last_undegraded":"2023-10-08T07:09:58.780269+0000","last_fullsized":"2023-10-08T07:09:58.780269+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5763","last_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_deep_scrub":"67'5763","last_deep_scrub_stamp":"2023-10-08T07:09:58.780116+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.780116+0000","objects_scrubbed":0,"log_size":4063,"log_dups_size":1700,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:40.304910+0000","scrub_duration":0.0028329620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":79960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"67'2888","reported_seq":2966,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:20.660569+0000","last_change":"2023-10-08T07:11:20.660569+0000","last_active":"2023-10-08T07:11:20.660569+0000","last_peered":"2023-10-08T07:11:20.660569+0000","last_clean":"2023-10-08T07:11:20.660569+0000","last_became_active":"2023-10-08T07:09:20.734859+0000","last_became_peered":"2023-10-08T07:09:20.734859+0000","last_unstale":"2023-10-08T07:11:20.660569+0000","last_undegraded":"2023-10-08T07:11:20.660569+0000","last_fullsized":"2023-10-08T07:11:20.660569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2888","last_scrub_stamp":"2023-10-08T07:11:20.660364+0000","last_deep_scrub":"67'2888","last_deep_scrub_stamp":"2023-10-08T07:11:20.660364+0000","last_clean_scrub_stamp":"2023-10-08T07:11:20.660364+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:40.092072+0000","scrub_duration":0.0024428240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8496,"num_write_kb":40444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"67'2890","reported_seq":2985,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:20.454247+0000","last_change":"2023-10-08T07:10:20.454247+0000","last_active":"2023-10-08T07:10:20.454247+0000","last_peered":"2023-10-08T07:10:20.454247+0000","last_clean":"2023-10-08T07:10:20.454247+0000","last_became_active":"2023-10-08T07:05:33.324485+0000","last_became_peered":"2023-10-08T07:05:33.324485+0000","last_unstale":"2023-10-08T07:10:20.454247+0000","last_undegraded":"2023-10-08T07:10:20.454247+0000","last_fullsized":"2023-10-08T07:10:20.454247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2890","last_scrub_stamp":"2023-10-08T07:10:20.454059+0000","last_deep_scrub":"67'2890","last_deep_scrub_stamp":"2023-10-08T07:10:20.454059+0000","last_clean_scrub_stamp":"2023-10-08T07:10:20.454059+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:00.814028+0000","scrub_duration":0.0034117829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8431,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"67'2","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.846960+0000","last_change":"2023-10-08T07:09:56.846960+0000","last_active":"2023-10-08T07:09:56.846960+0000","last_peered":"2023-10-08T07:09:56.846960+0000","last_clean":"2023-10-08T07:09:56.846960+0000","last_became_active":"2023-10-08T07:09:18.055164+0000","last_became_peered":"2023-10-08T07:09:18.055164+0000","last_unstale":"2023-10-08T07:09:56.846960+0000","last_undegraded":"2023-10-08T07:09:56.846960+0000","last_fullsized":"2023-10-08T07:09:56.846960+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:09:56.846797+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.846797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:44:30.858022+0000","scrub_duration":0.0019930149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:52.736039+0000","last_change":"2023-10-08T07:10:52.736039+0000","last_active":"2023-10-08T07:10:52.736039+0000","last_peered":"2023-10-08T07:10:52.736039+0000","last_clean":"2023-10-08T07:10:52.736039+0000","last_became_active":"2023-10-08T07:09:17.751019+0000","last_became_peered":"2023-10-08T07:09:17.751019+0000","last_unstale":"2023-10-08T07:10:52.736039+0000","last_undegraded":"2023-10-08T07:10:52.736039+0000","last_fullsized":"2023-10-08T07:10:52.736039+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:10:52.735818+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:10:52.735818+0000","last_clean_scrub_stamp":"2023-10-08T07:10:52.735818+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:14:10.360832+0000","scrub_duration":0.002026103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"67'1","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.785826+0000","last_change":"2023-10-08T07:09:56.785826+0000","last_active":"2023-10-08T07:09:56.785826+0000","last_peered":"2023-10-08T07:09:56.785826+0000","last_clean":"2023-10-08T07:09:56.785826+0000","last_became_active":"2023-10-08T07:09:17.753631+0000","last_became_peered":"2023-10-08T07:09:17.753631+0000","last_unstale":"2023-10-08T07:09:56.785826+0000","last_undegraded":"2023-10-08T07:09:56.785826+0000","last_fullsized":"2023-10-08T07:09:56.785826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.785595+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.785595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:56:34.531648+0000","scrub_duration":0.002195621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:56.475740+0000","last_change":"2023-10-08T07:10:56.475786+0000","last_active":"2023-10-08T07:10:56.475740+0000","last_peered":"2023-10-08T07:10:56.475740+0000","last_clean":"2023-10-08T07:10:56.475740+0000","last_became_active":"2023-10-08T07:05:32.316548+0000","last_became_peered":"2023-10-08T07:05:32.316548+0000","last_unstale":"2023-10-08T07:10:56.475740+0000","last_undegraded":"2023-10-08T07:10:56.475740+0000","last_fullsized":"2023-10-08T07:10:56.475740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:56.475635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:56.475635+0000","last_clean_scrub_stamp":"2023-10-08T07:10:56.475635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:57.868976+0000","scrub_duration":0.0020186980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'1","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:04.363638+0000","last_change":"2023-10-08T07:10:04.363638+0000","last_active":"2023-10-08T07:10:04.363638+0000","last_peered":"2023-10-08T07:10:04.363638+0000","last_clean":"2023-10-08T07:10:04.363638+0000","last_became_active":"2023-10-08T07:05:33.320629+0000","last_became_peered":"2023-10-08T07:05:33.320629+0000","last_unstale":"2023-10-08T07:10:04.363638+0000","last_undegraded":"2023-10-08T07:10:04.363638+0000","last_fullsized":"2023-10-08T07:10:04.363638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'1","last_scrub_stamp":"2023-10-08T07:10:04.363441+0000","last_deep_scrub":"67'1","last_deep_scrub_stamp":"2023-10-08T07:10:04.363441+0000","last_clean_scrub_stamp":"2023-10-08T07:10:04.363441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:16:25.507425+0000","scrub_duration":0.0036677139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:22.504516+0000","last_change":"2023-10-08T07:10:22.504516+0000","last_active":"2023-10-08T07:10:22.504516+0000","last_peered":"2023-10-08T07:10:22.504516+0000","last_clean":"2023-10-08T07:10:22.504516+0000","last_became_active":"2023-10-08T07:09:18.055300+0000","last_became_peered":"2023-10-08T07:09:18.055300+0000","last_unstale":"2023-10-08T07:10:22.504516+0000","last_undegraded":"2023-10-08T07:10:22.504516+0000","last_fullsized":"2023-10-08T07:10:22.504516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:22.504358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:22.504358+0000","last_clean_scrub_stamp":"2023-10-08T07:10:22.504358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:36.534493+0000","scrub_duration":0.001785551,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"67'2957","reported_seq":3035,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:28.713074+0000","last_change":"2023-10-08T07:11:28.713128+0000","last_active":"2023-10-08T07:11:28.713074+0000","last_peered":"2023-10-08T07:11:28.713074+0000","last_clean":"2023-10-08T07:11:28.713074+0000","last_became_active":"2023-10-08T07:09:20.736498+0000","last_became_peered":"2023-10-08T07:09:20.736498+0000","last_unstale":"2023-10-08T07:11:28.713074+0000","last_undegraded":"2023-10-08T07:11:28.713074+0000","last_fullsized":"2023-10-08T07:11:28.713074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2957","last_scrub_stamp":"2023-10-08T07:11:28.712943+0000","last_deep_scrub":"67'2957","last_deep_scrub_stamp":"2023-10-08T07:11:28.712943+0000","last_clean_scrub_stamp":"2023-10-08T07:11:28.712943+0000","objects_scrubbed":0,"log_size":2957,"log_dups_size":0,"ondisk_log_size":2957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:19:46.065381+0000","scrub_duration":0.0020660650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8642,"num_write_kb":40928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"66'1","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:56.183794+0000","last_change":"2023-10-08T07:09:56.183794+0000","last_active":"2023-10-08T07:09:56.183794+0000","last_peered":"2023-10-08T07:09:56.183794+0000","last_clean":"2023-10-08T07:09:56.183794+0000","last_became_active":"2023-10-08T07:05:32.318820+0000","last_became_peered":"2023-10-08T07:05:32.318820+0000","last_unstale":"2023-10-08T07:09:56.183794+0000","last_undegraded":"2023-10-08T07:09:56.183794+0000","last_fullsized":"2023-10-08T07:09:56.183794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'1","last_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_deep_scrub":"66'1","last_deep_scrub_stamp":"2023-10-08T07:09:56.183634+0000","last_clean_scrub_stamp":"2023-10-08T07:09:56.183634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:57:57.773772+0000","scrub_duration":0.0020570499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"67'5721","reported_seq":5835,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:32.072686+0000","last_change":"2023-10-08T07:11:32.072736+0000","last_active":"2023-10-08T07:11:32.072686+0000","last_peered":"2023-10-08T07:11:32.072686+0000","last_clean":"2023-10-08T07:11:32.072686+0000","last_became_active":"2023-10-08T07:09:21.034942+0000","last_became_peered":"2023-10-08T07:09:21.034942+0000","last_unstale":"2023-10-08T07:11:32.072686+0000","last_undegraded":"2023-10-08T07:11:32.072686+0000","last_fullsized":"2023-10-08T07:11:32.072686+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5721","last_scrub_stamp":"2023-10-08T07:11:32.072591+0000","last_deep_scrub":"67'5721","last_deep_scrub_stamp":"2023-10-08T07:11:32.072591+0000","last_clean_scrub_stamp":"2023-10-08T07:11:32.072591+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":1600,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:14:43.621587+0000","scrub_duration":0.0024425850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16807,"num_write_kb":79868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:31.244267+0000","last_change":"2023-10-08T07:11:31.244341+0000","last_active":"2023-10-08T07:11:31.244267+0000","last_peered":"2023-10-08T07:11:31.244267+0000","last_clean":"2023-10-08T07:11:31.244267+0000","last_became_active":"2023-10-08T07:05:32.320004+0000","last_became_peered":"2023-10-08T07:05:32.320004+0000","last_unstale":"2023-10-08T07:11:31.244267+0000","last_undegraded":"2023-10-08T07:11:31.244267+0000","last_fullsized":"2023-10-08T07:11:31.244267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:31.244107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:31.244107+0000","last_clean_scrub_stamp":"2023-10-08T07:11:31.244107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:01:57.412045+0000","scrub_duration":0.0020999299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"67'2857","reported_seq":2951,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:07.391860+0000","last_change":"2023-10-08T07:10:07.391860+0000","last_active":"2023-10-08T07:10:07.391860+0000","last_peered":"2023-10-08T07:10:07.391860+0000","last_clean":"2023-10-08T07:10:07.391860+0000","last_became_active":"2023-10-08T07:05:33.320645+0000","last_became_peered":"2023-10-08T07:05:33.320645+0000","last_unstale":"2023-10-08T07:10:07.391860+0000","last_undegraded":"2023-10-08T07:10:07.391860+0000","last_fullsized":"2023-10-08T07:10:07.391860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2857","last_scrub_stamp":"2023-10-08T07:10:07.391617+0000","last_deep_scrub":"67'2857","last_deep_scrub_stamp":"2023-10-08T07:10:07.391617+0000","last_clean_scrub_stamp":"2023-10-08T07:10:07.391617+0000","objects_scrubbed":0,"log_size":2857,"log_dups_size":0,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:07.864957+0000","scrub_duration":0.0030912190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8446,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"91'9","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:40.662587+0000","last_change":"2023-10-08T07:10:40.662587+0000","last_active":"2023-10-08T07:10:40.662587+0000","last_peered":"2023-10-08T07:10:40.662587+0000","last_clean":"2023-10-08T07:10:40.662587+0000","last_became_active":"2023-10-08T07:09:17.753137+0000","last_became_peered":"2023-10-08T07:09:17.753137+0000","last_unstale":"2023-10-08T07:10:40.662587+0000","last_undegraded":"2023-10-08T07:10:40.662587+0000","last_fullsized":"2023-10-08T07:10:40.662587+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'9","last_scrub_stamp":"2023-10-08T07:10:40.662409+0000","last_deep_scrub":"91'9","last_deep_scrub_stamp":"2023-10-08T07:10:40.662409+0000","last_clean_scrub_stamp":"2023-10-08T07:10:40.662409+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:47.613277+0000","scrub_duration":0.0039694750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"66'3","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:50.205001+0000","last_change":"2023-10-08T07:09:50.205001+0000","last_active":"2023-10-08T07:09:50.205001+0000","last_peered":"2023-10-08T07:09:50.205001+0000","last_clean":"2023-10-08T07:09:50.205001+0000","last_became_active":"2023-10-08T07:09:18.050839+0000","last_became_peered":"2023-10-08T07:09:18.050839+0000","last_unstale":"2023-10-08T07:09:50.205001+0000","last_undegraded":"2023-10-08T07:09:50.205001+0000","last_fullsized":"2023-10-08T07:09:50.205001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'3","last_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_deep_scrub":"66'3","last_deep_scrub_stamp":"2023-10-08T07:09:50.204815+0000","last_clean_scrub_stamp":"2023-10-08T07:09:50.204815+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:31.664355+0000","scrub_duration":0.0019594320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"91'90","reported_seq":203,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:27.323897+0000","last_change":"2023-10-08T07:11:27.324009+0000","last_active":"2023-10-08T07:11:27.323897+0000","last_peered":"2023-10-08T07:11:27.323897+0000","last_clean":"2023-10-08T07:11:27.323897+0000","last_became_active":"2023-10-08T07:09:18.054617+0000","last_became_peered":"2023-10-08T07:09:18.054617+0000","last_unstale":"2023-10-08T07:11:27.323897+0000","last_undegraded":"2023-10-08T07:11:27.323897+0000","last_fullsized":"2023-10-08T07:11:27.323897+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'90","last_scrub_stamp":"2023-10-08T07:11:27.323789+0000","last_deep_scrub":"91'90","last_deep_scrub_stamp":"2023-10-08T07:11:27.323789+0000","last_clean_scrub_stamp":"2023-10-08T07:11:27.323789+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:28:41.092087+0000","scrub_duration":0.0064926289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":248256,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"67'2841","reported_seq":2958,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:05.926577+0000","last_change":"2023-10-08T07:10:05.926577+0000","last_active":"2023-10-08T07:10:05.926577+0000","last_peered":"2023-10-08T07:10:05.926577+0000","last_clean":"2023-10-08T07:10:05.926577+0000","last_became_active":"2023-10-08T07:09:21.037000+0000","last_became_peered":"2023-10-08T07:09:21.037000+0000","last_unstale":"2023-10-08T07:10:05.926577+0000","last_undegraded":"2023-10-08T07:10:05.926577+0000","last_fullsized":"2023-10-08T07:10:05.926577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2841","last_scrub_stamp":"2023-10-08T07:10:05.926418+0000","last_deep_scrub":"67'2841","last_deep_scrub_stamp":"2023-10-08T07:10:05.926418+0000","last_clean_scrub_stamp":"2023-10-08T07:10:05.926418+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:58:07.516556+0000","scrub_duration":0.0027102820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8415,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"91'4","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:51.976716+0000","last_change":"2023-10-08T07:10:51.976777+0000","last_active":"2023-10-08T07:10:51.976716+0000","last_peered":"2023-10-08T07:10:51.976716+0000","last_clean":"2023-10-08T07:10:51.976716+0000","last_became_active":"2023-10-08T07:05:32.320102+0000","last_became_peered":"2023-10-08T07:05:32.320102+0000","last_unstale":"2023-10-08T07:10:51.976716+0000","last_undegraded":"2023-10-08T07:10:51.976716+0000","last_fullsized":"2023-10-08T07:10:51.976716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:10:51.976599+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:10:51.976599+0000","last_clean_scrub_stamp":"2023-10-08T07:10:51.976599+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:17:39.729393+0000","scrub_duration":0.0041755680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"67'2875","reported_seq":2953,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:16.695184+0000","last_change":"2023-10-08T07:11:16.695184+0000","last_active":"2023-10-08T07:11:16.695184+0000","last_peered":"2023-10-08T07:11:16.695184+0000","last_clean":"2023-10-08T07:11:16.695184+0000","last_became_active":"2023-10-08T07:09:20.736107+0000","last_became_peered":"2023-10-08T07:09:20.736107+0000","last_unstale":"2023-10-08T07:11:16.695184+0000","last_undegraded":"2023-10-08T07:11:16.695184+0000","last_fullsized":"2023-10-08T07:11:16.695184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2875","last_scrub_stamp":"2023-10-08T07:11:16.695045+0000","last_deep_scrub":"67'2875","last_deep_scrub_stamp":"2023-10-08T07:11:16.695045+0000","last_clean_scrub_stamp":"2023-10-08T07:11:16.695045+0000","objects_scrubbed":0,"log_size":2875,"log_dups_size":0,"ondisk_log_size":2875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:09.511327+0000","scrub_duration":0.0024567220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8397,"num_write_kb":39868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:59.504119+0000","last_change":"2023-10-08T07:10:59.504215+0000","last_active":"2023-10-08T07:10:59.504119+0000","last_peered":"2023-10-08T07:10:59.504119+0000","last_clean":"2023-10-08T07:10:59.504119+0000","last_became_active":"2023-10-08T07:05:32.318849+0000","last_became_peered":"2023-10-08T07:05:32.318849+0000","last_unstale":"2023-10-08T07:10:59.504119+0000","last_undegraded":"2023-10-08T07:10:59.504119+0000","last_fullsized":"2023-10-08T07:10:59.504119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:59.504012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:59.504012+0000","last_clean_scrub_stamp":"2023-10-08T07:10:59.504012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:51:50.766230+0000","scrub_duration":0.0016614209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"67'8742","reported_seq":8832,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:24.713295+0000","last_change":"2023-10-08T07:11:24.713295+0000","last_active":"2023-10-08T07:11:24.713295+0000","last_peered":"2023-10-08T07:11:24.713295+0000","last_clean":"2023-10-08T07:11:24.713295+0000","last_became_active":"2023-10-08T07:09:20.736990+0000","last_became_peered":"2023-10-08T07:09:20.736990+0000","last_unstale":"2023-10-08T07:11:24.713295+0000","last_undegraded":"2023-10-08T07:11:24.713295+0000","last_fullsized":"2023-10-08T07:11:24.713295+0000","mapping_epoch":77,"log_start":"56'4600","ondisk_log_start":"56'4600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8742","last_scrub_stamp":"2023-10-08T07:11:24.713102+0000","last_deep_scrub":"67'8742","last_deep_scrub_stamp":"2023-10-08T07:11:24.713102+0000","last_clean_scrub_stamp":"2023-10-08T07:11:24.713102+0000","objects_scrubbed":0,"log_size":4142,"log_dups_size":4600,"ondisk_log_size":4142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:15.657707+0000","scrub_duration":0.0024625300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25522,"num_write_kb":121148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:47.711265+0000","last_change":"2023-10-08T07:10:47.711265+0000","last_active":"2023-10-08T07:10:47.711265+0000","last_peered":"2023-10-08T07:10:47.711265+0000","last_clean":"2023-10-08T07:10:47.711265+0000","last_became_active":"2023-10-08T07:09:17.750625+0000","last_became_peered":"2023-10-08T07:09:17.750625+0000","last_unstale":"2023-10-08T07:10:47.711265+0000","last_undegraded":"2023-10-08T07:10:47.711265+0000","last_fullsized":"2023-10-08T07:10:47.711265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:47.711101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:47.711101+0000","last_clean_scrub_stamp":"2023-10-08T07:10:47.711101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:44:42.808700+0000","scrub_duration":0.001740978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"67'2840","reported_seq":2934,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:15.518408+0000","last_change":"2023-10-08T07:10:15.518408+0000","last_active":"2023-10-08T07:10:15.518408+0000","last_peered":"2023-10-08T07:10:15.518408+0000","last_clean":"2023-10-08T07:10:15.518408+0000","last_became_active":"2023-10-08T07:05:33.324113+0000","last_became_peered":"2023-10-08T07:05:33.324113+0000","last_unstale":"2023-10-08T07:10:15.518408+0000","last_undegraded":"2023-10-08T07:10:15.518408+0000","last_fullsized":"2023-10-08T07:10:15.518408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2840","last_scrub_stamp":"2023-10-08T07:10:15.518167+0000","last_deep_scrub":"67'2840","last_deep_scrub_stamp":"2023-10-08T07:10:15.518167+0000","last_clean_scrub_stamp":"2023-10-08T07:10:15.518167+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:47.143209+0000","scrub_duration":0.0035381470000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8342,"num_write_kb":39736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"91'13","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.954538+0000","last_change":"2023-10-08T07:10:36.954611+0000","last_active":"2023-10-08T07:10:36.954538+0000","last_peered":"2023-10-08T07:10:36.954538+0000","last_clean":"2023-10-08T07:10:36.954538+0000","last_became_active":"2023-10-08T07:09:18.054456+0000","last_became_peered":"2023-10-08T07:09:18.054456+0000","last_unstale":"2023-10-08T07:10:36.954538+0000","last_undegraded":"2023-10-08T07:10:36.954538+0000","last_fullsized":"2023-10-08T07:10:36.954538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'13","last_scrub_stamp":"2023-10-08T07:10:36.954426+0000","last_deep_scrub":"91'13","last_deep_scrub_stamp":"2023-10-08T07:10:36.954426+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.954426+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:38.169926+0000","scrub_duration":0.0097942589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:28.367071+0000","last_change":"2023-10-08T07:10:28.367120+0000","last_active":"2023-10-08T07:10:28.367071+0000","last_peered":"2023-10-08T07:10:28.367071+0000","last_clean":"2023-10-08T07:10:28.367071+0000","last_became_active":"2023-10-08T07:05:33.327116+0000","last_became_peered":"2023-10-08T07:05:33.327116+0000","last_unstale":"2023-10-08T07:10:28.367071+0000","last_undegraded":"2023-10-08T07:10:28.367071+0000","last_fullsized":"2023-10-08T07:10:28.367071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:28.366970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:28.366970+0000","last_clean_scrub_stamp":"2023-10-08T07:10:28.366970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:27.637172+0000","scrub_duration":0.0029471160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"91'2","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:56.966275+0000","last_change":"2023-10-08T07:10:56.966328+0000","last_active":"2023-10-08T07:10:56.966275+0000","last_peered":"2023-10-08T07:10:56.966275+0000","last_clean":"2023-10-08T07:10:56.966275+0000","last_became_active":"2023-10-08T07:09:18.056397+0000","last_became_peered":"2023-10-08T07:09:18.056397+0000","last_unstale":"2023-10-08T07:10:56.966275+0000","last_undegraded":"2023-10-08T07:10:56.966275+0000","last_fullsized":"2023-10-08T07:10:56.966275+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2023-10-08T07:10:56.966171+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2023-10-08T07:10:56.966171+0000","last_clean_scrub_stamp":"2023-10-08T07:10:56.966171+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:51:48.228389+0000","scrub_duration":0.0038520659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:03.716700+0000","last_change":"2023-10-08T07:11:03.716700+0000","last_active":"2023-10-08T07:11:03.716700+0000","last_peered":"2023-10-08T07:11:03.716700+0000","last_clean":"2023-10-08T07:11:03.716700+0000","last_became_active":"2023-10-08T07:09:17.752460+0000","last_became_peered":"2023-10-08T07:09:17.752460+0000","last_unstale":"2023-10-08T07:11:03.716700+0000","last_undegraded":"2023-10-08T07:11:03.716700+0000","last_fullsized":"2023-10-08T07:11:03.716700+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:03.716560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:03.716560+0000","last_clean_scrub_stamp":"2023-10-08T07:11:03.716560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:17.194562+0000","scrub_duration":0.0024862790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:01.721235+0000","last_change":"2023-10-08T07:10:01.721235+0000","last_active":"2023-10-08T07:10:01.721235+0000","last_peered":"2023-10-08T07:10:01.721235+0000","last_clean":"2023-10-08T07:10:01.721235+0000","last_became_active":"2023-10-08T07:09:17.752508+0000","last_became_peered":"2023-10-08T07:09:17.752508+0000","last_unstale":"2023-10-08T07:10:01.721235+0000","last_undegraded":"2023-10-08T07:10:01.721235+0000","last_fullsized":"2023-10-08T07:10:01.721235+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2023-10-08T07:10:01.721055+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2023-10-08T07:10:01.721055+0000","last_clean_scrub_stamp":"2023-10-08T07:10:01.721055+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:38.621496+0000","scrub_duration":0.0061286539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"67'2932","reported_seq":3010,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:03.673316+0000","last_change":"2023-10-08T07:10:03.673316+0000","last_active":"2023-10-08T07:10:03.673316+0000","last_peered":"2023-10-08T07:10:03.673316+0000","last_clean":"2023-10-08T07:10:03.673316+0000","last_became_active":"2023-10-08T07:09:20.737258+0000","last_became_peered":"2023-10-08T07:09:20.737258+0000","last_unstale":"2023-10-08T07:10:03.673316+0000","last_undegraded":"2023-10-08T07:10:03.673316+0000","last_fullsized":"2023-10-08T07:10:03.673316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2932","last_scrub_stamp":"2023-10-08T07:10:03.673166+0000","last_deep_scrub":"67'2932","last_deep_scrub_stamp":"2023-10-08T07:10:03.673166+0000","last_clean_scrub_stamp":"2023-10-08T07:10:03.673166+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":0,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:45:38.773848+0000","scrub_duration":0.0023330069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8402,"num_write_kb":91872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:26.956810+0000","last_change":"2023-10-08T07:10:26.956867+0000","last_active":"2023-10-08T07:10:26.956810+0000","last_peered":"2023-10-08T07:10:26.956810+0000","last_clean":"2023-10-08T07:10:26.956810+0000","last_became_active":"2023-10-08T07:09:18.056686+0000","last_became_peered":"2023-10-08T07:09:18.056686+0000","last_unstale":"2023-10-08T07:10:26.956810+0000","last_undegraded":"2023-10-08T07:10:26.956810+0000","last_fullsized":"2023-10-08T07:10:26.956810+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2023-10-08T07:10:26.956714+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2023-10-08T07:10:26.956714+0000","last_clean_scrub_stamp":"2023-10-08T07:10:26.956714+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:41.451138+0000","scrub_duration":0.0040178289999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"67'2863","reported_seq":2958,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:29.956001+0000","last_change":"2023-10-08T07:10:29.956001+0000","last_active":"2023-10-08T07:10:29.956001+0000","last_peered":"2023-10-08T07:10:29.956001+0000","last_clean":"2023-10-08T07:10:29.956001+0000","last_became_active":"2023-10-08T07:05:33.320690+0000","last_became_peered":"2023-10-08T07:05:33.320690+0000","last_unstale":"2023-10-08T07:10:29.956001+0000","last_undegraded":"2023-10-08T07:10:29.956001+0000","last_fullsized":"2023-10-08T07:10:29.956001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2863","last_scrub_stamp":"2023-10-08T07:10:29.955814+0000","last_deep_scrub":"67'2863","last_deep_scrub_stamp":"2023-10-08T07:10:29.955814+0000","last_clean_scrub_stamp":"2023-10-08T07:10:29.955814+0000","objects_scrubbed":0,"log_size":2863,"log_dups_size":0,"ondisk_log_size":2863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:43.985949+0000","scrub_duration":0.0033374920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8399,"num_write_kb":39972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:35.385631+0000","last_change":"2023-10-08T07:11:35.385684+0000","last_active":"2023-10-08T07:11:35.385631+0000","last_peered":"2023-10-08T07:11:35.385631+0000","last_clean":"2023-10-08T07:11:35.385631+0000","last_became_active":"2023-10-08T07:05:32.320192+0000","last_became_peered":"2023-10-08T07:05:32.320192+0000","last_unstale":"2023-10-08T07:11:35.385631+0000","last_undegraded":"2023-10-08T07:11:35.385631+0000","last_fullsized":"2023-10-08T07:11:35.385631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:35.385522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:35.385522+0000","last_clean_scrub_stamp":"2023-10-08T07:11:35.385522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:23.756186+0000","scrub_duration":0.0018716589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2908","reported_seq":3002,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:51.177449+0000","last_change":"2023-10-08T07:09:51.177449+0000","last_active":"2023-10-08T07:09:51.177449+0000","last_peered":"2023-10-08T07:09:51.177449+0000","last_clean":"2023-10-08T07:09:51.177449+0000","last_became_active":"2023-10-08T07:05:33.327003+0000","last_became_peered":"2023-10-08T07:05:33.327003+0000","last_unstale":"2023-10-08T07:09:51.177449+0000","last_undegraded":"2023-10-08T07:09:51.177449+0000","last_fullsized":"2023-10-08T07:09:51.177449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2908","last_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_deep_scrub":"67'2908","last_deep_scrub_stamp":"2023-10-08T07:09:51.177304+0000","last_clean_scrub_stamp":"2023-10-08T07:09:51.177304+0000","objects_scrubbed":0,"log_size":2908,"log_dups_size":0,"ondisk_log_size":2908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:24.847471+0000","scrub_duration":0.0043549410000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'4","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:01.413711+0000","last_change":"2023-10-08T07:11:01.413760+0000","last_active":"2023-10-08T07:11:01.413711+0000","last_peered":"2023-10-08T07:11:01.413711+0000","last_clean":"2023-10-08T07:11:01.413711+0000","last_became_active":"2023-10-08T07:05:32.318852+0000","last_became_peered":"2023-10-08T07:05:32.318852+0000","last_unstale":"2023-10-08T07:11:01.413711+0000","last_undegraded":"2023-10-08T07:11:01.413711+0000","last_fullsized":"2023-10-08T07:11:01.413711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:11:01.413615+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:11:01.413615+0000","last_clean_scrub_stamp":"2023-10-08T07:11:01.413615+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:07.522439+0000","scrub_duration":0.0035531170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"67'5846","reported_seq":5940,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:58.877374+0000","last_change":"2023-10-08T07:09:58.877374+0000","last_active":"2023-10-08T07:09:58.877374+0000","last_peered":"2023-10-08T07:09:58.877374+0000","last_clean":"2023-10-08T07:09:58.877374+0000","last_became_active":"2023-10-08T07:05:33.327519+0000","last_became_peered":"2023-10-08T07:05:33.327519+0000","last_unstale":"2023-10-08T07:09:58.877374+0000","last_undegraded":"2023-10-08T07:09:58.877374+0000","last_fullsized":"2023-10-08T07:09:58.877374+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5846","last_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_deep_scrub":"67'5846","last_deep_scrub_stamp":"2023-10-08T07:09:58.877221+0000","last_clean_scrub_stamp":"2023-10-08T07:09:58.877221+0000","objects_scrubbed":0,"log_size":4246,"log_dups_size":1600,"ondisk_log_size":4246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:00.287679+0000","scrub_duration":0.0031762159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17039,"num_write_kb":80852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:34.990887+0000","last_change":"2023-10-08T07:10:34.990887+0000","last_active":"2023-10-08T07:10:34.990887+0000","last_peered":"2023-10-08T07:10:34.990887+0000","last_clean":"2023-10-08T07:10:34.990887+0000","last_became_active":"2023-10-08T07:05:32.320681+0000","last_became_peered":"2023-10-08T07:05:32.320681+0000","last_unstale":"2023-10-08T07:10:34.990887+0000","last_undegraded":"2023-10-08T07:10:34.990887+0000","last_fullsized":"2023-10-08T07:10:34.990887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:34.990723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:34.990723+0000","last_clean_scrub_stamp":"2023-10-08T07:10:34.990723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:34.260924+0000","scrub_duration":0.0019640790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:37.996096+0000","last_change":"2023-10-08T07:10:37.996151+0000","last_active":"2023-10-08T07:10:37.996096+0000","last_peered":"2023-10-08T07:10:37.996096+0000","last_clean":"2023-10-08T07:10:37.996096+0000","last_became_active":"2023-10-08T07:09:18.058021+0000","last_became_peered":"2023-10-08T07:09:18.058021+0000","last_unstale":"2023-10-08T07:10:37.996096+0000","last_undegraded":"2023-10-08T07:10:37.996096+0000","last_fullsized":"2023-10-08T07:10:37.996096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:37.995993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:37.995993+0000","last_clean_scrub_stamp":"2023-10-08T07:10:37.995993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:06.897411+0000","scrub_duration":0.0020275480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:06.723751+0000","last_change":"2023-10-08T07:11:06.723751+0000","last_active":"2023-10-08T07:11:06.723751+0000","last_peered":"2023-10-08T07:11:06.723751+0000","last_clean":"2023-10-08T07:11:06.723751+0000","last_became_active":"2023-10-08T07:09:17.752334+0000","last_became_peered":"2023-10-08T07:09:17.752334+0000","last_unstale":"2023-10-08T07:11:06.723751+0000","last_undegraded":"2023-10-08T07:11:06.723751+0000","last_fullsized":"2023-10-08T07:11:06.723751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:06.723539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:06.723539+0000","last_clean_scrub_stamp":"2023-10-08T07:11:06.723539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:55.594128+0000","scrub_duration":0.0018006879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"67'5831","reported_seq":5945,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:39.461118+0000","last_change":"2023-10-08T07:11:39.461170+0000","last_active":"2023-10-08T07:11:39.461118+0000","last_peered":"2023-10-08T07:11:39.461118+0000","last_clean":"2023-10-08T07:11:39.461118+0000","last_became_active":"2023-10-08T07:09:21.038687+0000","last_became_peered":"2023-10-08T07:09:21.038687+0000","last_unstale":"2023-10-08T07:11:39.461118+0000","last_undegraded":"2023-10-08T07:11:39.461118+0000","last_fullsized":"2023-10-08T07:11:39.461118+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5831","last_scrub_stamp":"2023-10-08T07:11:39.461014+0000","last_deep_scrub":"67'5831","last_deep_scrub_stamp":"2023-10-08T07:11:39.461014+0000","last_clean_scrub_stamp":"2023-10-08T07:11:39.461014+0000","objects_scrubbed":0,"log_size":4231,"log_dups_size":1600,"ondisk_log_size":4231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:37:39.747194+0000","scrub_duration":0.002811296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17160,"num_write_kb":81004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:45.649710+0000","last_change":"2023-10-08T07:10:45.649710+0000","last_active":"2023-10-08T07:10:45.649710+0000","last_peered":"2023-10-08T07:10:45.649710+0000","last_clean":"2023-10-08T07:10:45.649710+0000","last_became_active":"2023-10-08T07:09:17.754507+0000","last_became_peered":"2023-10-08T07:09:17.754507+0000","last_unstale":"2023-10-08T07:10:45.649710+0000","last_undegraded":"2023-10-08T07:10:45.649710+0000","last_fullsized":"2023-10-08T07:10:45.649710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:45.649532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:45.649532+0000","last_clean_scrub_stamp":"2023-10-08T07:10:45.649532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:26.132541+0000","scrub_duration":0.0019874580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"67'2846","reported_seq":2960,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:39.152468+0000","last_change":"2023-10-08T07:11:39.152515+0000","last_active":"2023-10-08T07:11:39.152468+0000","last_peered":"2023-10-08T07:11:39.152468+0000","last_clean":"2023-10-08T07:11:39.152468+0000","last_became_active":"2023-10-08T07:09:21.040021+0000","last_became_peered":"2023-10-08T07:09:21.040021+0000","last_unstale":"2023-10-08T07:11:39.152468+0000","last_undegraded":"2023-10-08T07:11:39.152468+0000","last_fullsized":"2023-10-08T07:11:39.152468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2846","last_scrub_stamp":"2023-10-08T07:11:39.152360+0000","last_deep_scrub":"67'2846","last_deep_scrub_stamp":"2023-10-08T07:11:39.152360+0000","last_clean_scrub_stamp":"2023-10-08T07:11:39.152360+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:49.012464+0000","scrub_duration":0.0021660099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8313,"num_write_kb":39572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:53.453369+0000","last_change":"2023-10-08T07:10:53.453369+0000","last_active":"2023-10-08T07:10:53.453369+0000","last_peered":"2023-10-08T07:10:53.453369+0000","last_clean":"2023-10-08T07:10:53.453369+0000","last_became_active":"2023-10-08T07:09:18.056495+0000","last_became_peered":"2023-10-08T07:09:18.056495+0000","last_unstale":"2023-10-08T07:10:53.453369+0000","last_undegraded":"2023-10-08T07:10:53.453369+0000","last_fullsized":"2023-10-08T07:10:53.453369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:53.453181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:53.453181+0000","last_clean_scrub_stamp":"2023-10-08T07:10:53.453181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:27.290354+0000","scrub_duration":0.002075145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:18.987348+0000","last_change":"2023-10-08T07:10:18.987348+0000","last_active":"2023-10-08T07:10:18.987348+0000","last_peered":"2023-10-08T07:10:18.987348+0000","last_clean":"2023-10-08T07:10:18.987348+0000","last_became_active":"2023-10-08T07:05:32.324441+0000","last_became_peered":"2023-10-08T07:05:32.324441+0000","last_unstale":"2023-10-08T07:10:18.987348+0000","last_undegraded":"2023-10-08T07:10:18.987348+0000","last_fullsized":"2023-10-08T07:10:18.987348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:18.987171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:18.987171+0000","last_clean_scrub_stamp":"2023-10-08T07:10:18.987171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:50.612213+0000","scrub_duration":0.0022629809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"67'5777","reported_seq":5861,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:25.718202+0000","last_change":"2023-10-08T07:10:25.718202+0000","last_active":"2023-10-08T07:10:25.718202+0000","last_peered":"2023-10-08T07:10:25.718202+0000","last_clean":"2023-10-08T07:10:25.718202+0000","last_became_active":"2023-10-08T07:09:20.734991+0000","last_became_peered":"2023-10-08T07:09:20.734991+0000","last_unstale":"2023-10-08T07:10:25.718202+0000","last_undegraded":"2023-10-08T07:10:25.718202+0000","last_fullsized":"2023-10-08T07:10:25.718202+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5777","last_scrub_stamp":"2023-10-08T07:10:25.718038+0000","last_deep_scrub":"67'5777","last_deep_scrub_stamp":"2023-10-08T07:10:25.718038+0000","last_clean_scrub_stamp":"2023-10-08T07:10:25.718038+0000","objects_scrubbed":0,"log_size":4177,"log_dups_size":1600,"ondisk_log_size":4177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:55:11.338172+0000","scrub_duration":0.0025969640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16939,"num_write_kb":80472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:17.091890+0000","last_change":"2023-10-08T07:11:17.091890+0000","last_active":"2023-10-08T07:11:17.091890+0000","last_peered":"2023-10-08T07:11:17.091890+0000","last_clean":"2023-10-08T07:11:17.091890+0000","last_became_active":"2023-10-08T07:05:27.292482+0000","last_became_peered":"2023-10-08T07:05:27.292482+0000","last_unstale":"2023-10-08T07:11:17.091890+0000","last_undegraded":"2023-10-08T07:11:17.091890+0000","last_fullsized":"2023-10-08T07:11:17.091890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:17.091711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:17.091711+0000","last_clean_scrub_stamp":"2023-10-08T07:11:17.091711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:12.124209+0000","scrub_duration":0.0021563580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:47.998055+0000","last_change":"2023-10-08T07:10:47.998055+0000","last_active":"2023-10-08T07:10:47.998055+0000","last_peered":"2023-10-08T07:10:47.998055+0000","last_clean":"2023-10-08T07:10:47.998055+0000","last_became_active":"2023-10-08T07:05:32.320250+0000","last_became_peered":"2023-10-08T07:05:32.320250+0000","last_unstale":"2023-10-08T07:10:47.998055+0000","last_undegraded":"2023-10-08T07:10:47.998055+0000","last_fullsized":"2023-10-08T07:10:47.998055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:47.997873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:47.997873+0000","last_clean_scrub_stamp":"2023-10-08T07:10:47.997873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:35.775296+0000","scrub_duration":0.0020812069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"67'2854","reported_seq":2969,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:31.102978+0000","last_change":"2023-10-08T07:11:31.102978+0000","last_active":"2023-10-08T07:11:31.102978+0000","last_peered":"2023-10-08T07:11:31.102978+0000","last_clean":"2023-10-08T07:11:31.102978+0000","last_became_active":"2023-10-08T07:09:21.038394+0000","last_became_peered":"2023-10-08T07:09:21.038394+0000","last_unstale":"2023-10-08T07:11:31.102978+0000","last_undegraded":"2023-10-08T07:11:31.102978+0000","last_fullsized":"2023-10-08T07:11:31.102978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2854","last_scrub_stamp":"2023-10-08T07:11:31.102824+0000","last_deep_scrub":"67'2854","last_deep_scrub_stamp":"2023-10-08T07:11:31.102824+0000","last_clean_scrub_stamp":"2023-10-08T07:11:31.102824+0000","objects_scrubbed":0,"log_size":2854,"log_dups_size":0,"ondisk_log_size":2854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:23.151603+0000","scrub_duration":0.002145068,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8504,"num_write_kb":40520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.424976+0000","last_change":"2023-10-08T07:10:36.424976+0000","last_active":"2023-10-08T07:10:36.424976+0000","last_peered":"2023-10-08T07:10:36.424976+0000","last_clean":"2023-10-08T07:10:36.424976+0000","last_became_active":"2023-10-08T07:09:18.067561+0000","last_became_peered":"2023-10-08T07:09:18.067561+0000","last_unstale":"2023-10-08T07:10:36.424976+0000","last_undegraded":"2023-10-08T07:10:36.424976+0000","last_fullsized":"2023-10-08T07:10:36.424976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:36.424768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:36.424768+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.424768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:46.936565+0000","scrub_duration":0.001635028,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:04.640857+0000","last_change":"2023-10-08T07:10:04.640857+0000","last_active":"2023-10-08T07:10:04.640857+0000","last_peered":"2023-10-08T07:10:04.640857+0000","last_clean":"2023-10-08T07:10:04.640857+0000","last_became_active":"2023-10-08T07:09:17.752438+0000","last_became_peered":"2023-10-08T07:09:17.752438+0000","last_unstale":"2023-10-08T07:10:04.640857+0000","last_undegraded":"2023-10-08T07:10:04.640857+0000","last_fullsized":"2023-10-08T07:10:04.640857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:04.640672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:04.640672+0000","last_clean_scrub_stamp":"2023-10-08T07:10:04.640672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:31:07.525494+0000","scrub_duration":0.002134164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"67'8813","reported_seq":8928,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:41.160365+0000","last_change":"2023-10-08T07:11:41.160365+0000","last_active":"2023-10-08T07:11:41.160365+0000","last_peered":"2023-10-08T07:11:41.160365+0000","last_clean":"2023-10-08T07:11:41.160365+0000","last_became_active":"2023-10-08T07:09:21.040156+0000","last_became_peered":"2023-10-08T07:09:21.040156+0000","last_unstale":"2023-10-08T07:11:41.160365+0000","last_undegraded":"2023-10-08T07:11:41.160365+0000","last_fullsized":"2023-10-08T07:11:41.160365+0000","mapping_epoch":77,"log_start":"56'4700","ondisk_log_start":"56'4700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8813","last_scrub_stamp":"2023-10-08T07:11:41.160199+0000","last_deep_scrub":"67'8813","last_deep_scrub_stamp":"2023-10-08T07:11:41.160199+0000","last_clean_scrub_stamp":"2023-10-08T07:11:41.160199+0000","objects_scrubbed":0,"log_size":4113,"log_dups_size":4700,"ondisk_log_size":4113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:53:04.959395+0000","scrub_duration":0.0021911629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25632,"num_write_kb":121484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:22.226159+0000","last_change":"2023-10-08T07:11:22.226159+0000","last_active":"2023-10-08T07:11:22.226159+0000","last_peered":"2023-10-08T07:11:22.226159+0000","last_clean":"2023-10-08T07:11:22.226159+0000","last_became_active":"2023-10-08T07:05:27.292797+0000","last_became_peered":"2023-10-08T07:05:27.292797+0000","last_unstale":"2023-10-08T07:11:22.226159+0000","last_undegraded":"2023-10-08T07:11:22.226159+0000","last_fullsized":"2023-10-08T07:11:22.226159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:22.225988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:22.225988+0000","last_clean_scrub_stamp":"2023-10-08T07:11:22.225988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:16.913069+0000","scrub_duration":0.001846252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"91'159","reported_seq":311,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:02.005133+0000","last_change":"2023-10-08T07:11:02.005133+0000","last_active":"2023-10-08T07:11:02.005133+0000","last_peered":"2023-10-08T07:11:02.005133+0000","last_clean":"2023-10-08T07:11:02.005133+0000","last_became_active":"2023-10-08T07:09:18.051456+0000","last_became_peered":"2023-10-08T07:09:18.051456+0000","last_unstale":"2023-10-08T07:11:02.005133+0000","last_undegraded":"2023-10-08T07:11:02.005133+0000","last_fullsized":"2023-10-08T07:11:02.005133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'159","last_scrub_stamp":"2023-10-08T07:11:02.004931+0000","last_deep_scrub":"91'159","last_deep_scrub_stamp":"2023-10-08T07:11:02.004931+0000","last_clean_scrub_stamp":"2023-10-08T07:11:02.004931+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:07.761573+0000","scrub_duration":0.0067731960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:14.490962+0000","last_change":"2023-10-08T07:10:14.490962+0000","last_active":"2023-10-08T07:10:14.490962+0000","last_peered":"2023-10-08T07:10:14.490962+0000","last_clean":"2023-10-08T07:10:14.490962+0000","last_became_active":"2023-10-08T07:09:18.049710+0000","last_became_peered":"2023-10-08T07:09:18.049710+0000","last_unstale":"2023-10-08T07:10:14.490962+0000","last_undegraded":"2023-10-08T07:10:14.490962+0000","last_fullsized":"2023-10-08T07:10:14.490962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:14.490798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:14.490798+0000","last_clean_scrub_stamp":"2023-10-08T07:10:14.490798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:50.710326+0000","scrub_duration":0.0018705449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"67'5798","reported_seq":5913,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:38.484457+0000","last_change":"2023-10-08T07:11:38.484457+0000","last_active":"2023-10-08T07:11:38.484457+0000","last_peered":"2023-10-08T07:11:38.484457+0000","last_clean":"2023-10-08T07:11:38.484457+0000","last_became_active":"2023-10-08T07:09:21.038785+0000","last_became_peered":"2023-10-08T07:09:21.038785+0000","last_unstale":"2023-10-08T07:11:38.484457+0000","last_undegraded":"2023-10-08T07:11:38.484457+0000","last_fullsized":"2023-10-08T07:11:38.484457+0000","mapping_epoch":77,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5798","last_scrub_stamp":"2023-10-08T07:11:38.484223+0000","last_deep_scrub":"67'5798","last_deep_scrub_stamp":"2023-10-08T07:11:38.484223+0000","last_clean_scrub_stamp":"2023-10-08T07:11:38.484223+0000","objects_scrubbed":0,"log_size":4198,"log_dups_size":1600,"ondisk_log_size":4198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:43:16.800596+0000","scrub_duration":0.0022464609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16800,"num_write_kb":79732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:14.101830+0000","last_change":"2023-10-08T07:11:14.101830+0000","last_active":"2023-10-08T07:11:14.101830+0000","last_peered":"2023-10-08T07:11:14.101830+0000","last_clean":"2023-10-08T07:11:14.101830+0000","last_became_active":"2023-10-08T07:09:18.051234+0000","last_became_peered":"2023-10-08T07:09:18.051234+0000","last_unstale":"2023-10-08T07:11:14.101830+0000","last_undegraded":"2023-10-08T07:11:14.101830+0000","last_fullsized":"2023-10-08T07:11:14.101830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:14.101622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:14.101622+0000","last_clean_scrub_stamp":"2023-10-08T07:11:14.101622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:57:42.163685+0000","scrub_duration":0.001960626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:46.124301+0000","last_change":"2023-10-08T07:11:46.124355+0000","last_active":"2023-10-08T07:11:46.124301+0000","last_peered":"2023-10-08T07:11:46.124301+0000","last_clean":"2023-10-08T07:11:46.124301+0000","last_became_active":"2023-10-08T07:09:25.035610+0000","last_became_peered":"2023-10-08T07:09:25.035610+0000","last_unstale":"2023-10-08T07:11:46.124301+0000","last_undegraded":"2023-10-08T07:11:46.124301+0000","last_fullsized":"2023-10-08T07:11:46.124301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'5","last_scrub_stamp":"2023-10-08T07:11:46.124187+0000","last_deep_scrub":"91'5","last_deep_scrub_stamp":"2023-10-08T07:11:46.124187+0000","last_clean_scrub_stamp":"2023-10-08T07:11:46.124187+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:48:31.704705+0000","scrub_duration":0.0036295310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1212,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:22.766221+0000","last_change":"2023-10-08T07:10:22.766221+0000","last_active":"2023-10-08T07:10:22.766221+0000","last_peered":"2023-10-08T07:10:22.766221+0000","last_clean":"2023-10-08T07:10:22.766221+0000","last_became_active":"2023-10-08T07:09:17.754733+0000","last_became_peered":"2023-10-08T07:09:17.754733+0000","last_unstale":"2023-10-08T07:10:22.766221+0000","last_undegraded":"2023-10-08T07:10:22.766221+0000","last_fullsized":"2023-10-08T07:10:22.766221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:22.766075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:22.766075+0000","last_clean_scrub_stamp":"2023-10-08T07:10:22.766075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:57.867526+0000","scrub_duration":0.0019628810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:59.746038+0000","last_change":"2023-10-08T07:09:59.746038+0000","last_active":"2023-10-08T07:09:59.746038+0000","last_peered":"2023-10-08T07:09:59.746038+0000","last_clean":"2023-10-08T07:09:59.746038+0000","last_became_active":"2023-10-08T07:09:17.754501+0000","last_became_peered":"2023-10-08T07:09:17.754501+0000","last_unstale":"2023-10-08T07:09:59.746038+0000","last_undegraded":"2023-10-08T07:09:59.746038+0000","last_fullsized":"2023-10-08T07:09:59.746038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:09:59.745834+0000","last_clean_scrub_stamp":"2023-10-08T07:09:59.745834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:05.711715+0000","scrub_duration":0.002070012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":107,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:31.391575+0000","last_change":"2023-10-08T07:10:31.391575+0000","last_active":"2023-10-08T07:10:31.391575+0000","last_peered":"2023-10-08T07:10:31.391575+0000","last_clean":"2023-10-08T07:10:31.391575+0000","last_became_active":"2023-10-08T07:09:18.055870+0000","last_became_peered":"2023-10-08T07:09:18.055870+0000","last_unstale":"2023-10-08T07:10:31.391575+0000","last_undegraded":"2023-10-08T07:10:31.391575+0000","last_fullsized":"2023-10-08T07:10:31.391575+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:31.391414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:31.391414+0000","last_clean_scrub_stamp":"2023-10-08T07:10:31.391414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:58.361849+0000","scrub_duration":0.001953729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:05.747198+0000","last_change":"2023-10-08T07:11:05.747198+0000","last_active":"2023-10-08T07:11:05.747198+0000","last_peered":"2023-10-08T07:11:05.747198+0000","last_clean":"2023-10-08T07:11:05.747198+0000","last_became_active":"2023-10-08T07:09:17.752476+0000","last_became_peered":"2023-10-08T07:09:17.752476+0000","last_unstale":"2023-10-08T07:11:05.747198+0000","last_undegraded":"2023-10-08T07:11:05.747198+0000","last_fullsized":"2023-10-08T07:11:05.747198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:05.747028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:05.747028+0000","last_clean_scrub_stamp":"2023-10-08T07:11:05.747028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:48.021225+0000","scrub_duration":0.0025933689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"91'4","reported_seq":112,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:11.279450+0000","last_change":"2023-10-08T07:11:11.279450+0000","last_active":"2023-10-08T07:11:11.279450+0000","last_peered":"2023-10-08T07:11:11.279450+0000","last_clean":"2023-10-08T07:11:11.279450+0000","last_became_active":"2023-10-08T07:09:18.058945+0000","last_became_peered":"2023-10-08T07:09:18.058945+0000","last_unstale":"2023-10-08T07:11:11.279450+0000","last_undegraded":"2023-10-08T07:11:11.279450+0000","last_fullsized":"2023-10-08T07:11:11.279450+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:11:11.279275+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:11:11.279275+0000","last_clean_scrub_stamp":"2023-10-08T07:11:11.279275+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:33.249103+0000","scrub_duration":0.0038380409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:38.461609+0000","last_change":"2023-10-08T07:10:38.461609+0000","last_active":"2023-10-08T07:10:38.461609+0000","last_peered":"2023-10-08T07:10:38.461609+0000","last_clean":"2023-10-08T07:10:38.461609+0000","last_became_active":"2023-10-08T07:09:18.056419+0000","last_became_peered":"2023-10-08T07:09:18.056419+0000","last_unstale":"2023-10-08T07:10:38.461609+0000","last_undegraded":"2023-10-08T07:10:38.461609+0000","last_fullsized":"2023-10-08T07:10:38.461609+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:10:38.461431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:10:38.461431+0000","last_clean_scrub_stamp":"2023-10-08T07:10:38.461431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:09.555421+0000","scrub_duration":0.001628572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"67'2903","reported_seq":2998,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:52.224944+0000","last_change":"2023-10-08T07:09:52.224944+0000","last_active":"2023-10-08T07:09:52.224944+0000","last_peered":"2023-10-08T07:09:52.224944+0000","last_clean":"2023-10-08T07:09:52.224944+0000","last_became_active":"2023-10-08T07:05:33.326951+0000","last_became_peered":"2023-10-08T07:05:33.326951+0000","last_unstale":"2023-10-08T07:09:52.224944+0000","last_undegraded":"2023-10-08T07:09:52.224944+0000","last_fullsized":"2023-10-08T07:09:52.224944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2903","last_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_deep_scrub":"67'2903","last_deep_scrub_stamp":"2023-10-08T07:09:52.224790+0000","last_clean_scrub_stamp":"2023-10-08T07:09:52.224790+0000","objects_scrubbed":0,"log_size":2903,"log_dups_size":0,"ondisk_log_size":2903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:46.117778+0000","scrub_duration":0.0028885249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8479,"num_write_kb":39996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:20.186536+0000","last_change":"2023-10-08T07:11:20.186536+0000","last_active":"2023-10-08T07:11:20.186536+0000","last_peered":"2023-10-08T07:11:20.186536+0000","last_clean":"2023-10-08T07:11:20.186536+0000","last_became_active":"2023-10-08T07:09:18.054306+0000","last_became_peered":"2023-10-08T07:09:18.054306+0000","last_unstale":"2023-10-08T07:11:20.186536+0000","last_undegraded":"2023-10-08T07:11:20.186536+0000","last_fullsized":"2023-10-08T07:11:20.186536+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T07:11:20.186375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T07:11:20.186375+0000","last_clean_scrub_stamp":"2023-10-08T07:11:20.186375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:34:43.779446+0000","scrub_duration":0.0022044709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"91'10","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:03.449648+0000","last_change":"2023-10-08T07:11:03.449648+0000","last_active":"2023-10-08T07:11:03.449648+0000","last_peered":"2023-10-08T07:11:03.449648+0000","last_clean":"2023-10-08T07:11:03.449648+0000","last_became_active":"2023-10-08T07:05:32.317353+0000","last_became_peered":"2023-10-08T07:05:32.317353+0000","last_unstale":"2023-10-08T07:11:03.449648+0000","last_undegraded":"2023-10-08T07:11:03.449648+0000","last_fullsized":"2023-10-08T07:11:03.449648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2023-10-08T07:11:03.449489+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2023-10-08T07:11:03.449489+0000","last_clean_scrub_stamp":"2023-10-08T07:11:03.449489+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:26.149116+0000","scrub_duration":0.003637454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"67'2894","reported_seq":2972,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:36.619759+0000","last_change":"2023-10-08T07:10:36.619759+0000","last_active":"2023-10-08T07:10:36.619759+0000","last_peered":"2023-10-08T07:10:36.619759+0000","last_clean":"2023-10-08T07:10:36.619759+0000","last_became_active":"2023-10-08T07:09:20.734910+0000","last_became_peered":"2023-10-08T07:09:20.734910+0000","last_unstale":"2023-10-08T07:10:36.619759+0000","last_undegraded":"2023-10-08T07:10:36.619759+0000","last_fullsized":"2023-10-08T07:10:36.619759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2894","last_scrub_stamp":"2023-10-08T07:10:36.619619+0000","last_deep_scrub":"67'2894","last_deep_scrub_stamp":"2023-10-08T07:10:36.619619+0000","last_clean_scrub_stamp":"2023-10-08T07:10:36.619619+0000","objects_scrubbed":0,"log_size":2894,"log_dups_size":0,"ondisk_log_size":2894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:03.016252+0000","scrub_duration":0.0024615819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:53.800170+0000","last_change":"2023-10-08T07:09:53.800170+0000","last_active":"2023-10-08T07:09:53.800170+0000","last_peered":"2023-10-08T07:09:53.800170+0000","last_clean":"2023-10-08T07:09:53.800170+0000","last_became_active":"2023-10-08T07:09:22.761943+0000","last_became_peered":"2023-10-08T07:09:22.761943+0000","last_unstale":"2023-10-08T07:09:53.800170+0000","last_undegraded":"2023-10-08T07:09:53.800170+0000","last_fullsized":"2023-10-08T07:09:53.800170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:09:53.799979+0000","last_clean_scrub_stamp":"2023-10-08T07:09:53.799979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:44:11.628567+0000","scrub_duration":0.0021863500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"67'2","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:29.686997+0000","last_change":"2023-10-08T07:11:29.686997+0000","last_active":"2023-10-08T07:11:29.686997+0000","last_peered":"2023-10-08T07:11:29.686997+0000","last_clean":"2023-10-08T07:11:29.686997+0000","last_became_active":"2023-10-08T07:09:24.732514+0000","last_became_peered":"2023-10-08T07:09:24.732514+0000","last_unstale":"2023-10-08T07:11:29.686997+0000","last_undegraded":"2023-10-08T07:11:29.686997+0000","last_fullsized":"2023-10-08T07:11:29.686997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:11:29.686827+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:11:29.686827+0000","last_clean_scrub_stamp":"2023-10-08T07:11:29.686827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:33:22.032611+0000","scrub_duration":0.0019020109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"91'3","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:43.436498+0000","last_change":"2023-10-08T07:11:43.436498+0000","last_active":"2023-10-08T07:11:43.436498+0000","last_peered":"2023-10-08T07:11:43.436498+0000","last_clean":"2023-10-08T07:11:43.436498+0000","last_became_active":"2023-10-08T07:09:23.063640+0000","last_became_peered":"2023-10-08T07:09:23.063640+0000","last_unstale":"2023-10-08T07:11:43.436498+0000","last_undegraded":"2023-10-08T07:11:43.436498+0000","last_fullsized":"2023-10-08T07:11:43.436498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2023-10-08T07:11:43.436324+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2023-10-08T07:11:43.436324+0000","last_clean_scrub_stamp":"2023-10-08T07:11:43.436324+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:58:16.950805+0000","scrub_duration":0.003718098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"67'5806","reported_seq":5900,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:25.908075+0000","last_change":"2023-10-08T07:10:25.908075+0000","last_active":"2023-10-08T07:10:25.908075+0000","last_peered":"2023-10-08T07:10:25.908075+0000","last_clean":"2023-10-08T07:10:25.908075+0000","last_became_active":"2023-10-08T07:05:33.323093+0000","last_became_peered":"2023-10-08T07:05:33.323093+0000","last_unstale":"2023-10-08T07:10:25.908075+0000","last_undegraded":"2023-10-08T07:10:25.908075+0000","last_fullsized":"2023-10-08T07:10:25.908075+0000","mapping_epoch":17,"log_start":"50'1600","ondisk_log_start":"50'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5806","last_scrub_stamp":"2023-10-08T07:10:25.907915+0000","last_deep_scrub":"67'5806","last_deep_scrub_stamp":"2023-10-08T07:10:25.907915+0000","last_clean_scrub_stamp":"2023-10-08T07:10:25.907915+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":1600,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:33.667782+0000","scrub_duration":0.0029813180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16980,"num_write_kb":80520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"91'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:58.746571+0000","last_change":"2023-10-08T07:10:58.746571+0000","last_active":"2023-10-08T07:10:58.746571+0000","last_peered":"2023-10-08T07:10:58.746571+0000","last_clean":"2023-10-08T07:10:58.746571+0000","last_became_active":"2023-10-08T07:09:17.752737+0000","last_became_peered":"2023-10-08T07:09:17.752737+0000","last_unstale":"2023-10-08T07:10:58.746571+0000","last_undegraded":"2023-10-08T07:10:58.746571+0000","last_fullsized":"2023-10-08T07:10:58.746571+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2023-10-08T07:10:58.746368+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2023-10-08T07:10:58.746368+0000","last_clean_scrub_stamp":"2023-10-08T07:10:58.746368+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:25:49.547384+0000","scrub_duration":0.0037535310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"67'2925","reported_seq":3019,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:36.417311+0000","last_change":"2023-10-08T07:11:36.417364+0000","last_active":"2023-10-08T07:11:36.417311+0000","last_peered":"2023-10-08T07:11:36.417311+0000","last_clean":"2023-10-08T07:11:36.417311+0000","last_became_active":"2023-10-08T07:05:33.322061+0000","last_became_peered":"2023-10-08T07:05:33.322061+0000","last_unstale":"2023-10-08T07:11:36.417311+0000","last_undegraded":"2023-10-08T07:11:36.417311+0000","last_fullsized":"2023-10-08T07:11:36.417311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2925","last_scrub_stamp":"2023-10-08T07:11:36.417193+0000","last_deep_scrub":"67'2925","last_deep_scrub_stamp":"2023-10-08T07:11:36.417193+0000","last_clean_scrub_stamp":"2023-10-08T07:11:36.417193+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:46.277296+0000","scrub_duration":0.0047613630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8450,"num_write_kb":40176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:18.452754+0000","last_change":"2023-10-08T07:10:18.452754+0000","last_active":"2023-10-08T07:10:18.452754+0000","last_peered":"2023-10-08T07:10:18.452754+0000","last_clean":"2023-10-08T07:10:18.452754+0000","last_became_active":"2023-10-08T07:09:18.056700+0000","last_became_peered":"2023-10-08T07:09:18.056700+0000","last_unstale":"2023-10-08T07:10:18.452754+0000","last_undegraded":"2023-10-08T07:10:18.452754+0000","last_fullsized":"2023-10-08T07:10:18.452754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-10-08T07:10:18.452579+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-10-08T07:10:18.452579+0000","last_clean_scrub_stamp":"2023-10-08T07:10:18.452579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:48:51.487483+0000","scrub_duration":0.0019171150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"67'5794","reported_seq":5881,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:00.754601+0000","last_change":"2023-10-08T07:10:00.754601+0000","last_active":"2023-10-08T07:10:00.754601+0000","last_peered":"2023-10-08T07:10:00.754601+0000","last_clean":"2023-10-08T07:10:00.754601+0000","last_became_active":"2023-10-08T07:09:20.733601+0000","last_became_peered":"2023-10-08T07:09:20.733601+0000","last_unstale":"2023-10-08T07:10:00.754601+0000","last_undegraded":"2023-10-08T07:10:00.754601+0000","last_fullsized":"2023-10-08T07:10:00.754601+0000","mapping_epoch":77,"log_start":"50'1700","ondisk_log_start":"50'1700","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'5794","last_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_deep_scrub":"67'5794","last_deep_scrub_stamp":"2023-10-08T07:10:00.754451+0000","last_clean_scrub_stamp":"2023-10-08T07:10:00.754451+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":1700,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:09:41.308685+0000","scrub_duration":0.0023848570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16878,"num_write_kb":80216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:06.392100+0000","last_change":"2023-10-08T07:10:06.392100+0000","last_active":"2023-10-08T07:10:06.392100+0000","last_peered":"2023-10-08T07:10:06.392100+0000","last_clean":"2023-10-08T07:10:06.392100+0000","last_became_active":"2023-10-08T07:05:32.318653+0000","last_became_peered":"2023-10-08T07:05:32.318653+0000","last_unstale":"2023-10-08T07:10:06.392100+0000","last_undegraded":"2023-10-08T07:10:06.392100+0000","last_fullsized":"2023-10-08T07:10:06.392100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2023-10-08T07:10:06.391949+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2023-10-08T07:10:06.391949+0000","last_clean_scrub_stamp":"2023-10-08T07:10:06.391949+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:18.322702+0000","scrub_duration":0.005184073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:17.009849+0000","last_change":"2023-10-08T07:10:17.009849+0000","last_active":"2023-10-08T07:10:17.009849+0000","last_peered":"2023-10-08T07:10:17.009849+0000","last_clean":"2023-10-08T07:10:17.009849+0000","last_became_active":"2023-10-08T07:05:33.317767+0000","last_became_peered":"2023-10-08T07:05:33.317767+0000","last_unstale":"2023-10-08T07:10:17.009849+0000","last_undegraded":"2023-10-08T07:10:17.009849+0000","last_fullsized":"2023-10-08T07:10:17.009849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2023-10-08T07:10:17.009657+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2023-10-08T07:10:17.009657+0000","last_clean_scrub_stamp":"2023-10-08T07:10:17.009657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:59:07.822088+0000","scrub_duration":0.0028116880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"67'8723","reported_seq":8818,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:10:35.984376+0000","last_change":"2023-10-08T07:10:35.984376+0000","last_active":"2023-10-08T07:10:35.984376+0000","last_peered":"2023-10-08T07:10:35.984376+0000","last_clean":"2023-10-08T07:10:35.984376+0000","last_became_active":"2023-10-08T07:05:33.323604+0000","last_became_peered":"2023-10-08T07:05:33.323604+0000","last_unstale":"2023-10-08T07:10:35.984376+0000","last_undegraded":"2023-10-08T07:10:35.984376+0000","last_fullsized":"2023-10-08T07:10:35.984376+0000","mapping_epoch":17,"log_start":"55'4500","ondisk_log_start":"55'4500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8723","last_scrub_stamp":"2023-10-08T07:10:35.984180+0000","last_deep_scrub":"67'8723","last_deep_scrub_stamp":"2023-10-08T07:10:35.984180+0000","last_clean_scrub_stamp":"2023-10-08T07:10:35.984180+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":4500,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:35:02.954615+0000","scrub_duration":0.0034636020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25537,"num_write_kb":121056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"67'2897","reported_seq":3012,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:38.120044+0000","last_change":"2023-10-08T07:11:38.120044+0000","last_active":"2023-10-08T07:11:38.120044+0000","last_peered":"2023-10-08T07:11:38.120044+0000","last_clean":"2023-10-08T07:11:38.120044+0000","last_became_active":"2023-10-08T07:09:21.034983+0000","last_became_peered":"2023-10-08T07:09:21.034983+0000","last_unstale":"2023-10-08T07:11:38.120044+0000","last_undegraded":"2023-10-08T07:11:38.120044+0000","last_fullsized":"2023-10-08T07:11:38.120044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2897","last_scrub_stamp":"2023-10-08T07:11:38.119890+0000","last_deep_scrub":"67'2897","last_deep_scrub_stamp":"2023-10-08T07:11:38.119890+0000","last_clean_scrub_stamp":"2023-10-08T07:11:38.119890+0000","objects_scrubbed":0,"log_size":2897,"log_dups_size":0,"ondisk_log_size":2897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:26.490554+0000","scrub_duration":0.0025913389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8508,"num_write_kb":40344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"67'3","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:04.731839+0000","last_change":"2023-10-08T07:11:04.731839+0000","last_active":"2023-10-08T07:11:04.731839+0000","last_peered":"2023-10-08T07:11:04.731839+0000","last_clean":"2023-10-08T07:11:04.731839+0000","last_became_active":"2023-10-08T07:09:17.753285+0000","last_became_peered":"2023-10-08T07:09:17.753285+0000","last_unstale":"2023-10-08T07:11:04.731839+0000","last_undegraded":"2023-10-08T07:11:04.731839+0000","last_fullsized":"2023-10-08T07:11:04.731839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2023-10-08T07:11:04.731603+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2023-10-08T07:11:04.731603+0000","last_clean_scrub_stamp":"2023-10-08T07:11:04.731603+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:54:15.076074+0000","scrub_duration":0.0027692070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"67'3","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:09:55.216924+0000","last_change":"2023-10-08T07:09:55.216924+0000","last_active":"2023-10-08T07:09:55.216924+0000","last_peered":"2023-10-08T07:09:55.216924+0000","last_clean":"2023-10-08T07:09:55.216924+0000","last_became_active":"2023-10-08T07:09:18.056402+0000","last_became_peered":"2023-10-08T07:09:18.056402+0000","last_unstale":"2023-10-08T07:09:55.216924+0000","last_undegraded":"2023-10-08T07:09:55.216924+0000","last_fullsized":"2023-10-08T07:09:55.216924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2023-10-08T07:09:55.216748+0000","last_clean_scrub_stamp":"2023-10-08T07:09:55.216748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:14.264100+0000","scrub_duration":0.001903205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"67'2906","reported_seq":2984,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T07:11:11.731360+0000","last_change":"2023-10-08T07:11:11.731360+0000","last_active":"2023-10-08T07:11:11.731360+0000","last_peered":"2023-10-08T07:11:11.731360+0000","last_clean":"2023-10-08T07:11:11.731360+0000","last_became_active":"2023-10-08T07:09:20.734644+0000","last_became_peered":"2023-10-08T07:09:20.734644+0000","last_unstale":"2023-10-08T07:11:11.731360+0000","last_undegraded":"2023-10-08T07:11:11.731360+0000","last_fullsized":"2023-10-08T07:11:11.731360+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2906","last_scrub_stamp":"2023-10-08T07:11:11.731149+0000","last_deep_scrub":"67'2906","last_deep_scrub_stamp":"2023-10-08T07:11:11.731149+0000","last_clean_scrub_stamp":"2023-10-08T07:11:11.731149+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":0,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:11.458600+0000","scrub_duration":0.002706651,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8483,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541581,"num_write_kb":2621106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148889,"ondisk_log_size":148889,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":256123,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":147,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":249558,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":512246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738452,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595760,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":594878,"kb_avail":93776080,"statfs":{"total":96636764160,"available":96026705920,"internally_reserved":0,"allocated":892928,"data_stored":376198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":609155527},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:11:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.60999999999999999,"15min":0.497},"min":{"1min":0.35799999999999998,"5min":0.188,"15min":0.188},"max":{"1min":0.60599999999999998,"5min":15.805999999999999,"15min":15.805999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.60899999999999999,"15min":0.50700000000000001},"min":{"1min":0.36899999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.629,"5min":13.827999999999999,"15min":13.827999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Sun Oct 8 07:11:19 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.60999999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64700000000000002,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53300000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483908,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":482174,"kb_avail":93887932,"statfs":{"total":96636764160,"available":96141242368,"internally_reserved":0,"allocated":1765376,"data_stored":1221467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":493746630},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 07:11:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.433,"15min":0.43099999999999999},"min":{"1min":0.35099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46700000000000003,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.53700000000000003}]},{"osd":2,"last update":"Sun Oct 8 07:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.51400000000000001},"min":{"1min":0.33100000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66900000000000004,"5min":6.0590000000000002,"15min":6.0590000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.503,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.182,"15min":0.182},"max":{"1min":0.69299999999999995,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.61199999999999999}]}]},{"osd":1,"up_from":74,"seq":317827579940,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":1712,"kb_used_omap":5,"kb_used_meta":63610,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":1753088,"data_stored":1220245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6000,"internal_metadata":65136784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 07:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.34000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.502},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.36099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.59199999999999997}]},{"osd":2,"last update":"Sun Oct 8 07:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.42299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65400000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.61399999999999999,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59899999999999998,"5min":3.048,"15min":3.048},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":256123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":254901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4406,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T07:12:08.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-08T07:12:09.017 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T07:12:09.017 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T07:12:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:12:09.394 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T07:05:32.716095+0000","modified":"2023-10-08T07:05:35.730191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6803/122402808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":122402808},{"type":"v1","addr":"172.21.15.17:6803","nonce":122402808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T07:12:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2023-10-08T07:12:09.408 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T07:12:09.790 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:12:09.790 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T07:05:32.716095+0000","modified":"2023-10-08T07:05:35.730191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6803/122402808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":122402808},{"type":"v1","addr":"172.21.15.17:6803","nonce":122402808}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T07:12:09.792 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2023-10-08T07:12:09.804 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T07:12:10.143 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-08T07:12:10.143 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":91,"fsid":"bb50b5dc-93de-4177-9c34-354ea3b007d0","created":"2023-10-08T07:05:10.233885+0000","modified":"2023-10-08T07:09:36.105827+0000","last_up_change":"2023-10-08T07:09:17.031827+0000","last_in_change":"2023-10-08T07:05:11.167705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T07:05:20.557481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-08T07:05:25.624853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-08T07:05:30.549393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-08T07:05:31.693934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ba776b12-56dd-4565-ab87-300e9dcd9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6801","nonce":1203223037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6803","nonce":1203223037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6807","nonce":1203223037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1203223037},{"type":"v1","addr":"172.21.15.33:6805","nonce":1203223037}]},"public_addr":"172.21.15.33:6801/1203223037","cluster_addr":"172.21.15.33:6803/1203223037","heartbeat_back_addr":"172.21.15.33:6807/1203223037","heartbeat_front_addr":"172.21.15.33:6805/1203223037","state":["exists","up"]},{"osd":1,"uuid":"69c35118-ff9d-4847-ba6c-37d3e9805dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":36,"up_from":74,"up_thru":81,"down_at":37,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6801","nonce":551235404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6803","nonce":551235404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6807","nonce":551235404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":551235404},{"type":"v1","addr":"172.21.15.86:6805","nonce":551235404}]},"public_addr":"172.21.15.86:6801/551235404","cluster_addr":"172.21.15.86:6803/551235404","heartbeat_back_addr":"172.21.15.86:6807/551235404","heartbeat_front_addr":"172.21.15.86:6805/551235404","state":["exists","up"]},{"osd":2,"uuid":"98332c95-54f9-4263-a295-d2a753d9f200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6801","nonce":3675215989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6803","nonce":3675215989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6807","nonce":3675215989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":3675215989},{"type":"v1","addr":"172.21.15.144:6805","nonce":3675215989}]},"public_addr":"172.21.15.144:6801/3675215989","cluster_addr":"172.21.15.144:6803/3675215989","heartbeat_back_addr":"172.21.15.144:6807/3675215989","heartbeat_front_addr":"172.21.15.144:6805/3675215989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.224774+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.302627+0000","dead_epoch":36},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T07:05:16.248056+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T07:12:10.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T07:12:10.542 INFO:tasks.ceph.mds.a.smithi017.stderr: -2276> 2023-10-08T07:05:37.418+0000 7f607837c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T07:12:10.545 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T07:12:10.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T07:12:10.570 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2023-10-08T07:12:11.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T07:12:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2023-10-08T07:12:12.565 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T07:12:13.557 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2023-10-08T07:12:13.571 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-08T07:12:13.571 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T07:12:13.572 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:12:13.581 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T07:12:13.581 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-08T07:12:13.581 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-08T07:12:13.581 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:12:13.657 INFO:tasks.ceph.osd.0:Stopped 2023-10-08T07:12:13.657 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-08T07:12:13.657 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:12:13.709 INFO:tasks.ceph.osd.1:Stopped 2023-10-08T07:12:13.709 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-08T07:12:13.709 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:12:13.761 INFO:tasks.ceph.osd.2:Stopped 2023-10-08T07:12:13.761 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-08T07:12:13.761 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-08T07:12:13.761 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:12:13.788 INFO:tasks.ceph.mgr.x:Stopped 2023-10-08T07:12:13.788 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-08T07:12:13.788 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:12:13.857 INFO:tasks.ceph.mgr.y:Stopped 2023-10-08T07:12:13.857 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-08T07:12:13.857 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-08T07:12:13.857 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:12:13.909 INFO:tasks.ceph.mon.a:Stopped 2023-10-08T07:12:13.909 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-08T07:12:13.909 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:12:13.961 INFO:tasks.ceph.mon.b:Stopped 2023-10-08T07:12:13.961 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-08T07:12:13.961 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T07:12:14.013 INFO:tasks.ceph.mon.c:Stopped 2023-10-08T07:12:14.013 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-08T07:12:14.013 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2023-10-08T07:12:14.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-08T07:12:14.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-08T07:12:14.091 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi033.front.sepia.ceph.com 2023-10-08T07:12:14.091 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-08T07:12:14.306 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi086.front.sepia.ceph.com 2023-10-08T07:12:14.306 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-08T07:12:14.505 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T07:12:14.505 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-08T07:12:14.727 INFO:tasks.ceph:Archiving mon data... 2023-10-08T07:12:14.728 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/data/mon.a.tgz 2023-10-08T07:12:14.729 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2023-10-08T07:12:14.749 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.GcIzuprF6I 2023-10-08T07:12:14.750 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GcIzuprF6I 2023-10-08T07:12:14.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.GcIzuprF6I 2023-10-08T07:12:15.009 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.GcIzuprF6I is 417KB 2023-10-08T07:12:15.106 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.GcIzuprF6I 2023-10-08T07:12:15.123 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/data/mon.b.tgz 2023-10-08T07:12:15.123 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2023-10-08T07:12:15.178 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.MpdGLbjWZ7 2023-10-08T07:12:15.179 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.MpdGLbjWZ7 2023-10-08T07:12:15.361 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.MpdGLbjWZ7 2023-10-08T07:12:15.448 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.MpdGLbjWZ7 is 576KB 2023-10-08T07:12:15.519 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.MpdGLbjWZ7 2023-10-08T07:12:15.535 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/data/mon.c.tgz 2023-10-08T07:12:15.535 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2023-10-08T07:12:15.591 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.E1ZX7pljKc 2023-10-08T07:12:15.592 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.E1ZX7pljKc 2023-10-08T07:12:15.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.E1ZX7pljKc 2023-10-08T07:12:15.863 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.E1ZX7pljKc is 576KB 2023-10-08T07:12:15.962 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.E1ZX7pljKc 2023-10-08T07:12:15.979 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-08T07:12:15.979 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T07:12:16.021 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T07:12:16.024 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T07:12:16.026 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T07:12:16.071 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-08T07:12:16.072 DEBUG:teuthology.orchestra.run.smithi017:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T07:12:16.090 DEBUG:teuthology.orchestra.run.smithi033:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T07:12:16.099 DEBUG:teuthology.orchestra.run.smithi086:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T07:12:16.102 DEBUG:teuthology.orchestra.run.smithi144:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T07:12:16.129 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T07:12:16.140 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T07:12:16.141 INFO:teuthology.orchestra.run.smithi144.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T07:12:16.146 INFO:teuthology.orchestra.run.smithi033.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T07:12:16.154 INFO:tasks.ceph:Archiving crash dumps... 2023-10-08T07:12:16.156 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/remote/smithi017/crash 2023-10-08T07:12:16.157 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T07:12:16.202 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/remote/smithi033/crash 2023-10-08T07:12:16.203 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T07:12:16.262 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/remote/smithi086/crash 2023-10-08T07:12:16.262 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T07:12:16.299 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/remote/smithi144/crash 2023-10-08T07:12:16.300 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T07:12:16.337 INFO:tasks.ceph:Compressing logs... 2023-10-08T07:12:16.337 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T07:12:16.340 DEBUG:teuthology.orchestra.run.smithi033:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T07:12:16.342 DEBUG:teuthology.orchestra.run.smithi086:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T07:12:16.345 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T07:12:16.378 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-08T07:12:16.379 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-08T07:12:16.379 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.972.log 2023-10-08T07:12:16.379 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.972.log.gz 2023-10-08T07:12:16.415 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97664.log 2023-10-08T07:12:16.415 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-08T07:12:16.415 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97620.log 2023-10-08T07:12:16.415 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.97664.log: gzip -5 --verbose /var/log/ceph/ceph-osd.2.log: -- /var/log/ceph/ceph-client.admin.97708.log 2023-10-08T07:12:16.416 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97664.log.gz 2023-10-08T07:12:16.416 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.97620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97620.log.gz 2023-10-08T07:12:16.416 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.97708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97708.log.gz 2023-10-08T07:12:16.458 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109325.log 2023-10-08T07:12:16.458 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109187.log 2023-10-08T07:12:16.458 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99227.log 2023-10-08T07:12:16.458 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109325.log.gz 2023-10-08T07:12:16.458 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103040.log 2023-10-08T07:12:16.458 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109187.log.gz 2023-10-08T07:12:16.459 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107986.log 2023-10-08T07:12:16.459 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99227.log.gz 2023-10-08T07:12:16.459 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98931.log 2023-10-08T07:12:16.459 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103040.log.gz 2023-10-08T07:12:16.459 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100043.log 2023-10-08T07:12:16.459 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107986.log.gz 2023-10-08T07:12:16.459 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106017.log 2023-10-08T07:12:16.459 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98931.log.gz 2023-10-08T07:12:16.459 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108170.log 2023-10-08T07:12:16.459 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100043.log.gz 2023-10-08T07:12:16.459 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110178.log 2023-10-08T07:12:16.460 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106017.log.gz 2023-10-08T07:12:16.460 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98137.log 2023-10-08T07:12:16.460 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108170.log.gz 2023-10-08T07:12:16.460 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98609.log 2023-10-08T07:12:16.460 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110178.log.gz 2023-10-08T07:12:16.460 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109517.log 2023-10-08T07:12:16.460 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98137.log.gz 2023-10-08T07:12:16.460 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98609.log.gz 2023-10-08T07:12:16.460 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97701.log 2023-10-08T07:12:16.460 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101671.log 2023-10-08T07:12:16.460 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109517.log.gz 2023-10-08T07:12:16.461 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97701.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.97701.log.gz 2023-10-08T07:12:16.461 INFO:teuthology.orchestra.run.smithi017.stderr:--verbose -- /var/log/ceph/ceph-client.admin.106230.log 2023-10-08T07:12:16.461 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98331.log 2023-10-08T07:12:16.461 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101671.log.gz 2023-10-08T07:12:16.461 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106230.log.gz 2023-10-08T07:12:16.461 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109701.log 2023-10-08T07:12:16.461 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98792.log 2023-10-08T07:12:16.461 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98331.log.gz 2023-10-08T07:12:16.461 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108635.log 2023-10-08T07:12:16.461 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109701.log.gz 2023-10-08T07:12:16.461 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106378.log 2023-10-08T07:12:16.461 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98792.log.gz 2023-10-08T07:12:16.462 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104325.log 2023-10-08T07:12:16.462 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108635.log.gz 2023-10-08T07:12:16.462 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104375.log 2023-10-08T07:12:16.462 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106378.log.gz 2023-10-08T07:12:16.462 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104325.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.95981.log 2023-10-08T07:12:16.462 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104325.log.gz 2023-10-08T07:12:16.462 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103607.log 2023-10-08T07:12:16.462 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104375.log.gz 2023-10-08T07:12:16.462 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.tmp-client.admin.95981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107391.log 2023-10-08T07:12:16.462 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.95981.log.gz 2023-10-08T07:12:16.462 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104279.log 2023-10-08T07:12:16.463 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103607.log.gz 2023-10-08T07:12:16.463 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100613.log 2023-10-08T07:12:16.463 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107391.log.gz 2023-10-08T07:12:16.463 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99951.log 2023-10-08T07:12:16.463 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104279.log.gz 2023-10-08T07:12:16.463 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100502.log 2023-10-08T07:12:16.463 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100613.log.gz 2023-10-08T07:12:16.464 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99951.log.gz 2023-10-08T07:12:16.464 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106904.log 2023-10-08T07:12:16.464 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108405.log 2023-10-08T07:12:16.464 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100502.log.gz 2023-10-08T07:12:16.464 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107294.log 2023-10-08T07:12:16.464 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106904.log.gz 2023-10-08T07:12:16.464 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108405.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T07:12:16.464 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108405.log.gz 2023-10-08T07:12:16.464 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107294.log.gz 2023-10-08T07:12:16.464 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98791.log 2023-10-08T07:12:16.465 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106767.log 2023-10-08T07:12:16.465 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101284.log 2023-10-08T07:12:16.465 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98791.log.gz 2023-10-08T07:12:16.465 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102943.log 2023-10-08T07:12:16.465 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106767.log.gz 2023-10-08T07:12:16.465 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.101284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100178.log 2023-10-08T07:12:16.465 INFO:teuthology.orchestra.run.smithi017.stderr: 33.3% -- replaced with /var/log/ceph/ceph-client.0.101284.log.gz 2023-10-08T07:12:16.465 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103997.log 2023-10-08T07:12:16.465 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102943.log.gz 2023-10-08T07:12:16.465 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99905.log 2023-10-08T07:12:16.465 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100178.log.gz 2023-10-08T07:12:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103997.log.gz 2023-10-08T07:12:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104893.log 2023-10-08T07:12:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100089.log 2023-10-08T07:12:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99905.log.gz 2023-10-08T07:12:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107599.log 2023-10-08T07:12:16.466 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104893.log.gz 2023-10-08T07:12:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108497.log 2023-10-08T07:12:16.466 INFO:teuthology.orchestra.run.smithi017.stderr: 94.7% -- replaced with /var/log/ceph/ceph.log.gz 48.6% 2023-10-08T07:12:16.466 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100089.log.gz 2023-10-08T07:12:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99161.log 2023-10-08T07:12:16.466 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107599.log.gz 2023-10-08T07:12:16.467 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101918.log 2023-10-08T07:12:16.467 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108497.log.gz 2023-10-08T07:12:16.467 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102748.log 2023-10-08T07:12:16.467 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99161.log.gz 2023-10-08T07:12:16.467 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107940.log 2023-10-08T07:12:16.467 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101918.log.gz 2023-10-08T07:12:16.467 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109655.log 2023-10-08T07:12:16.467 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102748.log.gz 2023-10-08T07:12:16.467 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98655.log 2023-10-08T07:12:16.467 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107940.log.gz 2023-10-08T07:12:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104139.log 2023-10-08T07:12:16.468 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109655.log.gz 2023-10-08T07:12:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98655.log.gz 2023-10-08T07:12:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108865.log 2023-10-08T07:12:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100500.log 2023-10-08T07:12:16.468 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104139.log.gz 2023-10-08T07:12:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98043.log 2023-10-08T07:12:16.468 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108865.log.gz 2023-10-08T07:12:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106276.log 2023-10-08T07:12:16.468 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100500.log.gz 2023-10-08T07:12:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97997.log 0.0% 2023-10-08T07:12:16.469 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98043.log.gz 2023-10-08T07:12:16.469 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103901.log 2023-10-08T07:12:16.469 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106276.log.gz 2023-10-08T07:12:16.469 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109842.log 2023-10-08T07:12:16.469 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97997.log.gz 2023-10-08T07:12:16.469 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105847.log 2023-10-08T07:12:16.469 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103901.log.gz 2023-10-08T07:12:16.469 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109942.log 2023-10-08T07:12:16.469 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109842.log.gz 2023-10-08T07:12:16.469 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109233.log 2023-10-08T07:12:16.469 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105847.log.gz 2023-10-08T07:12:16.469 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107204.log 2023-10-08T07:12:16.470 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109942.log.gz 2023-10-08T07:12:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109233.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-08T07:12:16.470 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109233.log.gz 2023-10-08T07:12:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101572.log 2023-10-08T07:12:16.470 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107204.log.gz 2023-10-08T07:12:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107250.log 2023-10-08T07:12:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110088.log 2023-10-08T07:12:16.470 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101572.log.gz 2023-10-08T07:12:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107250.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.107250.log.gz--verbose 2023-10-08T07:12:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:-- /var/log/ceph/ceph-client.admin.98517.log 2023-10-08T07:12:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102406.log 2023-10-08T07:12:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110088.log.gz 2023-10-08T07:12:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.98517.log: -- /var/log/ceph/ceph-client.admin.103228.log 2023-10-08T07:12:16.471 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98517.log.gz 2023-10-08T07:12:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98471.log 2023-10-08T07:12:16.471 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102406.log.gz 2023-10-08T07:12:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104421.log 2023-10-08T07:12:16.471 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103228.log.gz 2023-10-08T07:12:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102988.log 2023-10-08T07:12:16.471 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98471.log.gz 2023-10-08T07:12:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109796.log 2023-10-08T07:12:16.471 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104421.log.gz 2023-10-08T07:12:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102988.log.gz 2023-10-08T07:12:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103951.log 2023-10-08T07:12:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100270.log 2023-10-08T07:12:16.472 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109796.log.gz 2023-10-08T07:12:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99675.log 2023-10-08T07:12:16.472 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103951.log.gz 2023-10-08T07:12:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108267.log 2023-10-08T07:12:16.472 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100270.log.gz 2023-10-08T07:12:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103702.log 2023-10-08T07:12:16.472 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99675.log.gz 2023-10-08T07:12:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107883.log 2023-10-08T07:12:16.473 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108267.log.gz 2023-10-08T07:12:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104234.log 2023-10-08T07:12:16.473 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103702.log.gz 2023-10-08T07:12:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102139.log 2023-10-08T07:12:16.473 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107883.log.gz 2023-10-08T07:12:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108633.log 2023-10-08T07:12:16.473 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104234.log.gz 2023-10-08T07:12:16.473 INFO:teuthology.orchestra.run.smithi017.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-08T07:12:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106086.log 2023-10-08T07:12:16.473 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102139.log.gz 2023-10-08T07:12:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100827.log 2023-10-08T07:12:16.473 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108633.log.gz 2023-10-08T07:12:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103759.log 2023-10-08T07:12:16.474 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106086.log.gz 2023-10-08T07:12:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105467.log 2023-10-08T07:12:16.474 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100827.log.gz 2023-10-08T07:12:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102116.log 2023-10-08T07:12:16.474 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103759.log.gz 2023-10-08T07:12:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105084.log 2023-10-08T07:12:16.474 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105467.log.gz 2023-10-08T07:12:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108910.log 2023-10-08T07:12:16.474 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102116.log.gz 2023-10-08T07:12:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109003.log 2023-10-08T07:12:16.474 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105084.log.gz 2023-10-08T07:12:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105991.log 2023-10-08T07:12:16.475 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108910.log.gz 2023-10-08T07:12:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107111.log 2023-10-08T07:12:16.475 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109003.log.gz 2023-10-08T07:12:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99997.log 2023-10-08T07:12:16.475 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105991.log.gz 2023-10-08T07:12:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103656.log 2023-10-08T07:12:16.475 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107111.log.gz 2023-10-08T07:12:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99299.log 2023-10-08T07:12:16.475 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99997.log.gz 2023-10-08T07:12:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106135.log 2023-10-08T07:12:16.475 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103656.log.gz 2023-10-08T07:12:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97222.log 2023-10-08T07:12:16.476 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99299.log.gz 2023-10-08T07:12:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102897.log 2023-10-08T07:12:16.476 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106135.log.gz 2023-10-08T07:12:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102652.log 2023-10-08T07:12:16.476 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97222.log.gz 2023-10-08T07:12:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107649.log 2023-10-08T07:12:16.476 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102897.log.gz 2023-10-08T07:12:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102703.log 2023-10-08T07:12:16.476 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102652.log.gz 2023-10-08T07:12:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105178.log 2023-10-08T07:12:16.476 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107649.log.gz 2023-10-08T07:12:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109563.log 2023-10-08T07:12:16.477 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102703.log.gz 2023-10-08T07:12:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107001.log 2023-10-08T07:12:16.477 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105178.log.gz 2023-10-08T07:12:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106452.log 2023-10-08T07:12:16.477 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109563.log.gz 2023-10-08T07:12:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99537.log 2023-10-08T07:12:16.477 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107001.log.gz 2023-10-08T07:12:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110042.log 2023-10-08T07:12:16.477 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106452.log.gz 2023-10-08T07:12:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109279.log 2023-10-08T07:12:16.477 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99537.log.gz 2023-10-08T07:12:16.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101805.log 2023-10-08T07:12:16.478 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110042.log.gz 2023-10-08T07:12:16.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105133.log 2023-10-08T07:12:16.478 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109279.log.gz 2023-10-08T07:12:16.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109049.log 2023-10-08T07:12:16.478 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101805.log.gz 2023-10-08T07:12:16.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97767.log 2023-10-08T07:12:16.478 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105133.log.gz 2023-10-08T07:12:16.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102555.log 2023-10-08T07:12:16.478 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109049.log.gz 2023-10-08T07:12:16.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104749.log 2023-10-08T07:12:16.479 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97767.log.gz 2023-10-08T07:12:16.479 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103179.log 2023-10-08T07:12:16.479 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102555.log.gz 2023-10-08T07:12:16.479 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99629.log 2023-10-08T07:12:16.479 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104749.log.gz 2023-10-08T07:12:16.479 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109141.log 2023-10-08T07:12:16.479 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103179.log.gz 2023-10-08T07:12:16.479 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96963.log 2023-10-08T07:12:16.479 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99629.log.gz 2023-10-08T07:12:16.479 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97587.log 2023-10-08T07:12:16.479 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109141.log.gz 2023-10-08T07:12:16.479 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.96963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98885.log 2023-10-08T07:12:16.480 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96963.log.gz 2023-10-08T07:12:16.480 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110270.log 2023-10-08T07:12:16.480 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97587.log.gz 2023-10-08T07:12:16.480 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107837.log 2023-10-08T07:12:16.480 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98885.log.gz 2023-10-08T07:12:16.480 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106814.log 2023-10-08T07:12:16.480 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110270.log.gz 2023-10-08T07:12:16.480 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108772.log 2023-10-08T07:12:16.480 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107837.log.gz 2023-10-08T07:12:16.480 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106860.log 2023-10-08T07:12:16.480 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106814.log.gz 2023-10-08T07:12:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98185.log 2023-10-08T07:12:16.481 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108772.log.gz 2023-10-08T07:12:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98089.log 2023-10-08T07:12:16.481 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106860.log.gz 2023-10-08T07:12:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99046.log 2023-10-08T07:12:16.481 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98185.log.gz 2023-10-08T07:12:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102606.log 2023-10-08T07:12:16.481 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98089.log.gz 2023-10-08T07:12:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99046.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-08T07:12:16.481 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99046.log.gz 2023-10-08T07:12:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98379.log 2023-10-08T07:12:16.481 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102606.log.gz 2023-10-08T07:12:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108221.log 2023-10-08T07:12:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104185.log 2023-10-08T07:12:16.482 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98379.log.gz 2023-10-08T07:12:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109048.log 2023-10-08T07:12:16.482 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108221.log.gz 2023-10-08T07:12:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101416.log 2023-10-08T07:12:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104185.log.gz 2023-10-08T07:12:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98285.log 2023-10-08T07:12:16.482 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109048.log.gz 2023-10-08T07:12:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102481.log 2023-10-08T07:12:16.482 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101416.log.gz 2023-10-08T07:12:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101716.log 0.0% 2023-10-08T07:12:16.483 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98285.log.gz 2023-10-08T07:12:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110224.log 2023-10-08T07:12:16.483 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102481.log.gz 2023-10-08T07:12:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101716.log: 95.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T07:12:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.101716.log.gz-- 2023-10-08T07:12:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109747.log 2023-10-08T07:12:16.484 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101867.log 2023-10-08T07:12:16.484 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110224.log.gz 2023-10-08T07:12:16.484 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109747.log.gz 2023-10-08T07:12:16.484 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99437.log 2023-10-08T07:12:16.484 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99071.log 2023-10-08T07:12:16.485 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101867.log.gz 2023-10-08T07:12:16.485 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105896.log 2023-10-08T07:12:16.485 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99437.log.gz 2023-10-08T07:12:16.485 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110473.log 2023-10-08T07:12:16.485 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99071.log.gz 2023-10-08T07:12:16.485 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103486.log 2023-10-08T07:12:16.486 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105896.log.gz 2023-10-08T07:12:16.486 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103279.log 2023-10-08T07:12:16.486 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110473.log.gz 2023-10-08T07:12:16.486 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103806.log 2023-10-08T07:12:16.486 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103486.log.gz 2023-10-08T07:12:16.486 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98239.log 2023-10-08T07:12:16.486 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103279.log.gz 2023-10-08T07:12:16.487 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105657.log 2023-10-08T07:12:16.487 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103806.log.gz 2023-10-08T07:12:16.487 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103325.log 2023-10-08T07:12:16.487 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98239.log.gz 2023-10-08T07:12:16.487 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104467.log 2023-10-08T07:12:16.487 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105657.log.gz 2023-10-08T07:12:16.487 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110380.log 2023-10-08T07:12:16.488 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103325.log.gz 2023-10-08T07:12:16.488 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106716.log 2023-10-08T07:12:16.488 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104467.log.gz 2023-10-08T07:12:16.488 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108078.log 2023-10-08T07:12:16.488 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110380.log.gz 2023-10-08T07:12:16.488 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108771.log 2023-10-08T07:12:16.488 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106716.log.gz 2023-10-08T07:12:16.488 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106631.log 2023-10-08T07:12:16.489 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108078.log.gz 2023-10-08T07:12:16.489 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107505.log 2023-10-08T07:12:16.489 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108771.log.gz 2023-10-08T07:12:16.489 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99483.log 2023-10-08T07:12:16.489 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106631.log.gz 2023-10-08T07:12:16.489 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105228.log 2023-10-08T07:12:16.490 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107505.log.gz 2023-10-08T07:12:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99483.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.99483.log.gz--verbose -- /var/log/ceph/ceph-client.admin.105037.log 2023-10-08T07:12:16.490 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-10-08T07:12:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107341.log 2023-10-08T07:12:16.490 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105228.log.gz 2023-10-08T07:12:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99767.log 2023-10-08T07:12:16.490 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105037.log.gz 2023-10-08T07:12:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107341.log.gz 2023-10-08T07:12:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105512.log 2023-10-08T07:12:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103442.log 2023-10-08T07:12:16.490 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99767.log.gz 2023-10-08T07:12:16.491 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102361.log 2023-10-08T07:12:16.491 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105512.log.gz 2023-10-08T07:12:16.491 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108313.log 2023-10-08T07:12:16.491 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103442.log.gz 2023-10-08T07:12:16.491 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107024.log 2023-10-08T07:12:16.491 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102361.log.gz 2023-10-08T07:12:16.491 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106428.log 2023-10-08T07:12:16.491 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108313.log.gz 2023-10-08T07:12:16.491 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107758.log 2023-10-08T07:12:16.491 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107024.log.gz 2023-10-08T07:12:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110132.log 2023-10-08T07:12:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106428.log.gz 2023-10-08T07:12:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97633.log 2023-10-08T07:12:16.492 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107758.log.gz 2023-10-08T07:12:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106955.log 2023-10-08T07:12:16.492 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110132.log.gz 2023-10-08T07:12:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104843.log 2023-10-08T07:12:16.492 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97633.log.gz 2023-10-08T07:12:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102800.log 2023-10-08T07:12:16.492 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106955.log.gz 2023-10-08T07:12:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102310.log 2023-10-08T07:12:16.492 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104843.log.gz 2023-10-08T07:12:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105941.log 2023-10-08T07:12:16.493 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102800.log.gz 2023-10-08T07:12:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109988.log 2023-10-08T07:12:16.493 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102310.log.gz 2023-10-08T07:12:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99813.log 2023-10-08T07:12:16.493 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105941.log.gz 2023-10-08T07:12:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109988.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-08T07:12:16.493 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109988.log.gz 2023-10-08T07:12:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104916.log 2023-10-08T07:12:16.493 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99813.log.gz 2023-10-08T07:12:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100316.log 2023-10-08T07:12:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107554.log 2023-10-08T07:12:16.494 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104916.log.gz 2023-10-08T07:12:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106630.log 2023-10-08T07:12:16.494 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100316.log.gz 2023-10-08T07:12:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98930.log 2023-10-08T07:12:16.494 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107554.log.gz 2023-10-08T07:12:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98701.log 2023-10-08T07:12:16.494 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106630.log.gz 2023-10-08T07:12:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98930.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.98930.log.gz--verbose 2023-10-08T07:12:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:-- /var/log/ceph/ceph-client.admin.97188.log 2023-10-08T07:12:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108451.log 2023-10-08T07:12:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98701.log.gz 2023-10-08T07:12:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102264.log 2023-10-08T07:12:16.495 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97188.log.gz 2023-10-08T07:12:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108451.log.gz 2023-10-08T07:12:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100501.log 2023-10-08T07:12:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103857.log 2023-10-08T07:12:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102264.log.gz 2023-10-08T07:12:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99391.log 2023-10-08T07:12:16.495 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100501.log.gz 2023-10-08T07:12:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104988.log 2023-10-08T07:12:16.495 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103857.log.gz 2023-10-08T07:12:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108543.log 2023-10-08T07:12:16.495 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99391.log.gz 2023-10-08T07:12:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99721.log 2023-10-08T07:12:16.496 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104988.log.gz 2023-10-08T07:12:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109371.log 2023-10-08T07:12:16.496 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108543.log.gz 2023-10-08T07:12:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105584.log 2023-10-08T07:12:16.496 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99721.log.gz 2023-10-08T07:12:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99023.log 2023-10-08T07:12:16.496 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109371.log.gz 2023-10-08T07:12:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102015.log 2023-10-08T07:12:16.496 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105584.log.gz 2023-10-08T07:12:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99023.log.gz 2023-10-08T07:12:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-08T07:12:16.497 INFO:teuthology.orchestra.run.smithi017.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-08T07:12:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106181.log 2023-10-08T07:12:16.497 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102015.log.gz 2023-10-08T07:12:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99184.log 2023-10-08T07:12:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102213.log 2023-10-08T07:12:16.497 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106181.log.gz 2023-10-08T07:12:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108124.log 2023-10-08T07:12:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99184.log.gz 2023-10-08T07:12:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109609.log 2023-10-08T07:12:16.497 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102213.log.gz 2023-10-08T07:12:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108124.log.gz 2023-10-08T07:12:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100665.log 2023-10-08T07:12:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104536.log 2023-10-08T07:12:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109609.log.gz 2023-10-08T07:12:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99859.log 2023-10-08T07:12:16.498 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100665.log.gz 2023-10-08T07:12:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105372.log 2023-10-08T07:12:16.498 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104536.log.gz 2023-10-08T07:12:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99859.log.gz 2023-10-08T07:12:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102844.log 2023-10-08T07:12:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100224.log 2023-10-08T07:12:16.499 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105372.log.gz 2023-10-08T07:12:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105585.log 2023-10-08T07:12:16.499 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102844.log.gz 2023-10-08T07:12:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100224.log.gz 2023-10-08T07:12:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97951.log 2023-10-08T07:12:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105752.log 2023-10-08T07:12:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105585.log.gz 2023-10-08T07:12:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101768.log 2023-10-08T07:12:16.499 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97951.log.gz 2023-10-08T07:12:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105323.log 2023-10-08T07:12:16.500 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105752.log.gz 2023-10-08T07:12:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105418.log 2023-10-08T07:12:16.500 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101768.log.gz 2023-10-08T07:12:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105323.log.gz 2023-10-08T07:12:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102458.log 2023-10-08T07:12:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105418.log.gz 2023-10-08T07:12:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105706.log 2023-10-08T07:12:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97444.log 2023-10-08T07:12:16.500 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102458.log.gz 2023-10-08T07:12:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98563.log 2023-10-08T07:12:16.501 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105706.log.gz 2023-10-08T07:12:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103084.log 2023-10-08T07:12:16.501 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97444.log.gz 2023-10-08T07:12:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98793.log 2023-10-08T07:12:16.501 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98563.log.gz 2023-10-08T07:12:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100386.log 2023-10-08T07:12:16.502 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103084.log.gz 2023-10-08T07:12:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105273.log 2023-10-08T07:12:16.502 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98793.log.gz 2023-10-08T07:12:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.100386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99345.log 2023-10-08T07:12:16.502 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100386.log.gz 2023-10-08T07:12:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104798.log 2023-10-08T07:12:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105273.log.gz 2023-10-08T07:12:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106333.log 2023-10-08T07:12:16.503 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99345.log.gz 2023-10-08T07:12:16.503 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104798.log.gz 2023-10-08T07:12:16.503 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110316.log 2023-10-08T07:12:16.503 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-08T07:12:16.503 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.106333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106333.log.gz 2023-10-08T07:12:16.504 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104703.log 2023-10-08T07:12:16.504 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110316.log.gz 2023-10-08T07:12:16.504 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108773.log 2023-10-08T07:12:16.504 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107459.log 2023-10-08T07:12:16.504 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104703.log.gz 2023-10-08T07:12:16.504 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97859.log 2023-10-08T07:12:16.505 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108773.log.gz 2023-10-08T07:12:16.505 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104090.log 2023-10-08T07:12:16.505 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107459.log.gz 2023-10-08T07:12:16.505 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104044.log 2023-10-08T07:12:16.505 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97859.log.gz 2023-10-08T07:12:16.505 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98425.log 2023-10-08T07:12:16.506 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104090.log.gz 2023-10-08T07:12:16.506 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109417.log 2023-10-08T07:12:16.506 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104044.log.gz 2023-10-08T07:12:16.506 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.98425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98425.log.gz 2023-10-08T07:12:16.506 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101620.log 2023-10-08T07:12:16.506 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108359.log 2023-10-08T07:12:16.506 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109417.log.gz 2023-10-08T07:12:16.506 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103132.log 2023-10-08T07:12:16.507 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101620.log.gz 2023-10-08T07:12:16.507 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102060.log 2023-10-08T07:12:16.507 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108359.log.gz 2023-10-08T07:12:16.507 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.103132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103132.log.gz 2023-10-08T07:12:16.507 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104654.log 2023-10-08T07:12:16.507 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108634.log 2023-10-08T07:12:16.508 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.102060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102060.log.gz 2023-10-08T07:12:16.508 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104654.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-08T07:12:16.508 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104654.log.gz 2023-10-08T07:12:16.508 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104513.log 2023-10-08T07:12:16.508 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108634.log.gz 2023-10-08T07:12:16.508 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101964.log 2023-10-08T07:12:16.508 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104513.log.gz 2023-10-08T07:12:16.508 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107157.log 2023-10-08T07:12:16.508 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105801.log 2023-10-08T07:12:16.509 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.101964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101964.log.gz 2023-10-08T07:12:16.509 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.107157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108032.log 2023-10-08T07:12:16.509 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107157.log.gz 2023-10-08T07:12:16.509 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.105801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110427.log 2023-10-08T07:12:16.509 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105801.log.gz 2023-10-08T07:12:16.509 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99583.log 2023-10-08T07:12:16.509 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108032.log.gz 2023-10-08T07:12:16.509 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.110427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97524.log 2023-10-08T07:12:16.509 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110427.log.gz 2023-10-08T07:12:16.509 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.99583.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-08T07:12:16.509 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99583.log.gz 2023-10-08T07:12:16.509 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97905.log 2023-10-08T07:12:16.510 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97524.log.gz 2023-10-08T07:12:16.510 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104570.log 2023-10-08T07:12:16.510 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97905.log.gz 2023-10-08T07:12:16.510 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.104570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104570.log.gz 2023-10-08T07:12:16.510 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109896.log 2023-10-08T07:12:16.510 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108911.log 2023-10-08T07:12:16.510 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97813.log 2023-10-08T07:12:16.510 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109896.log.gz 2023-10-08T07:12:16.510 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.108911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108911.log.gz 2023-10-08T07:12:16.510 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.97813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97813.log.gz 2023-10-08T07:12:16.510 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109463.log 2023-10-08T07:12:16.511 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.109463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109463.log.gz 2023-10-08T07:12:16.511 INFO:teuthology.orchestra.run.smithi017.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-08T07:12:16.554 INFO:teuthology.orchestra.run.smithi017.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-08T07:12:16.587 INFO:teuthology.orchestra.run.smithi017.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-08T07:12:16.729 INFO:teuthology.orchestra.run.smithi017.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-08T07:12:16.731 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-10-08T07:12:16.731 INFO:teuthology.orchestra.run.smithi017.stderr:real 0m0.377s 2023-10-08T07:12:16.731 INFO:teuthology.orchestra.run.smithi017.stderr:user 0m0.737s 2023-10-08T07:12:16.732 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m0.123s 2023-10-08T07:12:17.240 INFO:teuthology.orchestra.run.smithi086.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-08T07:12:17.241 INFO:teuthology.orchestra.run.smithi086.stderr: 2023-10-08T07:12:17.241 INFO:teuthology.orchestra.run.smithi086.stderr:real 0m0.881s 2023-10-08T07:12:17.241 INFO:teuthology.orchestra.run.smithi086.stderr:user 0m0.839s 2023-10-08T07:12:17.241 INFO:teuthology.orchestra.run.smithi086.stderr:sys 0m0.039s 2023-10-08T07:12:19.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-08T07:12:19.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-08T07:12:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.0.log: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-08T07:12:39.647 INFO:teuthology.orchestra.run.smithi033.stderr: 2023-10-08T07:12:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:real 0m23.288s 2023-10-08T07:12:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:user 0m22.571s 2023-10-08T07:12:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:sys 0m0.690s 2023-10-08T07:12:41.159 INFO:teuthology.orchestra.run.smithi144.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-08T07:12:41.160 INFO:teuthology.orchestra.run.smithi144.stderr: 2023-10-08T07:12:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:real 0m24.763s 2023-10-08T07:12:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:user 0m23.902s 2023-10-08T07:12:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m0.830s 2023-10-08T07:12:41.162 INFO:tasks.ceph:Archiving logs... 2023-10-08T07:12:41.162 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/remote/smithi017/log 2023-10-08T07:12:41.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T07:12:41.499 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/remote/smithi033/log 2023-10-08T07:12:41.500 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T07:12:44.686 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/remote/smithi086/log 2023-10-08T07:12:44.687 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T07:12:44.875 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/remote/smithi144/log 2023-10-08T07:12:44.876 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T07:12:48.713 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T07:12:48.723 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T07:12:48.723 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T07:12:48.726 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T07:12:48.728 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T07:12:48.731 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T07:12:48.862 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T07:12:48.871 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T07:12:48.872 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T07:12:48.875 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T07:12:48.877 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T07:12:48.880 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T07:12:48.891 INFO:teuthology.orchestra.run.smithi017.stderr:bash: ntpq: command not found 2023-10-08T07:12:48.899 INFO:teuthology.orchestra.run.smithi033.stderr:bash: ntpq: command not found 2023-10-08T07:12:48.900 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T07:12:48.900 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2023-10-08T07:12:48.900 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 40 -1093us[-1083us] +/- 76ms 2023-10-08T07:12:48.900 INFO:teuthology.orchestra.run.smithi033.stdout:^* hv02.front.sepia.ceph.com 3 6 377 37 +316us[ +325us] +/- 77ms 2023-10-08T07:12:48.900 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +720us[ +730us] +/- 60ms 2023-10-08T07:12:48.900 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:12:48.901 INFO:teuthology.orchestra.run.smithi144.stderr:bash: ntpq: command not found 2023-10-08T07:12:48.902 INFO:teuthology.orchestra.run.smithi086.stderr:bash: ntpq: command not found 2023-10-08T07:12:48.904 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T07:12:48.904 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2023-10-08T07:12:48.904 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 38 -1102us[-1102us] +/- 76ms 2023-10-08T07:12:48.904 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv02.front.sepia.ceph.com 3 6 377 38 +281us[ +365us] +/- 77ms 2023-10-08T07:12:48.904 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 +706us[ +706us] +/- 60ms 2023-10-08T07:12:48.904 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:12:48.905 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T07:12:48.905 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2023-10-08T07:12:48.905 INFO:teuthology.orchestra.run.smithi086.stdout:^* hv01.front.sepia.ceph.com 2 6 177 2 -1136us[-1040us] +/- 77ms 2023-10-08T07:12:48.906 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 1 +261us[ +261us] +/- 77ms 2023-10-08T07:12:48.906 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 1 +693us[ +693us] +/- 61ms 2023-10-08T07:12:48.906 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:12:48.908 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T07:12:48.908 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-10-08T07:12:48.908 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 39 -1106us[-1102us] +/- 76ms 2023-10-08T07:12:48.908 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv02.front.sepia.ceph.com 3 6 377 38 +290us[ +294us] +/- 77ms 2023-10-08T07:12:48.908 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +720us[ +724us] +/- 60ms 2023-10-08T07:12:48.909 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T07:12:48.909 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T07:12:48.919 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T07:12:48.919 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T07:12:48.931 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T07:12:49.053 DEBUG:teuthology.orchestra.run.smithi033:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T07:12:49.158 DEBUG:teuthology.orchestra.run.smithi086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T07:12:49.326 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T07:12:49.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T07:12:49.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:12:49.468 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T07:12:49.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:12:49.506 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T07:12:49.541 INFO:teuthology.orchestra.run.smithi086.stdout:type=AVC msg=audit(1696748941.884:45): avc: denied { node_bind } for pid=3838 comm="ping" saddr=172.21.15.86 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1 2023-10-08T07:12:49.541 DEBUG:teuthology.task.selinux:ubuntu@smithi086.front.sepia.ceph.com has 1 denials 2023-10-08T07:12:49.542 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T07:12:49.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:12:49.575 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi086.front.sepia.ceph.com: ['type=AVC msg=audit(1696748941.884:45): avc: denied { node_bind } for pid=3838 comm="ping" saddr=172.21.15.86 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2023-10-08T07:12:49.576 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T07:12:49.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T07:12:49.597 INFO:teuthology.task.internal:Duration was 1192.109493 seconds 2023-10-08T07:12:49.597 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T07:12:49.607 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T07:12:49.607 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T07:12:49.610 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T07:12:49.612 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T07:12:49.615 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T07:12:49.662 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T07:12:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T07:12:49.665 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T07:12:49.688 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T07:12:50.043 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T07:12:50.043 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2023-10-08T07:12:50.043 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T07:12:50.070 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2023-10-08T07:12:50.070 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T07:12:50.097 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2023-10-08T07:12:50.097 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T07:12:50.120 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T07:12:50.121 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T07:12:50.143 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T07:12:50.143 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T07:12:50.146 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T07:12:50.149 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T07:12:50.164 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T07:12:50.227 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T07:12:50.227 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T07:12:50.230 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T07:12:50.232 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T07:12:50.236 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T07:12:50.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T07:12:50.324 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T07:12:50.325 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T07:12:50.360 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T07:12:50.400 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T07:12:50.427 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T07:12:50.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T07:12:50.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:12:50.504 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:12:50.506 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:12:50.508 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:12:50.530 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2023-10-08T07:12:50.532 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2023-10-08T07:12:50.533 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2023-10-08T07:12:50.550 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2023-10-08T07:12:50.585 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:12:50.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:12:50.603 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:12:50.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:12:50.643 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:12:50.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:12:50.659 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T07:12:50.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:12:50.676 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T07:12:50.686 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T07:12:50.687 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/remote/smithi017 2023-10-08T07:12:50.687 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T07:12:50.728 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/remote/smithi033 2023-10-08T07:12:50.729 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T07:12:50.771 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/remote/smithi086 2023-10-08T07:12:50.772 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T07:12:50.809 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414/remote/smithi144 2023-10-08T07:12:50.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T07:12:50.848 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T07:12:50.849 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T07:12:50.851 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T07:12:50.854 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T07:12:50.858 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T07:12:50.899 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T07:12:50.920 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T07:12:50.920 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T07:12:50.931 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T07:12:50.932 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T07:12:50.934 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T07:12:50.936 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T07:12:50.939 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T07:12:50.949 INFO:teuthology.orchestra.run.smithi017.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 07:12 /home/ubuntu/cephtest 2023-10-08T07:12:50.952 INFO:teuthology.orchestra.run.smithi033.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 07:12 /home/ubuntu/cephtest 2023-10-08T07:12:50.952 INFO:teuthology.orchestra.run.smithi086.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 07:12 /home/ubuntu/cephtest 2023-10-08T07:12:50.955 INFO:teuthology.orchestra.run.smithi144.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 07:12 /home/ubuntu/cephtest 2023-10-08T07:12:50.956 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T07:12:50.967 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T07:12:50.979 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi086.front.sepia.ceph.com: ['type=AVC msg=audit(1696748941.884:45): avc: denied { node_bind } for pid=3838 comm="ping" saddr=172.21.15.86 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2023-10-08T07:12:50.980 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T07:12:51.007 DEBUG:teuthology.nuke:shortname: smithi017 2023-10-08T07:12:51.008 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T07:12:51.032 DEBUG:teuthology.nuke:shortname: smithi033 2023-10-08T07:12:51.033 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T07:12:51.037 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:47:34.430942', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T07:12:51.056 DEBUG:teuthology.nuke:shortname: smithi086 2023-10-08T07:12:51.056 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T07:12:51.063 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:47:34.432359', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T07:12:51.079 DEBUG:teuthology.nuke:shortname: smithi144 2023-10-08T07:12:51.079 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T07:12:51.085 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:47:34.433498', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T07:12:51.095 INFO:teuthology.orchestra.console.smithi017:Power off 2023-10-08T07:12:51.095 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T07:12:51.107 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:08:36-powercycle-main-distro-default-smithi/7417414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 06:47:34.434637', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T07:12:51.115 INFO:teuthology.orchestra.console.smithi033:Power off 2023-10-08T07:12:51.115 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T07:12:51.131 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-10-08T07:12:51.131 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:12:51.143 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-10-08T07:12:51.143 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:12:51.160 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-08T07:12:51.170 INFO:teuthology.orchestra.console.smithi086:Power off 2023-10-08T07:12:51.170 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T07:12:51.183 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-08T07:12:51.193 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-10-08T07:12:51.193 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:12:51.214 INFO:teuthology.orchestra.console.smithi144:Power off 2023-10-08T07:12:51.215 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T07:12:51.226 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-10-08T07:12:51.241 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-10-08T07:12:51.241 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:12:51.266 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-08T07:12:55.162 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:12:55.185 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:12:55.228 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:12:55.267 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:12:55.279 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-08T07:12:55.294 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-08T07:12:55.338 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-10-08T07:12:55.379 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-08T07:12:59.281 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:12:59.295 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:12:59.339 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:12:59.380 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:12:59.391 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-08T07:12:59.405 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-08T07:12:59.449 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-10-08T07:12:59.491 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-10-08T07:12:59.492 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-10-08T07:12:59.592 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-10-08T07:13:03.410 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:13:03.450 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T07:13:03.520 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-08T07:13:03.561 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-10-08T07:13:03.622 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-10-08T07:13:03.662 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-10-08T07:13:03.767 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} duration: 1192.1094925403595 failure_reason: 'SELinux denials found on ubuntu@smithi086.front.sepia.ceph.com: [''type=AVC msg=audit(1696748941.884:45): avc: denied { node_bind } for pid=3838 comm="ping" saddr=172.21.15.86 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'']' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-10-08T07:13:03.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T07:13:03.840 INFO:teuthology.run:FAIL